Computational social science case study

How does support unfold in Reddit conversations?

This project studies online support as an interaction: what the original poster appears to need, how commenters respond, and whether the original poster comes back with gratitude, elaboration, questions, or pushback.

2,765 annotated interaction units
24 support and advice subreddits
3 annotation layers
Human audit used to refine prompts and labels

Project Snapshot

Research question

Do support responses fit what posters are asking for, and does that fit predict more positive original-poster uptake?

Data

A stratified sample of Reddit post-comment-OP reply units from support and advice communities.

Methods

LLM-assisted annotation, human-in-the-loop validation, LIWC checks, and mixed-effects modeling.

Core finding

Responses often tracked the poster's needs, and better-matched support was associated with OP gratitude and elaboration.

Core Idea

What constitutes successful social support online? Rather than treating empathic support as a property of one comment in isolation, this project models support as a three-part exchange.

1

What did the OP seek?

Advice, emotional disclosure, validation, sense-making, high-stakes help, or another support need.

2

How did commenters respond?

Validation, interpretation, emotional acknowledgment, advice, questions, self-disclosure, or challenge.

3

How did the OP respond?

Gratitude, elaboration, answering a question, follow-up questions, or pushback.

Interactive Sankey chart from the analysis report, showing how support-seeking needs connect to response strategies and OP uptake in the annotated sample.

LLM Annotation Workflow

The main methodological contribution is a human-in-the-loop annotation workflow for complex social interaction data. I used the LLM to scale annotation, but kept the codebook, validation, and interpretation grounded in social support theory and human review.

Raw conversationsReddit posts, level-1 comments, and OP replies
Stratified samplingOP-replied, high-engagement, question-like, and information-rich cases
Codebook designSupport-seeking needs, response strategies, and OP uptake
GPT-5-mini annotationMulti-label codes for each interaction unit
Human auditManual checks against a gold-standard subset
Modeling and visualizationMixed-effects models, LIWC checks, and communication figures
Annotation layer What it captures Example labels
Support-seeking needs What kind of response the original post appears to invite. Advice, emotional disclosure, validation/appraisal, sense-making.
Comment strategies What the level-1 reply does in response to the OP. Validation, emotional acknowledgment, interpretation, question, advice, self-disclosure.
OP uptake How the original poster responds when they return to the thread. Gratitude, elaboration, answering, follow-up question, pushback.

Key Findings

Finding 1

Commenters responded to what posters appeared to seek.

Advice-seeking posts received more advice, emotional disclosure received more acknowledgment and validation, and sense-making posts received more interpretation and questions.

Finding 2

Different response strategies predicted different OP reactions.

Questions predicted answering and elaboration; validation was associated with gratitude and lower pushback; challenge predicted pushback.

Finding 3

Better-matched support predicted OP uptake.

Specific forms of need-response fit were associated with how original posters replied, especially gratitude, elaboration, and pushback.

Mixed-effects model coefficients showing support-seeking needs predicting comment response strategies
Mixed-effects models showed theoretically coherent links between support-seeking needs and response strategies.
Mixed-effects model coefficients showing comment response strategies predicting original-poster uptake
Response strategies predicted different forms of OP uptake, including answering questions, elaboration, gratitude, and pushback.
Mixed-effects model odds ratios showing need-response fit predicting original-poster uptake
Specific need-response fit indicators predicted OP uptake, helping distinguish different forms of support attunement.
LIWC language profiles by comment response move
LIWC profiles provided a descriptive construct check on the LLM-coded response strategies.

Modeling Details

Statistical approach

I used logistic mixed-effects models where feasible, accounting for clustering among comments within posts and subreddits. Models tested whether support-seeking needs predicted response strategies, whether response strategies predicted OP uptake, and whether specific need-response fit indicators predicted uptake.

Interpretation note

The sample was intentionally enriched for OP replies, gratitude-like uptake, high engagement, question-like comments, and information-rich cases. Findings should be read as patterns within annotated support interactions, not population prevalence estimates for Reddit overall.

Contribution and Next Steps

Recent work has identified the linguistic markers of successful support (Munin et al., 2025) and the templates people use to express empathy, such as validation, paraphrasing, informational guidance (Gueorguieva et al., 2026), and has examined how social support is received by the support-seeker and their community (Alghamdi et al., 2025)

However, when people seek support online, they are not all asking for the same thing: some want advice, validation, sensemaking, or space to disclose emotion. We know less about whether support providers adapt these tactics to what the seeker appears to need, and whether this fit predicts how support is received.

This project helps bridge this gap by simultaneously modeling three components of online social support: what the OP appears to seek, what the commenter provides, and how the OP responds. This makes it possible to study support fit rather than treating empathy as a stand-alone property of a single reply.

The next research step is to finish the remaining annotations, expand the human validation sample, and decide which labels are reliable enough for final confirmatory analyses. For the public website, the next design step is to refine the interactive flow visualization and add a short de-identified example explorer that shows how one post-comment-reply unit receives its labels.

References

Alghamdi, Z., Kumarage, T., Agrawal, G., Karami, M., Almuteb, I., & Liu, H. (2025). RedditESS: A Mental Health Social Support Interaction Dataset – Understanding Effective Social Support to Refine AI-Driven Support Tools. arXiv. https://arxiv.org/abs/2503.21888

Gueorguieva, E., Zhan, H., Suh, J., Hernandez, J., Lau, T., Li, J. J., & Ong, D. C. (2026). AI generates well-liked but templatic empathic responses. arXiv. https://arxiv.org/abs/2604.08479

Munin, S., Jurkiewicz, O., Gueorguieva, E. S., Oveis, C., & Ong, D. C. (2025). What can I say to help you? Language associated with successful extrinsic emotion regulation. Emotion.