Early Linguistic Pattern of Anxiety from Social Media Using Interpretable Linguistic Features: A Multi-Faceted Validation Study with Author-Disjoint Evaluation

Arnab Das Utsa · 2026

Read Early Linguistic Pattern of Anxiety from Social Media Using Interpretable Linguistic Features: A Multi-Faceted Validation Study with Author-Disjoint Evaluation by Arnab Das Utsa (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2601-11758.txt.

Introduction

Arnab Das Utsa studies early signs of anxiety in posts on social media. Anxiety touches a vast share of people round the world. Yet large scale checks for it stay rare. Word use in posts may give a cheap way to spot risk at scale. His method rests on word traits that a human can read and check. He tests it with care for word bias and for clean splits of users. Tests cross more than one data set and domain.

Catalog record

CREATORArnab Das Utsa
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE60 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2601-11758

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Early Linguistic Pattern of Anxiety from Social Media Using Interpretable Linguistic Features: A Multi-Faceted Validation Study with Author-Disjoint Evaluation Arnab Das Utsa Abstract Anxiety affects hundreds of millions of individuals globally, yet large-scale screening remains limited. Social media language provides an opportunity for scalable detection, but current models often lack interpretability, keyword-robustness validation, and rigorous user-level data integrity. This work presents a transparent approach to social media-based anxiety detection through linguistically interpretable feature-grounded modeling and cross-domain validation. Using a substantial dataset of Reddit posts, we trained a logistic regression classifier on carefully curated subreddits for training, validation, and test splits. Comprehensive evaluation included feature ablation, keyword masking experiments, and varying-density difference analyses comparing anxious and control groups, along with external validation using clinically interviewed participants with diagnosed anxiety disorders. The model achieved strong performance while maintaining high accuracy even after sentiment removal or keyword masking. Early detection using minimal post history significantly outperformed random classification, and cross-domain analysis demonstrated strong consistency with clinical interview data. Results indicate that transparent linguistic features can support reliable, generalizable, and keyword-robust anxiety detection. The proposed framework provides a reproducible baseline for interpretable mental health screening across diverse online contexts. Keywords: anxiety detection, linguistic pattern, interpretable machine learning, keyword robustness, cross-domain validation, author-disjoint evaluation, mental health screening 1 Introduction 1.1 Background and Motivation Anxiety disorders are the most common mental health conditions worldwide, affecting over 284 million people. Even though they are so widespread, more than half of those with anxiety are never formally diagnosed [ 2 ] . Factors like long wait times, limited access to clinicians, financial barriers, and stigma make it harder for people to get diagnosed. Traditional assessments, such as clinical interviews and questionnaires like the GAD-7, require direct contact with trained professionals. As a result, many people are not identified until their symptoms have become much worse. At the same time, millions of people use online platforms to talk about their mental health before seeking clinical help. For example, Reddit is a place where users share their symptoms, frustrations, and coping strategies in communities like r/Anxiety and r/socialanxiety [ 3 ] . These posts offer valuable insights into how people express psychological distress in their own words and over time. Advances in natural language processing (NLP) show that language patterns can reveal important psychological signals, which means computational tools could help identify people who might need mental health support earlier [ 4 ] . Even with recent progress, current NLP methods still face important challenges. Many systems use black-box models like deep neural networks and transformers, which can predict well but are hard to interpret. This lack of transparency makes it difficult to trust these models and slows their use in clinical settings [ 5 ] . Also, some models rely too much on disorder-specific keywords, so they may just pick up on words like “anxiety” instead of deeper language patterns linked to the condition [ 6 ] . Another issue is generalizability: models trained on one platform, like Twitter or Reddit, may not work as well in other settings, such as clinical interviews [ 7 ] . Finally, many earlier studies did not use author-disjoint evaluation, which can lead to data leakage. This means models might learn a user’s writing style instead of real anxiety markers [ 8 ] . 1.2 Research Questions To address these gaps, this study focuses on the following questions: RQ1: Can interpretable linguistic features such as sentiment, self-reference, and text structure accurately detect expressions of anxiety in social media posts while preserving clinical transparency and ensuring rigorous data integrity through author-disjoint evaluation? RQ2: Do these models truly capture underlying psychological patterns, such as increased self-focused attention, or are they relying on simple keyword cues? RQ3: Do the linguistic markers found in Reddit posts generalize to a clinical interview setting (DAIC-WOZ), indicating that these features reflect genuine psychological signals rather than platform-specific behaviors? We also look at a practical question: Is it possible to detect anxiety using just a few posts, like a user’s first three? If so, this could help provide support earlier when people first seek help online. 1.3 Contributions This work makes four core contributions to mental health NLP: 1. Interpretable, High-Accuracy Detection with Strong Data Integrity: We show that a simple and fully transparent set of 13 linguistic features, capturing sentiment, self-reference, and text structure, can detect anxiety with high accuracy using Logistic Regression. Across 286,994 Reddit posts, the model achieves an F1 score of 89.34% (95% CI: 0.8903–0.8966) and an AUC of 0.9500. Because the model is linear, every prediction can be explained through explicit coefficients, allowing clinicians to interpret results in intuitive terms such as “elevated self-focused attention” (first-person pronoun coefficient +4.11) or “increased negative sentiment.” We also enforce strict author-disjoint splits, ensuring that no user appears in more than one partition. This eliminates data leakage and provides honest estimates of how well the model generalizes to completely unseen individuals. 2. Demonstration of Keyword-Independent Learning: Many mental-health NLP systems may mistakenly rely on disorder-specific vocabulary rather than deeper psychological patterns. We directly test this concern using feature ablations and explicit keyword masking. Despite a 104 \times difference in disorder-term prevalence (71.9% in anxiety posts vs. 0.7% in controls), performance drops only slightly when sentiment is removed ( - 0.65pp F1) or when all disorder-related terms are masked ( - 0.62–0.65pp). Even using self-reference features alone, the model reaches 87.01% F1. These findings indicate that the model primarily captures meaningful linguistic signals, especially heightened self-focused attention, rather than relying on vocabulary shortcuts. 3. Cross-Domain Validation with Clinical Interviews: To assess whether the learned markers reflect genuine psychological patterns rather than platform-specific habits, we compare feature effects between Reddit and the DAIC-WOZ clinical interview dataset. We find 75% consistency (9 of 12 features), and three features show large effects in both domains (Hedges’ g = 0.78–0.92). This cross-domain agreement suggests the linguistic markers identified in social media correspond to psychological signals observable in clinical settings, strengthening the case for their broader relevance and reliability. 4. Early Detection from Minimal Posting History: Finally, we show that anxiety can be detected from a very limited user history. Using only the first three posts per user, the model achieves 88.44% F1, just 0.90pp below full-history performance (89.34%). McNemar’s test confirms a small but statistically significant difference ( \chi^{2} = 4.13, p = 0.042), corresponding to only 24 additional correct predictions among 6,088 users. This suggests that early-stage online expressions of distress already contain recognizable linguistic signals, supporting the feasibility of rapid, unobtrusive screening soon after help-seeking begins. 2 Related Work 2.1 Mental Health Detection from Social Media Early computational mental health research showed that language shared on platforms like Twitter and Reddit can reveal meaningful signs of psychological distress. Foundational studies by Coppersmith et al. demonstrated the feasibility of detecting depression, PTSD, and bipolar disorder using simple n-gram and topic-modeling approaches [ 9 , 10 ] . Around the same time, De Choudhury et al. showed that changes in online behavior could help predict depression onset, achieving around 70% accuracy in identifying individuals at elevated risk [ 11 , 12 ] . As the field matured, deep learning approaches—CNNs, LSTMs, BERT, and, more recently,

Read the complete text