Systematic Evaluation of Machine-Generated Reasoning and PHQ-9 Labeling for Depression Detection Using Large Language Models
Zongru Shao, Xin Wang, Zhanyang Liu, Chenhan Wang, K.P. Subbalakshmi · 2025
Read Systematic Evaluation of Machine-Generated Reasoning and PHQ-9 Labeling for Depression Detection Using Large Language Models by Zongru Shao, Xin Wang, Zhanyang Liu, Chenhan Wang, K.P. Subbalakshmi (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2505-17119.txt.
Introduction
Zongru Shao and co-authors audited AI reasoning about depression in two thousand twenty-five. Language models now screen for depression from text. Their machine-made training data lacked quality control. Reasoning behind labels went unexamined until now. The team broke detection into graded subtasks. A depression questionnaire supplied the labeling frame.
Contrastive examples and step-by-step prompts were tested. Weak reasoning surfaced where simple scores hid it. Mitigation strategies improved the flawed outputs. The audit method transfers to other health tasks. Trustworthy screening needs reasoning checks, not just accuracy. Clinics should demand both before deploying models.
Catalog record
| CREATOR | Zongru Shao, Xin Wang, Zhanyang Liu, Chenhan Wang, K.P. Subbalakshmi |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 32 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2505-17119
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Systematic Evaluation of Machine-Generated Reasoning and PHQ-9 Labeling for Depression Detection Using Large Language Models Zongru Shao, Xin Wang, Zhanyang Liu, Chenhan Wang, K.P. Subbalakshmi Abstract Recent research leverages large language models (LLMs) for early mental health detection, such as depression, often optimized with machine-generated data. However, their detection may be subject to unknown statistical biases which imposed detection inaccuracy. Meanwhile, quality control has not been applied to these generated corpora besides sampled human verifications, which is significantly limited compared to the scale of the data in use. Our goal in this work is to systematically evaluate LLM reasoning and reveal potential statistical biases. To this end, we first provide a systematic evaluation of the reasoning over machine-generated detection and interpretation, thus revealing potential statistic detection biases in the context. Then we use the models’ reasoning abilities to explore mitigation strategies for enhanced performance. Specifically, we do the following: (a) Design an LLM instruction strategy that allows for systematic analysis of the classification by breaking down the detection task into several subtasks. (b) Design contrastive few-shot and chain-of-thought prompts by selecting typical positive and negative examples of detection reasoning. (c) Perform human annotation for the subtasks identified in the first step and evaluate the few-shot performance. (d) Identify human-preferred detection with desired logical reasoning from the few-shot generation and use them to explore different optimization strategies. We conducted extensive comparisons of the experimental results on the DepTweet dataset across the following subtasks: (1) identifying whether the speaker is describing their own depression, (2) accurately detecting the presence of PHQ-9 symptoms, and (3) finally, detecting depression. Human verification of statistical outliers shows that LLMs demonstrate greater accuracy in analyzing and detecting explicit language of depression as opposed to implicit expressions of depression. We also note that, the LLMs are biased towards making a “depression” decision when there are explicit depression-related keywords. By contrast, they are biased towards “non-depression" decisions, when there is no depression-related keyword in the text. Two optimization methods are used for performance enhancement and reduction of the statistic bias: (1) supervised fine-tuning (SFT) and (2) direct preference optimization (DPO). Notably, the DPO approach achieves significant performance improvement. 1 Introduction It is estimated that approximately 5% of adults worldwide suffer from depression 1 1 1 WHO (World Health Organization), https://www.who.int/news-room/fact-sheets/detail/depression , which not only negatively impacts their emotions, behaviors, and cognitive processes but also potentially leads to self-harm or even suicide. Thus, early detection and diagnosis are crucial for effective treatment to minimize mortality and morbidity Goldman et al. 1999 . Social media platforms provide valuable insights on mental health, complementing traditional clinical diagnostics, especially with advances in natural language processing (NLP) De Choudhury et al. 2013 . Traditional NLP approaches detect depression through linguistic features like word frequencies and emotional keywords Lyu et al. 2023 while dismissing complex and indirect expressions. The emergence of transformer-based Vaswani et al. 2017 language models has enabled nuanced analysis of expression interactions within the context Zogan et al. 2023 ; Wang et al. 2021 to improve the detection performance, but they are supervised by the training data and fail to generalize for unseen scenarios Harrigian et al. 2020 . Recent advancements of LLMs have significantly impacted the automated screening of mental health issues Xu et al. 2023 . Several approaches fine-tuned open LLMs for this purpose, such as MentaLLaMA , MentalBART , MentalT5 Yang et al. 2023 , while their interpretability of reasoning was facilitated by a training dataset generated by proprietary LLMs. Meanwhile, SEGA Chen et al. 2024 transformed clinical interviews into expertise-driven graphs and leveraged LLMs for data augmentation, significantly boosting performance on clinical datasets. Diagnostic reasoning achieved by LLMs Savage et al. 2024 has garnered significant interest in related studies. However, comprehensive evaluations of the generated rationales are still conducted by manual assessment of physicians and medical experts Savage et al. 2024 , limiting the volume of throughput in their analysis. We want to automate the evaluation of reasoning so that the LLM-generated decisions and associated rationales can be evaluated in large quantities. Therefore, we propose a breakdown of the depression detection task into several subtasks and explore a few methods to use the LLM-generated rationales to improve overall system performance. The objectives of this work are as follows: (a) To systematically evaluate MentalLLM-generated detection in terms of their adherence to instructions/prompts and their reasoning. (b) To identify potential statistical biases in the decision-making compared to human judgments. (c) To explore the utilization of generated reasoning from open-source LLMs for further model optimization. Consequently, we design an LLM-based depression-detection system to identify a range of subtasks and evaluate their responses with subtask-labeling annotated by human experts. The analyses provide insights into effective instruction tuning of LLMs with machine-generated data, as well as an understanding of the potential weaknesses in LLM-based depression detection. 2 Defining Subtasks for Depression Detection Language models have attracted research interests for text-based depression detection, such as MentaLLaMA and other related works. However, the quality of the generated reasoning in the context is evaluated by human verification, which is costly and unscalable. Current AI systems still struggle to perform rigorous automated logical evaluation from the flow of the text. To address these challenges, we decompose the overall task of depression detection from tweet text into several subtasks that act as critical “checkpoints” within the logical reasoning process of the LLMs. This enables us to conduct a systematic analysis of the process, the outcome, and potential weaknesses. Implicit expressions and circumlocutory language pose significant challenges for traditional NLP approaches Despot et al. 2023 . This is often caused by the fact that the presence or absence of specific keywords can disproportionately impact the analysis. In particular, we identify two key scenarios where breaking down the depression prediction task into subtasks is especially beneficial: (a) When depression-related keywords are present but an analysis of the linguistic context demonstrates that the text does not describe the speaker’s own depressive state (for instance, when the text pertains to general knowledge or refers to another individual). (b) When depression keywords are absent, yet the speaker implicitly conveys extremely negative emotions, suggesting a high likelihood of depression as estimated by human experts. The presence of depressive symptoms is another key factor for depression detection. The Patient Health Questionnaire (PHQ-9) Kroenke et al. 2001 is a widely accepted self-report tool used to screen for both the presence and severity of depression. Given its simplicity and significant domain contribution, we leverage the PHQ-9 framework to break down our task as follows: (1) Self-reference Analysis : Determine whether the S peaker is describing their own mental state (S = Yes or No ). (2) Symptom Detection : Evaluate the presence of each of the PHQ-9 symptoms (S1–S9, as described in Kabir et al. 2023 ). (3) Overall Diagnosis : Make a final decision regarding D epression (D) by synthesizing the analyses from the previous steps. In total, depression detection from tweet text is decomposed into eleven subtasks: one for self-reference identification, nine for the PHQ-9 symptoms, and the last for the final depression diagnosis. 3 LLM Learning & Tuning Framework Figure 1: An overview of the LLM-based detection and analysis framework. We design a comprehensive