Evaluating LLMs for Anxiety, Depression, and Stress Detection Evaluating Large Language Models for Anxiety, Depression, and Stress Detection: Insights into Prompting Strategies and Synthetic Data
Mihael Arcan, David-Paul Niland · 2025
Read Evaluating LLMs for Anxiety, Depression, and Stress Detection Evaluating Large Language Models for Anxiety, Depression, and Stress Detection: Insights into Prompting Strategies and Synthetic Data by Mihael Arcan, David-Paul Niland (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2511-07044.txt.
Description
Mihael Arcan and David-Paul Niland evaluate how well automated systems detect anxiety, depression, and stress from text. More than a fifth of adults worldwide experience mental health disorders, yet symptom language is subtle and varied, making detection hard. The study compares large language models such as Llama and GPT against classic machine learning and transformer models including BERT, XLNet, and Distil-RoBERTa, using the DAIC-WOZ clinical interview dataset.
Models were fine-tuned for each condition, and synthetic data creation was used to fight class imbalance. Distil-RoBERTa scored highest on the anxiety scale, while XLNet led on the depression questionnaire tasks. A zero-shot synthetic approach performed best for stress. The authors conclude transformers plus augmentation improve recall and generalization, though calibration is needed to protect precision, a useful guide for automated mental health screening tools.
Catalog record
| CREATOR | Mihael Arcan, David-Paul Niland |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 64 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2511-07044