Evaluating LLMs for Anxiety, Depression, and Stress Detection Evaluating Large Language Models for Anxiety, Depression, and Stress Detection: Insights into Prompting Strategies and Synthetic Data

Mihael Arcan, David-Paul Niland · 2025

Read Evaluating LLMs for Anxiety, Depression, and Stress Detection Evaluating Large Language Models for Anxiety, Depression, and Stress Detection: Insights into Prompting Strategies and Synthetic Data by Mihael Arcan, David-Paul Niland (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2511-07044.txt.

Description

Mihael Arcan and David-Paul Niland evaluate how well automated systems detect anxiety, depression, and stress from text. More than a fifth of adults worldwide experience mental health disorders, yet symptom language is subtle and varied, making detection hard. The study compares large language models such as Llama and GPT against classic machine learning and transformer models including BERT, XLNet, and Distil-RoBERTa, using the DAIC-WOZ clinical interview dataset.

Models were fine-tuned for each condition, and synthetic data creation was used to fight class imbalance. Distil-RoBERTa scored highest on the anxiety scale, while XLNet led on the depression questionnaire tasks. A zero-shot synthetic approach performed best for stress. The authors conclude transformers plus augmentation improve recall and generalization, though calibration is needed to protect precision, a useful guide for automated mental health screening tools.

Catalog record

CREATORMihael Arcan, David-Paul Niland
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE64 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2511-07044

Browse the full library · About the Tower of Babel