MAQuA : Adaptive Question-Asking for Multidimensional Mental Health Screening using Item Response Theory

Vasudha Varadarajan, Hui Xu, Rebecca Astrid Boehme, Mariam Marlan Mirström, Sverker Sikström, H. Andrew Schwartz · 2025

Read MAQuA : Adaptive Question-Asking for Multidimensional Mental Health Screening using Item Response Theory by Vasudha Varadarajan, Hui Xu, Rebecca Astrid Boehme, Mariam Marlan Mirström, Sverker Sikström, H. Andrew Schwartz (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2508-07279.txt.

Introduction

Vasudha Varadarajan and co-authors build MAQuA, a screening system that asks each patient only the questions that teach it the most. Their 2025 paper tackles a burden problem in mental health checks: long fixed questionnaires tire users, yet many symptoms must be screened at once. Language models make interactive screening possible, but naive chat wastes turns.

MAQuA joins language modeling of answers with item response theory, the statistics behind adaptive testing. At each step it picks the question with the highest information across several symptom dimensions at once. On a new dataset, scores settled with half to nearly nine tenths fewer questions than random order. Early stopping cut the load further. The system held up across inward and outward symptom types, from depression to eating disorders.

Catalog record

CREATORVasudha Varadarajan, Hui Xu, Rebecca Astrid Boehme, Mariam Marlan Mirström, Sverker Sikström, H. Andrew Schwartz
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE52 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2508-07279

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

MAQuA : Adaptive Question-Asking for Multidimensional Mental Health Screening using Item Response Theory Vasudha Varadarajan, Hui Xu, Rebecca Astrid Boehme, Mariam Marlan Mirström, Sverker Sikström, H. Andrew Schwartz Abstract Recent advances in large language models (LLMs) offer new opportunities for scalable, interactive mental health assessment, but excessive querying by LLMs burdens users and is inefficient for real-world screening across transdiagnostic symptom profiles. We introduce MAQuA , an adaptive question-asking framework for simultaneous, multidimensional mental health screening. Combining multi-outcome modeling on language responses with item response theory (IRT) and factor analysis, MAQuA selects the questions with most informative responses across multiple dimensions at each turn to optimize diagnostic information, improving accuracy and potentially reducing response burden. Empirical results on a novel dataset reveal that MAQuA reduces the number of assessment questions required for score stabilization by 50–87% compared to random ordering (e.g., achieving stable depression scores with 71% fewer questions and eating disorder scores with 85% fewer questions). MAQuA demonstrates robust performance across both internalizing (depression, anxiety) and externalizing (substance use, eating disorder) domains, with early stopping strategies further reducing patient time and burden. These findings position MAQuA as a powerful and efficient tool for scalable, nuanced, and interactive mental health screening, advancing the integration of LLM-based agents into real-world clinical workflows. Introduction Recent progress in large language models (LLMs) has enabled the automated inference of mental health scores from patient-generated natural language. However, comprehensive evaluations indicate that such LLM-based assessments are inconsistent ( Ji et al. 2022 ) and, in many cases, less accurate than dedicated, condition-specific models with established psychometric validity ( Harrigian, Aguirre, and Dredze 2020 ) . These limitations present critical barriers to the clinical adoption and trustworthiness of LLMs in the mental health domain. Traditional NLP approaches in mental health have often relied on annotations of specific conditions derived from social media, primarily focusing on single-task models, such as encoder-based classifiers for depression ( Coppersmith et al. 2015 ; Eichstaedt et al. 2018 ) , suicidal ideation ( Shen et al. 2017 ) and anxiety ( Owen, Camacho-Collados, and Espinosa Anke 2020 ; Gkotsis et al. 2017 ) , detection. The narrow scope of modeling a single dimensional mental health score typically fails to capture comorbidities or the complex, multidimensional nature of symptoms observed by real-world clinicians ( Shani and Stade 2025 ) . More importantly, they do not address the interactive paradigm where LLM agents engage with users in prompted settings: language generated in response to structured diagnostic interviews, as would be typical in real-world clinical settings. Further, in actual clinical practice, clinicians dynamically adapt their lines of questioning based on prior information received, avoiding redundancy, clarifying ambiguous responses, and addressing emergent concerns ( James, Morse, and Howarth 2010 ) . While LLMs excel at modeling linguistic patterns, they often struggle to dynamically ground inferred states in underlying mental health constructs ( Singh et al. 2025 ) , especially given the multi-objective challenge of simultaneously selecting diagnostic questions and evaluating mental health status ( Li et al. 2025 ; Sener and Koltun 2018 ) . Furthermore, maximizing the diagnostic yield within the constraints of limited clinician-patient interaction time remains a key priority, as excessive probing, especially via LLM-based dialogue agents can be mentally taxing and lead to decision fatigue or disengagement ( Jin, Kim, and Han 2025 ) , highlighting the need for adaptive systems that select only the most informative and relevant follow-up questions. To address these challenges, we propose MAQuA : an adaptive, language-based assessment framework that supports multidimensional mental health modeling. This framework infers multiple underlying condition scores while adaptively selecting the most informative follow-up questions, thereby guiding interactions efficiently toward richer diagnostic insight, making it suitable to operate alongside LLM agents. Building on item response theory (IRT)-based adaptive assessments introduced by ( Varadarajan et al. 2024 ) , our results demonstrate that optimizing information gain across multiple conditions simultaneously can be even more effective than single-score models. To explore this, we empirically benchmark single-task and multitask models on a multidimensional mental health dataset and assess the effectiveness of adaptive question selection. Our research investigates (1) whether cross-condition information sharing improves per-condition predictive performance; (2) construct validity of automatically inferred mental health dimensions; and (3) the efficacy of multidimensional IRT in sustaining validity of measures in subsequent adaptive assessment turns. Our main contributions include: (a) a systematic comparison of multi-condition modeling techniques, (b) an adaptive assessment framework for optimizing information gain across outcomes, (c) empirical results demonstrating robust gains in multidimensional assessment, and (d) the release of a novel, questionnaire-driven dataset to support future research. Related Work While large language models (LLMs) have shown promising results in zero-shot and few-shot prediction tasks ( Ganesan et al. 2024 ; Hur et al. 2024 ) , finetuned or instruction-tuned models remain generally more reliable and better validated across a range of mental health outcomes ( Xu et al. 2024 ) . Recent advances demonstrate that open-ended language responses to standardized questions can predict mental health scores with high accuracies: sometimes with correlations exceeding 0.8 with established clinical rating scales ( Kjell et al. 2022 ; Varadarajan et al. 2024 ; Sikström et al. 2023 ) . These include pre-trained language models tailored for mental healthcare applications, such as ClinicalBERT and MentalBERT ( Alsentzer et al. 2019 ; Ji et al. 2022 ) . Large language models (LLMs) commonly address referential and vague queries by employing targeted, selective prompts, which has been shown to improve answer accuracy and reduce errors ( Zhang, Knox, and Choi 2025 ; Kuhn, Gal, and Farquhar 2023 ) . However, despite these improvements, LLMs still fall short of human conversational subtlety and adaptiveness when it comes to clarification and follow-up questions. In terms of LLMs for mental health support, Rosenman, Hendler, and Wolf 2024 demonstrate that LLMs can effectively transform unstructured psychological interviews into structured questionnaires, enabling automated, multidimensional psychiatric evaluation, though reliability and consistency still require further improvement for clinical deployment. Complementing this, Nguyen et al. 2025 explore LLMs’ ability to engage in mental health counseling, showing that, though LLMs can generate contextually relevant follow-up questions, they often lag behind human clinicians in empathy, specificity, and diagnostic nuance, and in crafting clarifying or probing questions that are crucial for effective counseling. Similarly, Yang et al. 2023 assess LLM performance across a spectrum of mental health tasks, finding that LLMs frequently overlook emotional cues or oversimplify questions, limiting their utility for nuanced clinical interpretation. This underscores the need for methods like ours that explicitly model multiple mental health factors to guide strategic question selection. Our framework enhances both the efficiency and accuracy of mental health assessments by optimizing inquiry and serving as a comprehensive diagnostic tool. While adaptive testing has gained significant traction in educational settings, its multidimensional applications remain relatively underexplored, particularly when leveraging open-ended language responses. Most existing approaches in NLP rely on unidimensional item response theory (IRT) focusing on single outcomes ( Lalor, Wu, and Yu 2016 ; Varadarajan et al. 2024 ) . To date, no prior work has effectively bridged this gap by integrating adaptive item selection with multitask learning for language-based, multidimensional mental health evaluation. To our knowledge, this work is the first to

Read the complete text