Assessing Risks of Large Language Models in Mental Health Support: A Framework for Automated Clinical AI Red Teaming Note: This paper is a condensed version of the first author’s Ph.D. dissertation submitted to Northeastern University ( 172 ) . CCS: Human-centered computing Natural language interfac

Ian Steenstra, Paola Pedrelli, Weiyan Shi, Stacy Marsella, Timothy W. Bickmore · 2026

Read Assessing Risks of Large Language Models in Mental Health Support: A Framework for Automated Clinical AI Red Teaming Note: This paper is a condensed version of the first author’s Ph.D. dissertation submitted to Northeastern University ( 172 ) . CCS: Human-centered computing Natural language interfac by Ian Steenstra, Paola Pedrelli, Weiyan Shi, Stacy Marsella, Timothy W. Bickmore (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2602-19948.txt.

Description

Language models are increasingly used for mental health support, yet standard safety tests often miss risks that build up over a therapeutic conversation. A 2026 arXiv paper by Ian Steenstra and four co-authors builds a framework for automated clinical red teaming of such systems.

The framework pairs AI therapists with simulated patients driven by dynamic cognitive-affective models, then scores the simulated sessions against a quality-of-care and risk ontology. Applied to alcohol use disorder, with several AI agents and a clinically validated set of patient personas, large-scale simulation reveals serious safety gaps. These include endorsing patient delusions and failing to de-escalate suicide risk. A dashboard validated with engineers, clinicians, and policy experts lets stakeholders audit the otherwise opaque behaviour of AI therapy.

Catalog record

CREATORIan Steenstra, Paola Pedrelli, Weiyan Shi, Stacy Marsella, Timothy W. Bickmore
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE159 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2602-19948

Browse the full library · About the Tower of Babel