Assessing Risks of Large Language Models in Mental Health Support: A Framework for Automated Clinical AI Red Teaming Note: This paper is a condensed version of the first author’s Ph.D. dissertation submitted to Northeastern University ( 172 ) . CCS: Human-centered computing Natural language interfac
Ian Steenstra, Paola Pedrelli, Weiyan Shi, Stacy Marsella, Timothy W. Bickmore · 2026
Read Assessing Risks of Large Language Models in Mental Health Support: A Framework for Automated Clinical AI Red Teaming Note: This paper is a condensed version of the first author’s Ph.D. dissertation submitted to Northeastern University ( 172 ) . CCS: Human-centered computing Natural language interfac by Ian Steenstra, Paola Pedrelli, Weiyan Shi, Stacy Marsella, Timothy W. Bickmore (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2602-19948.txt.
Description
Language models are increasingly used for mental health support, yet standard safety tests often miss risks that build up over a therapeutic conversation. A 2026 arXiv paper by Ian Steenstra and four co-authors builds a framework for automated clinical red teaming of such systems.
The framework pairs AI therapists with simulated patients driven by dynamic cognitive-affective models, then scores the simulated sessions against a quality-of-care and risk ontology. Applied to alcohol use disorder, with several AI agents and a clinically validated set of patient personas, large-scale simulation reveals serious safety gaps. These include endorsing patient delusions and failing to de-escalate suicide risk. A dashboard validated with engineers, clinicians, and policy experts lets stakeholders audit the otherwise opaque behaviour of AI therapy.
Catalog record
| CREATOR | Ian Steenstra, Paola Pedrelli, Weiyan Shi, Stacy Marsella, Timothy W. Bickmore |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 159 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2602-19948