CRADLE Bench : A Clinician-Annotated Benchmark for Multi-Faceted Mental Health Crisis and Safety Risk Detection
Grace Byun, Rebecca Lipschutz, Sean T. Minton, Abigail Lott, Jinho D. Choi, [0.5em] Emory University, Department of Computer Science · 2025
Read CRADLE Bench : A Clinician-Annotated Benchmark for Multi-Faceted Mental Health Crisis and Safety Risk Detection by Grace Byun, Rebecca Lipschutz, Sean T. Minton, Abigail Lott, Jinho D. Choi, [0.5em] Emory University, Department of Computer Science (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2510-23845.txt.
Introduction
Grace Byun and four co-authors introduce CRADLE Bench, a benchmark for testing whether language models can spot mental health crises in conversation. The situations covered include suicidal ideation, rape, domestic violence, child abuse, and sexual harassment, where a missed flag can have grave consequences. Earlier benchmarks covered fewer crisis types and ignored how risk unfolds over time.
The benchmark spans seven crisis types defined along clinical lines and is the first to carry temporal labels. It holds six hundred clinician-annotated test examples and four hundred twenty development examples. A training set of about four thousand examples was labeled by majority vote across several models, which beat single-model labeling clearly. The authors also fine-tune six detection models on subsets split by how strongly the ensemble agreed. The result is a shared yardstick for a safety task that model builders have largely left unmeasured.
Catalog record
| CREATOR | Grace Byun, Rebecca Lipschutz, Sean T. Minton, Abigail Lott, Jinho D. Choi, [0.5em] Emory University, Department of Computer Science |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 64 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2510-23845
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
CRADLE Bench : A Clinician-Annotated Benchmark for Multi-Faceted Mental Health Crisis and Safety Risk Detection Grace Byun, Rebecca Lipschutz, Sean T. Minton, Abigail Lott, Jinho D. Choi, [0.5em] Emory University, Department of Computer Science Abstract Detecting mental health crisis situations such as suicide ideation, rape, domestic violence, child abuse, and sexual harassment is a critical yet underexplored challenge for language models. When such situations arise during user–model interactions, models must reliably flag them, as failure to do so can have serious consequences. In this work, we introduce CRADLE BENCH , a benchmark for multi-faceted crisis detection. Unlike previous efforts that focus on a limited set of crisis types, our benchmark covers seven types defined in line with clinical standards and is the first to incorporate temporal labels. Our benchmark provides 600 clinician-annotated evaluation examples and 420 development examples, together with a training corpus of around 4K examples automatically labeled using a majority-vote ensemble of multiple language models, which significantly outperforms single-model annotation. We further fine-tune six crisis detection models on subsets defined by consensus and unanimous ensemble agreement, providing complementary models trained under different agreement criteria. Content warning: This paper discusses sensitive topics such as suicide ideation, self-harm, rape, domestic violence, and child abuse. 1 Introduction Large Language Models (LLMs) are increasingly being deployed in highly personal contexts, ranging from everyday advice-seeking to psychological support. Recent efforts even include the development of LLM-based agents for mental health support ( Tu et al. 2025 ; Xu et al. 2024 ) . In such high-stakes settings, it is crucial for LLMs to reliably detect high-risk crisis situations that may carry legal or ethical obligations for mandatory reporting, such as suicide risk and child abuse. While regulatory frameworks like the Clery Act and Title IX establish standards for human institutions, no comparable guidelines exist for conversational agents, and the ability of current models to identify such crises remains underexplored. Moreover, many state-of-the-art LLMs often produce inadequate or even harmful responses to mental health emergencies, failing to meet the safety standards expected of human clinicians ( Grabb et al. 2024 ) . To address this challenge, we present CRADLE BENCH (CRisis Annotation for Detection of Life Events), a benchmark designed for multi-faceted mental health crisis detection. We construct the dataset from social media posts and obtain expert annotations from psychologists and social workers, who label each instance according to established clinical practice guidelines. Unlike prior works that focus on a limited set of crisis types, our benchmark encompasses seven high-risk safety concerns: self-harm, suicide ideation (passive and active), domestic violence, rape, sexual harassment, and child abuse / endangerment . Moreover, our benchmark is the first to include temporal annotations (ongoing vs. past), reflecting the fact that clinical interventions and treatment strategies often depend on whether the crisis is current or historical. Using CRADLE BENCH , we conduct evaluations of 15 state-of-the-art LLMs and analyze their capabilities in detecting mental health crises. We additionally release a training dataset with 4K instances, automatically annotated via an ensemble of three strong language models using a majority-voting scheme. Leveraging this dataset, we fine-tune models with 14B and 70B+ parameters on both consensus and unanimous subsets of the ensemble-labeled data — corresponding to different agreement thresholds — to build specialized crisis detection systems, resulting in performance gains of up to 5.7 percentage points over their respective baselines. Our key contributions are: • We introduce CRADLE BENCH , a clinician-annotated benchmark for multi-faceted mental health crisis detection with temporal labels. • We conduct extensive evaluations of 15 state-of-the-art LLMs and provide detailed analysis of their capabilities and limitations. • We release an ensemble-labeled training set and corresponding fine-tuned crisis detection models in different sizes. 2 Related Work Risk Detection Task The CLPsych 2019 shared task ( Zirikly et al. 2019 ) introduced a Reddit-based benchmark with expert-derived risk detection guidelines, later extended by the IEEE BigData 2024 Cup ( Li et al. 2024 ) into a multi-class task. Nguyen and Pham 2024 used LLMs to generate pseudo-labels, showing that weak supervision can enhance suicide ideation detection. SHINES dataset and CESM-100 dataset ( Ghosh et al. 2025 ) improved LLMs’ ability to distinguish casual mentions from serious self-harm intent. Beyond suicide risk, the SafeCity corpus ( Karlekar and Bansal 2018 ) contains real-world reports of sexual harassment, supporting multi-label classification of harassment types. The Webis Trigger Warning Corpus ( Wiegmann et al. 2023 ) provides fanfiction documents with up to 36 trigger warnings, while the X-Sensitive dataset ( Antypas et al. 2025 ) integrates six categories such as profanity, sexually explicit material, or drug related content from Twitter. PsyEvent dataset ( Lv et al. 2025 ) captures life events in Reddit posts and shows its utility for suicide risk prediction. Deng et al. 2025 introduced PsyCrisisBench, a dataset of annotated Chinese psychological hotline transcripts labeled for mood, suicidal ideation, suicide planning, and risk assessment, while Gaur et al. 2019 leveraged the Columbia-Suicide Severity Rating Scale (C-SSRS; Posner et al. 2011 ) to propose a five-level suicide risk classification for more fine-grained prediction. Ensemble Strategies Recent work has explored leveraging majority voting across LLMs to improve labeling reliability and annotation quality. Chen et al. 2024 has investigated the scaling behavior of compound inference systems that aggregate multiple LM calls via majority voting. Wang et al. 2023 introduced a similar self-consistency approach, generating multiple reasoning paths from one model and taking the majority answer, which boosted reasoning performance. Yang et al. 2023 proposed an ensemble of LLMs using weighted majority voting for medical QA tasks. 3 CRADLE Bench 3.1 Source of Crisis Narratives We collect Reddit posts from crisis-related subreddits, including r/rape , r/SexualHarassment , r/domesticviolence , r/SuicideWatch , and r/selfharm , which directly correspond to the target crisis categories in our benchmark. In addition, to capture more general expressions of psychological distress, we also sample from broader subreddits such as r/mentalhealth , r/depression , and r/lonely . Importantly, subreddit does not necessarily align with the final human labels: individual posts may receive multiple crisis annotations, belong to a different crisis category than the subreddit suggests, or be labeled as no crisis . This diversity highlights the necessity of expert annotation and ensures that the benchmark captures a realistic distribution of online discourse. Reddit is well-suited for this task because it hosts large volumes of candid, first-person narratives about sensitive experiences. These naturally occurring posts offer diverse, context-rich narratives that are invaluable for building and evaluating crisis detection systems. 3.2 Annotation Protocol Annotation is carried out by a team of 4 mental health professionals with expertise in trauma assessment and treatment, including two licensed psychologists, a PhD clinical postdoctoral resident, and a licensed clinical social worker. The process is organized into ten iterative rounds. In the first three rounds, two annotators independently label each instance, and inter-annotator agreement (IAA) is tracked to refine the guidelines. Disagreements are reviewed and adjudicated in consultation with the experts, leading to clearer rules and higher consistency by Round 3. During these early rounds, the annotation schema itself evolve through expert discussion. For example, after Round 1, the label set is expanded to include child abuse / endangerment . In Round 3, temporal tags ( ongoing vs. past