Expert Evaluation and the Limits of Human Feedback in Mental Health AI Safety Testing Note: Preprint. Under review.
Kiana Jafari, Paul Ulrich Nikolaus Rust, Duncan Eddy, Robbie Fraser, Nina Vasan, Darja Djordjevic, Akanksha Dadlani, Max Lamparth, Eugenia Kim, Mykel J. Kochenderfer · 2026
Read Expert Evaluation and the Limits of Human Feedback in Mental Health AI Safety Testing Note: Preprint. Under review. by Kiana Jafari, Paul Ulrich Nikolaus Rust, Duncan Eddy, Robbie Fraser, Nina Vasan, Darja Djordjevic, Akanksha Dadlani, Max Lamparth, Eugenia Kim, Mykel J. Kochenderfer (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2601-18061.txt.
Description
Kiana Jafari and co-authors test a core belief behind AI safety work in mental health. Their 2026 preprint is a preprint under review, as its note states. Learning from human feedback assumes that expert judgments, when pooled, give a valid ground truth. Mental health is a field where that truth matters most, since safety stakes are high. Three certified psychiatrists rated language model replies on their own, using a calibrated rubric.
The study checks how far the experts agree with each other. If experts diverge, then pooled feedback hides real doubt. That would shake how models are trained and tested for clinic use. The work gives safety teams hard data on the limits of expert consensus.
Catalog record
| CREATOR | Kiana Jafari, Paul Ulrich Nikolaus Rust, Duncan Eddy, Robbie Fraser, Nina Vasan, Darja Djordjevic, Akanksha Dadlani, Max Lamparth, Eugenia Kim, Mykel J. Kochenderfer |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 63 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2601-18061