The Pursuit of Empathy: Evaluating Small Language Models for PTSD Dialogue Support
Suhas BN, Yash Mahajan, Dominik Mattioli, Andrew M. Sherrill, Rosa I. Arriaga, Chris W. Wiese, Saeed Abdullah · 2025
Read The Pursuit of Empathy: Evaluating Small Language Models for PTSD Dialogue Support by Suhas BN, Yash Mahajan, Dominik Mattioli, Andrew M. Sherrill, Rosa I. Arriaga, Chris W. Wiese, Saeed Abdullah (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2505-15065.txt.
Description
Suhas BN and six co-authors test small models as empathetic listeners in twenty twenty-five. People with PTSD may benefit from supportive dialogue systems. Small language models could run such support privately and cheaply. Whether they can respond with real empathy is the question.
The team built TIDE, a data set of ten thousand two-turn conversations. They span five hundred clinically grounded PTSD personas. Eight small models, from half a billion to five billion parameters, were tested zero-shot and after fine-tuning. Fine-tuning improved similarity to reference responses and perceived empathy. Gains varied by emotional scenario, and smaller models hit a transfer ceiling. The best frontier model still led, but small models often approached human-rated empathy. Readers get evidence on how far compact models go in sensitive support roles.
Catalog record
| CREATOR | Suhas BN, Yash Mahajan, Dominik Mattioli, Andrew M. Sherrill, Rosa I. Arriaga, Chris W. Wiese, Saeed Abdullah |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 81 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2505-15065