The Pursuit of Empathy: Evaluating Small Language Models for PTSD Dialogue Support

Suhas BN, Yash Mahajan, Dominik Mattioli, Andrew M. Sherrill, Rosa I. Arriaga, Chris W. Wiese, Saeed Abdullah · 2025

Read The Pursuit of Empathy: Evaluating Small Language Models for PTSD Dialogue Support by Suhas BN, Yash Mahajan, Dominik Mattioli, Andrew M. Sherrill, Rosa I. Arriaga, Chris W. Wiese, Saeed Abdullah (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2505-15065.txt.

Description

Suhas BN and six co-authors test small models as empathetic listeners in twenty twenty-five. People with PTSD may benefit from supportive dialogue systems. Small language models could run such support privately and cheaply. Whether they can respond with real empathy is the question.

The team built TIDE, a data set of ten thousand two-turn conversations. They span five hundred clinically grounded PTSD personas. Eight small models, from half a billion to five billion parameters, were tested zero-shot and after fine-tuning. Fine-tuning improved similarity to reference responses and perceived empathy. Gains varied by emotional scenario, and smaller models hit a transfer ceiling. The best frontier model still led, but small models often approached human-rated empathy. Readers get evidence on how far compact models go in sensitive support roles.

Catalog record

CREATORSuhas BN, Yash Mahajan, Dominik Mattioli, Andrew M. Sherrill, Rosa I. Arriaga, Chris W. Wiese, Saeed Abdullah
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE81 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2505-15065

Browse the full library · About the Tower of Babel