Scaling behavior of large language models in emotional safety classification across sizes and tasks

Edoardo Pinzuti, Oliver Tüscher, André Ferreira Castro · 2025

Read Scaling behavior of large language models in emotional safety classification across sizes and tasks by Edoardo Pinzuti, Oliver Tüscher, André Ferreira Castro (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2509-04512.txt.

Description

Edoardo Pinzuti and two co-authors study how model size affects emotional safety judgments in a 2025 research paper. Systems used near mental health conversations must classify content as safe, unsafe, or borderline, and tag risks across a six-category scheme. Their data set merges several human-authored mental health collections, over fifteen thousand samples, with emotion reinterpretation prompts generated through ChatGPT. Four LLaMA models, from one to seventy billion parameters, were compared under zero-shot, few-shot, and fine-tuned conditions.

Bigger models performed best on average, especially on the nuanced multi-label task and without examples. Light fine-tuning, though, lifted the smallest model to rival larger ones in several data-rich categories, while needing under two gigabytes of memory. Private, on-device safety screening looks feasible.

Catalog record

CREATOREdoardo Pinzuti, Oliver Tüscher, André Ferreira Castro
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE30 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2509-04512

Browse the full library · About the Tower of Babel