Extracting and Steering Emotion Representations in Small Language Models: A Methodological Comparison

Jihoon ‘JJ’ Jeong, MD, MPH, PhD · 2026

Read Extracting and Steering Emotion Representations in Small Language Models: A Methodological Comparison by Jihoon ‘JJ’ Jeong, MD, MPH, PhD (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-04064.txt.

Description

Jihoon Jeong tested ways to pull out and steer emotion vectors in small language models. Testing 9 models across 5 kinds with 20 feelings, text-making pulls split feelings better than reading-based pulls, with an edge shaped by tuning and build. Emotion vectors sat near middle layers, with a U-shaped curve stable from 124M to 3B sizes. Steering tests showed three regimes, from neat text change to loopy collapse to wild breakdown, and showed cross-lingual mixing in Qwen.

Catalog record

CREATORJihoon ‘JJ’ Jeong, MD, MPH, PhD
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE32656
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2604.04064

Browse the full library · About the Tower of Babel