Extracting and Steering Emotion Representations in Small Language Models: A Methodological Comparison
Jihoon ‘JJ’ Jeong, MD, MPH, PhD · 2026
Read Extracting and Steering Emotion Representations in Small Language Models: A Methodological Comparison by Jihoon ‘JJ’ Jeong, MD, MPH, PhD (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-04064.txt.
Description
Jihoon Jeong tested ways to pull out and steer emotion vectors in small language models. Testing 9 models across 5 kinds with 20 feelings, text-making pulls split feelings better than reading-based pulls, with an edge shaped by tuning and build. Emotion vectors sat near middle layers, with a U-shaped curve stable from 124M to 3B sizes. Steering tests showed three regimes, from neat text change to loopy collapse to wild breakdown, and showed cross-lingual mixing in Qwen.
Catalog record
| CREATOR | Jihoon ‘JJ’ Jeong, MD, MPH, PhD |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 32656 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2604.04064