The Echo Amplifies the Knowledge: Somatic Marker Analogues in Language Models via Emotion Vector Re-Injection
Jared Glover · 2026
Read The Echo Amplifies the Knowledge: Somatic Marker Analogues in Language Models via Emotion Vector Re-Injection by Jared Glover (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-08611.txt.
Introduction
Jared Glover gives a language model something like emotional memory, drawing on brain research by Tulving and Damasio. Human patients who know facts but lack emotional markers decide poorly, yet model memory stores only what happened, never how it felt. Using a small Gemma model, Glover finds hundreds of emotion linked features and rebuilds feeling vectors that are partly replayed during recall when contexts match.
The echo alone sharpens threat judgments, while feeling plus facts together lift good choices well above facts alone. Feeling alone changes no decisions, matching Damasio's central finding in people. Model memory research gains evidence that stored emotion amplifies knowledge rather than replacing it.
Catalog record
| CREATOR | Jared Glover |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 45 KB |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2605.08611
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
The Echo Amplifies the Knowledge: Somatic Marker Analogues in Language Models via Emotion Vector Re-Injection Jared Glover Abstract Current language model memory systems store what happened but not how it felt. This distinction—between semantic memory (knowing about a past event) and episodic memory (re-experiencing it)—was identified by Tulving [ 21 ] as the difference between noetic and autonoetic consciousness. Damasio [ 10 ] demonstrated that humans with intact knowledge but absent emotional markers exhibit impaired decision-making. We bridge this gap for language models. Using Gemma 3 1B-IT with pretrained Gemma Scope 2 sparse autoencoders, we identify 310 emotion-exclusive features at layer 22 with psychologically valid geometry. We construct distinctive-feature emotion vectors during experience and partially re-inject them during recall, triggered by context similarity at layer 7. We test four conditions paralleling Damasio’s framework: A (no memory), B (semantic labels), C (emotion echo), and BC (semantic + echo). For emotional orientation, the echo alone steepens the threat-safety gradient: the regression slope of threat rating on contextual similarity is 0.80 for C vs 0.56 for A ( p p =0.011, permutation test). For decisions, the echo amplifies knowledge into action: BC=80% good choices vs B=52% ( z z =+2.60, p p <0.01), while the echo alone has no effect (C=22%, n.s.). The echo changes how the model feels independently, but changes what it does only when combined with knowledge—replicating Damasio’s core finding. The echo amplifies knowledge. It does not replace it. 1 Introduction 1.1 The Tulving-Damasio Gap Endel Tulving’s [ 21 ] distinction between two forms of memory consciousness remains one of the most consequential in cognitive science. Episodic memory is accompanied by autonoetic consciousness—the re-experiencing of a past event. Semantic memory is accompanied by noetic consciousness—objective awareness of facts without the phenomenology of re-experiencing. This distinction carries behavioral consequences. Damasio’s somatic marker hypothesis [ 9 , 10 ] demonstrated that patients with ventromedial prefrontal cortex (VMPFC) damage—who retain intellectual capacity but lack emotional re-activation—exhibit impaired real-world decision-making. In the Iowa Gambling Task [ 3 ] , these patients understand which options are disadvantageous but fail to avoid them, because the anticipatory emotional signal is absent [ 4 ] . Bechara et al. [ 5 ] showed that healthy participants begin choosing advantageously before they can articulate the strategy—the somatic marker precedes conscious knowledge. Current LLM memory systems operate entirely in Tulving’s semantic mode. Systems such as EM-LLM [ 11 ] , Larimar [ 14 ] , SYNAPSE [ 24 ] , and AriGraph [ 2 ] store interaction events but do not re-experience them. The emotional state that accompanied the original processing is not preserved. This is the Tulving-Damasio gap applied to AI. 1.2 Functional Emotions in Language Models A language model processes text by passing it through a sequence of layers, each producing an activation vector—a list of numbers that encodes the model’s evolving “understanding” of the input at that depth. These activation vectors are high-dimensional (1,152 numbers in the model we study) and, in their raw form, difficult to interpret. Sparse autoencoders (SAEs) provide a tool for decomposing these activations into interpretable components called features . Each feature is a direction in activation space associated with a recognizable concept. Some features are mundane: one might activate for text about cooking, another for legal terminology, a third for Python code. Others are more subtle: a feature for sarcasm, for hedging, for the Golden Gate Bridge. Among these, some correspond to emotional states—a feature for grief, for excitement, for the feeling of being deceived. A feature “activating” means the model’s internal state has a significant component along that direction. The activation strength indicates how strongly the concept is represented. Crucially, different types of features tend to appear at different depths. Early layers encode surface-level content—what the text is about, what entities are mentioned, what kind of scene is being described. Middle layers encode more abstract structure—relationships between entities, narrative context, pragmatic intent. Late layers encode the highest-order abstractions—including emotional tone, moral valence, and the model’s “stance” toward what it is processing. This depth gradient means that the same text produces different feature activations at different layers: a description of a dark alley might activate “urban setting” features in early layers and “fear” or “danger” features in late layers. This observation motivates our two-layer architecture (Section 3): context matching at an early layer (where the content is represented) and emotion injection at a late layer (where the emotional response forms). Anthropic [ 18 ] applied this analysis to Claude Sonnet 4.5 and identified 171 features corresponding to distinct emotional states—not metaphorically, but functionally. These features activate when the model processes emotionally relevant text, are organized in clusters that mirror human emotional psychology (grief near love, anger near betrayal), and—critically— causally drive behavior . When researchers artificially amplified the “desperation” feature, the model’s tendency to pursue reward through unintended shortcuts (a failure mode known as reward-hacking) increased 14-fold. The emotion was not a label the model applied to its output. It was an internal state that changed what the model did. These features are the raw material for emotional memory. But they are activations —transient states that exist only while the model processes a given context. When the conversation ends, the activation vectors reset. Whatever functional analogue of feeling occurred during one interaction has no influence on the next. The emotion features are present during experience and absent during recall—precisely the deficit that characterizes Damasio’s VMPFC patients. 1.3 Contributions 1. Emotion feature discovery in Gemma 3 1B-IT: 310 exclusive features at layer 22 with psychologically valid geometry. 2. The distinctive-feature method for emotion-specific echo construction. 3. A two-vector architecture : context matching at layer 7, emotion injection at layer 22. 4. The Damasio comparison : the echo alone steepens the threat-safety gradient (orientation); the echo amplifies knowledge into better decisions. Different tasks, different roles, same echo. 5. Consumer hardware : all experiments on RTX 2060/2070 SUPER with a 1B model. 2 Related Work Episodic Memory in LLMs. EM-LLM [ 11 ] , Larimar [ 14 ] , SYNAPSE [ 24 ] , and AriGraph [ 2 ] implement structural episodic memory—Tulving’s 1972 taxonomy [ 20 ] rather than his 1985 phenomenological distinction [ 21 ] . REMT [ 1 ] proposes emotional valence as a scalar score but lacks experiments. The A-MBER benchmark [ 23 ] evaluates affective memory for user modeling but does not address the model’s own emotional states. None preserve re-activatable emotion vectors. Emotion in LLMs. Anthropic [ 18 ] found 171 functional emotion features. Control Reinforcement Learning (CRL) [ 8 ] demonstrated real-time steering of LLM behavior via SAE features at the token level. We extend this from deliberate steering to automatic re-activation on recall. Somatic Markers and AI. Lima and Martinho [ 15 ] applied Damasio’s somatic marker hypothesis to grid-world agents in the Pixelverse, using scalar valence signals. No prior work connects Damasio to LLMs or uses the model’s own internal representations (SAE features) as somatic marker analogues. Mechanistic Interpretability. We build on Bricken et al. [ 6 ] for SAEs, Rajamanoharan et al. [ 16 ] for the JumpReLU architecture, Gemma Scope [ 12 , 13 ] for pretrained features, and activation steering methods including ActAdd