Brain-Grounded Axes for Reading and Steering LLM States
Sandro Andric · 2025
Read Brain-Grounded Axes for Reading and Steering LLM States by Sandro Andric (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2512-19399.txt.
Introduction
Sandro Andric uses human brain activity as a coordinate system for reading language model states. Most interpretability tools carve directions from text labels alone, which can float free of any outside ground truth. Andric instead builds a word-level brain atlas from MEG recordings in the SMN4Lang dataset, using phase-locking patterns.
Independent component analysis pulls latent axes from the atlas, checked against outside word lists and labels. Lightweight adapters then map a model's hidden states onto those axes, with the model itself frozen. Steering along one axis shifted word-frequency behavior robustly in a small model, at matched perplexity. A function-versus-content axis steered consistently across three model families.
Catalog record
| CREATOR | Sandro Andric |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 21 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2512-19399
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Brain-Grounded Axes for Reading and Steering LLM States Sandro Andric Abstract Interpretability methods for large language models (LLMs) typically derive directions from textual supervision, which can lack external grounding. We propose using human brain activity not as a training signal but as a coordinate system for reading and steering LLM states. Using the SMN4Lang MEG dataset, we construct a word-level brain atlas of phase-locking value (PLV) patterns and extract latent axes via ICA. We validate axes with independent lexica and NER-based labels (POS/log-frequency used as sanity checks), then train lightweight adapters that map LLM hidden states to these brain axes without fine-tuning the LLM. Steering along the resulting brain-derived directions yields a robust lexical (frequency-linked) axis in a mid TinyLlama layer, surviving perplexity-matched controls, and a brain-vs-text probe comparison shows larger log-frequency shifts (relative to the text probe) with lower perplexity for the brain axis. A function/content axis (axis 13) shows consistent steering in TinyLlama, Qwen2-0.5B, and GPT-2, with PPL-matched text-level corroboration. Layer-4 effects in TinyLlama are large but inconsistent, so we treat them as secondary (Appendix). Axis structure is stable when the atlas is rebuilt without GPT embedding-change features or with word2vec embeddings ( | r | = 0.64 – 0.95 |r|=0.64\text{--}0.95 across matched axes), reducing circularity concerns. Exploratory fMRI anchoring suggests potential alignment for embedding change and log frequency, but effects are sensitive to hemodynamic modeling assumptions and are treated as population-level evidence only. These results support a new interface: neurophysiology-grounded axes provide interpretable and controllable handles for LLM behavior. 1 Introduction Most LLM interpretability discovers directions using text-derived labels or optimization objectives. Such directions can be effective yet are rarely grounded in external measurements of human cognition. We ask whether brain activity can define a stable, externally grounded coordinate system that enables both reading and steering of LLM representations. Our key idea is to compute a brain-derived atlas of semantic activity and use its axes as the target space for LLM projections. We do not optimize the LLM; instead we train a lightweight adapter and test whether steering along those axes produces reliable, interpretable shifts in generated text. Contributions: - We build a MEG-derived word-level brain atlas of PLV connectivity and extract latent axes with stability/robustness checks. - We show that a lightweight adapter can map LLM hidden states into this brain axis space without fine-tuning. - We demonstrate robust steering for a frequency-linked axis (TinyLlama L11) and cross-model steering for a function/content axis (GPT - 2, Qwen - 0.5B, TinyLlama), including PPL-matched and brain - vs - text probe controls. 2 Related Work Prior work aligns neural data with language models for encoding/decoding and representation comparisons [ 15 , 8 , 4 , 2 ] , uses brain data to interpret NLP models [ 17 ] , and demonstrates semantic reconstruction from brain recordings [ 16 ] . Recent steering methods use activation-addition and contrastive vectors [ 19 , 13 ] . Our contribution differs in two ways: (1) we derive axes from MEG connectivity geometry rather than textual supervision, and (2) we treat brain axes as a fixed interface for reading and steering, not as a reward for optimization. 3 Dataset We use SMN4Lang (OpenNeuro ds004078 v1.2.1) [ 20 , 21 ] , a synchronized MEG/fMRI dataset of naturalistic story listening. We use preprocessed MEG sensor-level data and word-level timing annotations. The dataset includes 12 subjects and 60 stories. 4 Methods 4.1 MEG PLV Atlas We compute phase-locking value (PLV) in theta band (4–8 Hz) over sliding windows (2.0 s length, 0.5 s step) on gradiometer channels [ 10 ] . For each window, we compute PLV connectivity and compress the edge vector using PCA to 128 dimensions (edge-PCA). Filtering and analytic phase extraction are implemented with MNE-Python [ 5 ] . This yields a time-indexed PLV state vector per run. 4.2 Word-Level Brain Atlas We align PLV windows to word-level timing annotations and build a word-level atlas using ridge regression [ 6 ] with features: embedding change (GPT), word log-frequency, and POS id. Lags of 0.0, 0.5, and 1.0 s are included. The model predicts PLV-PCA states per window; each window is assigned to the most recent word onset, and we average predicted PLV vectors by word type to obtain a word-level atlas per subject. We use predicted PLV states (rather than single-trial PLV averages) to improve signal-to-noise and stabilize word-level estimates. Subject-level atlases are then averaged across subjects to form a cross-subject atlas. To test circularity, we rebuild the atlas with embedding change removed (logfreq+POS only) and with word2vec embeddings [ 11 ] , then align axes by correlation. Atlas predictions are generated out-of-fold by run (5-fold): for each fold, models are trained on a subset of runs and used to predict held-out runs, and the word atlas is built from these OOF predictions (full-data weights are saved for reference). 4.3 Axis Discovery We apply ICA to the averaged word atlas and obtain latent axes [ 7 ] . We fix the number of components to 20 a priori for stability across runs. We validate axes using independent label sources: • CKIP POS/NER for function/content, noun/verb, and animate labels [ 9 ] (temporal heuristics used only for exploratory checks) • MELD-SCH concreteness [ 18 , 22 ] and Chinese valence/arousal lexica [ 24 ] Permutation tests confirm axis-label alignment. Axis labels in the paper (e.g., function/content, animacy) are assigned by the strongest atlas - label association and are not selected using steering outcomes. Axis IDs refer to fixed ICA component indices; when comparing across layers or models, we align axis direction by correlation and report signed effects after alignment (orientation is arbitrary). 4.4 LLM Adapter We extract TinyLlama word-level hidden states for all stories [ 25 ] and map them to brain axes using ridge regression (standardized, alpha chosen by CV). This yields an adapter f(h)=Wh+b that predicts axis scores per word. 4.5 Steering We steer TinyLlama by adding a normalized axis vector to hidden states at selected layers during generation. Concretely, for axis k we use the corresponding adapter weight vector W_{k} (scaled back if standardization is used), L2-normalize it, and add \alpha W_{k}/\|W_{k}\| to the hidden state at the chosen layer for all positions in each forward pass (prompt and generated tokens). We test strengths \{-5,-2,-1,0,1,2,5\} over 50 prompts with 4 samples per strength (256 tokens each) using batched generation, and evaluate: • Adapter-score shift (pos vs neg, t-test + permutation) • Strength correlation • Fluency (perplexity) shift • Text-level POS/NER metrics We correct for multiple comparisons across layers and axes with FDR [ 1 ] . 5 Results 5.1 Axis Validation Word-level validation confirms strong axis-label alignment on non-POS lexica: • Animate vs inanimate (confound-controlled): axis 2, residualized d=0.53 (logfreq+surprisal+length), matched d=0.70 with CI [0.53, 0.86] (n=330) • Lexical frequency: axis 15, r=0.51 with logfreq (n=13,632) Lexica validation: concreteness (axis 2, r=-0.128 , p=0.001 ), valence (axis 15, r=0.114 , p=0.001 ), arousal (axis 15, r=0.084 , p=0.001 ). Axis 15 is strongly frequency-linked, so valence/arousal effects are treated as secondary. POS-derived validations (function/content, noun/verb) are reported as sanity checks only (Appendix). Confound control shows that animacy is not driven by logfreq/surprisal/length: axis 2 remains significant after residualization