Evidence for feature-specific error correction in LLMs
Francisco Ferreira da Silva, Stefan Heimersheim · 2026
Read Evidence for feature-specific error correction in LLMs by Francisco Ferreira da Silva, Stefan Heimersheim (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2606-24964.txt.
Description
Francisco Ferreira da Silva and Stefan Heimersheim test a prediction about how large language models compute. Models are assumed to use superposition, packing more features than they have dimensions. Theory says computing in superposition needs error correction that favours feature directions over generic ones. That prediction had never been tested. The authors perturb residual stream activations and watch the response. Activations prove robust to small nudges, forming plateaus that fit error correction.
The asymmetry: models are less robust along feature directions, built from contrastive prompt pairs, than along blends of two such directions. The directions are privileged, as the theory wants. Fitting the response with an Lp norm split sharpens the picture. For contrastive, MELBO, and SAE decoder directions the fitted exponent exceeds two, matching feature specific error correction. Random and PCA control directions sit near two. It replicates across six models, including Gemma, Qwen, Llama, and Mistral.
Catalog record
| CREATOR | Francisco Ferreira da Silva, Stefan Heimersheim |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 50 KB |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2606.24964