Evidence for feature-specific error correction in LLMs

Francisco Ferreira da Silva, Stefan Heimersheim · 2026

Read Evidence for feature-specific error correction in LLMs by Francisco Ferreira da Silva, Stefan Heimersheim (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2606-24964.txt.

Description

Francisco Ferreira da Silva and Stefan Heimersheim test a prediction about how large language models compute. Models are assumed to use superposition, packing more features than they have dimensions. Theory says computing in superposition needs error correction that favours feature directions over generic ones. That prediction had never been tested. The authors perturb residual stream activations and watch the response. Activations prove robust to small nudges, forming plateaus that fit error correction.

The asymmetry: models are less robust along feature directions, built from contrastive prompt pairs, than along blends of two such directions. The directions are privileged, as the theory wants. Fitting the response with an Lp norm split sharpens the picture. For contrastive, MELBO, and SAE decoder directions the fitted exponent exceeds two, matching feature specific error correction. Random and PCA control directions sit near two. It replicates across six models, including Gemma, Qwen, Llama, and Mistral.

Catalog record

CREATORFrancisco Ferreira da Silva, Stefan Heimersheim
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE50 KB
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2606.24964

Browse the full library · About the Tower of Babel