Automated Interpretability and Feature Discovery in Language Models with Agents

Arnau Marin-Llobet, Javier Ferrando · 2026

Read Automated Interpretability and Feature Discovery in Language Models with Agents by Arnau Marin-Llobet, Javier Ferrando (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-01555.txt.

Description

Arnau Marin-Llobet and Javier Ferrando automate the detective work of mechanistic interpretability, the effort to say what single neurons and features inside a language model actually do. Hand labeling is slow, and one-shot machine labels are often vague stories that no test could refute.

Their multi-agent system runs two linked loops. In one, an agent proposes rival explanations for a feature and refines them with targeted prompt controls and several scoring metrics. In the other, an agent builds prompt sets, graphs activations by closeness, and pulls out candidate features using separability and coherence tests. Tested on the Gemma-2 family and on sparse transformer neurons, the system beats one-shot auto-labels, finds language-specific and safety-relevant features, and leaves an audit trail for each claim. The authors argue that loops of testable guesses beat single confident labels.

Catalog record

CREATORArnau Marin-Llobet, Javier Ferrando
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE78 KB
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2605.01555

Browse the full library · About the Tower of Babel