Automated Circuit Interpretation via Probe Prompting
Giuseppe Birardi · 2025
Read Automated Circuit Interpretation via Probe Prompting by Giuseppe Birardi (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2511-07002.txt.
Description
Giuseppe Birardi and Gonçalo Paulo propose a way to interpret the internal circuits of a large language model without hand-labeling thousands of parts. Sparse attribution graphs built from cross-layer transcoders capture much of a model's computation, but even short prompts yield graphs with thousands of nodes. Current automated labels come from corpus activations and are rarely checked by intervening on the model.
Their pipeline, probe prompting, groups features into concept-aligned supernodes using their responses to a small set of concept-targeted prompts, summarized as cross-prompt activation signatures. On Gemma-2-2B with a public transcoder dictionary, across four factual domains and more than forty-five thousand entity-swap actions, every labeled supernode showed the predicted steering behavior. Code, data, and an interactive demo accompany the paper.
Catalog record
| CREATOR | Giuseppe Birardi |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 67 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2511-07002