Automated Circuit Interpretation via Probe Prompting

Giuseppe Birardi · 2025

Read Automated Circuit Interpretation via Probe Prompting by Giuseppe Birardi (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2511-07002.txt.

Description

Giuseppe Birardi and Gonçalo Paulo propose a way to interpret the internal circuits of a large language model without hand-labeling thousands of parts. Sparse attribution graphs built from cross-layer transcoders capture much of a model's computation, but even short prompts yield graphs with thousands of nodes. Current automated labels come from corpus activations and are rarely checked by intervening on the model.

Their pipeline, probe prompting, groups features into concept-aligned supernodes using their responses to a small set of concept-targeted prompts, summarized as cross-prompt activation signatures. On Gemma-2-2B with a public transcoder dictionary, across four factual domains and more than forty-five thousand entity-swap actions, every labeled supernode showed the predicted steering behavior. Code, data, and an interactive demo accompany the paper.

Catalog record

CREATORGiuseppe Birardi
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE67 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2511-07002

Browse the full library · About the Tower of Babel