Data-driven Circuit Discovery for Interpretability of Language Models
Daking RaiGeorge Mason University [email protected] Mor GevaTel Aviv University [email protected], Ziyu YaoGeorge Mason University [email protected] · 2026
Read Data-driven Circuit Discovery for Interpretability of Language Models by Daking RaiGeorge Mason University [email protected] Mor GevaTel Aviv University [email protected], Ziyu YaoGeorge Mason University [email protected] (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-09129.txt.
Introduction
Daking Rai, together with Mor Geva and Ziyu Yao, studies how to find the inner circuits that let a language model carry out a task. Their 2026 work questions a common habit: older methods assume every example in a task uses one shared mechanism, then report a single circuit. The authors show mixed data can merge distinct mechanisms into one circuit that still looks faithful.
To handle that mix, they propose Data-driven Circuit Discovery, which groups examples before searching for circuits. Their grouping method clusters examples by their attribution patterns, then finds separate circuits for each group. Across four tasks and three models, the grouped circuits show distinct faithfulness patterns, pointing to real differences in how examples are handled. For interpretability research, the message is that a task label alone may hide several different internal routes to an answer.
Catalog record
| CREATOR | Daking RaiGeorge Mason University [email protected] Mor GevaTel Aviv University [email protected], Ziyu YaoGeorge Mason University [email protected] |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 89 KB |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2605.09129
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Data-driven Circuit Discovery for Interpretability of Language Models Daking RaiGeorge Mason University [email protected] Mor GevaTel Aviv University [email protected], Ziyu YaoGeorge Mason University [email protected] Abstract Circuit discovery aims to explain how language models (LMs) implement a task by localizing and interpreting a circuit: a computational subgraph responsible for the model’s behavior. Existing methods are largely hypothesis-driven : they define a task through a dataset, then run circuit discovery to obtain a single circuit. This workflow makes two assumptions: that the dataset adequately represents the task, and that the model uses a single circuit to solve it. We systematically test these assumptions across four previously studied tasks and find that even minor dataset variations that preserve task semantics can produce circuits with low edge overlap and cross-dataset faithfulness. More strikingly, when discovery is applied to a mixed dataset containing two distinct tasks, existing methods still return a single circuit with high faithfulness on both tasks. These results suggest that existing methods recover dataset-specific circuits that can mix distinct mechanisms into a single circuit, rather than general task circuits . Motivated by these findings, we propose Data-driven Circuit Discovery ( DCD ), a framework that drops the single-circuit-per-task assumption. Rather than discovering one circuit over all examples, DCD first groups examples in the dataset that are processed similarly by the model, then discovers a separate circuit for each group. We find that on a dataset combining multiple tasks, DCD recovers multiple circuits, each specializing to a coherent subset of examples and achieves higher faithfulness than hypothesis-driven methods. Broadly, DCD lets the model’s internal mechanisms determine the scope of each circuit explanation, rather than relying on human-defined task boundaries that may not align with how the model organizes its computation. 1 1 1 We release our datasets and source code at https://github.com/Ziyu-Yao-NLP-Lab/data-driven-circuit-discovery . 1 Introduction Mechanistic interpretability (MI) aims to reverse-engineer the internal mechanisms of LMs into human-understandable explanations [ 19 , 1 , 25 , 8 ] . A prominent paradigm within MI is circuit discovery, which seeks to explain how LMs implement a human-defined task by localizing and interpreting a circuit: a subgraph of the model’s computation graph responsible for implementing the task [ 6 , 29 , 12 , 15 ] . Existing circuit studies [ 6 , 29 , 12 , 13 ] share a common hypothesis-driven workflow (Figure 1 a): define a task, construct a representative dataset, discover a single circuit, and interpret it as the task mechanism. This workflow implicitly assumes that the LM implements the task via a single circuit and that the dataset adequately captures the task as humans understand it . However, datasets used in existing circuit studies are typically narrow, synthetic, and templated, which may not capture the full diversity of inputs the task can encompass, and there is no guarantee that LMs use a single coherent circuit for the task. In fact, recent work has shown that LMs indeed employ multiple distinct mechanisms for a single task, including tasks like arithmetic reasoning [ 18 , 24 ] , factual recall [ 2 ] , entity binding [ 11 ] , syntactic code generation [ 24 ] , and indirect object identification [ 29 , IOI;] . Figure 1 : Comparison of circuit discovery paradigms. (a) Hypothesis-driven: researchers define a task, construct a dataset, and discover a circuit on it, hypothesizing that the single circuit implements the task and that the dataset adequately represents it. (b) Data-driven Circuit Discovery ( DCD ) drops the hypotheses and lets the data determine the structure of discovery. Specifically, it follows a two-stage workflow: first group examples in a dataset with similar computation and then discover one circuit for each group, yielding multiple mechanism-specific circuits. This raises a fundamental question: what is the scope of explanation for a discovered circuit? Do they account for all instances of a task, or only a subset? We hypothesize that if these circuits are truly general task circuits, capturing the full mechanisms underlying the task, then a circuit should generalize to any dataset that preserves the same task semantics; otherwise, calling it a general task circuit is misleading. To test this, we conduct a circuit study across four previously studied common tasks — Indirect Object Identification [ 29 , IOI;] , entity binding [ 21 , 11 ] , arithmetic addition [ 18 , 14 ] , and sequence completion [ 6 ] . We find that circuits discovered using datasets differing only in minor ways (e.g., syntax, complexity, or domain) can have low edge overlap and cross-dataset faithfulness, despite preserving the task semantics. This indicates that hypothesis-driven methods do not discover general task circuits ; instead, the circuits they discover are dataset-specific . To further understand its implications, we construct datasets that combine examples from two distinct tasks whose independently discovered circuits are not mutually faithful. Surprisingly, even in this setting, existing methods recover a single circuit that achieves high faithfulness across both tasks. In other words, hypothesis-driven methods can mix distinct mechanisms in a single circuit. In light of these results, we propose Data-driven Circuit Discovery ( DCD ), a framework that removes the single-circuit-per-task assumption of hypothesis-driven methods (Figure 1 b). DCD follows a two-stage workflow: it first groups examples by how similarly the LM processes them, then performs circuit discovery independently within each group. The first step of DCD removes the assumption that all instances in the dataset are processed by LMs using a single mechanism. In fact, DCD can handle datasets that consist of multiple tasks, as instances that do not share mechanisms are naturally separated into different groups. Next, DCD performs independent circuit discovery for each group; since each circuit is derived from examples with similar mechanisms, the resulting circuits are more likely to reflect a single coherent mechanism. Our experimental results show that DCD can identify multiple circuits in datasets containing examples from multiple tasks, and discover circuits that are both sparser and more faithful than those found by hypothesis-driven methods. We highlight our contributions as follows: • We conduct circuit studies across four previously studied common tasks and find that existing circuit discovery methods do not discover general task circuits; instead, dataset-specific circuits that can mix distinct mechanisms. • We propose Data-driven Circuit Discovery ( DCD ), a framework that allows the discovery of multiple distinct circuits in a dataset, each explaining its own group rather than the full task. • We empirically validate DCD on both multi-task and single-task datasets, showing that it discovers multiple circuits with distinct mechanisms in each setting and can produce more faithful sparser circuits than hypothesis-driven methods. 2 Background and notations In this section, we introduce the notions of circuits and tasks, describe the hypothesis-driven approach to circuit discovery, and give an outline of our research investigation. Circuit and task The goal of circuit study is to understand how LMs implement a specific task by localizing the circuit and interpreting it as human-understandable algorithms. Formally, we represent the LM as a directed computation graph G=(N,E) , where each node n\in N corresponds to a distinct model component (e.g., the layer 5 MLP, or attention head 10 at layer 6) and each edge (n_{1},n_{2})\in E represents a direct causal