BlackboxNLP-2025 MIB Shared Task: Improving Circuit Faithfulness via Better Edge Selection

Yaniv Nikankin, Dana Arad, Itay Itzhak, Adi Simhi, Gal Kesten-Pomeranz, Yonatan Belinkov · 2025

Read BlackboxNLP-2025 MIB Shared Task: Improving Circuit Faithfulness via Better Edge Selection by Yaniv Nikankin, Dana Arad, Itay Itzhak, Adi Simhi, Gal Kesten-Pomeranz, Yonatan Belinkov (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2510-25786.txt.

Introduction

Yaniv Nikankin led six co-authors improving circuit faithfulness. Dana Arad, Itay Itzhak, and Anja Reusch helped. Adi Simhi, Gal Kesten-Pomeranz, and Yonatan Belinkov joined. Their 2025 paper tackles circuit discovery in mechanistic interpretability. Determining which model parts perform tasks is challenging. The Mechanistic Interpretability Benchmark supplies their testing setting. Three key improvements to circuit discovery are proposed.

Edge choice is central to circuit discovery quality. Second, a ratio-based choice strategy prioritizes strong edges. Positive-scoring edges are balanced for results and faithfulness. Third, integer linear programming replaces standard greedy choice. Their methods yield more faithful circuits overall. Faithful circuits help explain how models compute answers. Code is ready publicly for other scholars.

Catalog record

CREATORYaniv Nikankin, Dana Arad, Itay Itzhak, Adi Simhi, Gal Kesten-Pomeranz, Yonatan Belinkov
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE18 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2510-25786

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

BlackboxNLP-2025 MIB Shared Task: Improving Circuit Faithfulness via Better Edge Selection Yaniv Nikankin, Dana Arad, Itay Itzhak, Adi Simhi, Gal Kesten-Pomeranz, Yonatan Belinkov Abstract One of the main challenges in mechanistic interpretability is circuit discovery—determining which parts of a model perform a given task. We build on the Mechanistic Interpretability Benchmark (MIB) and propose three key improvements to circuit discovery. First, we use bootstrapping to identify edges with consistent attribution scores. Second, we introduce a simple ratio-based selection strategy to prioritize strong positive-scoring edges, balancing performance and faithfulness. Third, we replace the standard greedy selection with an integer linear programming formulation. Our methods yield more faithful circuits and outperform prior approaches across multiple MIB tasks and models. Our code is available at: https://github.com/technion-cs-nlp/MIB-Shared-Task . 1 Introduction Mechanistic interpretability has gained recent popularity due to its progress in characterizing the internal mechanisms of AI models Saphra and Wiegreffe 2024 ; Rai et al. 2024 . A popular paradigm aims to uncover circuits , subgraphs of the model’s computation graph that are responsible for specific tasks Olah et al. 2020 . However, discovering optimal circuits that are as small as possible while matching the original model’s behavior remains an open challenge. To this end, the recent Mechanistic Interpretability Benchmark (MIB) Mueller et al. 2025 was proposed to offer a standardized framework for evaluating circuit discovery methods. A typical circuit discovery pipeline consists of two stages: (1) obtaining scores for the full set of graph components (nodes, edges, etc.), and (2) selecting a subset of the components that constitute the circuit. Prior work has largely focused on developing improved scoring methods for the first stage, such as Edge Attribution Patching (EAP) ( Nanda 2023 ) and EAP with Integrated Gradients (EAP-IG) ( Hanna et al. 2024 ) , while relying on a greedy selection algorithm for the second stage. Using this setup, Mueller et al. 2025 demonstrated that EAP-IG scores led to the top-preforming subgraphs. In this work, as a part of the BlackboxNLP 2025 Shared Task Arad et al. 2025 , we focus on the second stage of circuit discovery and suggest several improvements for building a circuit given EAP-IG scores. We rely on a few key observations. First, EAP-IG scores can vary across data samples from the same task, with some edges receiving both negative and positive values in different samples. The score sign represents a significant property: positive-scoring components contribute positively to the model’s performance on the task, while negative scores indicate a negative impact, such as the negative name mover heads from Wang et al. 2023 . By bootstrapping the scores across resamples of the training data, we are able to identify edges with consistent score signs and filter out unstable ones. Second, we find that selecting edges by score magnitude alone, ignoring sign, often yields circuits that misrepresent the model’s original behavior. To address this, we introduce a simple ratio-based strategy: select a fixed proportion of top-positive edges, and the rest by absolute value. This approach allows finer control over the balance of edge types and improves circuit faithfulness. Lastly, we formulate circuit construction as an Integer Linear Programming (ILP) optimization problem, instead of using the naive greedy solution. Overall, we show that different combinations of our methods, tailored to the different faithfulness objectives proposed by MIB, yield improved performance over the leading approaches. IOI MCQA ARC (E) Method GPT-2 Qwen-2.5 Gemma-2 Qwen-2.5 Gemma-2 Gemma-2 CMD Baseline (Greedy) 0.0308 0.0374 0.0658 0.1846 0.0880 0.0458 CMD (ILP + PNR) 0.0294 0.0370 0.0760 0.1820 0.0907 0.0451 CPR Baseline (Greedy) 2.4901 2.2658 5.6155 1.0612 1.8769 1.9104 CPR (ILP + Bootstrapping) 2.5061 2.5092 5.4516 1.0926 1.9145 1.8918 Table 1: Comparison of our chosen methods against the baseline for CMD (lower is better) and CPR (higher is better) metrics on the public test sets. 2 Motivation Circuit discovery follows a two-stage pipeline: scoring and selection. In the scoring stage, each component of the model’s computation graph is given an importance score; in this submission we consider edges as our basic computation components and utilize Edge Attribution Patching with Integrated Gradients (EAP-IG) as our base scoring metric. We use EAP-IG as it obtained the best score on MIB across most of the models and tasks. While EAP-IG is typically computed once over the entire training set, applying it to multiple data subsets reveals an interesting pattern. In GPT-2 + IOI and Qwen-2.5 + MCQA, we find that 9.1 % and 6.5 % of edges, respectively, exhibit sign instability with both positive and negative scores across 10 samples. 1 1 1 Only edges with non-zero mean scores |\mu|>10^{-6} . Since sign indicates whether an edge contributes positively or negatively to circuit performance, instability may signal noisy attribution scores. By applying bootstrapping , we can filter out unstable edges before constructing the graph. After scoring each edge, the selection stage follows in which a subset of edges is selected to form the circuit. In this stage, Mueller et al. 2025 employ the approach of using a greedy, layer-by-layer algorithm ( Hanna et al. 2024 ) . The greedy algorithm starts from the output layer and works backward, adding the top-ranked edges needed to compute the activations of already selected components. The resulting graph is pruned to remove non-connected components, resulting in a connected subgraph. To evaluate circuits, Mueller et al. 2025 define two metrics based on the faithfulness curve with respect to circuit size. The integrated circuit performance ratio ( CPR ) measures how well the method identifies components that positively contribute to the model’s performance on a task, and is defined as the area under the curve. In contrast, the integrated circuit-model distance ( CMD ) quantifies how closely the circuit approximates the model’s overall behavior, including positive and negative contributions, and is defined as the area between the faithfulness curve and the optimal value of 1 . Thus, in the MIB implementation edges are ranked differently between the two metrics. For CPR edges are simply ranked by their scores, whereas for CMD the ranking is based on their absolute scores. We observe that for CMD , this may lead to over-selection of negatively scoring edges, which can degrade the circuit’s faithfulness. To mitigate this, we propose a positive-negative ratio (PNR) strategy: first select a given percentage of top-positive edges, then apply the usual selection. While the greedy algorithm is fast and guarantees a valid circuit, it relies solely on local decisions and may result in suboptimal edge selection. Thus, we formulate circuit selection as an integer linear program (ILP) for globally optimal subset selection under structural and budget constraints. 3 Method In this section, we describe three methods for improving circuit construction, which can be applied individually or in combination. 3.1 Bootstrapped Confidence Filtering We use bootstrapping to identify edges with consistently-signed attribution scores, since these are more likely to reflect meaningful structure in the model. For a dataset of size N , we sample with replacement to obtain \tau sets with N samples each. For each edge e , we collect a set of scores \{a_{1},\ldots,a_{\tau}\} from the \tau bootstrap runs. We compute the sample mean \mu_{e} and standard deviation \sigma_{e} , then construct a two-sided confidence interval: \mu_{e}\pm z\cdot\frac{\sigma_{e}}{\sqrt{\tau}}, (1) where \mu_{e}

Read the complete text