ICE: Intervention-Consistent Explanation Evaluation with Statistical Grounding for LLMs

Abhinaba Basu, Pavan Chakraborty · 2026

Read ICE: Intervention-Consistent Explanation Evaluation with Statistical Grounding for LLMs by Abhinaba Basu, Pavan Chakraborty (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-18579.txt.

Introduction

Basu and Chakraborty ask whether model explanations stay faithful when the test method changes. Their ICE framework checks explanations against random baselines of the same size. It uses several intervention operators across seven models and four tasks. Switching operators flips the verdict in 18 percent of attention comparisons. Gaps reach 44 points. Random baselines expose explanations worse than chance in near one third of English deletion tests. The pattern holds across six other languages and two attribution methods.

Catalog record

CREATORAbhinaba Basu, Pavan Chakraborty
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE41919
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2603.18579

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

ICE: Intervention-Consistent Explanation Evaluation with Statistical Grounding for LLMs Abhinaba Basu, Pavan Chakraborty Abstract Evaluating whether explanations faithfully reflect a model’s reasoning remains an open problem. Existing benchmarks use single interventions without statistical testing, making it impossible to distinguish genuine faithfulness from chance-level performance. We introduce ICE (Intervention-Consistent Explanation), a framework that compares explanations against matched random baselines via randomization tests under multiple intervention operators, yielding win rates with confidence intervals. Evaluating 7 LLMs across 4 English tasks, 6 non-English languages, and 2 attribution methods, we find that faithfulness is operator-dependent: operator gaps reach up to 44 percentage points, with deletion typically inflating estimates on short text but the pattern reversing on long text, suggesting that faithfulness should be interpreted comparatively across intervention operators rather than as a single score. Randomized baselines reveal anti-faithfulness in one-third of configurations, and faithfulness shows zero correlation with human plausibility ( | r | < 0.04 |r|<0.04 ). Multilingual evaluation reveals dramatic model-language interactions not explained by tokenization alone. We release the ICE framework and ICEBench benchmark. 1 Introduction Consider a sentiment model that correctly classifies “gorgeous, witty, seductive movie” as positive with 78% confidence. You ask: which words drove the prediction? Gradient attribution highlights “a” and “movie”—function words with no sentiment. Attention highlights “gorgeous” and “seductive”—the actual sentiment signal. The gradient explanation is not just unhelpful; it is anti-faithful , performing worse than randomly selected tokens in 100% of trials. This example illustrates a fundamental problem: we lack rigorous tools to tell faithful explanations from misleading ones. ERASER DeYoung et al. 2020 , the standard benchmark, reports raw sufficiency and comprehensiveness scores without statistical testing—a sufficiency of 0.62 might be noise. It uses a single intervention (deletion), which can inflate faithfulness by creating out-of-distribution (OOD) inputs that degrade any prediction, not just those relying on the highlighted tokens Hase et al. 2021 . And it cannot detect anti-faithfulness at all, since it lacks random baselines. We introduce ICE (Intervention-Consistent Explanation), a framework that addresses these gaps. ICE asks a simple question: do the tokens identified by an explanation method outperform randomly selected tokens? By comparing explanations against matched random baselines under identical interventions, ICE cancels out-of-distribution (OOD) artifacts and provides statistically grounded answers with confidence intervals. Our central claim is that attribution-faithfulness is not a single number that can be read off from one intervention. It is an operator-dependent quantity : different operators introduce different biases—deletion creates OOD inputs that can inflate or deflate estimates depending on text length, while retrieval infill preserves surface form but may introduce competing signals. When operators agree, the evidence for genuine faithfulness is strong regardless of these biases; when they disagree, the gap quantifies methodological uncertainty. ICE makes this dependence explicit through randomized baselines and operator-aware evaluation. We evaluate 7 LLMs across 4 English tasks, 6 non-English languages, and 2 attribution methods (attention, gradient). Our key contributions: 1. Operator-aware faithfulness : Intervention choice materially changes conclusions, with operator gaps reaching 8–44 percentage points. The direction of the gap is text-length dependent. Faithfulness should be interpreted as an operator-dependent quantity, not a single score. 2. Statistical grounding : Randomized baselines with win rates, effect sizes, and bootstrap CIs distinguish genuine faithfulness from chance and detect anti-faithfulness—invisible without random baselines—in nearly one-third of configurations. 3. Cross-lingual and cross-architecture generalization : These effects generalize across 6 non-English languages (4 scripts, 5 families) and encoder models, exposing model-language interactions and failures invisible to standard English-only benchmarks. More broadly, our results suggest that faithfulness evaluation should be interpreted comparatively across intervention regimes rather than reduced to a single benchmark score. Roadmap. We position ICE within faithfulness evaluation (§2), present the framework (§3), describe our experimental setup (§4), report results (§5), and analyze key findings including operator effects (§6). 2 Related Work ERASER DeYoung et al., 2020 Sufficiency + comprehensiveness; single operator Kamp et al. 2023 Dynamic top- k ; disagreement analysis F-Fidelity Zhang et al., 2025 Fine-tuning for OOD correction Atanasova et al. 2020 Faithfulness, plausibility, simulatability Sun et al. NAACL 2025 3 explanation types; 4 properties; unified metrics ICE (Ours) 2026 Randomization tests; multi-operator; retrieval infill; LLM-native Evaluation methodology Scope expansion Statistical rigor Figure 1: Evolution of faithfulness evaluation frameworks. ICE builds on evaluation methodology ( blue ) and scope expansion ( green ), adding statistical rigor ( orange ) via randomization testing and operator-consistent evaluation. Arrows show methodological lineage. 2.1 Faithfulness Evaluation Frameworks The evolution from single-metric evaluation to statistically grounded frameworks (Figure 1 ) motivates ICE’s design. ERASER and its legacy. ERASER DeYoung et al. 2020 introduced sufficiency and comprehensiveness as standard faithfulness metrics but has three limitations ICE addresses: no statistical testing, a single deletion operator that conflates faithfulness with OOD degradation, and no random baselines to detect anti-faithfulness. Our retrieval infill results (§ 6.2 ) show operator gaps reaching up to 44 percentage points. Subsequent frameworks. Sun et al. 2025 compare explanation types across several evaluation properties under fixed interventions; ICE asks whether the evaluation itself remains stable when the intervention regime changes. This is a deeper methodological question: Sun treats operator choice as implementation; ICE elevates it to a first-class variable. Crucially, Sun et al. still rely on raw scores without random baselines. Kamp et al. 2023 show that dynamically estimating top- k reduces attribution disagreement; our k -sensitivity analysis (Appendix D ) confirms faithfulness conclusions can reverse depending on k . Kamp et al. 2025 find that training on sufficient rationales does not consistently improve faithfulness—our “Lucky Tokens” category captures a similar phenomenon. F-Fidelity Zheng et al. 2025 addresses OOD via fine-tuning; ICE controls for OOD at the evaluation protocol level. Zaman and Srivastava 2025 apply a causal lens and find no single metric works across all tasks, echoing our finding that operator choice changes conclusions. 2.2 The Faithfulness-Plausibility Distinction Jacovi and Goldberg 2020 define faithfulness as a graded property distinct from plausibility, arguing both require independent evaluation. Parcalabescu and Frank 2024 argue many faithfulness tests actually measure self-consistency rather than mechanistic transparency. ICE acknowledges this limitation but argues that behavioral faithfulness, when statistically grounded, remains the most scalable evaluation for billion-parameter models. We contribute quantitative evidence: zero correlation ( |r|<0.04 ) between ICE faithfulness and human rationale alignment across three models. 2.3 Attribution Methods for LLMs Attention remains foundational for transformers; gradient faces memory and instability challenges in large LLMs. Madsen et al. 2024 find faithfulness is explanation-type, model, and task-dependent, reinforcing ICE’s multi-method evaluation. We include Integrated Gradients for encoder baselines but omit it for 7B+ LLMs due to memory constraints. 2.4 Multilingual Explainability and Statistical Methods Surveys Resck et al. 2025 highlight the need for cross-lingual faithfulness analysis, while studies Zhao and Aletras 2024 suggest larger multilingual models may produce less faithful explanations. Prior multilingual work evaluates plausibility rather than faithfulness and lacks statistical rigor. Permutation-based testing Mandel and Barnett 2024 ; Biswas et al. 2025 provides the statistical foundation ICE builds on. 2.5 Comparison with Prior Frameworks Aspect ERA Sun Mad F-Fid ICE Stat. testing ✗ ✗ ✗ ✗ ✓ Uncertainty ✗ ✗ ✗ ✗ ✓ LLM support ✗ ✗ Ltd ✗ Native Multilingual ✗ ✗ ✗ ✗ 6 langs Multi-operator ✗ Part Part ✗ ✓ OOD mitigation ✗ ✗ ✗

Read the complete text