Position: Causality is Key for Interpretability Claims to Generalise

Shruti Joshi, Aaron Mueller, David Klindt, Wieland Brendel, Patrik Reizinger, Dhanya Sridhar · 2026

Read Position: Causality is Key for Interpretability Claims to Generalise by Shruti Joshi, Aaron Mueller, David Klindt, Wieland Brendel, Patrik Reizinger, Dhanya Sridhar (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2602-16698.txt.

Description

Shruti Joshi and co-authors argue that causality is key to interpretability claims about large language models. Interpretability work has yielded real insights, yet findings often fail to generalize and causal readings often outrun the evidence. The authors hold that causal inference sets what counts as a valid map from activations to high-level structures, what data or assumptions it needs, and what inferences it can support.

Pearl's causal ladder clarifies the stakes. Observations give associations. Interventions such as ablations or activation patching support claims about edit effects on a metric. Counterfactual claims about the same prompt under an unseen edit stay largely unverifiable without controlled supervision. Causal representation learning operationalizes the ladder, and a diagnostic frame helps practitioners pick methods and tests that fit their claims.

Catalog record

CREATORShruti Joshi, Aaron Mueller, David Klindt, Wieland Brendel, Patrik Reizinger, Dhanya Sridhar
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE119 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2602-16698

Browse the full library · About the Tower of Babel