Position: Causality is Key for Interpretability Claims to Generalise
Shruti Joshi, Aaron Mueller, David Klindt, Wieland Brendel, Patrik Reizinger, Dhanya Sridhar · 2026
Read Position: Causality is Key for Interpretability Claims to Generalise by Shruti Joshi, Aaron Mueller, David Klindt, Wieland Brendel, Patrik Reizinger, Dhanya Sridhar (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2602-16698.txt.
Description
Shruti Joshi and co-authors argue that causality is key to interpretability claims about large language models. Interpretability work has yielded real insights, yet findings often fail to generalize and causal readings often outrun the evidence. The authors hold that causal inference sets what counts as a valid map from activations to high-level structures, what data or assumptions it needs, and what inferences it can support.
Pearl's causal ladder clarifies the stakes. Observations give associations. Interventions such as ablations or activation patching support claims about edit effects on a metric. Counterfactual claims about the same prompt under an unseen edit stay largely unverifiable without controlled supervision. Causal representation learning operationalizes the ladder, and a diagnostic frame helps practitioners pick methods and tests that fit their claims.
Catalog record
| CREATOR | Shruti Joshi, Aaron Mueller, David Klindt, Wieland Brendel, Patrik Reizinger, Dhanya Sridhar |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 119 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2602-16698