Tracking Equivalent Mechanistic Interpretations Across Neural Networks

Alan Sun, Mariya Toneva · 2026

Read Tracking Equivalent Mechanistic Interpretations Across Neural Networks by Alan Sun, Mariya Toneva (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-30002.txt.

Description

Sun and Toneva tackle a basic gap in reading neural nets: when do two models share one explanation? There is still no precise test for a valid reading of a model. Finding such readings is often ad hoc work. They define interpretive equivalence between two models. Two readings count as the same when all ways to build them match. Their algorithm gauges this link in transformer models. Similarity of internal states gives the exact test for that link.

Catalog record

CREATORAlan Sun, Mariya Toneva
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE116183
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2603.30002

Browse the full library · About the Tower of Babel