Evaluating SAE interpretability without explanations

Gonçalo Paulo, Nora Belrose · 2025

Read Evaluating SAE interpretability without explanations by Gonçalo Paulo, Nora Belrose (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2507-08473.txt.

Description

Gonçalo Paulo and Nora Belrose wrote this 2025 paper on how to judge sparse autoencoders. These tools split a neural network's signals into single features that people can inspect. Most tests first write a short gloss for each feature, then grade that gloss. The authors argue that the gloss itself can distort the score.

They adapt older tests so they score the features directly, with no gloss step. Their scores are then compared with human ratings across varied tasks and setups. Readers get a cleaner way to tell whether a feature truly means what it seems to mean. The paper also offers advice for making such tests a shared standard.

Catalog record

CREATORGonçalo Paulo, Nora Belrose
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE25 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2507-08473

Browse the full library · About the Tower of Babel