Evaluating SAE interpretability without explanations
Gonçalo Paulo, Nora Belrose · 2025
Read Evaluating SAE interpretability without explanations by Gonçalo Paulo, Nora Belrose (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2507-08473.txt.
Description
Gonçalo Paulo and Nora Belrose wrote this 2025 paper on how to judge sparse autoencoders. These tools split a neural network's signals into single features that people can inspect. Most tests first write a short gloss for each feature, then grade that gloss. The authors argue that the gloss itself can distort the score.
They adapt older tests so they score the features directly, with no gloss step. Their scores are then compared with human ratings across varied tasks and setups. Readers get a cleaner way to tell whether a feature truly means what it seems to mean. The paper also offers advice for making such tests a shared standard.
Catalog record
| CREATOR | Gonçalo Paulo, Nora Belrose |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 25 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2507-08473