Enhancing Automated Interpretability with Output-Centric Feature Descriptions
Yoav Gur-Arieh Roy Mayan Chen Agassy Atticus Geiger Mor Geva, Blavatnik School of Computer Science, AI, Tel Aviv University · 2025
Read Enhancing Automated Interpretability with Output-Centric Feature Descriptions by Yoav Gur-Arieh Roy Mayan Chen Agassy Atticus Geiger Mor Geva, Blavatnik School of Computer Science, AI, Tel Aviv University (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2501-08319.txt.
Description
Yoav Gur-Arieh and co-authors fix a blind spot in how machines name what parts of a language model do. Auto tools most often name a part by the inputs that wake it. Yet a part's true job is set as much by what its wake does to the text that comes next. Their 2025 study steers parts on and off to test if stock names catch that push. They find the names miss the push.
Two cheap out-first fixes are put forth. One reads which words gain weight when a part is prodded. The next reads the part through the model's own word head. Names from the out side catch the push far more true. Blend both sides and scores top each alone. Fair names can make model guts more safe to trust.
Catalog record
| CREATOR | Yoav Gur-Arieh Roy Mayan Chen Agassy Atticus Geiger Mor Geva, Blavatnik School of Computer Science, AI, Tel Aviv University |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 55 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2501-08319