Enhancing Automated Interpretability with Output-Centric Feature Descriptions

Yoav Gur-Arieh Roy Mayan Chen Agassy Atticus Geiger Mor Geva, Blavatnik School of Computer Science, AI, Tel Aviv University · 2025

Read Enhancing Automated Interpretability with Output-Centric Feature Descriptions by Yoav Gur-Arieh Roy Mayan Chen Agassy Atticus Geiger Mor Geva, Blavatnik School of Computer Science, AI, Tel Aviv University (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2501-08319.txt.

Description

Yoav Gur-Arieh and co-authors fix a blind spot in how machines name what parts of a language model do. Auto tools most often name a part by the inputs that wake it. Yet a part's true job is set as much by what its wake does to the text that comes next. Their 2025 study steers parts on and off to test if stock names catch that push. They find the names miss the push.

Two cheap out-first fixes are put forth. One reads which words gain weight when a part is prodded. The next reads the part through the model's own word head. Names from the out side catch the push far more true. Blend both sides and scores top each alone. Fair names can make model guts more safe to trust.

Catalog record

CREATORYoav Gur-Arieh Roy Mayan Chen Agassy Atticus Geiger Mor Geva, Blavatnik School of Computer Science, AI, Tel Aviv University
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE55 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2501-08319

Browse the full library · About the Tower of Babel