Beyond Input Activations: Identifying Influential Latents by Gradient Sparse Autoencoders
Dong Shu, Xuansheng Wu, Haiyan Zhao, Mengnan Du, Ninghao Liu · 2025
Read Beyond Input Activations: Identifying Influential Latents by Gradient Sparse Autoencoders by Dong Shu, Xuansheng Wu, Haiyan Zhao, Mengnan Du, Ninghao Liu (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2505-08080.txt.
Description
Dong Shu and co-authors wrote a 2025 paper on finding the inner features of a language model that truly drive its output. Sparse autoencoders unpack model activity into readable features, but most checks only watch which features switch on. The authors argue that switched on features do not pull equal weight.
Their method adds output side gradient data to rank features by real causal pull. Only high pull features, they hold, can steer a model well. The approach is simple and, by their tests, effective. It moves interpretation from what lights up to what actually matters, a shift with stakes for control and safety work.
Catalog record
| CREATOR | Dong Shu, Xuansheng Wu, Haiyan Zhao, Mengnan Du, Ninghao Liu |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 33 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2505-08080