Beyond Input Activations: Identifying Influential Latents by Gradient Sparse Autoencoders

Dong Shu, Xuansheng Wu, Haiyan Zhao, Mengnan Du, Ninghao Liu · 2025

Read Beyond Input Activations: Identifying Influential Latents by Gradient Sparse Autoencoders by Dong Shu, Xuansheng Wu, Haiyan Zhao, Mengnan Du, Ninghao Liu (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2505-08080.txt.

Description

Dong Shu and co-authors wrote a 2025 paper on finding the inner features of a language model that truly drive its output. Sparse autoencoders unpack model activity into readable features, but most checks only watch which features switch on. The authors argue that switched on features do not pull equal weight.

Their method adds output side gradient data to rank features by real causal pull. Only high pull features, they hold, can steer a model well. The approach is simple and, by their tests, effective. It moves interpretation from what lights up to what actually matters, a shift with stakes for control and safety work.

Catalog record

CREATORDong Shu, Xuansheng Wu, Haiyan Zhao, Mengnan Du, Ninghao Liu
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE33 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2505-08080

Browse the full library · About the Tower of Babel