Understanding sparse autoencoder scaling in the presence of feature manifolds

Eric J. Michaud, Liv Gorton, Tom McGrath · 2025

Read Understanding sparse autoencoder scaling in the presence of feature manifolds by Eric J. Michaud, Liv Gorton, Tom McGrath (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2509-02565.txt.

Description

Eric J. Michaud, Liv Gorton, and Tom McGrath wrote a 2025 paper on sparse autoencoders. These tools rewrite a network's inner activity as a sparse mix of feature directions. How well they rebuild activity, as features grow, follows scaling laws. Those laws need an account.

The authors adapt a capacity model from scaling research. Some features form multi-dimensional manifolds. A manifold is a surface, not a single direction. Such features change the picture. Distinct scaling regimes seen in practice reappear in the model. In one regime, manifolds cause a pathology. The autoencoder learns far fewer real features than it has slots for. The authors ask if practical autoencoders sit in that bad regime. The answer bears on trust in interpretability claims.

Catalog record

CREATOREric J. Michaud, Liv Gorton, Tom McGrath
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE29 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2509-02565

Browse the full library · About the Tower of Babel