Understanding sparse autoencoder scaling in the presence of feature manifolds
Eric J. Michaud, Liv Gorton, Tom McGrath · 2025
Read Understanding sparse autoencoder scaling in the presence of feature manifolds by Eric J. Michaud, Liv Gorton, Tom McGrath (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2509-02565.txt.
Description
Eric J. Michaud, Liv Gorton, and Tom McGrath wrote a 2025 paper on sparse autoencoders. These tools rewrite a network's inner activity as a sparse mix of feature directions. How well they rebuild activity, as features grow, follows scaling laws. Those laws need an account.
The authors adapt a capacity model from scaling research. Some features form multi-dimensional manifolds. A manifold is a surface, not a single direction. Such features change the picture. Distinct scaling regimes seen in practice reappear in the model. In one regime, manifolds cause a pathology. The autoencoder learns far fewer real features than it has slots for. The authors ask if practical autoencoders sit in that bad regime. The answer bears on trust in interpretability claims.
Catalog record
| CREATOR | Eric J. Michaud, Liv Gorton, Tom McGrath |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 29 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2509-02565