Learning Multi-Level Features with Matryoshka Sparse Autoencoders
Bart Bussmann, Noa Nabeshima, Adam Karvonen, Neel Nanda · 2025
Read Learning Multi-Level Features with Matryoshka Sparse Autoencoders by Bart Bussmann, Noa Nabeshima, Adam Karvonen, Neel Nanda (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2503-17547.txt.
Introduction
Bart Bussmann, Noa Nabeshima, Adam Karvonen, and Neel Nanda redesign sparse autoencoders, a tool for reading the concepts inside a neural network, in a paper published in two thousand twenty-five. These tools learn a dictionary of features from a network's activity, but the dictionary's size forces an awkward trade-off.
Make the dictionary bigger and the pressure for sparsity splits broad features into narrow ones, warping or erasing the high-level ideas. The team's Matryoshka variant trains several nested dictionaries at once, from small to large. Each smaller dictionary must rebuild the input on its own, without leaning on the bigger ones. That pressure sorts features into levels: small dictionaries hold general concepts, larger ones add specifics. High-level features survive instead of being absorbed. The design borrows its name from nesting dolls, and it aims to give interpreters a cleaner map of what a network knows.
Catalog record
| CREATOR | Bart Bussmann, Noa Nabeshima, Adam Karvonen, Neel Nanda |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 53 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2503-17547
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Learning Multi-Level Features with Matryoshka Sparse Autoencoders Bart Bussmann, Noa Nabeshima, Adam Karvonen, Neel Nanda Abstract Sparse autoencoders (SAEs) have emerged as a powerful tool for interpreting neural networks by extracting the concepts represented in their activations. However, choosing the size of the SAE dictionary (i.e. number of learned concepts) creates a tension: as dictionary size increases to capture more relevant concepts, sparsity incentivizes features to be split or absorbed into more specific features, leaving high-level features missing or warped. We introduce Matryoshka SAEs, a novel variant that addresses these issues by simultaneously training multiple nested dictionaries of increasing size, forcing the smaller dictionaries to independently reconstruct the inputs without using the larger dictionaries. This organizes features hierarchically - the smaller dictionaries learn general concepts, while the larger dictionaries learn more specific concepts, without incentive to absorb the high-level features. We train Matryoshka SAEs on Gemma-2-2B and TinyStories and find superior performance on sparse probing and targeted concept erasure tasks, more disentangled concept representations, and reduced feature absorption. While there is a minor tradeoff with reconstruction performance, we believe Matryoshka SAEs are a superior alternative for practical tasks, as they enable training arbitrarily large SAEs while retaining interpretable features at different levels of abstraction. † † affiliationnotice: Equal contribution Figure 1: Architecture and Performance of Matryoshka SAEs. (Left) The model learns multiple nested reconstructions simultaneously, with each reconstruction using only a subset of the total latents. This creates pressure for early latents to capture general features while later latents can specialize in more specific concepts. (Right) Comparative metrics between SAEs with average sparsity of 40 active latents per token (L0=40) showing that while Matryoshka SAEs sacrifice a small amount of reconstruction fidelity (higher variance unexplained), they achieve significantly lower feature absorption rates and less feature composition (lower decoder cosine similarity). 1 Introduction Sparse autoencoders (SAEs) have emerged as a powerful tool for interpreting the internal representations of neural networks ( Bricken et al., 2023 ; Cunningham et al., 2023 ) . By training autoencoders to map dense activations of neural networks into a sparse latent space, researchers aim to extract meaningful, human-interpretable features that provide insight into a model’s decision-making process. In practice, however, sparsity is only an imperfect proxy for interpretability; optimizing to represent inputs using as few active latents as possible can lead to pathological solutions. A core issue lies in the mismatch between the flat sparsity objective and the inherent hierarchical structure of real-world features. For example, a broad, general concept (e.g. “punctuation marks”) might be a parent feature to more specific ones (“punctuation mark and period”, “punctuation mark and question mark,” and “punctuation mark and comma”). When an SAE has the capacity to learn many latents, the sparsity penalty can push it to replace each general concept with a set of narrowly specialized features without retaining the original high-level category—a phenomenon called feature splitting ( Bricken et al., 2023 ) . Even more problematic is feature absorption ( Chanin et al., 2024 ) , where a parent feature only partially splits and a number of specific instances of a general feature are absorbed by more specialized latents, leaving “holes” in the representation of the more general feature (e.g. a latent that activates on all tokens starting with an E, except if the word is Elephant). Finally, feature composition occurs when the SAE merges distinct concepts (like “red” and “triangle”) into single composite features (”red triangle”) to minimize the number of active latents, instead of learning the underlying features ( Anders et al., 2024 ; Wattenberg & Viégas, 2024 ; Leask et al., 2025 ) . These problems become more severe as SAEs scale to larger dictionary sizes (i.e., more learned concepts), since the model exploits the additional capacity to further minimize active latents through mechanisms like feature splitting ( Karvonen et al., 2024a ) . This presents a stark contrast to typical deep learning, where scaling consistently improves both training loss and model capabilities ( Kaplan et al., 2020 ; Hoffmann et al., 2022 ) . While larger SAEs do achieve lower training loss ( Gao et al., 2024 ; Templeton, 2024 ) , their performance on downstream tasks often deteriorates ( Karvonen et al., 2024a ) . This fundamental tension creates significant practical challenges for deploying SAEs in interpretability research - they become less reliable for probing model behavior, steering models, analyzing feature circuits, or understanding how models process information. The current recommended approach is to train a sweep of different sizes and evaluate each of them, but this is costly ( Lieberum et al., 2024 ) . Ideally, we would like to have a single SAE that can capture both high-level and fine-grained features. Therefore, we introduce Matryoshka SAEs , a novel hierarchical approach to SAE training, named after the Russian nesting dolls and inspired by Kusupati et al. (2024) . Matryoshka SAEs learn a single feature space that retains both abstract and specific features by training multiple nested SAEs of increasing size simultaneously. Each nested sub-SAE is optimized to reconstruct the input using only a subset of the total latents (including the sub-SAEs nested within itself). This nested structure prevents later, more specialized latents from absorbing the roles of earlier, more general ones, effectively regularizing the SAE to learn features at multiple levels of abstraction. Despite the need for reconstructions at multiple scales, Matryoshka SAEs can be implemented efficiently with a modest increase in training time compared to traditional SAEs, depending on the number of nested sub-SAEs. Through extensive experiments on both synthetic and real-world datasets, we demonstrate that Matryoshka SAEs mitigate feature absorption across a wide range of model sizes and sparsity levels. We find that Matryoshka SAEs have more disentangled latent representations (as measured by maximum cosine similarity of decoder vectors) and also improve performance on probing and targeted concept erasure tasks compared to standard SAE baselines. Furthermore, we find that with increasing dictionary size, Matryoshka SAEs often improve or maintain their performance on downstream tasks, where other architectures deteriorate in performance. While Matryoshka SAEs exhibit a small trade-off in reconstruction error due to the additional constraints, we argue that the improved quality of the learned latents, which also get better with scaling, make them an attractive alternative for practical applications. We consider our results a positive sign for the use of SAEs in interpretability research. We find that concerning failure modes that were thought to be fundamental barriers to using SAEs, can be mitigated through simple changes in the training procedure. This indicates that other problems with SAEs might be easier to solve than thought, and illustrates the promise of more research in this area. 2 Background 2.1 Interpretability with Sparse Autoencoders Early mechanistic interpretability work sought to understand neural networks by examining individual architectural components, but faced challenges due to polysemanticity - where components seem to exhibit multiple unrelated behaviors ( Olah et al., 2020 ; Elhage et al., 2022 ) . In recent years, SAEs emerged as a promising solution for extracting monosemantic and interpretable features from model activations ( Bricken et al., 2023 ; Cunningham et al., 2023 ; Templeton, 2024 ; Gao et al., 2024 ; Rajamanoharan et al., 2024a ; Rajamanoharan et al., 2024b )