Toward Identifiable Sparse Autoencoders

Walter Nelson, Theofanis Karaletsos, Francesco Locatello · 2026

Read Toward Identifiable Sparse Autoencoders by Walter Nelson, Theofanis Karaletsos, Francesco Locatello (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-31245.txt.

Introduction

Nelson, Karaletsos and Locatello make sparse autoencoders stable, so retraining gives back the same concept lists. Standard versions wobble: distinct runs yield distinct concept lists and codes, as the authors prove as well as observe. They pin the wobble on specific model traits and fix each with small design and training changes. The fixed variant, an identifiable autoencoder, rebuilds inputs with less error and stays stable. Its learned lists nearly meet a restricted isometry rule, making the sparse codes nearly identifiable.

Catalog record

CREATORWalter Nelson, Theofanis Karaletsos, Francesco Locatello
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE57674
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2605.31245

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Toward Identifiable Sparse Autoencoders Walter Nelson, Theofanis Karaletsos, Francesco Locatello Abstract Recently, sparse autoencoders (SAEs) have emerged as an attractive tool for interpreting and interacting with representations in practical neural networks. While it is common empirical folklore, we also show theoretically that SAEs are highly unstable: different training runs are likely to produce different concept dictionaries and sparse codes. We characterize the model properties that hinder the stability of real-world SAEs, and address each of these problems through minimal changes to the architecture and training procedure. Together, these changes yield two versions of an i dentifiable SAE (iSAE), a variant of the standard TopK SAE with lower reconstruction error and improved stability. We explain this improvement theoretically by connecting SAEs with traditional dictionary learning approaches, and show that the dictionaries learned in practice satisfy an approximate restricted isometry condition, rendering the corresponding sparse codes in those models near-identifiable. Code † † affiliationnotice: 1 Introduction Sparse autoencoders (SAEs) decompose high-dimensional representations into a sparse linear combination of concepts from a large, learned dictionary. Due to their simplicity, flexibility, and well-characterized engineering ( 15 ) , they have seen widespread adoption across vision, language, and other modalities. In these settings, SAEs are used as a practical interface for analyzing and intervening on the internal representations. For example, individual dictionary atoms are often interpreted as human-meaningful concepts (e.g., topics, syntactic patterns, or visual components), enabling post-hoc interpretability. They have also been used for steering, where selectively activating or suppressing specific atoms alters model behavior in a targeted way. This line of work frequently relies, implicitly or explicitly, on the assumption that the sparse linear decompositions correspond to stable (or even semantically meaningful) structure in the underlying representation. In this work, we avoid this assumption by treating SAEs not as a priori interpretable objects, but as statistical estimators for the classical dictionary learning problem. Our goal is to investigate under what conditions their learned atoms and codes are in fact statistically identifiable. Figure 1 : Sparse autoencoders approximate nonlinear manifolds (dark blue, mostly occluded) with linear patches (light blue). We show that identifiability hinges on four key ingredients: (a) the approximation being good enough (low reconstruction error), (b) the manifold being sampled densely enough, (c) co-occurring concepts being distinct enough (an approximate restricted isometry property), and (d) sufficiently diverse concept co-occurrence patterns. When these hold, individual patches are identifiable, rendering the whole model statistically identifiable. We are motivated by prior work showing that modern SAEs suffer from various forms of non-identifiability ( 30 ) . In particular, prior work has shown that two SAEs trained on the same data are not guaranteed to yield the same concept dictionary ( 30 ) or sparse codes ( 29 ) , a phenomenon similar to the non-identifiability seen in disentangled representation learning ( 20 ) . This inconsistency potentially muddies the interpretation of the learned features, defeating the purpose of SAEs in the first place. SAE identifiability is also important when using them to interpret data and models in scientific applications, where identifiability ensures that statistical power is stable ( 23 ; 11 ) . The classical approaches to the compressed sensing and dictionary learning problems faced similar non-identifiability issues, which are mostly due to the fact that the dictionaries learned are highly overcomplete. We draw inspiration from these earlier works to improve the stability of the SAEs widely used in practice today. Concretely: • We show theoretically (Theorem 3.2 ) and empirically that consistently learning the dictionary is not sufficient for consistently learning the codes, motivating our proposed code consistency metrics. • We show theoretically that when the learned dictionary satisfies an approximate restricted isometry property (aRIP), the sparse codes of an SAE are provably near-identifiable (Theorem 3.6 ). • Empirically, we show that two variants of our model identifiable SAE ( iSAE ) exhibit improved stability and reconstruction over standard TopK baselines. 2 Related Work A growing body of recent work applies SAEs as a tool for post-hoc interpretability, including mechanistic interpretability, particularly in large language models ( 12 ; 25 ; 3 ) . In these settings, SAEs are trained on intermediate activations (e.g., residual streams or MLP layers), and individual dictionary elements are interpreted as corresponding to human-meaningful concepts such as semantic topics, syntactic patterns, or behavioral circuits. This approach has enabled analyses of feature superposition ( 12 ) , circuit structure ( 25 ) , and the localization of model behaviors, as well as interventions in which specific features are ablated or amplified to steer model outputs ( 3 ; 32 ) . These applications rely on the empirical observation that SAE features are often sparse, localized, and partially interpretable, even in highly overcomplete regimes, provided that reconstruction performance is good enough. Accordingly, most work on SAEs has focused on improving reconstruction error ( 15 ; 4 ) at the frontier of the reconstruction-sparsity tradeoff ( 13 ) . However, the evidence is unclear as to whether reconstruction performance is sufficient to give stability of the atoms and sparse codes. 30 point out the importance of the stability of the learned dictionary, arguing that TopK SAEs are stable according to this measure under re-trainings using a standard cosine similarity measure on the concept dictionary. 13 propose to constrain the concepts in the dictionary to the convex hull of the data, finding that this improves stability according to the same cosine similarity measure. Building on prior work which shows that two SAEs with the same dictionary can produce vastly different sparse codes for the same data ( 29 ) , we show that code identifiability is not implied by dictionary identifiability. Accordingly, we instead analyze the stability of both the dictionary and the sparse codes. In most works on mechanistic interpretability, identifiability is assessed subjectively, by checking the alignment with human-interpretable concepts ( 17 ) . In contrast, the historical view in sparse coding and dictionary learning is to assess when signals admit a stable sparse linear decomposition, without assigning a particular interpretation to it. Our work aims to bridge this gap by explicitly analyzing the conditions under which the representations learned by SAEs are stable and statistically identifiable, and by proposing metrics that capture this stability at the level of both dictionaries and codes. Our theoretical characterization is based on the restricted isometry property (RIP) from compressed sensing. 5 show that when a known dictionary satisfies the RIP, sparse codes are identifiable. Unfortunately, the classical RIP condition is combinatorially difficult to verify, a situation that does not become any easier when the dictionary is unknown ( 31 ) . To address this, we propose a data-driven relaxation of the RIP condition we refer to as approximate RIP (aRIP), which enforces the property only where data is actually observed. We show theoretically and empirically that this is sufficient for near-identifiability of both the dictionary and the codes for a given data distribution. Appealingly, given a trained SAE, the aRIP condition is easily measured. 3 Unifying SAEs and Dictionary Learning In this section, we contrast sparse autoencoders and the classical approaches to dictionary learning, with the goal of unifying them in theory and practice. Sparse autoencoding. Consider a distribution P(\mathbf{x}) over representations \mathbf{x}\in\mathbb{R}^{N} .

Read the complete text