Stable and Steerable Sparse Autoencoders with Weight Regularization

Piotr Jedryszek, Oliver M. Crook · 2026

Read Stable and Steerable Sparse Autoencoders with Weight Regularization by Piotr Jedryszek, Oliver M. Crook (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-04198.txt.

Introduction

Jedryszek and Crook study stable and steerable sparse autoencoders with weight regularization. Sparse autoencoders recover interpretable traits from neural network activations, but learned traits shift substantially across random seeds and training choices. For balance, they study weight regularization by adding L1 or L2 terms on encoder and decoder weights, evaluating contacts with common training defaults. Finally, under regularization, activation steering success is better predicted by auto-clarity scores, suggesting regularization aligns text-based feature explanations with functional controllability.

Catalog record

CREATORPiotr Jedryszek, Oliver M. Crook
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE29625
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2603.04198

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Stable and Steerable Sparse Autoencoders with Weight Regularization Piotr Jedryszek, Oliver M. Crook Abstract Sparse autoencoders (SAEs) are widely used to extract human-interpretable features from neural network activations, but their learned features can vary substantially across random seeds and training choices. To improve stability, we studied weight regularization by adding L1 or L2 penalties on encoder and decoder weights, and evaluate how regularization interacts with common SAE training defaults. On MNIST, we observe that L2 weight regularization produces a core of highly aligned features and, when combined with tied initialization and unit-norm decoder constraints, it dramatically increases cross-seed feature consistency. For TopK SAEs trained on language model activations (Pythia-70M-deduped), adding a small L2 weight penalty increased the fraction of features shared across three random seeds and roughly doubles steering success rates, while leaving the mean of automated interpretability scores essentially unchanged. Finally, in the regularized setting, activation steering success becomes better predicted by auto-interpretability scores, suggesting that regularization can align text-based feature explanations with functional controllability. 1 Introduction Sparse autoencoders (SAEs) have become central to mechanistic interpretability, offering a potential solution to the superposition hypothesis, the idea that neural networks represent more features than dimensions by encoding them in overlapping patterns ( 16 ) . By learning an overcomplete basis with sparse coefficients, SAEs aim to recover the “true” features underlying model computations ( 18 ; 6 ) . Despite their success, recent work raised concerns about SAE reliability. 5 showed that SAE features are highly sensitive to the L0 sparsity hyperparameter, and ( 8 ) demonstrated that SAEs trained with different random seeds on identical data learn substantially different features. This variability suggests underconstrained optimization : activation sparsity alone does not uniquely determine a solution. This underdetermination may help explain mixed downstream results: in a large-scale study of activation probing, 10 find that SAE-based probes do not provide a consistent advantage over strong baselines on raw activations across several challenging regimes, although they sometimes outperform on individual datasets. Recent work also argues that SAE objectives should prioritize functional faithfulness to model behavior rather than reconstruction alone; that is, by training SAEs end-to-end to preserve model outputs ( 2 ) . Other related work has begun to address these challenges by adding additional structure to SAE training beyond activation sparsity. For example, 14 propose Mutual Feature Regularization , which trains multiple SAEs in parallel and encourages them to converge to similar features, motivated by the idea that features replicated across runs are more likely to correspond to genuine input factors. Similarly, recently 15 introduced Distilled Matryoshka Sparse Autoencoders (DMSAEs), which run iterative train-and-select cycles: after each training run, features are scored by their gradient \times activation contribution to next-token loss, and only the highest-attribution subset is carried forward as frozen encoder directions for the next cycle. Where Mutual Feature Regularization encourages convergence across parallel SAEs, DMSAEs enforce consistency across sequential retraining cycles. In classical machine learning, underdetermined problems are addressed through regularization : additional constraints encoding prior beliefs about desirable solutions ( 9 ) . L1 regularization (Laplace prior) encourages weight sparsity, while L2 regularization (Gaussian prior) encourages small, smoothly distributed weights. Both improve generalization in many settings ( 17 ; 12 ) . In this work we revisit a simple idea: add an explicit weight penalty to SAE training, in addition to the usual activation sparsity term. We focus on three questions: 1. Cross-seed consistency: Does weight regularization increase the reproducibility of features across random seeds? 2. Feature quality: Does weight regularization affect downstream evaluations such as interpretability and steering? 3. Interaction with SAE design choices: How does weight regularization interact with common architectural and training decisions such as encoder/decoder initialization, decoder constraints, sparsity mechanism (TopK, BatchTopK, Matryoshka)? We explore weight regularization first on a toy model of MNIST images to build intuitions, then on a small language model (Pythia-70M-deduped) to test real-world applicability. 2 Methods 2.1 Sparse autoencoders with weight regularization Given an activation vector x\in\mathbb{R}^{d} , an SAE produces a sparse latent z\in\mathbb{R}^{m} and a reconstruction \hat{x} : \displaystyle z \displaystyle=f(W_{\mathrm{enc}}x+b_{\mathrm{enc}}), (1) \displaystyle\hat{x} \displaystyle=W_{\mathrm{dec}}z+b_{\mathrm{dec}}. (2) We consider standard sparsity mechanisms for z (e.g. an explicit l_{1} penalty or a hard TopK constraint) and add weight regularization: \mathcal{L}\;=\;\mathcal{L}_{\mathrm{recon}}(x,\hat{x})\;+\;\lambda_{\mathrm{sparse}}\,\mathcal{L}_{\mathrm{sparse}}(z)\;+\;\lambda_{\mathrm{w}}\Big(\|W_{\mathrm{enc}}\|_{p}^{p}+\|W_{\mathrm{dec}}\|_{p}^{p}\Big),\qquad p\in\{1,2\}. (3) where \mathcal{L}_{\mathrm{recon}}(x,\hat{x})=\|x-\hat{x}\|_{2}^{2} is the mean squared error reconstruction loss. For TopK models, sparsity is enforced by the encoder and we set \mathcal{L}_{\mathrm{sparse}}(z)=0 . Some implementations use mean rather than sum reductions (e.g. \mathrm{mean}(|z|) or \mathrm{mean}(|W|) ); though, for fixed layer shapes this differs by a constant factor that can be absorbed into \lambda_{\mathrm{sparse}} or \lambda_{\mathrm{w}} . 2.2 Decoder constraints and tied initialization Two implementation choices are common in recent SAE work and are present in the default SAE implementations of SAEBench: 1. Tied initialization: initialize W_{\mathrm{dec}}\leftarrow W_{\mathrm{enc}}^{\top} so that each latent starts as an approximately self-consistent “detector” and “writer” direction. 2. Unit-norm decoder columns: enforce \|W_{\mathrm{dec}}(:,i)\|_{2}=1 for each decoder column via normalization during training. A unit-norm constraint can neutralize L2 shrinkage on the decoder (since \|W_{\mathrm{dec}}\|_{F}^{2} becomes constant), so the same \lambda_{\mathrm{w}} may behave differently depending on whether decoder normalization is applied. Motivated by this, we explore these choices in a toy MNIST setting and retain SAEBench defaults when moving to language-model activations. Importantly, when unit-norm decoder columns are enforced, \|W_{\mathrm{dec}}\|_{F}^{2} is constant and the weight penalty acts primarily as encoder regularization; the decoder L2 term contributes little beyond what the norm constraint already imposes. 2.3 Cross-seed feature consistency To quantify reproducibility, we followed 8 and measured feature similarity across SAEs trained with different random seeds. For two trained SAEs A and B , let D_{A},D_{B}\in\mathbb{R}^{m\times d} be the decoder feature matrices. We compute the absolute cosine similarity matrix S=|\mathrm{cos}(D_{A},D_{B})| and use Hungarian matching to obtain a one-to-one pairing. We report: • Mean max cosine: average over features of \max_{j}S_{ij} (symmetrized across both directions). • Fraction paired: fraction of features with \max_{j}S_{ij}>0.7 . • Shared features: a stricter criterion requiring that the encoder and decoder Hungarian matchings agree and both matched similarities exceed 0.7 (sign-invariant). 2.4 Steering and evaluation For language-model SAEs, we evaluated feature steering by injecting a decoder feature vector into the residual stream during text generation: r_{t}\leftarrow r_{t}+\alpha\,d_{i}, (4) where d_{i} is decoder feature i and \alpha is the steering strength. We explored several strength parameterizations: fixed, residual-RMS scaled, and target pre-activation delta. The configuration yielding the best results for both regularized and unregularized SAEs used non-deterministic decoding (temperature =0.7 , top- p=0.9 ) with generation-only steering and fixed scaling ( \alpha=5 ). Full hyperparameter details appear in Appendix A . An LLM judge (GPT-5.1) scored whether the steered output (completing a set of 5 prompts) was more related to the feature’s expected concept than the unsteered output on a 1–5 scale (5 = steered is much more related, 3 = no meaningful change, 1 = steered is much less related). We counted scores greater than or equal to four as successful steering. 3 Toy experiments on MNIST 3.1 Weight regularization induces an “aligned core” We trained SAEs on flattened MNIST images ( d=784 ) with m=1{,}568 latents ( 2\times overcomplete) and an L1 sparsity penalty on activations. With untied initialization, adding L2 regularization ( \lambda_{w}=10^{-3} ) produced a bimodal distribution of encoder–decoder cosine similarities

Read the complete text