Steering LLMs? Actually, Sparse Autoencoders can outperform simple baselines

Mikkel Godsk Jørgensen [email protected], Lars Kai Hansen [email protected] · 2026

Read Steering LLMs? Actually, Sparse Autoencoders can outperform simple baselines by Mikkel Godsk Jørgensen [email protected], Lars Kai Hansen [email protected] (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-31183.txt.

Introduction

Jørgensen and Hansen defend sparse autoencoders as steering tools for large language models. An earlier benchmark had them trailing simple baselines, but with supervised feature selection and labelling, the authors find, they nearly match reference LoRA steering on AxBench. Their pipeline's interpretability-only parts also pick features that prove surprisingly causal. High sparsity, they add, may matter less for steering than earlier work suggested.

Catalog record

CREATORMikkel Godsk Jørgensen [email protected], Lars Kai Hansen [email protected]
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE47309
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2605.31183

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Steering LLMs? Actually, Sparse Autoencoders can outperform simple baselines Mikkel Godsk Jørgensen [email protected], Lars Kai Hansen [email protected] Abstract Sparse Autoencoders (SAEs) have been seen as a promising avenue for exploring the internals of Large Language Models (LLMs) and for steering model output generation. When AxBench - a model steering benchmark - was introduced in 37 , SAEs did not seem to live up to their original hype due to poor steering performance relative to a set of simple baselines. This work serves as a partial rebuttal for Sparse Autoencoders and suggests that the results of 37 did not do them full justice. We find that Sparse Autoencoders can, in fact, perform close to on par with the reference LoRA performance on the AxBench benchmark, when features are selected and labelled with our supervised pipeline. We also find that our pipeline selects features that are surprisingly causal of their identified labels when using only its interpretability-based components. Lastly, we present evidence that high sparsity (low ℓ 0 \ell_{0} ) may not be crucial for successful steering based on interpretability, which is in contrast to the earlier findings in 36 . Our code is available at https://github.com/MikkelGodsk/SAE-labelling . 1 Introduction Sparse Autoencoders have recently attracted a wave of attention ( 7 ; 24 ; 34 ; 14 ; 30 , e.g.) , offering an unsupervised interpretability model based on the Linear Representation Hypothesis (LRH) and the superposition hypothesis . The LRH suggests that many concepts may be stored in linear subspaces, as discussed in e.g. 1 ; 21 ; 9 ; 27 , although somewhat contested in e.g. 6 . Since LLMs can represent a large number of concepts in relatively low-dimensional latent spaces, the neurons must be polysemantic as a consequence, i.e. they become active across multiple different semantics, as discussed in e.g. 3 ; 24 ; 34 ; 13 ; 7 . The superposition hypothesis further suggests that linear concept representations are densely packed and not fully orthogonal ( 9 ) . Within this framework, Sparse Autoencoders offer an appealing interpretability tool, capable of discovering a subset of linear concept representations, referred to as features , which are thought to exhibit a high degree of monosemanticity ( 4 ; 34 , e.g.) . In 13 , the authors quantify the monosemantic property of SAEs in comparison to individual neurons in a network. Their findings suggest that, indeed, SAE features are more monosemantic than the individual neurons of language models. While the monosemantic response is interesting for interpretability, features have also shown some ability to control the model’s text generation ( 34 ; 2 ; 19 ; 36 , e.g.) , although the effectiveness is disputed most notably in 37 . In fact, 37 concludes that “Even simple baselines outperform Sparse Autoencoders” for steering, and finds that simply prompting the model is much more effective than other approaches, such as intervention via SAEs ( 34 , e.g.) and LoRA ( 20 ) . Although this is undeniably important for most practical applications, the prompt baseline can seem unfair since the subject LLM was originally trained precisely to follow instructions. Aside from steering, there have also been several attempts at using SAEs for knowledge unlearning/concept removal in language models ( 12 ; 38 ; 13 , e.g.) , essentially exploring the negative (removal) dimension of steering. Since Sparse Autoencoders are trained unsupervised, efforts have been made to label their features with the concepts they represent. This has been attempted at scale using LLMs ( 23 ; 29 , e.g.) , but to our knowledge, no dedicated efforts have been made to use a supervised approach to labelling. Recent work ( 36 ) has suggested that high interpretability of a feature tends to have some correlation with high utility for model steering, and that this relationship seems most pronounced for JumpReLU SAEs with a low \ell_{0} (i.e. high sparsity). This result could pose as a relevant context for interpreting the findings of 37 , in which they base their conclusions on SAEs with high \ell_{0} , being those that are already annotated in Neuronpedia 1 1 1 https://www.neuronpedia.org/gemma-scope#browse . 1.1 Contributions We make the following contributions: 1. We introduce a labelling pipeline for Sparse Autoencoders based on labelled datasets rather than LLMs. 2. We demonstrate that Sparse Autoencoders are substantially more powerful for steering than reported in 37 when the features are labelled via our proposed method. However, the steering performance we demonstrate is still not fully competitive with prompting on the AxBench benchmark. 3. We find indications that both low- and high-sparsity Sparse Autoencoders in Gemma Scope can be used for steering. 2 Preliminaries 2.1 Large Language Models Formal definition. Large Language Models define a distribution over text strings, and are typically based on transformers ( 35 ) . To transform a string of text into a format suitable for language modeling, the typical approach is to use a tokenizer to split up the text into a string of tokens. Here, the tokens constitute an alphabet \Sigma . For modeling purposes, we further augment the alphabet by the tokens BOS and EOS (beginning of sequence, end of sequence) to get an augmented alphabet \bar{\Sigma}=\Sigma\cup\{\textrm{BOS},\textrm{EOS}\}. Formally, a sequence of tokens is simply called a string . The language model can then be characterized as a string distribution p_{\rm LM}(\bm{s})=\prod_{i}p_{\rm SM}(s_{i}|\bm{s}_{<i}),\quad\bm{s}\in\left(\textrm{BOS}\cdot\Sigma^{*}\cdot\textrm{EOS}\right), (1) where \cdot denotes string concatenation and p_{\rm SM}(\cdot|\bm{s}_{<i}):\bar{\Sigma}\rightarrow[0,1] is typically fitted by the model. Here p_{\rm LM} is assumed to be a true distribution (i.e., no probability mass is leaked into the set of infinite strings). This is true for models with a softmax-based prediction head. To use the language model generatively, we use a decoding strategy to auto-regressively predict the next token until termination by EOS. The two simplest options are to greedily select \arg\max_{s_{i}}p_{\rm SM}(s_{i}|\bm{s}_{<i}) as our next token, or to sample from p_{\rm SM}(s_{i}|\bm{s}_{<i}) at each step ( 5 ) . Transformers. LLMs typically build on a modified transformer architecture compared to the one introduced in 35 . The main modifications are to use only the decoder, to apply the positional encodings within the Multi-Head Self-Attention, and to use the causal mask. The causal mask has the effect of making information always flow forward over a sequence of tokens. E.g., for two sentences "The bar closes at 4" and "The bar is made of metal", the internal representation for the word "bar" cannot be disambiguated at its token position using the succeeding tokens as they are masked out. This has the advantage of being computationally cheaper since the current representations need not be recomputed every time a new token is generated. This is depicted in figure 1 . For the reader less familiar with LLMs, we will occasionally refer to the chain of residual connections that flows throughout the network as the "residual stream". This view has been widely adopted in the literature, aptly so since there is a direct path from the input layer to the output layer through it, where the transformer blocks can be seen as reading and writing its value ( 10 ; 23 ) . Figure 1 : The architecture of a transformer-based causal LM at the level of a single transformer block. Here

Read the complete text