SAEs Are Good for Steering – If You Select the Right Features

Dana Arad, Aaron Mueller, Yonatan Belinkov · 2025

Read SAEs Are Good for Steering – If You Select the Right Features by Dana Arad, Aaron Mueller, Yonatan Belinkov (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2505-20063.txt.

Introduction

Dana Arad, Aaron Mueller, and Yonatan Belinkov ask which learned features of a language model are safe to steer with. Sparse autoencoders split a model's inner state into many features, and boosting a feature can push its output toward a chosen topic. Teams usually pick features by looking at which inputs switch them on, and the authors say that test is not enough.

They split features into two kinds: input features, which mirror patterns in the text fed in, and output features, which clearly change what the model says. Scores for the two kinds rarely run high in the same feature. Filtering out features with weak output scores made steering two to three times better in their tests. That gain puts the unsupervised method on par with supervised rivals, work published in 2025.

Catalog record

CREATORDana Arad, Aaron Mueller, Yonatan Belinkov
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE49 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2505-20063

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

SAEs Are Good for Steering – If You Select the Right Features Dana Arad, Aaron Mueller, Yonatan Belinkov Abstract Sparse Autoencoders (SAEs) have been proposed as an unsupervised approach to learn a decomposition of a model’s latent space. This enables useful applications such as steering—influencing the output of a model towards a desired concept–without requiring labeled data. Current methods identify SAE features to steer by analyzing the input tokens that activate them. However, recent work has highlighted that activations alone do not fully describe the effect of a feature on the model’s output. In this work, we draw a distinction between two types of features: input features , which mainly capture patterns in the model’s input, and output features , which have a human-understandable effect on the model’s output. We propose input and output scores to characterize and locate these types of features, and show that high values for both scores rarely co-occur in the same features. These findings have practical implications: after filtering out features with low output scores, we obtain 2–3x improvements when steering with SAEs, making them competitive with supervised methods. 1 1 1 Our code is available at https://github.com/technion-cs-nlp/saes-are-good-for-steering . Figure 1: Selecting features for steering. (1) Given a concept to steer (”apple”), we amplify a candidate SAE feature during a single forward pass of the model on a neutral prompt. (2) We compute the feature’s output score based on the rank and probability of representative after intervention. (3) Features with high output scores are more likely to be effective for steering. (a) Steering with an input feature. (b) Steering with an output feature. Figure 2: Examples of steering with input and output features. (a) An input feature, which activates strongly on tokens like ”_primary” (leading to a high input score of 0.82 ), fails to steer generation meaningfully; with a high steering factor, the model degenerates into repeating the token ”school”, as if continuing from the word ”primary”. (b) An output feature, with an output score of 0.81 , yields meaningful, coherent generations when steered at an optimal steering factor. 1 Introduction Sparse autoencoders (SAEs) have shown promise in extracting human-interpretable features from the hidden states of language models (LMs) Bricken et al. (2023) ; Templeton et al. (2024) . One appealing usage of SAEs is to enable fine-grained interventions such as generation steering O’Brien et al. (2024) ; Durmus et al. (2024) ; Marks et al. (2025) . However, selecting the right features for intervention is an open problem. Current approaches typically select features to steer based on their activation patterns, i.e., the input texts that most strongly activate a given feature Huben et al. (2024) . While input-based activations can reveal meaningful patterns, recent work highlights a critical limitation: a feature’s activations are not necessarily the same as its causal effect on the model’s output Durmus et al. (2024) ; Paulo et al. (2024) ; Gur-Arieh et al. (2025) . As a result, the way features are selected can lead to suboptimal steering, reducing its consistency and reliability Durmus et al. (2024) . In this work, we formalize two distinct roles that features can play: input features , which capture patterns within the model’s input, and output features , whose main role is to directly influence the tokens the model generates. To find them, we propose input scores and output scores . First, we obtain a representative set of tokens for each feature by applying the logit lens to SAE weights; this projects the weights directly into the vocabulary space nostalgebraist (2020) ; Bloom and Lin (2024) . We define input features as having high input scores—i.e., high overlap between their top-activating tokens and top logit lens tokens. We define output features as having high output scores—i.e., intervening on the feature increases the probability of its top logit lens tokens in the final output distribution. Notably, the input score can be computed in parallel for all features over a general dataset; the output score requires only one forward pass and no concept-specific data. We quantitatively show that these roles rarely co-occur and tend to emerge at different layers in the model. Specifically, features in earlier layers primarily act as detectors of input patterns, while features in later layers are more likely to drive the model’s outputs, consistent with prior analyses of LLM neuron functionality Lad et al. (2024) ; Marks et al. (2025) . By calculating the input and output scores of features extracted from Gemma-2 (2B and 9B) Team et al. (2024) , we show that features with high output scores are more effective for coherent and high-quality steering. This yields a practical feature selection method, illustrated in Figure 1 : starting with a (typically small) set of candidate features for steering, our scores are computed over this set to select a more effective subset. Figure 2 demonstrates the difference when steering with input features vs. output features: steering with a feature that has a high input score but low output score fails to meaningfully influence the generation. In contrast, steering using a feature with high output score and low input score yields better steering, as well as more fluent and semantically coherent completions. We demonstrate the effectiveness of these insights on the recent AxBench Wu et al. (2025) , a benchmark for evaluating steering methods. While AxBench found SAEs to be poor for steering, our feature selection results in a 2–3x improvement, causing SAE steering (an unsupervised method) to score significantly closer to supervised methods like LoRA Xu et al. (2024) . In summary, our contributions are threefold: • We propose a taxonomy of features according to whether they are more sensitive to analyzing the input or affecting the output, and propose ways of categorizing features into these different roles. • We propose a practical method for finding features effective for steering. • Using our results, we engage with current debates on the utility of SAEs for steering, and characterize why these approaches did not find strong results. 2 Preliminaries 2.1 Sparse Autoencoders Sparse Autoencoders (SAEs) were recently proposed as a method to address the problem of polysemanticity , where individual neurons entangle multiple unrelated concepts, and where a single concept may be distributed across many neurons Bricken et al. (2023) . Given a hidden representation x\in\mathbb{R}^{n} , an SAE consists of an encoder and a decoder, defined as: \displaystyle a(x) \displaystyle:=\sigma(W_{\text{enc}}x+b_{\text{enc}}), (1) \displaystyle\hat{x}(a) \displaystyle:=W_{\text{dec}}a+b_{\text{dec}}. (2) where W_{\text{enc}},W_{\text{dec}},b_{\text{enc}},d_{\text{dec}} are trainable parameters of the SAE. The encoder maps the latent x into a higher-dimensional sparse vector a(x) , or a for short, which we refer to as the activations. The decoder reconstructs x from a as a sparse linear combination of the learned features, given by the columns of W_{\text{dec}} . Sparsity and non-negativity of the activations are enforced through the non-linearity \sigma , often JumpReLU Rajamanoharan et al. (2024) , and regularization. 2.2 The Logit Lens The logit lens is a widely used interpretability tool for analyzing the hidden representations of language models nostalgebraist (2020) . Given a hidden state x\in\mathbb{R}^{n} at any layer of the model, the logit lens passes x through the final layer norm, LN , then projects x onto the vocabulary space by applying the unembedding matrix

Read the complete text