Denoising Concept Vectors with Sparse Autoencoders for Improved Language Model Steering

Haiyan Zhao, Xuansheng Wu, Fan Yang, Bo Shen, Ninghao Liu, Mengnan Du · 2025

Read Denoising Concept Vectors with Sparse Autoencoders for Improved Language Model Steering by Haiyan Zhao, Xuansheng Wu, Fan Yang, Bo Shen, Ninghao Liu, Mengnan Du (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2505-15038.txt.

Introduction

Haiyan Zhao and five co-authors proposed in 2025 a cleaner way to steer large language models with concept directions. Steering vectors can push a model's tone or stance, but noise from varied training data blurs them and makes steering unreliable. Their method passes the model's inner states through a sparse autoencoder. It then keeps only the few hidden units that best separate positive from negative examples.

Scaling those chosen units up rebuilds a sharper steering signal from the cleaned representation. Applied to two standard ways of building concept vectors, the cleanup raised steering success by four to sixteen points across six hard concepts. Answers stayed on topic while the steering held. The authors frame the method as a general add-on for probing and control techniques.

Catalog record

CREATORHaiyan Zhao, Xuansheng Wu, Fan Yang, Bo Shen, Ninghao Liu, Mengnan Du
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE41 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2505-15038

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Denoising Concept Vectors with Sparse Autoencoders for Improved Language Model Steering Haiyan Zhao, Xuansheng Wu, Fan Yang, Bo Shen, Ninghao Liu, Mengnan Du Abstract Linear concept vectors effectively steer LLMs, but existing methods suffer from noisy features in diverse datasets that undermine steering robustness. We propose Sparse Autoencoder-Denoised Concept Vectors (SDCV), which selectively keep the most discriminative SAE latents while reconstructing hidden representations. Our key insight is that concept-relevant signals can be explicitly separated from dataset noise by scaling up activations of top-k latents that best differentiate positive and negative samples. Applied to linear probing and difference-in-mean, SDCV consistently improves steering success rates by 4-16% across six challenging concepts, while maintaining topic relevance. 1 Introduction Linear concept vectors are generally derived with linear probing Kim et al. (2018) , difference-in-mean Wu et al. (2025) , contrastive activation addition Rimsky et al. (2023) , and their variants. They have been extensively used in representation engineering ( Zou et al., 2023 ) , which adds up concept vectors during inference-time to steer model’s output toward desired directions. Recently, these approaches have shown preliminary results in steering writing styles Konen et al. (2024) , emotions Zhao et al. (2025) , truthfulness Marks and Tegmark (2023) , hallucination Zou et al. (2023) , chain-of-thought reasoning Zhang and Viteri (2025) , etc. However, effective steering of concept vectors remains a challenging problem. The primary challenge lies in the noise present during concept vector learning. We focus on representative approaches including linear probing ( Alain and Bengio, 2016 ; Ousidhoum et al., 2021 ) , and difference-in-mean Wu et al. (2025) . More specifically, linear probing train classifiers to identify concept directions using contrastive datasets containing concept-related (positive) and concept-irrelevant (negative) samples. Unfortunately, random noises within datasets often introduce irrelevant features into their hidden representations with both methods. This issue is particularly pronounced for high-level and complex concepts such as sycophancy, corrigibility, Myopic reward, political speech, etc. These sophisticated concepts are especially sensitive to noise in the underlying data, which significantly undermines the performance of steering algorithms. Figure 1: Overview of the framework of SDCV. To overcome these limitations, we propose that we can explicitly disentangle the concept-relevant signal from dataset noise in language model representations . To this end, we introduce a simple yet elegant approach, Sparse Autoencoder-Denoised Concept Vector (SDCV) , to enhance the performance of concept vectors in steering tasks. Sparse Autoencoders (SAEs) are originally used to provide insights into the internal workings of LLMs by decomposing language model representations into more human-interpretable concepts Shu et al. (2025b) . Our proposed SDCV leverages SAEs to reconstruct hidden states in a more selective manner. Specifically, during the SAE reconstruction process, we selectively scale up the activation values of those latents that most effectively differentiate between positive and negative concepts, while keeping the activation values of other latents the same which we hypothesize are more related to noise rather than concept-relevant signals. This approach yields denoised representations that can be further employed for constructing probing and subsequent steering algorithms. Experiments on steering a series of high-level and challenging concepts demonstrate that steering algorithms equipped with SDCV module significantly improve upon baseline methods in terms of steering success rate. 2 Methodology In this section, we introduce the proposed SDCV framework (Figure 1 ). The notations and preliminary definitions are detailed in Appendix A . 2.1 Denoising Representations via SAE To reduce noise interference, we use SAEs to map hidden representations to a higher dimension and then reconstruct them using only the most influential SAE latents. Given a concept c , we first create a contrastive dataset \mathcal{D}_{c} with M positive and M negative samples. We extract hidden representations from the target layer \ell of an LLM, denoted as \mathcal{\boldsymbol{H}}_{\mathrm{p}}=\{\boldsymbol{h}_{i}\in\mathbb{R}^{d}\mid i\in[1,M]_{\mathbb{Z}}\} for positive samples and \mathcal{\boldsymbol{H}}_{\mathrm{n}}=\{\boldsymbol{h}_{i}\in\mathbb{R}^{d}\mid i\in[1,M]_{\mathbb{Z}}\} for negative samples. These representations are passed into a trained SAE, which yields higher-dimensional activation vectors {a}(\boldsymbol{h}_{i})\in\mathbb{R}^{C} , where C\gg d . To reduce noise, we select the dimensions that best differentiate the two classes, based on the influential score defined as following: s=\frac{\left|\overline{a_{\mathrm{p}}(\boldsymbol{h})}\ -\ \overline{a_{\mathrm{n}}(\boldsymbol{h})}\right|}{\sigma_{\mathrm{n}}^{2}\ +\ \sigma_{\mathrm{p}}^{2}}. (1) The score function aims to filter out the dimensions that best distinguish two classes, while ensuring that the variance between the classes remains as small as possible. More specifically, we use the absolute difference between the average activation vectors \overline{a_{\mathrm{p}}(\boldsymbol{h})} for the positive set and \overline{a_{\mathrm{n}}(\boldsymbol{h})} for the negative set to measure how distinguishable the two binary classes are. To further ensure that these dimensions are not significantly influenced by outliers, we incorporate the standard deviation as a measure of robustness, favoring dimensions with lower variance across the class-wise activations. We select the top- k latents with the highest influence scores. The indices of these selected latents are denoted by \mathcal{I}_{k} . For all samples, we scale up the activations of the top- k latents while keeping all other dimensions unchanged: {a}_{\mathrm{top-k}}\left(\boldsymbol{h}_{i}\right)=\begin{cases}m*{a}(\boldsymbol{h}_{i})_{j}&\text{ if }j\in\mathcal{I}_{k}\\ {a}(\boldsymbol{h}_{i})_{j}&\text{ if }j\notin\mathcal{I}_{k}\end{cases}. (2) After selecting the top- k latents, we replace the original activation vectors with a_{\text{top }-\mathrm{k}}\left(\boldsymbol{h}_{i}\right) . We then use the scaled vectors to reconstruct hidden states for all samples. This increases the proportion of information from the influential dimensions, and conversely reduces the influence of “noisy” dimensions when reconstructing hidden states. The reconstructed hidden representation is defined as: \displaystyle\mathrm{SAE}(\boldsymbol{h}_{i}) \displaystyle=a_{\mathrm{top-k}}(\boldsymbol{h}_{i})\boldsymbol{W}_{\mathrm{dec}}+\boldsymbol{b}_{\mathrm{dec}} (3) \displaystyle\boldsymbol{h}_{i}^{\prime} \displaystyle\leftarrow\mathrm{SAE}(\boldsymbol{h}_{i})+\epsilon (4) where \boldsymbol{W}_{\mathrm{dec}} is the decoder matrix and \boldsymbol{b}_{\mathrm{dec}} is the bias term, \epsilon is the reconstruction error of original \boldsymbol{h}_{i} . \mathrm{SAE}(\boldsymbol{h}_{i}) denotes the SAE reconstructed hidden state. \boldsymbol{h}_{i}^{\prime} is our final representation. Detailed explanations on these terms are in Appendix A . Table 1: Comparisons of steering tasks success rate between conventional methods and ours with Llama-3.1-8B. Concepts Linear Prob SDCV Linear Prob DIFF SDCV DIFF SR Relevance SR Relevance SR Relevance SR Relevance Sycophancy 10% 7.69 22% 6.91 18% 7.10 24% 7.52 Corrigibility 6% 8.49 20% 8.55 28% 9.27 30% 8.86 Myopic reward 14% 7.79 18% 7.15 12% 7.83 18% 7.62 Amazon review 18% 6.52 22% 7.00 38% 7.10 44% 7.35 Political speech 12% 5.47 22% 5.39 20% 6.05 36% 5.44 Twitter sentiments -2% 6.35 8% 6.39 -2% 6.38 2% 6.39 2.2 Probing and Steering We investigate the linear probing and difference-in-mean in our work, with their definitions provided in Appendix A . For SDCV-enhanced versions of these methods, we first replace the original hidden representations \boldsymbol{h}_{i} with the reconstructed representations \boldsymbol{h}_{i}^{\prime} obtained from Equation ( 4 ). We then compute the corresponding linear prob and difference-in-mean concept vectors, denoted as \boldsymbol{v}_{c} . For model steering, the resulting concept vectors are added to residual stream hidden representations during forward pass as follows: \boldsymbol{z}\leftarrow\boldsymbol{z}+\alpha\boldsymbol{v}_{c}. (5) where \boldsymbol{z} denotes the original hidden representation, and the reconstruction error is implicitly captured through the difference from \boldsymbol{z}^{\mathrm{new}} . The vector \boldsymbol{v}_{c} represents the concept vector associated with concept c , and \alpha is a hyperparameter controlling the steering strength. The modified hidden representation \boldsymbol{z}^{\mathrm{new}} is then propagated forward through the model for continued computation. 3 Experiments 3.1 Experimental Setup Datasets. Following Rimsky et al. (2023) , we consider the multiple-choice datasets sycophancy , corrigibility , and myopic reward to evaluate the quality of concept vectors derived from SDCV. Meanwhile, we also evaluate our approaches on three public datasets, including amazon reviews

Read the complete text