Selective Steering: Norm-Preserving Control Through Discriminative Layer Selection
Quy-Anh Dang, Chris Ngo · 2026
Read Selective Steering: Norm-Preserving Control Through Discriminative Layer Selection by Quy-Anh Dang, Chris Ngo (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2601-19375.txt.
Introduction
Quy-Anh Dang and Chris Ngo steer language model behavior by picking the right layers to nudge. Aligned models still fall to adversarial prompts that coax out harmful acts. Activation steering pushes the model's inner signals at run time. It is a promising defense, but old methods need careful tuning or give only on off control.
Their method selects layers by how well they discriminate the target behavior, and keeps the signal's size intact. Norm preserving control should be steadier across prompts. Run time steering that is stable and selective is a practical guard for deployed models.
Catalog record
| CREATOR | Quy-Anh Dang, Chris Ngo |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 73 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2601-19375
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Selective Steering: Norm-Preserving Control Through Discriminative Layer Selection Quy-Anh Dang, Chris Ngo Abstract Despite significant progress in alignment, large language models (LLMs) remain vulnerable to adversarial attacks that elicit harmful behaviors. Activation steering techniques offer a promising inference-time intervention approach, but existing methods suffer from critical limitations: activation addition requires careful coefficient tuning and is sensitive to layer-specific norm variations, while directional ablation provides only binary control. Recent work on Angular Steering introduces continuous control via rotation in a 2D subspace, but its practical implementation violates norm preservation, causing distribution shift and generation collapse, particularly in models below 7B parameters. We propose Selective Steering 1 1 1 Code: https://github.com/knoveleng/steering , which addresses these limitations through two key innovations: (1) a mathematically rigorous norm-preserving rotation formulation that maintains activation distribution integrity, and (2) discriminative layer selection that applies steering only where feature representations exhibit opposite-signed class alignment. Experiments across nine models demonstrate that Selective Steering achieves 5.5 × \times higher attack success rates than prior methods while maintaining zero perplexity violations and approximately 100% capability retention on standard benchmarks. Our approach provides a principled, efficient framework for controllable and stable LLM behavior modification. 1 Introduction Large Language Models (LLMs) have demonstrated remarkable capabilities, yet ensuring their safe deployment remains critical. Despite extensive alignment efforts through RLHF ( Ouyang et al. 2022 ) and constitutional AI ( Bai et al. 2022b ) , models remain vulnerable to jailbreaks ( Zou et al. 2023 ) and harmful behaviors ( Perez et al. 2022 ) . Traditional alignment requires expensive retraining and often degrades performance on benign tasks ( Casper et al. 2023 ; Tan et al. 2025 ) . Figure 1: Selective Steering pipeline. At each layer k , we compute projections of positive ( red ) and negative ( blue ) class means onto the selected feature direction ( red / blue boxes). Steering is applied only at layers where projections have opposite signs (layers k-2 and k+1 ), using norm-preserving rotation. Layers with same-sign projections (layer k-1 ) remain unchanged. Activation steering - modifying internal representations at inference time - offers an alternative ( Turner et al. 2024 ; Andy Zou 2023 ) . However, existing methods face critical limitations: Activation Addition requires careful coefficient tuning and is sensitive to layer-specific norms ( Templeton et al. 2024 ) , while Directional Ablation removes features entirely, precluding fine-grained control ( Arditi et al. 2024 ) . Recent Angular Steering ( Vu and Nguyen 2025 ) reformulates steering as geometric rotation in a 2D subspace, but suffers from generation collapse on small models (<7B) and poor controllability on strongly aligned models (Qwen, Gemma). Our Approach. We hypothesize these failures stem from uniform steering across all layers , ignoring heterogeneous layer roles. Through systematic analysis, we identify: (1) non-uniform activation norm growth across depth; (2) progressive emergence of opposite-signed discriminability in middle-to-late layers; and (3) layer-specific vulnerability to steering. We propose Selective Steering (SS) , which applies norm-preserving rotation only to layers where contrastive classes exhibit opposite-signed projections : \boldsymbol{\tilde{\mu}}^{(k)}_{\text{pos}}\cdot\boldsymbol{\tilde{\mu}}^{(k)}_{\text{neg}} . This discriminative criterion identifies steerable layers where features are meaningfully represented, achieving: (1) maintained coherence by avoiding non-discriminative layers; (2) enhanced controllability by concentrating effort where separation emerges; and (3) preserved general capabilities. Contributions. Our contributions are threefold: 1. We provide the first systematic analysis of layer-wise activation geometry in the context of steering, identifying non-uniform norm growth and progressive discriminability emergence as key phenomena governing steering effectiveness. 2. We propose Selective Steering, a principled method that combines norm-preserving rotation with discriminative layer selection. We prove that SS guarantees activation norm preservation (Proposition 2 ) while standard Angular Steering violates this property (Proposition 1 ). 3. Through comprehensive experiments on 8 models across 3 families (Llama, Qwen, Gemma), we demonstrate that SS simultaneously achieves: (1) zero perplexity threshold violations across all models and angles; (2) up to 5.5× improvement in attack success rate on challenging models; and (3) preservation of general capabilities, substantially outperforming existing methods. 2 Background 2.1 Transformer Architecture Decoder-only transformers process an input token sequence \mathbf{t}=(t_{1},\dots,t_{n}) by first converting tokens to initial embeddings, \mathbf{h}^{(1)}_{i}=\text{Embed}(t_{i}) , where \mathbf{h} denotes a vector in activation space. These activations are then iteratively refined through L layers via a residual stream architecture. Within each layer \ell , the residual stream activation \mathbf{h}^{(\ell)}_{i} for token t_{i} is updated by incorporating information from a self-attention mechanism and a multi-layer perceptron (MLP) block, typically with normalization applied before these components: \displaystyle\mathbf{h}^{(\ell)}_{i,\text{post-attn}} \displaystyle=\mathbf{h}^{(\ell)}_{i}+\text{Attn}^{(\ell)}(\text{Norm}(\mathbf{h}^{(\ell)}_{1:i})) \displaystyle\mathbf{h}^{(\ell+1)}_{i} \displaystyle=\mathbf{h}^{(\ell)}_{i,\text{post-attn}}+\text{MLP}^{(\ell)}(\text{Norm}(\mathbf{h}^{(\ell)}_{i,\text{post-attn}})) (1) This layered processing constructs increasingly sophisticated representations, where \mathbf{h}\in\mathbb{R}^{d_{\text{model}}} . Finally, output activations from the last layer, \mathbf{h}^{(L+1)}_{i} , are projected to vocabulary logits via \text{logits}_{i}=\text{Unembed}(\mathbf{h}^{(L+1)}_{i}) , which are then normalized using softmax to produce probability distributions \mathbf{y}_{i} for next-token prediction. 2.2 Activation Steering Activation steering modifies internal model representations at inference time to induce or suppress specific behaviors without requiring retraining ( Turner et al. 2024 ; Arditi et al. 2024 ) . Features are hypothesized to be represented by orthogonal directions in activation space ( Elhage et al. 2022 ) , enabling targeted interventions through geometric transformations. Existing methods include vector addition ( Turner et al. 2024 ) , orthogonal projection ( Arditi et al. 2024 ) , and geometric rotation ( Vu and Nguyen 2025 ) . A comprehensive comparison of these approaches is provided in Appendix A . Angular Steering Framework. We build upon Angular Steering ( Vu and Nguyen 2025 ) , which reformulates activation editing as rotation within a 2D subspace. Given an orthonormal basis \{\mathbf{b}_{1},\mathbf{b}_{2}\} spanning the steering plane P , rotation to target angle \theta is implemented as: \displaystyle\mathbf{h}_{\text{steered},\theta} \displaystyle=\mathbf{h}-\text{proj}_{P}(\mathbf{h}) \displaystyle+\|\text{proj}_{P}(\mathbf{h})\|\cdot[\mathbf{b}_{1}\;\mathbf{b}_{2}]\,\mathbf{R}_{\theta}\,[1\;0]^{\top}, (2) where \text{proj}_{P}(\mathbf{h})=(\mathbf{b}_{1}\mathbf{b}_{1}^{\top}+\mathbf{b}_{2}\mathbf{b}_{2}^{\top})\mathbf{h} denotes the projection of \mathbf{h} onto the steering plane, and \mathbf{R}_{\theta} is the standard 2D rotation matrix: \displaystyle\mathbf{R}_{\theta}=\begin{bmatrix}\cos(\theta)&-\sin(\theta)\\ \sin(\theta)&\cos(\theta)\end{bmatrix}. (3) This formulation provides continuous control over behavioral intensity through the rotation angle \theta\in[0°,360°) . 2.3 Feature Direction Extraction The most established method for constructing steering vectors is the difference-in-means approach ( Belrose 2023 ) . Given contrastive prompt sets - a negative set \mathcal{D}^{(\text{train})}_{\text{neg}} where a target feature is absent and a positive set \mathcal{D}^{(\text{train})}_{\text{pos}} where the feature is present - the steering vector at layer k is computed as: \displaystyle\mathbf{d}^{(k)}=\boldsymbol{\mu}^{(k)}_{\text{pos}}-\boldsymbol{\mu}^{(k)}_{\text{neg}}, (4) where the class-conditional mean vectors are: \displaystyle\boldsymbol{\mu}^{(k)}_{\text{pos}}=\frac{1}{|\mathcal{D}^{(\text{train})}_{\text{pos}}|}\sum_{p\in\mathcal{D}^{(\text{train})}_{\text{pos}}}\mathbf{x}^{(k)}(p), \displaystyle\boldsymbol{\mu}^{(k)}_{\text{neg}}=\frac{1}{|\mathcal{D}^{(\text{train})}_{\text{neg}}|}\sum_{p\in\mathcal{D}^{(\text{train})}_{\text{neg}}}\mathbf{x}^{(k)}(p). (5) Here, \mathbf{x}^{(k)}(p) denotes the activation vector at layer k for prompt p . This difference vector \mathbf{d}^{(k)} points in the direction that maximally separates the two classes in activation space. We normalize it to obtain the unit steering direction: \hat{\mathbf{d}}^{(k)}=\mathbf{d}^{(k)}/\|\mathbf{d}^{(k)}\| . 3 Methodology 3.1 Limitations of Angular Steering While Angular Steering ( Vu and Nguyen 2025 ) introduces continuous control through rotation in a 2D subspace, its practical implementation suffers from a critical flaw: norm distortion . Although the theoretical rotation matrix is mathematically sound, the efficient implementation (Equation 2.2 ) fails to preserve norms. Proposition 1 (Norm Violation in Angular Steering) . The Angular Steering implementation (Equation 2.2 ) does not preserve activation norms for general rotation angles \theta . We provide a constructive proof in Appendix B.1 , demonstrating that even at \theta=0° (the identity transformation), norm preservation fails unless the activation’s projection onto the steering plane lies exactly along \mathbf{b}_{1} with non-negative coefficient. This violation propagates through