Fusion Steering: Prompt-Specific Activation Control

Waldemar Chang, Dr. Alhassan Yasin · 2025

Read Fusion Steering: Prompt-Specific Activation Control by Waldemar Chang, Dr. Alhassan Yasin (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2505-22572.txt.

Introduction

Waldemar Chang and Alhassan Yasin present Fusion Steering, a 2025 method that nudges language model internals to raise factual accuracy. Steering adds small activation shifts while the model answers. Older steering stuck to one layer or a fixed plan. Fusion Steering tailors the shift to each prompt.

Reference answers blend the true answer with a model-written explanation. Deltas from those references inject across all layers. Weights per prompt are tuned against overlap and fluency goals. Scores mix token match with judged quality. The method targets question answering where facts matter most.

Catalog record

CREATORWaldemar Chang, Dr. Alhassan Yasin
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE38 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2505-22572

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Fusion Steering: Prompt-Specific Activation Control Waldemar Chang, Dr. Alhassan Yasin Abstract We present Fusion Steering , an activation steering methodology that improves factual accuracy in large language models (LLMs) for question-answering (QA) tasks. This approach introduces flexible steering configurations, including full-layer steering and segmented steering . Unlike traditional methods constrained to single-layer or fixed-layer operations, Fusion Steering employs dynamic injection of prompt-specific activation deltas across all transformer layers. These activation deltas are derived from reference completions that combine the ground-truth answer with a model-generated explanation to facilitate semantically enriched, example-specific steering. The injection weights are optimized per prompt using Optuna, targeting a joint objective that balances token overlap (factual alignment) and perplexity (fluency proxy). Evaluation employs a composite score integrating token overlap and LLM-graded quality, encompassing factual accuracy, coherence, and relevance. Empirical results on 260 SimpleQA prompts (selected from 500 where the baseline failed) showcase the efficacy of segmented steering . Using Gemma-2-2B-IT with 8-bit quantization, segmented steering achieves an accuracy of 25.4% (outputs scoring ≥ 0.6 \geq 0.6 ), outperforming the baseline at 3.5% and full-layer steering at 16.2%. Under the stricter SimpleQA rubric, segmented steering boosts fully correct responses from 0.0% to 13.1%. These findings highlight the strengths of segmented, dynamic intervention strategies and the promise of per-prompt, full-network activation control. Fusion Steering is also amenable to sparse representations, such as Neuronpedia or sparse crosscoders, suggesting a promising direction for interpretable and scalable activation-level control in LLMs. 1 Introduction Large language models (LLMs) have exhibited exceptional capabilities across a broad spectrum of natural language processing tasks, spanning from fundamental text classification to intricate reasoning and question-answering (QA) brown2020languagemodelsfewshotlearners ; openai2024gpt4technicalreport ; touvron2023llamaopenefficientfoundation . Nevertheless, achieving precise control over their outputs remains a formidable challenge. Recent advances in interpretability research underscore the complexity of comprehending or modulating LLM behavior at a holistic level, particularly due to long-range reasoning dependencies, abstract conceptual structures, and intertwined feature representations lindsey2025biology . This highlights the increasing importance of localized, prompt-specific control methodologies that integrate multi-layer interventions to mitigate cross-layer superposition and polysemantic feature entanglement scaling_monosemanticity2024 ; crosscoders2024 . Prior investigations into steering neural network activations have predominantly centered on tasks involving straightforward semantic or syntactic adjustments, such as antonym generation, sentiment modulation, or toxicity suppression, where steering vectors are typically well-defined and exhibit linear characteristics within activation spaces turner2024steeringlanguagemodelsactivation ; postmus2025steeringlargelanguagemodels ; panickssery2024steeringllama2contrastive . Although effective in simpler contexts, these steering methods remain largely unexplored for more sophisticated, semantically rich tasks like factual question answering, which necessitate highly precise and context-aware outputs. All code and materials are available at https://github.com/MechInterpreter/Fusion_Steering . In this work, we introduce a novel steering approach specifically designed for factual QA tasks. Our method distinguishes itself from previous approaches in four key aspects: First , we introduce the concept of enriched reference activations , which capture neural activation vectors when the model processes a fully enriched prompt explicitly containing both the correct ground-truth answer and its explanation. These vectors encode detailed semantic information directly tied to factual accuracy and explanatory coherence. This approach differs from prior methods that derive latent steering vectors from generic prompts or contrastive pairs, without integrating explanatory context as a conditioning input turner2024steeringlanguagemodelsactivation ; panickssery2024steeringllama2contrastive ; subramani2022extractinglatentsteeringvectors ; konen2024stylevectorssteeringgenerative ; stoehr2024activationscalingsteeringinterpreting . Second , our approach employs a synergistic combination of interpolated activation patching and additive steering, executed concurrently across all transformer layers. This comprehensive multilayer intervention strategy contrasts with prior methods, which typically applied steering to individual layers in isolation turner2024steeringlanguagemodelsactivation ; panickssery2024steeringllama2contrastive ; heimersheim2024useinterpretactivationpatching ; zou2025representationengineeringtopdownapproach , rather than concurrently across the whole network. Furthermore, unlike previous methods, we integrate an interpolated variant of activation patching with the directional modulation introduced by additive steering, ensuring a more refined and context-sensitive control mechanism. Third , we introduce prompt- and layer-specific tuning by optimizing two hyperparameters per instance: the fusion weight , which integrates the model’s original activations with the reference activations, and the steering strength , which scales the magnitude of the injected activation shift. These parameters are independently tuned across three distinct layer groups— early (layers 0–8), middle (layers 9–17), and late (layers 18–25), using 0-based indexing—enabling fine-grained, context-sensitive control over how factual guidance is incorporated throughout the model. Previous approaches to activation steering generally rely on a fixed intervention vector at a single layer or across multiple layers, often employing globally tuned intensity parameters that do not adapt to specific prompts or network regions turner2024steeringlanguagemodelsactivation ; panickssery2024steeringllama2contrastive ; li2024inferencetimeinterventionelicitingtruthful ; soo2025interpretablesteeringlargelanguage . In contrast, our approach performs localized, per-prompt calibration at multiple functional depths of the model, offering more precise control over the factual alignment process. Fourth , while previous steering approaches have targeted specific behaviors or attributes with clearly defined latent directions turner2024steeringlanguagemodelsactivation ; postmus2025steeringlargelanguagemodels ; panickssery2024steeringllama2contrastive ; marshall2025refusalllmsaffinefunction , our method is explicitly designed to enhance factual accuracy in open-ended question answering scenarios, where alignment cannot be captured by a single contrastive axis. This presents a more challenging control objective: the semantics of factual questions disperse across multiple, input-dependent dimensions. Effective control therefore requires semantically grounded steering capable of guiding the model toward discrete, knowledge-intensive answers. By distributing semantically meaningful reference activations throughout the network and dynamically adapting both their intensity and integration per prompt and layer group, our method enables holistic and precise control, explicitly guiding the model toward accurate, contextually grounded answers from the question alone. We empirically validate our approach on the SimpleQA benchmark wei2024measuringshortformfactualitylarge , demonstrating that our method significantly improves factual accuracy compared to the base model’s responses. 2 Methodology and experimental setup Note: All model generations in this work, whether from Gemma-2-2B-IT during inference or either Mistral Small 3.1 instance used for filtering and grading are performed under greedy decoding with temperature = 0.0 . This ensures complete determinism throughout the pipeline and facilitates precise, reproducible evaluation across all experimental stages. 2.1 Initial inference and subset construction We first ran the instruction-tuned baseline model (Gemma-2-2B-IT) gemmateam2024gemma2 on 500 prompts from the SimpleQA test split and used a rubric-based factuality classifier built on the Mistral Small 3.1 model mistral2024small to grade each response as CORRECT , INCORRECT , or NOT_ATTEMPTED (see Appendix A ). From these, we selected the 260 examples labeled INCORRECT , excluding both correct and non-attempted responses, for steering experimentation. We focus on this 260-prompt subset both due to computational constraints and because it represents the most challenging cases—each labeled INCORRECT by the LLM grader, making it ideal for stress-testing the effectiveness of steering interventions. To confirm that our experimentation subset covers a representative range of topics, we compared the topic distribution of the full 500-prompt sample to the 260 INCORRECT examples. As shown in Figure 1 , the distributions are broadly aligned across major categories such as Science and Technology , Politics , and Art , indicating that the incorrect subset retains the diversity of the larger sample. Furthermore, the complete SimpleQA dataset spans 4,326 prompts in 10 topic categories, with the largest shares belonging to Science and Technology (19.8%), Politics (16.4%), and Art (12.7%). This general distribution, shown in Figure 1 and documented in the official release wei2024measuringshortformfactualitylarge , 1 1 1 https://openai.com/index/introducing-simpleqa/ validates that our 500-sample—and by extension the 260-prompt subset—is well-stratified and representative of the broader benchmark. Figure

Read the complete text