From Attribution to Action: A Human-Centered Application of Activation Steering
Tobias Labarta, Maximilian Dreyer, Katharina Weitz, Wojciech Samek, Sebastian Lapuschkin · 2026
Read From Attribution to Action: A Human-Centered Application of Activation Steering by Tobias Labarta, Maximilian Dreyer, Katharina Weitz, Wojciech Samek, Sebastian Lapuschkin (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-11467.txt.
Introduction
Labarta and four colleagues make explanations actionable with activation steering. Their web tool combines sparse-autoencoder scores with steering for instance-level concept analysis in vision models. In expert interviews with eight experts doing debugging tasks on CLIP, steering shifted work from inspection to testing ideas by intervening for all eight. Most trusted observed responses over explanation appeal. The tool lets users test ideas by intervening, not just by looking. Users favored suppression and flagged ripple effects and limited generalization of instance fixes.
Catalog record
| CREATOR | Tobias Labarta, Maximilian Dreyer, Katharina Weitz, Wojciech Samek, Sebastian Lapuschkin |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 36048 |
| LICENSE | http://creativecommons.org/licenses/by-sa/4.0/ |
| RIGHTS | CC BY SA |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2604.11467
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
From Attribution to Action: A Human-Centered Application of Activation Steering Tobias Labarta, Maximilian Dreyer, Katharina Weitz, Wojciech Samek, Sebastian Lapuschkin Abstract Explainable AI (XAI) methods reveal which features influence model predictions, yet provide limited means for practitioners to act on these explanations. Activation steering of components identified via XAI offers a path toward actionable explanations, although its practical utility remains understudied. We introduce an interactive workflow combining SAE-based attribution with activation steering for instance-level analysis of concept usage in vision models, implemented as a web-based tool. Based on this workflow, we conduct semi-structured expert interviews (N=8) with debugging tasks on CLIP to investigate how practitioners reason about, trust, and apply activation steering. We find that steering enables a shift from inspection to intervention-based hypothesis testing (8/8 participants), with most grounding trust in observed model responses rather than explanation plausibility alone (6/8). Participants adopted systematic debugging strategies dominated by component suppression (7/8) and highlighted risks including ripple effects and limited generalization of instance-level corrections. Overall, activation steering renders interpretability more actionable while raising important considerations for safe and effective use. 1 Introduction Unlike traditional engineered systems, deep neural networks develop their internal structures through optimization over billions of parameters rather than through deliberate architectural specification 2 ; 23 ; 19 . The semantic knowledge encoded by individual neurons, channels, or attention heads remains largely unknown 24 ; 12 , creating challenges in safety-critical applications where comprehending failure modes is essential 6 ; 41 . The explainable AI (XAI) research community has produced diverse methodologies to explain machine learning (ML) models; spanning local attribution techniques 45 ; 34 ; 3 , counterfactual explanations 25 , and concept-based approaches 30 ; 1 ; 5 . These methods enable what we term correlational inspection : practitioners can observe which components or features receive high attribution for a prediction, identifying candidates that may drive model behavior 26 . However, precise identification of relevant components is only half the picture. To verify whether highly attributed components causally drive a prediction rather than merely correlate with it, practitioners need interventive tools that act on the components explanations have surfaced 35 ; 29 . Such tools remain largely unavailable in practice 35 ; 9 . Advances in mechanistic interpretability (MI) offer a path toward closing this gap, from correlational inspection to what we term actionable investigation : directly manipulating model internals to test causal hypotheses about functional component roles. Sparse autoencoders (SAEs) can be applied to decompose model representations into interpretable components 15 ; 16 , and attribution methods quantify each component’s relevance to a given prediction. Activation steering complements this with an actionable capability by modifying these components to test their actual influence on model behavior 46 ; 43 ; 22 . In principle, combining attribution with steering enables such actionable explainability previous work have called for 35 ; 29 . However, existing work on steering has focused on dataset-level component selection 28 , system usability 33 , and perceptibility of steering effects 13 rather than its application for practitioners. Whether practitioners actually make the transition from correlational to causal reasoning when given steering access 8 , and with what consequences for trust, strategy, and risk awareness, remains open. Figure 1 : The four-step workflow from attribution to action: practitioners review component attributions, form causal hypotheses about components’ roles, and test them via activation steering. The resulting prediction updates provide immediate feedback for hypothesis evaluation. Example shows suppressing the “woman” component to assess its influence on job role classification for “nurse”. In this work, we operationalize and evaluate the transition from attribution inspection to actionable investigation for instance-level model debugging. We structure this transition into a four-step workflow, from prediction review through attribution analysis and hypothesis formation to hypothesis testing via activation steering, and implement it in SemanticLens, a web-based tool for instance-level investigation of vision-language models. Using this workflow as experimental vehicle, we conducted semi-structured expert interviews with ML researchers and engineers (N = 8) with two debugging tasks on CLIP 44 to investigate whether the transition occurs in practice and what reasoning patterns, trust dynamics, investigation strategies, and perceived risks emerge. 2 Related Work Mechanistic Foundation of Model Interventions The field of mechanistic interpretability seeks to reverse-engineer neural networks by decomposing them into understandable components and causal mechanisms 57 ; 59 ; 20 . A recent survey 57 organizes mechanistic MI methods into a “Locate, Steer, and Improve” pipeline, categorizing localization techniques (including gradient-based attribution) and intervention approaches (including different steering methods). Model intervention can be applied for both understanding model representations and controlling model behavior. Early work on indiscriminate ablations 48 ; 50 applied random interventions as a tool to understand general network properties, while later targeted ablations 37 ; 38 were used for testing functional hypotheses. More recently, activation and relevance patching 56 ; 27 , also known as causal tracing 36 and interchange intervention 21 , emerged as a method to isolate which components mediate specific computations by replacing activations from counterfactual inputs 38 . Beyond model understanding, intervention has been applied to steer models towards desired behavior. Contrastive Activation Addition (CAA) enables steering of language model behavior via direction vectors 46 ; 43 ; 22 . Recent work demonstrates that SAE features in CLIP can be effectively steered to influence model outputs 28 , with approximately 10-15% of features exhibiting meaningful steerability. Bhalla et al. 8 observe that while causal intervention has been employed to assess explanation faithfulness 39 ; 7 ; 10 ; 42 , these approaches rarely examine intervention as a method for practical control and debugging. Interactive Visual Analytics for Model Validation and Error Analysis The goal of actionable model interventions has motivated development of several interactive visual analytics systems that combine explanation techniques with user-facing interfaces for systematic debugging. AttributionScanner 53 identifies data slices through attribution-based clustering without requiring metadata, while VISLIX 54 generates natural language explanations of error patterns using foundation models. SLIM 52 combines attention-weighted feature representations with human feedback to actively filter and rebalance datasets, and SUNY 51 analyzes necessity and sufficiency of learned features as causal explanations. These systems collectively establish that bridging correlational observation with actionable intervention through human feedback, data curation, or direct model steering is central to practical explainability. Human-Centered Evaluation of Steering While the MI field has developed intervention techniques opening a new human-AI interaction space for model understanding and control, their human evaluation remains limited. To our knowledge, only two works 33 ; 13 have measured user-facing outcomes. ConceptViz 33 is a visual analytics system for LLM concept exploration and validation with activation steering. The authors conduct a user study (N = 12) to evaluate the effectiveness of ConceptViz system components in supporting users to explore and understand features as well as the overall system usability and workflow. The evaluation focuses on interface and high-level usability aspects without investigating the impact of direct model intervention with steering on users’ mental models and trust. Diallo et al. 13 conduct the most comprehensive human evaluation of steering to date (N = 190), measuring whether users perceive emotion control in language model outputs. In a user study, participants rate perceived emotional intensity and text comprehensibility across six emotions and eight steering