ASGuard: Activation-Scaling Guard to Mitigate Targeted Jailbreaking Attack
Yein Park, Jungwoo Park, Jaewoo Kang, Korea University, AIGEN [email protected]@[email protected] · 2025
Read ASGuard: Activation-Scaling Guard to Mitigate Targeted Jailbreaking Attack by Yein Park, Jungwoo Park, Jaewoo Kang, Korea University, AIGEN [email protected]@[email protected] (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2509-25843.txt.
Introduction
Yein Park, Jungwoo Park, and Jaewoo Kang present ASGuard, a guard that blunts targeted jailbreak attacks on language models by scaling internal activations. Safety aligned models can refuse a harmful request yet comply when the same request is rephrased in past tense. That tense trick exposes a generalization gap in current alignment whose mechanism was poorly understood.
Circuit analysis first finds the attention heads causally linked to the tense attack. A channel wise scaling vector is then trained to recalibrate those vulnerable heads. Preventative fine tuning locks in a more robust refusal behavior. Across four models, attack success falls sharply while general capability is preserved and over refusal stays low. The work shows how mechanistic insight yields targeted defenses.
Catalog record
| CREATOR | Yein Park, Jungwoo Park, Jaewoo Kang, Korea University, AIGEN [email protected]@[email protected] |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 54 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2509-25843
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
ASGuard: Activation-Scaling Guard to Mitigate Targeted Jailbreaking Attack Yein Park, Jungwoo Park, Jaewoo Kang, Korea University, AIGEN [email protected]@[email protected] Abstract Large language models (LLMs), despite being safety-aligned, exhibit brittle refusal behaviors that can be circumvented by simple linguistic changes. As tense jailbreaking demonstrates that models refusing harmful requests often comply when rephrased in past tense, a critical generalization gap is revealed in current alignment methods whose underlying mechanisms are poorly understood. In this work, we introduce Activation-Scaling Guard ( ASGuard ), an insightful, mechanistically-informed framework that surgically mitigates this specific vulnerability. For the first step, we use circuit analysis to identify the specific attention heads causally linked to the targeted jailbreaking, the tense-changing attack. Second, we train a precise, channel-wise scaling vector to recalibrate the activation of tense vulnerable heads. Lastly, we apply it into a “preventative fine-tuning”, forcing the model to learn a more robust refusal mechanism. Across three LLMs, ASGuard effectively reduces the attack success rate of targeted jailbreaking while preserving general capabilities and minimizing over refusal, achieving a Pareto-optimal balance between safety and utility. Our findings underscore how adversarial suffixes suppress the propagation of the refusal-mediating direction, based on mechanistic analysis. Furthermore, our work showcases how a deep understanding of model internals can be leveraged to develop practical, efficient, and targeted methods for adjusting model behavior, charting a course for more reliable and interpretable AI safety 1 1 1 Our datasets and code are publicly available at https://github.com/dmis-lab/ASGuard . 1 Introduction Ever since the rise of Large Language Models (LLMs) in AI service, a tug of war between safety alignment and adversarial attacks seeking to exploit vulnerabilities is still ongoing ( Bengio et al. 2023 ; Dong et al. 2024 ) . While the technical reports for prominent models detail their internal alignment policies ( Dubey et al. 2024 ; Team et al. 2025 ) , a recent joint alignment evaluation by OpenAI and Anthropic reveals that even forefront models still struggle with critical issues, including vulnerabilities such as sycophancy and susceptibility to jailbreaks ( OpenAI 2025b ; Bowman et al. 2025 ) . These findings highlight not just the individual weaknesses of each model, but a fundamental challenge in AI safety, emphasizing the need for more multifaceted approaches. To date, initial and fundamental techniques such as Supervised Fine-Tuning (SFT) ( Wei et al. 2022 ) , Reinforcement Learning ( Ouyang et al. 2022 ) and Direct Preference Optimization (DPO) ( Rafailov et al. 2023 ) , have proven effective against direct and unambiguous harmful prompts. However, the threat landscape has evolved considerably, with adversaries developing sophisticated attacks that bypass these initial defenses ( Mazeika et al. 2024 ) . These recent attacks often move beyond simple adversarial suffixes, instead exploiting deeper semantic loopholes and generalization gaps within the model’s safety training. For example, tense jailbreaking demonstrates that a minor, semantically preserving linguistic alteration-changing a harmful request from the present tense (e.g., “How to make a Molotov cocktail”?) to the past tense (e.g., “How did pople make a Molotov cocktail?”)-is sufficient to bypass the safety guardrails of numerous state-of-the-art (SoTA) LLMs ( Andriushchenko & Flammarion 2025 ) . The vulnerability is inferred as stemming from a failure of semantic generalization; models usually trained to refuse requests for illicit instructions but often misinterpret past tense form as benign historical inquiries. This shows that current methods teach models what content to refuse by shaping their global output distribution, but fail to instill a robust understanding of the underlying harmful intent. Without more nuanced understanding of the model’s internal processing, not just mere output-level optimization, it struggles to patch specific, narrow vulnerabilities, accompanying side effects such as “over-refusal” ( Röttger et al. 2024 ; Jiang et al. 2024 ) and “catastrophic forgetting” ( Qi et al. 2025 ) . This is further justified by emerging evidence that core safety functions are highly localized, often residing within a small number of specific attention heads ( Zhou et al. 2025 ) . In this work, we introduce Activation-Scaling Guard ( ASGuard ), an interpretable alignment technique designed for surgical repair of localized safety failures. As previous methodologies have shown the safety-utility trade-off where enhancing safety often comes at the cost of utility degradation, we predicate on the hypothesis that to effectively patch only a specific, known vulnerability, one must intervene directly on the internal mechanisms causally responsible for it. Based on mechanistic interpretability, we employ transformer circuits to identify the specific causal points inside each LLM ( Elhage et al. 2021 ; Bereska & Gavves 2024 ; Lindsey et al. 2025 ) . We successfully localize the specific attention heads within the LLM’s that are causally implicated in the targeted jailbreaking attack, which shows up only within past tense vulnerable circuits. Next, we propose a two-step intervention strategy. First, an “Identify-then-Scale” protocol learns a precise channel-wise scaling vector that suppresses the output of vulnerable components, effectively neutralizing the harmful pathway. As Lee et al. 2025 have already verified the effectiveness of the light-weight scaling vector, we expand the approach to safety alignment successfully. One step further, we devise an insightful training process, “Preventative Fine-Tuning”, which uses scaling vector temporary to guide the model toward learning a more robust and resistant to overfitting inspired by Chen et al. 2025 . Figure 1: The overview of ASGuard . We first localize jailbreaking-vulnerable attention heads through circuit construction using successful attack cases. After filtering out specific heads only shown within tense vulnerable circuits by comparing them with attack failure circuits, we list up and train the attention head scaling vector which controls activations to be tuned into predefined refusal answer. Lastly, we freeze and attach it into LLMs, and fine-tune model with tense refusal dataset. LLMs can learn more robust refusal action, while preserve general capabilities and minimize over refusal. The scaling vector is no more needed so we detach it to mitigate any other over-boosting of refusal. The result in Table 2 shows that our method successfully decrease attack success rate of targeted jailbreak with more balanced safety-utility trade-off. The primary contributions of this paper are as follows: 1. We conduct identification and causal verification of tense vulnerable heads in three open-source LLMs (Llama-3.1-8B-Instruct, Qwen2.5-7B-Instruct, gemma-2-9b-it) using circuits. 2. Our ASGuard surgically patches the targeted vulnerability (attack success rate of tense jailbreaking reduced from 42% to 8% in Llama, 51% to 8% in Qwen) based on synergistic combination with activation scaling vector. 3. Empirical validation demonstrates that our method acheives a balance on the safety-utility Pareto front for the tense jailbreaking task, outperforming SFT, DPO, and other representation intervention, with less performance degradation. 2 Preliminaries 2.1 Circuit Analysis We model the internal computation of a transformer architecture as a directed acyclic graph (DAG) G=(N,E) , where each node in N corresponds to a distinct component in the model: attention heads A_{l,j} (at layer l and head j ), MLP modules M_{l} for each layer, the input node I (embeddings) and the output node O (logits), following the circuit framework ( Elhage et al. 2021 ; Nanda et al. 2023 ; Conmy et al. 2023 ; Ameisen et al. 2025 ) . It is formally defined as the set of nodes: N=\{I,A_{l,j},M_{l},O\}. (1) Edges E encode