The Struggle Between Continuation and Refusal: A Mechanistic Analysis of the Continuation-Triggered Jailbreak in LLMs
Yonghong Deng, Zhen Yang, Ping Jian, Xinyue Zhang, Zhongbin Guo, Chengzhi Li · 2026
Read The Struggle Between Continuation and Refusal: A Mechanistic Analysis of the Continuation-Triggered Jailbreak in LLMs by Yonghong Deng, Zhen Yang, Ping Jian, Xinyue Zhang, Zhongbin Guo, Chengzhi Li (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-08234.txt.
Introduction
Deng and colleagues analyze the continuation-triggered jailbreak. Simply moving a triggered instruction suffix can sharply raise jailbreak success rates. Despite safety alignment efforts, large language models stay open to jailbreaking, and the root causes are still unclear. Through a mechanistic analysis at the attention-head level, with causal tests and activation scaling, the authors trace the behavior to a contest. The model's built-in drive to keep going competes with safety defenses learned through safety training. Safety-critical heads act in varied ways across architectures.
Catalog record
| CREATOR | Yonghong Deng, Zhen Yang, Ping Jian, Xinyue Zhang, Zhongbin Guo, Chengzhi Li |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 33526 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2603.08234
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
The Struggle Between Continuation and Refusal: A Mechanistic Analysis of the Continuation-Triggered Jailbreak in LLMs Yonghong Deng, Zhen Yang, Ping Jian, Xinyue Zhang, Zhongbin Guo, Chengzhi Li Abstract With the rapid advancement of large language models (LLMs), the safety of LLMs has become a critical concern. Despite significant efforts in safety alignment, current LLMs remain vulnerable to jailbreaking attacks. However, the root causes of such vulnerabilities are still poorly understood, necessitating a rigorous investigation into jailbreak mechanisms across both academic and industrial communities. In this work, we focus on a continuation-triggered jailbreak phenomenon, whereby simply relocating a continuation-triggered instruction suffix can substantially increase jailbreak success rates. To uncover the intrinsic mechanisms of this phenomenon, we conduct a comprehensive mechanistic interpretability analysis at the level of attention heads. Through causal interventions and activation scaling, we show that this jailbreak behavior primarily arises from an inherent competition between the model’s intrinsic continuation drive and the safety defenses acquired through alignment training. Furthermore, we perform a detailed behavioral analysis of the identified safety-critical attention heads, revealing notable differences in the functions and behaviors of safety heads across different model architectures. These findings provide a novel mechanistic perspective for understanding and interpreting jailbreak behaviors in LLMs, offering both theoretical insights and practical implications for improving model safety. 1 Introduction Figure 1 : The procedure of the continuation-triggered jailbreak. We observe that placing the continuation-triggered instruction suffix outside the prompt boundary can trigger jailbreak behavior, leading to harmful content generation. Large language models demonstrate remarkable capabilities in natural language understanding and generation, producing coherent, contextually relevant, and semantically rich text Minaee et al. 2024 . They have been widely applied in dialogue systems Chen et al. 2025 , mathematical reasoning Guo et al. 2025 , code generation Anthropic 2024 , and other scenarios. However, these models remain vulnerable to carefully crafted malicious prompts, which can bypass their built-in safety mechanisms and induce the generation of potentially harmful or unsafe content Ma et al. 2025 ; Nasr et al. 2025 . Existing studies have identified various jailbreak attack methods, including prompt injection Zhang et al. 2024 ; Shen et al. 2024 , role-play Li et al. 2023b and multi-step jailbreak attack Alobaid et al. 2026 , which bypass the model’s safety alignment, causing the model to generate harmful content. To address this challenge, existing alignment strategies, such as Reinforcement Learning from Human Feedback (RLHF) Christiano et al. 2017 and Direct Preference Optimization (DPO) Rafailov et al. 2023 , to some extent enable models to resist jailbreak attacks by training on carefully crafted preference data. Regrettably, despite the enhanced safety performance, existing works primarily focus on black-box defenses against jailbreak attacks, yet overlook the underlying reasons for the success of these attack methods Zhou et al. 2024 ; Hines et al. 2024 ; Shi et al. 2025 . Blindly relying on aforementioned data-driven alignment training for jailbreak defense may introduce latent risks to real-world deployment, as such alignment methods often achieve only shallow alignment Qi et al. 2025 . Consequently, even minor variations of jailbreak strategies can easily again invalidate models. To address these challenges, we study the internal mechanisms of a continuation-triggered jailbreak phenomenon in this work, aiming to provide a mechanistic perspective for future safety defenses and to offer insights that are crucial for developing more robust and secure large language models. Specifically, as illustrated in Figure 1 , under the clean prompt setting, models refuse to respond when a continuation-triggered instruction suffix is appended after a harmful instruction. In contrast, under the jailbreak prompt setting, simply relocating the continuation-triggered suffix to follow the user instruction prompts the model to continue generating harmful content, thereby successfully bypassing safety constraints. It is worth noting that this setup is primarily designed to facilitate the investigation of the internal mechanisms underlying jailbreak behavior in large language models. Our results demonstrate that, across multiple datasets, both LLaMA-2-7B-Chat and Qwen2.5-7B-Instruct models exhibit substantial increases in Attack Success Rate (ASR) under this setting, with ASR rising from 0 to as high as 0.58 in some cases. Intuitively, given that most of current LLMs are trained on next-token prediction paradigm, they possess an inherent tendency to generate coherent continuations that align with the semantics of the input. Alignment training, however, attempt to redirect the model from continuing the input to declining the request when safety is at risk, which introduces a fundamental tension with the pre-training paradigm. Therefore, we hypothesize that the continuation-triggered jailbreaking may arise from an overactivation of the model’s continuation capabilities. Specifically, we posit that LLMs contain distinct attention heads responsible for safety enforcement (safety heads) and for continuation-triggered generation (continuation heads). The fundamental reason why different prompt structures induce drastically different model behaviors lies in the internal competition between these safety heads and continuation heads. To faithfully investigate the underlying mechanisms of this phenomenon and to validate our hypothesis, we adopt mechanistic interpretability at the level of attention heads. Specifically, we first employ a causal intervention technique, namely path patching Wang et al. 2022 , to conduct a head-wise analysis across the model. Through path patching, We identify a small subset of attention heads located in the middle-to-late layers of the model that play a critical role in enabling jailbreak behavior in the specific jailbreak task studied in this work. To further examine the functional contributions of these key heads, we ablate them by zeroing out their activations. Based on the resulting impact on ASR after ablation, these heads can be categorized into safety heads and continuation heads. Subsequently, we perform activation scaling and ablation experiments on both categories to validate their causal effects on jailbreak behavior. The experimental results demonstrate that this phenomenon indeed arises from an inherent tension between the model’s intrinsic continuation-driven generation capability and the safety capability acquired through alignment training. The main contributions of this work are as follows: • We are the first to investigate the underlying mechanisms of a specific jailbreaking method, i.e., the continuation-triggered jailbreak, providing valuable insight for understanding the genuine safety boundary of LLMs. • By leveraging path patching, activation scaling, and ablation analyses, we reveal that the core cause of this phenomenon lies in the conflict between the model’s intrinsic generative continuation capability and its safety-aligned behaviors. • We provide a detailed analysis of the selected safety heads, identifying those that are critical for model behavior under the continuation-triggered jailbreak, which could benefit the future development of more robust and reliable LLMs. These findings not only offer a new perspective for understanding the internal safety dynamics of large language models but also provide practical guidance for enhancing their alignment robustness. 2 Related Work Jailbreak Attack in LLMs. Jailbreak attacks refer to adversarial input strategies that deliberately exploit weaknesses in the safety alignment mechanisms of large language models, enabling them to generate outputs that violate predefined safety policies, ethical guidelines, or usage constraints. Despite extensive safety alignment, modern LLMs remain vulnerable to various jailbreak attacks, such as adversarial suffixes Zou et al. 2023 , LLM‑driven iterative attacks Chao et al. 2025 and attacks based on attention and generation mechanisms Wu et al. 2025 . Unlike prior works, we are the first to investigate the underlying mechanisms behind continuation-triggered