Babel: Jailbreaking Safety Attention via Obfuscation Distribution Optimized Sampling
Ziwei Wang, Jing Chen, Ruichao Liang, Zhi Wang, Yebo Feng Ju Jia Ruiying Du Cong Wu Yang Liu · 2026
Read Babel: Jailbreaking Safety Attention via Obfuscation Distribution Optimized Sampling by Ziwei Wang, Jing Chen, Ruichao Liang, Zhi Wang, Yebo Feng Ju Jia Ruiying Du Cong Wu Yang Liu (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-17971.txt.
Introduction
Ziwei Wang and eight colleagues investigate a weak spot in language-model safety alignment. Safety relies on a few sparsely spread attention heads, leaving much of that space weakly watched. The team formalizes this with a jailbreaking model that maps the boundary of effective text obfuscation. Guided by it, they build Babel, a black-box attack sampling obfuscations and refining their distribution with feedback, without internals. On frontier models, Babel lifts GPT-4o attack success from 41.33% to 82.67% and Claude-3-5-haiku from 38.33% to 78.33% within about 40 queries.
Catalog record
| CREATOR | Ziwei Wang, Jing Chen, Ruichao Liang, Zhi Wang, Yebo Feng Ju Jia Ruiying Du Cong Wu Yang Liu |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 41888 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2605.17971
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Babel: Jailbreaking Safety Attention via Obfuscation Distribution Optimized Sampling Ziwei Wang, Jing Chen, Ruichao Liang, Zhi Wang, Yebo Feng Ju Jia Ruiying Du Cong Wu Yang Liu Abstract Despite rigorous safety alignment, Large Language Models (LLMs) remain vulnerable to jailbreak attacks. Existing black-box methods often rely on heuristic templates or exhaustive trials, lacking mechanistic interpretability and query efficiency. In this study, we investigate an intrinsic vulnerability in the safety mechanisms of LLMs, where safety alignment relies on a small set of sparsely distributed attention heads, leaving much of the representational space weakly monitored. We formalize this phenomenon with a mathematical jailbreaking model that characterizes the delicate boundary of effective text obfuscation and analytically explains observed jailbreak behaviors. Guided by this model, we propose Babel, an efficient black-box attack framework that exploits the identified safety gap through systematic obfuscation sampling with iterative, feedback-driven distribution refinement, enabling reliable and high-success jailbreak attacks without access to model internals. Comprehensive evaluations on frontier commercial models demonstrate that Babel achieves state-of-the-art attack success rates and superior query efficiency. Specifically, compared to state-of-the-art methods, Babel increases the attack success rate on GPT-4o from 41.33% to 82.67% and on Claude-3-5-haiku from 38.33% to 78.33% within an average of 40 queries, providing a robust red-teaming methodology for LLMs safety research. 1 Introduction Large Language Models (LLMs) have emerged as cornerstone computational technologies across diverse industrial and academic sectors ( 15 ; 24 ; 3 ; 19 ) . The remarkable versatility and rapid evolution of LLMs have catalyzed their widespread commercial adoption, consistently extending both their practical scope and technical boundaries ( 9 ; 1 ; 33 ) . Despite their proliferation, the adversarial resilience of LLMs remains a critical concern, as their safety mechanisms often struggle to keep pace with evolving attack vectors. Certain adversarial attacks can go beyond the LLMs’ safety broundaries ( 12 ) which are not fully understood. In particular, LLMs have proven vulnerable to jailbreak attacks ( 40 ; 7 ; 37 ) , whereby meticulously crafted prompts bypass safety filters to elicit harmful or biased content. Even state-of-the-art models are not immune, occasionally producing prohibited outputs when subjected to sophisticated adversarial inputs ( 34 ; 35 ) . Consequently, rigorous red-teaming through diverse jailbreak methodologies has become imperative, serving as a vital diagnostic tool to evaluate and fortify the safety boundaries of LLMs. Jailbreak attacks are generally categorized as white-box and black-box attacks based on attacker capabilities. Black-box attacks pose a more pervasive threat, as most leading-edge models are deployed as closed-source services ( 25 ; 10 ) . Existing black-box attack techniques primarily design methods from the attackers’ perspective, constructing and optimizing templates and prompts through extensive search or heuristic algorithms to achieve effective and transferable attacks ( 38 ; 17 ; 8 ; 14 ; 34 ) . However, these approaches often lack interpretability for ignoring vulnerabilities within the LLMs’ inherent safety mechanisms, limiting their performance and insights into enhancing safety. To address these limitations, we shift the perspective to the internal safety mechanisms of LLMs, aiming to uncover intrinsic vulnerabilities that can be systematically exploited. Prior work shows that safety alignment is primarily implemented by a small number of sparsely distributed attention heads (safety heads) ( 42 ) , meaning that only a limited subset of hidden states is monitored while a large representational space remains unchecked. This imbalance creates an exploitable vulnerability. For the original harmful query, copyright-related information is captured by safety heads, resulting in refusal. In contrast, a carefully constructed obfuscated input can shift harmful semantics into hidden states not covered by safety heads, thereby bypassing safety alignment and eliciting disallowed outputs. However, the boundary of effective obfuscation is highly delicate: excessive obfuscation destroys harmful intent, whereas insufficient obfuscation remains detectable. To characterize this boundary, we propose a mathematical jailbreaking model that quantifies obfuscation strength, enabling reliable evaluation and controlled optimization of obfuscation strategies that stably activate this vulnerability. Guided by this insight, we propose Babel, a black-box attack framework that bypasses safety attention via text obfuscation. Babel evaluates and optimizes the obfuscation distribution of harmful queries, explicitly targeting the identified safety gap. Unlike existing trial-and-error prompting approaches, Babel performs systematic obfuscation sampling, regulating the statistical properties of obfuscation to maximize bypass probability. This process is further guided by an iterative feedback loop that dynamically refines the sampling distribution based on model responses. Extensive experiments on state-of-the-art closed-source models show that Babel achieves state-of-the-art attack success rates: 82.67% on GPT-4o, 78.33% on Gemini-2.0-Flash, 95.67% on Grok-3, and 75.67% on Claude-3.5-Haiku, while substantially improving query efficiency over existing baselines. This paper makes the following contributions: • We identify a intrinsic vulnerability in the safety mechanisms of LLMs and formalize it through a mathematical model that characterizes how to bypass safety alignment. • We propose Babel, a black-box jailbreak framework that systematically exploits this vulnerability via distribution-aware obfuscation sampling and iterative optimization. • We conduct extensive evaluations on commercial LLMs from multiple providers, achieving state-of-the-art attack success rates with significantly improved query efficiency. 2 Related Work 2.1 Safety Mechanisms of LLMs Recent mechanistic interpretability studies have begun to uncover the internal structures underlying safety alignment in large language models ( 42 ; 6 ; 32 ) . Prior work suggests that safety behaviors are implemented by sparse and highly localized components, including specific attention heads and neurons, whose ablation can substantially weaken safety alignment while largely preserving general model utility. For example, 42 identify safety-critical attention heads whose removal significantly increases harmful responses despite modifying only a negligible fraction of parameters. Similarly, 6 show that fewer than 1% of neurons consistently contribute to handling harmful queries, indicating that safety alignment is concentrated in compact parameter subspaces. Subsequent studies further reveal the structural fragility of these mechanisms. 32 demonstrate that safety-critical regions occupy only a small fraction of the parameter space and can be disrupted through pruning or low-rank modifications with minimal impact on downstream utility. Related work also shows that neuron-level pruning can severely degrade alignment behavior even under small perturbations, highlighting the brittleness of safety-relevant representations. Moreover, recent evidence suggests that post-training capabilities, such as enhanced reasoning behaviors in LRMs, may partially suppress or mask pre-existing safety mechanisms rather than eliminate them entirely, implying a complex interaction between reasoning and alignment objectives. Together, these findings suggest that current LLM safety mechanisms rely on compact yet fragile internal structures that remain vulnerable to targeted perturbations. This line of work motivates further investigation into how reasoning dynamics interact with safety-critical representations and how such mechanisms fail under adversarial prompts. 2.2 Jailbreak Attack White-box methods that generates adversarial suffixes based on gradient-based prompt optimization ( 44 ; 36 ) , offerring high interpretability but low transferability. Their requirement for internal model structure parameters and gradient information limits their performance. Black-box methods are more diverse, manually crafted jailbreak prompts circulate actively on various online forums and social media ( 28 ) , posing a threat to the commercial LLMs. Heuristic-based methods search jailbreak prompts within a massive input space ( 20 ; 14 ) . Model-aware and attention mechanism based methods achieve transferability across different models ( 26 ; 18 ) . There are also methods that construct attack prompts directly