Jailbroken Frontier Models Retain Their Capabilities

Daniel Zhu, Zihan Wang, Xuchan Bao, Jerry Wei · 2026

Read Jailbroken Frontier Models Retain Their Capabilities by Daniel Zhu, Zihan Wang, Xuchan Bao, Jerry Wei (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-00267.txt.

Introduction

Daniel Zhu and 3 co-authors test whether jailbreaking a guarded language model weakens the model itself. Earlier work had found a jailbreak tax: the tricks used to slip past safeguards also degrade task performance. The authors ask whether that tax shrinks as models grow more capable, and they run twenty-eight jailbreaks across five benchmarks.

Weaker models paid heavily, losing about a third of their benchmark performance on average when jailbroken. The strongest model tested lost only a small fraction, even though reasoning-heavy tasks degraded more than recall tasks across the board. One leading jailbreak method slipped past classifiers almost perfectly with near-zero loss. The authors recommend that safety cases for frontier models never count on jailbreaks dulling a model's abilities.

Catalog record

CREATORDaniel Zhu, Zihan Wang, Xuchan Bao, Jerry Wei
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE58 KB
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2605.00267

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Jailbroken Frontier Models Retain Their Capabilities Daniel Zhu, Zihan Wang, Xuchan Bao, Jerry Wei Abstract As language model safeguards become more robust, attackers are pushed toward developing increasingly complex jailbreaks. Prior work has found that this complexity imposes a jailbreak tax that degrades the target model’s task performance. We show that this tax scales inversely with model capability and that the most advanced jailbreaks effectively yield no reduction in model capabilities. Evaluating 28 jailbreaks on five benchmarks across Claude models ranging in capability from Haiku 4.5 to Opus 4.6, we find Haiku 4.5 loses an average of 33.1% on benchmark performance when jailbroken, while Opus 4.6 at max thinking effort loses only 7.7%. We also observe that across all models, reasoning-heavy tasks display considerably more degradation than knowledge-recall tasks. Finally, Boundary Point Jailbreaking, currently the strongest jailbreak against deployed classifiers, achieves near-perfect classifier evasion with near-zero degradation across safeguarded models. We recommend that safety cases for frontier models should not rely on a meaningful capability degradation from jailbreaks. 1 Introduction Large language models (LLMs) possess high-risk capabilities that can be used by malicious actors to cause significant harm, particularly for the development of chemical, biological, radiological, and nuclear weapons (CBRN) ( 11 ; 15 ) . To defend against potential misuse, frontier labs deploy safeguards that block harmful inputs and outputs ( 24 ) , preventing adversaries from exploiting these capabilities. Over time, these safeguards have improved to be more robust against adversarial jailbreaking attacks ( 6 ) , forcing attackers to develop increasingly complex jailbreaking strategies. Prior work has established the concept of a jailbreak tax ( 19 ; 26 ) , which quantifies the degradation in model capabilities induced by complex attacks such as obfuscation schemes ( 29 ; 27 ) , elaborate roleplay ( 25 ; 30 ) , and instruction hijacking ( 20 ; 9 ) . This existing evidence suggests that complex jailbreaks may divert an LLM’s cognitive capacity away from intended harmful requests, therefore reducing model capabilities significantly. However, prior work has not evaluated whether the jailbreak tax persists on the most capable frontier models, nor on more-recent attacks such as Boundary Point Jailbreaking (BPJ) ( 7 ) . Figure 1 : Baseline accuracy with no jailbreak applied (blue) and mean accuracy under 28 jailbreaks (orange) for each model across five benchmarks, with connecting bars showing the jailbreak tax. On four of five benchmarks, the jailbreak tax decreases as models become more capable. In this paper, we investigate the jailbreak tax across 28 jailbreaks, five benchmarks, and five frontier models of varying capabilities. We examine how degradation changes with model capability, task type, and attack design. Our findings are as follows. First, we study the effect of model capability on the jailbreak tax ( section 3 ). We find that as model capability increases, the gap between the model’s accuracy when no jailbreak is applied (baseline) and average jailbroken accuracy shrinks ( Figure 1 ). On average across all jailbreaks and benchmarks, the absolute degradation decreases from 20.4% for Haiku 4.5 to 7.1% for Opus 4.6 with max thinking effort. In four of five benchmarks, the gap is negligible for Opus 4.6 (thinking), with jailbreak performance nearly equal to baseline performance of Opus 4.5. This shows that the jailbreak tax is not a fixed property of the attack and instead shrinks as the target model grows more capable. Second, we investigate how attributes of the task affect degradation ( section 4 ). We observe that performance on reasoning-heavy tasks is more affected by jailbreaks than knowledge-recall tasks. Knowledge-recall benchmarks are nearly unaffected by jailbreaks for the most-capable models, while reasoning-heavy tasks show degraded performance even for the strongest models. Across all models, GPQA Diamond, our most reasoning-intensive benchmark, shows nearly twice the relative degradation of WMDP Bio, the least reasoning-dependent (21.8% vs. 12.0%). This suggests tasks that require complex reasoning are more affected by the jailbreak tax. Lastly, we focus on BPJ, an automated attack capable of producing universal jailbreaks against deployed safeguards ( section 5 ). We find that BPJ achieves near-zero degradation while maintaining high bypass rates against deployed classifiers, reaching 92–100% classifier evasion on safeguarded models. This shows that the most capable adversaries can bypass deployed safeguards without incurring a meaningful reduction in capabilities. Overall, our findings suggest that capability degradation from jailbreaks is not a reliable safety assumption. 2 Experimental Setup 2.1 Jailbreak Selection We curate 28 jailbreaks from three sources to ensure broad coverage of realistic attack techniques: • Bug bounty submissions: Jailbreaks submitted through Anthropic’s bug bounty program ( 24 ) by external red-teamers. • Red-teaming organizations: Jailbreaks developed by expert red-teamers at the UK AI Safety Institute and US AI Safety Institute ( 7 ) . • Academic literature: Published attack methods from jailbreaking literature, including adversarial optimization and encoding-based approaches ( 31 ; 27 ; 29 ) . Of these jailbreaks, 19 leverage ciphers to obfuscate inputs and outputs, while the remaining 9 rely on techniques such as roleplay, prompt injections, and adversarial suffixes. Our jailbreaks range from simple single-mechanism attacks to complex compositions that stack multiple strategies together. Each jailbreak is applied via a template-based transformation, plus an encoding scheme for cipher-based attacks, and requires no LLM to construct. See Appendix A for a complete catalog of our jailbreaks. In contrast to prior work, which relies primarily on academic attacks, the majority of our jailbreaks come from experienced red-teamers attacking deployed safeguards. 2.2 Benchmark Selection We evaluate on five benchmarks that collectively cover a wide range of biological knowledge and reasoning: GPQA Diamond ( 22 ) , the biology subset of WMDP ( 15 ) , LabBench ProtocolQA and CloningScenarios ( 14 ) , and the text-only subset of VCT ( 8 ) . All benchmarks are evaluated as multiple-choice questions, and we report pass@1 accuracy. We select these benchmarks to test scientific reasoning as a proxy for harmful biological capability because many of our jailbreaks were developed against bioweapon safeguards. 2.3 Prompt Strategies We design ten prompt strategies to model how an adversary would optimize a jailbreak to elicit the maximum performance from jailbroken models, ensuring that we do not understate model capabilities retained under jailbreaking. These strategies include both single-turn and two-turn approaches. Single-turn strategies combine reasoning and answering into one model response, whereas two-turn strategies have the model reason about its response before providing the final answer. Table 1 summarizes each strategy, and subsection B.1 provides the full prompt templates that we used for each strategy. No single prompting strategy is optimal for more than 20% of jailbreaks ( subsection B.2 ), so we evaluate all strategies and report the best score. Strategy Turns Description Direct 1 Ask for the answer with no additional prompting Explain Then Answer 1 Request explanation and answer in a single turn Confidence Rated 1 Reason, rate confidence, then answer Structured Output 1 Request key concepts, analysis, then answer Ultra Think 1 Encourage extensive step-by-step reasoning Chain of Thought 2 Reason in the first turn, extract the answer in the second Expert Persona 2 Adopt a domain expert persona before reasoning Elimination 2 Systematically eliminate incorrect options Self Critique 2 Generate an answer, then critically evaluate it

Read the complete text