Jailbreak-Zero: A Path to Pareto Optimal Red Teaming for Large Language Models
Kai Hu 1,2 , Abhinav Aggarwal 1 , Mehran Khodabandeh 1 , David Zhang 1 , Eric Hsin 1 , Li Chen 1 , Ankit Jain 1 , Matt Fredrikson 2 , Akash Bharadwaj 1 · 2026
Read Jailbreak-Zero: A Path to Pareto Optimal Red Teaming for Large Language Models by Kai Hu 1,2 , Abhinav Aggarwal 1 , Mehran Khodabandeh 1 , David Zhang 1 , Eric Hsin 1 , Li Chen 1 , Ankit Jain 1 , Matt Fredrikson 2 , Akash Bharadwaj 1 (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2601-03265.txt.
Description
Kai Hu and eight co-authors introduce Jailbreak-Zero, a red teaming method that probes language models for safety weaknesses using policies rather than fixed example lists. Example-based testing covers only the attacks someone already thought of. Jailbreak-Zero instead uses an attack model to generate a large, diverse volume of adversarial prompts, then fine-tunes that attacker on a preference dataset.
The authors report that the method reaches Pareto optimality across policy coverage, attack strategy diversity, and how closely prompts resemble real user inputs. It achieved significantly higher attack success rates than leading techniques against both open-source and proprietary models, including GPT-4o and Claude 3.5. The prompts remain human-readable, and the pipeline needs minimal human intervention, making the approach scalable for ongoing safety evaluation.
Catalog record
| CREATOR | Kai Hu 1,2 , Abhinav Aggarwal 1 , Mehran Khodabandeh 1 , David Zhang 1 , Eric Hsin 1 , Li Chen 1 , Ankit Jain 1 , Matt Fredrikson 2 , Akash Bharadwaj 1 |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 67 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2601-03265