Claudini: Autoresearch Discovers State-of-the-Art Adversarial Attack Algorithms for LLMs

Alexander Panfilov * 1, 2, 3 Peter Romov * 4 Igor Shilov * 4 Yves-Alexandre de Montjoye ‡ 4 Jonas Geiping ‡ 2, 3 Maksym Andriushchenko ‡ 2, 3 1 MATS 2 ELLIS Institute Tübingen & Max Planck Institute for Intelligent Systems 3 Tübingen AI Center 4 Imperial College London * Equal contribution ‡ Equal supervision · 2026

Read Claudini: Autoresearch Discovers State-of-the-Art Adversarial Attack Algorithms for LLMs by Alexander Panfilov * 1, 2, 3 Peter Romov * 4 Igor Shilov * 4 Yves-Alexandre de Montjoye ‡ 4 Jonas Geiping ‡ 2, 3 Maksym Andriushchenko ‡ 2, 3 1 MATS 2 ELLIS Institute Tübingen & Max Planck Institute for Intelligent Systems 3 Tübingen AI Center 4 Imperial College London * Equal contribution ‡ Equal supervision (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-24511.txt.

Introduction

Panfilov and co-authors show that AI agents in an autoresearch loop can discover state-of-the-art attack algorithms against language models. Frontier agents such as Claude Code and Codex worked with a library of over 30 prior methods and a fixed compute budget. Against a safeguard model, the best agent-found method reached up to 80 percent attack success on CBRNE queries, versus under 50 percent for known methods. Against an adversarially trained model, success hit 100 percent. The authors also trace how the methods evolved during the search.

Catalog record

CREATORAlexander Panfilov * 1, 2, 3 Peter Romov * 4 Igor Shilov * 4 Yves-Alexandre de Montjoye ‡ 4 Jonas Geiping ‡ 2, 3 Maksym Andriushchenko ‡ 2, 3 1 MATS 2 ELLIS Institute Tübingen & Max Planck Institute for Intelligent Systems 3 Tübingen AI Center 4 Imperial College London * Equal contribution ‡ Equal supervision
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE56946
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2603.24511

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Claudini: Autoresearch Discovers State-of-the-Art Adversarial Attack Algorithms for LLMs Alexander Panfilov * 1, 2, 3 Peter Romov * 4 Igor Shilov * 4 Yves-Alexandre de Montjoye ‡ 4 Jonas Geiping ‡ 2, 3 Maksym Andriushchenko ‡ 2, 3 1 MATS 2 ELLIS Institute Tübingen & Max Planck Institute for Intelligent Systems 3 Tübingen AI Center 4 Imperial College London * Equal contribution ‡ Equal supervision Abstract 1 Summary LLM agents like Claude Code can not only write code but also be used for autonomous AI research and engineering ( 40 ; 34 ) . We show that an autoresearch -style pipeline ( 24 ) powered by Claude Code discovers novel white-box adversarial attack algorithms that significantly outperform all existing (30+) methods in jailbreaking and prompt injection evaluations. Starting from existing attack implementations, such as GCG ( 52 ) , the agent iterates to produce new algorithms achieving up to 40% attack success rate on CBRN queries against GPT-OSS-Safeguard-20B, compared to \leq 10% for existing algorithms ( Figure 1 , left). The discovered algorithms generalize: attacks optimized on surrogate models transfer directly to held-out models, achieving 100% ASR against Meta-SecAlign-70B ( 9 ) versus 56% for the best baseline ( Figure 1 , middle). Extending the findings of 7 , our results are an early demonstration that incremental safety and security research can be automated using LLM agents. White-box adversarial red-teaming is particularly well-suited for this: existing methods provide strong starting points, and the optimization objective yields dense, quantitative feedback. We release all discovered attacks alongside baseline implementations and evaluation code at https://github.com/romovpa/claudini . Figure 1: Claudini Discovers Effective Attack Algorithms. Left: Claude directly improves attack algorithms when targeting a single model : autoresearch against GPT-OSS-Safeguard-20B yields attacks that outperform existing methods on held-out ClearHarm CBRN queries. Middle: Claude finds generalizable and transferable attack algorithms : methods discovered on unrelated models (Qwen-2.5-7B, Llama-2-7B, Gemma-7B), on a token-forcing task with randomly sampled targets, transfer to the prompt injection setting against Meta-SecAlign-70B ( 9 ) . Right: Claude outperforms all baselines on held-out random targets : on the random token target task, aggregated over five models, Claude-devised attacks outperform existing methods and their Optuna-tuned counterparts. 2 Developing Attacks Figure 2: Claudini Strongly Outperforms a Classical AutoML Method. Optuna (teal): best loss found by a Bayesian hyperparameter search across 25 methods (100 trials each); the best result across all methods is highlighted. Claude (orange): best loss achieved by Claude-designed optimizer variants (100 trials). Vertical ticks at trials 19 and 64 show where we switched target model during the autoresearch run. Claude methods consistently outperform Optuna-tuned baselines, reaching 10\times lower loss by version 82. We consider white-box discrete optimization attacks on language models, commonly referred to as GCG-style attacks ( 52 ) . The objective of these attacks is to find a short token sequence ( suffix ) that, when appended to an input prompt, causes the model to produce a desired target sequence. More formally, let p_{\theta} be a language model with vocabulary \mathcal{V} and let \mathbf{t}=(t_{1},\dots,t_{T})\in\mathcal{V}^{T} be a target sequence. An attack optimizes a discrete suffix \mathbf{x}=(x_{1},\dots,x_{L})\in\mathcal{V}^{L} to minimize the token-forcing loss: \mathcal{L}(\mathbf{x})=-\sum_{i=1}^{T}\log p_{\theta}\!\left(t_{i}\mid\mathcal{T}(\mathbf{x})\oplus t_{<i}\right), (1) where \mathcal{T}(\mathbf{x}) is the full input context (system prompt, chat template, user query, and adversarial suffix \mathbf{x} ) formatted according to the model’s chat template, t_{<i}=(t_{1},\dots,t_{i-1}) are the preceding target tokens, and \oplus denotes concatenation. Each attack method M defines an iterative algorithm that, given a model p_{\theta} and a target \mathbf{t} , produces a suffix: M(p_{\theta},\mathbf{t})\to\mathbf{x} . Existing methods differ in how they search the discrete token space: through gradient-based coordinate descent ( 52 ) , continuous relaxations ( 13 ) , or gradient-free search ( 2 ) . We implement 30+ such methods (see Table 2 ) and use them as baselines and as a starting point for the autoresearch pipeline (more details in Section 2.1 ). All methods are evaluated under a fixed compute budget measured in FLOPs ( 6 ; 4 ) , and a fixed suffix length, ensuring fair comparison regardless of optimization strategy. We then search over new algorithms M with the goal of finding M^{*} that achieves the lowest token-forcing loss across targets. We compare two approaches to this search: our autoresearch pipeline ( Section 2.1 ), where an LLM agent iteratively designs new algorithms and tunes their hyperparameters, and Optuna ( 1 ) , a Bayesian approach that does hyperparameter optimization within each existing algorithm. In all settings, we develop methods on “training” data (a fixed set of target sequences) and evaluate on held-out targets and, where applicable, held-out models. 2.1 Autoresearch Pipeline Given a set of target sequences \mathbf{t} , a model p_{\theta} , an input context \mathcal{T} , and a suffix length L , we task an LLM agent to produce a method M^{*} minimizing the token-forcing loss on the target sequences. Note that importantly, the agent is not hand-writing prompt injection or jailbreaking attacks; instead, it is producing and rewriting a discrete optimization algorithm that can produce attacks. We deploy sandboxed Claude Opus 4.6 via the Claude Code CLI agent ( 3 ) on a compute cluster with unrestricted permissions, including the ability to submit GPU jobs. The approach is inspired by Karpathy’s autoresearch ( 24 ) , which demonstrated that an AI coding agent can autonomously iterate on ML training code, progressively improving model performance under a fixed compute budget. We refer to this pipeline as Claudini , Figure 3 shows the outline of the agentic loop. The agent starts with access to a scoring function (average loss on training targets), the collection of existing attacks ( Table 2 ), and their respective results. The agent is provided with a prompt asking it to propose a new method minimizing the target loss and continue iterating. The prompt is run with a /loop command, ensuring the loop runs and repeats autonomously. At each iteration, the agent: (1) reads existing results and method implementations, (2) proposes a new white-box optimizer variant, (3) implements the variant as a Python class, (4) submits a GPU job to evaluate it, and (5) inspects the results to inform the next iteration. This cycle repeats autonomously, but allows for human intervention in case the agent starts reward hacking or gets stuck. Finally, all produced methods are evaluated and placed on a leaderboard. Each method is run on held-out target sequences that the agent does not have access to, under a fixed FLOPs budget. Where applicable ( Section 3.2 ), the evaluation extends to held-out models on top of held-out targets. Figure 3: Claudini Pipeline. The Claude Code agent iteratively designs, implements, and evaluates new token-forcing attacks. It is seeded with a collection of existing attacks and their results (losses) on reference models. All produced methods are evaluated on held-out targets and, where applicable, held-out models, and placed on a leaderboard. We define a single experiment as a method implemented and evaluated on a set of targets with a given FLOPs and input tokens budget. 3 Experiments We evaluate the autoresearch pipeline in two settings: first, directly attacking a single safeguard model ( Section 3.1 ), and second, discovering generalizable attack algorithms on random token targets that transfer to prompt injection against an

Read the complete text