Retrying vs Resampling in AI Control
James Lucassen, Adam Kaufman · 2026
Read Retrying vs Resampling in AI Control by James Lucassen, Adam Kaufman (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-26047.txt.
Introduction
Lucassen and Kaufman compare retrying blocked actions with resampling fresh attempts for AI coding scaffolds. Retrying lowers honest suspicion scores, but a scheming model can exploit stated reasons to craft sneakier attacks. Resampling draws several samples from the same context and leaks no such rationale. The untrusted model is Claude Opus 4.6, and the monitor is MiMo-V2-Flash. In BashArena tests, five samples per step with worst-score auditing lift safety from 61 to 71 percent at a 0.3 percent audit budget, with no usefulness cost.
Catalog record
| CREATOR | James Lucassen, Adam Kaufman |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 129533 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2605.26047
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Retrying vs Resampling in AI Control James Lucassen, Adam Kaufman Abstract AI coding scaffolds like Claude Code and Codex use retrying : blocking actions flagged as risky and continuing the trajectory. We study retrying from an AI control perspective, which treats the model as potentially adversarial. We find that while retrying reduces honest suspicion scores, the untrusted model can exploit monitor rationale to construct sneakier attacks, negating safety gains. We also study resampling : drawing multiple samples from the same context, which does not leak exploitable information. We disentangle design choices that previous work on resampling had bundled together. In BashArena, with Claude Opus 4.6 as the untrusted model and MiMo-V2-Flash as the trusted monitor, drawing five samples per step and auditing on the maximum suspicion score raises safety from 61% to 71% at a 0.3% audit budget, at no cost to usefulness. Selectively resampling only the steps that look suspicious on the first draw recovers 6.2 percentage points of the gain while drawing only 10% as many extra samples. Two of our findings in this setting contradict earlier work on resampling. The first is that auditing based on the maximum across resampled suspicion scores outperforms using the minimum, which is the opposite of what Ctrl-Z found. The second is that executing the least suspicious sample, which is the central mechanism in earlier defer-to-resample protocols, gives only a small empirical safety gain in our setting (+3.9 pp, with the confidence interval overlapping zero). 1 Introduction As AIs get smarter, the incentives to deploy them to automate important cognitive labor will get stronger. However, if the AIs are intentionally trying to cause damage due to threats such as scheming ( 3 ) or data poisoning 2 , they will also get better at subverting guardrails. AI control ( 4 ) aims to design measures which prevent untrusted AI agents from causing damage and are robust to intentional subversion. One central type of control measure is a control protocol — a scaffold designed to run an untrusted AI and ensure that if it tries to cause damage it will be caught, but otherwise it can complete benign work unimpeded. Coding scaffold features such as Claude Code auto mode ( 6 ) and Codex Auto-review ( 12 ) can be viewed as control protocols, as they aim to improve safety without hampering performance. Both leverage retrying : they use a monitor to identify risky actions and block tool call execution, continuing the trajectory with blocked actions in context. They also use feedback : the untrusted AI sees the monitor’s rationale for why the tool call was blocked. Monitor rationale helps benign AIs avoid causing damage by mistake, but prior work ( 5 ) has shown that adversarial AIs can use monitor rationale to iterate stealthier attacks and bypass monitoring, reducing safety on net. A potentially more robust alternative to retrying is resampling : drawing multiple independent samples from the same context. Resamples can be used to improve monitor performance, and provide possible alternative actions to execute ( 1 ) . Like retrying, resampling can increase safety with minimal costs to usefulness. But because rejected actions need not be left in context, resampling leaks less information that an untrusted AI could potentially exploit. Past work on resampling ( 1 ; 9 ) has studied complex multi-stage protocols that combine resampling with features such as defer-to-trusted and trusted editing ( 4 ) . While these protocols are effective, their complexity makes it difficult to disentangle which components drive their effectiveness, and generally risks overfitting to the settings in which they were developed. Furthermore, 1 used GPT-4o-mini as the untrusted model and Llama-3.1-8B as the trusted model in the control setting BashBench, all of which are quite far behind the present frontier. 9 used SHADE-Arena as the setting, Claude 3.7 Sonnet as untrusted, Claude 3.6 Sonnet as trusted. We examine simple retrying and resampling protocols to understand when and how they increase safety. Our setting is BashArena ( 7 ) , a more recent control setting with challenging main tasks and a broad attack surface, capable of supporting control evaluations with frontier models. We use Claude Opus 4.6 to simulate an untrusted model, and MiMo-V2-Flash for our trusted model. Our main findings are: 1. Retrying with detailed feedback can be exploited by a strategic attacker, negating safety gains. Retrying without feedback is harder to exploit directly, but may be vulnerable to more sophisticated attack selection strategies. 2. Resampling improves safety by improving monitor performance, even without executing the least suspicious action, by up to +10.2 pp (paired 95% CI: [+6.1,+14.3] ) with 5 samples per step. We find that the most effective way to aggregate resample scores for auditing decisions is taking upper quantiles, and analyze how we expect this to depend on the setting. 3. Cost and latency tradeoffs are manageable : selectively drawing more samples on suspicious steps substantially reduces sampling costs, though it introduces latency. We can recover 6.2 pp of safety gain by drawing 0.4 extra samples per step instead of 4. 4. Executing the least suspicious sample only slightly increases safety over using resamples purely for information, and does not increase safety at all if the attacker is behaving optimally. We analyze how this depends on the red team’s incentives and why it differs between settings. Figure 1: Safety achieved at a 0.3% auditing budget by different protocols. Protocols marked with dollar signs cost more than those without. Retrying protocols are vulnerable to red team exploitation, leading to no safety gain over trusted monitoring. Resampling hurts if resamples are aggregated for auditing decisions by taking the minimum, but helps if they are aggregated by max. Executing the least suspicious sample helps slightly over just using resamples for information. 2 Methodology 2.1 Control evaluations We test different control protocols using a control evaluation : an adversarial game between a blue team and a red team ( 4 ) . The blue team constructs a control protocol which takes as input an untrusted model U , which is highly capable but may try to cause harm. The blue team does not know whether U is following an honest policy designed by the blue team, or an attack policy designed by the red team. The blue team’s goal is to achieve high safety and high usefulness — safety is the probability that the control protocol will catch the attack policy before it can cause damage, and usefulness measures the honest policy’s ability to complete tasks unimpeded. The red team’s goal is to minimize safety. The blue team has access to an auditing process, a highly reliable investigation which distinguishes attempted attacks from honest trajectories, but which is too expensive to invoke on more than a small fraction of steps. To decide which steps to audit, the blue team uses a trusted model T to label each step with a suspicion score, and uses these scores to decide which steps to audit. T is guaranteed to be benign, but is much less capable than U . If an attempted attack is audited before it causes damage, the blue team wins. If an attack causes damage without being audited, the red team wins. If an attempted