Optimizing AI Agent Attacks With Synthetic Data
Chloe Loughridge, Paul Colognese, Avery Griffin, Tyler Tracy, Jon Kutasov, Joe Benton · 2025
Read Optimizing AI Agent Attacks With Synthetic Data by Chloe Loughridge, Paul Colognese, Avery Griffin, Tyler Tracy, Jon Kutasov, Joe Benton (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2511-02823.txt.
Description
Chloe Loughridge and five colleagues work on AI control, a framework for estimating the risk of advanced AI systems. Good control tests need strong attack policies, but complex agent settings offer little data to tune them. Their 2025 paper improves attacks inside SHADE-Arena, a set of realistic control test environments, despite that data shortage.
They split attack skill into five parts: modeling suspicion, choosing attacks, planning, execution, and subtlety. Each part is tuned on its own. To beat the data limit, they built a probabilistic model of attack dynamics, tuned settings inside that simulation, and showed the gains transfer to the real arena. Attack strength rose sharply: the safety score fell from 0.87 to 0.41 with their scaffold in place.
Catalog record
| CREATOR | Chloe Loughridge, Paul Colognese, Avery Griffin, Tyler Tracy, Jon Kutasov, Joe Benton |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 56 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2511-02823