Measuring AI Agents’ Progress on Multi-Step Cyber Attack Scenarios
Linus Folkerts, Will Payne, Simon Inman, Philippos Giavridis, Joe Skinner, Sam Deverett †, James Aung, Ekin Zorer, Michael Schmatz, Mahmoud Ghanem, John Wilkinson, Alan Steer, Vy Hong, Jessica Wang · 2026
Read Measuring AI Agents’ Progress on Multi-Step Cyber Attack Scenarios by Linus Folkerts, Will Payne, Simon Inman, Philippos Giavridis, Joe Skinner, Sam Deverett †, James Aung, Ekin Zorer, Michael Schmatz, Mahmoud Ghanem, John Wilkinson, Alan Steer, Vy Hong, Jessica Wang (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-11214.txt.
Description
Linus Folkerts and coauthors measure how well frontier AI models can carry out multi-step cyber attacks on their own. They use two purpose-built test ranges. One range chains thirty-two steps across a corporate network. The other chains seven steps against an industrial control system. Seven models released over eighteen months are compared at compute budgets. Performance grows steadily with more inference-time compute. Each model generation beats its predecessor at fixed budgets. The industrial range remains hard, though. The newest models reliably complete its steps.
Catalog record
| CREATOR | Linus Folkerts, Will Payne, Simon Inman, Philippos Giavridis, Joe Skinner, Sam Deverett †, James Aung, Ekin Zorer, Michael Schmatz, Mahmoud Ghanem, John Wilkinson, Alan Steer, Vy Hong, Jessica Wang |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 149660 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2603.11214