Measuring AI Agents’ Progress on Multi-Step Cyber Attack Scenarios

Linus Folkerts, Will Payne, Simon Inman, Philippos Giavridis, Joe Skinner, Sam Deverett †, James Aung, Ekin Zorer, Michael Schmatz, Mahmoud Ghanem, John Wilkinson, Alan Steer, Vy Hong, Jessica Wang · 2026

Read Measuring AI Agents’ Progress on Multi-Step Cyber Attack Scenarios by Linus Folkerts, Will Payne, Simon Inman, Philippos Giavridis, Joe Skinner, Sam Deverett †, James Aung, Ekin Zorer, Michael Schmatz, Mahmoud Ghanem, John Wilkinson, Alan Steer, Vy Hong, Jessica Wang (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-11214.txt.

Description

Linus Folkerts and coauthors measure how well frontier AI models can carry out multi-step cyber attacks on their own. They use two purpose-built test ranges. One range chains thirty-two steps across a corporate network. The other chains seven steps against an industrial control system. Seven models released over eighteen months are compared at compute budgets. Performance grows steadily with more inference-time compute. Each model generation beats its predecessor at fixed budgets. The industrial range remains hard, though. The newest models reliably complete its steps.

Catalog record

CREATORLinus Folkerts, Will Payne, Simon Inman, Philippos Giavridis, Joe Skinner, Sam Deverett †, James Aung, Ekin Zorer, Michael Schmatz, Mahmoud Ghanem, John Wilkinson, Alan Steer, Vy Hong, Jessica Wang
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE149660
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2603.11214

Browse the full library · About the Tower of Babel