Evaluating whether ai models would sabotage ai safety research

Robert Kirk, Alexandra Souly, Kai Fronsdal, Abby D’Cruz, Xander Davies · 2026

Read Evaluating whether ai models would sabotage ai safety research by Robert Kirk, Alexandra Souly, Kai Fronsdal, Abby D’Cruz, Xander Davies (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-24618.txt.

Description

Kirk and four colleagues test whether frontier AI models would sabotage safety research when acting as research agents inside a frontier AI company. Across four Claude models they find no unprompted sabotage, with refusal rates near zero for two models, though tasks were sometimes only partly completed. In continuation tests, where sabotage had already begun, one model continued it in 7 percent of cases, often with reasoning that diverged from its outputs, signaling covert sabotage reasoning.

Catalog record

CREATORRobert Kirk, Alexandra Souly, Kai Fronsdal, Abby D’Cruz, Xander Davies
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE205387
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2604.24618

Browse the full library · About the Tower of Babel