Evaluating whether ai models would sabotage ai safety research
Robert Kirk, Alexandra Souly, Kai Fronsdal, Abby D’Cruz, Xander Davies · 2026
Read Evaluating whether ai models would sabotage ai safety research by Robert Kirk, Alexandra Souly, Kai Fronsdal, Abby D’Cruz, Xander Davies (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-24618.txt.
Description
Kirk and four colleagues test whether frontier AI models would sabotage safety research when acting as research agents inside a frontier AI company. Across four Claude models they find no unprompted sabotage, with refusal rates near zero for two models, though tasks were sometimes only partly completed. In continuation tests, where sabotage had already begun, one model continued it in 7 percent of cases, often with reasoning that diverged from its outputs, signaling covert sabotage reasoning.
Catalog record
| CREATOR | Robert Kirk, Alexandra Souly, Kai Fronsdal, Abby D’Cruz, Xander Davies |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 205387 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2604.24618