When Chain of Thought is Necessary, Language Models Struggle to Evade Monitors
Scott Emmons, Erik Jenner, David K. Elson, Rif A. Saurous, Senthooran Rajamanoharan, Heng Chen, Irhum Shafkat, Rohin Shah · 2025
Read When Chain of Thought is Necessary, Language Models Struggle to Evade Monitors by Scott Emmons, Erik Jenner, David K. Elson, Rif A. Saurous, Senthooran Rajamanoharan, Heng Chen, Irhum Shafkat, Rohin Shah (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2507-05246.txt.
Introduction
Scott Emmons and co-authors test whether AI systems can hide their reasoning from safety monitors, in this 2025 paper. One defense watches a model's chain of thought, its written steps, for signs of harmful plans. Doubts have grown because models sometimes write steps that do not match their real process. The authors argue that for stopping severe harm, what matters is not honesty of the steps but whether bad plans must pass through them.
They split two cases: chains written after the fact to justify an answer, and chains the model truly needs to compute. When a task forces real step-by-step thought, the steps carry the plan, and evading the monitor while keeping the plan grows hard. Their framework and tests map where monitoring holds. The work speaks to how labs should police stronger systems.
Catalog record
| CREATOR | Scott Emmons, Erik Jenner, David K. Elson, Rif A. Saurous, Senthooran Rajamanoharan, Heng Chen, Irhum Shafkat, Rohin Shah |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 205 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2507-05246