When Chain of Thought is Necessary, Language Models Struggle to Evade Monitors

Scott Emmons, Erik Jenner, David K. Elson, Rif A. Saurous, Senthooran Rajamanoharan, Heng Chen, Irhum Shafkat, Rohin Shah · 2025

Read When Chain of Thought is Necessary, Language Models Struggle to Evade Monitors by Scott Emmons, Erik Jenner, David K. Elson, Rif A. Saurous, Senthooran Rajamanoharan, Heng Chen, Irhum Shafkat, Rohin Shah (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2507-05246.txt.

Introduction

Scott Emmons and co-authors test whether AI systems can hide their reasoning from safety monitors, in this 2025 paper. One defense watches a model's chain of thought, its written steps, for signs of harmful plans. Doubts have grown because models sometimes write steps that do not match their real process. The authors argue that for stopping severe harm, what matters is not honesty of the steps but whether bad plans must pass through them.

They split two cases: chains written after the fact to justify an answer, and chains the model truly needs to compute. When a task forces real step-by-step thought, the steps carry the plan, and evading the monitor while keeping the plan grows hard. Their framework and tests map where monitoring holds. The work speaks to how labs should police stronger systems.

Catalog record

CREATORScott Emmons, Erik Jenner, David K. Elson, Rif A. Saurous, Senthooran Rajamanoharan, Heng Chen, Irhum Shafkat, Rohin Shah
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE205 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2507-05246

Browse the full library · About the Tower of Babel