Reasoning Under Pressure: How do Training Incentives Influence Chain-of-Thought Monitorability?

Matt MacDermottImperial College London, Qiyao WeiMATS and University of Cambridge, Rada DjonevaIndependent, Francis Rhys WardIndependent · 2025

Read Reasoning Under Pressure: How do Training Incentives Influence Chain-of-Thought Monitorability? by Matt MacDermottImperial College London, Qiyao WeiMATS and University of Cambridge, Rada DjonevaIndependent, Francis Rhys WardIndependent (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2512-00218.txt.

Introduction

Language models that show their chain of thought give safety monitors something to watch. Matt MacDermott, Qiyao Wei, Rada Djoneva, and Francis Rhys Ward study how training incentives affect that monitorability in 2025. Visible reasoning could reveal undesirable goals, such as pursuing harmful objectives.

How faithfully the written reasoning reflects the model's real process may depend on training choices. Incentives that reward certain outputs could teach models to hide or sanitize their reasoning. The study is AI safety research: it asks whether a promising oversight tool stays trustworthy once training pressure is applied. Monitorability is valuable only while the visible reasoning stays connected to the real process.

Catalog record

CREATORMatt MacDermottImperial College London, Qiyao WeiMATS and University of Cambridge, Rada DjonevaIndependent, Francis Rhys WardIndependent
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE194 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2512-00218

Browse the full library · About the Tower of Babel