Analyzing and Improving Chain-of-Thought Monitorability Through Information Theory

Usman Anwar, Tim Bakker, Dana Kianfar, Cristina Pinneri, Christos Louizos · 2026

Read Analyzing and Improving Chain-of-Thought Monitorability Through Information Theory by Usman Anwar, Tim Bakker, Dana Kianfar, Cristina Pinneri, Christos Louizos (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2602-18297.txt.

Description

Usman Anwar and four co-authors study when chain-of-thought monitors can be trusted. Their 2026 paper treats monitors as language-model systems that read reasoning traces to flag traits like test-hacking in code generation. Using information theory, the team shows shared information between reasoning trace and output is necessary but not sufficient for monitorability.

Two error sources can sink monitors: the information gap, how much of the trace's information the monitor actually extracts, and elicitation error, how closely the monitor nears the ideal monitoring function. Worryingly, trace obfuscation can appear even without pressure against monitoring. A practical label-free training objective based on trace-output mutual information keeps traces readable even under training against a monitor, and eases reward hacking when task rewards are imperfect. The work gives monitor builders both a diagnosis and a fix.

Catalog record

CREATORUsman Anwar, Tim Bakker, Dana Kianfar, Cristina Pinneri, Christos Louizos
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE163 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2602-18297

Browse the full library · About the Tower of Babel