Analyzing and Improving Chain-of-Thought Monitorability Through Information Theory
Usman Anwar, Tim Bakker, Dana Kianfar, Cristina Pinneri, Christos Louizos · 2026
Read Analyzing and Improving Chain-of-Thought Monitorability Through Information Theory by Usman Anwar, Tim Bakker, Dana Kianfar, Cristina Pinneri, Christos Louizos (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2602-18297.txt.
Description
Usman Anwar and four co-authors study when chain-of-thought monitors can be trusted. Their 2026 paper treats monitors as language-model systems that read reasoning traces to flag traits like test-hacking in code generation. Using information theory, the team shows shared information between reasoning trace and output is necessary but not sufficient for monitorability.
Two error sources can sink monitors: the information gap, how much of the trace's information the monitor actually extracts, and elicitation error, how closely the monitor nears the ideal monitoring function. Worryingly, trace obfuscation can appear even without pressure against monitoring. A practical label-free training objective based on trace-output mutual information keeps traces readable even under training against a monitor, and eases reward hacking when task rewards are imperfect. The work gives monitor builders both a diagnosis and a fix.
Catalog record
| CREATOR | Usman Anwar, Tim Bakker, Dana Kianfar, Cristina Pinneri, Christos Louizos |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 163 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2602-18297