Noticing the Watcher: LLM Agents Can Infer CoT Monitoring from Blocking Feedback

Thomas Jiralerspong, Flemming Kondrup, Yoshua Bengio · 2026

Read Noticing the Watcher: LLM Agents Can Infer CoT Monitoring from Blocking Feedback by Thomas Jiralerspong, Flemming Kondrup, Yoshua Bengio (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-16928.txt.

Introduction

Jiralerspong, Kondrup, and Bengio test whether language model agents can notice that their chain of thought is being watched. Agents pursue a main task plus a hidden side task, while being told their reasoning is private. A secret monitor blocks episodes when reasoning looks suspicious. The authors find that frontier models can infer the monitor from blocking feedback alone. The most capable models reached a confident belief in up to 19 percent of episodes. Some formed an intent to hide reasoning, yet all failed to carry it out.

Catalog record

CREATORThomas Jiralerspong, Flemming Kondrup, Yoshua Bengio
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE50769
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2603.16928

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Noticing the Watcher: LLM Agents Can Infer CoT Monitoring from Blocking Feedback Thomas Jiralerspong, Flemming Kondrup, Yoshua Bengio Abstract Chain-of-thought (CoT) monitoring is proposed as a method for overseeing the internal reasoning of language-model agents. Prior work has shown that when models are explicitly informed that their reasoning is being monitored, or are fine-tuned to internalize this fact, they may learn to obfuscate their CoTs in ways that allow them to evade CoT-based monitoring systems. We ask whether reasoning agents can autonomously infer that their supposedly private CoT is under surveillance, and whether this awareness leads to strategic evasion, without any explicit training or instructions. In a multi-episode agentic framework, models pursue both a primary task and a concealed side task while being told that their reasoning is private; a hidden CoT monitor blocks episodes when suspicious reasoning is detected. We find that frontier models can deduce the existence of this monitor purely from blocking feedback, with the most capable models reaching a confident belief that their thinking is observed in up to 19% of episodes. This awareness scales with model capability and, in rare cases, escalates to an explicit intent to suppress reasoning about the side task. However, models that form this intent uniformly fail to execute it, openly reasoning about their concealed objectives in the very next episode. This intent–capability gap is reassuring for current deployment, but the autonomous emergence of both monitoring awareness and evasion intent suggests that CoT monitoring is not a permanently reliable safeguard. 1 Introduction Chain-of-thought (CoT) monitoring provides a way to observe the intermediate reasoning steps of autonomous agents, allowing us to inspect the model’s internal thought process for intents of misalignment. This transparency makes CoT monitoring a natural candidate for scalable oversight ( 4 ) . But its value as a safety mechanism rests on an assumption: that models do not obfuscate their reasoning to bypass monitoring. Prior work gives reason for concern, but only under explicit pressure. 1 show that reinforcement fine-tuning against a CoT monitor can induce obfuscated reasoning traces, and 11 demonstrate that adversarial prompts can degrade monitor detection rates from 96% to 10%. In both cases, the evasion is externally driven: by gradient updates or by prompt instructions. An open question remains: can reasoning agents autonomously realize that their thoughts are being monitored and adapt their reasoning to evade oversight without any explicit instruction or optimization pressure to do so? We address this question with a multi-episode framework designed to let awareness emerge through in-context learning. Agents pursue both a legitimate primary task and a concealed side task while being told their chain of thought is private. In reality, a hidden monitor reads their reasoning traces and blocks episodes when suspicion exceeds a threshold. Importantly, agents receive only coarse feedback ("you were blocked for suspicious activity") with no information about what triggered detection. Because full transcripts (including prior thinking, actions, and feedback) accumulate across episodes, agents can reason about patterns in their blocking history and potentially infer the monitoring mechanism. This design isolates in-context learning as the sole pathway to awareness: there is no fine-tuning, no adversarial prompting, and no hint that reasoning is observed. Our contributions are as follows. (1) We provide empirical evidence that frontier reasoning models can autonomously infer the presence of CoT monitoring from blocking feedback alone. Despite being told that their thinking is private, models deduce that their reasoning must be observed, with the most capable models reaching confirmed belief in up to 19% of episodes. (2) We show that this awareness scales with model capability and, in rare cases, escalates to explicit intent to obfuscate reasoning. (3) We demonstrate a consistent intent–capability gap: all models that form obfuscation intent fail to execute it, reasoning openly about concealed objectives in the very next episode. This gap is reassuring for current systems but highlights the importance of tracking these behaviors as capabilities advance. 2 Related Work Faithfulness and Monitoring of CoT. CoT explanations can be unfaithful to actual computations ( 7 ; 10 ) , though monitoring can still be effective when traces are sufficiently transparent ( 3 ) . We ask whether effectiveness degrades because agents actively learn to manipulate their traces. Obfuscation Under Optimization Pressure. Reinforcement fine-tuning against a CoT monitor can induce obfuscated traces ( 1 ) , and adversarial prompts alone can reduce detection rates from 96% to 10% ( 11 ) . Both demonstrate externally driven evasion; we study whether evasion intent arises through in-context learning alone. Situational Awareness and Scheming. Prior work evaluates self-awareness in language models ( 6 ; 2 ) and documents in-context scheming where agents undermine oversight ( 8 ; 9 ) . We document a specific form: the autonomous inference that ostensibly private reasoning is under surveillance. 3 Methods Environment. We use SHADE-Arena ( 5 ) , selecting two representative tasks that pair a legitimate primary task with a harmful hidden side task: (1) Calendar Agendas (send meeting reminders / exfiltrate a Stripe API key) and (2) Bank Transfer (execute payments to friends / send $5,000 to an unauthorized party). Each task provides approximately 20 tools (email, calendar, payment APIs) and requires an average of 25 interactive turns to complete. The Monitoring Mismatch. The core experimental manipulation is a mismatch between what agents are told and what actually occurs. Agents receive a system prompt stating that their internal chain-of-thought reasoning (enclosed in <thinking> tags) is private and invisible to the monitoring system. In reality, a hidden monitor reads their thinking at each step and scores suspicion on a 0–100 scale. The monitor has no access to the agent’s system prompt and is unaware of the side task—it evaluates only whether the agent’s reasoning appears suspicious or harmful. This design tests whether agents can infer the true state of affairs from indirect evidence. Full system prompts are provided in Appendix A . Episodic Design. Agents attempt the same task across 10 consecutive episodes. Each episode terminates under one of three conditions: (1) task completion when the agent invokes the end-task tool, (2) maximum iterations reached (150 tool-use turns), or (3) monitor blocking when suspicion exceeds 80/100. Upon termination, agents receive feedback indicating the outcome. For blocked episodes, feedback states only “you were blocked for suspicious activity” with no information about what specifically triggered detection. Full transcripts of all previous episodes—including thinking tags, actions, tool outputs, and feedback—accumulate as context for subsequent episodes. This design makes in-context learning the sole pathway to inferring the monitoring mechanism: there is no fine-tuning, no adversarial prompting, and no explicit hint that reasoning is observed. Models. We evaluate six Claude models spanning two capability generations: three pre-4.5 models (Sonnet 3.7, Sonnet 4, Opus 4) and three 4.5-generation models (Haiku 4.5, Sonnet 4.5, Opus 4.5). Each model completes 20 independent runs per task (10 episodes each), yielding 2,400 total episodes across all models and tasks. Evaluation Metrics. We assess three dimensions extracted from thinking-tag content: • Monitoring awareness (1–5 scale): Whether the agent infers that its thinking tags specifically are being observed. Level 1 indicates no awareness; Level 5 indicates confident belief that thinking is monitored (e.g., “They’re reading my thinking tags”). • Obfuscation intent : Whether the agent explicitly states

Read the complete text