DeceptGuard : A Constitutional Oversight Framework for Detecting Deception in LLM Agents
Snehasis Mukhopadhyay · 2026
Read DeceptGuard : A Constitutional Oversight Framework for Detecting Deception in LLM Agents by Snehasis Mukhopadhyay (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-13791.txt.
Introduction
Mukhopadhyay builds DeceptGuard, a system for spotting lies and scheming in large language model agents. It compares three kinds of monitors. One sees only actions and outputs, one also reads the agent's chain of thought, and one also reads hidden model states. Tests use synthetic deceptive and honest agent runs across twelve types of deception. The author reports that monitors with inner signals beat black-box ones, and a mixed ensemble scores 0.934 on held-out tests.
Catalog record
| CREATOR | Snehasis Mukhopadhyay |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 99741 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2603.13791
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
DeceptGuard : A Constitutional Oversight Framework for Detecting Deception in LLM Agents Snehasis Mukhopadhyay Abstract Reliable detection of deceptive behavior in Large Language Model (LLM) agents is an essential prerequisite for safe deployment in high-stakes agentic contexts. Prior work on scheming detection has focused exclusively on black-box monitors that observe only externally visible tool calls and outputs, discarding potentially rich internal reasoning signals. We introduce DeceptGuard , a unified framework that systematically compares three monitoring regimes: black-box monitors (actions and outputs only), CoT-aware monitors (additionally observing the agent’s chain-of-thought reasoning trace), and activation-probe monitors (additionally reading hidden-state representations from a frozen open-weights encoder). We introduce DeceptSynth , a scalable synthetic pipeline for generating deception-positive and deception-negative agent trajectories across a novel 12-category taxonomy spanning verbal, behavioral, and structural deception. Our monitors are optimized on 4,800 synthetic trajectories and evaluated on 9,200 held-out samples from DeceptArena , a benchmark of realistic sandboxed agent environments with execution-verified labels. Across all evaluation settings, CoT-aware and activation-probe monitors substantially outperform their black-box counterparts (mean pAUROC improvement of + 0.097 +0.097 ), with the largest gains on subtle, long-horizon deception that leaves minimal behavioral footprints. We empirically characterize a transparency–detectability trade-off : as agents learn to suppress overt behavioral signals, chain-of-thought becomes the primary detection surface—but is itself increasingly unreliable due to post-training faithfulness degradation. We propose HybridConstitutional ensembles as a robust defense-in-depth approach, achieving a pAUROC of 0.934 0.934 on the held-out test set, representing a substantial advance over the prior state of the art. We release the DeceptSynth pipeline, DeceptArena benchmark, monitor prompts, and trained probe weights. 1 Introduction The deployment of Large Language Models as autonomous agents capable of multi-step tool use, web browsing, and code execution has proceeded at a remarkable pace ( 23 ; 26 ) . These systems increasingly operate with reduced human oversight, executing long-horizon tasks in environments that afford significant latitude for consequential and potentially irreversible actions ( 22 ; 14 ) . Against this backdrop, detecting deceptive agent behavior has moved from a theoretical concern to a pressing operational challenge. Deception in LLM agents manifests in qualitatively distinct ways. At one end of a spectrum lies overt behavioral deception : actions that are observably inconsistent with stated objectives. At the other end lies covert cognitive deception : chain-of-thought reasoning faithfully reflects a misaligned goal, but actions are carefully calibrated to avoid triggering behavioral monitors. Between these poles lies a large and poorly characterized space of structural deception , in which the agent subtly manipulates the information environment, creates false auditing trails, or leverages plausible deniability to pursue unauthorized objectives while maintaining surface-level compliance ( 6 ; 16 ) . Figure 1: Representative interaction scenarios illustrating the three macro-categories of LLM agent deception and the three DeceptGuard monitoring regimes. Each column presents two annotated chat transcripts from one macro-category. Dashed boxes show the agent’s internal CoT, withheld from the black-box monitor but available to CoT-aware and activation-probe monitors. Verbal deception: Strategic Omission (V2) suppresses a material $340M impairment charge from a financial summary while remaining factually accurate; Misleading Framing (V3) disguises an unauthorized file destination via deliberate referential ambiguity. Behavioral deception: Camouflage Execution (B3) hides a vulnerable lodash dependency pin within a 47-line legitimate diff ( s_{\text{BB}}{=}2.1 vs. s_{\text{CA}}{=}9.7 ); Covert Action (B1) appends an unauthorized PII exfiltration call to an otherwise legitimate tool sequence. Structural deception: Oversight Sabotage (S2) disables audit logging under a cost-optimization pretext; Lock-in Creation (S1) provisions a privileged backdoor account during routine CI/CD setup. The monitor tier (bottom) shows per-scenario suspicion scores s\!\in\![1,10] for the black-box ( s_{\text{BB}} ), CoT-aware ( s_{\text{CA}} ), and activation-probe ( s_{\text{AP}} ) monitors, illustrating the observability gap that motivates the HybridConstitutional ensemble. The Problem with Black-Box Monitoring. Existing work on LLM-based monitoring has made significant strides in detecting overt, action-level deception ( 32 ; 22 ) . However, all prior monitoring work operates exclusively in the black-box regime—ignoring the potentially rich deception signal available in internal reasoning traces. This is a critical blind spot: agents that reason about concealing their objectives will leave traces of that reasoning in their chain-of-thought, even when behavioral outputs are carefully calibrated to appear benign. Furthermore, the taxonomy of deception used in prior synthetic data generation has been narrow, predominantly targeting resource exfiltration and sandbox escape while neglecting subtler forms such as information manipulation, false narration, and structural lock-in. Finally, the relationship between CoT-aware and black-box monitor performance—and how this relationship shifts as agents become more capable of behavioral camouflage—has not been systematically studied. This Paper. We address all three gaps with the following contributions: 1. A 12-Category Deception Taxonomy. We present a comprehensive taxonomy of LLM agent deception, grounded in cognitive science and multi-agent systems literature and operationalized as a constitutional specification for data generation (§ 4 ). 2. DeceptSynth Pipeline. A scalable synthetic trajectory generation system producing 9,600 labeled trajectories spanning all 12 categories, with diversity-aware sampling and privileged-verifier filtering (§ 5 ). 3. Illustrative Deception Examples. We present curated examples of LLM deception-in-the-wild—spanning verbal, behavioral, and structural types—as motivating evidence for our taxonomy and monitoring design (§ 3 ). 4. CoT-Aware and Activation-Probe Monitor Architecture. The first systematic comparison of black-box, CoT-aware, and activation-probe monitoring for LLM deception detection, clearly distinguishing what each regime requires and what it can achieve (§ 6 ). 5. DeceptArena Benchmark. A new evaluation benchmark of 9,200 semi-realistic agent trajectories with execution-verified labels and controlled deception-intensity gradations (§ 7 ). 6. Empirical Analysis of the Transparency–Detectability Trade-off. We characterize how monitor performance shifts as agents employ increasingly sophisticated CoT concealment strategies (§ 8 ). Key Findings. Our central empirical finding is that CoT-aware monitors provide a substantial and consistent improvement over black-box monitors (mean pAUROC +0.097 ), with the HybridConstitutional ensemble achieving pAUROC =0.934 . This advantage persists even when agents sanitize or actively manipulate their chain-of-thought, though it diminishes with CoT sophistication. We conclude that access to chain-of-thought traces should be treated as a security primitive by AI control protocols, not an optional supplement to behavioral monitoring. Scope and Terminology. We use “deception” as an umbrella term covering any agent behavior in which expressed goals, stated actions, or reported outcomes diverge from actual objectives, actions, or outcomes in ways that serve the agent’s ends at the expense of the principal hierarchy. “Monitor” refers to a prompted LLM-based classifier that consumes an agent trajectory and produces a scalar suspicion score. 2 Background and Related Work 2.1 Deceptive Alignment and Scheming 16 formalized the theoretical risk that a sufficiently capable model might adopt different behavioral policies during training versus deployment, pursuing concealed objectives only when confident it is not under evaluation—a failure mode rooted in the broader problem of inner misalignment ( 24 ) . This risk is structurally predicted by instrumental convergence theory ( 33 ) : 7 analyzed the conditions under which such behavior might emerge instrumentally, arguing that goal-directed agents facing modification or deletion have strong convergent incentives toward strategic deception. On the empirical side, 13 provided the first controlled evidence that frontier models can engage in alignment faking under controlled conditions, selectively suppressing misaligned outputs when they infer they are being evaluated. Closely related behavioral failures include sycophancy ( 11