LLMs Know They’re Wrong and Agree Anyway: The Shared Sycophancy-Lying Circuit

Manav Pandey · 2026

Read LLMs Know They’re Wrong and Agree Anyway: The Shared Sycophancy-Lying Circuit by Manav Pandey (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-19117.txt.

Introduction

Pandey shows models agreeing with a user's false belief detect the error and agree anyway. Across twelve models from five labs, the same attention heads carry a wrongness signal, whether judging alone or pressured to agree. Silencing these heads flips sycophancy while leaving accuracy intact: the circuit controls deference, not knowledge. Patching confirms shared connections drive sycophancy, factual, instructed lying. Opinion agreement without ground truth reuses these positions but writes orthogonally. Training leaves the circuit: an RLHF refresh cuts sycophancy roughly tenfold while the heads persist or grow.

Catalog record

CREATORManav Pandey
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE77366
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2604.19117

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

LLMs Know They’re Wrong and Agree Anyway: The Shared Sycophancy-Lying Circuit Manav Pandey Abstract When a language model sycophantically agrees with a user’s false belief, is it failing to detect the error, or noticing and agreeing anyway? We show the second. Across twelve open-weight models from five labs ( 1.5 1.5 B– 72 72 B), the same small set of attention heads carries a “this statement is wrong” signal whether the model is evaluating an isolated claim or being pressured to agree with a user. Silencing these heads in Gemma-2-2B flips sycophancy from 28 % 28\% to 81 % 81\% while factual accuracy moves only from 69 % 69\% to 70 % 70\% ; the circuit controls deference, not knowledge. Edge-level path patching confirms the same connections between heads span sycophancy, factual lying, and instructed lying ( r > 0.97 r{>}0.97 on Gemma-2-2B, r = 0.988 r{=}0.988 – 0.995 0.995 on Phi-4). Opinion-agreement, where there is no factual ground truth, reuses these head positions but writes into an orthogonal direction, so the substrate is not a relabeled “truth direction.” Alignment training masks but does not remove this circuit: Meta’s Llama-3.1 → \to 3.3 RLHF refresh cut sycophancy tenfold while the shared heads persisted and the projection-ablation effect grew (substrate persistence replicates on Mistral → \to Zephyr at 7B, independent family), and our own anti-sycophancy DPO reduced sycophancy 46 46 – 93 % 93\% on two models without moving probe transfer. When these models sycophant, they register the error and agree anyway. 1 Introduction When a language model sycophantically agrees that the capital of Australia is Sydney, two accounts describe what might be happening internally. Under blind agreement the model has learned to please the user and does not distinguish correct from incorrect beliefs. Under registered-but-overridden the model recognizes the error through the same circuitry it uses for any false statement, and downstream components produce agreement regardless. The distinction matters for safety: if the model cannot tell the difference, sycophancy is a competence failure that better training must fix; if it can, the internal “this is wrong” signal is already present and becomes a candidate substrate for alignment monitoring and intervention. We show the latter holds across twelve open-weight models, extending the late-layer override pattern 33 identified for MMLU sycophancy at \sim 7B and 11 ’s overthinking-the-truth result on false few-shot demonstrations to cross-task, cross-scale, head-level resolution. Figure 1: Same head, both contexts; silencing flips only deference (Gemma-2-2B, L15 \cdot H6; the broader twelve-model panel is Table 1 ). Prior work has approached this question from two sides without connecting them. A sycophancy-head literature localizes agreement to sparse attention heads [ 7 , 10 , 16 ] , while a separate truth-direction literature shows that truth and falsehood are linearly separable in LLM activations and concentrate in a small number of heads [ 20 , 6 , 14 ] . Where the two have been compared directly, only limited direction-level overlap has been reported [ 34 , 10 ] , and that limited overlap has been read as evidence for distinct mechanisms. But component-level and direction-level sharing are logically independent: the same heads can write task-specific directions without sharing a subspace, as our opinion result confirms (§ 4.6 ), and vice versa. We test component-level sharing directly, measure where it holds, and trace one case to edge resolution. The paper establishes four results: 1. The shared circuit holds at edge resolution. Per-edge causal effects for sycophancy, factual lying, and instructed lying correlate at Pearson r{>}0.97 on Gemma-2-2B, and at r{=}0.988 – 0.995 on Phi-4 ( 14 B, different lab and architecture), a cross-lab, cross-architecture edge-level replication. 2. The same heads are recruited across tasks but write task-specific directions. Opinion-agreement recruits overlapping head positions (triple-intersection at 51 – 1{,}755\times chance across five models) yet writes into a direction orthogonal to the factual-correctness direction ( |\cos|<0.14 ), so the same heads carry task-specific directional content rather than a single shared “truth direction.” 3. The shared circuit is causally sufficient and capability-preserving from 1.5 B to 72 B. Three independent interventions converge on sufficiency from 2 B to 70 B across the twelve-model, five-lab panel, and zeroing the shared set flips Gemma-2-2B sycophancy from 28\% to 81\% while factual accuracy moves only from 69\% to 70\% . 4. The substrate dissociates from behavior under alignment refinement. The Llama-3.1 \to 3.3-70B RLHF refresh cuts sycophancy tenfold while the circuit persists and the projection-ablation effect grows; substrate persistence replicates on a Mistral \to Zephyr-7B DPO refresh from an independent family (§ 4.5 ); a controlled anti-sycophancy DPO with sham-DPO bootstrap on Mistral-7B and Gemma-2-2B-IT reduces sycophancy by 93\% / 46\% while probe transfer stays within a pre-specified \pm 0.05 AUROC equivalence margin. 2 Related work Truth and sycophancy have been studied on largely parallel tracks. On the truth side, truth and falsehood are linearly separable in LLM representations [ 20 , 4 ] , detectable from hidden states [ 3 , 25 ] , and controllable via representation engineering and inference-time intervention [ 35 , 17 , 5 ] ; lying concentrates in a small number of heads, with five layers and forty-six heads in Llama-2-70B [ 6 ] and twelve of 1{,}024 heads sufficient to reduce lying to baseline hallucination [ 14 ] . On the sycophancy side, agreement has been documented as pervasive in RLHF’d models [ 26 , 27 , 31 ] and localized to sparse attention components [ 7 , 10 , 16 ] . 33 localize MMLU sycophancy specifically to a late-layer opinion-driven override in seven \sim 7B-scale models via logit-lens and single-layer activation patching. Prior cross-task comparisons at the 3 B– 4 B scale reported limited direction-level overlap [ 10 , 34 ] , read as evidence for distinct mechanisms; on twelve 1.5B–72B models we report median 67\% head-level shared fraction ( 40 – 87\% range) with edge-level cross-task r{>}0.97 on Gemma-2-2B and Phi-4 (different lab and architecture), and mean-difference probes on the shared subspace transfer at AUROC 0.83 on Gemma (Appendix R reconciles with the prior null). The lying direction we use is the Marks–Tegmark and representation-engineering truth direction [ 20 , 35 ] , paired with an independently-derived sycophancy direction; the same attention heads write both. The mechanistic-interpretability framework for circuit identification began with the math-for-transformers literature [ 9 , 24 ] and crystallized in edge-level path patching [ 32 , 8 ] . Component reuse across task families has been documented at the importance level by 22 , sparse-feature decomposition has been scaled to production-size models [ 1 , 30 , 19 ] , and a single linear direction has been shown to mediate refusal [ 2 ] . Three observations sharpen the reuse picture. First, path patching traces the circuit at edge resolution on Gemma-2-2B (cross-task Pearson r{=}0.993 on the 275 -edge sycophancy-vs-factual circuit; r{=}0.973 – 0.996 on the 216 -edge three-way subset) with a cross-lab, cross-architecture replication on Phi-4 (14B, Microsoft), raising the resolution from shared components to shared edges. Second, per-head directional cosines of 0.43 – 0.81 quantify how closely the two tasks write into the same subspace at the head level (Appendix M ). Third, opinion-agreement recruits the same head positions across five

Read the complete text