It’s Not Always Sycophancy: Measuring LLM Conformity as a Function of Epistemic Uncertainty
Kevin Guo, Chao Yan, Avinash Baidya, Katherine Brown, Xiang Gao, Juming Xiong, Zhijun Yin, Bradley Malin · 2026
Read It’s Not Always Sycophancy: Measuring LLM Conformity as a Function of Epistemic Uncertainty by Kevin Guo, Chao Yan, Avinash Baidya, Katherine Brown, Xiang Gao, Juming Xiong, Zhijun Yin, Bradley Malin (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-27288.txt.
Introduction
Kevin Guo and colleagues test whether language models cave to user pushback from flattery or from genuine uncertainty. Their two-stage MUSE framework maps a model's uncertainty on a question against its odds of yielding next turn. Both sycophancy and uncertainty drive yielding, and each grows when the user seems expert or the suggestion seems plausible.
Catalog record
| CREATOR | Kevin Guo, Chao Yan, Avinash Baidya, Katherine Brown, Xiang Gao, Juming Xiong, Zhijun Yin, Bradley Malin |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 35321 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2605.27288
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
It’s Not Always Sycophancy: Measuring LLM Conformity as a Function of Epistemic Uncertainty Kevin Guo, Chao Yan, Avinash Baidya, Katherine Brown, Xiang Gao, Juming Xiong, Zhijun Yin, Bradley Malin Abstract Large language models (LLMs) are known to abandon their initial stance to conform to user pushback. While prior research largely attributes this behavior to sycophancy learned during reinforcement learning from human feedback, we hypothesize that conformity is also driven by a model’s epistemic uncertainty at inference time. In this paper, we introduce MUSE, a two-stage evaluation framework to disentangle the mechanisms driving LLM conformity. Specifically, MUSE maps a model’s epistemic uncertainty in responding to a query against its likelihood to yield to user pushback in a subsequent turn. We demonstrate that the mechanisms driving conformity extend beyond sycophancy alone. Specifically, we characterize two distinct factors that jointly drive conformity: sycophantic conformity , where a model aligns with user pushback even with absolute certainty in its initial response, and uncertainty-driven conformity , where a model’s likelihood for conformity increases alongside its uncertainty. Furthermore, we conduct ablation studies to demonstrate that both sycophantic conformity and uncertainty-driven conformity grow with 1) the LLM’s perceived expertise of the user and 2) the plausibility of the user’s suggestions. More broadly, MUSE informs more targeted intervention strategies by distinguishing alignment-induced sycophancy and training-corpora-driven uncertainty. 1 Introduction Large language models (LLMs) are increasingly deployed as conversational assistants in high-stakes domains, raising concerns about their reliability in extended dialogue 24 ; 6 . Specifically, these models are known to abandon an initial stance to conform to a user’s beliefs when faced with conversational pressure (e.g., user pushback against an initial response) 19 . For instance, a model might correctly warn against a dangerous drug interaction, but inappropriately approve the combination if the user insists it is safe 2 . To date, the research community has largely equated this conformity with sycophancy , attributing it primarily to artifacts of reinforcement learning from human feedback (RLHF) 11 ; 12 ; 20 ; 15 . While some degree of this behavior likely stems from sycophantic tendencies acquired during RLHF, prior sycophancy evaluations have overlooked the influence of a model’s inference-time uncertainty in addressing a prompt. Figure 1: The MUSE Framework. Step 1 estimates a model’s inference-time epistemic uncertainty by computing a query’s decision-space entropy across k stochastic samples. Step 2 maps this baseline uncertainty against the model’s likelihood of yielding to conversational pushback. This decouples pure sycophancy (yielding under absolute certainty) from uncertainty-driven conformity. To understand how inference-time uncertainty can drive conformity, it is helpful to draw a parallel to social dynamics. In human-to-human interactions, a key factor determining whether an individual will yield to the suggestion of another is their initial uncertainty about the subject 3 ; 1 . To define this uncertainty in LLM interactions, we adopt the term epistemic uncertainty from prior literature, which reflects the uncertainty arising from limitations in an LLM’s inherent knowledge or capabilities 5 ; 25 . For example, a model encountering a rare clinical case outside its pretraining corpora may adopt a user’s suggested diagnosis because its epistemic uncertainty is high. Without controlling for this uncertainty, current approaches to evaluating sycophancy risk conflating pure sycophancy with conformity due to uncertainty. In this paper, we seek to decouple LLM conformity driven by sycophantic behaviors acquired during alignment, from conformity driven by epistemic uncertainty at inference-time. To achieve this, we introduce M easuring U ncertainty in S ycophancy E valuation (MUSE), a two-step framework to investigate LLM conformity as a joint function of alignment-time sycophancy and inference-time epistemic uncertainty (Figure 1 ). The primary contributions include: 1. We introduce MUSE , a novel evaluation framework that maps a model’s baseline epistemic uncertainty against its likelihood to yield to user pushback, disentangling inference-time uncertainty from alignment-induced sycophancy. 2. We evaluate 7 LLMs using MUSE to decouple conformity into i) pure sycophancy (yielding despite absolute certainty) and ii) uncertainty-driven conformity (yielding scales alongside uncertainty), illustrating that current metrics consistently overestimate pure sycophancy. 3. We conduct ablation studies to demonstrate that both forms of conformity vary depending on pushback plausibility and perceived user expertise, suggesting that conformity is sensitive to how a model is prompted. Together, these contributions show that detecting and mitigating unwarranted conformity requires targeted, context-specific interventions, addressing sycophancy during alignment and reducing uncertainty through model development. 1 1 1 Code will be open-sourced upon publication. 2 Background and Related Work 2.1 Sycophancy in LLMs Prior literature defines sycophancy as the phenomenon where a model aligns its response with a user’s stated or inferred beliefs, even when those beliefs are illogical or factually inaccurate 19 . Recent evidence attributes this behavior to RLHF, which optimizes chatbots to be helpful assistants 11 . However, in optimizing towards helpfulness, models are inadvertently trained to prioritize helpfulness over factual accuracy. Early approaches for evaluating sycophancy have relied primarily on prompting a model with an illogical request or factually inaccurate information 2 ; 10 and measuring its tendency to align with the flawed premises rather than resist or correct it. As LLMs are adopted beyond single-shot queries to power chatbots and copilots, more recent studies have evaluated the impact of sycophancy in multi-turn dialogues. These evaluations simulate conversational pressure by subjecting a model to user pushback after initially selecting an answer (typically in a question-answer setting), showing that models frequently align with factually inaccurate user suggestions and compound these errors across turns of conversation 14 ; 7 ; 12 . Specifically, Kim et al. formalize a model’s initial response as its assessment of the prompt and any subsequent changing in that stance to be the result of sycophancy 12 . 2.2 Uncertainty Estimation in LLMs Uncertainty estimation in LLMs characterizes two primary types of uncertainty: aleatoric and epistemic. Aleatoric uncertainty reflects the ambiguous and non-deterministic nature of the dependency between input and output which is irreducible 9 . By contrast, MUSE focuses on measuring epistemic uncertainty (hereon referred to as just uncertainty), which arises when a model is insufficiently complex to represent the knowledge it has been presented, or interacts with concepts underrepresented in its pretraining corpora, reflecting improvable gaps in its inherent capabilities 5 . Historically, measuring uncertainty leverages tools like token-level log-probabilities, which rely on a model’s internal next-token predictive distribution, and explicated confidence scores, where a model explicitly outputs its confidence in a response. However, since log-probabilities are computed iteratively, they can be skewed by prompt and output length, as well as syntax 13 ; 8 . Prompting a model to explicitly output a confidence score 16 has also been shown to be unreliable, as LLMs struggle to self-assess, causing misalignment with empirical accuracy 26 . Alternatively, researchers have adopted semantic entropy and self-consistency methods, which measure agreement across multiple sampled outputs 22 ; 4 . While this addresses the limitations of log-probs and explicated confidence, it sacrifices granularity of response distributions to achieve an aggregate vote 21 . In short, existing methods struggle to isolate knowledge gaps from generative or alignment artifacts. 3 MUSE Framework 3.1 Modeling Uncertainty through Decision-Space Entropies To isolate sycophancy from uncertainty-driven conformity, MUSE establishes a baseline uncertainty for each prompt prior to introducing conversational pressures. Formally, let x_{i} denote a query