Measuring Sycophancy of Language Models in Multi-turn Dialogues

Jiseung Hong, Grace Byun, Seungone Kim, Kai Shu, Jinho D. Choi · 2025

Read Measuring Sycophancy of Language Models in Multi-turn Dialogues by Jiseung Hong, Grace Byun, Seungone Kim, Kai Shu, Jinho D. Choi (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2505-23840.txt.

Introduction

Jiseung Hong and co-authors present a 2025 computing paper on sycophancy in language models during long conversations. Models often bend toward whatever the user believes, right or wrong. Past studies mostly tested one-shot factual questions, missing how pressure builds across turns.

Their benchmark, SYCON Bench, scores two things: how fast a model flips to the user's side, and how often it flips under steady pressure. Seventeen models were tested across three real-world scenarios. Sycophancy proved common across the board. Tuning for alignment made it worse, while larger size and reasoning training made models firmer. One simple prompt trick, taking a third-person view, cut the behavior by up to about two thirds in debates. Code and data are released in public.

Catalog record

CREATORJiseung Hong, Grace Byun, Seungone Kim, Kai Shu, Jinho D. Choi
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE62 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2505-23840

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Measuring Sycophancy of Language Models in Multi-turn Dialogues Jiseung Hong, Grace Byun, Seungone Kim, Kai Shu, Jinho D. Choi Abstract Large Language Models (LLMs) are expected to provide helpful and harmless responses, yet they often exhibit sycophancy —conforming to user beliefs regardless of factual accuracy or ethical soundness. Prior research on sycophancy has primarily focused on single-turn factual correctness, overlooking the dynamics of real-world interactions. In this work, we introduce SYCON Bench , a novel benchmark for evaluating sycophantic behavior in multi-turn, free-form conversational settings. Our benchmark measures how quickly a model conforms to the user ( Turn of Flip ) and how frequently it shifts its stance under sustained user pressure ( Number of Flip ). Applying SYCON Bench to 17 LLMs across three real-world scenarios, we find that sycophancy remains a prevalent failure mode. Our analysis shows that alignment tuning amplifies sycophantic behavior, whereas model scaling and reasoning optimization strengthen the model’s ability to resist undesirable user views. Reasoning models generally outperform instruction-tuned models but often fail when they over-index on logical exposition instead of directly addressing the user’s underlying beliefs. Finally, we evaluate four additional prompting strategies and demonstrate that adopting a third-person perspective reduces sycophancy by up to 63.8% in debate scenario. We release our code and data at https://github.com/JiseungHong/SYCON-Bench . 1 Introduction As Large Language Models (LLMs) achieve strong performance across diverse tasks, they are increasingly adopted as AI assistants in various domains ( Wang et al., 2025 ; Edge et al., 2025 ; Xie et al., 2024 ; Nori et al., 2023 ) . LLMs are trained to response in a human-preferred way, through preference optimization methods such as reinforcement learning from human feedback (RLHF) Ouyang et al. (2022) . However, this encourages models to prioritize user alignment over factual accuracy or ethical responsibility, resulting in a behavior known as sycophancy ( Sharma et al., 2023 ) . Although sycophancy may increase short-term user satisfaction, persistent agreement reinforces existing beliefs and hinders discovery in tasks such as exploring novel ideas or tackling unsolved problems. These real-world failures are most clearly revealed in multi-turn interactions, where conversational pressure can cause models to gradually conform to user beliefs, compromising truthfulness or safety. In fact, OpenAI recently rolled back its GPT-4o update due to sycophancy—being overly flattering and agreeable OpenAI (2025) . Yet, we cannot adequately quantify sycophancy in real-world failure cases, as prior studies only focus on single-turn factual sycophancy assessments. In this paper, we propose a benchmark called SYCON ( SY cophantic CON formity) Bench to measure sycophancy in real-world scenarios. Unlike previous studies, SYCON Bench quantifies sycophancy involving multi-turn conversations and free-form generation. To quantify the tendency of LLMs to adopt the user’s perspective, we propose two metrics: Turn of Flip (ToF), which measures the model’s resistance to stance change under sustained pressure, and Number of Flip (NoF), which indicates the model’s inconsistency in the face of repeated user challenges. Using SYCON Bench , we perform a comprehensive analysis of 17 LLMs across six model families in three real-world scenarios: (1) debate, (2) challenging unethical queries, and (3) identifying false presuppositions. We evaluate base, instruction-tuned, and reasoning-optimized variants and find that, within each family, larger models and reasoning-optimized models reduce sycophancy rates by up to 81.4% and 21.6%, respectively. We then explore simple prompting strategies to probe prompt sensitivity and mitigate sycophancy. As a mitigation, assigning a third-person persona ( Andrew Prompt ) boosts ToF performance by up to 63.8% in debate setting, while adding an explicit anti-sycophancy instruction ( Andrew + Non-Sycophantic Prompt ) yields ToF gains of up to 28% in the unethical query scenario. 2 Related Work While techniques like RLHF effectively align models with human preferences and improve instruction following ( Christiano et al., 2023 ; Bai et al., 2022 ; Ouyang et al., 2022 ), they also introduce unintended side effects like sycophancy ( Malmqvist, 2024 ; Sharma et al., 2023 ). Sycophancy is exacerbated by instruction tuning and model scaling, causing models to prioritize user agreement over factual accuracy or ethical considerations ( Liu et al., 2025 ; Laban et al., 2024 ). Recent mitigation strategies against sycophancy include targeted fine-tuning methods such as Supervised Pinpoint Tuning Chen et al. (2025) , linear probe penalties during fine-tuning Papadatos and Freedman (2024) , and synthetic data augmentation techniques Wei et al. (2024) . Moreover, TRUTH DECAY Liu et al. (2025) and the FlipFlop experiment Laban et al. (2024) have highlighted how repeated conversational interactions amplify sycophantic behavior, resulting in factual inaccuracies. Diagnostic frameworks such as SycEval Fanous et al. (2025) offer standardized metrics to quantify this behavior across multiple tasks and domains. Additionally, certain studies explore keyword-induced sycophantic hallucinations, emphasizing subtle prompt manipulations that elicit agreeable yet incorrect outputs RRV et al. (2024) . Figure 1: Qualitative Example of Debate Scenario. Given a question and an initial stance (colored in blue), an LM is tested to maintain the stance while the user repeatedly disagrees using consistent opposition. We determine at which turn the LM’s stance was reversed (colored in red) using GPT-4o evaluation. 3 SYCON Bench Real-world scenarios of user-AI interaction involve two crucial factors: (1) multi-turn conversation and (2) free-form, open-ended text generation. However, previous research falls short in capturing sycophancy in such settings, as most evaluations are limited to single-turn factual correctness—commonly referred to as Answer Sycophancy ( Sharma et al., 2023 ; Fanous et al., 2025 ). Even in studies that address free-form, open-ended text generation— Mimicry Sycophancy —sycophancy is typically measured by whether the model reproduces the user’s mistaken belief in a single response. In other words, the evaluation remains confined to static, one-shot correctness without considering how conversational context evolves. Moreover, while some recent efforts explore multi-turn interactions, they rely on constrained formats like multiple-choice questions and fail to capture how models shift their stance in natural, open-ended dialogue Liu et al. (2025) . To address this, we introduce SYCON Bench , a benchmark designed to evaluate and quantify sycophancy in real-world settings involving multi-turn, free-form interactions. Unlike prior studies, SYCON Bench simulates extended conversations where models are repeatedly challenged or questioned by user input. This setup enables us to measure behavioral failures, focusing on conversational consistency—revealing how and when models inappropriately conform to users over time. Benchmark Construction and Alignment Evaluation To construct SYCON Bench , we curate user queries from three domains—debate, unethical stereotypes, and false presuppositions—each selected to reflect real-world and diverse conversational challenges. For the debate scenario , we select 100 questions out of 632 public debate topics, prioritizing less polarized issues, and extract a specific argument that the model must uphold throughout the dialogue. For the unethical stereotypes scenario, we filter 200 prompts from StereoSet ( Nadeem et al., 2020 ) and rewrite them to implicitly embed stereotypical assumptions. For the false presupposition scenario , we sample 200 prompts that embed hidden false premises, challenging the model to detect and correct the misinformation. Across all scenarios, follow-up user turns are generated using predefined persuasive strategies (e.g., social proof, essentialism), simulating sustained conversational pressure. The final benchmark consists of 500 multi-turn prompts, each with five dialogue turns. We use GPT-4o to evaluate whether each model response aligns with expected behavior

Read the complete text