Peacemaker or Troublemaker: How Sycophancy Shapes Multi-Agent Debate
Binwei Yao ♢ \diamondsuit ♡ \heartsuit, Chao Shang ♢ \diamondsuit, Wanyu Du ♢ \diamondsuit, Jianfeng He ♢ \diamondsuit, Ruixue Lian ♢ \diamondsuit · 2025
Read Peacemaker or Troublemaker: How Sycophancy Shapes Multi-Agent Debate by Binwei Yao ♢ \diamondsuit ♡ \heartsuit, Chao Shang ♢ \diamondsuit, Wanyu Du ♢ \diamondsuit, Jianfeng He ♢ \diamondsuit, Ruixue Lian ♢ \diamondsuit (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2509-23055.txt.
Introduction
Models that agree too fast can wreck a multi-agent debate before truth wins. Work by Binwei Yao and 8 co-authors names that failure mode sycophancy. Debate systems need real disagreement to refine arguments. Excess agreeableness collapses debate into early consensus. The team give the first formal definition of sycophancy for debate settings.
New metrics score how sycophantic an agent is and how debate flow suffers. Tests vary the trait in debaters and judges, in both open and central setups. Sycophancy cut accuracy below even single-agent baselines. Debater-led and judge-led failures looked distinct. The team close with design rules that balance pushback and cooperation.
Catalog record
| CREATOR | Binwei Yao ♢ \diamondsuit ♡ \heartsuit, Chao Shang ♢ \diamondsuit, Wanyu Du ♢ \diamondsuit, Jianfeng He ♢ \diamondsuit, Ruixue Lian ♢ \diamondsuit |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 49 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2509-23055
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Peacemaker or Troublemaker: How Sycophancy Shapes Multi-Agent Debate Binwei Yao ♢ \diamondsuit ♡ \heartsuit, Chao Shang ♢ \diamondsuit, Wanyu Du ♢ \diamondsuit, Jianfeng He ♢ \diamondsuit, Ruixue Lian ♢ \diamondsuit Abstract Large language models (LLMs) often display sycophancy, a tendency toward excessive agreeability. This behavior poses significant challenges for multi-agent debating systems (MADS) that rely on productive disagreement to refine arguments and foster innovative thinking. LLMs’ inherent sycophancy can collapse debates into premature consensus, potentially undermining the benefits of multi-agent debate. While prior studies focus on user–LLM sycophancy, the impact of inter-agent sycophancy in debate remains poorly understood. To address this gap, we introduce the first operational framework that (1) proposes a formal definition of sycophancy specific to MADS settings, (2) develops new metrics to evaluate the agent sycophancy level and its impact on information exchange in MADS, and (3) systematically investigates how varying levels of sycophancy across agent roles (debaters and judges) affects outcomes in both decentralized and centralized debate frameworks. Our findings reveal that sycophancy is a core failure mode that amplifies disagreement collapse before reaching a correct conclusion in multi-agent debates, yields lower accuracy than single-agent baselines, and arises from distinct debater-driven and judge-driven failure modes. Building on these findings, we propose actionable design principles for MADS, effectively balancing productive disagreement with cooperation in agent interactions. 1 Introduction Sycophancy, defined as excessive agreement or flattery to gain favor ( Burnstein 1966 ) , poses a unique and stealthy challenge in AI systems due to its deceptive alignment with cooperative behavior, often evading detection by standard safety measures. Recent research reveals that large language models (LLMs) exhibit sycophantic tendencies ( Sharma et al. 2023 ; Perez et al. 2023 ) , likely stemming from training data that rewards such behavior. However, existing studies have primarily focused on user-LLM interactions, leaving inter-agent sycophancy in multi-agent settings poorly understood. This gap is particularly concerning for multi-agent debating systems (MADS), which rely on constructive disagreement and robust inter-agent communication to refine reasoning ( Liang et al. 2023 ) . Just as sycophancy undermines human group decision-making by fostering premature consensus and stifling critical discourse ( Gordon 1996 ) , it poses analogous risks to MADS. Effective multi-agent debating requires agents to resolve disagreements through critical thinking, rather than merely echoing others’ views or stubbornly maintaining their positions. For instance, in the Society of Minds (SoM) debating framework ( Du et al. 2023 ) , sycophancy appears when agents prioritize agreement at the expense of accuracy. As shown in Figure 1 (left), Debater 1 abandons a correct answer to align with Debaters 2’s incorrect commonsense reasoning result, demonstrating how such dynamics can corrupt collaborative reasoning. Despite its importance, the dynamics of sycophancy in multi-agent debating remains poorly understood, especially on how it manifests across debating structures. To address this gap, we propose the first operational definition of sycophancy in MADS: an agent’s excessive alignment with others, prioritizing harmony over its designated communication objectives . Building on this, first, we identify two high-stakes failure modes that expose vulnerabilities in different collaboration structures: (1) disagreement collapse in peer debates within decentralized systems without a judge, where sycophancy drives premature convergence on incorrect conclusions, and (2) disagreement collapse in judging within centralized systems with a judge, where evaluating agents echoing the stylistic response without independent reasoning. Second, based on our definition, we design two sets of tailored evaluation as shown in Figure 1 (center): one quantifying the rate of disagreement collapse during the debate and another measuring sycophancy itself. Third, we introduce sycophancy-control mechanisms that adjust agent personas along a spectrum of sycophancy levels, enabling systematic analysis of how these dynamics shape debate outcomes. This spectrum ranges from the peacemaker , who prioritizes harmony and agreement, to the “troublemaker” , who upholds independent reasoning and willingness to disagree when warranted. As shown in Figure 1 (right), we conduct a systematic grid search over debater personas, varying each debater’s sycophancy level to identify optimal settings for productive debate. For the judge, we directly manipulate its sycophancy levels. Figure 1: Evaluation Framework for Sycophancy in Multi-Agent Debating Systems. It comprises three components: (1) definition of sycophancy in MADS (left); (2) evaluation metrics to quantify agent sycophancy and its impact on debate performance (center); and (3) sycophancy-control mechanisms for debaters and judges that dynamically adjust agent personas along a spectrum of sycophancy levels between a “troublemaker” and a “peacemaker” (right). Our analysis reveals several important insights into how sycophancy systematically affects multi-agent debating. First, sycophantic behavior undermines performance by encouraging premature consensus and reducing decision quality, with higher debater sycophancy strongly associated with failures to reach correct conclusions during disagreements. Second, the interplay between debaters’ and judges’ sycophancy levels jointly shapes MADS’ behavior. In decentralized settings, performance is worst when all debaters are highly sycophantic, while optimal outcomes emerge from a balance between independence and cooperativeness: combining “peacemaker” and “troublemaker” roles maintains adversarial tension while keeping debates steerable. In centralized settings, system performance is largely insensitive to the judge’s sycophancy, highlighting the resilience of the centralized architecture to sycophantic influence. Based on these findings, we propose actionable design strategies for MADS, emphasizing strategic persona management and architecture-specific safeguards to mitigate sycophancy and enhance system robustness. 2 Related Work LLM Sycophancy. LLM sycophancy poses a major challenge for aligned AI, manifesting as language models’ tendency to excessively agree with or flatter human users, even at the expense of factual accuracy or ethical standards ( Sharma et al. 2023 ) . Empirical studies have shown this behavior across various LLMs and settings; for instance, Perez et al. 2023 demonstrate that models often shift their stated opinions to align with perceived user preferences, compromising their reliability as objective information sources. This tendency arises from training regimes that reward agreement with human feedback, effectively creating a form of reward-hacking ( Denison et al. 2024 ) . While sycophancy in user-model interactions has been widely studied ( Hong et al. 2025 ; Fanous et al. 2025 ) , Pitre et al. 2025 propose a mitigation strategy focused on improving debating system performance. However, their approach treats sycophancy purely as a negative trait, neglecting its potential role in enabling agents to flexibly adopt correct answers from others and leaving the phenomenon largely unexplored in multi-agent debate contexts. Multi-Agent Debating System. Prior work in multi-agent collaboration generally falls into two categories ( Huang et al. 2024 ) : decentralized and centralized frameworks. Decentralized approaches emphasize peer-to-peer communication, as in Society-of-Minds (SoM) ( Du et al. 2023 ) , where agents participate equally in debates without hierarchy or coordination. Centralized frameworks combine hierarchical and peer-to-peer interactions, exemplified by the two-debater-one-judge debate system ( Liang et al. 2023 ) or AgentVerse’s dynamic agent recruitment ( Chen et al. 2023 ) . Despite their potential, these designs have notable limitations: they often rely on complex, dataset-specific prompt engineering and ad-hoc persona control, and recent studies indicate that many multi-agent debating systems fail to consistently outperform single-agent reasoning on standard benchmarks ( Zhang et al. 2025 ) . A key challenge is that models frequently abandon correct answers in favor of peer consensus, prioritizing agreement over critical evaluation of flawed reasoning ( Wynn et al. 2025 ) . This