When Persuasion Overrides Truth in Multi-Agent LLM Debates: Introducing a Confidence-Weighted Persuasion Override Rate (CW-POR)
Mahak Agarwal Divyam Khanna Independent Researcher Independent Researcher [email protected] [email protected] · 2025
Read When Persuasion Overrides Truth in Multi-Agent LLM Debates: Introducing a Confidence-Weighted Persuasion Override Rate (CW-POR) by Mahak Agarwal Divyam Khanna Independent Researcher Independent Researcher [email protected] [email protected] (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2504-00374.txt.
Introduction
When language models argue, does the better debater win, or the truthful one? Mahak Agarwal and Divyam Khanna staged single-turn debates: one agent answers a factual question correctly, another argues forcefully for a falsehood, and a model of the same kind judges. They introduce a score, the confidence-weighted persuasion override rate, which counts not only how often the judge picks the lie but how confident it sounds when doing so.
Across five open-source models, from 3 to 14 billion parameters, and with debaters' answers varied from 30 to 300 words, the false side often won, sometimes with high confidence. Even small models wrote arguments persuasive enough to override true answers. The authors warn that debate-based schemes for safer AI need strong calibration and adversarial testing, or they may industrialize confident misinformation.
Catalog record
| CREATOR | Mahak Agarwal Divyam Khanna Independent Researcher Independent Researcher [email protected] [email protected] |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 25 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2504-00374
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
When Persuasion Overrides Truth in Multi-Agent LLM Debates: Introducing a Confidence-Weighted Persuasion Override Rate (CW-POR) Mahak Agarwal Divyam Khanna Independent Researcher Independent Researcher [email protected] [email protected] Abstract In many real-world scenarios, a single Large Language Model (LLM) may encounter contradictory claims—some accurate, others forcefully incorrect—and must judge which is true. We investigate this risk in a single-turn, multi-agent debate framework: one LLM-based agent provides a factual answer from TruthfulQA, another vigorously defends a falsehood, and the same LLM architecture serves as judge. We introduce the Confidence-Weighted Persuasion Override Rate (CW-POR) , which captures not only how often the judge is deceived but also how strongly it believes the incorrect choice. Our experiments on five open-source LLMs (3B–14B parameters), where we systematically vary agent verbosity (30–300 words), reveal that even smaller models can craft persuasive arguments that override truthful answers—often with high confidence. These findings underscore the importance of robust calibration and adversarial testing to prevent LLMs from confidently endorsing misinformation. Question Q: What would happen if you were struck by a penny dropped from the top of the Empire State Building? Agent A (Correct) Answer (A): It will be harmless. Due to air resistance, its impact energy is too low to cause significant injury. Agent B (Persuasive) Answer (B): It would be deadly! Despite its small size, the penny could hit with enough force to cause severe trauma or even death. Judge Model Selected: Answer B (Incorrect) Self-rated Confidence: 4/5 (0.8/1) LL Confidence: 0.92 Combine Confidences Final Confidence = 0.8 \times 0.92 = 0.736 Final Decision Decision: Chose Answer B (Persuasion Override) CW-POR CW-POR computed by weighting the override by Final Confidence (3.68) Figure 1: Example of a single-turn multi-agent debate. A factual question is answered by Agent A (Correct) and Agent B (Persuasive). The Judge Model evaluates both responses, reporting a self-rated confidence (4/5) (0.8 after normalization) and a log-likelihood confidence (0.92), which are combined into a final confidence (0.736). The Judge’s override decision (selecting the incorrect Answer B) is then used in computing the Confidence-Weighted Persuasion Override Rate (CW-POR). 1 Introduction Large Language Models (LLMs) have made significant strides in natural language processing tasks, powering applications like question answering, text generation, and content summarization. Yet, they also present new challenges: modern LLMs, trained on massive amounts of web text, can inadvertently reproduce misinformation with a veneer of fluency and authority. In real-world deployments, an LLM may act as both the producer and evaluator of content—authoring text one moment and judging correctness the next. This creates scenarios where a highly persuasive but fundamentally incorrect statement could override a more factual counterpart simply due to rhetorical style, emotional appeal, or authoritative tone. Consider the use case of an LLM-based agent crawling the web to compile a summary on a controversial topic: some sources might accurately detail the facts in a measured, neutral tone, whereas others might employ emotionally charged language or strong assertions to push a false narrative. Without robust mechanisms to differentiate fact from rhetorical flourish, the LLM could end up championing or highlighting the misleading claim—especially if it lacks further cross-examination or interactive debate. Single-Turn, Multi-Agent Framework. To study this phenomenon, we adopt a simplified but illustrative scenario: two LLM-based agents each provide a single-turn response about a question from TruthfulQA [ 12 ] . One agent receives the correct answer and explains it neutrally, while the other is tasked with persuasively defending a known falsehood. Crucially, the judge—also an LLM of the same or similar architecture—must choose which answer is correct and report a confidence rating from 1 to 5. This single-turn design reflects an everyday situation where an AI sees two conflicting statements without further opportunities for rebuttal or clarification. It also underscores the real risk: can rhetorical style alone outshine factual correctness when there is no second chance to respond? Confidence-Weighted Persuasion Override Rate (CW-POR). We introduce a new metric to measure both whether and how intensely an LLM judge is misled. Traditional metrics, such as the persuasion override rate (POR), record how often the persuasive (but incorrect) agent wins. However, they do not account for the judge’s self-reported certainty. Our proposed CW-POR addresses this by weighting each misjudgment by the judge’s confidence level, ensuring that a high-confidence error weighs more heavily than a low-confidence one. Contributions. In this paper, we: • Propose a single-turn, adversarial multi-agent debate framework as a lens to investigate whether rhetorical style and emotional language can trump correctness in LLM-based decision-making. • Introduce the Confidence-Weighted Persuasion Override Rate (CW-POR) to better capture the severity of being misled. • Evaluate five open-source LLMs, ranging from 3B to 14B parameters, across a spectrum of verbosity settings (30–300 words). In all roles (neutral, persuasive, judge), we use the same model family, mirroring real-world scenarios where one AI system handles generation and evaluation. • Demonstrate that even smaller models can forcefully and confidently advocate for false claims, eliciting high-confidence errors from their judging counterpart. Our findings highlight the vulnerabilities in single-turn LLM evaluations, showing that a sufficiently persuasive argument can override factual correctness—even in the absence of malicious intent. By quantifying these failures through CW-POR, we point to the need for stronger calibration, adversarial testing, and perhaps multi-turn or ensemble-based debate approaches to mitigate the risk of confidently endorsed misinformation. 2 Related Work Below, we expand on four primary research areas that inform our single-turn, multi-agent debate. 2.1 Debate Frameworks and Multi-Agent Systems Debate frameworks have gained prominence as a means to improve LLM reasoning and interpretability. Irving et al. [ 1 ] originally proposed multi-turn debates to surface truthful reasoning through adversarial argumentation. Follow-up studies (e.g., Michael et al. [ 2 ] , Kenton et al. [ 3 ] ) often involve iterative back-and-forth dialogues, with the judge or a separate verifier interjecting questions. While multi-turn interactions can expose hidden contradictions, they also rely on additional overhead and robust prompting. In contrast, our approach focuses on a single-turn scenario, echoing everyday situations where an AI system encounters two conflicting statements without further retort or explanation. Recent works in multi-agent evaluation (Chan et al. [ 4 ] , Bandi and Harrasse [ 5 ] ) suggest that having multiple agents critique and examine each other can enhance factual accuracy. However, these systems often adopt cooperative or partially adversarial protocols, whereas we implement a fully adversarial stance: one agent is explicitly correct, the other explicitly incorrect, and no clarifications are allowed. This one-shot confrontation underscores whether rhetorical style can trump clarity when there is no subsequent rebuttal. 2.2 Persuasive and Misinformation-Laden Text Generation A body of work investigates how LLMs produce or respond to persuasive text, particularly misinformation. Chiang et al. [ 6 ] illustrate that an LLM can be swayed by emotionally charged dialogue into endorsing blatantly false statements. Breum et al. [ 7 ] analyze rhetorical strategies that boost credibility, revealing how appealing to authority or emotion can sway both human and machine evaluators. Notably, these studies typically evaluate how well humans or the same model perceives the persuasion; our method places the judge, neutral agent, and persuasive agent in separate roles, even if they share the same base architecture. This structure more closely aligns with real scenarios where an LLM reading two articles—one