SVR-MAD: A Bayesian-Inspired Framework for Posterior-Guided Multi-Agent Debate
Weifan Jiang, Rana Shahout, Minghao Li, Zhenting Qi, Yilun Du · 2026
Read SVR-MAD: A Bayesian-Inspired Framework for Posterior-Guided Multi-Agent Debate by Weifan Jiang, Rana Shahout, Minghao Li, Zhenting Qi, Yilun Du (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-23099.txt.
Introduction
Jiang and six coauthors present SVR-MAD, a Bayesian-inspired framework for multi-agent debate. It treats pre-debate cues as priors and debate outcomes as evidence for agent correctness. Existing debate methods prune low-utility messages using prior signals like token log-likelihoods or self-reported confidence, which fail under hallucination. SVR-MAD builds the communication graph incrementally, prioritizing agents whose answers survive peer challenges. Across models and benchmarks it cuts token cost by up to 61 percent while matching or beating the top rival debate baseline.
Catalog record
| CREATOR | Weifan Jiang, Rana Shahout, Minghao Li, Zhenting Qi, Yilun Du |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 25943 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2605.23099
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
SVR-MAD: A Bayesian-Inspired Framework for Posterior-Guided Multi-Agent Debate Weifan Jiang, Rana Shahout, Minghao Li, Zhenting Qi, Yilun Du Abstract Multi-Agent Debate (MAD) improves LLM-agent accuracy but suffers from rapid context growth, limiting scalability in larger multi-agent settings. Existing methods prune low-utility communications using prior signals, such as token-level log-likelihoods or LLM self-reported confidence. However, these signals become unreliable under hallucination, degrading the accuracy of MAD methods that rely on them. We propose SVR-MAD, a Bayesian-inspired MAD framework that treats pre-debate signals as priors and debate outcomes as posterior-style evidence for estimating agent correctness. SVR-MAD uses this evidence to incrementally construct the communication graph, prioritizing agents whose answers survive peer challenges. Experiments across multiple LLMs and benchmarks show that SVR-MAD reduces token cost by up to 61% while matching or improving accuracy relative to the most accurate competing MAD baseline. 1 Introduction Multi-Agent Debate (MAD) improves the accuracy of Large Language Model (LLM) agents across diverse domains, including research, mathematics, and coding ( Du et al. 2024 ; Li et al. 2023 ; Wu et al. 2024 ) . By exchanging intermediate reasoning steps and answers across rounds, agents can revise their responses based on peer information and achieve accuracy gains beyond single-agent settings. However, MAD becomes costly as the communication graph grows. Each shared message is appended to another agent’s context, increasing the input-token cost and KV cache usage. With more agents or debate rounds, this overhead compounds quickly, limiting scalability. Recent work reduces the cost of MAD by removing nodes (i.e., participating agents) and/or edges (i.e., communication links between agents) from all-to-all communication graphs ( Liu et al. 2025 ; Chen et al. 2025 ; Zeng et al. 2025 ; Zhu et al. 2026 ) . These methods typically leverage information available prior to the debate (e.g., token-level log-likelihoods, LLM’s self-stated confidence) to identify and remove potentially low-utility communications. For example, outputs with high min. log-likelihood values are often considered to be reliable, and therefore are likely to be correct without further debate ( Chen et al. 2025 ) . In this work, we uncover that although pre-debate signals are effective in common cases, their informativeness can collapse on challenging problem instances relative to the LLM’s capabilities. On such instances, incorrect agents may hallucinate with high confidence, while correct agents may remain uncertain ( Kalai et al. 2025 ) . Methods based on prior signals can prematurely exclude agents or communication links that would otherwise be beneficial, thereby reducing MAD’s accuracy gains. To address this limitation, we take a Bayesian-inspired view of MAD: prior agent signals can be unreliable under hallucination, whereas debate outcomes provide posterior evidence of reliability. We focus on whether an agent preserves its answer after incorporating peer messages. Intuitively, an agent supported by sound reasoning is less likely to be convinced by flawed peer arguments. We propose Survival Rate (SVR), which measures how often an agent retains its original belief after being challenged. Because SVR is grounded in observed post-debate behavior, it provides a more hallucination-robust signal for identifying trustworthy reasoning processes and answers. We propose SVR-MAD, an efficient MAD framework that incrementally builds a communication graph using posterior debate outcomes. SVR-MAD initializes agent correctness scores from prior signals, probes S communication links to high-prior receivers, and updates scores based on whether agents retain or revise their answers. It then prioritizes high-score agents in later communications and terminates once an agent’s score exceeds a threshold. This greedy strategy identifies reliable solutions early, reducing token costs. Across two LLMs and datasets, SVR-MAD reduces token costs by up to 61% while matching or improving accuracy relative to the most accurate competing MAD baseline. 2 Background and Related Works MAD preliminary. In MAD, LLM agents iteratively exchange progress. Suppose N participating agents. Let C_{t}^{i} be the output (i.e., reasoning and answer) from agent i at turn t . Then, in all-to-all MAD, agent i generates the next-turn output, C_{t+1}^{i} , based on the following context: [Question] + [turn 1,\dots,t-1 history] + C_{t}^{i} + DebateFormat(C_{t}^{1},\dots,C_{t}^{i-1},C_{t}^{i+1}\dots C_{t}^{N}) where DebateFormat is a string manipulation function that concatenates peer outputs and adds a prompting hint to guide agent i to reflect on peer contexts, such as "These are the solutions from other agents [Insert peer solutions here]…Using the solutions from other agents as additional information, provide your answer…" ( Du et al. 2024 ) . While MAD improves LLM-agent accuracy, it scales poorly with more agents due to rapid context growth. Under all-to-all communication, each agent’s context grows as \mathcal{O}(N^{2}t) , increasing computation and KV-cache pressure while also risking long-context degradation from diluted salient information ( Liu et al. 2024 ; Laban et al. 2026 ) . Efficient MAD solutions. Existing works leverage pre-debate signals to improve MAD. One line of work uses agent-level reliability signals to identify agents whose answers already appear reliable and can therefore conclude without any debate ( Chen et al. 2025 ; Eo et al. 2025 ) . Another line uses cross-agent similarity signals to remove communication links that appear redundant ( Zeng et al. 2025 ; Liu et al. 2025 ; Zhu et al. 2026 ) . 3 Analysis of Prior and Posterior Signals Prior signals. Prior signals are derived from agents’ initial responses. They typically measure output quality and are used to exclude agents whose initial responses already appear reliable from debate, and/or prune the communication graph to prioritize deliberation with high-quality agents, aiming to improve accuracy with less communication. We study three prior signals: min. log-likelihood (min-LL), which captures the least likely token; perplexity (PPL), which measures response-level generation uncertainty; and the LLM’s self-reported confidence (conf). Our proposal: SVR. SVR measures how often an agent retains its initial belief after debating with peers. This evidence-grounded signal provides a posterior estimate of agent reliability that is less dependent on potentially hallucinated prior information. Let D , r , and c denote the total number of debates involving an agent, the number of times the agent retains or changes its belief after debate, respectively. We define SVR=(r-c)/D . Figure 1: SVR better identifies correct agents than prior signals under increasing difficulty. Percentage of problems where the top-ranked agent under each signal is correct, as a function of increasing difficulty. Approach. We validate SVR on two LLMs: GPT-OSS-120B ( OpenAI 2025 ) and DeepSeek-V3.1 ( DeepSeek-AI 2024 ) , using questions from IMO-AnswerBench ( Luong et al. 2025 ) . For each question, we run six agents and group questions by difficulty, measured by the number of agents that are correct before debate. We compare three prior signals against SVR by measuring how often the top-ranked agent under each signal is correct. Results. Figure 1 reports this percentage across difficulty groups, showing how each signal aligns with agent correctness as problems become harder. From 4+ correct agents (easiest) to 1 correct agent (hardest), the correctness of top-ranked agents under min-LL, PPL, and confidence drops from 67–87% to 5–34%. This sharp decline shows that prior signals become unreliable on difficult problems, where hallucinated or overconfident reasoning makes model behavior poorly aligned with correctness. In contrast, SVR remains predictive as difficulty increases: among questions with only 2 and 1 correct agents, SVR achieves 68–78% and 47–49%, respectively, outperforming the