More Debate, Same Evidence: Structural Limits of Homogeneous Multi-Agent Groundedness Judges
Yuelyu Ji · 2026
Read More Debate, Same Evidence: Structural Limits of Homogeneous Multi-Agent Groundedness Judges by Yuelyu Ji (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2608-00243.txt.
Description
Ji tests whether multi-agent debate improves groundedness judgements by LLM judges. Panels of agents are often assumed to judge better after trading critiques. Groundedness verification asks if a claim is supported by supplied evidence. Ji evaluates a homogeneous three-agent panel on six public benchmarks. Those benchmarks cover fact verification and hallucination detection.
Against a fixed single-agent reference, panel accuracy shifts ranged widely. Differences ran from plus 8.5 to minus 4.4 percentage points. Two data sets showed reliable gains, and one a reliable loss. Three were statistically inconclusive. Panel and reference used different model variants, Ji notes. The gaps thus describe complete systems, not a pure debate effect. More debate with the same evidence has structural limits, the results suggest.
Catalog record
| CREATOR | Yuelyu Ji |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 35 KB |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2608.00243