More Debate, Same Evidence: Structural Limits of Homogeneous Multi-Agent Groundedness Judges

Yuelyu Ji · 2026

Read More Debate, Same Evidence: Structural Limits of Homogeneous Multi-Agent Groundedness Judges by Yuelyu Ji (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2608-00243.txt.

Description

Ji tests whether multi-agent debate improves groundedness judgements by LLM judges. Panels of agents are often assumed to judge better after trading critiques. Groundedness verification asks if a claim is supported by supplied evidence. Ji evaluates a homogeneous three-agent panel on six public benchmarks. Those benchmarks cover fact verification and hallucination detection.

Against a fixed single-agent reference, panel accuracy shifts ranged widely. Differences ran from plus 8.5 to minus 4.4 percentage points. Two data sets showed reliable gains, and one a reliable loss. Three were statistically inconclusive. Panel and reference used different model variants, Ji notes. The gaps thus describe complete systems, not a pure debate effect. More debate with the same evidence has structural limits, the results suggest.

Catalog record

CREATORYuelyu Ji
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE35 KB
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2608.00243

Browse the full library · About the Tower of Babel