DeliberationBench: When Do More Voices Hurt? A Controlled Study of Multi-LLM Deliberation Protocols

Vaarunay Kaushal, Taranveer Singh · 2026

Read DeliberationBench: When Do More Voices Hurt? A Controlled Study of Multi-LLM Deliberation Protocols by Vaarunay Kaushal, Taranveer Singh (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2601-08835.txt.

Description

Vaarunay Kaushal and Taranveer Singh test if group talk helps chat models give a better joint answer. In group talk, more than one model shares views and they settle on one reply. Fans say the talk lifts quality. The pair ask if the same gain comes from a more plain trick: make many replies and just pick the best one.

Their test set is called DeliberationBench. It runs three forms of group talk next to that plain pick best base line. Each form is held to the same cost and pool size. A reader who builds model teams gets a fair check. It shows when group talk earns its cost, and when a plain pick does as well.

Catalog record

CREATORVaarunay Kaushal, Taranveer Singh
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE11 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2601-08835

Browse the full library · About the Tower of Babel