DeliberationBench: When Do More Voices Hurt? A Controlled Study of Multi-LLM Deliberation Protocols
Vaarunay Kaushal, Taranveer Singh · 2026
Read DeliberationBench: When Do More Voices Hurt? A Controlled Study of Multi-LLM Deliberation Protocols by Vaarunay Kaushal, Taranveer Singh (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2601-08835.txt.
Description
Vaarunay Kaushal and Taranveer Singh test if group talk helps chat models give a better joint answer. In group talk, more than one model shares views and they settle on one reply. Fans say the talk lifts quality. The pair ask if the same gain comes from a more plain trick: make many replies and just pick the best one.
Their test set is called DeliberationBench. It runs three forms of group talk next to that plain pick best base line. Each form is held to the same cost and pool size. A reader who builds model teams gets a fair check. It shows when group talk earns its cost, and when a plain pick does as well.
Catalog record
| CREATOR | Vaarunay Kaushal, Taranveer Singh |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 11 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2601-08835