Multi-Agent Reasoning Improves Compute Efficiency: Pareto-Optimal Test-Time Scaling
Florian Valentin Wunderlich, Lars Benedikt Kaesberg, Jan Philip Wahle, · 2026
Read Multi-Agent Reasoning Improves Compute Efficiency: Pareto-Optimal Test-Time Scaling by Florian Valentin Wunderlich, Lars Benedikt Kaesberg, Jan Philip Wahle, (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-01566.txt.
Description
Florian Valentin Wunderlich and four co-authors compare ways to spend extra computing time at inference so a language model answers better without retraining. The field often chases raw scores; this study prices every gain, since real deployments run on fixed budgets.
Four strategies face off: self-consistency, which samples many answers and votes; self-refinement, which revises; multi-agent debate; and mixture-of-agents, which merges. Across two hard reasoning benchmarks and many model sizes, the authors draw the Pareto front of best accuracy per unit of compute. They sweep dozens of settings for sample counts, agent counts, and debate rounds. At equal budgets, debate and mixture beat self-consistency by clear margins, and their gains keep growing on harder tasks where voting saturates early. One design rule emerges: mixture works best when parallel drafts outnumber the merging steps.
Catalog record
| CREATOR | Florian Valentin Wunderlich, Lars Benedikt Kaesberg, Jan Philip Wahle, |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 45 KB |
| LICENSE | http://creativecommons.org/licenses/by-sa/4.0/ |
| RIGHTS | CC BY SA |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2605.01566