Two Calls, Two Moments, and the Vote-Accuracy Curve of Repeated LLM Inference

Yi Liu · 2026

Read Two Calls, Two Moments, and the Vote-Accuracy Curve of Repeated LLM Inference by Yi Liu (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-03379.txt.

Description

Yi Liu studies how much repeated language model sampling helps binary decisions under majority vote, and how to forecast those gains before spending the compute. Extra calls cost money, so sharp bounds on vote accuracy at each budget matter for test-time planning.

Just two independent answers per validation example, Liu shows, pin down a class of latent success distributions consistent with the paired outcomes. Optimizing over that class gives sharp accuracy and gain bounds at every finite budget, plus infinite-vote limits and curve forecasts. On two question datasets, the method separated settings with real voting gains from those with little headroom.

Catalog record

CREATORYi Liu
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE65 KB
LICENSEhttp://creativecommons.org/licenses/by-sa/4.0/
RIGHTSCC BY SA
SOURCEarXiv

Source: https://arxiv.org/abs/2605.03379

Browse the full library · About the Tower of Babel