Understanding Performance Gap Between Parallel and Sequential Sampling in Large Reasoning Models

Xiangming Gu, Soham De, Larisa Markeeva, Petar Veličković, Razvan Pascanu, [0.5em] Google DeepMind · 2026

Read Understanding Performance Gap Between Parallel and Sequential Sampling in Large Reasoning Models by Xiangming Gu, Soham De, Larisa Markeeva, Petar Veličković, Razvan Pascanu, [0.5em] Google DeepMind (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-05868.txt.

Description

Gu and four colleagues explain why parallel sampling beats sequential sampling in large reasoning models despite sequential sampling's greater representational power. Testing three hypotheses across model families and math and coding domains, they rule out aggregation and context length as main culprits. Lack of exploration, from conditioning on prior answers, emerges as the larger cause.

Catalog record

CREATORXiangming Gu, Soham De, Larisa Markeeva, Petar Veličković, Razvan Pascanu, [0.5em] Google DeepMind
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE54558
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2604.05868

Browse the full library · About the Tower of Babel