Test-Time Scaling with Diffusion Language Models via Reward-Guided Stitching

Roy Miles, Aysim Toker, Andreea-Maria Oncescu, Songcen Xu, Jiankang Deng ✉, Ismail Elezi · 2026

Read Test-Time Scaling with Diffusion Language Models via Reward-Guided Stitching by Roy Miles, Aysim Toker, Andreea-Maria Oncescu, Songcen Xu, Jiankang Deng ✉, Ismail Elezi (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2602-22871.txt.

Description

Roy Miles and four co-authors stitch diffusion-model reasoning into stronger answers. Generating many chains of thought helps, but standard aggregation picks whole traces or votes on final answers, discarding useful steps from partial or nearly correct attempts. Stitching Noisy Diffusion Thoughts instead pools step-level candidates.

For each problem, the method samples many cheap, diverse reasoning paths from a masked diffusion language model. It scores every intermediate step with an off-the-shelf process reward model, and stitches the best steps across paths into one composite rationale. Only the final answer is then recomputed. Across math reasoning benchmarks, step-level recombination helps most on hard problems. It lifts average accuracy by up to about twenty-four percent across six math and coding tasks, with latency nearly halved against diffusion and unified rivals.

Catalog record

CREATORRoy Miles, Aysim Toker, Andreea-Maria Oncescu, Songcen Xu, Jiankang Deng ✉, Ismail Elezi
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE46 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2602-22871

Browse the full library · About the Tower of Babel