Test-Time Scaling with Diffusion Language Models via Reward-Guided Stitching
Roy Miles, Aysim Toker, Andreea-Maria Oncescu, Songcen Xu, Jiankang Deng ✉, Ismail Elezi · 2026
Read Test-Time Scaling with Diffusion Language Models via Reward-Guided Stitching by Roy Miles, Aysim Toker, Andreea-Maria Oncescu, Songcen Xu, Jiankang Deng ✉, Ismail Elezi (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2602-22871.txt.
Description
Roy Miles and four co-authors stitch diffusion-model reasoning into stronger answers. Generating many chains of thought helps, but standard aggregation picks whole traces or votes on final answers, discarding useful steps from partial or nearly correct attempts. Stitching Noisy Diffusion Thoughts instead pools step-level candidates.
For each problem, the method samples many cheap, diverse reasoning paths from a masked diffusion language model. It scores every intermediate step with an off-the-shelf process reward model, and stitches the best steps across paths into one composite rationale. Only the final answer is then recomputed. Across math reasoning benchmarks, step-level recombination helps most on hard problems. It lifts average accuracy by up to about twenty-four percent across six math and coding tasks, with latency nearly halved against diffusion and unified rivals.
Catalog record
| CREATOR | Roy Miles, Aysim Toker, Andreea-Maria Oncescu, Songcen Xu, Jiankang Deng ✉, Ismail Elezi |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 46 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2602-22871