Divide and Conquer: Accelerating Diffusion-Based Large Language Models via Adaptive Parallel Decoding
Xiangzhong Luo, Yilin An, Zhicheng Yu, Weichen Liu, Xu Yang · 2026
Read Divide and Conquer: Accelerating Diffusion-Based Large Language Models via Adaptive Parallel Decoding by Xiangzhong Luo, Yilin An, Zhicheng Yu, Weichen Liu, Xu Yang (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2602-23792.txt.
Description
Xiangzhong Luo and four co-authors present DiCo, a faster decoding method for diffusion-based language models. The 2026 paper notes that such models can in theory emit many tokens at once, yet in practice they still emit one at a time. Decoding many masked tokens together harms quality and stability.
DiCo splits the work into three phases. First it picks seed tokens among the masked positions and grows local clusters around them. Then it decodes clusters in parallel, repeating the split-and-decode loop until convergence. Finally it decodes the few tokens left with a fine-grained compound scheme. Tests show large speed gains while keeping generation quality competitive with slower baselines, closing much of the gap between theory and practice.
Catalog record
| CREATOR | Xiangzhong Luo, Yilin An, Zhicheng Yu, Weichen Liu, Xu Yang |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 42 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2602-23792