Divide and Conquer: Accelerating Diffusion-Based Large Language Models via Adaptive Parallel Decoding

Xiangzhong Luo, Yilin An, Zhicheng Yu, Weichen Liu, Xu Yang · 2026

Read Divide and Conquer: Accelerating Diffusion-Based Large Language Models via Adaptive Parallel Decoding by Xiangzhong Luo, Yilin An, Zhicheng Yu, Weichen Liu, Xu Yang (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2602-23792.txt.

Description

Xiangzhong Luo and four co-authors present DiCo, a faster decoding method for diffusion-based language models. The 2026 paper notes that such models can in theory emit many tokens at once, yet in practice they still emit one at a time. Decoding many masked tokens together harms quality and stability.

DiCo splits the work into three phases. First it picks seed tokens among the masked positions and grows local clusters around them. Then it decodes clusters in parallel, repeating the split-and-decode loop until convergence. Finally it decodes the few tokens left with a fine-grained compound scheme. Tests show large speed gains while keeping generation quality competitive with slower baselines, closing much of the gap between theory and practice.

Catalog record

CREATORXiangzhong Luo, Yilin An, Zhicheng Yu, Weichen Liu, Xu Yang
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE42 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2602-23792

Browse the full library · About the Tower of Babel