SimSD: Simple Speculative Decoding in Diffusion Language Models
Junxia Cui, Haotian Ye, Runchu Tian, Hongcan Guo, Jinya Jiang, Haoru Li, Chaojie Ren, Yiming Huang, Kaijie Zhu, Zhongkai Yu, Kun Zhou, Jingbo Shang · 2026
Read SimSD: Simple Speculative Decoding in Diffusion Language Models by Junxia Cui, Haotian Ye, Runchu Tian, Hongcan Guo, Jinya Jiang, Haoru Li, Chaojie Ren, Yiming Huang, Kaijie Zhu, Zhongkai Yu, Kun Zhou, Jingbo Shang (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2606-02544.txt.
Description
Cui and co-authors bring speculative decoding to diffusion language models. Such models generate text in parallel blocks. They are a fast alternative to autoregressive models. Standard speculative decoding does not fit them. Causal masks give valid token contexts in autoregressive models. Diffusion models use mask tokens and bidirectional attention instead. Context shifts across denoising steps, blocking direct verification.
Their method, SimSD, adds a plug-and-play masking strategy. Reference tokens come from a draft model's predictions. A designed attention mask governs how they interact with current-step tokens. The model then scores drafted tokens in a single forward pass. The method is training-free. It stacks with KV cache and blockwise decoding. Tests on SDAR-family models across four benchmarks show up to 7.46 times higher throughput. Generation quality holds or improves.
Catalog record
| CREATOR | Junxia Cui, Haotian Ye, Runchu Tian, Hongcan Guo, Jinya Jiang, Haoru Li, Chaojie Ren, Yiming Huang, Kaijie Zhu, Zhongkai Yu, Kun Zhou, Jingbo Shang |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 35 KB |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2606.02544