AdaBlock-dLLM : Semantic-Aware Diffusion LLM Inference via Adaptive Block Size
Guanxi Lu, Hao (Mark) Chen, Yuto Karashima, Zhican Wang, Daichi Fujiki, Hongxiang Fan · 2025
Read AdaBlock-dLLM : Semantic-Aware Diffusion LLM Inference via Adaptive Block Size by Guanxi Lu, Hao (Mark) Chen, Yuto Karashima, Zhican Wang, Daichi Fujiki, Hongxiang Fan (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2509-26432.txt.
Description
Guanxi Lu and five co-authors speed up a new kind of language model that writes by diffusion, in a 2025 arXiv paper. Such models unmask text block by block, which lets them use fast caching tricks. But a fixed block size cuts both ways: sure tokens past the block wait needlessly, while shaky tokens inside it get locked in too soon. The team studies the model's confidence swings as it cleans text.
They find a volatility band, a stretch where confidence wobbles and meaning takes shape. Their scheduler, AdaBlock-dLLM, needs no training and plugs into existing setups. It stretches or shrinks each block to match those meaning steps. Across test sets it gained up to about five percent in accuracy at the same speed.
Catalog record
| CREATOR | Guanxi Lu, Hao (Mark) Chen, Yuto Karashima, Zhican Wang, Daichi Fujiki, Hongxiang Fan |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 24 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2509-26432