AdaBlock-dLLM : Semantic-Aware Diffusion LLM Inference via Adaptive Block Size

Guanxi Lu, Hao (Mark) Chen, Yuto Karashima, Zhican Wang, Daichi Fujiki, Hongxiang Fan · 2025

Read AdaBlock-dLLM : Semantic-Aware Diffusion LLM Inference via Adaptive Block Size by Guanxi Lu, Hao (Mark) Chen, Yuto Karashima, Zhican Wang, Daichi Fujiki, Hongxiang Fan (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2509-26432.txt.

Description

Guanxi Lu and five co-authors speed up a new kind of language model that writes by diffusion, in a 2025 arXiv paper. Such models unmask text block by block, which lets them use fast caching tricks. But a fixed block size cuts both ways: sure tokens past the block wait needlessly, while shaky tokens inside it get locked in too soon. The team studies the model's confidence swings as it cleans text.

They find a volatility band, a stretch where confidence wobbles and meaning takes shape. Their scheduler, AdaBlock-dLLM, needs no training and plugs into existing setups. It stretches or shrinks each block to match those meaning steps. Across test sets it gained up to about five percent in accuracy at the same speed.

Catalog record

CREATORGuanxi Lu, Hao (Mark) Chen, Yuto Karashima, Zhican Wang, Daichi Fujiki, Hongxiang Fan
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE24 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2509-26432

Browse the full library · About the Tower of Babel