Lookahead Unmasking Elicits Accurate Decoding in Diffusion Language Models
Sanghyun Lee, Seungryong Kim, Jongho Park, Dongmin Park · 2025
Read Lookahead Unmasking Elicits Accurate Decoding in Diffusion Language Models by Sanghyun Lee, Seungryong Kim, Jongho Park, Dongmin Park (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2511-05563.txt.
Introduction
Sanghyun Lee, Seungryong Kim, Jongho Park, and Dongmin Park improve how diffusion language models choose the order in which they reveal words. These models start from masked text and uncover tokens step by step. Common rules pick the most confident token next, a greedy habit that can lock in early mistakes.
Their method, Lookahead Unmasking, treats decoding as picking a full path rather than single steps. It proposes several unmasking orders, scores each by its uncertainty, and keeps the safest paths. Only two or three paths were needed for peak scores. Across six benchmarks in math, planning, and coding, the method lifted results for two versions of the LLaDA model.
Catalog record
| CREATOR | Sanghyun Lee, Seungryong Kim, Jongho Park, Dongmin Park |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 43 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2511-05563
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Lookahead Unmasking Elicits Accurate Decoding in Diffusion Language Models Sanghyun Lee, Seungryong Kim, Jongho Park, Dongmin Park Abstract Masked Diffusion Models (MDMs) as language models generate by iteratively unmasking tokens, yet their performance crucially depends on the inference-time order of unmasking. Conventional methods such as confidence-based sampling are short-sighted, focusing on local optimization while neglecting additional test-time computation and allowing early decoding errors to cascade. We propose Lookahead Unmasking (LookUM) , which addresses these concerns by reformulating sampling as path selection over all possible unmasking orders without the need for an external reward model. Our framework couples (i) a path generator that proposes paths by sampling from pools of unmasking sets with (ii) a verifier that computes the uncertainty of the proposed paths and performs importance sampling to subsequently select the final paths. Empirically, erroneous unmasking measurably inflates sequence-level uncertainty, and our method exploits this to avoid error-prone trajectories. We validate our framework across six benchmarks, such as mathematics, planning, and coding, and demonstrate consistent performance improvements. LookUM requires only two to three paths to achieve peak performance, demonstrating remarkably efficient path selection. The consistent improvements on both LLaDA and post-trained LLaDA 1.5 are particularly striking: base LLaDA with LookUM rivals the performance of RL-tuned LLaDA 1.5, while LookUM further enhances LLaDA 1.5 itself—showing that uncertainty-based verification provides orthogonal benefits to reinforcement learning and underscoring the versatility of our framework. 1 Introduction Following the remarkable success of diffusion models in continuous domains such as image and video ( Song et al. 2020 ; Rombach et al. 2022 ; Ho et al. 2022 ) , diffusion language models (DLMs) have recently emerged as a promising and efficient alternative to autoregressive language models (ARMs) for discrete sequence generation ( Austin et al. 2021a ; Sahoo et al. 2024 ; Lou et al. 2023 ) . Notably, state-of-the-art DLMs, including LLaDA ( Nie et al. 2025 ) and Dream ( Ye et al. 2025 ) , adopt the form of masked diffusion models (MDMs), where generation proceeds through iterative unmasking over sequences of masked tokens. Recent advances have further enhanced these models through reinforcement learning-based fine-tuning, as demonstrated in LLaDA 1.5 ( Zhu et al. 2025 ) and d1 ( Zhao et al. 2025 ) , which employ reward-based optimization to improve reasoning capabilities. The primary distinction between ARMs and DLMs lies in the order of token unmasking. Unlike ARMs, DLMs possess the flexibility to arbitrarily select the positions of tokens to be unmasked, in addition to predicting token values. For instance, in tasks such as planning ( Ye et al. 2024 ) and infilling ( Gong et al. 2024 ) , where bidirectional rather than left-to-right unmasking is expected to be advantageous, DLMs demonstrate clear superiority over ARMs. This highlights that the order of unmasking is not merely an architectural detail but a critical factor in achieving strong performance. Figure 1: Standard unmasking vs. LookUM in discrete diffusion models. During the denoising process of unmasking from timestep T to 0 , greedy approaches often select the position with the highest token-level certainty which can lead to an incorrect unmasking order and result in local errors ( red ). In contrast LookUM generates candidate unmasking paths and leverages a verifier to select those that avoid local errors and recover the correct sequence ( blue ). Existing approaches to unmasking predominantly adopt heuristic strategies that rely on token-level model predictions to compute certainty measures (e.g., negative entropy, confidence, margin), which are then used to greedily select the next position to unmask ( Chang et al. 2022 ; Huang et al. 2025 ; Kim et al. 2025 ; Koh et al. 2024 ; Ben-Hamu et al. 2025 ) . Though lightweight and simple, these methods inherently reflect confidence in local token distributions rather than capturing sequence-level dependencies that govern the overall unmasking trajectory. As a result, they often disregard global consistency and are prone to irreversible local errors. As illustrated in Figure 1 , a single incorrect unmasking decision (e.g., prematurely revealing a digit in arithmetic) can cascade through subsequent steps, making recovery impossible. We empirically observe in our experiments in Section 3.1 . These limitations highlight the need for unmasking strategies that can identify potential local errors and steer the unmasking process toward paths that avoid them. To this end, we propose a framework that reformulates sampling as a path selection problem in the space of possible unmasking orders, where a verifier directs the process by detecting local errors and steering it toward more reliable paths. Building on this framework, we develop Lookahead Unmasking (LookUM) , which operates in a fully unsupervised manner by leveraging a certainty measure over sequences as a verifier. Our method achieves reliable error avoidance with only a 2-3× computational cost. It evaluates candidate paths through a verifier and selects those that best preserve sequence-level coherence. In reasoning benchmarks, LookUM consistently outperforms greedy unmasking, improving performance by up to 4 points on HumanEval and GSM8K, and 8 points on MBPP. Consistent gains in both LLaDA and its RL-tuned variant LLaDA 1.5 demonstrate that our method provides complementary benefits to the model training pipeline. Overall, our contributions can be summarized as: • We reformulate unmasking as path selection and introduce LookUM, which uses sequence-level uncertainty to guide generation. • LookUM reduces local error rates by 10\% and improves accuracy by 4-8 points on reasoning benchmarks with only 2-3× overhead. • The method requires no external models and complements both base training and RL optimization, as shown on LLaDA 1.5. 2 Background Masked Diffusion Language Models. A widely adopted family of discrete diffusion models for language is the masked diffusion framework ( Austin et al. 2021a ; Lou et al. 2023 ; Sahoo et al. 2024 ) , which reconstructs a text sequence from fully masked tokens. The process is formulated over timesteps t\in[0,T] , comprising (1) a forward noising process that transforms a token sequence x_{0} into masked tokens, and (2) a reverse denoising process that reconstructs the sequence from the masked token x_{T} . Formally, let \theta denote a DLM operating on sequences of length L . At each timestep t , the model handles x_{t}=(x_{t}^{1},x_{t}^{2},\ldots,x_{t}^{L}) , where each token x_{t}^{i} belongs to a vocabulary \mathcal{V}=\{1,2,\ldots,m\} , with the special symbol m indicating the mask token. During denoising, the model sequentially determines the order of token unmasking. Decoding process. The decoding progresses through iterative denoising steps, gradually converting the fully masked sequence x_{T} into a complete text sequence x_{0} . For each denoising step t , let \mathcal{M}_{t}:=\{i\in\{1,\ldots,L\}\;:\;x_{t}^{i}=m\} be a masked index set and p_{\theta}^{i}(\cdot\mid x_{t}) be a predicted categorical distribution over \mathcal{V} for each position i . Then, the objective of unmasking is to select b_{t} indices to unmask from the currently masked positions i\in\mathcal{M}_{t} , based on p^{i}_{\theta}(\cdot\mid x_{t}) . That is, unmasking index set \mathcal{U}_{t} is selected and used to update the next masked index set, such as \mathcal{M}_{t-1}=\mathcal{M}_{t}\setminus\mathcal{U}_{t} . In principle, token selection could be random, but the lack of explicit training constraints on the transition dynamics of the denoising process often leads to degraded performance ( Ben-Hamu et al. 2025 ) . Therefore, practical implementations employ greedy unmasking strategies, which consistently outperform random unmasking. Formally,