Learn from Your Mistakes: Self-Correcting Masked Diffusion Models
Yair Schiff 1 {}^{\text{~1}}, Omer Belhasin 2 {}^{\text{~2}}, Roy Uziel 2 {}^{\text{~2}}, Guanghan Wang 1 {}^{\text{~1}}, Marianne Arriola 1 {}^{\text{~1}}, Gilad Turok 1 {}^{\text{~1}}, Michael Elad 2 {}^{\text{~2}}, Volodymyr Kuleshov 1 {}^{\text{~1}}, 1 {}^{\text{1}} Cornell, 2 {}^{\text{2}} NVID · 2026
Read Learn from Your Mistakes: Self-Correcting Masked Diffusion Models by Yair Schiff 1 {}^{\text{~1}}, Omer Belhasin 2 {}^{\text{~2}}, Roy Uziel 2 {}^{\text{~2}}, Guanghan Wang 1 {}^{\text{~1}}, Marianne Arriola 1 {}^{\text{~1}}, Gilad Turok 1 {}^{\text{~1}}, Michael Elad 2 {}^{\text{~2}}, Volodymyr Kuleshov 1 {}^{\text{~1}}, 1 {}^{\text{1}} Cornell, 2 {}^{\text{2}} NVID (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2602-11590.txt.
Introduction
Masked diffusion models can generate tokens in parallel, but they suffer a one-way flaw: once a token is unmasked, it stays fixed, so early errors pile up and drag quality down. Yair Schiff and eight co-authors teach a model to do both jobs, unmasking and correcting, by reusing the denoiser output as training input for a corrector. During generation, extra refinement steps sit between unmasking steps so decoded tokens can still change.
The method, named Progressive Self-Correction, is tested across conditional and unconditional tasks. It reaches better quality-for-speed trade-offs, sampling up to about four times faster while still beating the best accuracy baseline, and it gains further from extra compute at inference time. Letting a model fix its own mistakes, the authors show, beats locking in every early guess.
Catalog record
| CREATOR | Yair Schiff 1 {}^{\text{~1}}, Omer Belhasin 2 {}^{\text{~2}}, Roy Uziel 2 {}^{\text{~2}}, Guanghan Wang 1 {}^{\text{~1}}, Marianne Arriola 1 {}^{\text{~1}}, Gilad Turok 1 {}^{\text{~1}}, Michael Elad 2 {}^{\text{~2}}, Volodymyr Kuleshov 1 {}^{\text{~1}}, 1 {}^{\text{1}} Cornell, 2 {}^{\text{2}} NVID |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 61 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2602-11590
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Learn from Your Mistakes: Self-Correcting Masked Diffusion Models Yair Schiff 1 {}^{\text{~1}}, Omer Belhasin 2 {}^{\text{~2}}, Roy Uziel 2 {}^{\text{~2}}, Guanghan Wang 1 {}^{\text{~1}}, Marianne Arriola 1 {}^{\text{~1}}, Gilad Turok 1 {}^{\text{~1}}, Michael Elad 2 {}^{\text{~2}}, Volodymyr Kuleshov 1 {}^{\text{~1}}, 1 {}^{\text{1}} Cornell, 2 {}^{\text{2}} NVIDIA Abstract Masked diffusion models (MDMs) have emerged as a promising alternative to autoregressive models, enabling parallel token generation while achieving competitive performance. Despite these advantages, MDMs face a fundamental limitation: once tokens are unmasked, they remain fixed, leading to error accumulation and ultimately degrading sample quality. We address this by proposing a framework that trains a model to perform both unmasking and correction. By reusing outputs from the MDM denoising network as inputs for corrector training, we train a model to recover from potential mistakes. During generation we apply additional corrective refinement steps between unmasking ones in order to change decoded tokens and improve outputs. We name our training and sampling method 𝒫 𝓇 ℴ \mathpzc{Pro} gressive 𝒮 ℯ \mathpzc{Se} lf- 𝒞 ℴ \mathpzc{Co} rrection ( 𝒫 𝓇 ℴ 𝒮 ℯ 𝒞 ℴ \mathpzc{ProSeCo} ) for its unique ability to iteratively refine an entire sequence, including already generated tokens. We conduct extensive experimental validation across multiple conditional and unconditional tasks, demonstrating that 𝒫 𝓇 ℴ 𝒮 ℯ 𝒞 ℴ \mathpzc{ProSeCo} yields better quality-efficiency trade-offs (up to ∼ \sim 2-3 x \mathrm{x} faster sampling) and enables inference-time compute scaling to further increase sample quality beyond standard MDMs (up to ∼ \sim 1.3 x \mathrm{x} improvement on benchmarks). † † affiliationnotice: Equal contribution \icmlEqualSenior Figure 1 : ( Left ) Overview of training \mathpzc{ProSeCo} : The original process trains the model to generate via unmasking. For every timestep in the masking process, we train the model to undo corruptions that can arise from sampling from the model’s unmasking predictions, thereby training for self-correction. (Right) Using our method to supervised fine-tune (SFT) the 8B parameter LLaDA model ( 35 ) significantly outperforms SFT with vanilla masked diffusion modeling. 1 Introduction Masked diffusion models (MDMs) have emerged as a powerful paradigm for discrete data generation, offering a compelling alternative to standard autoregressive (AR) models ( 34 ; 36 ; 45 ; 50 ) . By treating generation as a denoising process that gradually unmasks tokens in parallel, MDMs can achieve efficiency gains and maintain sample quality across various domains, including natural language processing and molecular design ( 48 ) , and have even demonstrated competitive performance from the 8B scale ( 35 ) up to 100B parameters ( 6 ) . However, a fundamental limitation persists for MDMs: once a token is unmasked, it remains fixed for the duration of the generation process. Consequently, errors made during parallel decoding inevitably accumulate, leading to distributional drift and degraded sample quality. While recent work has begun to explore error correction for MDMs ( 30 ; 67 ; 57 ; 21 ; 23 ; 32 ) , efficiently identifying which tokens require modification and altering them remains a significant challenge. In this work, we address this limitation by proposing a principled framework that equips MDMs with the inherent ability to both decode and correct. Our key insight is to treat model-generated outputs as corrupted versions of the true data, where errors represent a form of noise that can be undone through a nested corrector loop. Our method therefore trains a model to recover the clean signal from its own potentially mistaken outputs, enabling it to learn from and correct its own failure modes. We implement this training via a simple additional cross-entropy loss term added to standard MDM objectives. During inference, we leverage this capability by interleaving corrective steps in between standard unmasking steps, allowing the model to dynamically refine and “self-correct” outputs. The training and inference modifications we make to existing MDM algorithms are minimal, yet lead to marked gains. We name our approach \mathpzc{Pro} gressive \mathpzc{Se} lf- \mathpzc{Co} rrection ( \mathpzc{ProSeCo} ), since our method has the ability to iteratively refine all positions in a sequence, including ones already unmasked. On math and coding benchmarks, our method significantly improves standard fine-tuning of large MDMs, enabling \sim 2-3 \mathrm{x} faster generation without quality degradation, and up to \sim 1.3 \mathrm{x} increase in benchmark accuracy. For guided generation, we demonstrate that recovering from mistaken tokens improves the Pareto frontier of sample quality and property maximization. Finally, we also demonstrate that for unconditional generation, our method improves over MDMs and other proposed correctors in terms of generating fluent text without collapsing the diversity of generated outputs. Across all experiments we demonstrate that \mathpzc{ProSeCo} better trades-off quality and speed, and can also benefit from inference-time scaling to further increase sample quality. In summary, our contributions are as follows: 1. We present a framework that jointly trains a model to decode masked tokens and correct mistakes. 2. We provide easy-to-implement training and sampling algorithms for our model that entail only minor additions to standard MDM procedures. 3. We conduct a comprehensive experimental study demonstrating that \mathpzc{ProSeCo} outperforms baseline discrete diffusion models in terms of quality-efficiency trade-offs and enables inference-time compute scaling to further improve quality beyond standard MDMs. Figure 2 : Demonstrating the benefits of self-correction (LLaDA baseline SFT vs. \mathpzc{ProSeCo} SFT; block AR decoding with 4 tokens generated at each step). (Left) During parallel unmasking errors occur. These mistakes accumulate, and by the 3rd block of generated text, the sample has collapsed. (Middle) \mathpzc{ProSeCo} can self-correct and recover from errors. After the first block, a short correction loop steers generation ‘back on track.’ (Right) \mathpzc{ProSeCo} ’s ability to directly alter previously decoded tokens leads to a final high quality output. (Generated sequences are trimmed for illustrative purposes; see Appendix C.1 for full details). 2 Background Discrete Diffusion Diffusion is a paradigm for generative modeling where a denoising process p_{\theta} is trained to undo a pre-defined corruption process q ( 51 ; 52 ; 53 ) . Starting from data \mathbf{x}\sim q_{\text{data}} , the corruption process produces latent variables \mathbf{z}_{t}\sim q(\mathbf{z}_{t}\mid\mathbf{x}) for t\in[0,1] , which increasingly move further from the data and towards noise, as t increases. Adapting diffusion models to discrete data requires a corruption process over the space of sequences of tokens with values in a finite vocabulary ( 2 ) . To denote this data, we let \mathbf{x},\mathbf{z}_{t}\in\mathcal{V} , where \mathcal{V}:=\{0,1\}^{V}\subset\Delta^{V} , and \Delta^{V} denotes the probability simplex over V categories. We use superscripts to denote the sequence dimension; for example, \mathbf{x}^{1:L}\in\mathcal{V}^{L} represents a sequence of tokens (\mathbf{x}^{1},\dots,\mathbf{x}^{L}) , where token \mathbf{x}^{\ell}\in\mathcal{V} , for \ell\in\{1,\dots,L\} . Masked Diffusion Models A promising instantiation of the discrete diffusion paradigm is the recent line of masked diffusion models (MDM; 34 ; 36 ; 45 ; 50 ). In this framework, the corruption process is characterized by marginals that interpolate between data and noise: \displaystyle q(\mathbf{z}_{t}\mid\mathbf{x})=\mathrm{Cat}(\mathbf{z}_{t};\alpha_{t}\mathbf{x}+(1-\alpha_{t})\bm{m}), (1) where \bm{m} denotes the one-hot vector for a special [M] token and \alpha_{t}:=\alpha(t)\in[0,1] is a noise schedule that is monotonically decreasing in t . In MDM, the corruption process is defined to be ‘absorbing,’ meaning that once a token transitions to the masked state, it remains in this state. Diffusion models are