Taming Masked Diffusion Language Models via Consistency Trajectory Reinforcement Learning with Fewer Decoding Step
Jingyi Yang, Guanxu Chen, Xuhao Hu, Jing Shao · 2025
Read Taming Masked Diffusion Language Models via Consistency Trajectory Reinforcement Learning with Fewer Decoding Step by Jingyi Yang, Guanxu Chen, Xuhao Hu, Jing Shao (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2509-23924.txt.
Description
Masked diffusion language models generate in parallel, but training tricks borrowed from left-to-right models fit them badly. Jingyi Yang and 3 co-authors ask whether that naive transfer is ever optimal, and propose fixes on both decoding and learning. Their EOS Early Rejection and Ascending Step-Size scheduler let full diffusion-style decoding compete with block-wise schemes in fewer steps. A new reinforcement learning method keeps rollout and optimization trajectories consistent.
Tests on math and planning benchmarks use the LLaDA-8B-Instruct model. The combined recipe tames the models effectively, the authors report. They argue masked diffusion needs its own training discipline rather than borrowed habits.
Catalog record
| CREATOR | Jingyi Yang, Guanxu Chen, Xuhao Hu, Jing Shao |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 52 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2509-23924