Taming Masked Diffusion Language Models via Consistency Trajectory Reinforcement Learning with Fewer Decoding Step

Jingyi Yang, Guanxu Chen, Xuhao Hu, Jing Shao · 2025

Read Taming Masked Diffusion Language Models via Consistency Trajectory Reinforcement Learning with Fewer Decoding Step by Jingyi Yang, Guanxu Chen, Xuhao Hu, Jing Shao (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2509-23924.txt.

Description

Masked diffusion language models generate in parallel, but training tricks borrowed from left-to-right models fit them badly. Jingyi Yang and 3 co-authors ask whether that naive transfer is ever optimal, and propose fixes on both decoding and learning. Their EOS Early Rejection and Ascending Step-Size scheduler let full diffusion-style decoding compete with block-wise schemes in fewer steps. A new reinforcement learning method keeps rollout and optimization trajectories consistent.

Tests on math and planning benchmarks use the LLaDA-8B-Instruct model. The combined recipe tames the models effectively, the authors report. They argue masked diffusion needs its own training discipline rather than borrowed habits.

Catalog record

CREATORJingyi Yang, Guanxu Chen, Xuhao Hu, Jing Shao
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE52 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2509-23924

Browse the full library · About the Tower of Babel