Beyond Mode Elicitation: Diversity-Preserving Reinforcement Learning via Latent Diffusion Reasoner
Haoqiang Kang, Yizhe Zhang, Nikki Lijing Kuang, Yi-An Ma, Lianhui Qin · 2026
Read Beyond Mode Elicitation: Diversity-Preserving Reinforcement Learning via Latent Diffusion Reasoner by Haoqiang Kang, Yizhe Zhang, Nikki Lijing Kuang, Yi-An Ma, Lianhui Qin (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2602-01705.txt.
Description
Haoqiang Kang and colleagues move reinforcement learning for model reasoning from token sequences into latent space. Token level optimization mismatches reasoning, since choices are semantic and trajectory wide, not local token picks. Their LaDi-RL generates latent trajectories by denoising. A rollout entangles latent quality with decoding quality, since rewards arrive after decoding into text. Layered rollouts sample completions per latent trajectory and aggregate rewards, giving a cleaner signal for the policy. It beats token level RL by about nine percent on code generation and about six percent on math.
Catalog record
| CREATOR | Haoqiang Kang, Yizhe Zhang, Nikki Lijing Kuang, Yi-An Ma, Lianhui Qin |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 85818 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2602.01705