Beyond Mode Elicitation: Diversity-Preserving Reinforcement Learning via Latent Diffusion Reasoner

Haoqiang Kang, Yizhe Zhang, Nikki Lijing Kuang, Yi-An Ma, Lianhui Qin · 2026

Read Beyond Mode Elicitation: Diversity-Preserving Reinforcement Learning via Latent Diffusion Reasoner by Haoqiang Kang, Yizhe Zhang, Nikki Lijing Kuang, Yi-An Ma, Lianhui Qin (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2602-01705.txt.

Description

Haoqiang Kang and colleagues move reinforcement learning for model reasoning from token sequences into latent space. Token level optimization mismatches reasoning, since choices are semantic and trajectory wide, not local token picks. Their LaDi-RL generates latent trajectories by denoising. A rollout entangles latent quality with decoding quality, since rewards arrive after decoding into text. Layered rollouts sample completions per latent trajectory and aggregate rewards, giving a cleaner signal for the policy. It beats token level RL by about nine percent on code generation and about six percent on math.

Catalog record

CREATORHaoqiang Kang, Yizhe Zhang, Nikki Lijing Kuang, Yi-An Ma, Lianhui Qin
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE85818
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2602.01705

Browse the full library · About the Tower of Babel