Manifold-Aware Exploration for Reinforcement Learning in Video Generation
Mingzhe Zheng, Weijie Kong, Yue Wu, Dengyang Jiang, Yue Ma, Xuanhua He, Bin Lin, Kaixiong Gong, Zhao Zhong, Liefeng Bo, Qifeng Chen, Harry Yang · 2026
Read Manifold-Aware Exploration for Reinforcement Learning in Video Generation by Mingzhe Zheng, Weijie Kong, Yue Wu, Dengyang Jiang, Yue Ma, Xuanhua He, Bin Lin, Kaixiong Gong, Zhao Zhong, Liefeng Bo, Qifeng Chen, Harry Yang (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-21872.txt.
Description
Zheng and co-authors stabilize reinforcement learning for video generation by keeping exploration near the model's data manifold. Flow-based GRPO methods wander when a math conversion step injects extra noise into rollouts. Poor rollouts then poison the reward signal. Their SAGE-GRPO adds guards at two scales. A corrected sampling equation and a gradient norm equalizer steady each step. A dual trust region with a moving anchor curbs drift over long training. On HunyuanVideo1.5, the method beat prior approaches on reward scores and on visual quality measures alike.
Catalog record
| CREATOR | Mingzhe Zheng, Weijie Kong, Yue Wu, Dengyang Jiang, Yue Ma, Xuanhua He, Bin Lin, Kaixiong Gong, Zhao Zhong, Liefeng Bo, Qifeng Chen, Harry Yang |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 50829 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2603.21872