Manifold-Aware Exploration for Reinforcement Learning in Video Generation

Mingzhe Zheng, Weijie Kong, Yue Wu, Dengyang Jiang, Yue Ma, Xuanhua He, Bin Lin, Kaixiong Gong, Zhao Zhong, Liefeng Bo, Qifeng Chen, Harry Yang · 2026

Read Manifold-Aware Exploration for Reinforcement Learning in Video Generation by Mingzhe Zheng, Weijie Kong, Yue Wu, Dengyang Jiang, Yue Ma, Xuanhua He, Bin Lin, Kaixiong Gong, Zhao Zhong, Liefeng Bo, Qifeng Chen, Harry Yang (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-21872.txt.

Description

Zheng and co-authors stabilize reinforcement learning for video generation by keeping exploration near the model's data manifold. Flow-based GRPO methods wander when a math conversion step injects extra noise into rollouts. Poor rollouts then poison the reward signal. Their SAGE-GRPO adds guards at two scales. A corrected sampling equation and a gradient norm equalizer steady each step. A dual trust region with a moving anchor curbs drift over long training. On HunyuanVideo1.5, the method beat prior approaches on reward scores and on visual quality measures alike.

Catalog record

CREATORMingzhe Zheng, Weijie Kong, Yue Wu, Dengyang Jiang, Yue Ma, Xuanhua He, Bin Lin, Kaixiong Gong, Zhao Zhong, Liefeng Bo, Qifeng Chen, Harry Yang
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE50829
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2603.21872

Browse the full library · About the Tower of Babel