Euphonium: Steering Video Flow Matching via Process Reward Gradient Guided Stochastic Dynamics

Ruizhe Zhong, Jiesong Lian, Xiaoyue Mi, Zixiang Zhou, Yuan Zhou, Qinglin Lu, Junchi Yan · 2026

Read Euphonium: Steering Video Flow Matching via Process Reward Gradient Guided Stochastic Dynamics by Ruizhe Zhong, Jiesong Lian, Xiaoyue Mi, Zixiang Zhou, Yuan Zhou, Qinglin Lu, Junchi Yan (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2602-04928.txt.

Description

Online reinforcement learning is a common way to align video generators with human taste, but its training rollouts wander at random and its rewards arrive only at the end. The work is by Ruizhe Zhong and 6 co-authors.

Their framework, Euphonium, steers each sampling step with the gradient of a process reward model, a scorer that judges partial progress, not just finished videos. They write the sampling as a stochastic differential equation, show older methods are special cases, and then distill the guidance into the network so no scorer is needed at run time. Training pairs step-level rewards for credit assignment with pixel-level rewards for final quality. Experiments show better alignment with human preference and training that converges about 1.66 times faster.

Catalog record

CREATORRuizhe Zhong, Jiesong Lian, Xiaoyue Mi, Zixiang Zhou, Yuan Zhou, Qinglin Lu, Junchi Yan
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE61 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2602-04928

Browse the full library · About the Tower of Babel