Reparameterization Flow Policy Optimization

Hai Zhong, Zhuoran Li, Xun Wang, Longbo Huang · 2026

Read Reparameterization Flow Policy Optimization by Hai Zhong, Zhuoran Li, Xun Wang, Longbo Huang (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2602-03501.txt.

Description

Model-based reinforcement learning can learn from few trials by differentiating through a simulation of the world. Hai Zhong and 3 co-authors widen the policies that method can use in a 2026 paper. Earlier reparameterization policy gradient work mostly allowed Gaussian policies, which limits their expressive range and ignores modern generative models.

The authors observe that flow policies, which produce actions by integrating a differential equation, fit the framework naturally. Their method, RFO, backpropagates jointly through action generation and system dynamics, avoiding hard likelihood math. Two penalty terms add steadiness and exploration, and a variant chunks actions together. Across locomotion and manipulation tasks, including a soft-body quadruped, RFO nearly doubles the best baseline's reward.

Catalog record

CREATORHai Zhong, Zhuoran Li, Xun Wang, Longbo Huang
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE41 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2602-03501

Browse the full library · About the Tower of Babel