Posterior Optimization with Clipped Objective for Bridging Efficiency and Stability in Generative Policy Learning

Yuhui Chen, Haoran Li, Zhennan Jiang, Yuxing Qin, Yuxuan Wan, Weiheng Liu, Dongbin Zhao · 2026

Read Posterior Optimization with Clipped Objective for Bridging Efficiency and Stability in Generative Policy Learning by Yuhui Chen, Haoran Li, Zhennan Jiang, Yuxing Qin, Yuxuan Wan, Weiheng Liu, Dongbin Zhao (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-01860.txt.

Description

Chen and co-authors present Posterior Optimization with Clipped Objective, a reinforcement learning system for robots. Rich models capture action patterns, but fine-tuning wobbles and wastes samples. POCO treats policy gains as posterior guesses for action chunks, turning a reward-weighted posterior into the policy through Expectation-Maximization. Offline-to-online learning anchors search to pre-trained priors, and the design scales to large vision-language-action models as-is. Across 7 sims and 4 real-world tasks, POCO prevents policy collapse, beats rivals, and reaches a 96.7 percent success rate.

Catalog record

CREATORYuhui Chen, Haoran Li, Zhennan Jiang, Yuxing Qin, Yuxuan Wan, Weiheng Liu, Dongbin Zhao
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE68322
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2604.01860

Browse the full library · About the Tower of Babel