Posterior Optimization with Clipped Objective for Bridging Efficiency and Stability in Generative Policy Learning
Yuhui Chen, Haoran Li, Zhennan Jiang, Yuxing Qin, Yuxuan Wan, Weiheng Liu, Dongbin Zhao · 2026
Read Posterior Optimization with Clipped Objective for Bridging Efficiency and Stability in Generative Policy Learning by Yuhui Chen, Haoran Li, Zhennan Jiang, Yuxing Qin, Yuxuan Wan, Weiheng Liu, Dongbin Zhao (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-01860.txt.
Description
Chen and co-authors present Posterior Optimization with Clipped Objective, a reinforcement learning system for robots. Rich models capture action patterns, but fine-tuning wobbles and wastes samples. POCO treats policy gains as posterior guesses for action chunks, turning a reward-weighted posterior into the policy through Expectation-Maximization. Offline-to-online learning anchors search to pre-trained priors, and the design scales to large vision-language-action models as-is. Across 7 sims and 4 real-world tasks, POCO prevents policy collapse, beats rivals, and reaches a 96.7 percent success rate.
Catalog record
| CREATOR | Yuhui Chen, Haoran Li, Zhennan Jiang, Yuxing Qin, Yuxuan Wan, Weiheng Liu, Dongbin Zhao |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 68322 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2604.01860