Learning from Failures: Correction-Oriented Policy Optimization with Verifiable Rewards
Mengjie Ren, Jie Lou, Boxi Cao, Xueru Wen, Hongyu Lin, Xianpei Han, Le Sun, Xing Yu, Yaojie Lu · 2026
Read Learning from Failures: Correction-Oriented Policy Optimization with Verifiable Rewards by Mengjie Ren, Jie Lou, Boxi Cao, Xueru Wen, Hongyu Lin, Xianpei Han, Le Sun, Xing Yu, Yaojie Lu (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-14539.txt.
Description
Ren, Lou, Cao, Wen, Lin, Han, Sun, Yu and Lu turn a language model's own failed reasoning attempts into training signal. Their Correction-Oriented Policy Optimization adds correction samples drawn from failed trajectories to reinforcement learning with verifiable rewards, aiming to sharpen credit assignment where binary rewards are sparse. Across eleven mathematics and coding benchmarks, the method is claimed to beat strong baselines on reasoning and self-correction.
Catalog record
| CREATOR | Mengjie Ren, Jie Lou, Boxi Cao, Xueru Wen, Hongyu Lin, Xianpei Han, Le Sun, Xing Yu, Yaojie Lu |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 40239 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2605.14539