Learning from Failures: Correction-Oriented Policy Optimization with Verifiable Rewards

Mengjie Ren, Jie Lou, Boxi Cao, Xueru Wen, Hongyu Lin, Xianpei Han, Le Sun, Xing Yu, Yaojie Lu · 2026

Read Learning from Failures: Correction-Oriented Policy Optimization with Verifiable Rewards by Mengjie Ren, Jie Lou, Boxi Cao, Xueru Wen, Hongyu Lin, Xianpei Han, Le Sun, Xing Yu, Yaojie Lu (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-14539.txt.

Description

Ren, Lou, Cao, Wen, Lin, Han, Sun, Yu and Lu turn a language model's own failed reasoning attempts into training signal. Their Correction-Oriented Policy Optimization adds correction samples drawn from failed trajectories to reinforcement learning with verifiable rewards, aiming to sharpen credit assignment where binary rewards are sparse. Across eleven mathematics and coding benchmarks, the method is claimed to beat strong baselines on reasoning and self-correction.

Catalog record

CREATORMengjie Ren, Jie Lou, Boxi Cao, Xueru Wen, Hongyu Lin, Xianpei Han, Le Sun, Xing Yu, Yaojie Lu
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE40239
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2605.14539

Browse the full library · About the Tower of Babel