Training Reasoning Models on Saturated Problems via Failure-Prefix Conditioning
Minwu Kim, Safal Shrestha, Keith Ross · 2026
Read Training Reasoning Models on Saturated Problems via Failure-Prefix Conditioning by Minwu Kim, Safal Shrestha, Keith Ross (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2601-20829.txt.
Description
Minwu Kim, Safal Shrestha, and Keith Ross tackle a stall in training reasoning models. Their 2026 paper studies reinforcement learning with verifiable rewards. That method has greatly improved the reasoning of large language models. But training stalls once problems become saturated. Saturated problems are ones the model now almost always solves. They stop teaching it anything new.
The authors name the core issue: informative failures are hard to reach. The learning signal lives in failed attempts, yet standard rollouts rarely produce them. Their fix is failure-prefix conditioning. Training starts the model from the front part of a failed attempt. From there, useful failures become common again. The method aims to keep hard training sets useful for longer.
Catalog record
| CREATOR | Minwu Kim, Safal Shrestha, Keith Ross |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 43 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2601-20829