Training Reasoning Models on Saturated Problems via Failure-Prefix Conditioning

Minwu Kim, Safal Shrestha, Keith Ross · 2026

Read Training Reasoning Models on Saturated Problems via Failure-Prefix Conditioning by Minwu Kim, Safal Shrestha, Keith Ross (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2601-20829.txt.

Description

Minwu Kim, Safal Shrestha, and Keith Ross tackle a stall in training reasoning models. Their 2026 paper studies reinforcement learning with verifiable rewards. That method has greatly improved the reasoning of large language models. But training stalls once problems become saturated. Saturated problems are ones the model now almost always solves. They stop teaching it anything new.

The authors name the core issue: informative failures are hard to reach. The learning signal lives in failed attempts, yet standard rollouts rarely produce them. Their fix is failure-prefix conditioning. Training starts the model from the front part of a failed attempt. From there, useful failures become common again. The method aims to keep hard training sets useful for longer.

Catalog record

CREATORMinwu Kim, Safal Shrestha, Keith Ross
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE43 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2601-20829

Browse the full library · About the Tower of Babel