Online Difficulty Filtering for Reasoning Oriented Reinforcement Learning
Sanghwan Bae Jiwoo Hong Min Young Lee Hanbyul Kim JeongYeon Nam, Donghyun Kwak, NAVER Cloud KAIST AI TwelveLabs · 2025
Read Online Difficulty Filtering for Reasoning Oriented Reinforcement Learning by Sanghwan Bae Jiwoo Hong Min Young Lee Hanbyul Kim JeongYeon Nam, Donghyun Kwak, NAVER Cloud KAIST AI TwelveLabs (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2504-03380.txt.
Description
Sanghwan Bae and five co-authors study how to pick training tasks when teaching language models to reason, in this 2025 paper. The catalog creator carries stray affiliation text, but the head gives the clean byline. In this training style, models earn rewards only for answers that can be checked, so rewards are sparse and task choice matters a lot.
The team proves that expected learning gains are bounded below by how much success rates vary across tasks. Tasks of middle difficulty, where the model sometimes wins, teach the most. A balanced filter that keeps such tasks therefore lifts the bound. Tests on math reasoning benchmarks matched the math: balanced filtering sped training and raised final scores by up to twelve percent, in under half the usual steps. The authors offer the result as a base for future curricula.
Catalog record
| CREATOR | Sanghwan Bae Jiwoo Hong Min Young Lee Hanbyul Kim JeongYeon Nam, Donghyun Kwak, NAVER Cloud KAIST AI TwelveLabs |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 55 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2504-03380