Online Difficulty Filtering for Reasoning Oriented Reinforcement Learning

Sanghwan Bae Jiwoo Hong Min Young Lee Hanbyul Kim JeongYeon Nam, Donghyun Kwak, NAVER Cloud KAIST AI TwelveLabs · 2025

Read Online Difficulty Filtering for Reasoning Oriented Reinforcement Learning by Sanghwan Bae Jiwoo Hong Min Young Lee Hanbyul Kim JeongYeon Nam, Donghyun Kwak, NAVER Cloud KAIST AI TwelveLabs (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2504-03380.txt.

Description

Sanghwan Bae and five co-authors study how to pick training tasks when teaching language models to reason, in this 2025 paper. The catalog creator carries stray affiliation text, but the head gives the clean byline. In this training style, models earn rewards only for answers that can be checked, so rewards are sparse and task choice matters a lot.

The team proves that expected learning gains are bounded below by how much success rates vary across tasks. Tasks of middle difficulty, where the model sometimes wins, teach the most. A balanced filter that keeps such tasks therefore lifts the bound. Tests on math reasoning benchmarks matched the math: balanced filtering sped training and raised final scores by up to twelve percent, in under half the usual steps. The authors offer the result as a base for future curricula.

Catalog record

CREATORSanghwan Bae Jiwoo Hong Min Young Lee Hanbyul Kim JeongYeon Nam, Donghyun Kwak, NAVER Cloud KAIST AI TwelveLabs
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE55 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2504-03380

Browse the full library · About the Tower of Babel