Efficient Reinforcement Finetuning via Adaptive Curriculum Learning

Taiwei Shi [email protected] · 2025

Read Efficient Reinforcement Finetuning via Adaptive Curriculum Learning by Taiwei Shi [email protected] (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2504-05520.txt.

Description

Taiwei Shi, Yiyang Wu, Linxin Song, Tianyi Zhou, and Jieyu Zhao make the final training stage of language models cheaper. In that stage the model practices math problems and learns from rewards, but grinding through problems that are far too easy or hopelessly hard wastes enormous computing time.

Their method watches the model's recent rewards and adjusts the difficulty of the practice set on the fly, keeping problems in the sweet spot: hard, but within reach. The change is a light add-on that needs no new reward design and no change to the model itself. On contest-level math sets it cut training time by as much as half while also lifting the model's final reasoning skill.

Catalog record

CREATORTaiwei Shi [email protected]
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE71 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2504-05520

Browse the full library · About the Tower of Babel