Efficient Reinforcement Finetuning via Adaptive Curriculum Learning
Taiwei Shi [email protected] · 2025
Read Efficient Reinforcement Finetuning via Adaptive Curriculum Learning by Taiwei Shi [email protected] (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2504-05520.txt.
Description
Taiwei Shi, Yiyang Wu, Linxin Song, Tianyi Zhou, and Jieyu Zhao make the final training stage of language models cheaper. In that stage the model practices math problems and learns from rewards, but grinding through problems that are far too easy or hopelessly hard wastes enormous computing time.
Their method watches the model's recent rewards and adjusts the difficulty of the practice set on the fly, keeping problems in the sweet spot: hard, but within reach. The change is a light add-on that needs no new reward design and no change to the model itself. On contest-level math sets it cut training time by as much as half while also lifting the model's final reasoning skill.
Catalog record
| CREATOR | Taiwei Shi [email protected] |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 71 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2504-05520