A Deep Dive into Scaling RL for Code Generation with Synthetic Data and Curricula
Cansu Sancaktar, David Zhang, Gabriel Synnaeve, Taco Cohen · 2026
Read A Deep Dive into Scaling RL for Code Generation with Synthetic Data and Curricula by Cansu Sancaktar, David Zhang, Gabriel Synnaeve, Taco Cohen (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-24202.txt.
Description
Sancaktar and co-authors study how to scale reinforcement learning for code generation with synthetic data. A teacher model refines problems over several turns, guided by summaries of student performance. This multi-turn pipeline yields more valid problems than single-turn generation. It also creates easier and harder variants of one task, which form natural curricula. Tests span Llama and Qwen model families. Synthetic data improve code scores and often math scores too. The authors map how difficulty, scheduling, and diversity shape training.
Catalog record
| CREATOR | Cansu Sancaktar, David Zhang, Gabriel Synnaeve, Taco Cohen |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 74326 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2603.24202