A Deep Dive into Scaling RL for Code Generation with Synthetic Data and Curricula

Cansu Sancaktar, David Zhang, Gabriel Synnaeve, Taco Cohen · 2026

Read A Deep Dive into Scaling RL for Code Generation with Synthetic Data and Curricula by Cansu Sancaktar, David Zhang, Gabriel Synnaeve, Taco Cohen (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-24202.txt.

Description

Sancaktar and co-authors study how to scale reinforcement learning for code generation with synthetic data. A teacher model refines problems over several turns, guided by summaries of student performance. This multi-turn pipeline yields more valid problems than single-turn generation. It also creates easier and harder variants of one task, which form natural curricula. Tests span Llama and Qwen model families. Synthetic data improve code scores and often math scores too. The authors map how difficulty, scheduling, and diversity shape training.

Catalog record

CREATORCansu Sancaktar, David Zhang, Gabriel Synnaeve, Taco Cohen
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE74326
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2603.24202

Browse the full library · About the Tower of Babel