Accelerating Training of Recursive Reasoning Models with Curriculum Guided Adaptive Recursion
Kaleem Ullah Qasim, Jiashu Zhang · 2025
Read Accelerating Training of Recursive Reasoning Models with Curriculum Guided Adaptive Recursion by Kaleem Ullah Qasim, Jiashu Zhang (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2511-08653.txt.
Description
Kaleem Ullah Qasim and Jiashu Zhang speed up tiny recursive reasoning models, small networks that refine their answers over repeated steps and can rival much larger models. Training them is slow, though, partly because every run uses full recursion depth and equal supervision weight from the start.
Their method, CGAR, treats depth as a curriculum: training begins with shallow recursion and deepens in three stages, cutting floating-point work by about forty percent. A second piece weights early supervision steps more heavily, with importance decaying exponentially, which lowers gradient variance. On Sudoku-Extreme the combined method trains about one point seven times faster with a tiny accuracy cost. Models also halt reliably at test time using fewer reasoning steps.
Catalog record
| CREATOR | Kaleem Ullah Qasim, Jiashu Zhang |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 52 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2511-08653