Accelerating Training of Recursive Reasoning Models with Curriculum Guided Adaptive Recursion

Kaleem Ullah Qasim, Jiashu Zhang · 2025

Read Accelerating Training of Recursive Reasoning Models with Curriculum Guided Adaptive Recursion by Kaleem Ullah Qasim, Jiashu Zhang (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2511-08653.txt.

Description

Kaleem Ullah Qasim and Jiashu Zhang speed up tiny recursive reasoning models, small networks that refine their answers over repeated steps and can rival much larger models. Training them is slow, though, partly because every run uses full recursion depth and equal supervision weight from the start.

Their method, CGAR, treats depth as a curriculum: training begins with shallow recursion and deepens in three stages, cutting floating-point work by about forty percent. A second piece weights early supervision steps more heavily, with importance decaying exponentially, which lowers gradient variance. On Sudoku-Extreme the combined method trains about one point seven times faster with a tiny accuracy cost. Models also halt reliably at test time using fewer reasoning steps.

Catalog record

CREATORKaleem Ullah Qasim, Jiashu Zhang
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE52 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2511-08653

Browse the full library · About the Tower of Babel