TTCS : Test-Time Curriculum Synthesis for Self-Evolving
Chengyi Yang, Zhishang Xiang, Yunbo Tang, Zongpei Teng, Chengsong Huang, Fei Long, Yuhan Liu, Jinsong Su · 2026
Read TTCS : Test-Time Curriculum Synthesis for Self-Evolving by Chengyi Yang, Zhishang Xiang, Yunbo Tang, Zongpei Teng, Chengsong Huang, Fei Long, Yuhan Liu, Jinsong Su (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2601-22628.txt.
Introduction
Chengyi Yang and a large team let a model teach itself at test time with a built course of tasks. Test-time training tunes a model on just the questions at hand. Their 2026 preprint, TTCS, notes that hard reasoning tasks defeat plain test-time tuning for two clear reasons.
Their fix synthesizes a curriculum: a staged set of tasks that grows toward the hard target. A good ladder lets the model climb instead of stall. The method keeps all tuning inside the test window. It aims at hard math and logic tasks. The work turns one hard ask into a course.
Catalog record
| CREATOR | Chengyi Yang, Zhishang Xiang, Yunbo Tang, Zongpei Teng, Chengsong Huang, Fei Long, Yuhan Liu, Jinsong Su |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 56 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2601-22628
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
TTCS : Test-Time Curriculum Synthesis for Self-Evolving Chengyi Yang, Zhishang Xiang, Yunbo Tang, Zongpei Teng, Chengsong Huang, Fei Long, Yuhan Liu, Jinsong Su Abstract Test-Time Training offers a promising way to improve the reasoning ability of large language models (LLMs) by adapting the model using only the test questions. However, existing methods struggle with difficult reasoning problems for two reasons: raw test questions are often too difficult to yield high-quality pseudo-labels, and the limited size of test sets makes continuous online updates prone to instability. To address these limitations, we propose TTCS , a co-evolving test-time training framework. Specifically, TTCS initializes two policies from the same pretrained model: a question synthesizer and a reasoning solver . These policies evolve through iterative optimization: the synthesizer generates progressively challenging question variants conditioned on the test questions, creating a structured curriculum tailored to the solver’s current capability, while the solver updates itself using self-consistency rewards computed from multiple sampled responses on both original test and synthetic questions. Crucially, the solver’s feedback guides the synthesizer to generate questions aligned with the model’s current capability, and the generated question variants in turn stabilize the solver’s test-time training. Experiments show that TTCS consistently strengthens the reasoning ability on challenging mathematical benchmarks and transfers to general-domain tasks across different LLM backbones, highlighting a scalable path towards dynamically constructing test-time curricula for self-evolving. Our code and implementation details are available at https://github.com/XMUDeepLIT/TTCS . 1 Introduction Figure 1: Comparison of TTRL and our TTCS: (a) When applied to difficult test questions such as AIME24, TTRL suffers from noisy rewards caused by incorrect majority voting consensus. (b) TTCS synthesizes tractable variants to ensure valid pseudo-labels, providing reliable supervision for stable self-evolution. Large language models (LLMs) have evolved from passive text generators into increasingly autonomous agents capable of planning, acting, and reasoning over complex tasks 9 ; 33 ; 24 ; 17 ; 44 . This progress has been largely driven by reinforcement learning with verifiable rewards (RLVR) 27 ; 41 , which has yielded significant improvements on challenging mathematical and scientific benchmarks 7 ; 40 . By leveraging verifiable outcomes, RLVR allows models to iteratively refine their strategies through trial-and-error feedback. However, this paradigm faces a critical scalability bottleneck: it heavily depends on extensive, high-quality ground-truth labels 30 . To address this limitation, recent studies 5 ; 46 ; 23 ; 8 ; 14 ; 45 have shifted toward Self-Evolving . These approaches empower models to improve autonomously through self-generated supervision and environmental interactions, thereby reducing reliance on external human labels. A representative work of this paradigm is Test-Time Training 31 , particularly its reinforcement learning variant known as test-time reinforcement learning (TTRL) 49 . Originally Designed to mitigate distribution shifts, TTRL enables dynamic parameter adaptation on unlabeled test instances by optimizing a self-supervised objective, which is typically constructed via majority voting 36 . However, as illustrated in Figure 1 (a), when applied to challenging reasoning tasks, TTRL encounters two primary challenges: (i) Unreliable Pseudo-labels. For difficult questions such as AIME24 20 , the majority of sampled responses are often incorrect. Majority voting therefore converges to a wrong consensus, producing systematically noisy reward signals that actively misguide the policy update 47 . Instead of correcting errors, the model is reinforced toward misleading reasoning paths. (ii) Optimization lacks learnable samples. TTRL operates directly on a small set of extremely challenging test questions. As shown in Figure 1 (a), these questions lie far beyond the model’s current capability. Without intermediate variants to bridge the gap, the learning process becomes steep and often unclimbable 3 . To overcome these challenges, we draw upon the fundamental insight from Curriculum Learning 2 ; 35 that solving related, more tractable variants serves as a bridge to mastering complex problems. This implies that directly optimizing on the original intractable test questions is inherently flawed. Therefore, we instead focus on actively constructing a problem-centered curriculum comprised of diverse, solvable variants that match the model’s current capability. As shown in Figure 1 (b), the synthetic questions ensure that training samples remain within the model’s capability frontier, providing valid supervision signals that convert the noisy feedback of standard test-time training into a reliable pathway for self-evolution. In this paper, we propose TTCS ( T est- T ime C urriculum S ynthesis for Self-Evolving), a co-evolving test-time training framework that couples capability-aware synthesizer with online self-evolving solver . TTCS instantiates two agents initialized from the same pretrained model: a Synthesizer that, given a test question, generates curriculum questions variants that preserve the underlying reasoning structure while varying surface realizations; and a Solver that performs online training on a mixture of test questions and synthetic questions. Crucially, the two agents co-evolve in an iterative loop: the solver serves as an implicit judge of each synthesized question quality, providing a capability-aligned signal that trains the synthesizer to propose auxiliary questions near the solver’s capability frontier, while the solver is updated using self-supervised rewards derived from its own sampled responses 49 ; 36 . Both agents are optimized online via Group Relative Policy Optimization (GRPO) 27 , enabling stable self-evolving under label-free test-time constraints. Generally, our main contributions are summarized as follows: • We identify limitations in existing test-time training for complex reasoning, including unreliable pseudo-labels and the lack of learnable samples, which collectively hinder effective optimization on difficult test questions in practice. • We propose TTCS , a co-evolving test-time training framework. TTCS couples a capability-aware synthesizer with an online solver. Through iterative GRPO, the synthesizer dynamically constructs a problem-centered curriculum aligned with the solver’s capability frontier, thereby transforming noisy feedback into a reliable pathway for self-evolution. • Extensive experiments show that our approach achieves strong performance and generalizes well across both mathematical and general reasoning benchmarks. 2 Related Work The related works to ours mainly include the following two lines of studies: Self Evolving for LLMs. Self Evolving has been considered as a paradigm for augmenting LLMs’ reasoning ability without extra human supervision. In this regard, pioneering studies 15 ; 37 demonstrate that LLMs can achieve meaningful self-improvement by fine-tuning on their own high-confidence reasoning trajectories. Following this, SPIN 5 introduces iterative self-play fine-tuning. To address the degenerative feedback in single-model self-play, later role-specialized frameworks 22 ; 4 adopt co-evolution as a core principle, which scales effectively in low-data settings 8 ; 26 . Recent studies shift toward dynamic self-challenging 48 ; 21 and unsupervised post-training 39 . This progress marks a transition from imitating external supervision 42 to autonomous self-correction based on intrinsic verifiability, leading to zero-data systems 14 ; 46 ; 11 . However, as noted by 29 , recursive training on self-generated data carries the risk of model collapse, underscoring the need for high-quality data synthesis mechanisms. Test-Time Training (TTT). This paradigm dynamically adapts model parameters during inference via self-supervision 1 . A key development is Test-Time Reinforcement Learning (TTRL) 49 , which applies RLVR to unlabeled test data by deriving pseudo-labels from multi-sampling, allowing LLMs to self-improve during inference. While AlphaProof 16 has demonstrated the substantial potential of TTT in tackling Olympiad-level mathematical reasoning, it predominantly relies on stronger LLM 32 ; 6 for data synthesis, limiting the scope of fully autonomous self-evolving. To overcome this limitation, we