DiSCTT: Consensus-Guided Self-Curriculum for Efficient Test-Time Adaptation in Reasoning
Mohammad Mahdi Moradi, Sudhir Mudur · 2026
Read DiSCTT: Consensus-Guided Self-Curriculum for Efficient Test-Time Adaptation in Reasoning by Mohammad Mahdi Moradi, Sudhir Mudur (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-05357.txt.
Introduction
Mohammad Mahdi Moradi and Sudhir Mudur offer DiSCTT, an accord-guided self-course. Test-time change promises better thought without supervision, but uniform objectives adapt inefficiently. DiSCTT allocates plans by doubt from sampled-path agreement. Supervised fine-tuning on pseudo-labels consolidates high-accord inputs; low-accord inputs use reinforcement learning with accord regularization. Across thinking benchmarks, DiSCTT outperforms older models, achieving higher accuracy with lower math and training times. Accounting for difficulty and doubt enables stable and lean test-time change.
Catalog record
| CREATOR | Mohammad Mahdi Moradi, Sudhir Mudur |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 43782 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2603.05357
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
DiSCTT: Consensus-Guided Self-Curriculum for Efficient Test-Time Adaptation in Reasoning Mohammad Mahdi Moradi, Sudhir Mudur Abstract Test-time adaptation offers a promising avenue for improving reasoning performance in large language models without additional supervision, but existing approaches often apply a uniform optimization objective across all inputs, leading to inefficient or unstable adaptation on heterogeneous reasoning problems. We propose DiSCTT, a difficulty-aware, consensus-guided self-curriculum framework that dynamically allocates test-time optimization strategies based on instance-level epistemic uncertainty estimated from agreement among sampled reasoning trajectories. Inputs with high consensus are consolidated via supervised fine-tuning using majority-agreed solutions as pseudo-labels, while low-consensus inputs are optimized via reinforcement learning with a consensus-regularized objective that encourages diversity under relevance constraints. Across a broad suite of mathematical and general reasoning benchmarks, DiSCTT consistently outperforms strong test-time adaptation baselines, achieving higher accuracy with reduced variance and substantially lower computation and wall-clock training times. These results demonstrate that explicitly accounting for instance difficulty and uncertainty enables more stable, efficient, and effective test-time adaptation for reasoning models. 1 Introduction Large language models (LLMs) have achieved strong performance on mathematical and general reasoning tasks through supervised fine-tuning, chain-of-thought prompting, and reinforcement learning ( 10 ) . Despite these advances, inference-time behavior remains largely static: once deployed, a model applies a fixed policy to all inputs, regardless of input difficulty or the model’s own uncertainty. This rigidity has motivated growing interest in test-time adaptation , where models update their behavior during inference without access to ground-truth labels ( 3 ; 12 ) . Reasoning tasks are a particularly natural setting for such adaptation, as they exhibit wide variation in difficulty and admit multiple valid solution paths. A key challenge in test-time adaptation is that reasoning problems are inherently heterogeneous. Easier instances often benefit from consolidation, where reinforcing high-confidence solutions stabilizes correct behavior. Harder instances, by contrast, require structured exploration to uncover alternative reasoning strategies. Most existing test-time training methods apply a single optimization objective uniformly across all inputs (Figures 1 , 2 ). Supervised self-training can saturate quickly and offers limited benefit on difficult problems. On the other hand, uniform reinforcement learning introduces unnecessary variance on already-solved instances, often leading to unstable or inefficient learning dynamics. These limitations point to a broader principle: effective test-time adaptation for reasoning requires allocating different learning objectives to different inputs based on model uncertainty. In particular, test-time learners must (i) estimate instance difficulty online, (ii) consolidate high-confidence solutions efficiently, and (iii) focus exploration on uncertain instances while stabilizing reinforcement learning in the absence of external supervision. Applying a single objective uniformly at inference time inevitably trades off over-optimizing easy instances against under-exploring genuinely hard ones. Reasoning problems also pose challenges for uncertainty estimation. Token-level confidence scores or entropy are poorly aligned with multi-step reasoning, where errors often emerge only at the trajectory level ( 2 ) . In contrast, agreement among independently sampled reasoning trajectories can provide a useful proxy for epistemic uncertainty: high consensus indicates stable reasoning modes, while disagreement reflects uncertainty over inference strategies. This trajectory-level consensus therefore serves as an effective, label-free estimate of relative instance difficulty at test time. We operationalize this principle with DiSCTT (Difficulty-aware Consensus-Guided Self-Curriculum Test-Time Adaptation). DiSCTT uses consensus among sampled reasoning completions to estimate epistemic uncertainty online and dynamically routes inputs between two complementary learning objectives. Inputs with high consensus are optimized via supervised fine-tuning using majority-agreed solutions as pseudo-labels, consolidating correct behavior with low variance. Inputs with low consensus are optimized via reinforcement learning, enabling structured exploration of alternative reasoning paths. This routing is periodically recomputed, yielding a self-evolving curriculum that adapts to the model’s changing competence rather than relying on a fixed easy–hard decomposition. We summarize our contributions as follows: • Consensus-based difficulty estimation at test time. We formalize agreement among independently sampled reasoning trajectories as an online, instance-level estimator of epistemic uncertainty, enabling difficulty-aware adaptation without access to ground-truth labels. • Difficulty-aware self-curriculum for test-time adaptation. We introduce a dynamic routing mechanism that allocates supervised consolidation to high-consensus inputs and reinforcement learning to low-consensus inputs, yielding a self-evolving curriculum that adapts to the model’s changing competence during inference. • Stabilized label-free reinforcement learning for reasoning. We propose a correctness-gated, population-relative reward augmented with relevance-aware semantic gating, which encourages controlled exploration over reasoning trajectories while improving the stability of policy updates in the absence of external supervision. • Extensive empirical evaluation across models and benchmarks. We show that DiSCTT consistently improves accuracy, stability, and computational efficiency across diverse mathematical and general reasoning benchmarks, model scales, and test-time budgets. Figure 1 : Accuracy on MATH-500 over test-time training updates for different adaptation strategies. Uniform test-time training baselines show early saturation or unstable gains, whereas DiSCTT achieves more stable and sustained improvements through difficulty-aware routing. Figure 2 : AMC accuracy for different adaptation strategies. Difficulty-aware routing and correctness-gated exploration improve convergence stability and prevent performance collapse observed under uniform RL. 2 Related Work Modern reasoning performance in large language models is closely tied to eliciting intermediate reasoning steps and aggregating multiple sampled solutions. Chain-of-thought prompting improves multi-step reasoning by inducing explicit intermediate steps ( 11 ) . Beyond single-sample decoding, self-consistency demonstrates that sampling many reasoning paths and selecting the most frequent final answer via majority voting yields substantial gains across reasoning tasks ( 9 ) . This use of agreement among model generations as a weak supervision signal underpins a growing class of label-free or weakly supervised approaches for improving reasoning without access to ground-truth labels at inference time. However, in most prior works, consensus is used as a static selection mechanism rather than as a dynamic signal to guide how learning objectives should be allocated. Test-Time Training (TTT) formalizes adaptation at inference by updating model parameters on unlabeled test inputs using self-supervised objectives, primarily to address distribution shift ( 8 ) . Verifier-Driven Selective Test-Time Training (VDS-TTT) extends this paradigm by conditioning supervised fine-tuning updates using an external verifier ( 5 ) . While verifier-based selection can improve stability, performance becomes strongly dependent on verifier quality and availability, and such methods do not model population-level difficulty or allocate exploration across reasoning instances. In reasoning-specific settings, Test-Time Reinforcement Learning (TTRL) extends TTT by applying reinforcement learning updates at inference time using majority-based signals derived from multiple generations ( 14 ) . TTRL establishes that label-free self-improvement is feasible for complex reasoning tasks, but also exposes two key challenges. First, updates are applied uniformly, remaining blind to epistemic uncertainty and problem difficulty. Second, repeated self-updates under uniform reinforcement pressure can introduce instability, noisy learning dynamics, or partial collapse. To mitigate exploration collapse in label-free reinforcement learning, EVOL-RL proposes coupling majority-based selection with novelty-promoting variation, implemented via embedding-space diversity and GRPO-based optimization ( 13 ) . EVOL-RL applies a uniform optimization objective across all inputs and while effective, does not explicitly account for heterogeneity in instance difficulty. Consequently, novelty-driven exploration is encouraged even for high-confidence, already-solved instances, introducing unnecessary variance and potentially destabilizing learning. In addition, novelty is defined globally over the response population, without conditioning on instance-specific reasoning structure or semantic relevance, which can promote spurious or off-task deviations. Orthogonal to how test-time learning signals are constructed, reinforcement learning has become a standard optimization backbone for improving reasoning and