CoT 2 -Meta: Budgeted Metacognitive Control for Test-Time Reasoning

Siyuan Ma, Bo Gao, Zikai Xiao, Hailong Wang, Xinlei Yu, Rui Qian, Jiayu Qian, Luqi Gong, Yang Liu · 2026

Read CoT 2 -Meta: Budgeted Metacognitive Control for Test-Time Reasoning by Siyuan Ma, Bo Gao, Zikai Xiao, Hailong Wang, Xinlei Yu, Rui Qian, Jiayu Qian, Luqi Gong, Yang Liu (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-28135.txt.

Introduction

Ma and eight co-authors present CoT2-Meta, a framework that adds metacognitive control to test-time reasoning. Most methods just sample more chains or search bigger trees, with no control over when to expand, prune, fix, or stop. CoT2-Meta pairs chain-of-thought generation with a meta-controller and a step-level scoring oracle. Under matched compute budgets it beat sampling and search baselines on six tests, including MATH and GSM8K. Gains held across a wider 15-benchmark suite.

Catalog record

CREATORSiyuan Ma, Bo Gao, Zikai Xiao, Hailong Wang, Xinlei Yu, Rui Qian, Jiayu Qian, Luqi Gong, Yang Liu
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE95225
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2603.28135

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

CoT 2 -Meta: Budgeted Metacognitive Control for Test-Time Reasoning Siyuan Ma, Bo Gao, Zikai Xiao, Hailong Wang, Xinlei Yu, Rui Qian, Jiayu Qian, Luqi Gong, Yang Liu Abstract Recent test-time reasoning methods improve performance by generating more candidate chains or searching over larger reasoning trees, but they typically lack explicit control over when to expand, what to prune, how to repair, and when to abstain. We introduce CoT 2 -Meta , a training-free metacognitive reasoning framework that combines object-level chain-of-thought generation with meta-level control over partial reasoning trajectories. The framework integrates four components: strategy-conditioned thought generation, tree-structured search, an online process oracle for step-level reasoning evaluation, and a meta-controller that allocates computation through expansion, pruning, repair, stopping, and fallback decisions. Under matched inference budgets, CoT 2 -Meta consistently outperforms strong single-path, sampling-based, and search-based baselines, including ReST-MCTS. On the default backbone, it achieves 92.8 EM on MATH , 90.4 accuracy on GPQA , 98.65 EM on GSM8K , 75.8 accuracy on BBEH , 85.6 accuracy on MMMU-Pro , and 48.8 accuracy on HLE , with gains over the strongest non- CoT 2 -Meta baseline of +3.6, +5.2, +1.15, +2.0, +4.3, and +4.3 points, respectively. Beyond these core results, the framework remains effective across a broader 15-benchmark suite spanning knowledge and QA, multi-hop reasoning, coding, and out-of-distribution evaluation. Beyond aggregate accuracy, we show that the gains are not reducible to brute-force compute: CoT 2 -Meta yields better compute scaling, improved calibration, stronger selective prediction, and targeted repair behavior under token-matched comparisons. Additional analyses show that the framework generalizes across backbone families while decision-trace audits and failure taxonomies reveal interpretable controller behavior and localized remaining failure modes. These results suggest that explicit metacognitive control is a practical design principle for reliable and compute-efficient test-time reasoning systems. 1 Introduction Large language models (LLMs) benefit substantially from additional test-time compute on complex reasoning tasks. Chain-of-thought (CoT) prompting, self-consistency, and related scaling strategies show that more inference-time reasoning can improve final performance Wang et al. 2022 ; Zhou et al. 2022 . More recent methods extend single-path reasoning to structured exploration, including tree-based search, graph-based search, and process-reward-guided deliberation Yao et al. 2023 ; Besta et al. 2024 ; Zhang et al. 2024 . However, most still treat extra compute mainly as more generation rather than better control : they expand search more broadly, but typically do not explicitly decide when a partial trajectory should be expanded, pruned, repaired, or terminated Yao et al. 2023 ; Zhang et al. 2024 . As a result, computation is often wasted on weak branches, while fluent but incorrect trajectories may persist too long. A parallel line of work shows that reliable reasoning requires more than final-answer correctness. Verifier-based methods and process supervision highlight the importance of intermediate reasoning quality Cobbe et al. 2021 ; Lightman et al. 2023 ; Pronesti et al. 2026 ; Kim and Yun ; related studies show that outcome accuracy can mask flawed reasoning processes Pronesti et al. 2026 , while LLM confidence is often poorly calibrated unless explicitly modeled or controlled Guo et al. 2017 ; Jiang et al. 2021 ; Kapoor et al. 2024 . More broadly, metareasoning and computation-selection research frames deliberation as a decision problem under limited resources: the question is not only how to reason, but also which computations are worth performing, and when Russell and Wefald 1991 ; Hay et al. 2014 . These observations motivate systems that reason not only through trajectories, but also about how reasoning should proceed. Figure 1: CoT 2 -Meta as reasoning over reasoning. The inner layer performs object-level reasoning, while the outer layer performs metacognitive control over partial trajectories. The meta-controller decides when to expand, prune, repair, stop, or abstain under a bounded budget. We introduce CoT 2 -Meta , a budgeted metacognitive reasoning framework that separates object-level reasoning from meta-level control . An LLM generates candidate reasoning steps that form a tree of partial trajectories, while a controller evaluates process quality, maintains a compact meta-state, and decides whether to expand , prune , repair , stop , or abstain . This casts test-time reasoning as sequential control over trajectories rather than passive sample-and-rerank. Our design follows two principles. First, useful test-time scaling should be selective : computation should be allocated according to intermediate quality and uncertainty rather than spent uniformly across trajectories Ma et al. 2026 ; Snell et al. 2024 ; Singhi et al. 2025 . Second, confidence should be actionable : the same signals used to assess trustworthiness should also govern whether the system continues searching, invokes repair, or declines to answer. Accordingly, CoT 2 -Meta integrates process evaluation, meta-state construction, confidence-aware routing, and decision logging into a single inference-time loop. Empirically, CoT 2 -Meta consistently outperforms strong baselines under matched compute budgets. On the default backbone, it improves over the strongest non- CoT 2 -Meta baseline by +3.6 on MATH , +5.2 on GPQA , +1.15 on GSM8K , +2.0 on BBEH , +4.3 on MMMU-Pro , and +4.3 on HLE . The method also remains effective across a broader 15-benchmark suite spanning knowledge and QA, multi-hop QA, coding, and out-of-distribution evaluation, with gains that persist across backbone families under compute-normalized evaluation and are accompanied by better calibration, stronger selective prediction, more effective repair, and interpretable decision traces. Contributions. (1) We introduce CoT 2 -Meta , a unified inference-time framework for process-aware metacognitive control over reasoning trajectories. (2) We show consistent gains across a 15-benchmark suite spanning reasoning, multimodal reasoning, knowledge and QA, multi-hop QA, coding, and out-of-distribution evaluation under strict compute normalization. (3) We show that these gains arise from stronger reasoning control rather than brute-force extra compute alone. 2 Method We present CoT 2 -Meta , a budgeted metacognitive reasoning framework that explicitly separates object-level reasoning from meta-level control . At the object level, a backbone language model generates candidate reasoning steps. At the meta level, a controller evaluates partial trajectories, maintains a compact state representation, and decides whether to expand, prune, repair, stop, or abstain. This design turns test-time reasoning from pure text generation into a sequential control problem over reasoning trajectories. 2.1 Problem Formulation Let x denote an input problem. A reasoning trajectory is a sequence of intermediate thoughts \tau_{t}=(z_{1},z_{2},\dots,z_{t}), where each z_{i} is a coherent reasoning unit such as a sub-derivation, decomposition step, verification step, or intermediate conclusion. The final output is either an answer \hat{y} or an abstention decision \varnothing . We assume access to an object-level generator G_{\theta}(z_{t+1}\mid x,\tau_{t},s_{t}), where s_{t} denotes the current control context, including the active reasoning strategy and any meta-level signals exposed to the generator. Unlike standard chain-of-thought prompting, which follows a single trajectory, we consider a search space over multiple trajectories organized as a reasoning tree. Let \mathcal{T} denote the evolving reasoning tree and let \mathcal{F}_{t} be its frontier at step t . Each frontier node corresponds to a partial reasoning trajectory. The system operates under a finite inference budget C , which counts all generation, evaluation, repair, and control calls. The goal is to maximize answer quality while respecting this budget: \max_{\pi}\;\mathbb{E}\!\left[U(\hat{y},x)\right]\quad\text{s.t.}\quad\mathrm{Cost}(\pi;x)\leq C, where \pi is the meta-control policy and U(\hat{y},x) is a utility that rewards correct high-confidence answers and can optionally penalize unsafe overconfident

Read the complete text