Metacognitive Reuse: Turning Recurring LLM Reasoning Into Concise Behaviors

Aniket Didolkar, Nicolas Ballas, Sanjeev Arora, Anirudh Goyal · 2025

Read Metacognitive Reuse: Turning Recurring LLM Reasoning Into Concise Behaviors by Aniket Didolkar, Nicolas Ballas, Sanjeev Arora, Anirudh Goyal (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2509-13237.txt.

Introduction

Aniket Didolkar, Nicolas Ballas and two co-authors turn repeat reasoning steps into short reusable behaviors in 2025. Language models re-derive the same mid steps across tasks, which wastes tokens and fills context. Stored hints could free room for search.

The model mines its own past traces for repeat fragments. Each becomes a named behavior with a short instruction, kept in a handbook. Hints at test time cut tokens by up to near half at equal scores. Self-use of past hints lifts scores alone. Training on hint-led traces builds reasoners better than plain training.

Catalog record

CREATORAniket Didolkar, Nicolas Ballas, Sanjeev Arora, Anirudh Goyal
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE52 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2509-13237

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Metacognitive Reuse: Turning Recurring LLM Reasoning Into Concise Behaviors Aniket Didolkar, Nicolas Ballas, Sanjeev Arora, Anirudh Goyal Abstract Large language models (LLMs) now solve multi-step problems by emitting extended chains of thought. During the process, they often re-derive the same intermediate steps across problems, inflating token usage and latency. This saturation of the context window leaves less capacity for exploration. We study a simple mechanism that converts recurring reasoning fragments into concise, reusable “behaviors” (name + instruction) via the model’s own metacognitive analysis of prior traces . These behaviors are stored in a “behavior handbook” which supplies them to the model in-context at inference or distills them into parameters via supervised fine-tuning. This approach achieves improved test-time reasoning across three different settings - 1) Behavior-conditioned inference : Providing the LLM relevant behaviors in-context during reasoning reduces number of reasoning tokens by up to 46% while matching or improving baseline accuracy; 2) Behavior-guided self-improvement : Without any parameter updates, the model improves its own future reasoning by leveraging behaviors from its own past problem solving attempts. This yields up to 10% higher accuracy than a naive critique-and-revise baseline; and 3) Behavior-conditioned SFT : SFT on behavior-conditioned reasoning traces is more effective at converting non-reasoning models into reasoning models as compared to vanilla SFT. Together, these results indicate that turning slow derivations into fast procedural hints enables LLMs to remember how to reason, not just what to conclude. † † affiliation: Meta † † affiliation: Mila-Quebec AI Institute, University of Montreal † † affiliation: Princeton University † † contribution: Work done at Meta † † contribution: Joint last author † † date: August 10, 2026 † † correspondence: [email protected] , [email protected] 1 Introduction LLMs have made rapid progress on mathematics, coding and other multi-step tasks by generating long, deliberative chains-of-thought ( Wei et al. 2022 ; Guo et al. 2025 ; Shao et al. 2024 ; OpenAI 2024 ; Muennighoff et al. 2025 ; Ye et al. 2025 ; Gao et al. 2024 ; Lambert et al. 2024 ; Team et al. 2025 ) . Yet, this capability exposes a structural inefficiency: each new problem triggers reconstruction of ubiquitous sub-procedures (e.g., finite-series sums, case splits, unit conversions), inflating token usage and latency. For instance, suppose the LLM derives the finite geometric series formula while solving one problem. Can it avoid re‑deriving from scratch when similar reasoning is needed for another problem? Current inference loops lack a mechanism to promote frequently rediscovered patterns into a compact, retrievable form. We introduce a metacognitive pathway that extracts and reuses such patterns. Given a problem, the model first solves it, then reflects on its trace to identify generalizable steps, and finally emits a set of behaviors—short, actionable instructions with canonical names. These behaviors populate a searchable handbook (a procedural memory) that can be provided in-context at test time or internalized through supervised fine-tuning. This provides a framework for turning verbose derivations into quick reflexes . Unlike typical memory/Retrieval-Augmented Generation (RAG) systems that store declarative facts, the handbook targets procedural knowledge ( Willingham et al. 1989 ) about how to think. This procedural memory contrasts sharply with most existing “memory” add‑ons for LLMs, including RAG, which target declarative knowledge for tasks such as factual question-answering ( Borgeaud et al. 2022 ; Lewis et al. 2020 ) . Instead of being assembled from curated documents or knowledge graphs—rather, it is generated by the model itself. It emerges from the model’s own metacognitive cycle: critiquing its own chain‑of‑thought and abstracting repeated reasoning patterns into behaviors. We evaluate three instantiations of the proposed framework. (i) Behavior-conditioned inference: Providing behaviors obtained by solving questions in-context results in reasoning chains that utilize up to 46% fewer tokens while improving or maintaining strong performance across MATH and AIME benchmarks (ii) Behavior-guided self-improvement: While solving a problem, providing the model access to behaviors extracted by itself from its own past attempts for that question improves accuracy by up to 10% compared to naive self-improvement baseline. (iii) Behavior-conditioned SFT: training on reasoning traces generated via behavior-conditioned inference yields models that are both more accurate and more concise than models trained on ordinary traces, especially when turning non-reasoning models into reasoning models. Figure 1 : Behavior Curation Pipeline (left) : All the 3 stages of behavior curation pipeline are shown. The stages are described in detail in Section 3 with detailed prompts for each stage shown in Figure 2 . LLM A refers to the Metacognitive Strategist . Reasoning with behaviors (right) : This part showcases various ways in which behaviors are utilized for LLM reasoning. For behavior-conditioned inference and behavior-guided self-improvement, behaviors retrieved from the behavior handbook, are provided in-context to the Student model (LLM C) during inference. For behavior-conditioned SFT, a training dataset is created using a Teacher LLM (LLM B) via behavior-conditioned inference and then a Student LLM is trained on the resulting (question, response) pairs. After training, during inference, the Student LLM is queried with the given question without any behaviors in-context. Contributions. 1. We formalize behaviors as named, reusable reasoning instructions discovered by metacognitive reflection over solution traces. 2. We introduce a three-step approach to employ an LLM to extract behaviors from its own reasoning traces (Section 3 ). 3. We develop three settings for utilizing these behaviors: behavior-conditioned inference, behavior-guided self-improvement, and behavior-conditioned SFT. (Section 4 ) 4. We provide empirical evidence of the effectiveness of our behavior-based approach across each of the three settings, evaluated on challenging mathematical benchmarks such as MATH ( Hendrycks et al. 2021 ) and AIME–24/25 ( MAA 2024 ; MAA 2025 ) (Section 5 ). 5. We discuss some limitations and challenges of the proposed framework—e.g., lack of dynamic behavior retrieval during long solutions, usage of behaviors beyond math, constructing large scale behavior handbooks across various domains, etc. By converting frequently rediscovered steps into compact procedures, behavior handbooks encourage LLMs to remember how to think. This simple addition to the reasoning stack improves token efficiency and suggests a path toward models that accumulate procedural knowledge over time. 1.1 Paper Outline The paper starts with describing the pipeline for curating the behaviors (Section 3 ) followed by various ways in which behaviors are utilized for improved reasoning (Section 4 ). The experiment section describes the corresponding experiment results. Section 5.1 presents results for behavior-conditioned inference on the MATH ( Hendrycks et al. 2021 ) and the AIME datasets ( MAA 2024 ; MAA 2025 ) showing that the proposed approach exhibits similar or improved performance compared to normal inference while reducing token usage by up to 46%. Section 5.2 presents the self-improvement experiment where the behavior-guided approach uses behaviors as lessons for scalable self-improvement achieving up to 10% higher accuracy as compared to the baseline self-improvement approach at the highest considered token budget of 16,384. Finally, the SFT experiments (Section 5.3 ) show that using behavior-conditioned inference to generate reasoning traces for SFT results in stronger reasoning models as compared to performing SFT with vanilla reasoning traces. 2 Related Work Efficient Reasoning with LLMs Reinforcement‑tuned, long‑form chain‑of‑thought (CoT) prompting has enabled recent LLMs to tackle highly complex problems in mathematics, logic, and code ( OpenAI 2024 ; Guo et al. 2025 ; Shao et al.

Read the complete text