Monitor-Generate-Verify (MGV) : Formalising Metacognitive Theory for Language Model Reasoning
Nick Oh, Fernand Gobet · 2025
Read Monitor-Generate-Verify (MGV) : Formalising Metacognitive Theory for Language Model Reasoning by Nick Oh, Fernand Gobet (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2511-04341.txt.
Introduction
Nick Oh and Fernand Gobet formalise metacognition for language model reasoning in a Monitor-Generate-Verify framework. Popular test-time setups generate and then verify, skipping the monitoring step that decides when and how reasoning should begin. The authors link that omission to early commitment to poor reasoning paths and sizable accuracy loss.
Monitoring before generation captures difficulty ratings and confidence judgments, drawn from classic metacognitive theories of Flavell and of Nelson and Narens. Verification feedback then refines future monitoring. No hands-on validation is claimed; what it adds is a diagnostic vocabulary and concrete structural fixes, plus links to resource-rational analysis. Component-level failure in such systems becomes easier to name and target.
Catalog record
| CREATOR | Nick Oh, Fernand Gobet |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 123 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2511-04341
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Monitor-Generate-Verify (MGV) : Formalising Metacognitive Theory for Language Model Reasoning Nick Oh, Fernand Gobet Abstract Test-time reasoning architectures such as those following the Generate-Verify paradigm, where a model iteratively refines or verifies its own generated outputs, prioritise generation and verification but exclude the monitoring processes that determine when and how reasoning should begin. This omission may contribute to the prefix dominance trap, in which models commit early to suboptimal reasoning paths and seldom recover, yielding roughly 20% accuracy loss. We address this architectural gap by proposing the Monitor-Generate-Verify (MGV) framework, a computational translation of Flavell’s and Nelson and Narens’ metacognitive theories that preserves their psychological detail. MGV extends the Generate-Verify paradigm by adding explicit monitoring that captures metacognitive experiences (from difficulty assessments to confidence judgements) before generation begins and refines future monitoring through verification feedback. Though we present no empirical validation, MGV provides a vocabulary for diagnosing component-level failures in reasoning systems, suggests specific architectural interventions for future designs, and identifies connections to resource-rational analysis that may ground its mechanisms in normative principles. \workshoptitle Foundations of Reasoning in Language Models (FoRLM) 1 Introduction Once language models commit to an initial reasoning strategy, subsequent verification rarely helps; this prefix dominance trap causes nearly 20% performance degradation when models choose suboptimal approaches, with limited recovery possible through refinement ( Luo et al. 2025 ) . Today’s dominant Generate-Verify test-time reasoning architectures ( Weng et al. 2023 ; Madaan et al. 2023 ; Lee et al. 2025 ; Zhang et al. 2024 ) exemplify this limitation through their very design. They operate through immediate generation followed by iterative refinement, without assessing task characteristics or selecting appropriate strategies before generating solutions. What architectural vocabulary might help diagnose what these systems lack? Cognitive psychology offers a candidate answer. Before attempting complex tasks, humans engage in metacognitive monitoring, assessing difficulty, retrieving relevant strategies, and establishing confidence criteria, often without conscious deliberation ( Flavell 1979 ; Nelson and Narens 1990 ) . This monitoring capacity transforms uncertainty into tractable signals that guide subsequent action. Flavell 1979 ’s model specifies how metacognitive knowledge and experience interact to enable strategy selection, while Nelson and Narens 1990 ’ metamemory framework details how confidence thresholds and adaptive search mechanisms emerge from hierarchical monitoring and control. These theories suggest that the Generate-Verify paradigm may be missing an entire phase of processing that precedes generation. However, translating these psychological insights into architectural recommendations requires computational specification. Resource-rational analysis has made significant progress here, with Callaway et al. 2024 formalising Nelson and Narens 1990 ’ metamemory theory as a meta-level MDP that derives optimal stopping policies from cost-benefit principles. While their approach offers normative grounding and empirical validation, the present work pursues a complementary goal: instead of deriving optimal behaviour from computational constraints, we translate the detailed psychological vocabulary of Flavell 1979 and Nelson and Narens 1990 into algorithmic form, preserving structure that resource-rational approaches may abstract away. The resulting Monitor-Generate-Verify (MGV) framework extends the Generate-Verify paradigm by adding explicit monitoring that captures metacognitive experiences before generation begins and refines future monitoring through verification feedback. Our formalisation preserves constructs including the tripartite organisation of metacognitive knowledge, the distinction between difficulty and evaluative experiences, dual-counter evidence accumulation for feeling-of-knowing, and satisficing threshold dynamics. We offer no empirical validation and no normative justification for these architectural choices. The contribution is a detailed computational translation that provides diagnostic vocabulary for understanding what reasoning systems might lack, suggesting where architectural interventions might prove productive. The remainder of this paper is organised as follows. Section 2 situates our contribution within resource-rational approaches to metacognition and LLMs. Section 3 presents algorithmic formalisations of Flavell’s and Nelson and Narens’ theories, translating psychological concepts into computational structures. Section 4 acknowledges limitations and outlines future directions. 2 Related Work This section situates the present work within two related research programmes. The first is resource-rational analysis, a cognitive modelling paradigm that formalises metacognition as cost-benefit optimisation over computational resources. The second is recent work applying these principles to language models. We review each in turn before clarifying how the present work differs in its foundational commitments. 2.1 Resource-Rational Analysis of Metacognition Resource-rational analysis is a cognitive modelling paradigm that reconceives bounded rationality not as a departure from optimality but as optimality under constraints ( Griffiths et al. 2015 ; Griffiths et al. 2019 ; Lieder and Griffiths 2020 ) . Making good decisions requires computation, yet computation itself is costly. This tension between the value of deliberation and its cost gives rise to a class of meta-problems: problems not about what to decide, but about how to decide. How much should an agent think before acting ? Which cognitive strategy should be deployed for a given problem ? Which aspects of a decision path merit exploration, and which can be safely ignored ? These questions concern the allocation of computational resources, and answering them requires reasoning about reasoning itself. Resource-rational analysis provides a framework for addressing such meta-problems by treating cognitive constraints as part of the optimisation problem rather than as departures from rationality. Under metalevel rationality, an agent is assessed not by the expected utility of actions taken, but by how well its cognitive algorithm trades off decision quality against deliberation costs. From this perspective, rationality concerns not only making good decisions but also employing efficient cognitive strategies. The framework reduces meta-reasoning 1 1 1 Meta-reasoning should be distinguished from meta-learning. Meta-reasoning concerns how to allocate limited computational resources during cognition, deciding which computations to perform and when to stop deliberating. Meta-learning concerns how to structure the learning process itself, exploiting knowledge about the statistical structure of learning environments to make better use of limited data. Both address resource limitations, but at different levels: meta-reasoning optimises the use of time and cognitive effort within a task, whereas meta-learning optimises the acquisition of knowledge across tasks. For a treatment that situates both perspectives within the resource-rational framework, see Griffiths et al. 2019 . to a decision-theoretic problem: for any computation the agent could perform, there exists a value of computation (VOC) that quantifies the expected improvement in decision quality minus the cost of deliberation . This cognitive modelling paradigm provides a common structure that different research programmes have instantiated in distinct ways, each addressing a different facet of the meta-reasoning problem. Lieder and Griffiths 2017 modelled strategy selection : rather than asking whether to think more, this formulation asks how to think, treating the choice among cognitive strategies as a contextual bandit in which the agent learns to predict which mode of reasoning best suits each type of problem (Appendix 7.2 ). Lieder et al. 2018 modelled cognitive control : by casting control specification as a belief-MDP and introducing a learned approximation, this formulation explains how control exhibits plasticity, adapting through experience to select signals that optimally trade off effort against goal achievement (Appendix 7.4 ). Callaway et al. 2022 modelled planning : by embedding deliberation within a meta-level MDP, this formulation captures the sequential structure of mental simulation, recognising that the value of a computation depends not only on its immediate effect but also on the future computations it enables (Appendix 7.3 ). Callaway et al. 2024 modelled memory recall : by treating