Know When to Trust the Skill: Delayed Appraisal and Epistemic Vigilance for Single-Agent LLMs

Eren Unlu · 2026

Read Know When to Trust the Skill: Delayed Appraisal and Epistemic Vigilance for Single-Agent LLMs by Eren Unlu (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-16753.txt.

Introduction

Unlu argues the agent choke is not capability or skill range but missing strict second-order metacognitive governance. He opens MESA-S, a framework turning delayed review, knowledge watch and nearby hand-off into a single-agent architecture. Scalar confidence becomes a vector splitting self-confidence from source-confidence in found outside procedures. A delayed step probe plus Meta Skill Cards split sense of utility from token-heavy running. Results on Gemini 3.1 Pro suggest coded trust roots and delayed handoffs prune thought loops and prevent trust bloat.

Catalog record

CREATOREren Unlu
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE15976
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2604.16753

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Know When to Trust the Skill: Delayed Appraisal and Epistemic Vigilance for Single-Agent LLMs Eren Unlu Abstract As large language models (LLMs) transition into autonomous agents integrated with extensive tool ecosystems, traditional routing heuristics increasingly succumb to context pollution and "overthinking". We argue that the bottleneck is not a deficit in algorithmic capability or skill diversity, but the absence of disciplined second-order metacognitive governance. In this paper, our scientific contribution focuses on the computational translation of human cognitive control—specifically, delayed appraisal, epistemic vigilance, and region-of-proximal offloading—into a single-agent architecture. We introduce MESA-S (Metacognitive Skills for Agents, Single-agent), a preliminary framework that shifts scalar confidence estimation into a vector separating self-confidence (parametric certainty) from source-confidence (trust in retrieved external procedures). By formalizing a delayed procedural probe mechanism and introducing Metacognitive Skill Cards , MESA-S decouples the awareness of a skill’s utility from its token-intensive execution. Evaluated under an In-Context Static Benchmark Evaluation natively executed via Gemini 3.1 Pro, our early results suggest that explicitly programming trust provenance and delayed escalation mitigates supply-chain vulnerabilities, prunes unnecessary reasoning loops, and prevents offloading-induced confidence inflation. This architecture offers a scientifically cautious, behaviorally anchored step toward reliable, epistemically vigilant single-agent orchestration. 1 Introduction The prevailing architectural approach to augmenting LLMs with external tools—often characterized as "progressive disclosure" or naive semantic retrieval ( 22 ) —assumes that a model’s ability to match an utterance to a tool description guarantees optimal utility. However, recent empirical audits of large skill ecosystems (e.g., 9 ) and "in the wild" agent deployments ( 10 ) indicate that indiscriminate access to procedural augmentation can actively degrade performance. Models frequently exhibit "overthinking" ( 23 ) , allocating costly test-time compute to verify trivial assertions, or succumb to context pollution when ingesting stale or malicious returns. While metacognitive prompting ( 4 ) and budgeted test-time reasoning ( 11 ) have shown promise, they predominantly focus on expanding reasoning trees rather than governing when external reliance is warranted. Our investigation respectfully seeks to add to this emerging literature by isolating a specific architectural boundary: the decoupling of procedural awareness from procedural execution . Drawing on foundational cognitive psychology, we observe that humans do not instantly commit to total cognitive offloading ( 18 ) ; rather, they rely on conditional metacognitive knowledge ( 19 ) and low-cost, delayed judgments-of-learning ( 14 ) to determine whether internal resources are sufficient. Similarly, human communication avoids blanket trust mechanisms, operating instead through epistemic vigilance ( 20 ) to continuously evaluate the competence and benevolence of external sources. A modern skill repository is, algorithmically, a social learning environment in disguise ( 8 ) . To operate securely within it, a single agent must decide whether an external script "knows better" and whether it should be trusted. We formalize this through MESA-S (Metacognitive Skills for Agents, Single-agent), shifting the routing decision from a singular uncertainty scalar ( 21 ) to a Dual-Confidence architecture. 2 Translating Human Control into Agentic Governance Before establishing the algorithmic implementation, we delineate the three cognitive motifs translated into our architecture. We explicitly reject claims of biological fidelity; we borrow these established cognitive constructs solely to solve the specific context-ceiling and skill-routing bottlenecks observed in state-of-the-art agent orchestration. 2.1 Delayed Metacognitive Escalation In human metamemory, Judgments of Learning (JOLs) made immediately after study are notoriously noisy, whereas judgments made after a brief delay or minimal retrieval attempt are highly predictive of true knowledge boundaries ( 15 ) . Within an LLM context, immediate uncertainty checks often collapse context dynamics. We translate the delayed-JOL effect ( 14 ) into Delayed Metacognitive Escalation . Rather than querying the full skill body immediately upon semantic match, the controller first uses cheap meta-cues and runs a "procedural probe" only escalating to a full file load if the probe indicates that parametric knowledge is insufficient. 2.2 Region-of-Proximal Offloading Research into the Region of Proximal Learning ( 13 ; 12 ) indicates that learners allocate study time not to the easiest or hardest items, but to the intermediate zone where effort yields maximal returns. We apply this to agentic offloading ( 18 ) . Not all uncertainty dictates the same architectural response. Under our framework, tasks are triaged into three explicitly separable offloading classes: • Procedural Offloading: Loading a skill, playbook, or behavioral script. • Epistemic Offloading: Querying standard retrieval tools or calculators to bridge factual knowledge boundaries ( 16 ) . • Evaluative Offloading: Launching verifiers, unit tests, or isolated execution environments to confirm hypothesized outputs. 2.3 Epistemic Vigilance and Confidence Decontamination Exposure to external digital resources, such as internet searches or GenAI advice, frequently inflates a user’s perceived internal knowledge, leading to overconfidence ( 5 ; 2 ) . To combat this inside the agent, MESA-S enforces Confidence Decontamination . The controller maintains a strict bifurcation between local uncertainty interfacing and trajectory-level global confidence ( 6 ; 7 ) . Following the retrieval of an external artifact, fluency increases are discounted algorithmically unless verification protocols or strict trust priors natively support the escalation. 3 Formalizing the MESA-S Architecture Standard LLM routing algorithms optimize for semantic relevance, maximizing expected utility U : a^{*}=\arg\max_{a\in A}\mathbb{E}[U(a|c)] (1) We hypothesize that this formulation collapses distinct probability distributions, blinding the agent to adversarial tool conditions. The core theoretical construct of MESA-S is the transition to a Dual-Confidence matrix. We formally reconceptualize the expected utility by integrating a vigilance prior V_{a} (source trust) and a conflict differential \Delta (the divergence between self-confidence p_{self} and maximum source-confidence p_{source} ): a_{mesa}^{*}=\arg\max_{a\in A}\left(\alpha p_{self}\cdot U(a_{direct})+(1-\alpha)\cdot V_{a}\cdot p_{source|a}\cdot U(a_{offload})-\lambda\cdot Cost(a)\right) (2) Note: Equation 2 acts as a theoretical formalization dictating our controller design. In the current implementation, we execute this architecture implicitly via a structured JSON-prompting controller steering the agent’s latent representations, rather than explicitly parsing the parameters over an abstract syntax tree. 3.1 Metacognitive Skill Cards To operationalize this without exploding context, we introduce Metacognitive Skill Cards . Unlike standard unstructured documentation, these cards encapsulate conditional metacognitive variables, functioning exactly as procedural retrieval cues. Fields such as apply_when , cheap_probe , offloading_type , and source_trust serve as the primary routing plane. They allow the agent to update V_{a} iteratively before committing to execution, effectively solving the tension where metadata saves context but full bodies save routing accuracy ( 22 ) . 3.2 The High-Confidence Control-Failure Bank For retrospective evolution, MESA-S departs from generalized "reflection". Drawing upon the hypercorrection effect—wherein errors committed with high confidence are most rapidly learned and corrected ( 1 ) —we instantiate a prioritized trajectory postmortem. Rather than indiscriminately converting all reasoning into generic behaviors via Metacognitive Reuse ( 3 ) , the controller exclusively updates the skill card metadata for high-confidence failures (e.g., confidently routing to a malicious payload or skipping evaluation). 4 Related Work Recent audits of agentic capabilities demonstrate that unconditional access to skills degrades LLM performance, specifically due to context pollution ( 9 ; 10 ) . While test-time reasoning scaling works aim to combat "overthinking" by budgeting inference ( 23 ; 11 ) , our approach emphasizes externalized metacognition rather than latent search tree extensions. Projects mapping human planning to agents similarly aim to control reasoning loops ( 4 ; 3 ) , but often ignore the underlying social-metacognitive implications of

Read the complete text