Agentic Uncertainty Quantification
Jiaxin Zhang, Prafulla Kumar Choubey, Kung-Hsiang Huang · 2026
Read Agentic Uncertainty Quantification by Jiaxin Zhang, Prafulla Kumar Choubey, Kung-Hsiang Huang (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2601-15703.txt.
Introduction
Jiaxin Zhang, Prafulla Kumar Choubey, and Kung-Hsiang Huang tackle trust in AI agents in a 2026 arXiv paper. Agents now reason over long horizons with real skill. Early errors can poison that whole run, though. The authors name this the spiral of hallucination. Small epistemic mistakes propagate and cannot be undone. Existing tools split into two camps, each with a flaw.
Uncertainty methods act as passive sensors. They flag risk but do not fix it. Self-reflection methods try to fix errors, but their corrections can be aimless. The title names the authors' aim: agentic uncertainty quantification that does more. A system that measures doubt and acts on it could stop spirals early. For long agent runs in real work, that combination is the missing piece.
Catalog record
| CREATOR | Jiaxin Zhang, Prafulla Kumar Choubey, Kung-Hsiang Huang |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 107 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2601-15703
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Agentic Uncertainty Quantification Jiaxin Zhang, Prafulla Kumar Choubey, Kung-Hsiang Huang Abstract Although AI agents have demonstrated impressive capabilities in long-horizon reasoning, their reliability is severely hampered by the “Spiral of Hallucination,” where early epistemic errors propagate irreversibly. Existing methods face a dilemma: uncertainty quantification (UQ) methods typically act as passive sensors, only diagnosing risks without addressing them, while self-reflection mechanisms suffer from continuous or aimless corrections. To bridge this gap, we propose a unified Dual-Process Agentic UQ ( AUQ ) framework that transforms verbalized uncertainty into active, bi-directional control signals. Our architecture comprises two complementary mechanisms: System 1 (Uncertainty-Aware Memory, UAM ), which implicitly propagates verbalized confidence and semantic explanations to prevent blind decision-making; and System 2 (Uncertainty-Aware Reflection, UAR ), which utilizes these explanations as rational cues to trigger targeted inference-time resolution only when necessary. This enables the agent to balance efficient execution and deep deliberation dynamically. Extensive experiments on closed-loop benchmarks and open-ended deep research tasks demonstrate that our training-free approach achieves superior performance and trajectory-level calibration. We believe this principled framework AUQ represents a significant step towards reliable agents. 1 Introduction Figure 1: Overview of Dual-Process Agentic UQ Framework. To address the spiral of hallucination challenges in long-horizon agents, AUQ transforms verbalized uncertainty into active, bi-directional control signals, comprising two complementary mechanisms: System 1 (Uncertainty-Aware Memory, UAM ), which implicitly propagates verbalized confidence and semantic explanations to prevent blind decision-making; and System 2 (Uncertainty-Aware Reflection, UAR ), which utilizes these explanations as rational cues to trigger targeted inference-time resolution only when necessary. This allows the agent to balance efficient execution and deep deliberation dynamically. The transition from LLMs to autonomous agents has unlocked capabilities in long-horizon reasoning and tool use ( 40 ; 30 ) . However, as agents operate in dynamic environments, they face a critical reliability bottleneck: the “Curse of Recursion” 3 . Unlike single generation, agentic workflows are prone to “Spiral of Hallucination” ( 8 ; 42 ; 16 ) , where a minor grounding error in an early reasoning step propagates through the context window, biasing all subsequent planning towards an irreversible failure state 43 . To deploy agents in high-risk real-world scenarios, they need not only reasoning capabilities but also the ability to detect when they are deviating from the correct path before errors propagate. Addressing this fragility of long horizons necessitates a shift from blind execution to conscious control. For an agent to be reliable, it must be aware of its own limitations, and know when it knows and when it does not 14 . Recent work like UProp ( 7 ) and SAUP ( 44 ) have formally characterized uncertainty propagation , mathematically demonstrating how local epistemic errors compound into global failures 41 . While they successfully quantify the risk, they do not inherently provide a mechanism to resolve it. Conversely, current mitigation strategies rely on self-reflection mechanisms ( 31 ; 26 ) . However, without access to ground-truth labels (unavailable in open-ended tasks), standard reflection is often triggered blindly or incessantly, leading to computational inefficiency or the sycophancy effect ( 13 ) , where the model hallucinates justifications for its errors 28 . More discussions can be found in the related work section in Appendix A.1 . We believe that reliable long-term intelligent agents need to bridge this gap by transforming uncertainty into bidirectional control signals: Forward Propagation for constraint and Inverse Calibration for problem-solving. To this end, we propose Uncertainty-Aware Memory ( UAM ) to explicitly retain verbalized confidence and explanations in the agent’s context window. This leverages the Transformer’s attention mechanism to naturally suppress overconfidence, creating a soft cognitive constraint that prevents errors from solidifying (Forward). Simultaneously, when suppression signals critical instability, the retained explanation serves as a rational cue , transforming vague epistemic anxiety into targeted diagnosis via Uncertainty-Aware Reflection ( UAR ) (Inverse). Unlike single-step generation (where the process ends at the output), our agent utilizes this cue to trigger targeted actions, such as switching tools or expanding retrieval, effectively transforming epistemic uncertainty into an information-search strategy. This dual mechanism transforms uncertainty from a passive indicator into an active control signal, implicitly constraining the operation of System 1 (fast, intuitive) using memory and explicitly guiding the operation of System 2 (slow, reflective) using interpretation 15 ; 21 . To realize this vision, we propose a unified framework for Agentic UQ based on a dual-process architecture. Our key contributions are threefold: • We formally decouple Agentic UQ into two complementary mathematical problems: Forward Uncertainty Propagation (preventing epistemic errors from solidifying into history) and Inverse Uncertainty Calibration (using inference-time compute to correct deviations). To our knowledge, this is the first work to frame agent reliability through this dual-process lens. • We introduce a novel dual-process architecture, combining System 1 (Uncertainty-Aware Memory) and System 2 (Uncertainty-Aware Reflection) , as well as a trajectory-level evaluation metric, tailored for long-horizon reliability calibration. Our approach is a training-free framework, which enables the agent to dynamically balance efficient execution with deep deliberation. • We validate the framework across diverse domains, spanning embodied decision-making ( ALFWorld ), web agents ( WebShop ), and open-ended reasoning ( DeepResearch ). Our results demonstrate that AUQ achieves superior performance, effectively bridging the gap between passive UQ and active agentic control, while yielding superior trajectory-level calibration. 2 Preliminaries 2.1 Long-horizon Agentic Process We model the long-horizon agent’s system as a Partially Observable Markov Decision Process (POMDP) defined by the tuple \mathcal{E}=(\mathcal{S},\mathcal{A},\Omega,\mathcal{T},\mathcal{R}) . At step t , the agent acts based on a history-dependent policy \pi(a_{t}|h_{t}) , where h_{t}=(o_{0},a_{0},\dots,o_{t}) represents the observed trajectory. Unlike single-step LLM, where the full context is visible, autonomous agents operate under state uncertainty (the true state s_{t} is latent). The agent maintains an implicit belief state b_{t}(s_{t})=P(s_{t}|h_{t}) . In this context, reliability failure occurs when the agent’s internal belief b_{t} diverges from the true state s_{t} , while the policy \pi continues to act on this flawed belief. Therefore, the core objective of Agentic UQ is to quantify the uncertainty of b_{t} and its propagation over trajectories. 2.2 Decomposing Uncertainty: From Static to Agentic Classical UQ distinguishes between aleatoric and epistemic uncertainty 17 , but these definitions undergo a semantic shift, particularly regarding their temporal interaction. Aleatoric Uncertainty (Environmental Stochasticity) : typically refers to inherent randomness of systems and irreducible noise in data. In agentic settings, it maps to the stochasticity of the environment interface . This represents the objective, external friction of the world that the agent cannot eliminate but must robustly handle. Epistemic Uncertainty (Cognitive Deficiency) : Traditionally, this stems from a lack of knowledge and ignorance of model parameters. In Agentic Context: it maps to the agent’s reasoning limitations , manifesting as hallucinations, logic gaps, or memory failures. Crucially, this is reducible via better reasoning strategies or external knowledge. The Entanglement in Long Trajectories : A key insight of our work is that these two uncertainties are not independent in agentic UQ. When an agent acts with high epistemic uncertainty at step t and commits it to the history h_{t} , this error becomes part of the “ground truth” context for step t+1 . This phenomenon, which we term the Spiral of Hallucination , effectively transforms the agent’s internal cognitive