Agentic Confidence Calibration

Jiaxin Zhang, Caiming Xiong, Chien-Sheng Wu · 2026

Read Agentic Confidence Calibration by Jiaxin Zhang, Caiming Xiong, Chien-Sheng Wu (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2601-15778.txt.

Introduction

Jiaxin Zhang, Caiming Xiong, and Chien-Sheng Wu study confidence in AI agents in a 2026 arXiv paper. Agents are moving from passive models to autonomous systems. They execute complex, multi-step tasks on their own. Overconfidence in failure remains a fundamental barrier to high-stakes use. An agent that does not know it is failing will not stop or ask for help. Existing calibration methods were built for static, single-turn outputs.

Agent runs break those methods' assumptions. Errors compound along trajectories. External tools inject their own uncertainty. Failure modes stay opaque across long runs. The title names the goal: agentic confidence calibration. Calibrated agents could slow down, verify, or escalate when doubt grows. That behavior is a precondition for trusting agents with real work.

Catalog record

CREATORJiaxin Zhang, Caiming Xiong, Chien-Sheng Wu
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE104 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2601-15778

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Agentic Confidence Calibration Jiaxin Zhang, Caiming Xiong, Chien-Sheng Wu Abstract AI agents are rapidly advancing from passive language models to autonomous systems executing complex, multi-step tasks. Yet their overconfidence in failure remains a fundamental barrier to deployment in high-stakes settings. Existing calibration methods, built for static single-turn outputs, cannot address the unique challenges of agentic systems, such as compounding errors along trajectories, uncertainty from external tools, and opaque failure modes. To address these challenges, we introduce, for the first time, the problem of Agentic Confidence Calibration and propose Holistic Trajectory Calibration ( HTC ) , a novel diagnostic framework that extracts rich process-level features ranging from macro dynamics to micro stability across an agent’s entire trajectory. Powered by a simple, interpretable model, HTC consistently surpasses strong baselines in both calibration and discrimination, across eight benchmarks, multiple LLMs, and diverse agent frameworks. Beyond performance, HTC delivers three essential advances: it provides interpretability by revealing the signals behind failure, enables transferability by applying across domains without retraining, and achieves generalization through a General Agent Calibrator ( GAC ) that achieves the best calibration (lowest ECE) on the out-of-domain GAIA benchmark. Together, these contributions establish a new process-centric paradigm for confidence calibration, providing a framework for diagnosing and enhancing the reliability of AI agents. Figure 1: Overview of Holistic Trajectory Calibration ( HTC ). The framework first collects confidence signals along the agent’s trajectory, then derives rich process-level diagnostic features, which are used to train a simple yet interpretable calibrator. This process not only improves calibration accuracy but also yields the three pillars of reliable agentic AI: interpretability , transferability , and generalization . 1 Introduction Large Language Models (LLMs) are rapidly evolving from static or retrieval-augmented text-generation tools into the core reasoning engines of complex, multi-step agentic systems ( 36 ; 33 ) . These agents, which integrate sophisticated capabilities such as planning, using tools, and handling memory ( 36 ; 29 ) , can autonomously interact with dynamic environments to solve complex problems. As these systems are increasingly deployed in high-stakes, safety-critical domains, their reliability has emerged as the most critical and yet unresolved challenge ( 33 ; 23 ) . Ensuring that we can trust the outputs of these powerful but opaque systems is critical for their responsible adoption. This shift from a static generator to a dynamic actor fundamentally alters the nature of the reliability challenge. First, uncertainty is no longer an isolated property of a single output, but a compounding factor that accumulates and propagates throughout a sequential trajectory ( 7 ; 41 ) . An early, low-confidence decision-such as erroneously selecting a tool, can “poison” the entire subsequent execution path, leading to an agent holding high confidence in a completely incorrect result. Second, agents introduce new, external sources of uncertainty through their interaction with tools and environments ( 22 ) . API failures, noisy data returned by tools, or the misuse of a tool’s functionality create new reliability bottlenecks independent of the model’s internal knowledge. Finally, the multi-step nature of agentic processes makes failure modes more opaque. A final incorrect answer may not stem from the last reasoning step, but from a critical, masked breakdown that occurs at a specific intermediate step earlier in the trajectory ( 8 ) . Agent calibration also faces a fundamental data scarcity challenge that means each agent trajectory represents an expensive execution involving LLM inference, tool interactions, and human evaluation for ground truth labels. This constraint shapes us toward sample-efficient and interpretable methods. In light of these unique challenges, existing approaches to confidence estimation are insufficient. On one hand, traditional calibration techniques like Temperature Scaling ( 13 ) were designed for post-hoc correction of static, single-point classification predictions. Methodologically, they are incapable of processing sequential trajectory data and thus completely ignore the process-level information that could reveal the root cause of an agent’s failure. On the other hand, while recent work has begun to explore more fine-grained confidence signals ( 9 ) , these efforts often rely on coarse aggregation methods like global averaging, which can mask local yet critical reasoning failures ( 8 ) , or are limited to evaluating pure reasoning chains without external tool interaction ( 35 ) , see more related work in Appendix A.1 . Consequently, a significant gap exists in the current studies: there is a lack of a systematic framework for effectively calibrating the confidence of an agent’s final output by diagnosing its entire execution trajectory . In this work, we introduce the new problem of Agentic Confidence Calibration (ACC) : estimating the likelihood that an agent’s trajectory will succeed by diagnosing its entire execution process rather than only its final output. As illustrated in Figure 1 , this process-centric perspective raises three key challenges: uncertainty signals dispersed across multiple temporal scales, compounding noise from both model and environment, and limited availability of labeled data. To address these challenges, we propose Holistic Trajectory Calibration ( HTC ) , a novel framework that transforms raw confidence traces into a rich set of process-diagnostic features, encompassing cross-step dynamics, intra-step stability, positional indicators, and structural attributes. These features are then mapped through a simple, interpretable model to produce calibrated confidence estimates. Importantly, HTC is decoupled from any specific agent architecture, making it lightweight, transparent, and broadly applicable across diverse tasks and frameworks. Our study demonstrates that HTC brings three key benefits: • Interpretability : By grounding calibration in trajectory-level features such as early-step entropy, confidence gradients, and stability dynamics, HTC exposes the signals behind model confidence, enabling transparent diagnosis of failure modes and guiding principled agent design. • Transferability : Once trained, an HTC calibrator can be seamlessly applied across tasks and domains without retraining, delivering consistent gains in both calibration and discrimination and reducing dependence on costly, task-specific tuning. • Generalization : Pre-training a General Agent Calibrator (GAC) on diverse datasets yields a universal reliability layer that achieves the best calibration (lowest ECE) on out-of-domain challenges such as GAIA, pointing toward a scalable foundation for trustworthy agentic AI. Across eight benchmarks, multiple agent frameworks, and both closed- and open-source LLMs, we show that HTC reliably outperforms strong baselines. Beyond empirical gains, HTC establishes a process-centric paradigm for agentic confidence calibration, uniting interpretability, transferability, and generalization, three essential components for building reliable and trustworthy AI agents. 2 Method 2.1 Holistic Trajectory Calibration: A New Formulation An agent system is defined as a policy \pi that, at step t , maps the interaction history h_{t} to an action a_{t}\in\mathcal{A}:a_{t}=\pi(h_{t}),h_{t}=(s_{0},a_{1},o_{1},\ldots,s_{t}) . The environment \Omega executes a_{t} from state s_{t} and returns an observation o_{t}\in\mathcal{O} together with the next state via a (possibly stochastic) transition kernel (o_{t},\,s_{t+1})\sim\delta(\,\cdot\mid s_{t},a_{t}\,) . This interaction produces an execution trajectory , \mathcal{T}=\big(s_{0},\,a_{1},o_{1},\mathcal{L}_{1},\,s_{1},\,a_{2},o_{2},\mathcal{L}_{2},\,\ldots,\,a_{N},o_{N},\mathcal{L}_{N},\,s_{N}\big), (1) which records the complete problem-solving process up to termination at step N . For LLM-based agents, each action a_{t} (e.g., thinking, planning pr or tool call) is generated by an LLM \mathcal{M} . We denote by \mathcal{L}_{t}=(\ell_{t,1},\ldots,\ell_{t,m_{t}}) the sequence of token-level log-probabilities produced when generating a_{t} , where m_{t} is the number of tokens in action a_{t} . By concatenating these sequences across all N steps, we obtain the log-probability trajectory after LLM execution: \mathcal{L}_{\mathcal{T}}=\Big((\ell_{1,1},\ldots,\ell_{1,m_{1}}),\;(\ell_{2,1},\ldots,\ell_{2,m_{2}}),\;\ldots,\;(\ell_{N,1},\ldots,\ell_{N,m_{N}})\Big). (2) This trajectory captures the agent’s complete

Read the complete text