Proper Scoring Rules for Agentic Uncertainty Quantification

Suresh Raghu, Satwik Pandey, Shashwat Pandey · 2026

Read Proper Scoring Rules for Agentic Uncertainty Quantification by Suresh Raghu, Satwik Pandey, Shashwat Pandey (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-24756.txt.

Introduction

Suresh Raghu and co-authors argue that agentic uncertainty scores mix ranking skill with true odds. Common metrics test ranking, calibration, or short summaries, but none elicit the full success trace. They introduce the Trajectory Proper Score, a family of rules for any per-step uncertainty signal, built on prequential scoring. They prove it elicits the success process in full view. An extension handles cut-off runs by mapping them onto the stopped part. Tests on four benchmarks show recalibration shifts the score while rank metrics stay nearly unchanged.

Catalog record

CREATORSuresh Raghu, Satwik Pandey, Shashwat Pandey
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE131990
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2605.24756

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Proper Scoring Rules for Agentic Uncertainty Quantification Suresh Raghu, Satwik Pandey, Shashwat Pandey Abstract Language-model agents increasingly emit uncertainty signals throughout a trajectory, but existing agentic UQ evaluations often conflate ranking usefulness with probabilistic truthfulness. AUROC, AUPRC, risk–coverage, Trajectory ECE, and scalarized trajectory scores evaluate discrimination, binwise calibration, or collapsed summaries, but do not strictly elicit the full prefix-conditioned success-probability trace q t = ℙ π ​ ( Y = 1 ∣ ℋ t ) q_{t}=\mathbb{P}^{\pi}(Y{=}1\mid\mathcal{H}_{t}) . Building on prequential proper scoring, we introduce the Trajectory Proper Score ( TPS \mathrm{TPS} ), a predictor-agnostic family of strictly proper trajectory-level scoring rules for any per-step uncertainty signal calibrated into a probability of eventual success. We prove that TPS \mathrm{TPS} strictly elicits the success-probability process under complete observation, within the chosen score family and weight schedule. We extend the construction to administratively censored trajectories by projecting the complete-data score onto the observable stopped prefix, yielding an exact q Z q_{Z} -weighted reduced score and a tractable approximation when q Z q_{Z} is unestimated. We further show that common trajectory evaluators target weaker objects than the full prefix-conditioned probability process: Trajectory ECE is resolution-blind, while scalarized Trajectory Brier elicits only the collapsed scalar, not the full trace. Experiments on StrategyQA, Tau2-Bench, HotpotQA, and WebShop show that these theoretical distinctions are operationally visible: probability recalibration can substantially change TPS \mathrm{TPS} while leaving rank metrics nearly unchanged, and the tractable censored approximation can change the verdict relative to complete-only evaluation. 1 Introduction Language-model agents increasingly act through extended trajectories: they observe, reason, call tools, revise plans, and eventually either succeed or fail. In such settings, uncertainty is not a property of the final answer alone. A useful agent should know, at each prefix of the interaction, how likely the task is to succeed from that point onward. Recent agentic UQ work has moved from final-answer uncertainty toward trajectory-level signals, including stepwise calibration, propagated uncertainty, and trajectory confidence aggregation [ 34 , 10 , 33 , 28 ] . These methods mark an important shift, but they leave open a more basic evaluator-side question: what should count as a correct evaluation of such a trace? We argue that the missing object is a strictly proper evaluator for the prefix-conditioned probability process. Existing trajectory evaluations typically rely on AUROC, trajectory-ECE, or scalarized trajectory-Brier. These are useful diagnostics for particular summaries: AUROC measures rank discrimination, ECE measures binwise marginal calibration, and scalar Brier scores a collapsed binary probability. None of them, however, strictly elicits the full process (F_{t})_{t=1}^{T} , where F_{t} is the agent’s reported probability of eventual task success from the current prefix. This distinction matters: two agents can induce similar rankings while assigning very different probabilities, and downstream interventions such as deferral, reflection, or human handoff depend on the probability scale, not only on rank. The forecast object in this paper is deliberately simple. At step t , after observing history \mathcal{H}_{t} , the agent reports F_{t}\in[0,1] , interpreted as the probability that the task will eventually succeed. The truthful target is q_{t}:=\mathbb{P}^{\pi}(Y=1\mid\mathcal{H}_{t}), the continuation-success probability under the evaluation law. This process need not be monotone: a calibrated agent should lower F_{t} after a harmful action and raise it after acquiring useful evidence [ 18 ] . We make the following contributions. 1. We formalize agentic uncertainty evaluation as strictly proper elicitation of the prefix-conditioned success process q_{t}=\mathbb{P}^{\pi}(Y=1\mid\mathcal{H}_{t}) , and define the weighted trajectory score \mathrm{TPS}(F_{1:T},Y)=\sum_{t=1}^{T}w_{t}\,S_{\alpha,\beta}(F_{t},Y). 2. We extend the trajectory score to censored traces via conditional projection onto the observable prefix. In the binary agentic setting this reduces to an exact censored score parameterized by a single continuation-success weight q_{Z} . 3. We show that common trajectory evaluators target weaker objects: trajectory-ECE is resolution-blind, and scalarized trajectory-Brier is proper only for a collapsed scalar rather than the full prefix-conditioned trace. 4. Empirically, we show that recalibration can leave rank-based metrics nearly unchanged while strictly proper trajectory scores reveal large probability-scale errors, and that censored-aware scoring yields different conclusions from complete-only evaluation on administratively censored agent trajectories. The aim of this work is to separate the question of how an agent produces uncertainty from the question of whether the reported uncertainty means what it says. \mathrm{TPS} is agnostic to the source of the signal: verbal confidence, token-probability features, post-hoc calibrators, and predictor-side agentic UQ methods such as SAUP, UProp, and AUQ can all be evaluated once expressed as prefix-conditioned success probabilities. 2 Related Work Strictly proper scoring rules provide the classical language for evaluating probabilistic forecasts. A proper score rewards truthful probability reporting, and a strictly proper score makes the truthful report the unique optimum; Gneiting and Raftery [ 13 ] characterize regular proper scores as those generated by a convex function. In the binary case, proper scores admit threshold-mixture representations [ 24 ] ; the beta family S_{\alpha,\beta} uses this view to recover log and Brier scores as special cases while allowing bounded asymmetric cost shaping [ 5 ] . Calibration–resolution–uncertainty decompositions further show why marginal calibration is not enough: a forecast can be reliable on average while carrying little resolution about the outcome [ 22 , 8 , 4 ] . This distinction is central for agentic UQ, where an evaluator should reward informative prefix-conditioned probabilities rather than only binwise calibration. Our complete-data trajectory score applies this binary scoring-rule machinery at each prefix and aggregates the resulting scores with positive weights. Proper scoring under censoring has been studied mainly in survival analysis, where right-censored event times require observable-data extensions of complete-data scores. Rindt et al. [ 23 ] prove that a censored log-score extension is strictly proper for right-censored survival times, while Blanche et al. [ 3 ] show that common survival metrics, including C-index variants and integrated Brier-style scores, can fail propriety. Yanagisawa [ 29 ] systematizes this view by extending multiple proper scoring rules to censored observations and identifying when the required censoring weights are valid. Our censored extension borrows this conditional-projection view, but targets a different forecast object: F_{t}=\Pr(Y=1\mid\mathcal{H}_{t}) , the probability of one fixed terminal outcome from the current agent prefix, rather than a cumulative event-time distribution. Thus the trace may rise or fall as evidence, mistakes, or recovery occur, unlike the monotone CDF target in standard survival analysis. Agentic uncertainty quantification has so far focused mainly on producing uncertainty signals. Local predictors include verbalized confidence [ 15 ] , token-level measures such as log-probability and predictive entropy [ 21 , 9 ] , and semantic entropy over sampled responses [ 19 ] . More recent agentic methods move from local signals to trajectory-level uncertainty: SAUP propagates step uncertainty with situation-aware weights [ 34 ] , UProp studies how uncertainty is inherited across multi-step decision chains [ 10 ] , AUQ evaluates trajectory confidence aggregators such as \Phi_{\mathrm{last}} , \Phi_{\mathrm{avg}} , and \Phi_{\min} [ 33 ] , and STeCa uses step-level calibration signals for agent learning [ 28 ] . These methods describe how uncertainty signals are produced, propagated, or used; we ask how to evaluate them once expressed as prefix-conditioned success probabilities. Evaluation practice has not kept pace with the predictor side. UProp evaluates uncertainty with AUROC and selective-prediction metrics such as AUARC, while AUQ evaluates trajectory-level confidence aggregators

Read the complete text