Confidence-Gated Robot Autonomy: When Does Uncertainty Actually Help?
Johannes A. Gaus, Jhon P.F. Charaja, Daniel Haeufle · 2026
Read Confidence-Gated Robot Autonomy: When Does Uncertainty Actually Help? by Johannes A. Gaus, Jhon P.F. Charaja, Daniel Haeufle (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-18045.txt.
Introduction
Johannes A. Gaus and two colleagues ask when uncertainty helps autonomy. In threshold-gated autonomy, it matters mainly for ranking likely errors, but expected calibration error and AUROC do not test whether it changes act-or-defer decisions. The team evaluates it with rank correlation, bootstrap equivalence testing, and act-or-defer agreement. Across three benchmarks, they find a competence regime below which it ranks errors weakly and unstably. Above it, softmax heuristics, MC Dropout, and ensembles behave alike, while threshold choice matters much more for execution outcomes.
Catalog record
| CREATOR | Johannes A. Gaus, Jhon P.F. Charaja, Daniel Haeufle |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 30606 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2605.18045
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Confidence-Gated Robot Autonomy: When Does Uncertainty Actually Help? Johannes A. Gaus, Jhon P.F. Charaja, Daniel Haeufle Abstract Robotic systems often use predictive uncertainty to decide whether to act autonomously or defer to a fallback policy. In threshold-gated autonomy, uncertainty matters mainly through its ability to rank likely errors. Standard metrics such as expected calibration error and AUROC do not directly test whether uncertainty changes act/defer decisions. We therefore evaluate uncertainty using Spearman rank correlation, paired bootstrap equivalence testing, and act/defer agreement. Across three temporal activity-recognition benchmarks, we find a dataset-dependent competence regime below which uncertainty provides a weak and unstable error ranking. Above this regime, softmax heuristics, MC Dropout, and ensembles produce similar gating behavior, while threshold choice has a much larger effect on execution outcomes. A multi-seed embodied simulation shows the same pattern for collision rate and cost once realized autonomy is matched. Under temporal covariate shift, ranking quality remains stable, but fine-grained semantic OOD detection remains near chance. These results suggest that simple uncertainty proxies can suffice for selective gating once the base model is competent, but not for semantic novelty detection. I Introduction Robotic systems must estimate not only the most likely state of the world, but also whether that estimate is reliable enough for autonomous execution [ 2 ] . A common mechanism is confidence-gated autonomy: a perception model predicts an action or activity label, and an uncertainty score determines whether the robot acts autonomously or defers to a fallback policy. This is closely related to selective prediction and reject-option decision making, which formalize the risk–coverage trade-off induced by abstention [ 8 , 1 ] . In practice, uncertainty is often derived from softmax probabilities using entropy, margin, or least confidence, although Bayesian approximations and ensembles are also common. This raises a practical question: how should uncertainty be evaluated when its role is to gate execution rather than provide calibrated probabilities? Standard metrics such as expected calibration error (ECE) and area under the receiver operating characteristic curve (AUROC) do not directly answer whether two estimators induce materially different act/defer decisions. We study this question in threshold-gated temporal activity recognition along two axes: model competence and distribution shift. Across three benchmarks, we find that uncertainty becomes decision-useful only after the base model enters a dataset-dependent competence regime. Above this regime, softmax heuristics, MC Dropout, and ensembles induce similar gating behavior, while threshold choice has a much larger effect on execution outcomes. Under temporal covariate shift, ranking quality remains stable enough for selective deferral, whereas fine-grained semantic OOD detection remains weak. Figure 1 summarizes the setting. Fig. 1: Confidence-gated autonomy: a classifier produces an uncertainty score u(x) , and threshold \tau determines whether the robot executes autonomously or defers to fallback. In our experiments, varying \tau changes behavior far more than switching uncertainty estimators. Contributions. • We introduce a decision-centric evaluation protocol for confidence-gated autonomy based on rank correlation, paired bootstrap equivalence testing, and act/defer agreement. • We identify dataset-dependent competence regimes below which uncertainty does not reliably rank prediction errors for gating. • We show that threshold choice has a substantially larger effect on execution outcomes than estimator choice, both offline and in a minimal embodied simulation, while fine-grained semantic OOD detection remains near chance. II Related Work Uncertainty Quantification and Calibration. Predictive uncertainty methods include MC Dropout [ 7 ] and deep ensembles [ 16 , 21 ] . However, improved calibration does not necessarily improve error ranking for selective prediction [ 5 ] . Autonomy Adjustment and Risk-Aware Robotics. In robotics, uncertainty is used for selective execution, shared autonomy, and introspection [ 19 , 2 , 11 , 12 ] , as well as risk-sensitive control through chance constraints or CVaR [ 20 ] . Our focus is narrower: when uncertainty is useful for threshold-gated autonomy and when common proxies are effectively interchangeable. Task-Driven Shift Detection. Related work detects distribution shift through task-level performance violations rather than input novelty alone [ 6 ] . This helps explain why temporal covariate shift and semantic held-out-class detection behave differently in our experiments. Selective Prediction and Evaluation Pitfalls. Selective prediction formalizes the coverage–risk trade-off [ 1 , 8 ] . Common evaluations use risk–coverage curves, SelectiveNet, or AUROC [ 9 , 3 ] , but global metrics such as ECE or AUROC may fail to reflect decision-level utility in structured robotic tasks [ 5 ] . Recent work has also highlighted pitfalls in multi-threshold evaluation of selective systems [ 22 ] . In robotics, related conformal and risk-calibrated methods focus on safety guarantees or action-set calibration rather than whether scalar uncertainty scores induce different threshold-gated act/defer behavior [ 18 , 17 ] . Competence-Dependent Utility of Uncertainty. Aleatoric and epistemic uncertainty remain central in uncertainty quantification [ 14 , 13 , 4 ] . Our focus is complementary: when increasing base-model accuracy makes uncertainty reliable enough to rank prediction errors for gating. III Problem Formulation: Confidence-Gated Autonomy We consider a temporal classifier that maps each input sequence x\in\mathcal{X} to a predictive distribution over labels \mathcal{Y} , \mathbf{p}(x)=[p_{1}(x),\dots,p_{K}(x)],\qquad\sum_{k=1}^{K}p_{k}(x)=1, (1) with prediction \hat{y}(x)=\arg\max_{k}p_{k}(x) . Each input is also assigned a scalar uncertainty score u(x) , used only for ranking, with larger values indicating greater uncertainty. Confidence-like scores such as margin are sign-reversed so that all methods share the same ordering convention. Autonomous execution is controlled by threshold \tau : \pi_{\tau}(x)=\begin{cases}1,&u(x)\leq\tau,\\ 0,&\text{otherwise},\end{cases} (2) where \pi_{\tau}(x)=1 denotes autonomous execution and \pi_{\tau}(x)=0 deferral. Smaller \tau lowers coverage and executed error; larger \tau increases both. IV A Decision-Centric Evaluation Framework We evaluate uncertainty as a decision variable rather than a probabilistic quantity. The framework combines Spearman rank correlation, paired bootstrap equivalence testing, and act/defer agreement under threshold sweeps to test whether differences between methods are operationally meaningful. IV-A Uncertainty Scores We evaluate seven scores: four softmax-derived heuristics (entropy, margin, variation ratio, least confidence), MC Dropout predictive entropy, MC Dropout epistemic variance from T=30 stochastic passes, and 3-member ensemble entropy. These span lightweight deterministic proxies and standard posterior approximations [ 7 , 16 ] . IV-B Metrics for Ranking-Based Gating Ranking Quality. Because confidence-gated execution depends primarily on the ordering of predictions by uncertainty, we evaluate ranking quality using Spearman rank correlation between uncertainty scores and the binary error indicator, \rho=\mathrm{corr}_{\mathrm{rank}}\!\left(u(x),\mathbb{1}\!\left[\hat{y}(x)\neq y\right]\right). (3) Here, y denotes the ground-truth label. Although the error indicator is binary, Spearman \rho still captures whether higher uncertainty is assigned to erroneous predictions more often than to correct ones, which is the key requirement for confidence-gated autonomy. AUROC. We report AUROC as a familiar baseline, but our main conclusions rely on rank correlation, equivalence testing, and decision-level agreement because these align more directly with threshold-gated autonomy. IV-C Paired Bootstrap and Practical Equivalence All metrics are estimated with nonparametric bootstrap resampling over test examples ( B=1000 ). When comparing methods, we use paired bootstrap resampling so that metric differences are computed on the same resampled test sets. Rather than testing only for nonzero differences, we assess practical equivalence with margin \delta=0.01 for ranking metrics [ 15 ] . We use \delta=0.01 as a conservative small-effect threshold because differences of this magnitude in Spearman \rho were not expected to induce materially different coverage-matched act/defer decisions in our setting. Specifically, two methods are considered