Uncertainty Gating for Cost-Aware Explainable Artificial Intelligence

Georgii Mikriukov, Grégoire Montavon, Marina M.-C. Höhne · 2026

Read Uncertainty Gating for Cost-Aware Explainable Artificial Intelligence by Georgii Mikriukov, Grégoire Montavon, Marina M.-C. Höhne (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-29915.txt.

Introduction

Mikriukov, Montavon, and Höhne use model uncertainty to gate costly explanations. Post-hoc explanations can be slow to compute and are not always faithful. High epistemic uncertainty marks zones where the decision boundary is fuzzy. Explanations there tend to be unstable and unfaithful, they find. That signal can route samples to cheap or pricey methods. It can also defer shaky explanations when budgets are tight. Tests span four datasets, five model types, and four explanation methods.

Catalog record

CREATORGeorgii Mikriukov, Grégoire Montavon, Marina M.-C. Höhne
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE52831
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2603.29915

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Uncertainty Gating for Cost-Aware Explainable Artificial Intelligence Georgii Mikriukov, Grégoire Montavon, Marina M.-C. Höhne Abstract Post-hoc explanation methods are widely used to interpret black-box predictions, but their generation is often computationally expensive and their reliability is not guaranteed. We propose epistemic uncertainty as a low-cost proxy for explanation reliability: high epistemic uncertainty identifies regions where the decision boundary is poorly defined and where explanations become unstable and unfaithful. This insight enables two complementary use cases: ‘improving worst-case explanations’ (routing samples to cheap or expensive XAI methods based on expected explanation reliability), and ‘recalling high-quality explanations’ (deferring explanation generation for uncertain samples under constrained budget). Across four tabular datasets, five diverse architectures, and four XAI methods, we observe a strong negative correlation between epistemic uncertainty and explanation stability. Further analysis shows that epistemic uncertainty distinguishes not only stable from unstable explanations, but also faithful from unfaithful ones. Experiments on image classification confirm that our findings generalize beyond tabular data. ⋆ 1 1 footnotetext: The code is available at https://github.com/comrados/uq-xai . 1 Introduction Explainable AI (XAI) methods have become essential for interpreting black-box model predictions in high-stakes domains [ 1 , 4 ] . In particular, ‘model-agnostic’ explanations [ 18 , 27 ] have proven flexible across a wide range of models, but this comes with substantial computational cost and unreliable outputs: explanations may inherit uncertainty from the model or arise from biases intrinsic to the explanation technique, often in an input-dependent manner. Existing evaluation criteria such as faithfulness and stability [ 35 , 2 ] can detect unreliable explanations, but only retrospectively and at high computational cost, making them impractical at runtime. Thus, current XAI lacks a low-cost mechanism to decide how much computational effort to invest in an explanation before generating it. Uncertainty quantification (UQ) addresses model reliability by identifying regions where predictions are poorly supported by training data. Recent works connect UQ with XAI – using explanations to estimate uncertainty [ 28 ] , analyzing how uncertainty undermines explanation stability [ 8 ] , or explaining uncertainty itself [ 6 ] – yet all still require generating explanations first. Most closely related, [ 38 ] uses uncertainty to guide explanation type selection or reject unreliable explanations. However, no prior work frames uncertainty-guided XAI resource allocation as a cost-benefit problem, where deferring explanations yields computational savings or prevents misleading attributions. In this paper, we systematically explore the relationship between epistemic uncertainty and explanation reliability across multiple datasets, architectures, and XAI methods. We hypothesize that explanations are inherently unstable and unfaithful in high epistemic uncertainty regions, enabling two complementary use cases: (1) improving worst-case explanations , where epistemic uncertainty routes samples to low- or high-cost XAI methods depending on expected reliability, and (2) recalling high-quality explanations , where explanation generation is deferred for high-uncertainty samples under constrained computational budget. For models without low-cost native epistemic uncertainty estimation, lightweight surrogate models provide effective proxies. Our contributions are as follows: • UQ-XAI correlation analysis: We identify systematic relationships between epistemic uncertainty and XAI stability and faithfulness, including a clear monotonic pattern across epistemic strata (low > medium \gg high). • Uncertainty-guided resource allocation: We propose a framework that routes explanation effort based on epistemic uncertainty and quantify the resulting cost-quality trade-offs across XAI methods and deferral regimes. • Cost-efficient epistemic proxies: We demonstrate that lightweight uncertainty estimators (e.g., random forest) provide sufficiently strong signals to enable reliable gating at negligible overhead relative to XAI cost. 2 Related Work Our work lies at the intersection of uncertainty quantification, XAI, and AI robustness under perturbations, with a focus on tabular data. The related work can be organized in three categories. Methods for Uncertainty Quantification Uncertainty quantification (UQ) distinguishes aleatoric uncertainty , induced by inherent data noise, from epistemic uncertainty , reflecting limited model knowledge in underrepresented regions [ 13 , 14 ] . For ensemble-based models, epistemic uncertainty is typically computed as prediction variance across ensemble members: \displaystyle\mathcal{U}_{\text{epi}}(\mathbf{x})=\text{Var}_{m}[f_{m}(y=k|\mathbf{x})], (1) Established methods include prediction variance for random forests [ 30 ] , deep ensembles and MC Dropout for neural networks [ 16 , 12 ] , surrogate-based approaches for gradient boosting [ 21 , 10 ] , and bootstrap resampling for linear models [ 11 ] . In contrast to these works, we do not propose a new method for estimating predictive uncertainty but use the latter as a criterion for deciding how much effort is required to explain those predictions. Evaluating Explanation Methods As XAI typically cannot be simply assessed based on ground-truth explanations, and must also fulfill complex multifaceted desiderata [ 34 ] , significant work has been dedicated to the question of how to assess explanation quality and usefulness, summarized in reviews such as [ 26 ] . As major families of evaluation techniques, we can mention the ‘pixel-flipping’ and insertion/deletion metrics [ 29 ] , as well as measures of explanation stability [ 25 , 3 , 23 ] . Multiple works document explanation vulnerability to perturbations and adversarial attacks [ 5 , 24 ] . In comparison to these classical methods for evaluating explanations, which often require repeatedly calling the ML model with XAI-derived input perturbations, we establish a fast surrogate that is purely based on predictive uncertainty and that can be computed quickly for single data points. Connections between UQ and XAI Recent work integrates UQ with XAI. Bayesian extensions of LIME and SHAP model explanation uncertainty internally by producing credible intervals for individual attributions [ 37 , 31 ] ; a broader review of UQ modeling and human perception of uncertainty in explanations is provided in [ 9 ] . Uncertainty decomposition can guide both explanation rejection and explanation type selection [ 38 ] . Uncertainty-aware explanations reduce interpretation biases in healthcare [ 28 ] and identify uncertainty drivers in manufacturing [ 22 ] . Work on uncertainty propagation examines how perturbations in the data and model affect explanation stability [ 8 ] , while [ 6 ] proposes a method that explains the prediction uncertainty itself, by identifying input features that contribute to it. Compared to these works, we provide a different perspective, viewing UQ as a proxy for explanation reliability, enabling both computational gains and quality-aware routing in dataset-wide XAI. Specifically, this is achieved by leveraging strong correlations between epistemic uncertainty and explanation stability and faithfulness. 3 Epistemic Gating for Cost-Aware XAI In this section, we propose using epistemic uncertainty as a routing signal to allocate explanation effort based on predicted reliability. 3.1 The Epistemic Gating Mechanism Post-hoc explanation methods vary in cost: KernelSHAP [ 18 ] requires thousands of model evaluations per sample, while TreeSHAP [ 17 ] operates in polynomial time. Crucially, not all predictions require equally thorough analysis: samples in well-constrained regions yield reliable explanations with lightweight methods, whereas samples near poorly-defined decision boundaries warrant more thorough attribution. Our framework exploits this asymmetry by routing samples toward the appropriate explanation effort based on epistemic uncertainty. We consider supervised classification settings where a model f:\mathbb{R}^{d}\to\Delta^{K} maps an input \mathbf{x}\in\mathbb{R}^{d} to a probability distribution over K classes. Given a test sample, we aim to assess whether the post-hoc explanation is expected to be faithful and stable under input perturbations, and whether these properties are predictable from

Read the complete text