No Single Metric Tells the Whole Story: A Multi-Dimensional Evaluation Framework for Uncertainty Attributions

Emily Schiller, Teodor Chiaburu, Marco Zullich, Luca Longo · 2026

Read No Single Metric Tells the Whole Story: A Multi-Dimensional Evaluation Framework for Uncertainty Attributions by Emily Schiller, Teodor Chiaburu, Marco Zullich, Luca Longo (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-24524.txt.

Introduction

Schiller and co-authors set out a way to judge methods that assign a model's uncertainty to input features. Studies of such methods use mismatched proxy tasks and metrics, so results cannot be compared. The authors align the task with the Co-12 scheme and give measures for four traits: correctness, consistency, continuity, and compactness. They add a fifth trait, conveyance, which checks if set rises in uncertainty reach the feature scores. Across eight metrics, gradient methods beat perturbation ones on consistency and conveyance.

Catalog record

CREATOREmily Schiller, Teodor Chiaburu, Marco Zullich, Luca Longo
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE59237
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2603.24524

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

No Single Metric Tells the Whole Story: A Multi-Dimensional Evaluation Framework for Uncertainty Attributions Emily Schiller, Teodor Chiaburu, Marco Zullich, Luca Longo Abstract Research on explainable AI (XAI) has frequently focused on explaining model predictions. More recently, methods have been proposed to explain prediction uncertainty by attributing it to input features (uncertainty attributions). However, the evaluation of these methods remains inconsistent as studies rely on heterogeneous proxy tasks and metrics, hindering comparability. We address this by aligning uncertainty attributions with the well-established Co-12 framework for XAI evaluation. We propose concrete implementations for the correctness, consistency, continuity, and compactness properties. Additionally, we introduce conveyance , a property tailored to uncertainty attributions that evaluates whether controlled increases in epistemic uncertainty reliably propagate to feature-level attributions. We demonstrate our evaluation framework with eight metrics across combinations of uncertainty quantification and feature attribution methods on tabular and image data. Our experiments show that gradient-based methods consistently outperform perturbation-based approaches in consistency and conveyance, while Monte-Carlo dropconnect outperforms Monte-Carlo dropout in most metrics. Although most metrics rank the methods consistently across samples, inter-method agreement remains low. This suggests no single metric sufficiently evaluates uncertainty attribution quality. The proposed evaluation framework contributes to the body of knowledge by establishing a foundation for systematic comparison and development of uncertainty attribution methods. Keywords Explainable AI \cdot Uncertainty Quantification \cdot Uncertainty Attributions \cdot Evaluation Metrics. AI artificial intelligence CNN convolutional neural network DNN deep neural network MLP multi-layer perceptron RNN recurrent neural network XAI Explainable Artificial Intelligence XUQ Explainable Uncertainty Quantification UQ Uncertainty Quantification MSE Mean Squared Error MAE Mean Absolute Error RMSE Root Mean Squared Error OOD out-of-distribution AUC area under the curve RRI Relative Rank Improvement UCS Uncertainty Conveyance Similarity MCD Monte-Carlo dropout MCDC Monte-Carlo dropconnect 1 Introduction The field of xai ( xai ) has grown into a highly active area of research. A substantial body of xai research focuses on explaining why a model produces a particular prediction 6 . In parallel, the field of uq ( uq ) aims at quantifying the uncertainties inherent in ai ( ai ) predictions. UQ methods typically consider three types of uncertainty: epistemic, aleatoric, and predictive uncertainty. Epistemic uncertainty ( model uncertainty ) arises from limited knowledge or insufficient data and can be reduced by collecting more data or improving the model; aleatoric uncertainty ( data uncertainty ) arises from the data-generating process itself and cannot be reduced; predictive uncertainty combines both sources 17 . xai and uq are fields dedicated to enhancing the reliability of ai models, promoting responsible ai usage, and, in turn, aiming to achieve user trust. Additionally, these fields enable developers to evaluate their models, uncover weaknesses, and ultimately improve performance. The intersection of xai and uq holds significant potential to further advance these objectives. Recent research has begun to explore this intersection by proposing methods that combine xai and uq techniques 9 ; 18 ; 38 . The emerging research field of xuq ( xuq ) focuses on explaining uncertainty in model predictions rather than the predictions themselves. Consider, for example, a medical diagnosis system. Such a system should indicate which input patterns lead to high uncertainty, enabling doctors to make informed decisions and “advise the clinicians on the course of action needed to improve the AI predictions” 13 . Most prior work in xuq has focused on explaining uncertainty in terms of input features, an approach we denote as uncertainty attributions 10 ; 38 ; 18 ; 37 ; 39 ; 9 . Similar to feature attributions in xai , these methods attribute importance scores to input features. However, the importance reflects the contribution to prediction uncertainty rather than to the prediction itself. Despite growing interest in xuq , the evaluation of uncertainty attribution methods remains fragmented and inconsistent. While the xai literature has converged towards established evaluation protocols 28 , xuq research currently relies on heterogeneous proxy tasks and metrics that vary across studies 9 ; 18 ; 37 . This lack of standardisation creates several problems. First, it hinders systematic comparison of methods. Second, it limits reproducibility. Third, it complicates the assessment of progress in the field. The challenges are further compounded by underlying questions about what defines a “good” uncertainty attribution. The xai community has made significant progress in addressing analogous challenges in explaining model predictions. The field has distinguished among functionally grounded metrics, which evaluate explanation quality based on model behaviour; human-grounded evaluation, based on user studies and simplified tasks; and application-grounded evaluation, involving users and a real-world application task 12 . Functionally grounded metrics enable objective, reproducible evaluation and have become standard in xai research for initial technical inspection of xai methods 28 . Nauta et al. 28 performed an exhaustive literature review on functionally grounded metrics, which they synthesised into the Co-12 framework, including twelve desirable properties of explanations. In this work, we investigate the transferability of functionally grounded xai evaluation properties and metrics to uncertainty attributions. We adapt established xai metrics, aligned with the Co-12 properties, to the setting of uncertainty attribution. Specifically, we propose concrete implementations for four properties: correctness, consistency, continuity, and compactness (see Section 4 ). We omit the other eight because their implementation depends on the specific application or user involvement, or because they pose conceptual challenges. Recognising that uncertainty attributions require additional considerations, we introduce a new property, conveyance , that assesses whether controlled increases in uncertainty reliably propagate to feature-level uncertainty attributions. We demonstrate our evaluation framework by comparing multiple uncertainty attribution methods across two datasets (UCI Wine Quality 1 1 1 Available at https://archive.ics.uci.edu/dataset/186/wine+quality , MNIST 2 2 2 Available at http://yann.lecun.com/exdb/mnist ). We further validate the framework by applying sanity checks to assess the reliability of the proposed metrics. The contributions of this work are as follows: • We provide a systematic adaptation of functionally grounded xai evaluation metrics for uncertainty attribution. This includes proposing concrete metrics for the four Co-12 properties and introducing the novel conveyance property. • We introduce a novel metric, uncertainty similarity conveyance , to evaluate the conveyance property for uncertainty. • We conduct a systematic empirical evaluation demonstrating how different uncertainty attribution methods perform across multiple quality dimensions and apply sanity checks to assess metric reliability. The remainder of this paper is organised as follows. Section 2 reviews related work. Section 3 introduces formal notions and the used uncertainty attribution approach. Section 4 presents our evaluation framework with adapted evaluation properties and corresponding metrics. Section 5 describes the experimental setup. Section 6 and 7 report and discuss the results and limitations. Finally, Section 8 concludes with directions for future work. The code for the experiments is available at https://github.com/emilyS135/xuq_eval . 2 Related Work Previous work on xuq has primarily focused on developing novel methods to generate explanations of prediction uncertainty 6 ; 39 ; 9 . One of the first approaches to explain predictive uncertainty was CLUE by Antorán et al. 6 , a counterfactual method for differentiable probabilistic models like Bayesian Neural Networks (BNNs). It modifies inputs based on uncertain predictions using a generative model, with attribution maps computed by measuring differences between original and modified inputs. The predominant approach in xuq , however, is uncertainty attribution, which adapts feature attribution

Read the complete text