Epistemic Wrapping for Uncertainty Quantification
Maryam Sultana, Neil Yorke-Smith, Kaizheng Wang, Shireen Kudukkil Manchingal, Muhammad Mubashar, Fabio Cuzzolin · 2025
Read Epistemic Wrapping for Uncertainty Quantification by Maryam Sultana, Neil Yorke-Smith, Kaizheng Wang, Shireen Kudukkil Manchingal, Muhammad Mubashar, Fabio Cuzzolin (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2505-02277.txt.
Introduction
Knowing your model is unsure is half of trusting it, and Maryam Sultana and five co-authors wrap classifiers in a layer that speaks uncertainty more honestly, in a 2025 paper. Their Epistemic Wrapping takes a Bayesian neural network's outputs and converts them into belief function posteriors. That representation is built to carry ignorance explicitly.
The wrapper is general and cheap: any Bayesian classifier can wear it. The team tested it with an interval neural network across four image benchmarks, from handwritten digits to the hundred-class CIFAR set. The wrapped models generalized better and quantified their uncertainty more faithfully than the unwrapped baselines. The authors argue the conversion, not a bigger network, is the advance. Belief functions let a model distinguish being split between answers from simply not knowing. Decisions downstream can price that difference.
Catalog record
| CREATOR | Maryam Sultana, Neil Yorke-Smith, Kaizheng Wang, Shireen Kudukkil Manchingal, Muhammad Mubashar, Fabio Cuzzolin |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 51 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2505-02277
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Epistemic Wrapping for Uncertainty Quantification Maryam Sultana, Neil Yorke-Smith, Kaizheng Wang, Shireen Kudukkil Manchingal, Muhammad Mubashar, Fabio Cuzzolin Abstract Uncertainty estimation is pivotal in machine learning, especially for classification tasks, as it improves the robustness and reliability of models. We introduce a novel ‘Epistemic Wrapping’ methodology aimed at improving uncertainty estimation in classification. Our approach uses Bayesian Neural Networks (BNNs) as a baseline and transforms their outputs into belief function posteriors, effectively capturing epistemic uncertainty and offering an efficient and general methodology for uncertainty quantification. Comprehensive experiments employing a Bayesian Neural Network (BNN) baseline and an Interval Neural Network for inference on the MNIST, Fashion-MNIST, CIFAR-10 and CIFAR-100 datasets demonstrate that our Epistemic Wrapper significantly enhances generalisation and uncertainty quantification. 1 Introduction In the realm of machine learning, particularly in classification tasks, uncertainty estimation plays a crucial role in enhancing the robustness and reliability of models ( sale2023volume ) . Accurately quantifying uncertainty is vital for applications where decisions must be made with confidence, such as in medical diagnosis ( lambrou2010reliable ) , autonomous driving ( fort2019large ) and financial forecasting. Traditional deterministic neural networks, while powerful, cannot often effectively capture and express uncertainty ( liu2020simple ) . This shortfall has spurred interest in probabilistic approaches, with Bayesian neural networks (BNNs) emerging as a promising solution in this context. BNNs offer a principled approach to uncertainty estimation by incorporating prior distributions over the model parameters, leading to posterior distributions that reflect model uncertainty ( jospin2022hands ) . Despite their theoretical appeal, BNNs face practical challenges, including high computational costs and complexity in training. The literature majors on two sources of uncertainty: Epistemic Uncertainty (EU) and Aleatoric Uncertainty (AU) ( hullermeier2021aleatoric ; abdar2021review ) . Epistemic uncertainty is due to a lack of knowledge about the true model parameters and can be reduced with more data or better models. In contrast, aleatoric uncertainty (AU) stems from the inherent randomness in the data generation process and cannot be reduced. Over the years, various studies ( hullermeier2021aleatoric ; abdar2021review ) have recognised that accurately modelling parameter uncertainty can produce a variety of credible network models, which are likely to include the true underlying network model, leading to both better EU estimation and more reliable inference. In particular, second-order uncertainty frameworks (including belief functions cuzzolin2020geometry ) can be employed to model both EU and AU, effectively expressing ‘uncertainty about a prediction’s uncertainty’ ( hullermeier2021aleatoric ; sale2023volume ) . Figure 1: Epistemic Wrapper transforms weights posteriors from a Bayesian Neural Network into belief posteriors through a five-step process. It involves extracting probability posteriors, calculating belief values over Borel intervals, computing mass values using Moebius inversion, fitting a Dirichlet distribution to these masses via method of L-moments, and using the resulting belief posteriors as weights to Interval Neural Networks (INNs) for final predictions. BNNs, as one of the prevalent method for uncertainty estimation, treat all the weights and biases of the network as probability distributions. The prediction of the NN is represented as a second-order distribution, thus representing the probability distribution of distributions ( hullermeier2021aleatoric ) . Although effective approximation techniques have been developed, such as variational inference approaches ( blundell2015weight ; gal2016dropout ) and sampling methods ( neal2011mcmc ; hoffman2014no ) , the high computational cost of BNNs during training as well as inference time limit their practical adoption, especially in real-time applications ( abdar2021review ) . Recent results support the claim that modelling EU using uncertainty measures more general than probability distributions cuzzolin2024uncertainty , such as credal sets levi1980enterprise or random sets / belief functions shafer1976mathematical , can lead to better uncertainty estimation and robustness manchingal2022epistemic ; RS-NN ; manchingal2023random ; chan2024estimating ; wang2024credal ; wang2024credalwrapper ; caprio2024credal ; manchingal2025unifiedevaluationframeworkepistemic . Still, all those efforts model (epistemic) uncertainty in the model’s target space, rather than its parameter space. To our knowledge, no attempts have been made to model EU in the parameter space via higher-order uncertainty measures. This paper proposes Epistemic Wrapper , a novel method which, for the first time, models EU in the parameter space via a random set representation by “wrapping" a learnt Bayesian posterior there in the form of a belief function . posterior (Fig. 1 ). Our Epistemic Wrapper follows a structured five-step process, where each step is executed in a hierarchical manner: (i) We begin by extracting posterior distributions with parameters ( \mu,\sigma ) from a pre-trained BNN model, where the priors are modeled as Gaussian distributions. (ii) The posterior distributions are then truncated, and continuous belief functions are computed over closed intervals. (iii) In the third step, these belief values are transformed into mass values using Moebius inversion. (iv) A Dirichlet distribution is fitted to the grid of mass values using the Method of L-moments. (v) Finally, inference is performed using a Hybrid Interval Neural Network (INN). Our approach leverages the strengths of BNNs while injecting the ability of higher-order measure to improve robustness and uncertainty estimation. Our contributions are therefore: 1. A first attempt to model EU in the parameter space using higher-order uncertainty measures . 2. This happens via a new, versatile Epistemic Wrapper concept, that can be applied to any BNN baseline to convert it automatically into a belief-function posterior. 3. Based on the above, a novel approach to uncertainty estimation in classification which efficiently leverages BNNs as a foundation. Our experiments demonstrate the versatility of the proposed Epistemic-wrapper approach across the BNN baseline on two datasets: MNIST and Fashion-MNIST. The results indicate that the epistemic wrapper generalizes effectively across these diverse datasets, significantly improving performance over the baseline BNN. On MNIST dataset, the baseline BNN achieved an accuracy of 72.44% \pm 0.24, whereas the Epi-Wrapper substantially outperformed it, achieving 91.02% \pm 0.05. Similarly, on the Fashion-MNIST dataset, the baseline BNN attained an accuracy of 58.91% \pm 0.24, while the Epi-Wrapper demonstrated a notable improvement, reaching 82.45% \pm 0.10. These results highlight the effectiveness of our approach in enhancing predictive performance across different datasets. Why do we model epistemic uncertainty in the parameter space rather than in the target space? The motivation behind modeling epistemic uncertainty in the parameter space using higher-order uncertainty measures stems from the idea that parameter uncertainty is a primary source of epistemic uncertainty. By modeling uncertainty directly in the parameter space before it propagates to predictions we capture model-level uncertainty in a more principled way. Modeling in the parameter space offers several advantages: (a) It provides a prior-agnostic mechanism to represent epistemic uncertainty, without relying solely on the model’s output distribution. (b) It enables structured and interpretable sampling through belief functions and Dirichlet distributions, supporting more stable and calibrated uncertainty estimates via interval-based inference. (c) It can be seamlessly integrated with existing BNNs without retraining, offering flexibility and broader applicability. The paper is organised as follows. Section 2 surveys the relevant literature. Section 3 explains in detail our epistemic wrapper approach. Section 4 reports the experiments and results. Section 5 concludes. 2 Relevant Work 2.1 Bayesian Neural Networks Bayesian Neural Networks (BNNs) provide a principled framework for uncertainty estimation by treating weights and biases as probability distributions, supporting robust decision-making ( jospin2022hands ) . Efficient methods like Variational Inference (e.g., Bayes by Backprop ( blundell2015weight ) ) and dropout-based