Plug-in Losses for Evidential Deep Learning: A Simplified Framework for Uncertainty Estimation that Includes the Softmax Classifier

Berk Hayta, Hannah Laus, Simon Mittermaier, Infineon Technologies, Felix Krahmer, TU Darmstadt, TU Munich & MCML · 2026

Read Plug-in Losses for Evidential Deep Learning: A Simplified Framework for Uncertainty Estimation that Includes the Softmax Classifier by Berk Hayta, Hannah Laus, Simon Mittermaier, Infineon Technologies, Felix Krahmer, TU Darmstadt, TU Munich & MCML (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-22746.txt.

Introduction

Hayta and others simplify evidential deep learning, which estimates uncertainty in one pass through Dirichlet distributions over class probabilities. They replace complex expected objectives with a plug in loss at the Dirichlet mean. The approximation error shrinks as evidence grows for broad loss types including squared error and cross entropy. As a special case, this justifies the standard softmax classifier under a given evidence mapping. On Google Speech Commands, the simpler losses match older learning on correct calls and selective prediction while using standard training.

Catalog record

CREATORBerk Hayta, Hannah Laus, Simon Mittermaier, Infineon Technologies, Felix Krahmer, TU Darmstadt, TU Munich & MCML
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE57123
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2605.22746

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Plug-in Losses for Evidential Deep Learning: A Simplified Framework for Uncertainty Estimation that Includes the Softmax Classifier Berk Hayta, Hannah Laus, Simon Mittermaier, Infineon Technologies, Felix Krahmer, TU Darmstadt, TU Munich & MCML Abstract Real-world sensor-based learning systems require uncertainty estimation that is both reliable and computationally efficient. Evidential Deep Learning (EDL) provides single-pass uncertainty estimation by modeling the class probabilities via Dirichlet distributions, where the Dirichlet parameters are predicted by a learned neural network mapping. However, this approach can lead to computational challenges, as Dirichlet expected objectives are more complex than standard supervised learning losses, complicating their analysis and implementation. We address this issue by approximating the objective of the first-order empirical risk minimization problem induced by EDL with a plug-in loss evaluated at the Dirichlet mean and show that, under mild assumptions, the approximation error decays with growing evidence for a broad class of loss functions, including mean-squared error and cross-entropy loss. As a special case, our analysis provides justification for the use of softmax in the context of uncertainty estimation, since under a particular evidence-to-Dirichlet mapping, our framework includes the standard softmax classifier. We validate the proposed simplified objectives on the Google Speech Commands dataset and show that they achieve predictive accuracy and selective prediction performance comparable to classical EDL, while being simpler to implement using standard deep learning losses and training pipelines. To the best of our knowledge, this empirical analysis is the first to obtain coverage-accuracy trade-offs for speech recognition tasks through EDL. 1 Introduction Deep neural networks are increasingly deployed in resource-constrained and safety-critical settings, where predictive accuracy alone is often insufficient. Overconfident predictions may lead to undesirable or unsafe system behavior, motivating methods that quantify predictive uncertainty and enable selective prediction. At the same time, many established approaches for uncertainty estimation come with significant computational overhead, e.g., Monte Carlo dropout ( 8 ), Bayesian neural networks ( 21 ; 3 ) and Deep ensembles ( 16 ; 31 ). This can make them unsuitable for real-time applications such as embedded sensing, where uncertainty estimation methods should add only minimal inference-time overhead; moreover, many of these methods require specific training procedures, making them less straightforward to integrate into existing pipelines. Evidential Deep Learning (EDL) ( 24 ) aims to address these issues by enabling uncertainty estimation in a single forward pass while remaining compatible with standard neural network training. The idea of EDL is not to learn only a single prediction, but rather to predict parameters of a Dirichlet distribution modeling the class probabilities. Despite promising empirical results for controlled benchmark settings ( 24 ; 7 ), there remains a gap between the theoretical foundations of this uncertainty-aware learning strategy and the algorithmic implementation. In particular, the theory-based loss function of EDL is based on an explicit formula for the expected loss over the unknown Dirichlet distribution to be estimated. Compared with ordinary supervised losses, the resulting objectives are more complex because they depend on both the projected class probabilities and the total Dirichlet concentration. This additional structure can make the optimization landscape harder to interpret and may contribute to sensitivity in hyperparameter choices, slow convergence, or convergence to poor local minima. This motivates a closer analysis of the empirical-risk structure induced by EDL and the plug-in simplifications developed below. In this work, we propose a remedy for these concerns by working with an approximation to the EDL loss function that is closer to the loss without EDL, while also retaining the uncertainty information provided by its minimizer. Thus, the resulting uncertainty-aware learning problem can be optimized using simpler supervised-learning objectives with efficient implementations and well-understood training behavior. To illustrate this, we validate the resulting simplified objectives on the Google Speech Commands v1 dataset ( 30 ). As we demonstrate in theoretical derivations and numerical studies, the resulting uncertainty-aware learning methods exhibit comparable operational metrics to EDL. More precisely, we proceed via a Taylor expansion of the Dirichlet expected loss around the Dirichlet mean. The first-order term vanishes in expectation, and higher terms decay with growing evidence, which establishes that evaluating the loss at the Dirichlet mean yields a good approximation of the EDL objective. As a special case, the softmax classifier belongs to this class of simplified evidential classifiers. For the Google Speech Commands v1 dataset, we estimate uncertainty distributions for correct and incorrect predictions and evaluate the resulting coverage–accuracy trade-off. By thresholding an uncertainty score, the classifier can withhold predictions for uncertain samples, increasing accuracy on the accepted samples at the cost of reduced coverage. Both EDL and the proposed approximate EDL objectives, including the softmax case, provide such uncertainty scores. Contributions. The contributions of this work are as follows: • In this paper, we derive that the evidential deep learning framework (EDL) can be simplified by working with plug-in losses that approximate the EDL objective proposed in 24 . • We rigorously show that, for growing evidence, the EDL objective is well approximated by the proposed plug-in loss and quantify the approximation error. • The resulting classification framework includes a variant of the classical softmax classifier, hence our analysis provides a first step towards understanding the performance of softmax for uncertainty estimation in the EDL framework. • We apply the resulting uncertainty estimation framework for a realistic keyword spotting task on Google Speech Commands v1 and find that it performs comparably to the original EDL formulation, despite its simpler implementability. • We illustrate the benefits of the resulting uncertainty estimates by evaluating operational uncertainty through fixed high-reliability operating points, coverage–accuracy trade-offs, and uncertainty distributions for correct and incorrect predictions. To the best of our knowledge, this is the first uncertainty analysis in the spirit of EDL in the speech recognition context. 2 Related work Evidential Deep Learning Evidential deep learning was introduced by 24 for classification and is inspired by Dempster-Shafer theory ( 6 ; 26 ; 25 ) and subjective logic ( 14 ; 12 ). In recent years many refinements and extensions of EDL have been proposed ( 29 ; 9 ). For example, R-EDL ( 4 ) replaces the fixed prior-weight choice in the subjective-logic parametrization of classical EDL with a tunable hyperparameter, and separately simplifies the original EDL mean-squared-error objective by removing its variance term. I-EDL ( 7 ) adds an extra Fisher regularization term to the loss. Re-EDL ( 5 ) and 27 both argue that for improved out-of-distribution detection one can leave out the KL-divergence term. Besides advancements in EDL, there is also a line of work criticizing EDL ( 2 ; 13 ; 27 ). 13 shows that EDL does not model epistemic uncertainty in the formal Bayesian sense, since its uncertainty does not necessarily vanish with infinite training data and is highly dependent on hyperparameter choices. On the other hand, 27 shows that EDL can perform well for out-of-distribution detection, even if it should not be interpreted as Bayesian uncertainty quantification. These observations motivate a direct study of the Dirichlet-expected losses used in classification EDL. In particular, our work analyzes the relation between losses evaluated under the Dirichlet expectation and losses evaluated at the Dirichlet mean. In a parallel line of work, 19 introduced Prior Networks which also use Dirichlet-output classifiers. The method

Read the complete text