EU-Nets: Enhanced, Explainable and Parsimonious U-Nets

Bohang Sun, Pietro Liò · 2025

Read EU-Nets: Enhanced, Explainable and Parsimonious U-Nets by Bohang Sun, Pietro Liò (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2502-18122.txt.

Introduction

Bohang Sun and Pietro Liò present a framework for clearer medical image models in this 2025 paper. Their base is the U-Net, a model shaped like the letter U that segments images well but stays hard to read and gives no sense of its own doubt. The authors aim to fix both flaws without giving up accuracy.

Their framework, MHEX+, can wrap around any U-Net design, and the wrapped versions are called EU-Nets. One trick merges stacked layers into a single equal kernel, making the model's steps easier to follow. Another compares gradients across the model's layers to gauge doubt. In tests the new versions raised accuracy a little and cut score swings, all with a small added parameter count. The authors pitch the design for settings where trust matters.

Catalog record

CREATORBohang Sun, Pietro Liò
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE15 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2502-18122

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

EU-Nets: Enhanced, Explainable and Parsimonious U-Nets Bohang Sun, Pietro Liò Abstract In this study, we propose MHEX+, a framework adaptable to any U-Net architecture. Built upon MHEX+, we introduce novel U-Net variants, EU-Nets, which enhance explainability and uncertainty estimation, addressing the limitations of traditional U-Net models while improving performance and stability. A key innovation is the Equivalent Convolutional Kernel, which unifies consecutive convolutional layers, boosting interpretability. For uncertainty estimation, we propose the collaboration gradient approach, measuring gradient consistency across decoder layers. Notably, EU-Nets achieve an average accuracy improvement of 1.389% and a variance reduction of 0.83% across all networks and datasets in our experiments, requiring fewer than 0.1M parameters. 1 Introduction In clinical practice, accurate segmentation of anatomical structures or lesions is crucial for diagnosis, treatment planning, and prognosis. However, deep neural networks, despite their strong performance, often lack transparency, making their decision-making process difficult to understand. [ 1 , 2 ] Existing explainability methods, particularly Grad-CAM and its variants [ 3 , 4 , 5 ] , have demonstrated effectiveness in classification tasks. However, their application to semantic segmentation is limited, as they primarily highlight the predicted regions without explaining the underlying decision-making process. [ 6 , 7 , 8 ] . Beyond explainability, uncertainty estimation is also crucial in medical image segmentation. Inference methods based on uncertainty modeling, such as Subjective Logic (SL) [ 9 ] and Dempster-Shafer Theory (DST) [ 10 ] , can quantify belief mass. However, these methods typically require training models from scratch, which may degrade accuracy, especially in cases where the loss function is sensitive. Monte Carlo Dropout (MC Dropout) [ 11 ] requires the model to incorporate dropout layers at inference, while Deep Ensembles [ 12 ] estimate uncertainty by measuring model disagreement but incur high computational costs due to the need for training multiple identical or diverse models. Motivated by the above considerations, we propose a novel explainable U-Net variant, referred to as EU-Nets , based on the Multi-Head Explainer (MHEX) framework [ 13 ] . The main contributions of this work are summarized as follows: • Enhanced U-Net Variants. We propose the MHEX + framework, which is applicable to any U-Net architecture, achieving higher accuracy and stability with minimal parameter overhead (<0.1M). • Revealing the Decision-Making Process. We introduce an equivalent convolutional kernel that merges consecutive convolutions into a single operation, improving interpretability. • Reliable Uncertainty Estimation. We propose the collaboration gradient method, which provides a trustworthy uncertainty measure by examining whether backpropagated gradients reach consensus at given pixel. 2 Related Work U-Net and Its Variants U-Net [ 14 ] introduced skip connections to bridge low-level and high-level features, significantly improving segmentation performance. U-Net++ [ 15 ] further enhanced this design by incorporating dense connections and deep supervision to refine feature aggregation. AHF-U-Net [ 16 ] employed attention mechanisms similar to SE [ 17 ] and CBAM [ 18 ] to compute importance coefficients for fusion connections, enhancing feature selection adaptively. U-Net Transformer [ 19 ] integrated self-attention in the bottleneck and cross-attention in skip connections. Explainability Methods Grad-CAM and its variants [ 3 , 4 , 5 ] generate saliency maps by weighting feature maps based on gradients, second-order derivatives, or model confidence. SHAP [ 20 ] estimates feature importance by perturbing inputs and computing Shapley values. LIME [ 21 ] approximates local decision boundaries by training interpretable linear models around the input space. MHEX (Multi-Head Explainer) [ 13 ] enhances both performance and explainability through lightweight modules and fine-tuning while also providing uncertainty estimation. Uncertainty Estimation Subjective Logic (SL) [ 9 ] and Dempster-Shafer Theory (DST) [ 10 ] encourage models to quantify uncertainty in predictions. Monte Carlo Dropout (MC Dropout) [ 11 ] estimates uncertainty by enabling dropout at inference time. Deep Ensembles [ 12 ] aggregate predictions from multiple independently trained models to improve robustness. Test-Time Augmentation (TTA) [ 22 ] leverages augmented inputs during inference to indirectly reflect model uncertainty. MHEX [ 13 ] introduces an alternative uncertainty estimation approach by analyzing gradient consistency. 3 Method 3.1 EU-Nets MHEX has been shown to enhance interpretability and uncertainty estimation in classification tasks. However, its integration into semantic segmentation remains underexplored. The original MHEX framework [ 13 ] employs deep supervision [ 23 , 24 ] and attention gating mechanisms [ 25 ] to enhance performance. During the explanation phase, an equivalent transformation matrix W_{\text{equiv}}=W_{1}W_{2} is constructed. In this work, we introduce MHEX+, an extended version of MHEX tailored for semantic segmentation. MHEX+ is designed to be applicable to any U-Net architecture. To validate its broad effectiveness, we integrate it into U-Net, U-Net++, U-Net Transformer, and AHF-U-Net, forming a new family of explainable architectures: EU-Nets. 3.2 MHEX+ Module Figure 1: The left side illustrates the working mechanism of the MHEX+ module, while the right side represents the Equivalent Convolutional Kernel In EU-Nets, the MHEX+ module operates as follows: Y=\text{ReLU}(\text{Conv}_{1}(X)+b_{1}) \text{Attention Gate}=\sigma(Y),\quad Y_{\text{attended}}=\sigma(Y)\odot Y \text{Deep Prediction}=\text{Conv}_{2}(Y)+b_{2} where \text{Conv}_{1} is a 1\times 1 convolution followed by ReLU activation, and \sigma(\cdot) denotes the sigmoid function applied in the attention gate. The final deep prediction is computed via \text{Conv}_{2} . For simplicity, biases are omitted in our implementation. The MHEX+ module in EU-Nets is depicted on the left side of Figure 1 . 3.3 Equivalent Convolutional Kernel & Salience Map We extend the W_{equiv} principle to convolutions. Given two consecutive layers \text{Conv}_{1} and \text{Conv}_{2} , their equivalent kernel is computed as: W_{\text{equiv}}[c]=\sum_{j=1}^{C_{\text{in}}}W_{\text{Conv}_{2}}[c,j]\cdot W_{\text{Conv}_{1}}[j] where c represents the output channel corresponding to a specific class. \text{Conv}_{1} is part of the Attention Gate, while \text{Conv}_{2} is responsible for deep prediction. In this way, multiple convolutional operations are consolidated into a single equivalent transformation. The Equivalent Convolutional Kernel enables efficient Class Activation Map (CAM) generation: \text{CAM}_{c}=\sum_{j=1}^{C_{\text{in}}}W_{\text{equiv}}[c,j]\cdot A[j] where A[j] represents the activation map of the j -th channel. It is important to note that the time complexity of Grad-CAM is O(n^{2}\cdot C) , whereas MHEX+CAM has a time complexity of O(C) , where C denotes the num_{\text{channels}} , which is a constant usually. The right side of Figure 1 illustrates the Equivalent Convolutional Kernel. 3.4 Integration U-Net-like networks consist of three stages: downsampling (encoder), extracting low-level features; bottleneck, capturing global context; and upsampling (decoder), reconstructing the segmentation map. Figure 2: Example of MHEX+ integration with U-Net Transformer (EU-Net Transformer) We construct residual connections in the double convolution module across all decoders in U-Nets to integrate MHEX+, following the structural design principles of ResNet [ 26 ] . For U-Net++, we use the densely connected version rather than the deep supervision version, as MHEX+ already incorporates deep supervision. Please refer to Figure 2 . 3.5 Uncertainty Analysis In this section, we introduce the concept of collaboration gradient to measure the consistency between adjacent MHEX+ blocks at the pixel level. We compute gradients for each pixel (i,j) and measure the cosine similarity of gradient vectors from adjacent MHEX+ blocks at layers l and l+1 in EU-Nets decoders. Specifically, for each pixel, the Uncertainty ( U^{(i,j)} ) is defined as: U^{(i,j)}=\sum_{L-1}\cos(\nabla_{l}^{(i,j)},\nabla_{l+1}^{(i,j)})=\frac{\nabla_{l}^{(i,j)}\cdot\nabla_{l+1}^{(i,j)}}{\|\nabla_{l}^{(i,j)}\|\|\nabla_{l+1}^{(i,j)}\|+\epsilon}, • \nabla_{l}^{(i,j)}=\frac{\partial\mathcal{L}_{l}^{(i,j)}}{\partial C_{1}} denotes the gradient of the cross-entropy loss \mathcal{L}_{l}^{(i,j)} with respect to the parameter C_{1} at layer l ; • \nabla_{l+1}^{(i,j)}=\frac{\partial\mathcal{L}_{l+1}^{(i,j)}}{\partial C_{1}} represents the corresponding gradient from layer l+1 ; • \cos(\nabla_{l}^{(i,j)},\nabla_{l+1}^{(i,j)}) represents the

Read the complete text