Generalizing Abstention for Noise-Robust Learning in Medical Image Segmentation

Wesam Moustafa 1,2, Hossam Elsafty 1,2,3, Helen Schneider 1,2,3, Lorenz Sparrenberg 1,3, Rafet Sifa 1,2,3 · 2026

Read Generalizing Abstention for Noise-Robust Learning in Medical Image Segmentation by Wesam Moustafa 1,2, Hossam Elsafty 1,2,3, Helen Schneider 1,2,3, Lorenz Sparrenberg 1,3, Rafet Sifa 1,2,3 (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2601-14039.txt.

Introduction

Wesam Moustafa and co-authors help medical image models cope with wrong labels in 2026. Label noise is a critical problem in medical image segmentation. Manual annotation is hard, so errors creep into training data. Models trained on noisy data are prone to overfitting, which degrades generalization.

Many methods try to mitigate noisy labels in segmentation. The area remains largely under-explored, the team notes. Their work generalizes abstention, where a model can decline to learn from suspect labels. Safer learning from flawed labels could improve tools that outline tumors and organs.

Catalog record

CREATORWesam Moustafa 1,2, Hossam Elsafty 1,2,3, Helen Schneider 1,2,3, Lorenz Sparrenberg 1,3, Rafet Sifa 1,2,3
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE33 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2601-14039

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Generalizing Abstention for Noise-Robust Learning in Medical Image Segmentation Wesam Moustafa 1,2, Hossam Elsafty 1,2,3, Helen Schneider 1,2,3, Lorenz Sparrenberg 1,3, Rafet Sifa 1,2,3 Abstract Label noise is a critical problem in medical image segmentation, often arising from the inherent difficulty of manual annotation. Models trained on noisy data are prone to overfitting, which degrades their generalization performance. While a number of methods and strategies have been proposed to mitigate noisy labels in the segmentation domain, this area remains largely under-explored. The abstention mechanism has proven effective in classification tasks by enhancing the capabilities of Cross Entropy, yet its potential in segmentation remains unverified. In this paper, we address this gap by introducing a universal and modular abstention framework capable of enhancing the noise-robustness of a diverse range of loss functions. Our framework improves upon prior work with two key components: an informed regularization term to guide abstention behaviour, and a more flexible power-law-based auto-tuning algorithm for the abstention penalty. We demonstrate the framework’s versatility by systematically integrating it with three distinct loss functions to create three novel, noise-robust variants: GAC, SAC, and ADS. Experiments on the CaDIS and DSAD medical datasets show our methods consistently and significantly outperform their non-abstaining baselines, especially under high noise levels. This work establishes that enabling models to selectively ignore corrupted samples is a powerful and generalizable strategy for building more reliable segmentation models. Our code is publicly available at https://github.com/wemous/abstention-for-segmentation . \midlauthor \orcid 0009-0001-4095-4912 \orcid 0000-0001-9450-7387 1 Institute of Computer Science, University of Bonn, Bonn, Germany 2 Fraunhofer Institute for Intelligent Analysis and Information Systems IAIS, Sankt Augustin, Germany 3 Lamarr Institute for Machine Learning and Artificial Intelligence, Dortmund, Germany † † volume: – Under Review † † year: 2026 † † workshop: Full Paper – MIDL 2026 submission † † editors: Under Review for MIDL 2026 keywords Abstention, Medical Image Segmentation, Label Noise, Noise-Robust Learning, Loss Functions. 1 Introduction The remarkable advancements in deep learning have revolutionized numerous fields, largely propelled by the availability of labelled datasets 9 ; 34 ; 3 . However, the presence of label noise is a significant impediment to the generalizability of Deep Neural Networks (DNNs), as their immense capacity makes them prone to memorizing incorrect labels, which harms their ability to generalize to unseen data 11 ; 5 ; 21 ; 19 . This problem is especially pronounced in medical image segmentation, where obtaining clean, pixel-level annotations is notoriously difficult and expensive, and where annotation errors can have direct clinical consequences 9 ; 34 ; 30 . Training on such noisy labels leads to incorrect gradients, causing the model to learn erroneous patterns and fail in critical applications 14 . To counteract label noise, a variety of robust learning methodologies have been developed, primarily for classification tasks. These include noise filtering techniques 5 , loss reweighting strategies 9 , and curriculum learning 11 . While promising, these methods often introduce computational complexity or require strong assumptions about the noise characteristics 5 . Among the explored directions, noise-robust loss functions are a compelling alternative due to their simplicity, efficiency, and model-agnostic nature 24 . By leveraging properties like boundedness 35 and symmetry 29 , they modify the optimization objective to inherently limit the influence of noisy examples and prevent overfitting 28 ; 2 . Despite these advances, a research gap remains for robust learning specifically in image segmentation, where existing methods often struggle to address the spatially-correlated inaccuracies inherent in annotation noise 7 ; 9 . In this paper, we propose to address this gap by adapting and generalizing the abstention mechanism, a powerful technique that has proven effective in mitigating label noise in classification 9 ; 25 ; 18 . The abstention mechanism empowers a DNN to abstain from making a prediction on confusing or unreliable samples by integrating an abstention option directly into the training process. Building upon the foundational Deep Abstaining Classifier (DAC) 25 and its extension, the Informed Deep Abstaining Classifier (IDAC) 18 , this paper makes several contributions to advance noise-robust medical image segmentation: • Adaptation of Abstention to Segmentation : We investigate the applicability of the abstention mechanism to image segmentation by adapting the DAC and IDAC loss functions for this domain. • Enhanced and Generalized Abstention Definition : Our contribution improves and generalizes abstention, incorporating an informed regularization term guided by estimated noise rates \tilde{\eta} and a power-law-based \alpha auto-tuning algorithm. • Loss-Agnostic Integration and Novel Loss Functions : We integrate the enhanced abstention mechanism with other loss functions, including Generalized Cross Entropy (GCE) 35 , Symmetric Cross Entropy (SCE) 29 , and Dice Loss 15 , introducing three loss functions: the Generalized Abstaining Classifier (GAC), the Symmetric Abstaining Classifier (SAC), and the Abstaining Dice Segmenter (ADS). ADS introduces architectural adaptations for class-wise abstention and class-specific noise rates \tilde{\eta}_{c} . • Empirical Validation of Robustness and Versatility : Through empirical evaluations and quantitative analysis (fig:intro) on medical image datasets (CaDIS 6 and DSAD 1 ) under varying noise levels, we show consistent superiority over non-abstaining baselines. The remainder of this paper reviews related work ( 2 ), details our proposed abstention framework and novel loss functions ( 3 ), outlines the experimental setup ( 4 ), and presents a comprehensive evaluation of our results ( 5 ) before concluding in 6 . \figureconts fig:intro Figure 1: The impact of our noise-robust abstention framework. On a CaDIS sample with 25% label noise, the baseline Dice Loss (b) produces a noisy and inaccurate mask. In contrast, our proposed Abstaining Dice Segmenter (ADS) (c) yields a result that is visually cleaner and adheres more closely to the ground truth (a). \subfigure [Ground Truth] \subfigure [Dice] \subfigure [ ADS] 2 Related Work The deployment of deep learning in medical imaging is frequently hampered by data imperfections, ranging from data scarcity and class imbalance 26 ; 27 to missing or uncertain annotations 20 . Within this landscape, label noise remains a particularly pervasive challenge that has been explored through several avenues 9 . Early strategies operated at different granularities, seeking to identify and correct noisy labels. These included pixel-wise adaptive weight maps, as proposed by 22 , which dynamically adjust the contribution of each pixel to the loss, and graph-based label correction by 33 , which models spatial relationships to propagate corrections from reliable to unreliable pixels. Other frameworks operated at the image level to assess overall annotation quality, with some combining both pixel- and image-level perspectives to distill supervision more effectively 22 ; 37 . Recognizing that segmentation noise is often not random but spatially correlated, other works have proposed explicit noise models. The Markov models from 31 , for instance, simulate realistic boundary distortions, while methods like LVC-Net by 23 leverage local visual cues to guide the network away from incorrect labels during training. A significant approach exploits the intrinsic learning dynamics of deep networks, particularly the ‘early-learning’ phenomenon, where models tend to fit clean, simple patterns before eventually memorizing the noise present in incorrect labels 13 ; 32 . This observation has led to the development of adaptive correction methods like ADELE by 13 , which detects the onset of memorization for each semantic class to intervene at the optimal moment. In

Read the complete text