Adaptive Noise-Tolerant Network for Image Segmentation
Weizhi Li · 2025
Read Adaptive Noise-Tolerant Network for Image Segmentation by Weizhi Li (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2501-07163.txt.
Introduction
Weizhi Li asked whether a neural network can learn to outline structures in medical images without perfectly labeled training examples. Hand-drawn outlines are the usual teaching signal, but for tissue microscopy images they are nearly impossible to produce at scale. Instead, Li's Adaptive Noise-Tolerant Network learns from the imperfect outlines produced by existing automatic tools.
The model can blend several noisy label sources into one training process. It also estimates how trustworthy each source is, adjusting to the look of each new test image. On synthetic data and on real tissue images, the network beat both the tools that supplied its labels and other deep learning segmenters. The result suggests noisy supervision, handled carefully, can substitute for scarce expert labels.
Catalog record
| CREATOR | Weizhi Li |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 30 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2501-07163
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Adaptive Noise-Tolerant Network for Image Segmentation Weizhi Li Abstract Unlike image classification and annotation, for which deep network models have achieved dominating superior performances compared to traditional computer vision algorithms, deep learning for automatic image segmentation still faces critical challenges. One of such hurdles is to obtain ground-truth segmentations as the training labels for deep network training. Especially when we study biomedical images, such as histopathological images (histo-images), it is unrealistic to ask for manual segmentation labels as the ground truth for training due to the fine image resolution as well as the large image size and complexity. In this paper, instead of relying on clean segmentation labels, we study whether and how integrating imperfect or noisy segmentation results from off-the-shelf segmentation algorithms may help achieve better segmentation results through a new Adaptive Noise-Tolerant Network (ANTN) model. We extend the noisy label deep learning to image segmentation with two novel aspects: (1) multiple noisy labels can be integrated into one deep learning model; (2) noisy segmentation modeling, including probabilistic parameters, is adaptive, depending on the given testing image appearance. Implementation of the new ANTN model on both the synthetic data and real-world histo-images demonstrates its effectiveness and superiority over off-the-shelf and other existing deep-learning-based image segmentation algorithms. BMVC Author Guidelines 1 Introduction Many deep learning models operate in a supervised nature and have had enormous successes in many applications, including image classification and annotation [ ? ? ? ? ? ? ]. However, when we have only unlabeled data, for example, for biomedical image analysis, the existing Convolutional Neural Network (CNN) based methods may not apply. In order to overcome such limitations, a crowd-sourcing strategy [ ? ] has been proposed to collect manual annotations from different people when getting labels from medical experts is difficult and then integrate the cues from these noisy crowd-sourcing annotations to infer the ground truth [ ? ]. In image classification, these noisy crowd-sourcing labels are considered to be Noisy At Random (NAR) [ ? ] and several NAR models [ ? ? ] have been proposed by modeling the label-flip noise independent of input images. In this paper, we focus on deep learning for image segmentation when it is difficult to obtain clean pixel-wise segmentation labels. There are indeed many existing traditional image segmentation algorithms that can provide segmentation results with reasonable quality and can be taken as noisy training labels. However, for these segmentation labels, the NAR assumption may not hold any more, since the label-flip noise is not only dependent on the true object class but also the image features of the corresponding classes [ ? ]. Hence, it is more proper to consider the Noisy Not At Random (NNAR) model [ ? ] and develop adaptive image-dependent label-flip noise transition models. Motivated by the recent dynamic filter networks [ ? ] that adaptively adjust deep network parameters accordingly to the input features, we propose an Adaptive Noise-Tolerant Network (ANTN) for image segmentation. The graphical probabilistic model and architecture of the network are shown in Figure 1. In ANTN, we explicitly model the probabilistic dependency between the input image, the ground-truth segmentation, and noisy segmentation results from off-the-shelf image segmentation algorithms. By adaptively modeling image-dependent label-flip noise from different segmentation algorithms, ANTN can borrow signal strengths from multiple noisy labels to achieve better segmentation results. We develop an EM (Expectation-Maximization) based model inference algorithm and apply ANTN for image segmentation with both synthetic and histo-images. Performance comparison with off-the-shelf and deep learning algorithms shows the effectiveness and superiority of ANTN over other competing algorithms. (a) (b) Figure 1: (a) Graphical probabilistic model and (b) architecture of the Adaptive Noise-Tolerant Network (ANTN). X represents the input image, Y represents the ground-truth segmentation, \hat{Y}^{1} and \hat{Y}^{2} represent noisy segmentations. 2 Related Work Hinton et al. [ ? ] have pioneered to use the deep network to incorporate the label-flip noise in aerial image labeling. They assumed the label-flip noise is only dependent on the true label and adopted an EM algorithm to train network model parameters iteratively, considering the true labels as latent variables. Benoît et al. [ ? ] pointed out it is more realistic that mislabeling is dependent on input features and Xiao et al. [ ? ] took such an assumption into consideration and integrated three types of label noise transition probabilities given the same true label for clothing classification. Instead of modeling true labels as latent variables in [ ? ? ], Veit et al. [ ? ] recently introduced a multi-task label cleaning architecture for image classification, in which an image classifier is supervised by the output of the label cleaning network trained using the mixture of clean and noisy labels, which is effective in learning large-scale noisy data in conjunction with a small subset of clean data. All the aforementioned methods [ ? ? ? ] require a small clean dataset to assist model inference. Sukhbaatar et al. [ ? ] proposed a noisy label image classification model that is capable of learning network parameters from noisy labels solely by diffusing label noise transition probability matrix from the initial identity matrix with a weight decay trick; but such model inference can be instable. Reed et al. [ ? ] introduced “prediction consistency” in training a feed-forward autoencoder with noisy data, requiring that the same label prediction should be made given similar image features. Similar to the idea of avoid overfitting, Kakar et al. [ ? ] added a regularization term on the coefficients of hidden units during training to obtain stable results. Most of the existing noisy label deep network models [ ? ? ? ? ? ? ] are on image classification or patch-labeling. The authors in [ ? ] extended the label-flip noise model [ ? ] to image segmentation and devised a Noise-Tolerant Network (NTN) based on the architecture of u-net [ ? ] assuming that the label noise is only dependent on the true label. For image segmentation, it may be more appropriate to model label transition probabilities adaptively as discussed earlier. In addition, when different types of noisy labels are available, there is still no existing method to flexibly integrate them in the literature to the best of our knowledge. Our ANTN specifically addresses these two problems for deep-learning image segmentation. 3 Method We study whether and how integrating multiple noisy datasets from off-the-shelf segmentation algorithms may help achieve better segmentation results. We develop the ANTN model for image segmentation with two novel aspects: (1) multiple noisy labels can be naturally integrated; (2) noisy segmentation modeling is adaptive, with image-dependent label transition probabilities. First, we introduce the probabilistic model of image segmentation when multiple noisy segmentations are available. Based on the model, we construct the adaptive deep learning framework, motivated by the recent dynamic filter network [ ? ]. We note that we focus on the model with two noisy datasets but the model can be generalized to the settings with more than two noisy datasets in a straightforward manner due to the symmetry of our proposed framework. We also provide the model inference procedure to train the proposed adaptive deep learning model. 3.1 Model Given a set of training images X=\{X_{1},X_{2},\ldots,X_{T}\}