SingleStrip: learning skull-stripping from a single labeled example
Bella Specktor-Fadida, Malte Hoffmann · 2025
Read SingleStrip: learning skull-stripping from a single labeled example by Bella Specktor-Fadida, Malte Hoffmann (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2508-10464.txt.
Introduction
Bella Specktor-Fadida and Malte Hoffmann teach a computer to strip the skull from brain scans with just one labelled case. Skull stripping means keeping the brain and cutting away bone and other tissue in an MRI scan. Hand labels for such scans take hours of expert time, so labelled sets are small. Past tricks fake fresh training images from label maps, but one map gives too little shape variety on its own.
Their method fakes images from that one map to train a first model. A second small network, trained to rebuild the one case, grades how good each new mask looks. The best masks then join the training set to sharpen the model. The result came close to models trained with far more labels, even on scans from new sources. A rival grading trick based on repeat runs did worse.
Catalog record
| CREATOR | Bella Specktor-Fadida, Malte Hoffmann |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 19 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2508-10464
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
SingleStrip: learning skull-stripping from a single labeled example Bella Specktor-Fadida, Malte Hoffmann Abstract Deep learning segmentation relies heavily on labeled data, but manual labeling is laborious and time-consuming, especially for volumetric images such as brain magnetic resonance imaging (MRI). While recent domain-randomization techniques alleviate the dependency on labeled data by synthesizing diverse training images from label maps, they offer limited anatomical variability when very few label maps are available. Semi-supervised self-training addresses label scarcity by iteratively incorporating model predictions into the training set, enabling networks to learn from unlabeled data. In this work, we combine domain randomization with self-training to train three-dimensional skull-stripping networks using as little as a single labeled example. First, we automatically bin voxel intensities, yielding labels we use to synthesize images for training an initial skull-stripping model. Second, we train a convolutional autoencoder (AE) on the labeled example and use its reconstruction error to assess the quality of brain masks predicted for unlabeled data. Third, we select the top-ranking pseudo-labels to fine-tune the network, achieving skull-stripping performance on out-of-distribution data that approaches models trained with more labeled images. We compare AE-based ranking to consistency-based ranking under test-time augmentation, finding that the AE approach yields a stronger correlation with segmentation accuracy. Our results highlight the potential of combining domain randomization and AE-based quality control to enable effective semi-supervised segmentation from extremely limited labeled data. This strategy may ease the labeling burden that slows progress in studies involving new anatomical structures or emerging imaging techniques. 1 Introduction Segmentation of anatomical structures in medical images is essential for many clinical tasks, such as assessing tumor size and progression. However, manually labeling is laborious, requires expertise, and results vary with the rater, motivating the development of automated techniques. For example, skull-stripping [ 23 , 20 ] of brain magnetic resonance imaging (MRI) is a technique automated in neuroimage analysis pipelines that removes distracting non-brain image content for downstream analyses [ 6 , 13 , 5 ] . Modern methods leverage deep learning for fast and accurate skull stripping, but they typically rely on high-quality training datasets with annotations, which are costly to create [ 27 ] . Training strategies using as little data as possible, potentially a single labeled example image, are therefore highly valuable for developing models that segment new anatomies or imaging modalities without substantial labeling effort. Domain randomization: Recent synthesis, or domain-randomization, strategies [ 11 , 2 , 9 , 10 ] have shown robust brain segmentation performance across a landscape of modalities by generating diverse training data from a few label maps, which reduces the need for extensive datasets. These methods synthesize images by assigning a random intensity to the voxels of each brain structure and each of background structure. They then apply a series of aggressive augmentation steps, leading to complex intensity patterns across the anatomy. This strategy has led to a number of tools that reliably process unseen image types without retraining. However, despite geometric augmentation, the generated training images do not necessarily cover the real-world anatomical variability needed to train robust, generalizable networks when only a single label map is used. Semi-supervised learning: Various other approaches address annotation scarcity in semantic segmentation [ 27 ] . A prominent example is semi-supervised learning (SSL) with self-training (ST), which creates pseudo-labels. In ST, a model improves itself by first predicting labels for an unlabeled dataset and, second, by adding the pseudo-labels to the training set to learn from the network’s own predictions [ 4 ] . This approach makes it possible to substantially increase the variability of the training data without human effort, as unlabeled datasets are generally more widely available than labeled ones. Figure 1: Method overview. To learn skull-stripping from a single labeled image, we first fit a Gaussian mixture model (GMM), assigning voxel intensities to c classes. From these, we synthesize diverse images to train a skull-stripping U-Net. In parallel, we train an autoencoder (AE) to reconstruct brain masks for quality control. Assuming high-quality masks change least in AE reconstruction, we use both networks to skull-strip an unlabeled dataset and retain the least-changing predictions to fine-tune the U-Net via GMM synthesis. This scheme can be repeated several times as needed. Works on ST often train two or more networks in an uncertainty-aware fashion [ 27 , 4 , 21 ] . One method [ 16 ] leverages a convolutional adversarial framework combining a segmentation network with a confidence network. The latter predicts an attention map, used to select reliable pseudo-labels predicted from unlabeled data for further semi-supervised learning. Another approach generates pseudo-labels by co-training multiple networks [ 28 , 30 ] . It rotates and flips inputs into multiple views and trains separate networks with each, enforcing consistency across unlabeled views weighted by uncertainty. In contrast, consistency regularization [ 3 , 17 ] applies perturbations to generate disagreement across different versions of the same input, training a single model by enforcing prediction consistency for unlabeled data. Recently, an offline ST approach involving teacher and student networks has reached promising segmentation performance [ 32 , 26 , 29 , 25 ] . First, the teacher network trains on labeled data and then predicts pseudo-labels for an unlabeled dataset. Second, the student network trains using both the manual ground-truth labels and the generated pseudo-labels. Quality control: To reduce the human burden, ST employs automated quality control (QC) techniques to discriminate between reliable and less accurate pseudo-labels. Supervised methods for segmentation QC typically estimate a single metric with a regression network [ 18 , 7 , 12 , 22 , 1 ] . However, training a regression network with a single labeled example is challenging. An alternative strategy estimates segmentation quality using a two-dimensional (2D) convolutional autoencoder (AE) trained on a ground-truth label map to reconstruct the shape of the structures of interest from a latent space. A QC metric is then calculated as the Dice score between an input label map and its reconstruction [ 8 ] . Unsupervised QC techniques aim to gauge segmentation quality in the absence of labels. For example, test-time augmentation (TTA) applies random transformations to a test image and compares the predictions for each version after undoing the transformations. TTA assumes that models are most certain about the predictions with the least variability across transformations and has shown promise in estimating segmentation quality [ 15 , 24 ] . Recently, a two-stage method [ 31 ] combined realistic tumor synthesis with pseudo-labeling for unsupervised segmentation. Similar to teacher-student approaches [ 32 , 26 , 29 , 25 ] , this method bootstraps a first network and uses its predictions to train a second, focusing on bridging the gap between real and synthetic images. Contribution: In this work, we combine synthesis techniques and pseudo-labeling with automated quality estimation to bootstrap high-performing segmentation networks in a semi-supervised setting. Instead of aiming for realism, our generative model synthesizes training data far outside the typical range of medical images, prioritizing model exposure to intensity variability. We demonstrate robust performance using as little human input as a single labeled image for training skull-stripping networks. Figure 2: Skull-stripping examples. Methods SSL-TTA and SSL-AE fine-tune a U-Net trained with a “Single example” using pseudo-labels selected via