A Unified Framework for Foreground and Anonymization Area Segmentation in CT and MRI Data
Michal Nohel, Constantin Ulrich, Jonathan Suprijadi, Tassilo Wald, Klaus Maier-Hein · 2025
Read A Unified Framework for Foreground and Anonymization Area Segmentation in CT and MRI Data by Michal Nohel, Constantin Ulrich, Jonathan Suprijadi, Tassilo Wald, Klaus Maier-Hein (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2501-04361.txt.
Introduction
Nohel, Ulrich, Suprijadi, Wald, and Maier-Hein release an open toolkit that prepares 3D medical scans for self-supervised learning in a 2025 paper. Two chores slow such projects: finding the body region fast, and masking areas blanked out for privacy.
One network outlines the foreground so sampling skips empty space and training speeds up. A second network finds anonymized regions, so reconstruction methods do not learn from fake blank content. Both scored near-perfect overlap with human markings across CT and MRI data. Scores held across several anonymization methods. Code and model weights are public. The authors aim to cut privacy and efficiency friction in medical AI. The toolkit targets 3D imaging pipelines.
Catalog record
| CREATOR | Michal Nohel, Constantin Ulrich, Jonathan Suprijadi, Tassilo Wald, Klaus Maier-Hein |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 12 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2501-04361
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
A Unified Framework for Foreground and Anonymization Area Segmentation in CT and MRI Data Michal Nohel, Constantin Ulrich, Jonathan Suprijadi, Tassilo Wald, Klaus Maier-Hein Abstract This study presents an open-source toolkit to address critical challenges in preprocessing data for self-supervised learning (SSL) for 3D medical imaging, focusing on data privacy and computational efficiency. The toolkit comprises two main components: a segmentation network that delineates foreground regions to optimize data sampling and thus reduce training time, and a segmentation network that identifies anonymized regions, preventing erroneous supervision in reconstruction-based SSL methods. Experimental results demonstrate high robustness, with mean Dice scores exceeding 98.5 across all anonymization methods and surpassing 99.5 for foreground segmentation tasks, highlighting the toolkit’s efficacy in supporting SSL applications in 3D medical imaging for both CT and MRI images. The weights and code is available at https://github.com/MIC-DKFZ/Foreground-and-Anonymization-Area-Segmentation . 1 Introduction Deep learning has achieved remarkable success in medical image analysis. Groundbreaking work in segmentation has greatly enhanced treatment planning and monitoring outcomes [ 6 , 16 , 17 ] , while advances in detection models have improved diagnostic [ 1 ] . Despite these advancements, progress in deep learning for medical imaging remains constrained by the scarcity of annotated data, which is essential for training robust models. Self-supervised learning (SSL) offers a solution to this challenge by leveraging vast amounts of unannotated medical images, thus potentially improving all downstream tasks. However, there are two critical limitations hindering the effective use of unannotated medical data within the community. Firstly, a lot of volume in 3D medical images contains air, which increases training inefficiencies when sampled compared to traditional 2D natural images. This makes it essential to efficiently filter and use only those parts of the images that contribute valuable information, avoiding unnecessary computational costs. Secondly, data is artificially altered due to privacy concerns; publicly accessible medical datasets are often anonymized, with sensitive areas like the face, ears, and even the top of the head removed or blurred. Such alterations create challenges for deep learning applications, particularly in generative models like GANs, diffusion models, or autoencoders, which rely on original images for accurate supervision. When these images are artificially distorted, networks may receive erroneous signals. For SSL methods focused on reconstruction, identifying and excluding these altered areas from loss calculation becomes especially critical. To improve 3D medical SSL applications, we introduce an open-source toolkit designed to preprocess data for SSL tasks. The toolkit includes two key components: (1) a network that segments all foreground regions within a CT or MR scan, allowing models to selectively sample patches from anatomical regions, thereby reducing training time; and (2) a network that identifies anonymized regions in CT and MRI images, enabling the exclusion of these regions from loss calculations to avoid incorrect supervision signals. Figure 1: Boxplot results illustrating the Dice Similarity Coefficient and HD95 for foreground segmentation, shown for both the test portion of the training dataset and the external test dataset. 2 Materials and methods Anatomical foreground segmentation We assembled a diverse collection of CT and MRI images to construct a robust training dataset for anatomical foreground segmentation. This dataset includes the set of publicly available datasets introduced in Tab. 1 . In total, the dataset comprises 3299 3D images: 1899 CT and 1400 MRI scans. The TotalSegmentator MRI dataset was exclusively reserved for testing MRI images, and the MAAL dataset for testing CT images, while the remaining datasets were evenly split 50:50 into training and testing. This resulted in 1483 training and 1816 testing images. A multi-step approach was applied to obtain anatomical foreground masks for both CT and MRI images. For CT images, the TotalSegmentator tool [ 17 ] was utilized in “body mode” to generate initial segmentations, which were manually refined using the MITK [ 18 ] and ITK-SNAP [ 19 ] software tools to ensure accurate foreground delineation by filling gaps, removing errors, and adding missing regions. On average, correcting a single 3D CT image took only a few minutes. Since TotalSegmentator was only trained on CT images, it did not perform well on MRI images. Therefore, we annotated a smaller subset of images from each dataset using intensity thresholding and manual correction. This initial segmentation process was time-consuming and required significant effort to ensure accurate delineations. Once the initial network was trained on this subset, it was used to predict segmentations for the remaining MRI images, requiring only minor manual refinements, significantly reducing the time to just a few minutes per 3D image. Finally, we trained a nnU-Net on all training data including both modalities, increasing the patch size to 192\times 192\times 192 to reduce inference time and applying z-score normalization to handle CT and MRI images with a single network. Table 1: Overview of all datasets used for foreground prediction. * A small number of images from the original set of 1,228 CT and 298 MRI were excluded due to file corruption or incompatibility with MITK and ITK-SNAP. Dataset # Images Modalities LACS [ 15 ] 30 cardiac MRI ACDC [ 2 ] 300 cine MRI AMOS [ 7 ] 600 500 CT & 100 MRI (no further information given) TotSeg [ 17 ] 1360* 1092 CT & 268 MRI (no further information given) HanSeg [ 13 ] 84 42 CT & 42 T1w MRI OASIS3 [ 8 ] 860 200 CT, 200 T1w, 200 T2w, 100 Angio & 160 FLAIR MAAL [ 9 ] 65 CT Figure 2: Boxplot examples illustrating the Dice coefficient and HD95 for segmentation of deface area across different anonymization modes and the external OpenNeuro dataset. Deface area segmentation The publicly available OASIS 3 dataset [ 8 ] was used as a training dataset for the segmentation of the anonymized facial parts. We selected a total of 1,005 scans of this database, comprising 319 T1-weighted (T1w) images, 329 T2-weighted (T2w) images, 68 angiographic images, 130 FLAIR images, and 159 CT images. These images, originally non-anonymized, were subjected to artificial anonymization using the AFNI (Analysis of Functional NeuroImages) software [ 3 ] . AFNI provides three anonymization methods: deface, reface, and reface plus. Deface sets voxel values in the face and ears to zero, reface replaces them with a blurred generic face and blurred ears, and reface plus also applies blurring to the outer skull. Each image was processed with all three methods, resulting in a comprehensive dataset of 3015 anonymized images with corresponding masks and different anonymization schemes. The dataset was further extended with data from the OpenNeuro dataset collection [ 10 ] , which is particularly valuable due to its diverse MRI head scans in different acquisition sequences and accessible licensing, making it suitable for SSL training. This collection employed different anonymization methods, with some datasets providing original deface masks originating from the Defaced method [ 4 , 11 , 14 , 5 ] . There were a total of 107 MRI images in this OpenNeuro dataset, including 78 T1w and 29 T2w images. We then trained a nnU-Net on this dataset and we measured both the Dice score and 95% Hausdorff Distance (HD95) on a five-fold cross-validation. In one dataset within the OpenNeuro collection, 14 images were anonymized through blurring; however, no ground truth masks were provided [ 12