On-the-Fly Data Augmentation for Brain Tumor Segmentation
Ishika Jain, Siri Willems, Steven Latre, Tom De Schepper · 2025
Read On-the-Fly Data Augmentation for Brain Tumor Segmentation by Ishika Jain, Siri Willems, Steven Latre, Tom De Schepper (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2509-24973.txt.
Introduction
Ishika Jain and co-authors grow fake tumors inside brain scans during training, rather than storing them. Their twenty twenty-five paper serves tumor segmentation across scans taken before and after treatment. Gliomas change shape over therapy, and labeled examples of each stage are scarce.
A generative network inserts synthetic tumors into real scans on the fly. Three segmentation models built on nnU-Net are compared, with and without the trick and in ensembles. Making data during training skips the storage cost of giant augmented sets. The aim is a model that tracks a tumor through the whole treatment arc, giving doctors a steady ruler for growth or shrink.
Catalog record
| CREATOR | Ishika Jain, Siri Willems, Steven Latre, Tom De Schepper |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 31 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2509-24973
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
On-the-Fly Data Augmentation for Brain Tumor Segmentation Ishika Jain, Siri Willems, Steven Latre, Tom De Schepper Abstract Robust segmentation across both pre-treatment and post-treatment glioma scans can be helpful for consistent tumor monitoring and treatment planning. BraTS 2025 Task 1 addresses this by challenging models to generalize across varying tumor appearances throughout the treatment timeline. However, training such generalized models requires access to diverse, high-quality annotated data, which is often limited. While data augmentation can alleviate this, storing large volumes of augmented 3D data is computationally expensive. To address these challenges, we propose an on-the-fly augmentation strategy that dynamically inserts synthetic tumors using pretrained generative adversarial networks (GliGANs) during training. We evaluate three nnU-Net-based models and their ensembles: (1) a baseline without external augmentation, (2) a regular on-the-fly augmented model, and (3) a model with customized on-the-fly augmentation. Built upon the nnU-Net framework, our pipeline leverages pretrained GliGAN weights and tumor insertion methods from prior challenge-winning solutions. An ensemble of the three models achieves lesion-wise Dice scores of 0.79 (ET), 0.749 (NETC), 0.872 (RC), 0.825 (SNFH), 0.79 (TC), and 0.88 (WT) on the online BraTS 2025 validation platform. This work ranked first in the BraTS Lighthouse Challenge 2025 Task 1- Adult Glioma Segmentation. Ensemble 1 Introduction Gliomas are the most common malignant primary brain tumors found in adults. These diffuse gliomas present significant clinical challenges due to their highly infiltrative growth into normal tissue, heterogeneous biology, and variable response to therapy. Accurate assessment of these tumors is critical for diagnosis, treatment planning, monitoring progression and predicting patient outcomes [ 5 ] [ 11 ] . These assessments are performed by precise delineation, mainly performed manually, of different regions of the tumor, based on information from various MRI modalities (T1,T2, FLAIR, …). However, manual segmentation of gliomas is time-consuming, subjective and prone to human error, which motivates the need for automated and reproducible solutions. Over the past 15 years, AI has rapidly evolved, driven by breakthroughs in neural network architectures and learning paradigms. Initially, Convolutional Neural Networks (CNNs) revolutionized image processing, including medical imaging tasks, by excelling at detecting spatial patterns [ 21 ] . Frameworks as U-Net became popular for solving unimodal and multi-modal medical imaging challenges [ 18 ] . The introduction of transformers marked a significant shift in AI, enabling models to capture long-range dependencies and contextual relationships within data [ 22 ] . Vision transformers like TransUNet [ 9 ] , for example, excel at understanding spatial correlations across the entire images and have significantly improved both the accuracy and efficiency of segmentation methods, outperforming CNNs in scenarios with large, diverse datasets [ 23 ] . In general, these models leverage large-scale data, self-configuring pipelines, and attention mechanisms to better capture complex anatomical structures, reducing manual effort and accelerating clinical workflows. To drive research further towards development of robust data-driven clinical pipelines, different challenges tackling various clinical problems are hosted at the annual Medical Image Computing and Computer Assisted Intervention (MICCAI). The Brain Tumor Segmentation (BraTS) challenge in particular provides standardized, annotated datasets and a fair, open benchmarking platform to drive research in automated brain tumor segmentation [ 13 ] . The 2025 BraTS subchallenge on pre- and post-treatment glioma [ 4 ] [ 2 ] [ 5 ] [ 12 ] focuses on robust, automated segmentation of both pre- and post-treatment MRI images specifically, from adults diagnosed with diffuse gliomas. Hereby, aiming to create tools for objectively assessing tumor volume for treatment planning on one hand, and post surgical monitoring and outcome prediction on the other hand. 1.1 State of the Art A well-known challenge for solving medical tasks using a data-driven approach is the scarcity of data. While there are millions of images of natural scenes, medical imaging datasets consist of only hundred or couple of thousand samples. Data augmentation strategies are key for the development of robust and strong performing models, which has been proven in previous editions of the BraTS challenge. In the BraTS 2023 pre-treatment adult glioma segmentation challenge, top-performing methods focused on enhancing segmentation precision through architectural innovations and advanced augmentation. The winning team "Faking It" introduced GliGAN, a GAN-based data augmentation framework that inserts realistic synthetic tumors into healthy MRIs using a Swin UNETR-based generator [ 1 ] . Other methods employed robust 3D U-Net with attention mechanism [ 11 ] , and lesion-wise loss function [ 19 ] to better capture tumor boundaries and sub-regions. Some achieved competitive results by leveraging model diversity and robust post-processing [ 10 ] . The winners of the BraTS 2024 post-treatment glioma segmentation challenge were the same team "Faking It", continuing their success by generating massive synthetic data and ensembling diverse architectures trained across multiple folds. Other teams explored ideas, such as generating an additional input image via a linear combination of MRI sequences to emphasize contrast-enhancing tumor regions. This artificial sequence, proposed by Kim [ 3 ] , improved segmentation accuracy when used alongside the original modalities in ensemble models. While the winning methods in the BraTS 2023 and 2024 challenges achieved notably higher segmentation scores, particularly through advanced augmentation strategies, model ensembling, and synthetic data generation, several limitations remain. • Augmentation using registration took around 2 weeks, ensembling multiple models substantially increases computational cost. • Underrepresented subregions, remain difficult to segment accurately due to low lesion frequency and volume. • In post-treatment gliomas, the presence of multiple small lesions, often low contrast makes accurate segmentation difficult, contributing to lower Dice scores and higher lesion-level false negatives, particularly for the tumor core. In this work, we address these challenges by integrating on-the-fly data augmentation into the nnU-Net training pipeline. This approach not only enables the dynamic insertion of synthetic tumors during training but also allows for targeted augmentation—such as adding small lesions or omitting specific tumor classes—to address class imbalance. Furthermore, we ensemble the augmented models with a baseline model to leverage both the diversity introduced through augmentation and the stability of the original training distribution, aiming for a well-balanced and robust segmentation performance. 2 Methods 2.1 Data The data provided by the BraTS 2025 challenge is acquired over multiple institutions and includes routine pre- and post-treatment multi-parametric MRI (mpMRI) from patients diagnosed with diffuse gliomas resulting in total in 2877 cases. Each case in the dataset has four co-registered mpMRI modalities in NIfTI format: native T1-weighted (t1n), post-contrast T1-weighted (t1ce), T2-weighted (t2w), and T2 FLAIR (t2f). All volumes are isotropically resampled to a resolution of 1mm 3 with dimensions (182,218,182). Corresponding annotations (Figure 1 ) consist of four tumor subregions to which we refer as ’Tumor Classes’ from now on: • Non-enhancing tumor core (NETC)- the necrosis and cysts within the tumor • Surrounding non-enhancing FLAIR hyperintensity (SNFH)- edema, infiltrating tumor, and post-treatment changes • Enhancing tumor (ET)- regions of active tumor • Resection cavity (RC) -recent and chronic resection cavities (only in post-treatment scans) For clinical decision-making, two composite regions are also of importance and are thus also considered for evaluation: • Tumor core (TC) includes NETC and ET (labels 1 and 3), representing the lesion that is typically removed during surgical resection. • Whole tumor (WT) includes all abnormal tissue (labels 1, 2, 3), representing the whole extent of