A Multi-Stage Fine-Tuning and Ensembling Strategy for Pancreatic Tumor Segmentation in Diagnostic and Therapeutic MRI
Omer Faruk Durugol, Maximilian Rokuss, Yannick Kirchhoff, Klaus H. Maier-Hein · 2025
Read A Multi-Stage Fine-Tuning and Ensembling Strategy for Pancreatic Tumor Segmentation in Diagnostic and Therapeutic MRI by Omer Faruk Durugol, Maximilian Rokuss, Yannick Kirchhoff, Klaus H. Maier-Hein (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2508-21775.txt.
Introduction
Omer Faruk Durugol and three co-authors detail a prize entry for outlining pancreatic tumors on MRI scans. Their work appeared in twenty twenty-five. The cancer is hard to spot against normal tissue, and labeled training scans are scarce.
Their pipeline starts from a general anatomy model, then fine-tunes in stages: first on CT scans of pancreatic lesions, then on the target MRI types. Two tasks cover diagnostic and therapy scans. Careful tests split augmentation styles: heavy changes maximized volume overlap, while defaults gave the sharpest borders. The final entry blended specialist models chosen by metric. Scores topped their validation table for the diagnostic task. The method suits other scarce-data imaging problems.
Catalog record
| CREATOR | Omer Faruk Durugol, Maximilian Rokuss, Yannick Kirchhoff, Klaus H. Maier-Hein |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 24 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2508-21775
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
A Multi-Stage Fine-Tuning and Ensembling Strategy for Pancreatic Tumor Segmentation in Diagnostic and Therapeutic MRI Omer Faruk Durugol, Maximilian Rokuss, Yannick Kirchhoff, Klaus H. Maier-Hein Abstract Automated segmentation of Pancreatic Ductal Adenocarcinoma (PDAC) from MRI is critical for clinical workflows but is hindered by poor tumor-tissue contrast and a scarcity of annotated data. This paper details our submission to the PANTHER challenge , addressing both diagnostic T1-weighted (Task 1) and therapeutic T2-weighted (Task 2) segmentation. Our approach is built upon the nnU-Net framework and leverages a deep, multi-stage cascaded pre-training strategy, starting from a general anatomical foundation model and sequentially fine-tuning on CT pancreatic lesion datasets and the target MRI modalities. Through extensive five-fold cross-validation, we systematically evaluated data augmentation schemes and training schedules. Our analysis revealed a critical trade-off, where aggressive data augmentation produced the highest volumetric accuracy, while default augmentations yielded superior boundary precision (achieving a state-of-the-art MASD of 5.46 mm and HD95 of 17.33 mm for Task 1). For our final submission, we exploited this finding by constructing custom, heterogeneous ensembles of specialist models, essentially creating a mix of experts. This metric-aware ensembling strategy proved highly effective, achieving a top cross-validation Tumor Dice score of 0.661 for Task 1 and 0.523 for Task 2. Our work presents a robust methodology for developing specialized, high-performance models in the context of limited data and complex medical imaging tasks ( Team MIC-DKFZ ). † These authors contributed equally to this work. * Corresponding author: 1 Introduction Magnetic Resonance Imaging (MRI) is a cornerstone in the management of pancreatic cancer, one of the most lethal malignancies worldwide [ 2 ] . It provides critical visualization for diagnosis, staging, and treatment planning, particularly with the advent of advanced techniques like MR-guided linear accelerators (MR-Linacs) for adaptive radiation therapies [ 5 ] . However, the manual delineation of tumors and surrounding tissues from these images is a significant bottleneck. This process is not only time-consuming and labor-intensive but also highly dependent on expert radiologist interpretation, which is challenged by the pancreas’s complex anatomy and additionally by the subtle appearance of tumors on certain MRI phases [ 7 ] . Automated pancreatic tumor segmentation presents a compelling solution, promising to accelerate clinical workflows and improve the consistency of clinical analysis. Despite this potential, automated segmentation of pancreatic tumors on MRI faces substantial hurdles. The complexity stems from the low soft-tissue contrast of tumors against surrounding pancreatic tissue, close proximity to similar structures like small/large bowel, anatomical variability between patients, and the significant changes in tumor shape and position that can occur during a course of treatment. Furthermore, the lack of large, publicly available, annotated MRI datasets for pancreatic cancer has severely limited the development, validation, and benchmarking of robust AI-driven solutions [ 1 ] . Models must be capable of performing accurately across different MRI sequences-such as T1W CE (T1-Weighted, Contrast-enhanced) scans for diagnosis and T2W (T2-Weighted) scans for on-treatment guidance-and generalize well despite variations in imaging phases and protocols. To spur innovation and address these challenges, the PANTHER challenge (Pancreatic Tumor Segmentation in Therapeutic and Diagnostic MRI) was established. As the first grand challenge of its kind, PANTHER challenge provides a platform for researchers to develop and benchmark algorithms on the first publicly available dataset for this task, encompassing both diagnostic T1W and treatment-planning MR-Linac T2W scans. The challenge tasks participants with creating robust models for two distinct clinical needs: Segmenting tumors from T1W diagnostic MRIs (Task 1) and T2W MR-Linac images (Task 2), the latter of which represents a real-world few-shot learning problem due to the limited data available (50 training cases). This manuscript details our participation in the PANTHER challenge , where we address both Task 1 and Task 2. Our approach is built upon the strong foundation of the nnU-Net v2 framework. We tackle the aforementioned challenges of pancreatic tumor segmentation through robust data handling, network architecture design, and ensembling strategies. Our goal is to develop highly accurate and generalizable models for both tasks, that can effectively handle the complexities of different MRI sequences and contribute to the advancement of automated tools for pancreatic cancer treatment. 2 Methods Our method builds upon the robust and self-configuring nnU-Net framework [ 3 ] , a leading approach in medical image segmentation. To address the specific challenges of pancreatic ductal adenocarcinoma (PDAC) segmentation in multi-modal MRI, we developed a multi-stage, cascaded fine-tuning strategy and systematically evaluated the impact of data augmentation and training hyperparameters. We selected the recently introduced Residual Encoder, ResEncL [ 4 ] as our network backbone due to its demonstrated power and large capacity. 2.1 nnUNet Configuration All experiments were conducted using the 3d_fullres configuration. A critical step in our methodology was data harmonization; all MRI sequences were resampled to an isotropic spacing of [1.0, 1.0, 1.0] mm. This isotropic resampling ensures that the network learns features that are invariant to the initial orientation and slice thickness of the input scans, which is crucial for building a robust model from multi-center data. Based on our experimental results, we identified an optimal training schedule of 150-200 epochs with an initial learning rate of 1e-3 and a batch size of 2. We utilized a large, isotropic patch size of [192, 192, 192] to provide the network with sufficient 3D context, which is vital for distinguishing the subtle textural changes of PDAC from surrounding healthy pancreatic tissue. The standard nnU-Net training utilizes a PolyLR scheduler; however, we also explored alternatives with warmup and augmentation to optimize convergence for our specific fine-tuning task. 2.2 Pretraining and Finetuning Recognizing the challenge of segmenting PDAC, especially in the low-contrast T2W modality (Task 2), we adopted a cascaded pre-training and fine-tuning approach to imbue the model with a rich anatomical prior. Our strategy consists of three main stages: 1. Foundation Pre-training: We began with a powerful foundation model pre-trained on a vast, multi-modal dataset of over 18,000 3D medical scans, including CT, MRI, and PET images, in a MultiTalent-inspired fashion [ 6 ] . This model called MultiTalentV2 1 1 1 https://zenodo.org/records/13753413 , has a deep, generalized understanding of abdominopelvic anatomy. 2. Task-Specific Pre-training (CT Lesions): The MultiTalentV2 model was then fine-tuned on a large dataset of 760 CT scans combined from MSD and PANORAMA datasets, featuring pancreatic lesions, we call this dataset PancCTPretrain. This step specialized the model’s anatomical knowledge to the specific morphology of pancreatic pathologies. The resulting model is our PancCTMultiTalentV2 cascade pre-training model. 3. Modality Bridging and Final Fine-tuning: This PancCTMultiTalentV2 cascade served as the starting point for all our PANTHER-specific training. We reduced the initial learning rate to 1e-3 to counteract catastrophic forgetting and train the model on the learned weights from the pre-trainings. For Task 2 (T2W), we found that an additional intermediate fine-tuning step on Task 1 (T1W) was critical for bridging the modality gap between CT and T2W MRI. Our final and best-performing models for Task1 and Task 2 were therefore trained with the cascades shown in Fig 1 : Figure 1 : The multi-stage cascaded fine-tuning strategy for our final models. A foundational model pre-trained on diverse medical data is first specialized on pancreatic CT lesions. This cascade model is then fine-tuned to create the final Task 1