Robust Brain Tumor Segmentation with Incomplete MRI Modalities Using Hölder Divergence and Mutual Information-Enhanced Knowledge Transfer
Runze Cheng, Xihang Qiu, Ming Li, Ye Zhang, Chun Li, F. Yu · 2025
Read Robust Brain Tumor Segmentation with Incomplete MRI Modalities Using Hölder Divergence and Mutual Information-Enhanced Knowledge Transfer by Runze Cheng, Xihang Qiu, Ming Li, Ye Zhang, Chun Li, F. Yu (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2507-01254.txt.
Introduction
Six researchers build a brain tumor segmentation system that tolerates missing scans in a paper from 2025. Tumor outlining usually needs several MRI types at once. In practice, some scans are missing due to quality, cost, or patient issues. Their framework processes each available scan type in parallel. Special loss functions keep each stream faithful while sharing useful knowledge across streams.
Two ideas drive the losses, one measuring mismatch with a flexible divergence and one rewarding shared information. Tests on two public tumor data sets beat existing methods when scans were missing. The authors stress consistent accuracy across missing-data patterns. The design targets real clinics, where incomplete imaging is common.
Catalog record
| CREATOR | Runze Cheng, Xihang Qiu, Ming Li, Ye Zhang, Chun Li, F. Yu |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 75 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2507-01254
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Robust Brain Tumor Segmentation with Incomplete MRI Modalities Using Hölder Divergence and Mutual Information-Enhanced Knowledge Transfer Runze Cheng, Xihang Qiu, Ming Li, Ye Zhang, Chun Li, F. Yu Abstract Multimodal MRI provides critical complementary information for accurate brain tumor segmentation. However, conventional methods struggle when certain modalities are missing due to issues like image quality, protocol inconsistencies, patient allergies, or financial constraints. To address this, we propose a robust single-modality parallel processing framework that achieves high segmentation accuracy even with incomplete modalities. Leveraging Hölder divergence and mutual information, our model maintains modality-specific features while dynamically adjusting network parameters based on available inputs. By using these divergence and information-based loss functions, the framework effectively quantifies discrepancies between predictions and ground-truth labels, resulting in consistently accurate segmentation. Extensive evaluations on the BraTS 2018 and BraTS 2020 datasets demonstrate superior performance over existing methods in handling missing modalities, with ablation studies validating each component’s contribution to the framework. I Introduction Brain tumors are aggressive diseases requiring early, accurate detection to improve treatment outcomes. Magnetic Resonance Imaging (MRI) is widely regarded as an essential tool for assessing brain tumors, thanks to its high-resolution soft tissue contrast and non-invasive nature [ 1 ] . MRI-based brain tumor segmentation is critical in delineating healthy tissue from tumorous regions, which supports diagnosis, tracking tumor progression, and assessing treatment response. Typically, multimodal MRI—consisting of T1-weighted, T1-weighted post-contrast (T1c), T2-weighted, and FLAIR images—provides complementary insights, with each modality capturing specific tissue characteristics necessary for precise tumor boundary identification [ 2 , 3 , 4 ] . Most traditional segmentation methods assume access to all four MRI modalities. However, in clinical practice, it is common for one or more modalities to be unavailable, resulting in incomplete multimodal data. Missing modalities can occur due to various reasons, such as differences in imaging protocols, patient allergies to contrast agents, image quality issues from patient movement, or resource limitations in healthcare facilities [ 5 ] . These scenarios of missing modalities pose significant challenges for existing segmentation methods, which often experience performance drops without access to the full imaging data. To address the missing-modality issue, two main approaches have emerged: modality-specific methods and unified single-model methods. In modality-specific approaches, separate models are trained for each missing modality scenario, allowing for knowledge transfer from well-trained multimodal networks to those designed for limited modalities. For instance, SMU-Net [ 6 ] utilized a teacher-student framework, where a multimodal teacher network transfers knowledge to unimodal student networks. ProtoKD [ 7 ] combined knowledge distillation with prototype learning to capture essential data patterns, while MMCFormer [ 8 ] employed transformers with auxiliary tokens for modality-specific representation transfer. Although these methods can achieve high segmentation accuracy, they are computationally intensive, especially with more modalities, as each missing-modality case requires a unique model, leading to exponential growth in the number of models. The second approach addresses all missing-modality scenarios with a unified model, typically by projecting each modality through independent encoders into a shared latent space for feature fusion. For instance, RFNet [ 9 ] adopts a region-aware fusion strategy; Ting and Liu [ 10 ] introduce modality-specific encoders coupled with a shared decoder; and Wang et al. [ 11 ] combine shared and modality-specific features to enhance segmentation performance. Recent methods, including GGMD [ 12 ] , MAVP [ 13 ] , and QuMo [ 14 ] , further aim to improve robustness under missing modalities. Specifically, GGMD applies gradient-guided modality decoupling to reduce overreliance on dominant modalities but neglects optimization for asymmetric data distributions and underutilizes cross-modal complementarity. MAVP employs a modality-status classifier to generate visual prompts that guide feature fusion, yet it is susceptible to classifier inaccuracies and does not address data distribution asymmetry. QuMo adapts to missing modalities via learnable queries but fails to adequately mitigate dominant modality effects and lacks explicit metrics for handling asymmetry. In summary, although unified models effectively reduce computational overhead, they typically struggle to maintain robust and consistent performance under complex missing-modality conditions or imbalanced data distributions. To overcome these limitations, we propose a single-modality parallel processing framework [ 15 , 16 , 17 , 18 ] that integrates Hölder divergence and mutual information for enhanced robustness in missing-modality scenarios. Inspired by Chang et al. [ 19 ] on mutual information-based learning and recent advancements in high mutual information knowledge transfer [ 20 ] , our approach processes each modality independently through a shared network backbone, preserving modality-specific information and allowing flexible handling of missing modalities. Specifically, we introduce a mutual information-based metric with Hölder divergence [ 21 ] to robustly measure discrepancies between predicted and true segmentation maps, promoting effective feature alignment across modalities. The main contributions of this work include: 1. Novel Network Architecture: A parallel 3D U-Net-based structure that processes each modality independently and dynamically adjusts network parameters for missing modalities, achieving high segmentation accuracy even with incomplete data. 2. Enhanced Robustness with Hölder Divergence and Mutual Information: By incorporating Hölder divergence and mutual information into the loss function, our method effectively measures prediction-label discrepancies, improving robustness against data distribution asymmetries. 3. Extensive Validation and Ablation Studies: Comprehensive evaluations on the BraTS 2018 and BraTS 2020 datasets demonstrate that our framework consistently outperforms existing methods across various missing-modality scenarios. Ablation studies further validate each component’s significance in achieving robust segmentation. In conclusion, this study introduces a robust solution to the missing-modality problem in brain tumor segmentation, addressing both computational efficiency and segmentation accuracy challenges. By harnessing the benefits of Hölder divergence and mutual information for effective knowledge transfer, our framework offers a resilient approach for multimodal segmentation in diverse clinical environments. This work is an extended version of the conference paper Robust Divergence Learning for Missing-Modality Segmentation [ 22 ] , which has been accepted for presentation at the China Automation Congress 2024 . Compared to the conference version, this work extends the original work in three primary aspects: (1). We redesign and present a more rigorous and systematic network architecture diagram to improve the clarity and precision of the proposed methodology; (2). We conduct more extensive experimental analyses, comprehensively benchmarking our approach against state-of-the-art methods addressing the missing modality segmentation problem, thus verifying its superiority and state-of-the-art performance; and (3), We provide an in-depth theoretical analysis, including Theorems 1 through 7, which rigorously demonstrates the validity and robustness of the proposed method, significantly enhancing the methodological rigor and theoretical foundation of this manuscript. II Related Works II-A Incomplete Multi-Modal Brain Tumor Segmentation Deep learning has been widely applied in various scenarios such as intelligent transportation [ 23 , 24 , 25 ] , cross-modal learning [ 26 , 27 , 28 ] , privacy protection [ 29 , 30 ] , and artificial intelligence generated content [ 31 , 32 , 33 ] . For brain tumor segmentation, compared to methods that assumed all modalities are available [ 34 ] , segmentation approaches handling missing modalities faced greater challenges but offered more practical flexibility for real-world applications. For example, HeMIS [ 35 ] addressed the issue of missing modalities by learning modality embeddings and mapping them into a shared latent space, effectively avoiding traditional data imputation techniques. ACN [ 36 ] and SMU-Net [ 6 ] introduced