MoE-Health: A Mixture of Experts Framework for Robust Multimodal Healthcare Prediction DOI: XXXXXXX.XXXXXXX Conference: Make sure to enter the correct conference title from your rights confirmation email; June 03–05, 2018; Woodstock, NY ISBN: 978-1-4503-XXXX-X/2018/06 CCS: Applied computing Health i
Xiaoyang Wang, Christopher C. Yang · 2025
Read MoE-Health: A Mixture of Experts Framework for Robust Multimodal Healthcare Prediction DOI: XXXXXXX.XXXXXXX Conference: Make sure to enter the correct conference title from your rights confirmation email; June 03–05, 2018; Woodstock, NY ISBN: 978-1-4503-XXXX-X/2018/06 CCS: Applied computing Health i by Xiaoyang Wang, Christopher C. Yang (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2508-21793.txt.
Introduction
Wang and Yang propose MoE-Health, a mixture of experts framework for multimodal healthcare prediction, in a paper from twenty twenty-five. Health records, notes, and images arrive in varying combinations per patient. Most fusion methods demand complete data for every case. Their system routes each sample to specialized expert networks dynamically.
A gating mechanism picks experts based on which modalities exist. Three tasks on a large hospital data set test the framework. Mortality, long stay, and readmission prediction all improve. Robustness holds across different missing-modality patterns. Diverse hospitals with uneven data could deploy it realistically.
Catalog record
| CREATOR | Xiaoyang Wang, Christopher C. Yang |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 40 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2508-21793
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
MoE-Health: A Mixture of Experts Framework for Robust Multimodal Healthcare Prediction DOI: XXXXXXX.XXXXXXX Conference: Make sure to enter the correct conference title from your rights confirmation email; June 03–05, 2018; Woodstock, NY ISBN: 978-1-4503-XXXX-X/2018/06 CCS: Applied computing Health informatics CCS: Applied computing Bioinformatics CCS: Computing methodologies Artificial intelligence Xiaoyang Wang, Christopher C. Yang Abstract . Healthcare systems generate diverse multimodal data, including Electronic Health Records (EHR), clinical notes, and medical images. Effectively leveraging this data for clinical prediction is challenging, particularly as real-world samples often present with varied or incomplete modalities. Existing approaches typically require complete modality data or rely on manual selection strategies, limiting their applicability in real-world clinical settings where data availability varies across patients and institutions. To address these limitations, we propose MoE-Health, a novel Mixture of Experts framework designed for robust multimodal fusion in healthcare prediction. MoE-Health architecture is specifically developed to handle samples with differing modalities and improve performance on critical clinical tasks. By leveraging specialized expert networks and a dynamic gating mechanism, our approach dynamically selects and combines relevant experts based on available data modalities, enabling flexible adaptation to varying data availability scenarios. We evaluate MoE-Health on the MIMIC-IV dataset across three critical clinical prediction tasks: in-hospital mortality prediction, long length of stay, and hospital readmission prediction. Experimental results demonstrate that MoE-Health achieves superior performance compared to existing multimodal fusion methods while maintaining robustness across different modality availability patterns. The framework effectively integrates multimodal information, offering improved predictive performance and robustness in handling heterogeneous and incomplete healthcare data, making it particularly suitable for deployment in diverse healthcare environments with heterogeneous data availability. 1. Introduction The integration of artificial intelligence in healthcare has witnessed remarkable progress, with predictive models increasingly leveraging diverse data modalities to improve clinical decision-making ( Soenksen et al. 2022 ) . Modern healthcare systems generate vast amounts of heterogeneous data, including structured electronic health records (EHRs), unstructured clinical notes, and medical imaging data ( Soenksen et al. 2022 ; Shaik et al. 2024 ) . This multimodal nature of healthcare data presents both opportunities and challenges for developing robust predictive models that can support critical clinical tasks such as mortality prediction, length of stay estimation, and readmission forecasting. While multimodal approaches have demonstrated superior performance compared to single-modality methods, existing frameworks face significant limitations in real-world deployment scenarios. Most current multimodal healthcare prediction models are trained and evaluated on patient subsets with complete modality availability ( Wang et al. 2024b ; Wang et al. 2024a ) , overlooking the variability and incompleteness that are inherent in clinical practice. In reality, healthcare institutions differ in their data collection protocols, technological infrastructure, and documentation quality, resulting in frequent cases where certain modalities are unavailable. Our analysis of the MIMIC-IV dataset illustrates this issue clearly: among 31,088 admissions, only 37.4% contain all three modalities—structured EHR, clinical notes, and CXR images. This missingness highlights a key limitation of existing approaches: by assuming fully observed inputs, they exclude a large proportion of the patient population and fail to model the complex interactions between partially observed modalities. Such limitations are particularly problematic in high-stakes environments like emergency departments, where timely decisions must be made based on whatever data is immediately accessible ( Zhang et al. 2022 ; Arnaud et al. 2023 ) . In these scenarios, reliance on fully observed data is impractical. Therefore, there is a pressing need for predictive frameworks that are robust to missing or varying modalities, capable of adapting dynamically to whatever information is available. These models must ensure reliable decision support across the full spectrum of patients, rather than a privileged subset with complete records. To address these challenges, we propose MoE-Health, a novel Mixture of Experts (MoE) framework specifically designed for robust multimodal healthcare prediction. MoE-Health leverages the strengths of expert models specialized for different data modalities (or combinations thereof) and a gating mechanism to dynamically weigh their contributions. Specifically, this architecture allows the framework to effectively handle samples with differing sets of available modalities and learn tailored fusion strategies. The main contributions of this work are as follows: • We propose MoE-Health, a Mixture of Experts framework specifically engineered for robust clinical prediction from heterogeneous multimodal data with inherent missingness. • We design a unique architecture featuring specialized experts, each pre-trained to handle specific combinations of data modalities, coupled with a dynamic gating mechanism that intelligently routes patient data. This design explicitly models and adapts to real-world data availability patterns. • We conduct extensive experiments on the large-scale MIMIC-IV dataset across three clinically significant prediction tasks. Our results validate that MoE-Health consistently outperforms established baselines, demonstrating the framework’s effectiveness and robustness in realistic, incomplete-data scenarios. 2. Related Work 2.1. Healthcare Predictive Modeling Predictive modeling in healthcare has seen significant advancements, particularly with the availability of large-scale datasets like MIMIC-IV ( Johnson et al. [n. d.] ) . Traditional approaches, such as logistic regression and gradient boosting, have been widely used for tasks such as mortality prediction, length-of-stay estimation, and hospital readmission prediction ( Rajkomar et al. 2018 ) . More recently, deep learning has emerged as a powerful paradigm in healthcare analytics. Convolutional Neural Networks (CNNs) have achieved state-of-the-art results in medical image analysis ( Litjens et al. 2017 ) , while Recurrent Neural Networks (RNNs), Long Short-Term Memory (LSTM) networks, and Transformer models have shown significant promise in processing sequential data like EHR time series and unstructured clinical notes ( Xu et al. 2023 ) . These models excel at automatic feature extraction from high-dimensional data and learning intricate patterns that may be missed by traditional techniques. Applications span a wide range of clinical problems, including those addressed in our work such as mortality prediction, length of stay estimation, and readmission risk assessment ( Zhang et al. 2023 ) . However, these methods typically focus on a single modality, such as EHR, and struggle to incorporate complementary data from clinical notes or medical images. This reliance on single-modality inputs limits their ability to capture the full complexity of patient health, particularly in real-world scenarios where data availability varies. Furthermore, these models often require extensive feature engineering or preprocessing, reducing their scalability across diverse clinical tasks. Our MoE-Health framework addresses these limitations by dynamically integrating multiple modalities, offering a more flexible and robust solution for healthcare prediction. 2.2. Multimodal Learning Multimodal learning focuses on building models that can process and relate information from multiple heterogeneous data sources ( Baltrušaitis et al. 2018 ) . In healthcare, this involves integrating data from EHRs, clinical notes, medical images, genomics, and other physiological signals to gain a more holistic understanding of a patient’s condition ( Zhao et al. 2024 ; Krones et al. 2025 ) . The central idea is that different modalities offer complementary information, and their effective fusion can lead to more accurate and robust predictions than using any single modality alone. Initially, researchers fused modality embedding vectors using methods such as direct concatenation, summation, or pooling for downstream tasks ( Soenksen et al. 2022 ) . Early fusion approaches combine raw data from different modalities before processing, while late fusion combines predictions from modality-specific models. Intermediate fusion strategies, which combine features at various stages of processing, have shown superior performance