Not Only Grey Matter: OmniBrain for Robust Multimodal Classification of Alzheimer’s Disease

Ahmed Sharshar, Yasser Ashraf, Tameem Bakr, Salma Hassan, Hosam Elgendy, Mohammad Yaqub, Mohsen Guizani, Mohamed bin Zayed University of Artificial Intelligence (MBZUAI), Abu Dhabi UAE · 2025

Read Not Only Grey Matter: OmniBrain for Robust Multimodal Classification of Alzheimer’s Disease by Ahmed Sharshar, Yasser Ashraf, Tameem Bakr, Salma Hassan, Hosam Elgendy, Mohammad Yaqub, Mohsen Guizani, Mohamed bin Zayed University of Artificial Intelligence (MBZUAI), Abu Dhabi UAE (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2507-20872.txt.

Introduction

Ahmed Sharshar and co-authors present OmniBrain in this 2025 paper, a system that classifies Alzheimer's disease from many data types at once. The disease affects over fifty-five million people, and the count is set to more than double by 2050. Past systems tended to fail at least one need: accuracy, use across data sets, grace when a data type is missing, or clear reasons for a call.

OmniBrain joins brain MRI scans, radiomics measures, gene activity, and clinical data in one model. Cross-attention links the streams, and random dropout of streams in training teaches it to cope with gaps. It scored about ninety-two percent accuracy on one data set and about seventy percent on a second, MRI only set. Checks of its reasoning pointed to brain regions and genes known to matter in the disease. The authors offer it as a robust and explainable aid for diagnosis.

Catalog record

CREATORAhmed Sharshar, Yasser Ashraf, Tameem Bakr, Salma Hassan, Hosam Elgendy, Mohammad Yaqub, Mohsen Guizani, Mohamed bin Zayed University of Artificial Intelligence (MBZUAI), Abu Dhabi UAE
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE38 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2507-20872

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Not Only Grey Matter: OmniBrain for Robust Multimodal Classification of Alzheimer’s Disease Ahmed Sharshar, Yasser Ashraf, Tameem Bakr, Salma Hassan, Hosam Elgendy, Mohammad Yaqub, Mohsen Guizani, Mohamed bin Zayed University of Artificial Intelligence (MBZUAI), Abu Dhabi UAE Abstract Alzheimer’s disease affects over 55 million people worldwide and is projected to more than double by 2050, necessitating rapid, accurate, and scalable diagnostics. However, existing approaches are limited because they cannot achieve clinically acceptable accuracy, generalization across datasets, robustness to missing modalities, and explainability all at the same time. This inability to satisfy all these requirements simultaneously undermines their reliability in clinical settings. We propose OmniBrain , a multimodal framework that integrates brain MRI, radiomics, gene expression, and clinical data using a unified model with cross-attention and modality dropout. OmniBrain achieves 92.2 ± 2.4 % 92.2\pm 2.4\% accuracy on the ANMerge dataset and generalizes to the MRI-only ADNI dataset with 70.4 ± 2.7 % 70.4\pm 2.7\% accuracy, outperforming unimodal and prior multimodal approaches. Explainability analyses highlight neuropathologically relevant brain regions and genes, enhancing clinical trust. OmniBrain offers a robust, interpretable, and practical solution for real-world Alzheimer’s diagnosis. 1 Introduction Alzheimer’s disease (AD) is a chronic neurodegenerative disorder that progressively erodes memory, reasoning, and communication. It accounts for 60-70% of dementia cases worldwide [ 29 ] , affecting about 55 million people in 2020 and expected to top 139 million by 2050 [ 29 ] . In the United States, nearly 7 million people live with AD, a figure projected to almost double by mid‑century [ 5 ] . Dementia already costs more than $1 trillion annually and could reach $2 trillion by 2030, underscoring the need for accurate and efficient diagnostics. AD evolves from mild cognitive impairment (MCI), subtle cognitive deficits, to severe dementia; symptom‑free individuals are labeled cognitively normal controls (CTL). Distinguishing CTL, MCI, and AD is difficult because symptoms overlap, onset is gradual, and definitive biomarkers remain scarce. Many deep‑learning models train on homogeneous cohorts and therefore fail to generalise [ 3 ] . Despite rapid advances in medical AI, most Alzheimer’s diagnostic systems remain limited in practical scope. As summarized in Table 1 , prior studies typically focus on a single data modality (MRI scans), neglecting key biomarkers (e.g., gene expression, cognitive scores) crucial for reliable AD classification. Even recent multimodal models rarely address two essential challenges: (1) the frequent absence of clinical or genetic data in real-world settings, and (2) the need for robust validation across multiple datasets to ensure generalizability. Furthermore, explainability—a prerequisite for clinical adoption—remains underexplored. These gaps have collectively hindered translation from research to routine care, motivating the development of a comprehensive framework that is not only multimodal, but also resilient to missing data, validated across cohorts, and interpretable by design. The proposed framework addresses these limitations by introducing a comprehensive, multimodal framework that fuses structural MRI information with radiomics, meta information (e.g., APOE), cognitive scores (e.g., MMSE), and gene expression features to classify CTL, MCI, and AD robustly while being able to perform if one of these modalities is missing constantly. Specifically, we leverage: • Foundation models (AnatCL, y-Aware InfoNCE) for anatomical MRI representations and an FT-Transformer for tabular data (radiomics, metadata, gene expression), integrating these via an attention-based fusion mechanism. • A missing-modality approach that incorporates genes and clinical metadata during training but allows for inference with or without these inputs, reducing real-world data constraints. • Cross-dataset validation on ADNI—showcasing state-of-the-art results on ANMerge and strong generalization to different data distributions. We also employ interpretable analytics (e.g., radiomics) to highlight key features and enhance clinical trust. Figure 1 : Multimodal diagnostic pipeline for dementia classification. MRI scans are processed to extract grey matter maps and radiomics features. Genetic and EHR data undergo feature selection. Grey matter is passed through AnatCL, while selected tabular features flow through the FT-Transformer. A cross-attention module integrates both representations before predicting dementia class (CTL, MCI, AD). Missing modalities such as EHR and genetic data are outlined in red to indicate their potential absence. The proposed framework processes MRI data by integrating genetic and clinical metadata to enhance accuracy, without requiring additional resources such as costly gene sequencing data at inference time. By effectively addressing the challenges of generalizability and interpretability, the proposed system demonstrates better real-world feasibility and outperforms existing methods. The key contributions of our work are as follows: 1. Comprehensive Multimodal Learning: OmniBrain, an elegant multimodal model that fuses structural MRI, radiomics, cognitive scores, and gene expression data into a single framework, providing the most holistic modeling view of AD pathology. 2. Robust Missing-Modality Strategy: Although training is performed on multimodal data, we employ a practical method combining Modality-Aware Attention Masking , enabling the model to effectively handle missing modalities during inference and enhancing its robustness for real-world applications. 3. State-of-the-Art Performance and Transferability: We achieve new SOTA results on ANMerge and demonstrate effective generalization to ADNI, even with incomplete inputs, reinforcing the framework’s real-world applicability. 2 Related Work Benchmarking AD Classification Results. The Alzheimer’s Disease Neuroimaging Initiative (ADNI) is widely used as a benchmark for Alzheimer’s classification. Zarei et al. 2024 applied 3D-CNN models combined with hippocampal and amygdala radiomics, reporting an accuracy of 84.4\% for AD vs. CTL, but only \sim 57\% for AD vs. MCI. Maddalena et al. 2022a used the ANMerge dataset, which includes MRI, gene expression, and clinical measures for over 1,700 participants. They fused MRI and gene expression data, achieving 94.6\% accuracy for AD vs. CTL, but performance dropped to 56\% for MCI vs. CTL. Huang et al. 2025 utilized graph optimal transport to explore molecular subtypes in ANMerge, though diagnostic classification was not the primary focus. Multimodal Approaches for Alzheimer’s Classification. Several works have explored combining modalities to better model AD pathology. The 3MT cross-attention transformer with modality dropout achieved 93.0\% accuracy (AUC 0.970) on ADNI/AIBL datasets [ 22 ] . Henríquez and Araya 2024 introduced a deep ensemble method that scored 98.8\% for CTL vs. MCI on a small cohort. MINDSETS integrated longitudinal MRI radiomics, transcriptomics, and cognitive scores to achieve 89.25\% for AD vs. VaD [ 15 ] , though multiclass performance and reproducibility were limited. MADDi employed cross-modal attention to merge MRI, genetic, and clinical data and reached 96.9\% accuracy on ADNI without offering interpretability tools [ 14 ] . Castellano et al. 2024 combined MRI and amyloid PET scans to enhance classification on OASIS-3, but the dependence on dual imaging restricted applicability. Handling Missing Modalities in Alzheimer’s Disease Models. Prior studies implemented generative imputation or modality-agnostic inference. 3MT used modality-dropout with cross-attention to manage incomplete inputs [ 21 ] . ITCFN co-attended MRI and clinical data to hallucinate PET imaging for MCI-conversion prediction [ 17 ] . Flex-MoE enabled dynamic routing through expert networks tailored to different modality combinations [ 39 ] . Explainability in Alzheimer’s Models. Most models apply saliency-based techniques for interpretability. Grad-CAM and 3D Grad-CAM have been used to visualize spatial attention in CNNs [ 36 ] , while LIME has been applied for local surrogate explanations [ 1 ] . Islam et al. 2023 used dictionary learning and CNN ensembles to provide visual explanations. Alatrany et al. 2024 combined rule-based SVMs with SHAP values for tabular interpretability. Existing approaches are constrained

Read the complete text