Causal Debiasing Medical Multimodal Representation Learning with Missing Modalities
Xiaoguang Zhu, Lianlong Sun, Yang Liu, Pengyi Jiang, Uma Srivatsa, Nipavan Chiamvimonvat, Vladimir Filkov · 2025
Read Causal Debiasing Medical Multimodal Representation Learning with Missing Modalities by Xiaoguang Zhu, Lianlong Sun, Yang Liu, Pengyi Jiang, Uma Srivatsa, Nipavan Chiamvimonvat, Vladimir Filkov (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2509-05615.txt.
Introduction
Bias created by how medical data are collected can poison models that fuse several data types, Xiaoguang Zhu and six co-authors argue in a 2025 medical data mining paper. Patient records often miss whole modalities, such as a scan or lab panel, for cost or protocol reasons, and that missingness is rarely random.
A causal analysis separates two problems: missingness bias from the collection process and distribution bias from hidden factors affecting both features and outcomes. Their framework adds a module that mimics intervention using backdoor adjustment, plus a two-branch network splitting causal features from spurious ones. It plugs into existing prediction methods and improved results on public and hospital datasets.
Catalog record
| CREATOR | Xiaoguang Zhu, Lianlong Sun, Yang Liu, Pengyi Jiang, Uma Srivatsa, Nipavan Chiamvimonvat, Vladimir Filkov |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 61 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2509-05615
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Causal Debiasing Medical Multimodal Representation Learning with Missing Modalities Xiaoguang Zhu, Lianlong Sun, Yang Liu, Pengyi Jiang, Uma Srivatsa, Nipavan Chiamvimonvat, Vladimir Filkov Abstract Medical multimodal representation learning aims to integrate heterogeneous clinical data into unified patient representations to support predictive modeling, which remains an essential yet challenging task in the medical data mining community. However, real-world medical datasets often suffer from missing modalities due to cost, protocol, or patient-specific constraints. Existing methods primarily address this issue by learning from the available observations in either the raw data space or feature space, but typically neglect the underlying bias introduced by the data acquisition process itself. In this work, we identify two types of biases that hinder model generalization: missingness bias , which results from non-random patterns in modality availability, and distribution bias , which arises from latent confounders that influence both observed features and outcomes. To address these challenges, we perform a structural causal analysis of the data-generating process and propose a unified framework that is compatible with existing direct prediction-based multimodal learning methods. Our method consists of two key components: (1) a missingness deconfounding module that approximates causal intervention based on backdoor adjustment and (2) a dual-branch neural network that explicitly disentangles causal features from spurious correlations. We evaluated our method in real-world public and in-hospital datasets, demonstrating its effectiveness and causal insights. I Introduction Medical data is inherently multimodal, consisting of a wide range of heterogeneous modalities such as electronic health records (EHR) [ 1 ] , electrocardiograms (ECG) [ 2 ] , biomarkers [ 3 ] , and medical imaging [ 4 ] , making medical data mining significantly more challenging compared to single-modal knowledge discovery tasks. To address this complexity in healthcare data engineering, researchers have proposed multimodal representation learning approaches that aim to combine information between heterogeneous data sources to learn unified latent representations capturing complementary and correlated patterns, which facilitate downstream data mining applications such as disease classification, progression forecasting, and prediction of treatment outcome [ 5 ] . However, clinical data are often incomplete in practice, where specific modalities are missing for certain patients due to various practical constraints [ 6 ] . This prevalent data incompleteness poses significant challenges for conventional multimodal learning models, which typically assume that all modalities are fully observed during both the training and the testing phases [ 7 ] . To address this challenge, some earlier work [ 8 , 9 ] disregarded incomplete data in the training phase, and therefore were limited in their real-world applicability, where data are scarce and missingness is unavoidable. Current methods fall predominantly into two categories when addressing the missing modalities problem: (1) modality imputation and (2) direct prediction approaches. The former [ 10 , 11 , 12 ] use deep generative models to reconstruct the absent modalities. However, these methods rely on strong assumptions to learn the mappings from a lower-dimensional latent space to the high-dimensional original input space [ 13 ] , which is an ill-posed inverse problem [ 14 ] . The latter, direct prediction approaches, directly predict outcomes from incomplete observed inputs. Recent methods adopt Graph Neural Networks (GNNs) [ 15 , 16 , 13 ] or Transformer [ 17 , 18 ] to model inter-modality or inter-patient correlations to compensate for missing information in the feature space. Despite the progress of both approaches, they had a common limitation that they overlook the correlations between the modalities, neglecting the bias introduced by the data acquisition process [ 19 ] . In this way, the model could be biased towards modality-specific patterns that are overrepresented in the observed data. This issue is further exacerbated by the fact that medical data often contains features that are not causally related to the underlying disease mechanisms, making models more likely to exploit spurious shortcuts based on non-causal correlations [ 20 ] . In this paper, we identify the following two types of biases: i) Distribution Bias. Clinical data often contains spurious correlations introduced by latent confounders affecting both observed data and outcomes, with missingness further amplifying these confounding effects [ 21 ] . For example, in Alzheimer’s research, visible brain atrophy on MRI is more common in late stage patients. This may cause models to over-rely on imaging features like ventricular enlargement, treating them as direct predictors of cognitive decline, even when such features may result from aging or comorbidity unrelated to AD progression. Such correlations lead the model to learn nongeneralizable patterns related to the data collection distribution rather than true disease mechanisms, limiting the generalization ability across hospitals or patient populations. ii) Missingness Bias. Prior approaches often assume that missingness is random [ 16 , 22 ] , without modeling the underlying mechanisms behind why certain modalities are missing. In reality, missing data can be the result of factors such as high cost [ 23 ] , patient dropout [ 24 ] , noncompliance [ 25 ] , or technical failures [ 15 ] . For example, neuroimaging data in ADNI [ 26 ] are frequently missing for patients with advanced dementia due to enrollment restrictions. Such structured, non-random missingness reflects latent patient conditions or institutional policies, making the absence of modalities itself a potential source of bias in downstream prediction. Fig. 1: Conditional entropy analysis on the MIMIV-IV [ 1 ] dataset for mortality prediction. More samples with normalized zero-conditional entropy reveal a strong presence of the bias. We have carried out a toy experiment to verify missingness bias in the MIMIC-IV dataset [ 1 ] , which aims to quantify the extent to which outcome labels are correlated with missingness patterns. For each sample, we construct a 6-dimensional binary missingness vector based on the availability of the following modalities: demographics, diagnosis codes, procedure codes, medication records, lab values, and clinical notes. In the mortality task, we observe 47 different missingness patterns, while the readmission task contains 54 patterns. We compute the normalized conditional entropy (NCE) [ 27 ] of the label given each missingness pattern. A lower NCE indicates that the outcome is more predictable given the pattern, i.e., the pattern exhibits stronger label-specific bias. We visualize the distribution of these patterns in terms of the total number of samples associated with each range for both mortality (Fig. 1 (a, b) and readmission tasks (Fig. 1 (c, d). Concretely, approximately only 29% of the samples with mortality = 0 fall into missingness patterns whose NCE is in the range [0, 0.2), indicating that these patterns are highly predictive of negative outcomes. These observations suggest that both outcome groups exhibit substantial pattern-label correlation, reflecting a strong dependency between missingness configurations and mortality outcomes, and highlighting the potential biases in the data. To overcome biases, we attempt to incorporate causal inference [ 28 ] into the medical multimodal representation learning task. In this paper, we introduce a unified Ca usal D ebiasing ( CaD ) framework that systematically identifies and mitigates both missingness and distributional biases through structural causal modeling. In detail, CaD consists of two key modules: (1) A Missingness Deconfounding Module that approximates interventional distributions via a Normalized Weighted Geometric Mean, leveraging a learned confounder dictionary to perform efficient backdoor adjustment over missingness patterns. (2) A Causal-Biased