Understanding Sources of Demographic Predictability in Brain MRI via Disentangling Anatomy and Contrast
Mehmet Yigit Avci ∗, Akshit Achara ∗, Andrew King †, Jorge Cardoso †, for the Alzheimer’s Disease Neuroimaging Initiative · 2026
Read Understanding Sources of Demographic Predictability in Brain MRI via Disentangling Anatomy and Contrast by Mehmet Yigit Avci ∗, Akshit Achara ∗, Andrew King †, Jorge Cardoso †, for the Alzheimer’s Disease Neuroimaging Initiative (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-04113.txt.
Introduction
Avci and others study demographic predictability in brain MRI via disentangled anatomy and acquisition. Medical images allow demographic output, raising bias concerns, and X-ray acquisition contributes substantially, yet brain MRI was unclear. Across three data, predictability is driven primarily by anatomy, with contrast embeddings holding a weaker signal that does not extend.
Catalog record
| CREATOR | Mehmet Yigit Avci ∗, Akshit Achara ∗, Andrew King †, Jorge Cardoso †, for the Alzheimer’s Disease Neuroimaging Initiative |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 23145 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2603.04113
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Understanding Sources of Demographic Predictability in Brain MRI via Disentangling Anatomy and Contrast Mehmet Yigit Avci ∗, Akshit Achara ∗, Andrew King †, Jorge Cardoso †, for the Alzheimer’s Disease Neuroimaging Initiative Abstract Demographic attributes such as age, sex, and race can be predicted from medical images, raising concerns about bias in clinical AI systems. In brain MRI, this signal may arise from anatomical variation, acquisition-dependent contrast differences, or both, yet these sources remain entangled in conventional analyses. Without disentangling them, mitigation strategies risk failing to address the underlying causes. We propose a controlled framework based on disentangled representation learning, decomposing brain MRI into anatomy-focused representations that suppress acquisition influence and contrast embeddings that capture acquisition-dependent characteristics. Training predictive models for age, sex, and race on full images, anatomical representations, and contrast-only embeddings allows us to quantify the relative contributions of structure and acquisition to the demographic signal. Across three datasets and multiple MRI sequences, we find that demographic predictability is primarily rooted in anatomical variation: anatomy-focused representations largely preserve the performance of models trained on raw images. Contrast-only embeddings retain a weaker but systematic signal that is dataset-specific and does not generalise across sites. These findings suggest that effective mitigation must explicitly account for the distinct anatomical and acquisition-dependent origins of the demographic signal, ensuring that any bias reduction generalizes robustly across domains. † † footnotetext: ∗ These authors contributed equally to this work. † † footnotetext: † These authors jointly supervised this work. 1 Introduction Medical imaging plays a central role in modern clinical practice and biomedical research, supporting diagnosis, treatment planning, and disease monitoring across a wide range of modalities. Advances in machine learning have enabled models that extract rich information from medical images for tasks such as segmentation, classification, and prognosis. However, growing evidence suggests that machine learning models may encode and exploit unintended correlations present in imaging data, leading to systematic performance disparities across demographic groups, with attributes such as race remaining identifiable even when clinically unrelated to the target task [ 22 , 14 , 25 , 19 , 7 , 19 ] . Attempts to mitigate these effects through generic fairness interventions have proven insufficient, often degrading performance or failing under real-world distribution shifts [ 21 ] . These observations suggest that the demographic signal is not a superficial modelling artifact but reflects structured variation embedded within the data itself. Recent work has begun to investigate where this signal originates. For example, in cardiac MRI segmentation, demographic information has been shown to persist within learned representations despite controlled task settings [ 15 ] . In chest X-ray classification, acquisition-related factors substantially contribute to the demographic signal and downstream performance disparities [ 16 ] . Collectively, these findings indicate that bias may emerge not only from population imbalance, but also from modality- and acquisition-specific characteristics that models implicitly exploit. This perspective is particularly relevant for brain MRI. Although demographic bias has been documented in MRI-based models [ 1 , 18 , 6 ] , its origins remain unclear. Brain MRI is intrinsically heterogeneous: image appearance is governed by interactions between sequence parameters (e.g., TR, TE), scanner hardware, and site-specific protocols. These acquisition-dependent factors systematically shape intensity distributions and tissue contrast, introducing variability sources that correlate with demographic attributes. As anatomical structure and acquisition-dependent contrast are entangled in raw images, conventional models cannot determine whether the demographic signal arises from biological variation, acquisition settings, or their interaction. To understand the underlying drivers of demographic bias in brain MRI, we employ disentangled representation learning frameworks, specifically MR-CLIP [ 4 ] and DIST-CLIP [ 3 ] . These models decompose brain MRI into distinct anatomical images and contrast-only embeddings, enabling explicit separation of structural information from acquisition-dependent signal. We train predictive models for age, sex, and race using (i) full brain MRI images, (ii) anatomy-focused images that are independent of contrast, and (iii) contrast-only embeddings that capture acquisition characteristics while minimizing anatomical content. By comparing predictive performance across these representations, we quantify the relative contributions of anatomical structure and acquisition-induced contrast to the demographic signal. Our contributions are: (1) a controlled framework for disentangling anatomical and acquisition-dependent sources of the demographic signal in brain MRI; (2) evidence, across three datasets and multiple MRI sequences, that anatomical structure is the dominant carrier of demographic information; and (3) showing that contrast-only embeddings retain a weaker, dataset-specific signal that does not generalise across sites, establishing that effective bias mitigation strategies must address both sources. 2 Methods 2.1 Experimental Design Let \mathcal{D}=\{(x_{i},y_{i},a_{i})\}_{i=1}^{N} denote a dataset of brain MRI scans x_{i}\in\mathcal{X} , demographic attributes y_{i}\in\mathcal{Y} (age, sex, race), and acquisition metadata a_{i}\in\mathcal{A} (e.g., TR, TE, scanner type, site). Our objective is to determine whether the demographic signal arises primarily from anatomical structure, acquisition-dependent contrast, or their interaction. In raw MRI, anatomical structure and contrast are inherently entangled within the image space \mathcal{X} . We therefore seek a representation-level decomposition of each image x into two components, x\;\longrightarrow\;(z_{\text{anat}},z_{\text{contrast}}), (1) where z_{\text{anat}}\in\mathcal{Z}_{\text{anat}} captures structural information while minimizing acquisition effects, and z_{\text{contrast}}\in\mathcal{Z}_{\text{contrast}} captures acquisition-dependent signal while reducing anatomical dominance. To operationalize this separation, we leverage pre-trained disentangled representation learning frameworks, MR-CLIP [ 4 ] and DIST-CLIP [ 3 ] . MR-CLIP is a metadata-guided contrastive learning framework that aligns MRI images with their associated DICOM acquisition parameters without requiring manual sequence labels. An image encoder E_{I} and a metadata encoder E_{M} are trained jointly so that the image embedding z_{\text{contrast}}^{x}=E_{I}(x) and the metadata embedding z^{a}=E_{M}(a) are similar for matched pairs and dissimilar for mismatches. By optimizing a contrastive objective over image–metadata pairs drawn from diverse scanners and parameter settings, MR-CLIP learns a 512-dimensional embedding that reflects systematic contrast variations induced by acquisition differences [ 2 , 4 ] . DIST-CLIP builds upon MR-CLIP by introducing an explicit anatomical pathway to separate structural content from acquisition-dependent contrast. It employs an anatomy mapper that projects an input image x to an anatomy-focused representation z_{\text{anat}} . This representation is designed to preserve geometric and morphological structure while suppressing intensity and contrast-related cues. To enforce acquisition invariance, DIST-CLIP incorporates contrastive loss applied at the patch level across anatomy images. This loss encourages corresponding anatomical patches from images acquired with different protocols to remain similar in the z_{\text{anat}} space, regardless of acquisition differences. This explicitly promotes structural consistency while discouraging the encoding of contrast-specific information. As a result, the model achieves a disentangled decomposition in which z_{\text{anat}} captures acquisition-invariant information, while z_{\text{contrast}} encodes acquisition-dependent characteristics [ 3 ] . Figure 1: Qualitative and embedding-level visualization of the disentanglement. A : Raw images ( x , top) and anatomy-focused representations ( z_{\text{anat}} , bottom). B : t-SNE of contrast embeddings ( z_{\text{contrast}} ) showing acquisition-driven clustering. Fig. 1 illustrates the proposed disentanglement qualitatively and quantitatively. Panel A shows representative raw T1-weighted images from OASIS, HCP, and ADNI alongside their corresponding anatomical images ( z_{\text{anat}} ). While the raw images reflect both structural content and site-specific contrast differences, the anatomy-focused representations preserve geometric structure while suppressing acquisition-driven intensity variations. Panel B visualizes contrast-only embeddings ( z_{\text{contrast}} ) using t-SNE. The clear clustering by dataset and sequence (e.g., T1w, T2w, FLAIR) indicates that these embeddings capture acquisition-dependent characteristics. To quantify the contribution of