Contrastive Anatomy-Contrast Disentanglement: A Domain-General MRI Harmonization Method

Daniel Scholz, Ayhan Can Erdur, Robbie Holland, Viktoria Ehm, Jan C. Peeken, Benedikt Wiestler, Daniel Rueckert · 2025

Read Contrastive Anatomy-Contrast Disentanglement: A Domain-General MRI Harmonization Method by Daniel Scholz, Ayhan Can Erdur, Robbie Holland, Viktoria Ehm, Jan C. Peeken, Benedikt Wiestler, Daniel Rueckert (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2509-06592.txt.

Introduction

MRI scans that look different on every scanner are brought into line by Daniel Scholz and six co-authors in a 2025 medical imaging paper. Scanner and setting differences change image contrast, which hurts comparisons across hospitals and studies. Older harmonization methods may need the same person scanned everywhere, or fail on new scanners.

Their method uses a conditioned diffusion autoencoder trained with a contrastive loss and heavy contrast augmentation that ignores scanner identity. Anatomy stays fixed while contrast is restyled, so a brain scan can be synthesized in a target scanner's look from one reference image. On traveling-subject data it beat baselines on image quality, and on age prediction for unseen scanners it improved results markedly. No fine-tuning is needed for new sites, which suits multi-center and long-term studies.

Catalog record

CREATORDaniel Scholz, Ayhan Can Erdur, Robbie Holland, Viktoria Ehm, Jan C. Peeken, Benedikt Wiestler, Daniel Rueckert
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE21 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2509-06592

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Contrastive Anatomy-Contrast Disentanglement: A Domain-General MRI Harmonization Method Daniel Scholz, Ayhan Can Erdur, Robbie Holland, Viktoria Ehm, Jan C. Peeken, Benedikt Wiestler, Daniel Rueckert Abstract Magnetic resonance imaging (MRI) is an invaluable tool for clinical and research applications. Yet, variations in scanners and acquisition parameters cause inconsistencies in image contrast, hindering data comparability and reproducibility across datasets and clinical studies. Existing scanner harmonization methods, designed to address this challenge face limitations, such as requiring traveling subjects or struggling to generalize to unseen domains. We propose a novel approach using a conditioned diffusion autoencoder with a contrastive loss and domain-agnostic contrast augmentation to harmonize MR images across scanners while preserving subject-specific anatomy. Our method enables brain MRI synthesis from a single reference image. It outperforms baseline techniques, achieving a + 7 % {+7}\% PSNR improvement on a traveling subjects dataset and +18% improvement on age regression in unseen scanners. Our model provides robust, effective harmonization of brain MRIs to target scanners without requiring fine-tuning. This advancement promises to enhance comparability, reproducibility, and generalizability in multi-site and longitudinal clinical studies, ultimately contributing to improved healthcare outcomes. 1 1 1 The code is publicly available at: https://github.com/daniel-scholz/cacd . 1 Introduction Magnetic resonance imaging (MRI) is a versatile technique for brain studies, offering multiple tissue contrasts in a single session and enabling non-invasive insights into the brain’s structure and function. However, its flexibility leads to a lack of standardization across imaging studies. Variations in pulse sequences, acquisition parameters, and scanner hardware can cause undesired contrast variations, particularly in multi-site and longitudinal studies [ 15 , 9 ] . These variations create a domain shift problem, introducing underlying bias into the models and limiting the generalizability of quantitative analyses. Addressing these challenges is crucial for advancing multi-center MRI research and improving diagnostic reliability across healthcare settings. By using traveling subjects, i.e., scans of the same subject in different scanners serving as ground truth, harmonization can be achieved by learning direct mappings between scanners [ 4 , 24 ] . However, traveling subjects require significant effort and hence occur only seldom in clinical reality, limiting the application of such methods to a narrow context. Many methods alleviate the necessity for traveling subjects through inter-domain cycle consistency [ 18 , 25 ] . These methods can usually translate between only two scanners by their pair-wise design, thus lacking the generalizability to harmonize multiple sources into a common space. Furthermore, the absence of anatomical constraints can lead to unrealistic transformations or even hallucinations. Recent methods [ 27 , 2 ] tackle scanner harmonization by disentangling contrast from anatomy, i.e., keeping subject-specific anatomical aspects consistent while learning contrast changes that originate from scanners to generalize to more than two domains. To this end, Zuo et al. [ 27 ] rely on paired MRI sequences, such as T1w, T2w, and FLAIR, of the same subject, which are more common in clinical practice, to learn anatomical consistency. Models that can achieve disentanglement from only a single sequence also exist [ 2 ] . However, due to the lack of domain generalization, these models are limited to synthesizing images similar to their training domain. In particular, introducing new domains unseen during training often fails but is a clinical reality. In our work, we develop an anatomy-consistent approach that harmonizes between an arbitrary number of unseen scanners outside the training domain. Additionally, the proposed method overcomes the reliance on paired subjects or multiple MRI sequences per subject. We summarize our contributions as follows: 1. We present a domain-general scanner harmonization algorithm capable of harmonizing arbitrary unseen scanners in brain MRI by controlling contrast and maintaining anatomy. 2. To this end, we introduce a novel anatomy-contrast-disentanglement module , including an elegant loss formulation with contrastive losses and a domain-agnostic contrast augmentation suite. 3. We advance MRI scanner harmonization in unseen scanners in terms of traveling subjects harmonization and age regression. 2 Related Works Numerous methods have been proposed for MRI harmonization, which are discussed in detail in these two recent reviews [ 7 , 10 ] , so that we focus on discussing approaches most relevant to our work. Learning-based Methods Many existing deep learning models for scanner harmonization require traveling subjects [ 4 , 24 ] . Their reliance on full supervision, i.e., datasets with images of the same patient from multiple sites, limits their applicability drastically. In contrast, the unsupervised CycleGAN method [ 26 ] uses a cycle consistency loss to learn mappings between two domains without paired examples. While adaptations of CycleGAN have been explored for MRI harmonization [ 18 , 25 ] , this approach can naturally only handle two sites, and anatomical consistency during harmonization is not ensured. Latent-Space Disentanglement Representation disentanglement has been a significant focus of the computer vision community, e.g. for style transfer [ 6 , 14 ] or medical image segmentation [ 8 , 11 ] . Some works accomplish scanner harmonization with disentangled latent spaces to maintain anatomical consistency while learning intensity-level translation [ 2 , 27 ] . HACA3 [ 27 ] extract the anatomy embedding through shape constraints from paired MRI sequences while the contrast is learned as the remaining information. To overcome the need for paired MRI sequences, [ 2 ] introduce Gamma augmentations to create different contrasts. This approach, however, is limited to the contrast differences covered by Gamma augmentations, which do not account for the entire variation in real-world data, and relies on patches for training. These limitations highlight the need for a framework capable of processing full volumes while leveraging a more generalizable image synthesis and latent-space disentanglement. 3 Method 3.1 Diffusion Autoencoder The foundation of our work is the diffusion autoencoder (DiffAE) [ 19 ] . It consists of a conditional DDIM [ 21 ] and a separate semantic encoder E(x) that projects the input image x to a latent feature vector z_{\text{sem}} , which is then used to condition the DDIM. The diffusion autoencoder architecture allows control of the image editing process by altering the semantic feature vector to contain the semantic information desired in the edited image. However, the feature space needs to be disentangled to make specific changes that leave other imaging features constant. Figure 1 : Our novel anatomy-content-disentanglement module . Two images from different subjects and arbitrary (possibly even the same) scanners x^{(0)} and x^{(1)} are modified through two augmentations A_{j}(x) and A_{i}(x) , yielding a view \tilde{x} each. An anatomy-contrast disentanglement is learned through deliberate pushing and pulling (see contrastive loss, Eq. 1 ) of the anatomy z_{a}=h_{a}(E(\tilde{x})) and contrast z_{c}=h_{c}(E(\tilde{x})) embeddings (Section 3.2 ). Note that in this example, push and pull are shown only for a single view - in practice, all views are considered. The resulting feature vectors z_{a} and z_{c} are used to condition the DDIM to synthesize \tilde{x} by denoising the noise map x_{T} to the input view denoted as x_{0}\hat{=}\tilde{x} . 3.2 Disentanglement Module In this work, we aim to disentangle anatomy and contrast to enable altering intensity while maintaining the anatomy in the image (Figure 1 ). To this end, we split the feature vector z_{\text{sem}}\in\mathbb{R}^{d} into two feature vectors z_{a}\in\mathbb{R}^{d_{a}} and z_{c}\in\mathbb{R}^{d_{c}} for anatomy and contrast, respectively. To achieve this, we add two

Read the complete text