Can Diffusion Models Bridge the Domain Gap in Cardiac MR Imaging?

Xin Ci Wong, Duygu Sarikaya, Kieran Zucker, Marc De Kamps, Nishant Ravikumar · 2025

Read Can Diffusion Models Bridge the Domain Gap in Cardiac MR Imaging? by Xin Ci Wong, Duygu Sarikaya, Kieran Zucker, Marc De Kamps, Nishant Ravikumar (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2508-06327.txt.

Introduction

Xin Ci Wong, Duygu Sarikaya, and their co-authors ask whether diffusion models can help heart MRI tools work across hospitals. Their 2025 paper notes that scanner and protocol differences shift image appearance, a problem called domain shift, and models trained at one site degrade at others. Collecting more labeled data at each site is costly, and synthetic images often break anatomical accuracy.

Their diffusion model, trained on a source site, generates synthetic heart images that mimic a target site's look while keeping the source anatomy and its segmentation mask intact. Models then train on the synthetic pairs. The team tested three segmentation networks on multi center heart MRI data. The approach aims at models that travel between hospitals without retraining on private local data.

Catalog record

CREATORXin Ci Wong, Duygu Sarikaya, Kieran Zucker, Marc De Kamps, Nishant Ravikumar
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE24 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2508-06327

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Can Diffusion Models Bridge the Domain Gap in Cardiac MR Imaging? Xin Ci Wong, Duygu Sarikaya, Kieran Zucker, Marc De Kamps, Nishant Ravikumar Abstract Magnetic resonance (MR) imaging, including cardiac MR, is prone to domain shift due to variations in imaging devices and acquisition protocols. This challenge limits the deployment of trained AI models in real-world scenarios, where performance degrades on unseen domains. Traditional solutions involve increasing the size of the dataset through ad-hoc image augmentation or additional online training/transfer learning, which have several limitations. Synthetic data offers a promising alternative, but anatomical/structural consistency constraints limit the effectiveness of generative models in creating image-label pairs. To address this, we propose a diffusion model (DM) trained on a source domain that generates synthetic cardiac MR images that resemble a given reference. The synthetic data maintains spatial and structural fidelity, ensuring similarity to the source domain and compatibility with the segmentation mask. We assess the utility of our generative approach in multi-centre cardiac MR segmentation, using the 2D nnU-Net, 3D nnU-Net and vanilla U-Net segmentation networks. We explore domain generalisation, where, domain-invariant segmentation models are trained on synthetic source domain data, and domain adaptation, where, we shift target domain data towards the source domain using the DM. Both strategies significantly improved segmentation performance on data from an unseen target domain, in terms of surface-based metrics (Welch’s t-test, p < 0.01 p<0.01 ), compared to training segmentation models on real data alone. The proposed method ameliorates the need for transfer learning or online training to address domain shift challenges in cardiac MR image analysis, especially useful in data-scarce settings. 1 INTRODUCTION Cardiac magnetic resonance (MR) imaging has been extensively studied for automated segmentation [ 2 , 5 ] , but most models are trained and evaluated on the same dataset. In clinical practice, variations in imaging devices and acquisition protocols lead to domain shift, where differences in training and target data distribution degrade model performance on unseen data [ 11 , 15 , 30 ] . To address domain shift, researchers have explored generative models such as GANs [ 4 , 29 ] to augment the data and Variational Autoencoders (VAE) to align feature distributions [ 10 ] . Domain-shift invariant CNN frameworks [ 26 ] and soft-labeled contrastive learning [ 13 ] have also been investigated for cardiac segmentation, along with variational approximation techniques [ 35 ] . However, the use of synthetic data as a direct substitute for real training or test data for downstream tasks remains underexplored, which is the focus of our work. Diffusion models (DMs) [ 16 ] known for generating high-quality images have recently been used for cardiac MR augmentation [ 28 , 31 ] , but their potential to mitigate domain shift has not been thoroughly investigated. DMs have been observed to memorise and replicate training samples [ 3 ] , raising questions about their effectiveness in generating useful synthetic medical data. Our approach is not limited by this because we integrate a reference image as guidance during the DM sampling process. Instead of generating images purely from noise, we iteratively refine the sampling process to ensure that the synthetic data remains structurally consistent with anatomical features while aligning with the source domain distribution. This distinguishes our approach from traditional DM-based augmentation, where uncontrolled synthesis may introduce undesired variations. Recent work on Diffusion-Driven Adaptation (DDA) [ 12 ] adapts target domain inputs back to the source domain using a DM trained on source data to mitigate input corruption, i.e. undesirable alterations in image appearance due to noise or artifacts. We extend this DDA by applying it to segmentation instead of classification, demonstrating its effectiveness in downstream pixel-wise tasks. Our work focuses on using source domain-trained diffusion models (SD-DM) to address domain shift in medical imaging, particularly in data-scarce settings where collecting training data from multiple centres or vendors is infeasible. Our key contributions are: (1) Diffusion-Driven Adaptation (DDA) for test-time input domain alignment: we propose a simple yet effective strategy that leverages source domain-trained DM to adapt test-time inputs, ensuring that synthetic test images closely resemble real images while preserving anatomical structures. Unlike prior use of DDA, which primarily focus on data augmentation, our approach enables test-time domain alignment directly on the reference image for downstream medical image segmentation. (2) Mixed adaptation for generalisable segmentation models: we introduce a dual adaptation strategy, where both training and test data are adapted, enhancing segmentation robustness across domains without requiring explicit data augmentation. 2 RELATED WORKS Domain Adaptation (DA) aims to align the source and target domains to reduce performance degradation. Most DA methods for medical image analysis fall into the single-source DA category and struggle with pixel-wise classification tasks [ 14 ] . Our approach preserves pixel-level and structural similarities during adaptation. Domain generalisation (DG) enables models to generalise to unseen domains without knowledge of the target domain during training [ 36 ] . Common DG strategies involve feature constraints and data augmentation [ 17 ] . However, GAN-based and adversarial approaches risk modifying domain-invariant features [ 25 ] , which can negatively impact downstream tasks. Furthermore, many DG methods also rely on auxiliary real data collected from different sources other than the target domain, whereas our method requires only a single training phase using synthetic data generated from the source domain. 3 METHODS Figure 1 : The proposed reference-based cardiac MR synthesis using source domain-trained DM (SD-DM) can project target cardiac MR images to the source domain. The process involves a forward diffusion (blue arrow) process that transforms the reference image through noise injection, followed by iterative denoising of the transformed input via a reverse diffusion (red arrow) process, while conditioning on the reference with a degree of scaling (denoted by the green arrows). The output y_{0}^{g} is the adapted image which resembles the reference, y_{0} . The reference image can be sourced from any target domain. In this section, we provide an overview of our approach, which leverages a source domain-trained diffusion model (SD-DM) to generate synthetic cardiac MR images aligned with the source domain (Fig. 1 ). DM consists of a two-step process: a forward pass that adds noise to an image and a reverse pass that denoises it. During training, a neural network (U-Net in our approach) learns to predict and remove noise at different time steps, enabling image generation from pure noise. Our training and unconditional proposal are the same as Nichol et al. [ 24 ] . The unconditional proposal means the model is free to create from the learned distribution without specific guidance. For image synthesis, we use an iteratively refinement process [ 12 ] , as detailed in Algorithm 1 . The process begins by corrupting the reference image \mathbf{y}_{0} to a noisy version \mathbf{y}_{N} through a forward diffusion process. Starting from this noisy initialisation \mathbf{y}_{N}^{g} , the algorithm performs a reverse denoising process across N steps, progressively generating samples closer to the source domain distribution. At each timestep t , an intermediate denoised sample \hat{\mathbf{y}}_{t-1}^{g} is obtained through the learned reverse process. A predicted clean image \hat{\mathbf{y}}_{0}^{g} is then computed using the standard DDPM reparameterisation formula. We incorporate a linear low-pass filter \phi_{D}(\cdot) that provides a sequence of downsampling

Read the complete text