Non-rigid Motion Correction for MRI Reconstruction via Coarse-To-Fine Diffusion Models
Frederic Wang, Jonathan I. Tamir · 2025
Read Non-rigid Motion Correction for MRI Reconstruction via Coarse-To-Fine Diffusion Models by Frederic Wang, Jonathan I. Tamir (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2505-15057.txt.
Introduction
Frederic Wang and Jonathan Tamir correct motion in MRI scans with diffusion models in a 2025 paper. MRI takes long enough that patients often move during sampling. Non-rigid motion, like a beating heart, blurs the result badly.
Their method alternates between rebuilding the image and estimating the motion. A custom diffusion model drives both steps jointly. Coarse-to-fine denoising first locks down large motion and low detail. Fine structure is restored only after that stable base exists. Tests used real heart cine scans and simulated warps. Readers see generative priors used as motion detectives, not just image polishers.
Catalog record
| CREATOR | Frederic Wang, Jonathan I. Tamir |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 21 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2505-15057
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Non-rigid Motion Correction for MRI Reconstruction via Coarse-To-Fine Diffusion Models Frederic Wang, Jonathan I. Tamir Abstract Magnetic Resonance Imaging (MRI) is highly susceptible to motion artifacts due to the extended acquisition times required for k k -space sampling. These artifacts can compromise diagnostic utility, particularly for dynamic imaging. We propose a novel alternating minimization framework that leverages a bespoke diffusion model to jointly reconstruct and correct non-rigid motion-corrupted k k -space data. The diffusion model uses a coarse-to-fine denoising strategy to capture large overall motion and reconstruct the lower frequencies of the image first, providing a better inductive bias for motion estimation than that of standard diffusion models. We demonstrate the performance of our approach on both real-world cine cardiac MRI datasets and complex simulated rigid and non-rigid deformations, even when each motion state is undersampled by a factor of 64 × \times . Additionally, our method is agnostic to sampling patterns, anatomical variations, and MRI scanning protocols, as long as some low frequency components are sampled during each motion state. † † address: 1 Department of Computing and Mathematical Sciences, Caltech 2 Chandra Family Department of Electrical and Computer Engineering, UT Austin 1 Introduction MRI produces images of high diagnostic versatility, but the scan time is very slow, often resulting in motion artifacts in the reconstructed image. Although compressed sensing methods [ 1 , 2 ] can accelerate scanning time, non-rigid motion may still occur, such as when scanning children or scanning anatomy with involuntary motion such as the heart, bowels, or lungs. Image registration methods can correct motion by modeling it as a displacement field. Traditional methods involve fitting this field with B-splines or vector fields with regularization to ensure properties such as smoothness, diffeomorphism, and invertibility of the fitted displacement field [ 3 , 4 ] . Deep learning approaches to image registration [ 5 ] can leverage data-driven anatomical priors to improve motion estimation, in particular for undersampled MRI data [ 6 ] . Another common approach involves alternating between solving for the reconstructed image and estimating the motion [ 7 ] . Diffusion models are a class of generative models that have achieved state-of-the-art performance for inverse problems such as inpainting, denoising, and MRI reconstruction [ 8 , 2 ] . However, leveraging diffusion models as a prior for non-rigid motion correction is still relatively unexplored. Our contributions: • We develop a diffusion-based alternating minimization to jointly reconstruct a motion-corrected MRI image and corresponding non-rigid motion fields from a set of undersampled, motion-corrupted k -space. • We propose a novel coarse-to-fine diffusion model and show that it provides a better noise schedule for MRI reconstruction and registration by denoising the lower frequency k -space coefficients first. • Our method generalizes to arbitrary k -space sampling patterns with arbitrary motion without the need to re-train the model, as long as some low-frequency components of k -space are sampled at each motion state. • While our method is developed to correct non-rigid motion, it can also correct for rigid motion comparable to the state-of-the-art. We show the efficacy of our algorithm on complex retrospectively simulated motion as well as prospective motion corruption from cine cardiac MRI scans. 1.1 Related Work Several approaches have been proposed to leverage deep learning for non-rigid motion correction in MRI reconstruction [ 6 ] . These methods typically involve simulating deformation fields for training, which naturally limits their use at inference time to motion that matches the simulation parameters. While this may be acceptable for regular, periodic motion such as respiratory and cardiac motion, it is not suitable for arbitrary motion a priori, as the learned model has been tuned to the particular motion patterns. Still, these approaches can be used given fully sampled training data [ 9 ] . The use of diffusion models for MRI motion correction has been explored for rigid motion [ 10 ] by formulating the reconstruction as joint posterior sampling over the image and motion parameters. Diffusion models have also been used for more general blind inverse problems where the forward operator is unknown but belongs to a family of corruptions such as shift-invariant blurring [ 11 ] , and this idea has also been applied specifically to MRI [ 12 ] . Diffusion models on function spaces can also be used to enforce consistency between frames on video data [ 13 ] , which has potential applications in motion correction. Diffusion models with non-isotropic noise have been studied for tasks such as image generation and posterior sampling. Coarse-to-fine blurring of diffusion models has been explored [ 14 ] but only for prior sample generation. Diffusion bridges [ 15 ] also allow for non-isotropic noise for intermediate probability distributions. This can make sampling more efficient, particularly for solving inverse problems [ 16 ] . 2 METHODS Figure 1: Visualization of the motion-corrupt forward model. Our goal is to recover the ground truth image \mathbf{x} (top left) given the undersampled, deformed measurements \mathbf{y}^{(\tau)} and undersampling masks \mathbf{M}^{(\tau)} (bottom right). Coils are omitted without loss of generality. 2.1 Problem Formulation Suppose we have motion-corrupted, multi-coil k -space from motion states \{\mathbf{y}_{i}^{(\tau)}\} , where \tau is a discrete variable that represents the motion state and i represents the coil index. We assume \tau=0 is the motion-free state. The forward model for motion state \tau\in\{0,\dots,n_{\mathrm{states}}-1\} can be written as \displaystyle\mathbf{y}_{i}^{(\tau)} \displaystyle=\mathbf{M}^{(\tau)}\mathbf{F}\mathbf{S}_{i}\Phi^{(\tau)}\mathbf{x}+\varepsilon_{i}^{(\tau)}, (1) where \mathbf{M}^{(\tau)} is the undersampling mask representing the k -space collected at motion state \tau ; \mathbf{F} is the Fourier transform; \mathbf{S}_{i} is the sensitivity map of coil i ; \Phi^{(\tau)} is the displacement field for motion state \tau ; and \varepsilon_{i} is measurement noise. The sensitivity maps are a function of the MRI hardware and assumed constant over time. More succintly, \displaystyle\mathbf{y}^{(\tau)} \displaystyle=\mathbf{A}^{(\tau)}\Phi^{(\tau)}\mathbf{x}+\varepsilon^{(\tau)}, (2) where \mathbf{y}^{(\tau)} represents k -space across all coils and \mathbf{A}^{(\tau)} is the block-diagonal operator subsuming all coils from Eq. 1 . The goal is to reconstruct a fully sampled version of \mathbf{x} and the motion fields \Phi^{(\tau)} given the deformed measurements \mathbf{y}^{(\tau)} . See Fig. 1 for a visual. 2.2 Non-Isotropic Diffusion Models Given a clean image \mathbf{x}_{0}\sim p(\mathbf{x}) , the diffusion forward process of standard variance exploding (VE) [ 17 ] at time t\in[0,T] is \displaystyle\mathbf{x}_{t}=\mathbf{x}_{0}+\mathbf{B}_{t}\mathbf{z}_{t},\quad\mathbf{z}_{t}\sim\mathcal{N}(0,\mathbf{I}). (3) where \mathbf{x}_{t} is the intermediate corrupted image and \mathbf{B}_{t} is a linear operator that warps the noise. This process has an equivalent probability flow ODE \displaystyle d\mathbf{x} \displaystyle=\left\{\frac{d}{dt}\mathbf{x}-\frac{d\mathbf{B}_{t}}{dt}\mathbf{B}_{t}\nabla_{\mathbf{x}}\log p_{t}(\mathbf{x})\right\}dt, (4) where p_{t} represents the distribution of \mathbf{x}_{t} . A denoising network D(\mathbf{x},t) trained with the standard score matching loss \|D(\mathbf{x}_{t},t)-\mathbf{x}_{0}\|_{2}^{2} can be used to approximate the score \hat{s}(\mathbf{x}_{t},t)\approx\nabla_{\mathbf{x}}\log p_{t}(\mathbf{x}) via \displaystyle\hat{s}(\mathbf{x}_{t},t)=(\mathbf{B}_{t}\mathbf{B}_{t}^{H})^{-1}(D(\mathbf{x};t)-\mathbf{x}). (5) Once this network is trained, we can sample along the reverse process of this ODE to generate samples from p(\mathbf{x}) . We develop a coarse-to-fine (C2F) diffusion process by designing intermediate noise corruption masks \mathbf{B}_{t} to emphasize higher frequencies later and lower frequencies early on when the generated sample is still very noisy. This design accommodates multi-coil MRI applications, where the low frequencies of k -space are fully sampled to calibrate sensitivity maps (i.e. the auto-calibration region). Furthermore, this design also promotes better optimization in two ways: (1) the smoother optimization landscape of the low frequencies allows for smooth convergence towards the global