Groupwise Registration with Physics-Informed Test-Time Adaptation on Multi-parametric Cardiac MRI
Xinqi Li, Yi Zhang, Li-Ting Huang, Hsiao-Huang Chang, Thoralf Niendorf, Min-Chi Ku, Qian Tao, Hsin-Jung Yang ∗ · 2025
Read Groupwise Registration with Physics-Informed Test-Time Adaptation on Multi-parametric Cardiac MRI by Xinqi Li, Yi Zhang, Li-Ting Huang, Hsiao-Huang Chang, Thoralf Niendorf, Min-Chi Ku, Qian Tao, Hsin-Jung Yang ∗ (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2510-26022.txt.
Introduction
Xinqi Li leads seven co-authors in a method to align heart images taken with different magnetic resonance contrasts. Multi parametric cardiac MRI produces maps that characterize heart muscle tissue, but the maps can be misaligned, which breaks pixel by pixel analysis. Their model registers, or warps into alignment, a whole group of contrast weighted images at once, and it adapts at test time using physics.
Synthetic images from the physical model for each contrast serve as the reference for alignment, which lets the method learn from the new case itself. Tests in healthy volunteers across several scan sequences showed better multi modal registration under a wide range of contrast changes. The physics guidance helps the model generalize.
Catalog record
| CREATOR | Xinqi Li, Yi Zhang, Li-Ting Huang, Hsiao-Huang Chang, Thoralf Niendorf, Min-Chi Ku, Qian Tao, Hsin-Jung Yang ∗ |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 16 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2510-26022
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Groupwise Registration with Physics-Informed Test-Time Adaptation on Multi-parametric Cardiac MRI Xinqi Li, Yi Zhang, Li-Ting Huang, Hsiao-Huang Chang, Thoralf Niendorf, Min-Chi Ku, Qian Tao, Hsin-Jung Yang ∗ Abstract Multiparametric mapping MRI has become a viable tool for myocardial tissue characterization. However, misalignment between multiparametric maps makes pixel-wise analysis challenging. To address this challenge, we developed a generalizable physics-informed deep-learning model using test-time adaptation to enable group image registration across contrast weighted images acquired from multiple physical models (e.g., a T1 mapping model and T2 mapping model). The physics-informed adaptation utilized the synthetic images from specific physics model as registration reference, allows for transductive learning for various tissue contrast. We validated the model in healthy volunteers with various MRI sequences, demonstrating its improvement for multi-modal registration with a wide range of image contrast variability. 1 Introduction Multiparametric quantitative cardiac magnetic resonance (CMR) imaging has become an essential diagnostic tool for cardiovascular pathology. The myocardial multiparametric mapping techniques, including T1 mapping and T2 mapping, provide complementary information about the heart and can reflect various myocardial abnormalities that can be used as a crucial tool to differentiate subtypes of cardiomyopathies [ 21 ] , and stage ischemic injuries [ 19 , 16 , 23 , 6 , 10 ] . However, the cardiac and respiratory motion introduce susceptibility to image alignment. Such motion can substantially compromise the fitting of quantitative maps and the multiparametric analysis between different mapping sequences [ 24 , 12 ] . Motion correction has therefore evolved into a fundamental component of contemporary post-processing workflows [ 2 , 5 ] , ensuring optimal image quality and diagnostic accuracy [ 17 ] . Deep learning-based image registration has gained significant attention in medical imaging due to its ability to provide rapid inference compared to traditional optimization-based methods [ 1 , 3 , 7 , 8 , 13 , 14 , 15 , 18 , 25 ] , offering computational efficiency and generalizability to in-domain data [ 3 , 7 ] . However, these methods face several limitations, particularly in multiparametric MRI mapping. One key challenge is the large signal variations between weighted images, making them less robust in quantitative MRI scenarios. Additionally, existing physics-informed registration methods, while showing improvement by incorporating known MRI signal models [ 26 ] , are often restricted to a single physics model within a single mapping acquisition. This limitation reduces their effectiveness when registering multiparametric maps acquired under different MRI sequences, where signal evolution follows multiple distinct models. Conventional methods that adopt motion-free synthetic images with similar contrast to the targeted data for registration show promising results [ 24 ] . However, training neural networks using synthetic images has two main limitations: it constrains the model’s applicability to a specific modality with known signal model, while demanding substantial computational resources. Recent advances in large pre-trained models that learn good representations and provide strong foundations for fine-tuning, have renewed interest in test-time adaptation [ 22 ] . This allows model optimization based on existing models [ 14 ] and specifically fine-tuning for the given task without redoing the intensive pre-training step, which sheds light on the registration between multiparametric maps. Here, we propose a new method for test-time adaptation of cardiac registration that pre-trains the neural network using a model-agnostic approach [ 14 ] and leverages physical models of MR contrast evolution as additional guidance during the fine-tuning process. By fine-tuning the model at test time, it can adapt specifically to the contrast patterns present in the current image series, enabling more robust registration across diverse contrast mechanisms. Furthermore, cardiac motion patterns and tissue appearances can vary significantly between patients due to differences in heart rate, breathing patterns, and underlying pathologies. Test-time adaptation allows the model to optimize its parameters for each specific case, accounting for patient-specific variations without requiring a massive training dataset that covers all possible scenarios. This adaptive capability is especially valuable when dealing with pathological cases that may be underrepresented in training data. In this work, we proposed a registration pipeline that leverage the contrast agnostic pretraining and physics guided test-time adaptation to enable a generalizable registration technique for multiparametric CMR maps. Our main contributions are: 1. Developed a generalizable deep-learning model to enable group image registration, regardless of contrast progression, length of the image series. 2. Combined an existing rPCA-based contrast agnostic registration pipeline with physics models to guide model fine-tuning and boost registration accuracy when large contrast variations (e.g., weighted images from T1 recovery and T2 decay) are present. 3. Integrated a hierarchical registration pipeline to incorporate image contrast ruled by multiple physical models. 2 Methods 2.1 Problem Formulation The multi-parametric dataset contains a set of image series \mathcal{S}=\{S^{1},S^{2},\cdots,S^{M}\} where M is the total number of sequences. Each sequence S_{i} contains its time series images S^{i}=\{I^{i}_{1},I^{i}_{2},\cdots,I^{i}_{N}\} where i\in\{1,\cdots,M\} is the sequence index and N is the number of time frames, I^{i}_{t}\in\mathcal{R}^{H\times W} is the image at inversion time t in sequence i . The goal of the registration is to achieve spatial alignment among all I^{i}_{t} by determining each frame’s corresponding deformation field \phi^{i}_{t}\in\mathcal{R}^{2\times H\times W} . The deformable mapping can be obtained by solving the following optimization problem: \phi^{*}=\mathop{\arg\min}\limits\mathcal{L}_{\mathrm{similarity}}+\lambda_{0}\mathcal{L}_{\mathrm{smooth}}+\lambda_{1}\mathcal{L}_{\mathrm{cyclic}}. (1) The \mathcal{L}_{\mathrm{similarity}} term measures the groupwise image similarity and will be introduced in detail in Section 2.2 . The \mathcal{L}_{\mathrm{smooth}} term denotes the smoothness regularization and is regularized by \mathcal{L}_{\text{smooth }}=\frac{1}{H\times W}\sum_{t=1}^{N}\int_{0}^{H}\int_{0}^{W}\left[\left(\frac{\partial^{2}\phi_{i}^{t}}{\partial x^{2}}\right)^{2}+\left(\frac{\partial^{2}\phi_{i}^{t}}{\partial y^{2}}\right)^{2}+2\left(\frac{\partial^{2}\phi_{i}^{t}}{\partial xy}\right)^{2}\right]dxdy. (2) Furthermore, given that deformation fields in the group exhibit periodic or symmetric properties, \mathcal{L}_{\mathrm{cyclic}} term denotes the cyclic consistency and is defined as follows: \mathcal{L}_{\mathrm{cyclic}}=\sqrt{\frac{1}{2(H\times W)}\sum_{i,j\in H,W}\left(\sum_{t=1}^{N}\phi_{i}^{t}(i,j)\right)^{2}}, (3) to avoid the degenerate case in which textural features collapse across the entire image sequence [ 14 ] . \lambda_{0} and \lambda_{1} denote the weight parameters respectively. Figure 1: Overview of the physics-informed test-time adaptation. The model is pre-trained using training data, and the pre-trained model is adapted to obtain desired capabilities on specific test images according to different physics models. The similarity term is changed from normalized mutual information to mean squared error during fine-tuning. In this figure, we use the data following the T_{1} -relaxation model as an example. In practice, it can be replaced with others based on the data modality. The rPCA-GroupRegNet is built based on the previous work [ 14 ] 2.2 Physics-Informed Test-time Adaptation Test-time adaptation is a special setting of unsupervised domain adaptation where a trained model on the source domain has to adapt to the target domain [ 4 ] . Test-time fine-tuning is one of the approaches that works by fine-tuning the parameters of a pre-trained model at test time [ 9 ] . The overview of the proposed approach is shown in Figure 1 . In pre-training, an average template S_{ref}^{i}=\frac{1}{N}\sum_{t=1}^{N}(\phi_{t}^{i}\circ I_{t}^{i}) is calculated for groupwise registration, and each I_{t}^{i} in image series S^{i} should align its anatomical structures to S_{ref}^{i} . The \mathcal{L}_{\mathrm{similarity}} term is defined as: \mathcal{L}_{\mathrm{similarity}}=-\frac{1}{N}\sum_{t=1}^{N}NMI(\phi_{t}^{i}\circ I_{t}^{i},S_{ref}^{i}). (4) In physics-informed test-time adaptation (PI-TTA), depending on the physics model of the test data, we generate the inversion recovery image series \hat{S}^{i} following the relaxation model (using T1-relaxation as an example): \hat{S}^{i}(x,y,t_{n})=|A(x,y)-B(x,y)\times e^{t_{n}/T_{1}^{*}(x,y)}|, (5) where A , B , T_{1}^{*} are the estimated parameters by fitting the warped images \phi_{t}^{i}\circ I_{t}^{i} to the 3-parameter model.