RealKeyMorph: Keypoints in Real-world Coordinates for Resolution-agnostic Image Registration
\firstname Mina \surname C. Moghadam* \email [email protected], \firstname Alan Q. \surname Wang* \email [email protected], \firstname Omer \surname Taub* \email [email protected], \firstname Martin R. \surname Prince \email [email protected], \name Mert R. Sabuncu \email msabuncu@ · 2025
Read RealKeyMorph: Keypoints in Real-world Coordinates for Resolution-agnostic Image Registration by \firstname Mina \surname C. Moghadam* \email [email protected], \firstname Alan Q. \surname Wang* \email [email protected], \firstname Omer \surname Taub* \email [email protected], \firstname Martin R. \surname Prince \email [email protected], \name Mert R. Sabuncu \email msabuncu@ (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2506-10344.txt.
Introduction
Mina C Moghadam and co-authors present RealKeyMorph, a 2025 arXiv paper on lining up medical scans. Two scans of the same body part often differ in sharpness, slice depth, or view size, thanks to unlike machine settings. Older learning tools first rescale both scans to one fixed grid, and that step can smear fine detail. Their method skips rescaling and works on the raw scans.
The tool learns matching landmark points on each scan, then solves for the shift that lines the points up. Its trick is to state the points in real-world space, using the scanner's own map from pixels to body space. Tests on belly scans and brain sets at mixed sharpness show the gain. The method builds on an earlier tool from the same line of work, KeyMorph.
Catalog record
| CREATOR | \firstname Mina \surname C. Moghadam* \email [email protected], \firstname Alan Q. \surname Wang* \email [email protected], \firstname Omer \surname Taub* \email [email protected], \firstname Martin R. \surname Prince \email [email protected], \name Mert R. Sabuncu \email msabuncu@ |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 40 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2506-10344
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
RealKeyMorph: Keypoints in Real-world Coordinates for Resolution-agnostic Image Registration \firstname Mina \surname C. Moghadam* \email [email protected], \firstname Alan Q. \surname Wang* \email [email protected], \firstname Omer \surname Taub* \email [email protected], \firstname Martin R. \surname Prince \email [email protected], \name Mert R. Sabuncu \email [email protected] Abstract Many real-world settings require registration of a pair of medical images that differ in spatial resolution, which may arise from differences in image acquisition parameters like pixel spacing, slice thickness, and field-of-view. However, all previous machine learning-based registration techniques resample images onto a fixed resolution. This is suboptimal because resampling can introduce artifacts due to interpolation. To address this, we present RealKeyMorph (RKM), a resolution-agnostic method for image registration. RKM is an extension of KeyMorph ( Evan et al. 2022 ; Wang A. Q. 2023 ) , a registration framework which works by training a network to learn corresponding keypoints for a given pair of images, after which a closed-form keypoint matching step is used to derive the transformation that aligns them. To avoid resampling and enable operating on the raw data, RKM outputs keypoints in real-world coordinates of the scanner. To do this, we leverage the affine matrix produced by the scanner (e.g., MRI machine) that encodes the mapping from voxel coordinates to real world coordinates. By transforming keypoints into real-world space and integrating this into the training process, RKM effectively enables the extracted keypoints to be resolution-agnostic. In our experiments, we demonstrate the advantages of RKM on the registration task for orthogonal 2D stacks of abdominal MRIs, as well as 3D volumes with varying resolutions in brain datasets. Keywords: Image registration, MRI, Keypoint, Real-world coordinates, Resolution-agnostic. 1 Introduction Image registration is essential in medical image processing for aligning scans within or across subjects Maintz and Viergever 1998 ; Sotiras et al. 2013 ; Fu et al. 2020 ; Kurugol et al. 2017 . It plays a key role in longitudinal studies by tracking anatomical changes and disease progression over time and comparing disease severity between subjects. Additionally, it serves as a crucial preprocessing step in multimodal image analysis, aligning MR sequences or planes for segmentation and reconstruction. Traditional, non-learning-based registration relies on iterative optimization of a similarity metric within a defined transformation space ( Oliveira and Tavares 2014 ; Li Z. and M. 2016 ; Sotiras et al. 2013 ; Chui and Rangarajan 2003 ; Hill et al. 2001 ) . Despite their effectiveness, these methods are computationally expensive, often requiring several minutes to register a single pair of images, and they tend to perform poorly when there is substantial initial misalignment between images. Among traditional approaches, keypoint-based methods have been widely explored as a means to improve robustness and interpretability ( Bay et al. 2008 ; Rosenfeld and Thurston 1971 ; Forstner and Gulch 1987 ; Harris et al. 1988 ; Montesinos and R. 1998 ; Wachinger et al. 2018 ) . By focusing on keypoints rather than dense voxel grids, keypoint-based methods reduce computational complexity, handle large misalignments robustly, and enhance interpretability. However, their effectiveness depends heavily on the quality of the detected keypoints, and they can struggle in cases with significant contrast or intensity variations ( Verdie et al. 2015 ) . In recent years, deep learning-based approaches have emerged as a promising alternative, leveraging large datasets to train neural networks for image registration ( Fu et al. 2020 ; Haskins et al. 2020 ; Cao et al. 2018 ; Eppenhof et al. 2018 ; Lee et al. 2019 ; Uzunova et al. 2017 ; Yang et al. 2017 ; Balakrishnan et al. 2019 ) . These techniques train neural networks to find the best transformation for each voxel or a set of representative keypoints in the moving images. The recently proposed KeyMorph technique ( Evan et al. 2022 ; Wang A. Q. 2023 ) integrates deep learning into keypoint-based registration to detect an optimal keypoint set and compute transformations through a closed-form solution. This technique combines the robustness and interpretability of keypoint-based methods, particularly in handling large misalignments, with the fast inference times of deep learning. Additionally, KeyMorph supports various transformations based on user specifications, enhancing human controllability in the registration process. A common characteristic across existing registration methods is their reliance on resampling paired images onto a standardized grid, often with isotropic resolution. While this simplifies computations, it reduces robustness when the input image pairs differ in dimensions or resolutions. This limitation is particularly pronounced when registering 2D MR stacks, specially orthogonal planes, with high slice thicknesses (greater than 2mm), where extensive interpolation can introduce inaccuracies. Contribution. In this work we present RealKeyMorph (RKM), as an extension of KeyMorph ( Evan et al. 2022 ; Wang A. Q. 2023 ) , designed to compute keypoints in real-world coordinates. Our approach yields a resolution-agnostic registration model capable of handling images with varying input resolutions and dimensions. By learning keypoint correspondences in real-world coordinates, the model eliminates the need to resample images onto a common spatial grid, thereby removing an extra interpolation step, preserving the integrity of the original data, and improving overall accuracy. RKM enjoys the benefits of KeyMorph, such that the learned keypoints can be visualized to interpret what is driving the alignment. RKM also offers users the flexibility to compute a dense set of registrations at test time directly from the learned keypoints. This feature allows users to control the level of non-linear deformation at inference time, tailoring it to the specific requirements of each application. The experimental analysis in this work is, in part, motivated by the application of image registration as a pre-processing step for high-resolution 3D volume reconstruction in abdominal MRI. Specifically, we utilize orthogonal 2D MRI stacks of abdominal images from 350 patients—comprising axial, coronal, and sagittal planes—which we aim to precisely align ( Rousseau et al. 2006 ) . In this context, the in-plane resolution varies across scans, while the slice thickness introduces an out-of-plane resolution that is significantly coarser than the in-plane resolution. Additionally, patient movement during the acquisition of different planes adds further complexity to the registration process. Our resolution-agnostic RKM approach, tested on 140 pairs of axial and coronal 2D stacks from 50 patients, achieves a state-of-the-art median Dice score of 79% and a Hausdorff Distance (HD) of 23 mm, underscoring the model’s ability to accurately register MRI planes with varying resolutions. To further explore the effectiveness and applicability of RKM, we performed a second analysis on the publicly available ADNI brain dataset, focusing on registration between image pairs with varying resolutions. Our goal was to include images from different MRI sequences to evaluate the model’s ability to generalize across diverse MRI acquisition protocols. The brain dataset included 3,480 pairs of 3D images with arbitrary MRI sequences, yielding registration performance of 89%(4%) Dice score and 48 mm (13 mm). These results demonstrate RKM’s capability to capture both affine and non-linear transformations between image pairs in the brain dataset. Our code is available at https://github.com/alanqrwang/keymorph . 2 Background Image registration is a rich literature that has been recently impacted by machine learning. Here we provide a very limited overview. Registration strategies. Classical registration approaches involve pairwise iterative optimization techniques ( Hill et al. 2001 ; Oliveira and Tavares 2014 ; Li Z.