Implicit Deformable Medical Image Registration with Learnable Kernels
Stefano Fogarollo, Gregor Laimer, Reto Bale, Matthias Harders · 2025
Read Implicit Deformable Medical Image Registration with Learnable Kernels by Stefano Fogarollo, Gregor Laimer, Reto Bale, Matthias Harders (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2506-02150.txt.
Introduction
Stefano Fogarollo and co-authors give a new way to align medical scans that bend and shift. The work dates to 2025. Good alignment matters for cancer care, where staff track tumor growth and aim treatment with care. New AI tools are fast and sharp but can warp anatomy in ways staff cannot trust.
The team treats alignment as rebuilding a signal. A learned kernel rebuilds the full shift field from a few matched points. Shifts are built step by step, from coarse to fine, and staff can adjust them at test time. Tests on chest and belly scans showed sharp results that kept anatomy intact.
Catalog record
| CREATOR | Stefano Fogarollo, Gregor Laimer, Reto Bale, Matthias Harders |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 23 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2506-02150
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Implicit Deformable Medical Image Registration with Learnable Kernels Stefano Fogarollo, Gregor Laimer, Reto Bale, Matthias Harders Abstract Deformable medical image registration is an essential task in computer-assisted interventions. This problem is particularly relevant to oncological treatments, where precise image alignment is necessary for tracking tumor growth, assessing treatment response, and ensuring accurate delivery of therapies. Recent AI methods can outperform traditional techniques in accuracy and speed, yet they often produce unreliable deformations that limit their clinical adoption. In this work, we address this challenge and introduce a novel implicit registration framework that can predict accurate and reliable deformations. Our insight is to reformulate image registration as a signal reconstruction problem: we learn a kernel function that can recover the dense displacement field from sparse keypoint correspondences. We integrate our method in a novel hierarchical architecture, and estimate the displacement field in a coarse-to-fine manner. Our formulation also allows for efficient refinement at test time, permitting clinicians to easily adjust registrations when needed. We validate our method on challenging intra-patient thoracic and abdominal zero-shot registration tasks, using public and internal datasets from the local University Hospital. Our method not only shows competitive accuracy to state-of-the-art approaches, but also bridges the generalization gap between implicit and explicit registration techniques. In particular, our method generates deformations that better preserve anatomical relationships and matches the performance of specialized commercial systems, underscoring its potential for clinical adoption. 1 Introduction Accurate and reliable registration is an essential step in computer-assisted interventions, with direct applications on intra-procedural navigation, treatment monitoring and evaluation. The task consists of finding the optimal transformation that aligns the two input images. In particular in the abdominal and thoracic regions, deformable registration is needed to correctly model large nonlinear deformations resulting from the complex behavior and interaction of soft tissues [ 45 ] . Traditional image registration methods [ 3 , 23 , 32 ] can estimate accurate deformations for each image pair, but often struggle to balance accuracy, computational efficiency, and anatomical plausibility; modern techniques can leverage hardware acceleration (GPU) for faster inference [ 36 , 18 ] . Recent advances in artificial intelligence (AI) have shown promising results in addressing these challenges, with learning-based methods achieving state-of-the-art performance in terms of both speed and accuracy. Building on the frameworks described in VoxelMorph [ 4 ] and SynthMorph [ 21 ] , AI methods are trained to predict a tensor \phi\in\mathbb{R}^{D\times H\times W\times 3} representing the displacement field that spatially aligns the two 3 D inputs, namely the moving and fixed images, with D,H,W denoting the spatial dimensions. Backpropagation of the gradients is achieved by warping the image with \phi using a Spatial Transformer Network layer [ 22 ] . Multi-stage incremental prediction has been shown to increase the registration accuracy with minimal computational overhead [ 30 , 42 , 8 , 43 ] , achieving comparable performance to pyramidal [ 33 ] and cascaded [ 47 ] architectures. Despite these improvements, current AI registration methods struggle with unseen anatomical variations or clinical scenarios not encountered during training [ 20 ] . Recent foundation models try to bridge this gap by pre-training on large-scale diverse datasets, but they still need test-time refinement in difficult zero-shot cases (“Type 2” out-of-distribution) [ 39 , 11 ] . Related to our approach are implicit neural representations (INRs), which employ multi-layer perceptrons (MLP) to continuously represent a signal [ 37 , 28 ] . While INRs offer significant potential in medical imaging due to their inherent efficiency [ 31 ] , they are designed to fit individual input signals, rather than to generalize to unseen data. The implicit method introduced in [ 46 ] can model the spatial transformation between a pair of medical images, but requires retraining for each new pair. Several strategies have been explored to address this limitation, including hyper-networks [ 37 , 7 , 14 ] , modulation of periodic activations [ 28 ] , and conditioned MLPs [ 2 ] . Recently, the authors of [ 48 ] propose to generalize the pairwise implicit registration technique of [ 46 ] by conditioning on learned image features. To the best of our knowledge, this is the only prior work addressing generalized INRs for medical image registration, highlighting a critical research gap. Therefore, a key question remains [ 6 ] : how can we mitigate AI generalization issues to achieve reliable zero-shot registration? This is the focus of our work, and to answer the question, we cast deformable image registration as a signal reconstruction problem. We propose to reconstruct the dense displacement field with a learnable kernel conditioned on sparse keypoint correspondences. An implicit dual-stream attention mechanism is used to model the spatial and semantic dependencies of the neighboring displacements, allowing to learn complex deformations in a data-driven manner. Distinct from sparse correspondence extrapolation methods [ 17 ] , our approach learns a continuous implicit representation of the dense displacement field. Our method improves the generalization of existing INRs by conditioning the representation on the local neighborhood. Moreover, our approach naturally supports interactive test-time refinement, enhancing its practicality for real-world clinical applications. We visualize the proposed method in Figure 1 . In summary, the main contributions of this work are threefold: 1) We introduce a novel implicit framework for medical image registration leveraging learnable kernels. 2) We condition the representation on local keypoint correspondences for improved generalization. 3) We extensively evaluate our method and compare it with several state-of-the-art approaches on zero-shot intra-patient registration tasks. In the following sections, we introduce our method, followed by empirical results and ablation studies supporting the design choices. Figure 1 : In this work, we rephrase deformable image registration as signal reconstruction. First, we obtain sparse correspondences between the input images using cost-volume optimization on multi-scale features learned with \mathcal{F} . Then, we reconstruct the displacement field with a learnable kernel function \mathbf{w} , conditioned on the local displacements \mathbf{d}(y),y\in\mathcal{N}(x) , depicted in blue. 2 Method In this work, we cast deformable medical image registration as a signal reconstruction problem. Our goal is to reconstruct a high-dimensional signal \mathbf{d}:\mathbb{R}^{3}\to\mathbb{R}^{3} from a sparse set of observations O=\{p_{i},d_{i}\}_{i\in\mathbb{N}:1\leq i\leq m} , where p_{i} are spatial coordinates \in\mathbb{R}^{3} , and d_{i}\in\mathbb{R}^{3} denote the observed signal values. Under this formulation, we evaluate \mathbf{d} on the regular Cartesian grid to represent the displacement field \phi on the voxel domain. 2.1 Learnable kernels for image registration Our key insight is that natural signals, such as displacement fields in medical images, exhibit strong local and global structure that can be encoded in a learnable basis representation. We adopt a kernelised formulation and compute \mathbf{d}(x) as \mathbf{d}(x)=\sum_{y\in\mathcal{N}(x)}\mathbf{w}(x,y)\cdot\mathbf{d}(y), (1) where \mathcal{N}(x) represents the neighborhood of x , and the kernel \mathbf{w} determines the contribution of each neighbor to the final displacement at x . The signal observations can be obtained via point-to-point correspondences between the moving and fixed images, as described later on. While \mathbf{w} is defined a priori in traditional techniques, in our method it is parameterized with a neural network. In particular, we design a dual-stream attention mechanism [ 41 ] to disentangle geometric and semantic information through two dedicated attention heads \mathcal{H}_{s},\mathcal{H}_{f} , respectively: a(x,y)=\mathcal{H}_{s}(\mathcal{E}_{s}(x),\mathcal{E}_{s}({y})))+\mathcal{H}_{f}(\mathcal{E}_{f}(x_{f})+\mathcal{E}_{f}({y_{f}})))+b(x,y),\quad y\in\mathcal{N}(x). (2) a(x,y) encodes the attention score between