Learning KAN-based Implicit Neural Representations for Deformable Image Registration
Nikita Drozdov, Marat Zinovev & Dmitry SorokinLomonosov Moscow State University, Moscow, Russia {drozdovna,zinovevmo}@my.msu.ru, [email protected] · 2025
Read Learning KAN-based Implicit Neural Representations for Deformable Image Registration by Nikita Drozdov, Marat Zinovev & Dmitry SorokinLomonosov Moscow State University, Moscow, Russia {drozdovna,zinovevmo}@my.msu.ru, [email protected] (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2509-22874.txt.
Introduction
Nikita Drozdov, Marat Zinovev, and Dmitry Sorokin align medical images with a neural field built from Kolmogorov-Arnold networks. Deformable registration warps one scan onto another for longitudinal studies and multi-modal fusion. Learned methods are fast but data-hungry and can lag classical iteration on some anatomies. Implicit neural representations instead fit each pair directly, modeling the warp as a continuous map from coordinates to displacement.
Their variants, KAN-IDIR and RandKAN-IDIR, use learnable activation functions suited to smooth physical warps. A randomized version cuts cost by sampling fewer basis functions. On lung CT, brain MRI, and cardiac MRI, they led implicit methods in accuracy, with low overhead and strong stability across random starts.
Catalog record
| CREATOR | Nikita Drozdov, Marat Zinovev & Dmitry SorokinLomonosov Moscow State University, Moscow, Russia {drozdovna,zinovevmo}@my.msu.ru, [email protected] |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 43 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2509-22874
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Learning KAN-based Implicit Neural Representations for Deformable Image Registration Nikita Drozdov, Marat Zinovev & Dmitry SorokinLomonosov Moscow State University, Moscow, Russia {drozdovna,zinovevmo}@my.msu.ru, [email protected] Abstract Deformable image registration (DIR) is a cornerstone of medical image analysis, enabling spatial alignment for tasks like comparative studies and multi-modal fusion. While learning-based methods (e.g., CNNs, transformers) offer fast inference, they often require large training datasets and struggle to match the precision of classical iterative approaches on some organ types and imaging modalities. Implicit neural representations (INRs) have emerged as a promising alternative, parameterizing deformations as continuous mappings from coordinates to displacement vectors. However, this comes at the cost of requiring instance-specific optimization, making computational efficiency and seed-dependent learning stability critical factors for these methods. In this work, we propose KAN-IDIR and RandKAN-IDIR, the first integration of Kolmogorov-Arnold Networks (KANs) into deformable image registration with implicit neural representations (INRs). The learnable activation functions of KANs and their inherent suitability for approximating physical systems make them ideal for modeling deformation fields. Our proposed randomized basis sampling strategy reduces the required number of basis functions in KAN while maintaining registration quality, thereby significantly lowering computational costs. We evaluated our approach on three diverse datasets (lung CT, brain MRI, cardiac MRI) and compared it with competing instance-specific learning-based approaches, dataset-trained deep learning models, and classical registration approaches. KAN-IDIR and RandKAN-IDIR achieved the highest accuracy among INR-based methods across all evaluated modalities and anatomies, with minimal computational overhead and superior learning stability across multiple random seeds. Additionally, we discovered that our RandKAN-IDIR model with randomized basis sampling slightly outperforms the model with learnable basis function indices, while eliminating its additional training-time complexity. Source code is available at https://github.com/anac0der/KAN-IDIR . 1 Introduction Deformable image registration (DIR) is a fundamental task in the field of medical image processing. Its primary goal is to determine a spatial transformation that aligns one image with another, ensuring that corresponding regions appear in the same locations. This process enables accurate comparison, fusion, or further analysis of imaging data. Figure 1: Target registration error (TRE) distributions for IDIR and proposed KAN-IDIR across all DIR-Lab cases, comparing outlier characteristics between optimal ( lowest mean error ; first two histograms) and suboptimal ( highest mean error ; last two histograms) seed initializations from a total of 10 seeds. The dashed red line indicates the 3 mm acceptability threshold, while the dotted purple line marks the maximum outlier value per method. Our proposed KAN-IDIR demonstrates: (1) fewer outliers overall in optimal seed conditions – 54 vs. 64 for IDIR; and (2) consistent performance across seed selections – >3 mm outlier count difference for best/worst seed is 4 for KAN-IDIR vs. 56 for IDIR. With recent advances in artificial intelligence technologies, image-to-image architectures such as convolutional neural networks (CNNs) and transformers have become increasingly popular in medical image registration ( Balakrishnan et al. 2019a ; Chen et al. 2022 ) . These approaches predict displacement vector fields for image pairs, offering inference speeds several orders of magnitude faster than classical iterative methods – an essential advantage for real-time clinical applications. However, such learning-based methods face three primary limitations: (1) their performance relies on large training datasets, which are often unavailable for specific organs or imaging modalities; (2) they do not consistently outperform classical methods for certain anatomical structures; and (3) they exhibit a degradation of registration quality when input data resolution varies. An alternative approach to dataset-trained registration methods is to learn the deformation field as a mapping from continuous voxel coordinates to the corresponding displacement vector. This mapping is parametrized by a neural network, referred to as an implicit neural representation (INR). INRs have demonstrated remarkable performance in tasks like novel view synthesis (NeRFs) ( Mildenhall et al. 2020 ) and have been leveraged in several methods for DIR ( Wolterink et al. 2022 ; Harten et al. 2023 ; Harten et al. 2024 ) . INR-based solutions address the main limitations of dataset-trained deep learning models: their reliance on large training datasets, sensitivity to domain shifts, and difficulties with handling substantially different resolutions. However, these methods require instance-specific optimization, which makes computational efficiency and seed-dependent learning stability crucial for the practical use of these methods. Most existing INR architectures are based on multi-layer perceptrons (MLPs) with various activation functions ( Sitzmann et al. 2020 ; Saragadam et al. 2023 ; Liu et al. 2024a ) . Recently, Kolmogorov-Arnold Networks (KANs), with their learnable activations, have emerged as a promising alternative to traditional MLPs in regression tasks ( Liu et al. 2024c ) . Several recent studies have examined the INRs based on KANs across various tasks ( Mehrabian et al. 2024 ; Li et al. 2025 ) . To date, however, no prior work has investigated KAN-based INRs for deformable image registration, leaving their potential to advance registration techniques unexplored. In this paper, we propose a novel approach to DIR using Implicit Neural Representations enhanced with Kolmogorov-Arnold Networks. Our key contributions are: 1. We introduce the first integration of Kolmogorov-Arnold Networks with randomized basis sampling for INR-based deformable image registration. Our approach enhances registration accuracy while maintaining low computational and memory costs compared to classical or neural network-based methods. Additionally, it demonstrates improved seed-dependent learning stability compared to other INRs (see Figure 1 ). 2. Our models, namely KAN-IDIR and RandKAN-IDIR, are the only INR-based solutions that achieve the best or best-in-class performance across all three evaluated datasets spanning different organs and imaging modalities. Specifically, they deliver superior accuracy and runtime/memory efficiency on DIR-Lab (lung CT), surpass other instance-specific solutions on OASIS-1 (brain MRI), and achieve the leading perfomance and best deformation regularity on ACDC (cardiac MRI). Besides that, the proposed models result in fewer outliers compared to the other INR-based baseline method for the DIR-Lab dataset (see Figure 1 ). 3. Surprisingly, our RandKAN-IDIR model with randomized basis sampling achieved similar performance to the adaptive KAN variant that learns function indices, while eliminating their additional computational overhead during training. 2 Related Works Implicit Neural Representations. Implicit neural representations model signals as continuous, differentiable functions parameterized by neural networks. Following ( Sitzmann et al. 2020 ) , an INR is defined as the solution to an equation: \mathcal{C}(\mathbf{x},\Phi,\nabla_{\mathbf{x}}\Phi,\nabla_{\mathbf{x}}^{2}\Phi,\ldots)=0,\quad\Phi:\mathbf{x}\mapsto\Phi(\mathbf{x}). (1) Here, a network is trained to parameterize the function \Phi that maps coordinates \mathbf{x}\in\mathbb{R}^{n} to target values while satisfying the implicit constraint \mathcal{C} in Eq. 1 . The choice of INR architecture is critical, as it determines the class of functions that the network can effectively represent. While ReLU networks primarily capture low-frequency signals ( Mildenhall et al. 2020 ) , research has focused on alternative activations, e.g. SIREN’s sine functions ( Sitzmann et al. 2020 ) or wavelet activations ( Saragadam et al. 2023 ) . Notably, SIREN remains a strong baseline in most applications. 2.1 Medical Image Registration Medical Image Registration. Recent advances in deep learning (DL) for medical image registration have been heavily CNN-based methods. The VoxelMorph framework ( Balakrishnan et al. 2019a ) was a major breakthrough, enabling fast deformable registration using CNNs to learn deformation fields in unsupervised manner. It was further extended with probabilistic modeling with stationary velocity fields (SVFs) ( Dalca et al. 2019 ) , diffeomorphic networks in LapIRN approach (