Strategies for Robust Deep Learning Based Deformable Registration
Joel Honkamaa, Pekka Marttinen · 2025
Read Strategies for Robust Deep Learning Based Deformable Registration by Joel Honkamaa, Pekka Marttinen (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2510-23079.txt.
Introduction
Joel Honkamaa and Pekka Marttinen describe their entry to the LUMIR brain registration challenge, which tests whether image alignment holds up on new scan types. Deep registration methods often fail when contrast or modality differs from training data. The challenge for Learn2Reg 2025 grades methods on exactly those unseen kinds of brain scans.
Their fix is simple: convert images into MIND feature space before feeding them to the model. That change greatly improved robustness across contrasts. A special ensembling step added a small but steady gain. The entry shows a plain preprocessing idea can beat complex tweaks for medical image alignment.
Catalog record
| CREATOR | Joel Honkamaa, Pekka Marttinen |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 11 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2510-23079
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Strategies for Robust Deep Learning Based Deformable Registration Joel Honkamaa, Pekka Marttinen Abstract Deep learning based deformable registration methods have become popular in recent years. However, their ability to generalize beyond training data distribution can be poor, significantly hindering their usability. LUMIR brain registration challenge for Learn2Reg 2025 aims to advance the field by evaluating the performance of the registration on contrasts and modalities different from those included in the training set. Here we describe our submission to the challenge, which proposes a very simple idea for significantly improving robustness by transforming the images into MIND feature space before feeding them into the model. In addition, a special ensembling strategy is proposed that shows a small but consistent improvement. 1 Introduction Deep learning based medical image registration methods have emerged as a strong alternative for classical iterative methods, but their usability has been brought to question due to their potentially poor performance on data outside the training distribution [ 8 ] . However, the best methods submitted for the LUMIR MRI brain registration challenge organized as part of Learn2Reg 2024 showed strong robustness to domain shifts, failing only on out-of-distribution contrasts. LUMIR challenge for Learn2reg 2025 aims to advance the field particularly in this regard: For training, one is required to use the provided T1-weighted brain MRI images but the evaluation is performed on new contrasts or even modalities. This paper is an algorithm description of our submission to the challenge. As our main contribution, we propose to transform the images using the MIND [ 5 ] transformation before feeding them into the model, while still using intra-modality similarity loss (normalized cross-correlation) as the training signal. While the MIND features contain less information than the original images, the transformation unifies the representation between different modalities, and the performance on in-domain images remains similar. Earlier MIND features or its variants have been used for evaluating multi-modal similarity (including in deep learning [ 4 , 6 , 1 ] ) but to our knowledge they have not been used as an input transformation in deep learning before. In addition, we propose a special ensembling strategy which still retains the diffeomorphic properties of the used backbone model. Figure 1: Overview of the proposed main idea. The input images go through the MIND transformation before being fed to the registration network. As a result, the network learns to do multi-modal registration even though it is trained with an intra-modality similarity loss. The similarity loss is normalized cross-correlation. Also note that in practice the registration network predicts the deformation in both directions, and the losses are also computed for both directions. 2 Background MIND (Modality Independent Neighborhood Descriptor) [ 5 ] is a well-established and simple method for measuring multi-modal similarity. The method works by computing MIND features of both images and then taking some simple distance measure such as the mean absolute error or mean squared error between the resulting volumes. MIND encodes how similar a voxel’s neighborhood is to its surrounding neighborhoods, not the absolute intensity values. Given an offset r , the formula for computing a single MIND feature at location x can be written as \operatorname{MIND}(x,r)=\exp\left(-\frac{D(I,x,x+r)}{V(I,x)}\right) (1) where D(I,x,x+r) is the Gaussian-weighted sum of the squared differences between the patches around x and x+r D(I,x,y):=\sum_{p\in P}\exp(-\frac{p^{2}}{\sigma^{2}})(I(x+p)-I(y+p))^{2} (2) with P being large enough lattice around origin to incorporate most of the Gaussian, and V(I,x) is local variance of I estimated as the mean of D in the six-neighborhood around x , giving V(I,x):=\frac{1}{6}\sum_{n\in\mathscr{N}}D(I,x,x+n) . Here, I refers to the image, and \mathscr{N} is the six-neighborhood around origin. To compute MIND features, Eq. 1 is evaluated for each voxel and multiple offsets, and each voxel is associated with a feature vector consisting of those values. The six-neighborhood set is often used for the offsets as well, resulting in a six-dimensional feature vector. 3 Methods 3.1 Backbone As a backbone architecture we use our work SITReg [ 7 ] which was used by the winning submission for Learn2Reg 2024. The architecture is by construction symmetric, inverse consistent, and produces diffeomorphic deformations. The overall architecture starts by extracting multiresolution features from both images independently using ResNet-style convolutional neural network. The architecture then recursively updates the deformation at each resolution starting from the lowest resolution. At each resolution stage, the features of that resolution are transformed by the deformation learned up to that point and are then used to predict a deformation update in symmetric manner. The update deformations are generated using constrained B-spline control points to ensure diffeomorphic predictions. See the paper for more details. 3.2 Input transformation The challenge requires the method to work on images of different contrast or modality from the training images. In general, the behavior of machine learning algorithms on inputs outside the training distribution is hard to predict, and for that reason we take the approach of trying to transform the images to some representation which contains less information than the original representation but is similar across contrasts and modalities. Preferably, mainly the structural information would be preserved. The MIND transformation described in Section 2 is a well-established and simple transformation that unifies different modalities. Note that unlike in the usual use case, we do not use the MIND transformation in computing the similarity loss which is instead computed with the original images using intra-modality loss. Since MIND features unify representation across modalities, the symmetric nature of the backbone architecture is still meaningful even for multi-modal registration. We use \sigma=0.5 for the MIND transformation (Eq. 2 ) which performed the best in the original paper [ 5 ] . 3.3 Ensembling We train an ensemble of 5 models with different data generation seeds. For the final prediction we average the predicted update deformations at each registration stage of the SITReg multiresolution architecture. We perform averaging in the B-spline weight space to preserve the diffeomorphic properties of the architecture. 3.4 Further details We also use augmentations to help with generalization. We randomly apply Gaussian noise, Gaussian blur, sign inversion, and gamma correction to the input images. We use normalized cross-correlation as a similarity metric. Due to the MIND input transformation, the network still learns to register images of different modality. For computing the similarity loss, we always use the original non-augmented images, and mask the background out. We regularize the predicted deformations with diffusion regularization (L 2 norm on displacements). While the original SITReg paper applied the losses only after the final stage of its multi-resolution architecture, we apply the loss also on intermediate stages to ensure consistent behavior across the trained model ensemble. However, we use very low loss weight of \frac{1}{100} for the earlier stages. While the SITReg backbone produces nearly perfectly diffeomorphic deformations, due to resampling errors tiny folding errors can still occur. To ensure a very high competency, we add non-diffeomorphic volume (NDV) [ 9 ] as an additional loss term for the final epochs. We also train with group consistency loss [ 3 ] for the final epochs. The loss encourages the composition of predicted deformations over image cycles to be identity mappings. Note that NDV and group consistency losses were also used in the winning submission of Learn2Reg 2024 which was also based on