Unified Brain Surface and Volume Registration

S. Mazdak Abulnaga, Andrew Hoopes, Malte Hoffmann, Robin Magnet, Maks Ovsjanikov, Lilla Zöllei, John Guttag, Bruce Fischl, Adrian Dalca · 2025

Read Unified Brain Surface and Volume Registration by S. Mazdak Abulnaga, Andrew Hoopes, Malte Hoffmann, Robin Magnet, Maks Ovsjanikov, Lilla Zöllei, John Guttag, Bruce Fischl, Adrian Dalca (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2512-19928.txt.

Introduction

Mazdak Abulnaga leads a ten-author team unifying two ways to align brain scans. Warping one MRI onto another backs group studies of the brain. Surface methods align the folded cortex. Volume methods align the inside. Done apart, the two breed mismatches. NeurAlign instead aligns volume and surface at once, in one deep learning frame.

A sphere-based space bridges the two sides. It links the cortex sheet's shape with the anatomy inside the volume. Spherical alignment is folded into the learning itself. That keeps the two domains in geometric step. On in-domain and out-of-domain data, NeurAlign beat classic and learned rivals. Dice overlap rose by up to seven points, with smooth warp fields kept. It also runs far faster than the standard pipeline. It needs nothing past the scan itself.

Catalog record

CREATORS. Mazdak Abulnaga, Andrew Hoopes, Malte Hoffmann, Robin Magnet, Maks Ovsjanikov, Lilla Zöllei, John Guttag, Bruce Fischl, Adrian Dalca
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE47 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2512-19928

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Unified Brain Surface and Volume Registration S. Mazdak Abulnaga, Andrew Hoopes, Malte Hoffmann, Robin Magnet, Maks Ovsjanikov, Lilla Zöllei, John Guttag, Bruce Fischl, Adrian Dalca Abstract Accurate registration of brain MRI scans is fundamental for cross-subject analysis in neuroscientific studies. This involves aligning both the cortical surface of the brain and the interior volume. Traditional methods treat volumetric and surface-based registration separately, which often leads to inconsistencies that limit downstream analyses. We propose a deep learning framework, NeurAlign, that registers 3 3 D brain MRI images by jointly aligning both cortical and subcortical regions through a unified volume-and-surface-based representation. Our approach leverages an intermediate spherical coordinate space to bridge anatomical surface topology with volumetric anatomy, enabling consistent and anatomically accurate alignment. By integrating spherical registration into the learning, our method ensures geometric coherence between volume and surface domains. In a series of experiments on both in-domain and out-of-domain datasets, our method consistently outperforms both classical and machine learning-based registration methods–improving the Dice score by up to 7 7 points while maintaining regular deformation fields. Additionally, it is orders of magnitude faster than the standard method for this task, and is simpler to use because it requires no additional inputs beyond an MRI scan. With its superior accuracy, fast inference, and ease of use, NeurAlign sets a new standard for joint cortical and subcortical registration. 1 Introduction Accurate alignment of both cortical and subcortical regions is essential for comprehensive and consistent whole-brain analysis in neuroimaging studies. For example, functional MRI (fMRI) measures brain activity by detecting blood oxygenation changes, with a key goal of localizing functional regions in the cerebral cortex. Mapping activation patterns to brain structure reveals functional organization and is essential for quantifying how neurodegenerative diseases affect things such as cognition ( 21 ; 55 ; 24 ) . Traditional deformable volumetric registration methods compute a three-dimensional (3D) displacement field to align brain images by maximizing intensity similarity ( 5 ; 7 ; 48 ) . While effective for aligning subcortical structures and global anatomy, volumetric deformable registration often fails in the cortex. The cortex is a thin, highly curved surface with significant inter-subject variability in folding patterns that is difficult to align in Euclidean space ( 22 ) . Accurate alignment is critical, since the cortex encodes many of the brain’s high-level functions such as memory and language, and serves as a primary target for structural and functional neuroimaging studies ( 23 ) . Surface-based methods address this challenge by projecting the cortex onto a sphere and aligning the cortex using pre-computed anatomical features such as sulcal depth and/or curvature. This facilitates registration by providing a common geometric space to preserve the topology of the cortex ( 22 ; 60 ) . Using fundamentally different representations for surface- and volume-based registration forces neuroscience researchers to tackle two disjoint problems and combine solutions ad hoc ( 57 ) . This typically involves solving an elastic partial differential equation to propagate the surface registration to the interior brain. However, interpolating the surface registration to the interior is not guaranteed to be consistent with the original volumetric registration. This sequential approach thus prevents computing a single coherent registration that simultaneously satisfies both cortical and subcortical alignment objectives. This introduces errors, undermining whole-brain analyses by potentially misaligning anatomically and functionally connected areas ( 33 ; 44 ; 3 ) . In this work, we propose NeurAlign , a machine learning framework for unified registration of cortical and subcortical structures. NeurAlign, simultaneously trains a volumetric registration network and a spherical registration network using a shared framework that combines both domains. Unlike existing approaches, our model explicitly couples the two through a loss function that encourages the volumetric deformation field on the cortical ribbon to match the spherical registration field. This promotes topologically correct and geometrically consistent alignment across cortical and subcortical regions. Crucially, because our method performs registration in a single forward pass, it enables efficient and scalable whole-brain registration for large population studies. Further, NeurAlign does not require cortical meshes nor segmentations at inference, avoiding the computationally intensive preprocessing required by other methods. Our method, NeurAlign, achieves significantly improved cortical and subcortical alignment compared to the standard joint registration framework, CVS ( 44 ) , while reducing computation time by several orders of magnitude. In addition, NeurAlign substantially outperforms state-of-the-art volumetric machine learning–based registration approaches. To summarize our contributions: • We propose a unified machine learning model that performs consistent registration of both cortical and subcortical structures using coupled spherical and volumetric networks. • We derive a cortical consistency loss that explicitly encourages agreement between the volumetric deformation field in the cortex and the spherical registration field, promoting anatomically coherent alignment across the entire brain. • Our proposed method leverages cortical meshes during training , but does not require them during inference, enabling accessible, rapid, and accurate registration. • We validate our method on four clinical neuroimaging datasets, showing substantially improved and rapid cortical and subcortical alignment compared to standard baselines. Our code and trained model weights are available at https://github.com/mabulnaga/neuralign . 2 Related Work Volumetric Registration. Deformable registration estimates a dense spatial mapping between a pair of images. Classical methods ( 48 ; 4 ; 46 ; 40 ) solve an optimization problem for each pair of images. This balances an image-similarity objective, often mean-squared error (MSE) or normalized cross correlation (NCC) ( 5 ) , between the warped image and the fixed image, with a regularization objective that encourages a smooth and plausible solution. Methods differ in their optimization strategy, the choice of the objective function, and in how they parameterize the deformation field. Learning-based methods fit the parameters of a neural network to a training dataset. The network learns a nonlinear function that maps an input image pair to an output transform, generally enabling much faster inference than classical methods. Supervised approaches ( 52 ; 45 ; 59 ) reproduce known simulated deformations or fields estimated by classical methods, whereas unsupervised approaches ( 17 ; 7 ; 41 ; 25 ; 2 ; 26 ) optimize an image-similarity loss term and a regularization loss term at training, analogous to classical registration. Both optimization-based and machine learning-based volumetric approaches are highly effective at aligning subcortical structures. However, they struggle with cortical registration, since the optimization landscape in Euclidean space often leads to suboptimal local minima. This can lead to implausible solutions that, for example, move voxels from one gyrus to the next instead of following the cortical fold. Further, relying only on image-based features cannot align the functional regions of the cortex, so geometric features must be employed from geometric representations ( 22 ; 50 ) . Spherical Registration. Cortical alignment in the spherical domain is the standard approach in neuroscientific studies ( 23 ; 24 ; 57 ) . Mapping the cortex to the sphere simplifies the optimization, since the registration is guaranteed to preserve topology. The registration is driven by geometric descriptors that measure the cortical shape and folding patterns ( 22 ; 23 ; 60 ; 14 ; 62 ) . Similar to volumetric registration, spherical registration is posed as an optimization problem that balances a geometric similarity objective with a regularization objective. Many of these methods

Read the complete text