Model-based Dynamic 3 3 D MRI Reconstructions using Neural Fields and Tensor Product Expansions
Ray Sheombarsing, Max van Riel, David Heesterbeek · 2026
Read Model-based Dynamic 3 3 D MRI Reconstructions using Neural Fields and Tensor Product Expansions by Ray Sheombarsing, Max van Riel, David Heesterbeek (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-08275.txt.
Introduction
Ray Sheombarsing, Max van Riel, David Heesterbeek, Nico van den Berg, and coauthors reconstruct dynamic MRI scans from far fewer measurements than usual. Standard methods store images and coil sensitivities as discrete grids, which eats memory and hides structure that could guide reconstruction, a real problem for beating-heart scans.
Their framework represents both magnetization and coil sensitivities as continuous differentiable functions, built from tensor products of small one-dimensional neural fields. That structure keeps memory low and scales to three-dimensional, time-varying data. The method beat leading model-based reconstructions in two and three dimensions, preserving anatomy and motion even at an acceleration factor of sixteen.
Catalog record
| CREATOR | Ray Sheombarsing, Max van Riel, David Heesterbeek |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 47 KB |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2605.08275
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Model-based Dynamic 3 3 D MRI Reconstructions using Neural Fields and Tensor Product Expansions Ray Sheombarsing, Max van Riel, David Heesterbeek Abstract Conventional MRI reconstruction methods treat images and coil sensitivities as discrete objects, leading to high memory demands and limited structural awareness that hamper effective regularization. These limitations hinder accurate reconstruction in highly undersampled scenarios, such as dynamic 3D cardiac magnetic resonance (CMR). We introduce a discretization-free, memory-efficient, model-based framework for dynamic 2D and 3D MRI reconstruction from highly undersampled data. We represent magnetization and coil sensitivities as continuous objects—differentiable functions—using tensor products of univariate neural fields. This tensor product structure enables scalable optimization in high-dimensional spatiotemporal settings. Our method outperforms state-of-the-art model-based reconstructions in dynamic 2D and 3D MR settings, preserving structure and motion even under aggressive undersampling (e.g., acceleration factor 16). Keywords Accelerated MRI \cdot Continuous-domain modeling \cdot Dynamic 3D MRI \cdot Joint image-sensitivity reconstruction \cdot Neural fields \cdot Tensor product representations 1 Introduction Conventional MRI reconstruction represents magnetization (images) as discrete arrays. While natural for digital data, this approach suffers from high memory demands and limited structural awareness, requiring strong regularization (e.g., Total Variation) to enforce consistency, especially in highly undersampled acquisitions such as dynamic 2 D and 3 D cardiac magnetic resonance (CMR) [ 36 , 26 , 25 , 2 , 20 , 21 , 3 ] . In these applications, high acceleration factors are essential to resolve cardiac motion at sufficiently fine spatiotemporal resolution. Under such conditions, the limitations of purely discrete model-based frameworks become evident, as effective regularization becomes increasingly difficult. Deep learning–based reconstruction methods [ 16 , 10 , 17 ] provide an alternative by learning expressive priors from large collections of fully sampled data. Broadly, these approaches fall into two categories. Fully supervised approaches use neural networks to map undersampled data, or aliased images, to fully sampled k -space or directly to images. Physics-informed model-based approaches incorporate deep networks into classical parallel imaging, typically replacing handcrafted regularizers with convolutional neural networks trained on large paired datasets. Despite their success, these methods share two limitations: (i) they rely heavily on large supervised training sets, reducing adaptability across scanners, protocols and region of interests, and (ii) they treat images as discrete objects, tying reconstructions to a fixed resolution and limiting structural flexibility. These limitations motivate scan - specific continuous representations, where images (and coil sensitivities) are modeled as differentiable functions of space and time. Continuous representations offer several advantages: they support evaluation and differentiation at arbitrary points, enable discretization - free regularization, and connect naturally to well - established tools in scientific computing such as orthogonal polynomial expansions [ 5 ] , splines [ 27 , 7 ] , and wavelets [ 35 , 22 ] . Importantly, multivariate functions can be represented efficiently using tensor products of univariate functions, enabling fast evaluation and differentiation. Directly applying these classical tools to MRI reconstruction, however, requires choosing a specific functional representation, e.g., a basis. In highly undersampled scenarios, this choice effectively acts as a strong prior, which may limit performance. Implicit Neural Fields (INFs) [ 18 , 30 ] offer a flexible alternative: they represent functions with neural networks that adapt to the structure of each scan. Like classical representations, INFs yield continuous representations, but in contrast, the entire representational structure is learned during reconstruction rather than fixed in advance. Existing INF - based MRI approaches mostly employ fully multivariate networks [ 8 , 9 , 29 , 31 , 18 ] . Because the computational cost of these models grows rapidly with dimensionality, they become difficult to apply in higher - dimensional (dynamic) problems. In this paper, we propose a model - based reconstruction framework using tensor products of univariate neural fields for dynamic 2 D and 3 D MRI. This architecture generalizes classical tensor product bases, such as Fourier and polynomial bases, replacing fixed basis functions with adaptable neural networks. These networks provide continuous, scan - specific representations of both magnetization and coil sensitivities, which are reconstructed jointly from undersampled data without requiring external training datasets or separate coil - calibration scans. Our main contribution is an efficient formulation that uses tensor products of univariate neural fields rather than a single multivariate network. This structure is crucial for computational feasibility; evaluating a multivariate neural field on a dense P_{1}\times\ldots\times P_{d} grid involves \prod_{j=1}^{d}P_{j} points to evaluate at, which is prohibitive for dynamic 3 D MRI ( d=4 ). In contrast, our tensor product design evaluates only d univariate networks at P_{j} points each, drastically reducing computation to \sum_{j=1}^{d}P_{j} evaluations thereby saving memory. Differentiation is also far more memory - efficient under the tensor product formulation, which is crucial when evaluating gradient - based regularizers such as Total Variation (TV). Combined with a stochastic formulation of the parallel - imaging objective, this enables efficient reconstruction at high acceleration factors. To illustrate the practical impact of these memory savings, consider a dynamic 2 D example from our experiments (Section 4 ), which uses d=3 and grid size (P_{1},P_{2},P_{3})=(8,288,112) . A conventional multivariate neural field requires roughly 23 GB GPU memory during optimization, whereas our tensor product formulation reduces this to about 750 MB, a 31\times reduction. The gap widens further in our dynamic 3 D examples. With (P_{1},P_{2},P_{3},P_{4})=(16,128,64,64) , optimization with a single multivariate network cannot be performed on a 48 GB GPU, while the proposed method converges successfully using only 12 GB, with additional reductions possible by using smaller batch sizes in the stochastic optimization. Related work Implicit neural fields have recently been explored for model - based MRI reconstruction [ 8 , 9 , 29 , 31 ] and, more broadly, for inverse problems. As in conventional reconstruction, existing approaches can be grouped into methods operating in frequency space (GRAPPA - like [ 11 ] ) and those in the spatial domain (SENSE - like [ 24 ] ). Since our formulation belongs to the latter class, we focus on spatial - domain approaches. A closely related approach is IMJENSE [ 9 ] , which represents magnetization using a neural field while modeling coil sensitivities with low - order polynomials. This design choice reflects the smoothness of coil maps, and as the authors argue, avoids high parameter counts which may make the problem too ill-posed. IMJENSE uses SIREN networks [ 30 ] , as we do, but without a tensor product structure, and its evaluation is restricted to static 2D imaging. A more recent method [ 8 ] , extends neural fields to dynamic 2D MRI. In contrast to IMJENSE, coil sensitivities are treated as precomputed discrete arrays rather than learned continuous functions. High - frequency details are captured using hash encoding [ 19 ] , which enables standard ReLU - MLPs to approximate fine structure. However, regularization remains tied to discrete formulations (e.g., low - rank constraints on Casorati matrices), and the method is not applied to higher - dimensional dynamic data. Our work differs in several fundamental aspects; the primary contribution is the introduction of a tensor product architecture of univariate neural fields. This structure replaces a single multivariate neural field and enables memory - and flop - efficient evaluation, differentiation, and integration—capabilities that are crucial for dynamic 3D