NerT-CA: Efficient Dynamic Reconstruction from Sparse-view X-ray Coronary Angiography
Kirsten W.H. Maas, Danny Ruijters, Nicola Pezzotti, Anna Vilanova · 2025
Read NerT-CA: Efficient Dynamic Reconstruction from Sparse-view X-ray Coronary Angiography by Kirsten W.H. Maas, Danny Ruijters, Nicola Pezzotti, Anna Vilanova (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2507-19328.txt.
Introduction
Doctors would like moving three-dimensional views of heart arteries from the few X-ray images taken during care. Kirsten Maas and co-authors present a method in 2025 that rebuilds the beating arteries from as few as three views. Older methods need slow manual tracing or error-prone automatic tracing of the vessels, which limits clinic use.
Their method mixes two kinds of learned fields: fast grid-based fields for the steady parts and neural fields for the moving, sparse vessels. Splitting the scene this way cut training time and raised accuracy over earlier neural approaches. Tests on realistic phantom data, with known ground truth, showed sound reconstructions. The team sees the speed gain as a step toward use in real procedures.
Catalog record
| CREATOR | Kirsten W.H. Maas, Danny Ruijters, Nicola Pezzotti, Anna Vilanova |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 21 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2507-19328
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
NerT-CA: Efficient Dynamic Reconstruction from Sparse-view X-ray Coronary Angiography Kirsten W.H. Maas, Danny Ruijters, Nicola Pezzotti, Anna Vilanova Abstract Three-dimensional (3D) and dynamic 3D+time (4D) reconstruction of coronary arteries from X-ray coronary angiography (CA) has the potential to improve clinical procedures. However, there are multiple challenges to be addressed, most notably, blood-vessel structure sparsity, poor background and blood vessel distinction, sparse-views, and intra-scan motion. State-of-the-art reconstruction approaches rely on time-consuming manual or error-prone automatic segmentations, limiting clinical usability. Recently, approaches based on Neural Radiance Fields (NeRF) have shown promise for automatic reconstructions in the sparse-view setting. However, they suffer from long training times due to their dependence on MLP-based representations. We propose NerT-CA, a hybrid approach of Neural and Tensorial representations for accelerated 4D reconstructions with sparse-view CA. Building on top of the previous NeRF-based work, we model the CA scene as a decomposition of low-rank and sparse components, utilizing fast tensorial fields for low-rank static reconstruction and neural fields for dynamic sparse reconstruction. Our approach outperforms previous works in both training time and reconstruction accuracy, yielding reasonable reconstructions from as few as three angiogram views. We validate our approach quantitatively and qualitatively on representative 4D phantom datasets. 1 Introduction X-ray coronary angiography (CA) remains the gold standard for diagnosing and treating coronary artery disease [ 6 ] . It captures the coronary arteries as a dynamic sequence of two-dimensional (2D) X-ray projections, referred to as coronary angiograms. These angiograms inherently represent four-dimensional (4D) information, as they capture the dynamic 3D motion of the coronary arteries largely induced by cardiac and respiratory motion [ 6 ] . However, since these X-rays provide only 2D projections of 3D structure, depth foreshortening occurs, which can negatively impact the perception of the vessel structure. To mitigate this, multiple coronary angiograms are acquired from different viewpoints during interventions [ 10 ] . Yet, to avoid X-ray exposure, typically no more than four views are captured [ 7 ] . A 4D reconstruction could improve CA procedures by providing a comprehensive view of the coronary arteries, aiding, for example, in catheter navigation for roadmap overlays while limiting the X-ray exposure [ 22 ] . Even though clinically relevant, the problem of 4D reconstruction from CA data remains challenging. CA data exhibits several complex properties, namely the extremely sparse-view setting, intra-scan motion, and the intricate characteristics of the blood vessel, such as structure sparsity, overlapping background structures, and contrast inhomogeneity [ 6 ] . Traditional successful reconstruction methods rely on sequences acquired from many viewpoints or time-consuming manual segmentations, not fitting clinical workflows [ 6 , 12 , 10 ] . Recent approaches utilize automatic segmentation models to reconstruct from two angiogram sequences, but suffer from noise propagated from the segmentation errors [ 11 , 1 , 32 ] . Figure 1 : NerT-CA models the dynamic CA scene as a self-supervised decomposition of low-rank and sparse components. The low-rank component is modeled by a tensorial field and the sparse component by a dynamic neural field. Approaches building on Neural Radiance Fields (NeRFs) [ 19 ] have been proposed, which directly reconstruct from the x-ray images, avoiding reliance on segmentation models [ 17 , 16 ] . NeRFs are powerful for 3D and 4D reconstruction by learning individual continuous scenes from a limited number of projections [ 19 , 30 ] . Most notably, NeRF-CA [ 17 ] recently demonstrated reasonable reconstructions from four synthetic coronary angiograms exhibiting cardiac motion. They decompose the CA scene into a static and dynamic component, each modeled by a multi-layer perceptron (MLP). While significantly outperforming state-of-the-art X-ray NeRF-based techniques in reconstruction quality, their method suffers from hour-long training times. Meanwhile, many acceleration methods for general NeRFs have been proposed [ 31 , 5 ] , which could potentially be leveraged to accelerate NeRF-CA. For example, Tensorial Radiance Field (TensoRF) [ 5 ] models scenes through fast tensorial decompositions [ 15 ] , which has been shown beneficial to replace MLP-based representations in medical settings [ 29 ] , but are not directly applicable to the CA setting. Inspired by these developments, we present NerT-CA, a hybrid approach of Neural and Tensorial representations that efficiently reconstructs dynamic CA scenes from as few as three coronary angiogram views. Building on the foundation of NeRF-CA, we decompose the CA scene into static and dynamic components. In contrast, we extend this decomposition by applying low-rank and sparse decomposition constraints [ 9 ] , utilizing a combination of neural and tensorial representations with tailored regularizations. Specifically, the low-rank component is modeled as an efficient tensorial field with smoothness regularization. Concurrently, the sparse component is represented as a dynamic neural field, where we impose specific regularization for the sparse-view setting. Not only does this approach gain a significant speed-up, but we also show that it benefits reconstruction quality in the sparse-view setting, outperforming NeRF-CA and state-of-the-art X-ray reconstruction techniques. We evaluate our work quantitatively and qualitatively using representative 4D phantoms [ 26 , 24 ] . 2 Method NerT-CA is built on top of NeRF-CA [ 17 ] , a method that utilizes static and dynamic decomposition to reconstruct synthetic CA scenes with four coronary angiograms that exhibit cardiac motion. We propose a hybrid approach, combining fast tensorial fields [ 5 ] with dynamic neural fields [ 19 , 21 ] , to accelerate this method while improving reconstruction quality. Figure 1 provides an overview of NerT-CA. We will detail each element in the next sections. The total loss function is given by \mathcal{L}=\mathcal{L}_{p}+\lambda_{TV}\mathcal{L}_{TV}+\lambda_{o}\mathcal{L}_{o}, where \mathcal{L}_{p} , \mathcal{L}_{TV} , and \mathcal{L}_{o} are the photometric, total variation (TV), and occlusion minimization losses, respectively, with their according weights \lambda_{TV} and \lambda_{o} . Compared to NeRF-CA, this loss term is simplified by removing several regularization techniques, but introducing the \mathcal{L}_{TV} term enabled by the tensorial field. 2.1 Neural and Tensorial Representations Neural Radiance Fields (NeRFs) encode a continuous scene through a multilayer perceptron (MLP) [ 19 ] . For the X-ray setting [ 25 ] , NeRF-CA learns a function \mathcal{F}_{\Theta}(\boldsymbol{x})=\sigma , where \boldsymbol{x}\in\mathbb{R}^{3} is a 3D spatial coordinate, \sigma is the attenuation coefficient, and \Theta represents the weights of the MLP. To model high-frequency details, NeRF-CA applies positional encoding \gamma to map inputs to a higher-dimensional space, a common approach in NeRFs [ 27 , 19 ] . A dynamic scene is modeled as \mathcal{D}_{\Theta}(\boldsymbol{x},\tau_{i})=\sigma , where a learnable time latent-code \tau_{i} represents each unique time i in the scene [ 21 ] . In NeRF-CA and our method, \tau_{i} represents discrete cardiac phases i\in{1,\dots,T} extracted from an ECG signal, as illustrated in Figure 1 . While powerful for high-fidelity scene reconstruction, NeRF-CA, like other NeRF architectures [ 20 ] , suffers from high computational costs due to the dense sampling of 3D points needed to be evaluated by the MLP. Tensorial Radiance Field (TensoRF) addresses the computational costs by introducing an explicit volumetric representation of the attenuation field [ 5 ] . Instead of utilizing MLPs, TensoRF decomposes the volumetric space using low-rank tensor decomposition [ 15 ] . The 3D volume is represented as a tensor \mathcal{G}\in\mathbb{R}^{D\times D\times D} , where D represents the resolution of the grid in the dimensions X,Y, and Z . TensoRF