Gaussian RBFNet: Gaussian Radial Basis Functions for Fast and Accurate Representation and Reconstruction of Neural Fields
Abdelaziz Bouzidi, Hamid Laga, Hazem Wannous · 2025
Read Gaussian RBFNet: Gaussian Radial Basis Functions for Fast and Accurate Representation and Reconstruction of Neural Fields by Abdelaziz Bouzidi, Hamid Laga, Hazem Wannous (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2503-06762.txt.
Introduction
Abdelaziz Bouzidi and co-authors build Gaussian Neural Fields, a compact way to store signals such as images, shapes, and light fields. Neural fields map coordinates to signal values, but high quality has needed wide, deep networks that train and run slowly. Their 2025 paper swaps the heavy network for a single layer of Gaussian kernels acting in a learned feature space.
A learned grid of features feeds the Gaussian layer, which decodes the signal as a smooth continuous function. The design covers color images, signed distance shapes, and radiance fields in one frame. It avoids the memory trades and thousands of fitted parts that slow rival methods. Graphics researchers get a neural field that stays smooth, small, and quick to fit.
Catalog record
| CREATOR | Abdelaziz Bouzidi, Hamid Laga, Hazem Wannous |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 42 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2503-06762
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Gaussian RBFNet: Gaussian Radial Basis Functions for Fast and Accurate Representation and Reconstruction of Neural Fields Abdelaziz Bouzidi, Hamid Laga, Hazem Wannous Abstract Neural fields such as DeepSDF and Neural Radiance Fields have recently revolutionized novel-view synthesis and 3D reconstruction from RGB images and videos. However, achieving high-quality representation, reconstruction, and rendering requires deep neural networks, which are slow to train and evaluate. Although several acceleration techniques have been proposed, they often trade off speed for memory. Gaussian splatting-based methods, on the other hand, accelerate the rendering time but remain costly in terms of training speed and memory needed to store the parameters of a large number of Gaussians. In this paper, we introduce a novel neural representation that is fast, both at training and inference times, and lightweight. Our key observation is that the neurons used in traditional MLPs perform simple computations (a dot product followed by ReLU activation) and thus one needs to use either wide and deep MLPs or high-resolution and high-dimensional feature grids to parameterize complex nonlinear functions. We show in this paper that by replacing traditional neurons with Radial Basis Function (RBF) kernels, one can achieve highly accurate representation of 2D (RGB images), 3D (geometry), and 5D (radiance fields) signals with just a single layer of such neurons. The representation is highly parallelizable, operates on low-resolution feature grids, and is compact and memory-efficient. We demonstrate that the proposed novel representation can be trained for 3D geometry representation in less than 15 15 seconds and for novel view synthesis in less than 15 15 mins. At runtime, it can synthesize novel views at more than 60 60 fps without sacrificing quality. Our code is available at https://grbfnet.github.io/ . I Introduction In recent years, neural fields have gained in popularity for their ability to accurately represent multidimensional signals such as RGB images and videos [ 1 , 2 ] , 3D geometry [ 3 , 4 ] , and radiance fields [ 5 , 4 ] . Compared to traditional discrete signal representations, neural fields use Multi-Layer Perceptrons (MLP) to learn a mapping from a continuous input, e.g., a 2D point p\in\mathbb{R}^{2} , a 3D point p\in\mathbb{R}^{3} , or a 3D point and a viewing direction \textbf{v}\in\mathbb{S}^{2} , to the corresponding output value such as RGB color, SDF value or volume density, and radiance. This efficient formulation has achieved state-of-the-art results in applications such as 3D reconstruction, neural rendering and novel view synthesis, virtual (human and animal) avatar reconstruction and generation, and many more. Despite their performance, neural fields are very slow to train ( e.g., traditional NeRF can take hours to train on a single scene) and evaluate, and are expensive in terms of memory requirements. Although several acceleration techniques have been proposed, they either focus on accelerating the inference stage [ 6 , 7 , 8 ] or trade speed for memory [ 7 , 9 ] . For instance, methods such as Plenoxels [ 7 ] and InstantNGP [ 9 ] achieve fast training but result in a significant memory footprint for storing the feature grids and network parameters. On the other hand, 3D Gaussian Splatting (3DGS)-based methods [ 10 ] , which are explicit representations, achieve realtime rendering performance by parameterizing the radiance field using 3D Gaussians instead of MLPs. These methods, however, require a large number of Gaussians to accurately represent 3D scenes, which makes them expensive in terms of memory requirements. Also, although they are very fast at runtime, they can still require hours to train per scene. In this work, we propose a novel neural representation that is compact, memory-efficient, and fast to train and evaluate without sacrificing quality or memory. Our key observation is that the neurons used in MLP-based neural fields perform simple computations: a dot product followed by an activation function, usually ReLU. Thus, to parameterize complex functions, one needs to stack multiple layers of such neurons, leading to wide and deep MLPs that have a large number of parameters. Thus, they are difficult and time-consuming to train and evaluate. In this paper, we show that by letting the neurons perform slightly more than just a dot product, we can significantly reduce the depth and width of the network used in neural field representations. In particular, we propose a novel architecture composed of a single layer of a small number of Radial Basis Function kernels that decode a low-resolution feature grid. We show that this compact representation is sufficient to accurately represent multidimensional signals such as RGB images, 3D geometry, and radiance fields. More importantly, it can be trained, on a desktop PC equipped with an NVIDIA GEFORCE RTX4090 GPU, in less than 15 secs for 3D geometry representation and in less than 15 mins for novel view synthesis. At runtime, it can render novel views at more than 60 fps without sacrificing quality. The remaining parts of the paper are organized as follows; Section II reviews the state-of-the-art. Sections III , IV , V , and VI describe in detail the proposed framework. Sections VII presents the results and analyzes the performance of the proposed framework. Section VIII summarizes the main findings of the paper and discusses its limitations and avenues for future research. II Related Work We refer the reader to recent comprehensive surveys of the state-of-the-art on neural fields [ 11 ] and 3D Gaussian Splatting [ 12 ] . Here, we focus on the papers that are closely related to our work. Neural fields Neural fields use MLPs to represent signals such as 2D images [ 9 , 13 , 14 ] , SDF values [ 15 , 16 , 3 , 4 ] , and radiance fields [ 5 ] as continuous functions. While powerful, these methods require querying deep and wide MLPs – often composed of dozens of layers and thousands of neurons – millions of times, both during training and at runtime. As such, training scene-specific neural fields can take hours or days for each scene. Several methods have been proposed to accelerate the training and inference of neural fields. In particular, feature grid-based neural fields [ 9 ] significantly improve inference time by shifting most of the computation burden to the features and then using shallow MLPs to decode them into geometry and appearance. However, they are very expensive in terms of memory requirement, as the space required to store the features exceeds that of the network parameters. Some methods improve the computation time by reducing the number of forward passes through early ray termination [ 17 , 18 ] or efficient surface localization [ 19 , 20 , 21 , 22 , 18 , 17 , 6 , 23 , 7 ] . Others employ baking strategies by precomputing and storing some content in sparse 3D data structures [ 24 , 25 , 26 , 27 ] . PlenOctrees [ 23 ] , on the other hand, represent view-dependent effects as a weighted sum of Spherical Harmonic (SH) basis, parameterized by the viewing direction. The view-dependent color can then be computed in a single forward pass. Plenoxels [ 23 ] follows the same idea but drops entirely the MLPs and represents a scene as a sparse 3D grid