Accurate Surface and Reflectance Modelling from 3D Radar Data with Neural Radiance Fields

Judith Treffler, Vladimír Kubelka, Henrik Andreasson, Martin Magnusson · 2026

Read Accurate Surface and Reflectance Modelling from 3D Radar Data with Neural Radiance Fields by Judith Treffler, Vladimír Kubelka, Henrik Andreasson, Martin Magnusson (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-25623.txt.

Introduction

Treffler and co-authors build 3D maps from radar data with a neural implicit method. Radar works well in fog, smoke, and dust, but its point clouds are sparse and noisy. Their method learns a signed distance field for the surfaces. It also learns how radar reflections depend on the viewing angle. A compact hybrid encoding keeps memory use low. The authors report smoother and more accurate surfaces than lidar-based methods applied to radar. The method also holds up as point clouds grow sparser.

Catalog record

CREATORJudith Treffler, Vladimír Kubelka, Henrik Andreasson, Martin Magnusson
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE34279
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2603.25623

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Accurate Surface and Reflectance Modelling from 3D Radar Data with Neural Radiance Fields Judith Treffler, Vladimír Kubelka, Henrik Andreasson, Martin Magnusson Abstract Robust scene representation is essential for autonomous systems to safely operate in challenging low-visibility environments. Radar has a clear advantage over cameras and lidars in these conditions due to its resilience to environmental factors such as fog, smoke, or dust. However, radar data is inherently sparse and noisy, making reliable 3D surface reconstruction challenging. To address these challenges, we propose a neural implicit approach for 3D mapping from radar point clouds, which jointly models scene geometry and view-dependent radar intensities. Our method leverages a memory-efficient hybrid feature encoding to learn a continuous Signed Distance Field (SDF) for surface reconstruction, while also capturing radar-specific reflective properties. We show that our approach produces smoother, more accurate 3D surface reconstructions compared to existing lidar-based reconstruction methods applied to radar data, and can reconstruct view-dependent radar intensities. We also show that in general, as input point clouds get sparser, neural implicit representations render more faithful surfaces, compared to traditional explicit SDFs and meshing techniques. I Introduction Accurate and reliable representations of the environment are essential for autonomous systems, particularly in low-visibility conditions. However, classical explicit mapping approaches often struggle with sparse or noisy data. In the last few years, neural implicit scene representations, such as Neural Radiance Fields (NeRF) [ 17 ] , have become a widely adopted framework for 3D mapping [ 10 , 35 , 24 ] . Unlike explicit representations, which employ fixed spatial data structures, neural methods implicitly represent the surface structure with a neural network and trainable features, enabling maps with improved surface reconstruction at arbitrary resolutions. Still, the majority of these methods focus on camera or lidar data and might fail in low-visibility environments. Radar, with its ability to penetrate clouds of small particles such as fog, smoke, or dust with minimal attenuation, is a promising alternative. The view-dependent intensities and reflections of radar data can provide valuable information for localisation and scene understanding. However, radar also introduces additional challenges, as the noisy data – particularly multi-path reflections – makes accurate modelling more difficult. Despite its potential, radar-based neural implicit scene representations have remained unexplored until recently. Existing methods focus on 2D novel view synthesis (NVS) with limited 3D reconstruction [ 3 , 9 , 34 ] , perform NVS of 3D radar point clouds via projections to 2D range maps [ 22 ] , or can only model radar jointly with camera and lidar [ 21 ] . To the best of our knowledge, no prior work has reconstructed 3D surfaces from radar point clouds while modelling view-dependent radar intensities. Figure 1 : Accurate surface reconstruction (right) produced by 3QFPI from a set of 3D radar point clouds (left) from the Radar Forest dataset. The mesh is coloured according to surface normals. In this paper, we propose a neural implicit approach for 3D mapping from radar point clouds that offers both accurate surface reconstruction and modelling of view-dependent intensities. We base our method on the memory-efficient 3QFP representation, designed for dense lidar point clouds [ 24 ] , and learn a Signed Distance Field (SDF) for surface reconstruction directly from 3D radar data. Inspired by the architecture of NeuS2 [ 29 ] , we introduce an intensity network that models view-dependent radar intensities, enabling our method to learn both geometric and reflective aspects from radar data. This network can implicitly account for sensor-specific constants of the radar equation, such as transmitted power and antenna gain. We further analyse the impact of the components of the NeuS2 architecture on the intensity reconstruction quality when applied to radar data. Our main contributions are as follows: • A memory-efficient learnable radar reflectivity model that accounts for surface geometry and view-dependent backscatter, improving reconstruction quality and robustness in low-visibility and feature-poor environments. • An evaluation of 3D reconstruction methods on two radar sensors with different noise characteristics. • A discussion on metrics for assessing radar-based environment modelling. As our experiments demonstrate, our approach produces more accurate surface reconstructions with smoother locally planar regions from radar data, compared to both classical explicit methods and recent neural representations, while also predicting realistic view-dependent radar intensities across varying viewing angles. II Related Work 3D mapping has traditionally relied on explicit scene representations, such as occupancy grids [ 7 , 12 ] , surfels [ 1 , 27 ] , meshes [ 5 , 2 , 11 , 25 , 6 ] or Truncated Signed Distance Field (TSDF) values [ 19 , 26 ] . These discretised spatial representations often face challenges with scalability, memory inefficiency at high resolutions, and reconstruction of fine details or unobserved areas. In the last few years, neural implicit methods have gained popularity. In contrast to explicit approaches, they use multi-layer perceptrons (MLP) to learn a continuous scene representation, enabling reconstruction at different resolutions, improved completion, and more robustness to sparse input data. The seminal work introducing Neural Radiance Fields (NeRF) [ 17 ] learns a volumetric scene representation from 2D images. While intended for novel view synthesis, scene geometry can be extracted via volume rendering; however, since surface geometry is inferred from the volume density field, high-quality surface extraction remains challenging, and often results in noisier reconstructions. To learn surface representations more directly, several approaches learn implicit occupancy fields [ 15 , 18 , 32 ] or signed distance functions [ 33 ] . In particular, NeuS [ 28 ] and its extension NeuS2 [ 29 ] combine volume rendering with an SDF and use a separate network to model view-dependent components. Beyond camera-based methods, SHINE-Mapping [ 35 ] and 3QFP [ 24 ] learn an SDF from lidar data. SHINE-Mapping uses an octree-based data structure to store learnable features. Building on this, 3QFP reduces the memory usage while maintaining the reconstruction quality by replacing octrees with more efficient tri-quadtrees and using Fourier feature positional encoding. Neural implicit scene representations have further been applied to other sensors, including ultrasound [ 30 ] , sonar [ 20 , 31 ] , or synthetic aperture radar (SAR) [ 13 , 23 ] . Most neural implicit reconstruction methods focus on RGB, RGB-D, lidar, or combinations thereof and might fail in low-visibility environments. While several advances have been made to overcome these challenges [ 16 , 4 ] , radar offers an inherently more robust solution. Its longer wavelength enables radar signals to penetrate clouds of small particles (dust, smoke, fog, etc.) with little attenuation, making it well-suited for low-visibility conditions without specialised correction techniques. For autonomous systems, two types of mmWave radar sensors are commonly used: spinning radars that capture 2D polar images, or system-on-a-chip (SoC) radars that generate 3D radar data cubes with an additional velocity dimension, often referred to as 3+1D or 4D radar. Despite these advantages, the sparse and noisy nature of radar data poses challenges for neural implicit representations, which have only recently been explored. Initial work with 2D radars consists of DART [ 9 ] , which performs NVS on range-Doppler radar images. Radar Fields [ 3 ] and RF4D [ 34 ] perform NVS and 3D mapping from 2D radar data, and thus

Read the complete text