DenseSplat: Densifying Gaussian Splatting SLAM with Neural Radiance Prior

Mingrui Li *, Shuhong Liu *, Tianchen Deng, Hongyu Wang · 2025

Read DenseSplat: Densifying Gaussian Splatting SLAM with Neural Radiance Prior by Mingrui Li *, Shuhong Liu *, Tianchen Deng, Hongyu Wang (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2502-09111.txt.

Introduction

Mingrui Li, Shuhong Liu, Tianchen Deng, and Hongyu Wang present DenseSplat in two thousand twenty-five. Gaussian splatting SLAM maps a scene and tracks the camera at once. It renders fast and rebuilds fine detail well. But it leans on many keyframes, which real robots rarely have.

Sparse views leave big holes in the map as a result. DenseSplat seeds splats from a neural radiance prior to fill gaps. Sampling and pruning steps tuned to geometry keep the map lean. Loop closure and bundle adjustment sharpen tracking as well. Tests on large data sets beat top rivals on both tasks.

Catalog record

CREATORMingrui Li *, Shuhong Liu *, Tianchen Deng, Hongyu Wang
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE58 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2502-09111

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

DenseSplat: Densifying Gaussian Splatting SLAM with Neural Radiance Prior Mingrui Li *, Shuhong Liu *, Tianchen Deng, Hongyu Wang Abstract Gaussian SLAM systems excel in real-time rendering and fine-grained reconstruction compared to NeRF-based systems. However, their reliance on extensive keyframes is impractical for deployment in real-world robotic systems, which typically operate under sparse-view conditions that can result in substantial holes in the map. To address these challenges, we introduce DenseSplat, the first SLAM system that effectively combines the advantages of NeRF and 3DGS. DenseSplat utilizes sparse keyframes and NeRF priors for initializing primitives that densely populate maps and seamlessly fill gaps. It also implements geometry-aware primitive sampling and pruning strategies to manage granularity and enhance rendering efficiency. Moreover, DenseSplat integrates loop closure and bundle adjustment, significantly enhancing frame-to-frame tracking accuracy. Extensive experiments on multiple large-scale datasets demonstrate that DenseSplat achieves superior performance in tracking and mapping compared to current state-of-the-art methods. I Introduction Visual Dense Simultaneous Localization and Mapping (SLAM) is a core area of study in 3D computer vision, focusing on real-time localization of the camera and generating a fine-grained map of the surrounding environment. It plays a crucial role in robot localization and navigation, autonomous vehicles, and Virtual/Augmented Reality (VR/AR). Recent breakthroughs in differential rendering, specifically with Neural Radiance Fields (NeRF) [ 1 , 2 , 3 ] and 3D Gaussian Splatting (3DGS) [ 4 , 5 , 6 ] , have significantly advanced visual dense SLAM systems [ 7 , 8 , 9 , 10 , 11 , 12 ] . NeRF-based neural implicit SLAM [ 13 , 14 , 15 , 16 , 17 ] integrates the NeRF model for simultaneous tracking and mapping, which facilitates high-quality, dense online map reconstruction and remarkably improves geometric accuracy. Building on this, Gaussian-based SLAM systems [ 18 , 19 , 20 , 21 , 22 , 23 , 24 ] have pushed the boundaries by delivering higher-fidelity map reconstruction. By utilizing explicit Gaussian primitives, 3DGS provides substantial benefits in terms of detailed texture representation [ 19 ] , explicit scene manipulation [ 25 ] , and remarkable real-time rendering capabilities [ 24 ] . Fig. 1: DenseSplat leverages NeRF priors into the Gaussian SLAM system, offering superior tracking, fine-grained mapping, and extraordinary real-time performance using sparse keyframes. However, 3DGS faces particular challenges within the context of SLAM systems. Unlike offline reconstruction often applied to exhaustive image collections [ 26 , 14 , 27 ] , online SLAM systems are typically deployed in complex environments with insufficient observations, leading to partially observed or obstructed views. This shortage significantly affects the completeness of the Gaussian map, as it struggles to effectively interpolate missing geometry of unobserved areas. Moreover, current Gaussian SLAM systems rely on per-frame pixel backprojection from the input stream, which fails to capture the 3D structure of the scene. Such 2D-based initialization results in a map representation where foreground elements are detailed with denser primitives, while the backgrounds, encompassing broader scene geometries, are less defined. Figure 2 illustrates these limitations, where imbalanced point distribution, erroneous depth projection, and undersampling due to occlusions lead to an uneven and challenging optimization landscape for multiview geometry [ 28 ] . Given these limitations, current Gaussian SLAM systems often maintain a dense keyframe list, such as one in every four frames, during the mapping process that attempts to engage more viewpoints for reliable map optimization [ 29 ] . This reliance on a dense keyframe list demands extensive memory and reduces real-time processing capabilities, both of which are crucial for online SLAM systems. Fig. 2: Gaussian primitives initialized by direct backprojection from RGB-D streams suffer from several drawbacks. The left pixel image illustrates that closer objects occupy more pixels, whereas farther regions receive fewer rays. (a) Imbalanced point sampling occurs due to the uneven distribution of rays. (b) Erroneous projections arise from inaccurate depth estimates in distant regions. (c) Undersampled areas result from occlusions or insufficient views. To address these challenges, we propose employing NeRF priors to densify the Gaussian SLAM system. This densification is achieved through two primary mechanisms using the NeRF model: (1) its interpolation capabilities efficiently close the gaps in the map with densely positioned Gaussian primitives, and (2) it offers a robust initialization of Gaussian primitives that can be densified using extremely sparse keyframes. Moreover, NeRF-based sampling ensures an even distribution of Gaussian primitives aligned with the scene geometry and allows for manageable granularity in the scene representation through specific sampling ratios. Coupled with loop closure and bundle adjustment (BA), our method delivers state-of-the-art performance across large-scale synthetic and real-world datasets as illustrated in Figure 1 . Overall, our contributions can be summarized as follows: • We propose DenseSplat, the first SLAM system combining the advantages of NeRF and 3DGS, capable of real-time tracking, mapping, and loop correction using only sparsely sampled keyframes. • By leveraging NeRF priors, DenseSplat effectively fills the gaps from unobserved or obstructed viewpoints. • We implement geometry-aware primitive sampling and pruning strategies that control the granularity of the Gaussian representation and prune inactive primitives, ensuring a high-fidelity map and real-time processing. • We compare our method with state-of-the-art (SOTA) approaches on multiple datasets, including a challenging large-scale apartment dataset, where DenseSplat achieves superior performance. II Related Work II-A Neural Dense SLAM In contrast to traditional SLAM systems [ 30 , 31 , 32 , 33 , 34 , 35 , 36 ] that utilize point-clouds or voxels for sparse map representation, neural dense SLAM systems [ 37 , 38 , 39 , 40 , 41 , 42 , 43 , 44 , 45 , 46 ] offer substantial advantages through their dense neural radiance maps, providing a robust foundation for downstream tasks in robotics and AR/XR [ 47 ] . iMAP [ 48 ] pioneered neural implicit SLAM but suffers from large tracking and mapping error using a single MLP. NICE-SLAM [ 49 ] employs multiple MLPs for coarser-to-finer mapping, effectively filling the gaps in reconstruction. ESLAM [ 50 ] leverages tri-plane features for efficient scene representation, while Co-SLAM [ 51 ] employs multi-resolution hash-grids for real-time performance. Point-SLAM [ 52 ] relies on neural point clouds for dense scene reconstruction, and Loopy-SLAM [ 53 ] introduces map corrections to address scene drift caused by accumulated tracking errors. However, maps reconstructed using NeRF typically lack the quality seen in more recent systems built upon 3D Gaussian Splatting. Furthermore, high-resolution NeRF models often require extensive training and exhibit slower real-time rendering performance [ 4 ] , which significantly reduces their practical efficiency. II-B Gaussian Splatting SLAM Propelled by advancements in 3DGS [ 4 ] , recent Gaussian SLAM systems [ 18 , 29 , 25 , 24 , 54 ] have shown remarkable capabilities in high-fidelity map reconstruction and efficient real-time rendering. Notably, SplaTAM [ 19 ] utilizes isotropic Gaussian representation coupled with dense point-cloud sampling to ensure geometric precision. Conversely, MonoGS [ 20 ] employs anisotropic Gaussians to accelerate map reconstruction and enhance texture rendering. Nevertheless, the frame-to-frame tracking mechanisms of these systems do not incorporate loop closure or bundle adjustment, which leads to significant tracking discrepancies in real-world environments. Concurrently, Photo-SLAM [ 21 ] and RTG-SLAM [ 22 ] , which integrate feature-based

Read the complete text