DensifyBeforehand: LiDAR-assisted Content-aware Densification for Efficient and Quality 3D Gaussian Splatting

Phurtivilai Patt, Leyang Huang, Yinqiang Zhang, Yang Lei · 2025

Read DensifyBeforehand: LiDAR-assisted Content-aware Densification for Efficient and Quality 3D Gaussian Splatting by Phurtivilai Patt, Leyang Huang, Yinqiang Zhang, Yang Lei (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2511-19294.txt.

Introduction

Phurtivilai Patt, Leyang Huang, Yinqiang Zhang, and Yang Lei improve three-dimensional Gaussian splatting by densifying the scene before optimisation starts. Standard splatting grows its points adaptively during training, which can leave floating artefacts and waste resources on redundant blobs. Their method combines sparse LiDAR measurements with depth estimates from matching photos to build a dense starting cloud, using a sampling scheme that favours regions important in meaning or geometry.

Starting dense lets the optimisation skip adaptive density control entirely and focus on the other attributes of each blob, reducing overlap while raising visual quality. The authors report results comparable to leading techniques with significantly lower cost. For scanning teams with a LiDAR unit at hand, the approach promises cleaner scenes for less compute.

Catalog record

CREATORPhurtivilai Patt, Leyang Huang, Yinqiang Zhang, Yang Lei
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE32 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2511-19294

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

DensifyBeforehand: LiDAR-assisted Content-aware Densification for Efficient and Quality 3D Gaussian Splatting Phurtivilai Patt, Leyang Huang, Yinqiang Zhang, Yang Lei Abstract This paper addresses the limitations of existing 3D Gaussian Splatting (3DGS) methods, particularly their reliance on adaptive density control, which can lead to floating artifacts and inefficient resource usage. We propose a novel “densify beforehand” approach that enhances the initialization of 3D scenes by combining sparse LiDAR data with monocular depth estimation from corresponding RGB images. Our ROI-aware sampling scheme prioritizes semantically and geometrically important regions, yielding a dense point cloud that improves visual fidelity and computational efficiency. This “densify beforehand” approach bypasses the adaptive density control that may introduce redundant Gaussians in the original pipeline, allowing the optimization to focus on the other attributes of 3D Gaussian primitives, reducing overlap while enhancing visual quality. Our method achieves comparable results to state-of-the-art techniques while significantly lowering resource consumption and training time. We validate our approach through extensive comparisons and ablation studies on four newly collected datasets, showcasing its effectiveness in preserving regions of interest in complex scenes. Keywords: 3DGS, adaptive density control, ROI-aware sampling, point cloud generation, visual quality, resource efficiency 1 Introduction Neural Radiance Fields [ 18 , 1 ] that can render novel view images of a scene have attracted increasing research interest. Among all relevant works, 3D Gaussian Splatting (3DGS) [ 14 ] uses the sparse points from structure-from-motion (SfM) [ 22 ] when tracking the camera poses of the input multi-view images to initialize a 3D scene and employs a point-based approach that drastically speeds up the rendering efficiency, paving the way for various computer vision and robotic applications. Based on this recent breakthrough, recent works [ 13 , 17 , 11 , 9 , 15 , 23 ] accompany the RGB camera with a ranging sensor (e.g., RGB-Depth cameras or LiDAR device) to utilize 3DGS for simultaneous localization and mapping (SLAM) and fast or large-scale scene reconstruction. Compared to using the sparse point cloud produced by SfM, LiDAR sensors can provide a readily measurable point cloud for many downstream tasks, such as construction inspection or progress monitoring [ 25 ] . Figure 1: Our performance comparing to other SOTA methods on wetlab dataset (a) and corner dataset (b). Our method can achieve comparable performance in terms of rendering quality and use fewer Gaussians to represent the same scene. With the increasing accessibility of miniaturized LiDAR sensors on personal mobile devices [ 2 ] , such as the iPhone Pro series, a promising application would be how to use the miniaturized LiDAR sensor to facilitate modeling a scene with 3DGS. Despite their advantages of being accessible and less sensitive to lighting conditions (compared to RGB-Depth cameras), miniaturized LiDAR sensors usually provide very sparse ranging data [ 21 , 3 ] and are with a limited ranging distance, thereby restricting their performance in modeling complex 3D scenes, particularly in regions with fine details or thin objects. Previous LiDAR-based works optimize their 3DGS scenes with the adaptive density control (ADC) strategy proposed in [ 14 ] to grow Gaussian primitives by cloning, splitting, and pruning. However, ADC faces several limitations, such as floating artifacts [ 26 ] and an excessive number of Gaussian primitives [ 7 ] , as discussed in Sec. 2 , potentially compromising the overall visual fidelity. In this paper, we aim to propose a novel, streamlined approach to 3DGS scene representation. This approach takes as input from a consumer-grade mobile device: 1) the tracked poses of the device, 2) sparse point clouds by a miniaturized LiDAR sensor, and 3) high-resolution RGB images captured by an RGB camera. As shown in Fig. 2 , it then resorts to the monocular depth estimation (MDE) approach (e.g., [ 10 ] ) for initial point cloud densification. This “densify-beforehand” approach uses a (nearly) constant number of Gaussian primitives from the initialization, offering a practical controllability of the optimization process. It also achieves high-quality rendering results without using several million Gaussian primitives, yielding a resource-aware and efficient implementation by leveraging LiDAR input. We prioritize computational resources by defining the regions of interest (ROI) in the RGB images (such as texture-rich regions or foreground objects and texts/signs) while downsampling other regions. This yields a dense point cloud to represent the ROIs in the given scene. As we will show in our results, our method can model a scene with 3DGS using a much smaller number of Gaussian primitives yet achieving a comparable rendering quality. Comparison with state-of-the-art methods shows that our “densify-beforehand” approach can achieve results comparable to the adaptive density control of the original 3DGS [ 14 ] or an improved version proposed in Pixel-GS [ 26 ] in terms of visual quality, while drastically reducing resource consumption in terms of the final number of Gaussians and training time. We also compare our method with Taming 3DGS [ 16 ] and LightGaussian [ 8 ] to demonstrate our effectiveness in a resource-constrained set-up. Ablation studies are conducted to validate our design choices. Furthermore, our MDE-based densification pipeline generates dense point clouds comparable to those produced by depth sensors, validating its effectiveness. We collected six new datasets featuring scenes with thin geometry objects and rich textual content, to validate the proposed method. We also showcase some applications where our reconstructed scenes can preserve regions of interest specified by users (such as using a verbal description). In summary, our technical contributions are: 1) A novel offline, content-aware densification approach that bypasses the adaptive density control in the existing 3DGS pipeline. 2) A practical strategy that leverages sparse LiDAR points to refine the monocular depth estimation results for 3DGS scene representation. 3) Six datasets demonstrating a diverse range of appearances captured using a camera and a miniaturized LiDAR sensor. 2 Related works LiDAR-assisted 3DGS. The accessibility of LiDAR sensors and recent progress in multi-sensor fusion [ 27 , 9 ] lead to increasing adoption of visual-LiDAR systems in reconstructing 3D scenes [ 9 , 15 , 23 , 6 ] . In contrast to these previous works that utilize high-end LiDAR sensors, our method focuses on a miniaturized LiDAR equipped on a commodity-grade mobile device. Since a miniaturized LiDAR sensor produces a very sparse point cloud, we propose to leverage the recent advancement in monocular depth estimation (MDE), such as [ 10 , 24 , 5 ] to name just a few, to densify the sparse LiDAR point cloud. We show that this approach can bypass the error-prone yet expensive adaptive density control, allowing our method to achieve SOTA performance in terms of both visual quality and efficiency. Adaptive Density Control. Original 3DGS employs adaptive density control to grow the 3D scene initialized from SfM. However, this adaptive density control strategy suffers from several limitations that may yield blurry rendered images of the scene. Large Gaussian primitives can be produced due to the sparse, unevenly distributed initial points produced by SfM. Pixel-GS [ 26 ] addresses this limitation by taking into account the number of pixels a Gaussian primitive covers in each view in the optimization. This weighted average formulation encourages the point growth in regions covered by large Gaussian primitives, thus avoiding the blurry results due to the presence of large

Read the complete text