SurfFill: Completion of LiDAR Point Clouds via Gaussian Surfel Splatting

Svenja Strobel, Matthias Innmann, Bernhard Egger, Marc Stamminger, Linus Franke · 2025

Read SurfFill: Completion of LiDAR Point Clouds via Gaussian Surfel Splatting by Svenja Strobel, Matthias Innmann, Bernhard Egger, Marc Stamminger, Linus Franke (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2512-03010.txt.

Introduction

Svenja Strobel and four co-authors fill the holes that LiDAR scans leave behind. LiDAR point clouds are the gold standard in active 3D reconstruction, exact in flat regions. Scanners miss small structures, though, and fail on dark, absorbent materials that swallow the beam.

Photogrammetry from multiple photos can infer those missing details, since they often sit in feature rich regions. SurfFill completes point clouds using Gaussian surfel splatting to merge both sources. Complete scans matter for heritage preservation, construction checks, and robot maps that must not omit thin obstacles. Two eyes beat one in the field once more. What the beam skips, the lens can catch, and the blend of the two is the scan crews can sign.

Catalog record

CREATORSvenja Strobel, Matthias Innmann, Bernhard Egger, Marc Stamminger, Linus Franke
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE58 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2512-03010

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

SurfFill: Completion of LiDAR Point Clouds via Gaussian Surfel Splatting Svenja Strobel, Matthias Innmann, Bernhard Egger, Marc Stamminger, Linus Franke Abstract LiDAR-captured point clouds are often considered the gold standard in active 3D reconstruction. While their accuracy is exceptional in flat regions, the capturing is susceptible to miss small geometric structures and may fail with dark, absorbent materials. Alternatively, capturing multiple photos of the scene and applying 3D photogrammetry can infer these details as they often represent feature-rich regions. However, the accuracy of LiDAR for featureless regions is rarely reached. Therefore, we suggest combining the strengths of LiDAR and camera-based capture by introducing SurfFill: a Gaussian surfel-based LiDAR completion scheme. We analyze LiDAR capturings and attribute LiDAR beam divergence as a main factor for artifacts, manifesting mostly at thin structures and edges. We use this insight to introduce an ambiguity heuristic for completed scans by evaluating the change in density in the point cloud. This allows us to identify points close to missed areas, which we can then use to grow additional points from to complete the scan. For this point growing, we constrain Gaussian surfel reconstruction 29 to focus optimization and densification on these ambiguous areas. Finally, Gaussian primitives of the reconstruction in ambiguous areas are extracted and sampled for points to complete the point cloud. To address the challenges of large-scale reconstruction, we extend this pipeline with a divide-and-conquer scheme for building-sized point cloud completion. We evaluate on the task of LiDAR point cloud completion of synthetic and real-world scenes and find that our method outperforms previous reconstruction methods. Figure 1 : For a given LiDAR scan, we complete the point cloud by carefully integrating Gaussian surfel-based 3D reconstruction. We analyze erroneous regions and identify ambiguity in the point cloud as well as areas of high uncertainty in captured visual data. Missing structures are reconstructed with a focused 2D Gaussian Splatting technique, followed by filtering and sampling for point cloud completion. We extend this with a divide-and-conquer scheme, allowing us to process this building-scale point cloud in less than 75 minutes. † † footnotetext: *Corresponding author: {firstname.lastname}@fau.de 1 Introduction Light-based sensing via light detection and ranging (LiDAR) works by scanning the environment with rotating bundles of laser beams and measuring their time of flight. It has been the gold standard for environment and object scanning and is used as ground truth for benchmarks in many tasks related to 3D data 36 ; 78 ; 42 . Due to the LiDAR’s panoramic 360-degree field of view, LiDAR SLAM methods generate models with high global consistency and precision, even for outdoor scenes 28 . However, LiDAR point clouds still exhibit artifacts, especially in areas with small geometric structures or along silhouettes, where multiple depths appear within a LiDAR beam. Such LiDAR ambiguities result in incorrect measurements. This effect is exacerbated when the return signal is diminished or removed due to light-absorbing or reflective surfaces. Solving these failure cases may be expensive, requiring additional scans, or even manual fixing by a 3D artist. Furthermore, while errors manifest as partial, incomplete shapes, the sheer scale and resource demand of these datasets renders typical shape completion methods 90 unfeasible. In contrast, photos of the scene are inexpensive to acquire and allow common 3D reconstruction methods to match image-to-image patches for geometric reconstruction 56 . Such Multi-view Stereo (MVS) reconstructions can be very detailed, but they often exhibit holes in feature-sparse areas. As an alternative, inverse rendering methods, e.g. NeuS 64 and Neuralangelo 41 using neural implicit representations or 2D Gaussian Splatting (2DGS) 29 using Gaussian surfels, reconstruct finer geometry. However, they also suffer from artifacts in feature-sparse areas. While both directions do not reach the global precision of LiDAR scans, they perform best in feature-rich regions, e.g. along edges which are difficult for LiDAR capture. A key insight is that LiDAR scans and image-based reconstruction thus complement each other very well, as seen in the results in Fig. 1 . Consequently, this paper aims to leverage the strengths of both modalities by combining detailed LiDAR scanning in flat, feature-sparse areas with photometric 3D reconstruction along silhouettes and edges. The key problem is how to integrate photometric reconstruction with completed LiDAR scans, as we need to identify areas where the LiDAR scans are erroneous and simultaneously perform a focused reconstruction to avoid adding outliers or low-accuracy samples from the photometric reconstruction to the point cloud. Directly identifying missing scanned areas is difficult, as, for example, a four-legged table missing one leg (seen in Fig. 1 (left)) is indistinguishable from a three-legged table from the point cloud alone. However, we can identify ambiguous areas (Fig. 1 (middle), in blue), which are adjacent to possibly missing structures by analyzing the change of point density. We introduce a technique for this, which we call the ambiguity heuristic . This set of ambiguous points is then used as a starting point for reconstruction with point growing. Specifically, we introduce constraints for Gaussian surfel splatting to precisely reconstruct into missed areas. To handle ambiguous regions, we connect our heuristic to the captured 2D RGB images. For this, we estimate monocular surface normals, infer uncertainty through their 2D spatial differences and restrict reconstruction to these regions. Additionally, ambiguity guides the sampling of training views. Furthermore, we introduce a set of losses and regularizers for this focused task and integrate a filtering and sampling scheme for acquiring points from the Gaussian model. Although our optimization is focused on critical regions only, the overall size of LiDAR captured scenes can be massive and may overshoot common hardware limits. We thus extend our scheme to handle this by subdividing the scene into chunks and performing a per-chunk optimization, allowing us to optimize building-sized scans with tens of millions of LiDAR points. In summary, our contributions are as follows: • A discussion of LiDAR artifacts and formulation of region importance for completion with our ambiguity heuristic . • An integration of this heuristic into Gaussian surfel splatting for fine-detailed and focused reconstruction integrated with a filtering and sampling pipeline for new points. • A set of constraints for Gaussian surfel splatting for the reconstruction of edges and exploration of space. • Application of a divide-and-conquer technique to complete large-scale LiDAR datasets. Our evaluation shows that our method produces point completion of high accuracy, outperforming common reconstruction techniques as well as shape completion techniques. Furthermore, it is able to complete efficiently on large-scale scenes. Project page and source code are available under: https://lfranke.github.io/surffill 2 Related Work Figure 2 : High-level functionality of LiDAR and formation of mixed pixels: a) General setup: The sensor emits and receives a light ray and calculates the range via the light travel time, b) Formation of mixed pixels: The laser beam diverges during traveling and thus hits both foreground and background, resulting in a mixed range estimate, c) Raw LiDAR data example with mixed pixels shown in red. Shape Completion. Direct completion techniques on point clouds have gained prominence, with recent deep learning approaches demonstrating impressive results 13 , relying on per-point features 51 . For instance, Yu et al. 80 proposed a feature embedding and hierarchical expansion scheme to upsample point clouds, a concept further refined with GANs 40

Read the complete text