The Role and Relationship of Initialization and Densification in 3D Gaussian Splatting

Ivan Desiatov, Torsten Sattler · 2026

Read The Role and Relationship of Initialization and Densification in 3D Gaussian Splatting by Ivan Desiatov, Torsten Sattler (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-20714.txt.

Introduction

Desiatov and Sattler study how the starting point cloud shapes 3D Gaussian Splatting results. This method rebuilds scenes as sets of 3D Gaussians for new view synthesis. Most runs start from a sparse structure from motion cloud. A densification stage then grows the scene. The team tests dense versus sparse starts across growth strategies. Dense starts gave no steady visual gain with strong growth. But they helped views off the training path. They also raised geometric accuracy by a clear margin.

Catalog record

CREATORIvan Desiatov, Torsten Sattler
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE55131
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2603.20714

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

The Role and Relationship of Initialization and Densification in 3D Gaussian Splatting Ivan Desiatov, Torsten Sattler Abstract 3D Gaussian Splatting (3DGS) has become the method of choice for photo-realistic 3D reconstruction of scenes, due to being able to efficiently and accurately recover the scene appearance and geometry from images. 3DGS represents the scene through a set of 3D Gaussians, parameterized by their position, spatial extent, and view-dependent color. Starting from an initial point cloud, 3DGS refines the Gaussians’ parameters as to reconstruct a set of training images as accurately as possible. Typically, a sparse Structure-from-Motion point cloud is used as initialization. In order to obtain dense Gaussian clouds, 3DGS methods thus rely on a densification stage. In this paper, we systematically study the relation between densification and initialization. Proposing a new benchmark, we study combinations of different types of initializations (dense laser scans, dense (multi-view) stereo point clouds, dense monocular depth estimates, sparse SfM point clouds) and different densification schemes. We show that current densification approaches are not able to take full advantage of dense initialization as they are often unable to (significantly) improve over sparse SfM-based initialization. We will make our benchmark publicly available. 1 Introduction Accurately reconstructing the 3D structure of a scene from a set of images or a video stream is a long-standing problem in computer vision, with applications in cultural heritage documentation, asset generation for entertainment, and robotics ( e.g . , for path planning and navigation). The field of 3D reconstruction from images has received significant attention in the last few years due to the emergence of efficient learning-based reconstruction techniques, especially neural radiance fields (NeRFs) [ 33 ] and 3D Gaussian Splatting (3DGS) [ 20 ] . Gaussian splatting represents a scene using a collection of 3D Gaussians, each defined by a position, covariance matrix (representing anisotropic scale and orientation), opacity, and a view-dependent color function (typically modeled via spherical harmonics). 3DGS relies on an initial estimate of the Gaussian positions, typically provided by a sparse point cloud obtained from Structure-from-Motion (SfM). A crucial part of any 3DGS approach is thus a densification stage, which aims to generate more Gaussians in underrepresented areas [ 20 , 21 , 47 , 13 , 30 , 16 ] . Consequently, improving the densification stage has been a research focus [ 21 , 47 , 35 , 9 , 13 ] . In most cases, the densification strategies have been designed and evaluated on initial positions provided by sparse SfM point clouds or through random sampling. Another line of research, especially in the context of few-view reconstruction [ 12 , 51 , 43 , 31 ] , where only a few sparsely sampled images of the scene are available, has focused on improving the initialization stage of 3DGS [ 23 , 14 , 41 ] . Examples include using stereo matching [ 23 , 12 , 43 , 31 ] and neural radiance fields [ 14 ] to obtain denser point clouds as initialization for the 3D Gaussians. To the best of our knowledge, prior work has studied initialization and densification largely independently, and their interaction has not been systematically analyzed. In this work, we aim to close this gap in the literature. In particular, we are interested in answering the question whether better (dense) initialization removes the need for densification, or whether densification still provides value even in such scenarios. To this end, we design a novel benchmark to quantify the impact different initialization strategies (SfM point clouds, "ground truth" point clouds obtained by a laser scanner, and dense point clouds obtained via efficient stereo matching or from monocular depth estimates) have on the performance of 3DGS methods under different densification strategies. Besides the benchmark itself 1 1 1 We will make our evaluation protocol and all other new code and data required to replicate our results publicly available. , our main contribution is a set of insights drawn from detailed experiments on several novel view synthesis (NVS) datasets: (i) Even if accurate and dense point positions are available, densification can still improve NVS quality. Furthermore, for certain densification strategies, using dense initialization can actually degrade performance. (ii) Despite this, using dense initialization can improve generalization performance on views underrepresented in the training set. (iii) Two of the evaluated densification strategies [ 21 , 9 ] are highly insensitive to both the accuracy and density distribution of the initial set of Gaussians. Thus, with the current densification methods, initialization based on stereo matching and monocular depth can be used in practice to improve generalization, without requiring significant additional processing time. Generally, we observe that there is no densification strategy that performs best in all scenarios. (iv) Most importantly, we see little benefit in using dense initialization compared to sparse SfM point clouds. Based on our insights, two recommendations for the field emerge: (1) Practical systems should prioritize robust densification strategies over highly accurate initialization, as methods that are insensitive to initialization properties can achieve competitive results even when initialized with SfM. (2) While providing additional priors from inexpensive sources such as stereo matching or monocular depth estimates could improve generalization, we currently do not observe significant improvements. Thus, future work should not focus on initialization or densification in isolation. Rather, densification strategies should be tailored to initialization strategies. 2 Related Work The success of the original 3DGS formulation [ 20 ] has sparked significant interest in expanding and improving the method, targeting key areas such as core rendering and representation improvements [ 49 , 44 , 36 , 27 ] , the reconstruction of dynamic scenes [ 42 , 45 ] , relighting techniques [ 26 , 15 , 3 ] , feed-forward networks [ 4 , 6 , 32 ] , geometry consistent 3DGS and mesh reconstruction [ 18 , 5 , 16 , 50 ] , and hybrid neural–Gaussian models [ 30 , 40 , 24 ] . Initializing 3DGS. In this work, we focus on the relation between the initialization of the 3D Gaussian Splatting training process, and the densification stage employed to be able to initialize from sparse Structure-from-Motion (SfM) point clouds. 3DGS requires known camera intrinsics and extrinsics for the training images. These are typically computed via SfM to obtain accurate estimates, which as a side product of the estimation process produces a sparse point cloud that can be used for initialization. Hence, intialization from SfM point clouds is the de-facto standard approach, and densification strategies are typically tuned for this type of initialization. Still, there is a range of works focusing on improving the initialization, including using dense feature matching between images to obtain a dense point cloud [ 23 ] , and training a NeRF model for a short time to obtain a dense estimate of the scene geometry [ 14 ] . [ 41 ] uses an MLP to predict new gaussian positions based on the input SfM data. We compare the initialization strategy from [ 23 ] to initialization from "ground truth" laser scans and dense point clouds obtained by merging depth maps predicted by monocular depth estimators. Densifying 3DGS. The original 3DGS formulation relies on heuristics for creating new Gaussians close to existing ones and

Read the complete text