ActiveInitSplat: How Active Image Selection Helps Gaussian Splatting
Konstantinos D. Polyzos 1 *, Athanasios Bacharis 2 *, Saketh Madhuvarasu 1 , Nikos Papanikolopoulos 2 , Tara Javidi 1 1 University of California San Diego 2 University of Minnesota * Authors declare equal contribution · 2025
Read ActiveInitSplat: How Active Image Selection Helps Gaussian Splatting by Konstantinos D. Polyzos 1 *, Athanasios Bacharis 2 *, Saketh Madhuvarasu 1 , Nikos Papanikolopoulos 2 , Tara Javidi 1 1 University of California San Diego 2 University of Minnesota * Authors declare equal contribution (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2503-06859.txt.
Introduction
Konstantinos Polyzos and co-authors pick training shots with care for 3D scene builds in a 2025 paper. Gaussian splatting paints a scene from many soft blobs, fit from flat shots. Shot pick sets the fit, yet past work grabs dense shots with no plan. Their frame, ActiveInitSplat, picks shots by how well they seed the scene. Density and fill grades flag shots that span wide views and match the true form.
Tests on fake and real scenes back the craft. Fit scores beat dense-shot base builds in both rich and thin shot sets. Three grades of image truth all rose. The team say smart picks beat brute bulk for scene builds. The frame costs no extra shots, just choice.
Catalog record
| CREATOR | Konstantinos D. Polyzos 1 *, Athanasios Bacharis 2 *, Saketh Madhuvarasu 1 , Nikos Papanikolopoulos 2 , Tara Javidi 1 1 University of California San Diego 2 University of Minnesota * Authors declare equal contribution |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 37 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2503-06859
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
ActiveInitSplat: How Active Image Selection Helps Gaussian Splatting Konstantinos D. Polyzos 1 *, Athanasios Bacharis 2 *, Saketh Madhuvarasu 1 , Nikos Papanikolopoulos 2 , Tara Javidi 1 1 University of California San Diego 2 University of Minnesota * Authors declare equal contribution Abstract Gaussian splatting (GS) along with its extensions and variants provides outstanding performance in real-time scene rendering while meeting reduced storage demands and computational efficiency. While the selection of 2D images capturing the scene of interest is crucial for the proper initialization and training of GS, hence markedly affecting the rendering performance, prior works rely on passively and typically densely selected 2D images. In contrast, this paper proposes ‘ActiveInitSplat’, a novel framework for active selection of training images for proper initialization and training of GS. ActiveInitSplat relies on density and occupancy criteria of the resultant 3D scene representation from the selected 2D images, to ensure that the latter are captured from diverse viewpoints leading to better scene coverage and that the initialized Gaussian functions are well aligned with the actual 3D structure. Numerical tests on well-known simulated and real environments demonstrate the merits of ActiveInitSplat resulting in significant GS rendering performance improvement over passive GS baselines, in the widely adopted LPIPS, SSIM, and PSNR metrics. 1 Introduction 3D scene representation and novel view synthesis are fundamental tasks in computer vision with diverse applications including autonomous driving, robotics, and medical imaging just to name a few. The goal in these tasks is to develop models capable of fast scene rendering while maintaining high visual quality, minimizing storage requirements, and ensuring computational efficiency. Gaussian splatting (GS), first proposed in [ 12 ] , along with its extended variants have sparked attention in the research community due to their efficient 3D scene representation via a set of anisotropic Gaussian functions, allowing for fast rendering with memory efficiency, and outstanding visual performance. Across different GS models, the selection of initial training images is known to be a crucial factor for the rendering performance, since they have a direct impact on the initialization and training of GS. However, existing GS frameworks hinge on a passively pre-selected and typically dense set of training images which ensures redundancy, along with increased processing and computational cost. Even in the few GS frameworks designed for efficient rendering with a limited number of images, passive selection may confine the expressiveness of the 3D scene representation, potentially leading to reduced scene coverage. This paper, in contrast, provides a general framework for active and strategic selection of a few yet informative training images captured at diverse viewpoints, to ensure effective GS rendering performance at a lower sampling cost. Figure 1 : ActiveInitSplat in a nutshell . In contrast to existing Gaussian splatting (GS) methods that rely on passively (and possibly densely) collected 2D images of the scene of interest, ActiveInitSplat actively selects informative images to assist the initialization and training of GS. The active selection mechanism lies on optimizing a (black-box) function quantifying the quality of the resultant 3D point cloud from the selected images via density and occupancy criteria. The collected images are captured from diverse viewpoints, ensuring better scene coverage and facilitating the accurate alignment of the initialized Gaussian functions with the underlying 3D structure. While the idea of actively optimizing the training set of images seems natural and necessary, identifying a compact set of optimal camera views that lead to high-quality 3D scene representation, is fundamentally challenged by the need to guarantee diverse viewpoints without incurring redundancy. Specifically, (i) there is no explicit function in the existing literature that maps a certain set of images to the quality of the reconstructed 3D scene and, consequently, to GS rendering performance; (ii) even if such an explicit function were provided, it certainly would depend on the structure of the scene for which prior information is typically not available; and finally (iii) a sequential processing of multiple different sets of images to empirically assess GS rendering performance is impractical. In the face of these challenges, this paper proposes ‘ActiveInitSplat’, a novel active GS framework shown in Fig. 1 , whose contributions can be summarized in the following aspects. • In contrast to existing passive GS approaches, ActiveInitSplat is the first work to introduce an effective and lightweight active camera view selection strategy for Gaussian Splatting without requiring any depth information or any prior knowledge (such as geometric cues) of the 3D scene of interest. • To guide the active selection process, ActiveInitSplat proposes an innovative optimization formulation, where the objective function integrates density- and occupancy-based criteria of the 3D point cloud, informing the initialization step in GS. As such, our method is agnostic to the subsequent steps of GS. Hence, it can be readily incorporated into the growingly extended variants of GS architectures. • Numerical tests on simulated and well-known real-world benchmark 3D scenes, demonstrate the significance of ActiveInitSplat in actively capturing informative training images from diverse viewpoints for GS, with substantial rendering performance improvement compared to passive selection counterparts. • The proposed active selection mechanism is shown to benefit GS models both in sparse- and dense-view regimes. In addition, ActiveInitSplat performs well both in the general setting of selecting optimal images from any position in 3D space, as well as in scenarios where the view selection is limited to a finite set of images (such as benchmark datasets). Figure 2 : Active viewpoint selection process using Gaussian process-based surrogate modeling for black-box optimization. 2 Related Works In this section, prior art is presented to contextualize the motivation and contributions of ActiveInitSplat. 2.1 Novel view synthesis and scene rendering Novel view synthesis (NVS) refers to the problem of estimating views of a 3D scene of interest at unobserved viewpoints/poses based on a certain budget of observed images. NVS initially garnered notable attention with the emergence of approaches leveraging the SfM process, which estimates a (typically sparse) 3D scene representation, and multi-view stereo (MVS) techniques that enable denser 3D reconstructions; see e.g. [ 13 , 3 ] . Albeit interesting, the visual quality of the rendered images admitted further improvements. Recently, neural radiance field (NeRF) based methods that leverage multi-layer perceptrons (MLPs) utilizing volumetric ray-marching for NVS, have shown great empirical success. For example, the ‘Mip-NeRF360’ framework in [ 1 ] has achieved outstanding visual quality of rendered images but may entail up to 48 hours of training, which discourages its application in time-sensitive tasks. To alleviate such computational burdens, existing NeRF-based methods employ simpler MLPs or other techniques; see e.g. [ 4 , 20 , 27 ] . Although being more efficient in terms of training, these approaches show inferior rendering quality compared to ‘Mip-NeRF360’. 2.2 Gaussian splatting for novel view synthesis Striving for high rendering quality and reduced training time compared to the ‘Mip-NeRF360’ NeRF-based approach, the recently developed Gaussian splatting (GS) methods provide principled frameworks to represent a 3D scene of interest using a set of Gaussian functions. To initialize these Gaussian functions so that they are aligned with the 3D structure, the initial GS approach in [ 12 ] relies on the SfM process to obtain a representation of the 3D scene. Yet, the SfM process may become inefficient when the number of training images is