EcoSplat: Efficiency-controllable Feed-forward 3D Gaussian Splatting from Multi-view Images

Jongmin Park 1, Minh-Quan Viet Bui 1, Jaeho Moon 1, Jihyong Oh 3, Munchurl Kim 1, 2 Flawless AI, 3 Department of Imaging Science, GSAIM, Chung-Ang University, [email protected], [email protected] · 2025

Read EcoSplat: Efficiency-controllable Feed-forward 3D Gaussian Splatting from Multi-view Images by Jongmin Park 1, Minh-Quan Viet Bui 1, Jaeho Moon 1, Jihyong Oh 3, Munchurl Kim 1, 2 Flawless AI, 3 Department of Imaging Science, GSAIM, Chung-Ang University, [email protected], [email protected] (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2512-18692.txt.

Introduction

Jongmin Park and five co-authors speed up 3D scene reconstruction from photos. Feed-forward 3D Gaussian Splatting builds a renderable 3D model in one pass. But it tends to spray out far too many Gaussian primitives when many views are available, with no dial to control the count. Their framework, EcoSplat, posted to arXiv in December 2025, adds exactly that dial.

Training runs in two stages. Pixel-aligned Gaussian Training teaches first predictions. Importance-aware Gaussian Finetuning then teaches the model two skills: rank primitives, and reshape them to hit any target count requested at run time. Across dense-view tests, EcoSplat stays robust and beats leading methods under strict primitive budgets. For graphics teams, a controllable primitive count means one model can serve both high-end rendering and tight mobile budgets.

Catalog record

CREATORJongmin Park 1, Minh-Quan Viet Bui 1, Jaeho Moon 1, Jihyong Oh 3, Munchurl Kim 1, 2 Flawless AI, 3 Department of Imaging Science, GSAIM, Chung-Ang University, [email protected], [email protected]
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE48 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2512-18692

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

EcoSplat: Efficiency-controllable Feed-forward 3D Gaussian Splatting from Multi-view Images Jongmin Park 1, Minh-Quan Viet Bui 1, Jaeho Moon 1, Jihyong Oh 3, Munchurl Kim 1, 2 Flawless AI, 3 Department of Imaging Science, GSAIM, Chung-Ang University, [email protected], [email protected] Abstract Feed-forward 3D Gaussian Splatting (3DGS) enables efficient one-pass scene reconstruction, providing 3D representations for novel view synthesis without per-scene optimization. However, existing methods typically predict pixel-aligned primitives per-view, producing an excessive number of primitives in dense-view settings and offering no explicit control over the number of predicted Gaussians. To address this, we propose EcoSplat, the first efficiency-controllable feed-forward 3DGS framework that adaptively predicts the 3D representation for any given target primitive count at inference time. EcoSplat adopts a two-stage optimization process. The first stage is Pixel-aligned Gaussian Training (PGT) where our model learns initial primitive prediction. The second stage is Importance-aware Gaussian Finetuning (IGF) stage where our model learns rank primitives and adaptively adjust their parameters based on the target primitive count. Extensive experiments across multiple dense-view settings show that EcoSplat is robust and outperforms state-of-the-art methods under strict primitive-count constraints, making it well-suited for flexible downstream rendering tasks. Figure 1 : (a) EcoSplat is a feed-forward 3D Gaussian Splatting framework that enables explicit control over the number of output primitives. (b) It consistently outperforms state-of-the-art methods across a wide range of target primitive counts. 1 Introduction Novel View Synthesis (NVS) is a fundamental task in 3D vision, enabling applications in virtual reality (VR), augmented reality (AR), and cinematic production. Neural implicit representations 32 ; 1 ; 2 ; 15 ; 46 ; 33 ; 5 have shown impressive progress, yet their training and rendering remain computationally expensive. Recently, 3D Gaussian Splatting (3DGS) 24 has emerged as a state-of-the-art method to achieve both improved rendering quality and real-time rendering speed. Although 3DGS enables real-time rendering and fast reconstructions, it still requires substantial training time, often several minutes or even hours per scene for reconstruction, since it relies on per-scene optimization. To address this limitation, several feed-forward-based approaches 6 ; 36 ; 10 ; 42 ; 23 ; 44 ; 20 ; 48 have been proposed to directly predict the properties of 3D Gaussians (primitives) from multi-view images, leveraging large-scale datasets. In general, these approaches unproject the 2D pixels of each input image into a corresponding 3D primitive (i.e., pixel-aligned Gaussians) and aggregate the resulting primitives from all input views to represent the corresponding scene. After the feed-forward reconstruction stage, the predicted 3D Gaussian primitives can be stored and reused for real-time rendering on end-user devices such as mobile phones or AR/VR headsets. In practical applications, reconstruction is typically performed once on the server-side devices, while the generated 3DGS must support multiple rendering requests across diverse end-user devices. However, existing feed-forward methods typically generate a large number of pixel-aligned primitives, especially for dense-view reconstructions, which can be impractical for resource-constrained devices. To mitigate this, several approaches 22 ; 50 ; 52 have attempted to reduce redundant Gaussians across multiple views through voxelization 22 , graph-based aggregation 50 , or opacity-based pruning 52 . Nonetheless, these methods lack explicit control over the target numbers of primitives because they were not specifically designed for fine-level control over this number , which is a crucial factor for flexible deployment in real-time and streamable applications. Their threshold-based pruning strategies (e.g., voxel size or opacity-based pruning) often yield scene-dependent and unstable primitive counts, resulting in a poor quality-efficiency trade-off. In practice, explicit control over the number of 3D Gaussian primitives is essential: without a mechanism to enforce a prescribed count, the final number of primitives varies across scenes and view counts, leading to unpredictable latency, memory, and bandwidth requirements. Importantly , it should be noted that our work is distinguished from the standardization activities of MPEG 21 and other academic works 34 ; 9 where 3D Gaussians are subject to compression via codecs while our approach is related to effective and controllable compaction of feed-forward 3DGS representations in terms of the number of the primitives. To overcome these challenges, we propose EcoSplat, an E fficiency- co ntrollable feed-forward 3D Gaussian Splat ting framework for dense-view reconstruction. As shown in Fig. 1 , EcoSplat maximizes rendering quality while explicitly controlling the number of 3D Gaussians to match a target number, all in a feed-forward manner. To achieve this, we introduce a two-stage training process consisting of Pixel-aligned Gaussian Training (PGT) and Importance-aware Gaussian Finetuning (IGF). In the first stage (PGT), we train our model to reliably predict pixel-aligned 3D Gaussians. In the second stage (IGF), we further train our model to adaptively predict the 3D Gaussian parameters conditioned on the target number of primitives. Specifically, in the IGF stage, we introduce an importance-aware opacity loss \mathcal{L}_{\text{io}} to encourage the suppression of less informative primitives. Moreover, for improved training stability, we adopt a Progressive Learning on Gaussian Compaction (PLGC) strategy that gradually expands the sampling range of the target number of primitives during training. As a result of this training process, our EcoSplat can adaptively select the most important Gaussians for any target number of primitives during inference (Fig. 1 -(b)). Our main contributions are summarized as follows: • We introduce EcoSplat, the first feed-forward 3DGS framework that reconstructs a high-quality and robust set of Gaussian primitives while satisfying explicit and controllable constraints on the target number of primitives . • We design a two-stage training process, including Pixel-aligned Gaussian Training (PGT) followed by Importance-aware Gaussian Finetuning (IGF), that enables the model to learn an importance-aware primitive ranking and achieve controllable efficiency . • We demonstrate state-of-the-art efficiency-controllable NVS performance on dense-view benchmarks such as RealEstate10K 51 and ACID 29 . By achieving an optimal trade-off between primitive count and rendering quality, EcoSplat significantly outperforms previous feed-forward methods that lack fine-grained control over the number of primitives. 2 Related Work Optimization-based NVS. Since the introduction of Neural Radiance Fields (NeRF) 32 , the research on novel view synthesis (NVS) has made remarkable progress, with numerous extensions 46 ; 15 ; 16 ; 19 ; 33 ; 7 ; 5 ; 14 ; 4 . 3D Gaussian Splatting (3DGS) 24 has emerged as an explicit scene representation approach that models a scene using millions of anisotropic Gaussian primitives and employs differentiable rasterization to achieve photorealistic novel views with real-time inference. Despite these advantages, 3DGS relies on per-scene optimization of Gaussians and cannot directly render novel views from input images without retraining. Very recently, several post-optimization techniques have been proposed to control the number of Gaussian primitives 17 ; 13 . PUP 3D-GS 17 computes a spatial sensitivity score to prune pretrained 3DGS models. LightGaussian 13 utilizes significance-based pruning, SH coefficient distillation, and vector quantization to reduce the 3DGS model size. However, similar to 3DGS 24 , these methods cannot operate in a feed-forward manner. Figure 2 : Overview of EcoSplat. EcoSplat is trained in two stages: Pixel-aligned Gaussian Training (PGT) (Sec. 3.2 ) and Importance-aware Gaussian Finetuning (IGF) (Sec. 3.3 ). During IGF, the combination of the importance-aware opacity loss \mathcal{L}_{\text{io}} and the Progressive Learning on Gaussian Compaction (PLGC) encourages EcoSplat to suppress the opacities of less important Gaussians. At inference, it adaptively satisfies an arbitrary user-specified primitive count and

Read the complete text