Optimized 3D Gaussian Splatting using Coarse-to-Fine Image Frequency Modulation
Umar Farooq, Jean-Yves Guillemaut, Graham Thomas, Adrian Hilton, Marco Volino · 2025
Read Optimized 3D Gaussian Splatting using Coarse-to-Fine Image Frequency Modulation by Umar Farooq, Jean-Yves Guillemaut, Graham Thomas, Adrian Hilton, Marco Volino (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2503-14475.txt.
Introduction
Umar Farooq and his co-authors present a computer vision method from two thousand twenty-five called Opti3DGS. The method builds three-dimensional scenes from images with Gaussian splatting, a way to render a scene in real time. Such scenes can need much memory and disk space, which limits use on home devices.
Opti3DGS starts with a coarse scene and adds detail step by step, guided by image frequency. On the base method, it cut the number of Gaussians by about sixty-two percent on average. It also cut training memory and time, with no loss in image quality. The method fits other splatting tools too, and it yields levels of detail at no extra cost.
Catalog record
| CREATOR | Umar Farooq, Jean-Yves Guillemaut, Graham Thomas, Adrian Hilton, Marco Volino |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 34 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2503-14475
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Optimized 3D Gaussian Splatting using Coarse-to-Fine Image Frequency Modulation Umar Farooq, Jean-Yves Guillemaut, Graham Thomas, Adrian Hilton, Marco Volino Abstract . The field of Novel View Synthesis has been revolutionized by 3D Gaussian Splatting (3DGS), which enables high-quality scene reconstruction that can be rendered in real-time. 3DGS-based techniques typically suffer from high GPU memory and disk storage requirements which limits their practical application on consumer-grade devices. We propose Opti3DGS, a novel frequency-modulated coarse-to-fine optimization framework that aims to minimize the number of Gaussian primitives used to represent a scene, thus reducing memory and storage demands. Opti3DGS leverages image frequency modulation, initially enforcing a coarse scene representation and progressively refining it by modulating frequency details in the training images. On the baseline 3DGS ( Kerbl et al., 2023 ) , we demonstrate an average reduction of 62% in Gaussians, a 40% reduction in the training GPU memory requirements and a 20% reduction in optimization time without sacrificing the visual quality. Furthermore, we show that our method integrates seamlessly with many 3DGS-based techniques ( Papantonakis et al., 2024 ; Lee et al., 2024 ; Girish et al., 2024 ; Fang and Wang, 2024 ; Mallick et al., 2024 ) , consistently reducing the number of Gaussian primitives while maintaining, and often improving, visual quality. Conference: European Conference on Visual Media Production; December 3–4, 2025; London, United Kingdom European Conference on Visual Media Production (CVMP ’25), December 3–4, 2025, London, United Kingdom DOI: 10.1145/3756863.3769707 ISBN: 979-8-4007-2117-5/2025/12 CCS: Computing methodologies Computer graphics; Reconstruction Figure 1. Opti3DGS progressively grows levels to reduce redundant and unused Gaussians while maintaining accurate geometric structure and competitive quality. 1. Introduction Figure 2. We start with uniform distribution of larger Gaussians as compared to 3DGS which starts heavy densification from the very start of optimization thus complicating the loss landscape. The zoomed views show efficient use of the initial sparse pointcloud by our approach. Photorealistic scene reconstruction remains a fundamental challenge in 3D computer vision, with applications spanning augmented and virtual reality, media production, and immersive gaming. Despite significant advancements, existing Novel View Synthesis (NVS) methods - particularly those based on Neural Radiance Fields (NeRF) ( Mildenhall et al., 2021 ) - face substantial computational constraints ( Hu et al., 2022 ; Li et al., 2023 ; Deng and Tartaglione, 2023 ) . These constraints hinder broader adoption, especially on web, mobile, and edge devices, where efficient rendering and low memory usage are critical. 3D Gaussian Splatting (3DGS) ( Kerbl et al., 2023 ) , recently introduced as an explicit point-based NVS technique, achieves high visual fidelity with fast training and real-time rendering. However, it suffers from significant GPU memory and storage overhead ( Papantonakis et al., 2024 ; Niedermayr et al., 2024 ) , limiting its applicability across diverse device form factors. To address these challenges we introduce Opti3DGS, a novel and efficient coarse-to-fine optimization strategy that reduces the number of Gaussians used to represent a scene. This translates into reduced memory and storage overheads compared to 3DGS ( Kerbl et al., 2023 ) . Our approach begins with intentional over-reconstruction, which serves as an effective regularizer, followed by progressive refinement of the scene to balance detail and efficiency. Several techniques have been proposed which aim to reduce 3DGS memory and storage costs. Some focus on compressing the stored representation ( Niedermayr et al., 2024 ; Lee et al., 2024 ; Fan et al., 2024 ; Navaneet et al., 2023 ; Liu et al., 2024 ) , others optimize training speed and parallelization ( Zhao et al., 2025 ) , while a few attempt to minimize Gaussian primitive count during optimization itself ( Lee et al., 2024 ; Papantonakis et al., 2024 ) . Our approach falls into the latter category, reducing Gaussian primitives during the optimization process, thereby decreasing GPU memory demands and accelerating training speed while maintaining visual quality. Notably, our method achieves these benefits as a plug-in approach without introducing additional learnable parameters or requiring lengthy optimizations. Opti3DGS improves the baseline 3DGS ( Kerbl et al., 2023 ) , achieving a 62% reduction in Gaussian primitives, a 40% decrease in GPU memory usage during training, and a 20% speedup in optimization time. Our technique is highly modular and can be easily incorporated into most 3DGS-based pipelines with minimal modifications. Furthermore, we demonstrate its positive impact when integrated into optimized 3DGS variants such as MiniSplatting ( Fang and Wang, 2024 ) and Taming3DGS ( Mallick et al., 2024 ) , as well as other recent appraches ( Papantonakis et al., 2024 ; Lee et al., 2024 ; Girish et al., 2024 ) . Due to the coarse-to-fine nature of our approach, it naturally produces level-of-detail representation as a byproduct, shown in Figure 1 , which could have useful applications in foveated rendering, streaming applications and advanced storage mechanisms. To summarize, our key contributions are: • We present Opti3DGS, a framework to minimize the number of Gaussian primitives in a 3DGS scene resulting in improved training speed, memory and storage requirements. • We propose a coarse-to-fine optimization strategy that increases the size of the Gaussians at the start of optimization and then slowly breaks down the large coarse Gaussians in a controlled fashion leading to an improved Gaussian densification process. • We demonstrate that Opti3DGS can be seamlessly integrated into a wide range of existing 3DGS techniques minimizing the number of Gaussians used to represent the scene without sacrificing visual quality, and in most cases improving it. 2. Related Work 3DGS Compression : One approach to reduce the storage size of 3DGS scenes focuses on quantizing raw parameters stored for each Gaussian primitive ( Niedermayr et al., 2024 ; Lee et al., 2024 ; Fan et al., 2024 ; Navaneet et al., 2023 ; Liu et al., 2024 ) . These enable efficient storage and transmission but since the optimization is done after 3DGS scene optimization, it does not lower GPU memory requirements during training and some of these methods require cumbersome decoding in GPU memory from a compressed representation which can be computationally expensive to render ( Kim et al., 2024 ) . Some methods like ( Girish et al., 2024 ) also include an efficient encoding and decoding mechanism for parameters during the optimization process, leading to both storage and compute time gains. However, in the case of ( Girish et al., 2024 ) they introduce additional learnable parameters and use a separate neural network to decode the color values and face complications due to quantized vectors not being differentiable. ( Girish et al., 2024 ) also use progressive resolution training which is different from our frequency based image filtering as outlined in section 4 . A subset of these methods ( Niedermayr et al., 2024 ; Girish et al., 2024 ; Fang and Wang, 2024 ; Wang et al., 2024 ; Papantonakis et al., 2024 ) also compute the rendering importance of each Gaussian primitive based on its contribution to individual pixels, its relative size or the Gaussian neighborhood it is located in. Gaussian Primitive Reduction : An alternative approach is to actively reduce the number of primitives during the optimization process ( Lee et al., 2024 ; Papantonakis et al., 2024 ; Fang and