BlockGaussian: Efficient Large-Scale Scene Novel View Synthesis via Adaptive Block-Based Gaussian Splatting
Yongchang Wu, Zipeng Qi, Zhenwei Shi, Zhengxia Zou ⋆ · 2025
Read BlockGaussian: Efficient Large-Scale Scene Novel View Synthesis via Adaptive Block-Based Gaussian Splatting by Yongchang Wu, Zipeng Qi, Zhenwei Shi, Zhengxia Zou ⋆ (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2504-09048.txt.
Introduction
Yongchang Wu and co-authors present a block-wise method for rebuilding large scenes in 3D in a 2025 paper. A popular technique scatters soft 3D blobs to model a scene, but big scenes must be split into blocks, and splitting, tuning, and merging each bring flaws. Their method, BlockGaussian, plans the split by scene content.
Blocks are cut so that busy and quiet zones share the compute load fairly. Extra guide points keep each block's tuning honest against the true images. A fake-view rule cleans up floating artefacts when blocks merge. Tests on large scenes gave top scores for both speed and image quality. The whole job fits on a single graphics card with modest memory.
Catalog record
| CREATOR | Yongchang Wu, Zipeng Qi, Zhenwei Shi, Zhengxia Zou ⋆ |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 54 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2504-09048
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
BlockGaussian: Efficient Large-Scale Scene Novel View Synthesis via Adaptive Block-Based Gaussian Splatting Yongchang Wu, Zipeng Qi, Zhenwei Shi, Zhengxia Zou ⋆ Abstract The recent advancements in 3D Gaussian Splatting (3DGS) have demonstrated remarkable potential in novel view synthesis tasks. The divide-and-conquer paradigm has enabled large-scale scene reconstruction, but significant challenges remain in scene partitioning, optimization, and merging processes. This paper introduces BlockGaussian, a novel framework incorporating a content-aware scene partition strategy and visibility-aware block optimization to achieve efficient and high-quality large-scale scene reconstruction. Specifically, our approach considers the content-complexity variation across different regions and balances computational load during scene partitioning, enabling efficient scene reconstruction. To tackle the supervision mismatch issue during independent block optimization, we introduce auxiliary points during individual block optimization to align the ground-truth supervision, which enhances the reconstruction quality. Furthermore, we propose a pseudo-view geometry constraint that effectively mitigates rendering degradation caused by airspace floaters during block merging. Extensive experiments on large-scale scenes demonstrate that our approach achieves state-of-the-art performance in both reconstruction efficiency and rendering quality, with a 5× speedup in optimization and an average PSNR improvement of 1.21 dB on multiple benchmarks. Notably, BlockGaussian significantly reduces computational requirements, enabling large-scale scene reconstruction on a single 24GB VRAM device. The project page is available at https://github.com/SunshineWYC/BlockGaussian . Fig. 1 : BlockGaussian reconstructs city-scale scenes from massive multi-view images and enables high-quality novel view synthesis from arbitrary viewpoints, as illustrated in the surrounding images. Compared to existing methods, our approach reduces reconstruction time from hours to minutes while achieving superior rendering quality in most scenes. I Introduction Large-scale scene high-fidelity and real-time novel view synthesis is essential for many applications, including autonomous driving [ 1 , 2 , 3 ] , virtual reality [ 4 , 5 ] , remote sensing photogrammetry [ 6 , 7 ] , and embodied intelligence. Recently, prominent novel view synthesis approaches have fallen into two main categories: Neural Radiance Fields (NeRF)-based methods [ 8 , 9 , 10 , 11 ] and Gaussian Splatting-based techniques [ 12 , 13 , 14 ] . Neural Radiance Fields (NeRF) [ 8 ] , due to their capability in high-fidelity rendering through implicit representation, have been extended to large-scale scene reconstruction tasks [ 15 , 16 , 17 ] . Although Block-NeRF [ 17 ] achieved large-scale reconstruction of San Francisco neighborhoods, the scene representation using MLP networks as the smallest unit lacks flexibility and struggles with slow rendering speeds. 3D Gaussian Splatting [ 12 ] , as an alternative, demonstrates more significant potential, particularly with its fast rendering speed. Explicit point clouds scene representation makes it more scalable for large-scale scenes [ 18 , 19 , 20 , 21 ] . The divide-and-conquer paradigm [ 15 , 20 , 19 ] has become the mainstream of large-scale scene novel view synthesis constrained by hardware VRAM resources. By dividing the scene into subregions, the reconstruction speed has been significantly improved in multi-GPU parallel. This paradigm consists of three key stages: scene partitioning, individual block optimization, and fusion of block reconstruction results. These stages exhibit a strictly sequential dependency, meaning the input of each subsequent stage entirely relies on the output of the preceding phase. The quality of the final reconstruction result is contingent upon the effectiveness of each stage. Although existing research methods have established a baseline, challenges remain in these steps, including imbalanced reconstruction complexity across blocks, supervision mismatch in block-wise optimization, and quality degradation in fusion results. The imbalanced reconstruction complexity across blocks arises from unreasonable scene partitioning, which reduces the efficiency of large-scale scene reconstruction, especially on multi-GPU devices. As illustrated in Fig. 2 (a), evenly dividing the scene into grids ignores the content disparity of different regions. When partitioning the scene, two critical factors must be considered: the granularity of block division and the computational loads across blocks. The former requires attention to the complexity of different scene regions, with higher granularity for areas of interest or greater complexity. The latter aims to balance the computational loads across blocks, thereby reducing the training time of the entire scene in multi-GPU. VastGaussian [ 19 ] introduced a progressive data partitioning strategy, which divides the scene based on camera positions. DOGS [ 21 ] improved VastGaussian’s partitioning method by proposing a recursive method to balance computational loads across blocks. However, scene partitioning based on camera positions is limited by the spatial distribution of cameras and struggles to generalize to scenes with more complex viewpoint distributions. CityGaussian [ 20 ] firstly trains a coarse Gaussian as the scene prior, using it to partition the scene into grids. Nevertheless, this partitioning method requires pre-training a coarse Gaussian model, which does not fully decouple scene scale from the optimization process. The supervision mismatch in block-wise optimization leads to artifacts within individual blocks, degrading scene reconstruction quality. NeRF/Gaussian-based scene representations employ an end-to-end optimization pipeline, where the parameters of the scene representation are optimized by constructing an objective function that compares ground-truth images with rendered images. However, under the divide-and-conquer paradigm for large-scale scene reconstruction, the lack of a entire scene representation leads to visibility problems during individual block optimization. As illustrated in Fig. 2 (b), after scene partitioning, the content of a training view may be distributed across multiple blocks, indicating that a single block only corresponds to a portion of the image scope. When reconstructing the concerned block, a mismatch arises between the rendered image and the training view during loss calculation. This mismatch stems from two factors: a) the image rendering process from the concerned block ignores occlusion relationships between blocks; b) it is difficult to calculate the accurate boundary with under-optimized block representations. Noisy supervision confuses the gradients of Gaussian parameters during end-to-end optimization, leading to degradation reconstruction results. Fig. 2 : Existing challenges in large-scale scene novel view synthesis task under divide-and-conquer paradigm. a) Imbalanced reconstruction complexity across blocks: The intensity of content in different scene regions exhibits significant differences. Areas with dense content require finer subdivision granularity to ensure reconstruction fidelity, while sparser-content regions benefit from coarser partitioning to enhance computational efficiency. b) Supervision mismatch in block-wise optimization: The content of a training view may be divided into multiple blocks after scene partitioning. Due to visibility constraints, the entire training view image does not match the ideal supervision when optimizing the individual block. c) Quality degradation in fusion results: Floater in airspace is an important reason for the quality degradation of fusion results. Since each block is optimized individually, these floaters fit well in the training perspective but degrade the quality of the synthesized novel views, especially in the boundary region. Seamless scene fusion avoiding quality degradation is another critical challenge in large-scale scene reconstruction. Optimizing individual blocks tends to produce floaters in the airspace due to the lack of accurate geometric supervision, leading to degenerate solutions. This significantly degrades the rendering quality after block fusion. As shown in Fig. 2 (c), floaters in airspace may fit the training-views well, but cause artifacts in novel views, especially at block boundaries. Therefore, adequate airspace supervision is vital for the scene training process. VastGaussian [ 19 ] tries to solve this problem by introducing more training views and designs an airspace-aware visibility