CityGS- 𝒳 \mathcal{X} : A Scalable Architecture for Efficient and Geometrically Accurate Large-Scale Scene Reconstruction

Yuanyuan Gao, Hao Li, Jiaqi Chen, Zhengyu Zou, Zhihang Zhong, Dingwen Zhang, Xiao Sun, Junwei Han · 2025

Read CityGS- 𝒳 \mathcal{X} : A Scalable Architecture for Efficient and Geometrically Accurate Large-Scale Scene Reconstruction by Yuanyuan Gao, Hao Li, Jiaqi Chen, Zhengyu Zou, Zhihang Zhong, Dingwen Zhang, Xiao Sun, Junwei Han (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2503-23044.txt.

Introduction

Yuanyuan Gao and seven co-authors speed up 3D rebuilds of whole city scenes in a 2025 paper. A famed method that sprays soft 3D blobs to fake a scene works well, but at city scale it runs slow, costs much, and loses fine shape. Its loose build and poor fit for parallel work sit at the root.

Their build, called CityGS-X, rests on a layered blob form made for many chips at once. It drops the old merge-and-split slog for batch rendering of many tasks in parallel. The result rebuilds large scenes faster, with truer shapes and lower cost.

Catalog record

CREATORYuanyuan Gao, Hao Li, Jiaqi Chen, Zhengyu Zou, Zhihang Zhong, Dingwen Zhang, Xiao Sun, Junwei Han
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE39 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2503-23044

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

CityGS- 𝒳 \mathcal{X} : A Scalable Architecture for Efficient and Geometrically Accurate Large-Scale Scene Reconstruction Yuanyuan Gao, Hao Li, Jiaqi Chen, Zhengyu Zou, Zhihang Zhong, Dingwen Zhang, Xiao Sun, Junwei Han Abstract Despite its significant achievements in large-scale scene reconstruction, 3D Gaussian Splatting still faces substantial challenges, including slow processing, high computational costs, and limited geometric accuracy. These core issues arise from its inherently unstructured design and the absence of efficient parallelization. To overcome these challenges simultaneously, we introduce CityGS- 𝒳 \mathcal{X} , a scalable architecture built on a novel parallelized hybrid hierarchical 3D representation (PH 2 -3D). As an early attempt, CityGS- 𝒳 \mathcal{X} abandons the cumbersome merge-and-partition process and instead adopts a newly-designed batch-level multi-task rendering process. This architecture enables efficient multi-GPU rendering through dynamic Level-of-Detail voxel allocations, significantly improving scalability and performance. To further enhance both overall quality and geometric accuracy, CityGS- 𝒳 \mathcal{X} presents a progressive RGB-Depth-Normal training strategy. This approach enhances 3D consistency by jointly optimizing appearance and geometry representation through multi-view constraints and off-the-shelf depth priors within batch-level training. Through extensive experiments, CityGS- 𝒳 \mathcal{X} consistently outperforms existing methods in terms of faster training times, larger rendering capacities, and more accurate geometric details in large-scale scenes. Notably, CityGS- 𝒳 \mathcal{X} can train and render a scene with 5,000+ images in just 5 hours using only 4×4090 GPUs, a task that would make other alternative methods encounter Out-Of-Memory (OOM) issues and fail completely. This implies that CityGS- 𝒳 \mathcal{X} is far beyond the capacity of other existing methods. Project Page: https://lifuguan.github.io/CityGS-X/ . Figure 1 : We propose CityGS- \mathcal{X} , a scalable architecture for efficient and geometrically accurate large-scale scene reconstruction (left). The middle column shows qualitative results of rendered depth between our method and CityGS-v2 [ 10 ] , demonstrating CityGS- \mathcal{X} ’s superior geometric representation with smoother object surfaces. The top-right PSNR chart highlights CityGS- \mathcal{X} ’s superior reconstruction quality across various GPU configurations while significantly reducing time consumption. The bottom-right section highlights the memory efficiency of CityGS- \mathcal{X} , successfully handling high-resolution 4K rendering, while CityGS-v2 encounters out-of-memory issues. 1 Introduction Large-scale scene reconstruction is essential in areas such as urban planning [ 11 ] , autonomous driving [ 28 , 27 ] , and aerial surveying [ 12 ] . The primary goal is to create photorealistic 3D models with accurate geometry from image collections, enabling high-quality visualization, analysis, and simulation. Recent advancements in 3D Gaussian Splatting (3DGS) [ 16 ] have brought this goal closer to reality, improving scene reconstruction with high-fidelity novel-view synthesis and fast rendering. Despite these advancements, current 3DGS methods still struggle with issues related to geometry accuracy, as well as inefficiencies in training and inference. Figure 2 : Comparison between our parallel architecture and previous methods that reconstruct large-scale scenes using a partition-after-merge strategy. (a) uses overlap partition training and suffers from issues in the overlap areas during merging, which is time-consuming. (b) instead employs model distillation to enable distributed training, though it still introduces extra time for the distillation process. Moreover, both (a) and (b) restrict Gaussian rendering to a single GPU, limiting the size of the final merged model. (c) Our approach introduces a novel paradigm with Parallel Hybrid Hierarchical 3D Representation and parallel batch-level rendering techniques, offering enhanced scalability and efficiency for large-scale scene reconstruction. Existing methods [ 57 , 37 , 10 ] for large-scale scenes rely heavily on the merge-and-partition strategy, where scenes are divided into independent blocks for Multi-GPUs training. As shown in Fig. 2 , these approaches face issues with inconsistencies at block boundaries due to the lack of multi-view constraints during independent block training. Some methods attempt to address this by increasing the overlap area [ 48 , 37 , 10 ] or performing post-training after merging [ 13 , 12 ] , but these solutions add extra training time and computational costs, making them inefficient for large-scale scene reconstruction. Furthermore, existing methods still require merging on a single GPU for novel-view synthesis, and even with an RTX 4090 GPU, only up to 5 million Gaussians can be handled, severely limiting scalability for large scenes. A key insight of this work is that the field lacks a scalable architecture for efficient and geometrically accurate large-scale scene reconstruction. We argue that a compact yet geometry-friendly 3D representation, coupled with an optimized parallel training and rendering mechanism, is essential to advancing this task. Fortunately, progress has been made in both 3D representations and parallelism for 3DGS. Traditional 3DGS represents a scene using a set of discrete Gaussian attributes, but this unstructured [ 7 ] approach fails to accurately capture the scene’s surface. It also becomes memory- and storage-intensive when handling large-scale scenes. To address these issues, hybrid representations [ 9 , 8 ] have been introduced, which integrate anchor or voxel structures with MLP decoders to represent Gaussians. This reduces memory usage while maintaining high-quality geometric fidelity. On the parallelism front, Grendel-GS [ 17 ] is the first distributed training system designed to scale Gaussian splatting, effectively balancing the computational load across multiple GPUs. Building on existing advancements, we present CityGS- \mathcal{X} , a novel architecture that scales up Parallelized Hybrid Hierarchical 3D Representation (PH 2 -3D) into multi-GPU systems for scalable and efficient large-scale scene reconstruction. To achieve this goal, we dynamically allocate LOD voxel structures across multiple GPUs, enabling voxel-wise parallelism and automatic load balancing during training. Powered by a shared Gaussian decoder, the voxels across different GPUs are decoded as distributed Gaussians, facilitating parallel training and rendering. This design eliminates fragmentation, removes redundant 3D representations, and better aligns with the real geometry’s distribution. Building on this architecture, we implement batch rendering techniques with multi-task ( e.g . , RGB, depth, and normal), leveraging the parallel nature of the system. Meanwhile, since our Gaussian Decoder is an implicit representation, it is a natural fit for batch training, further enhancing its generalization ability. More importantly, CityGS- \mathcal{X} enables the incorporation of batch-level consistent geometric constraints. We leverage the prior knowledge of an off-the-shelf mono-depth estimator [ 6 ] for per-batch images and propose a confidence-aware filtering strategy that adaptively masks and filters low-quality depth estimations during batch-view projections, further enhancing both quality and geometric accuracy. We perform extensive experiments on large-scale scene datasets, demonstrating the superior rendering quality, exceptional surface reconstruction performance, and fast training speed of our approach (Fig. 1 ). Additionally, we test our method on various configurations of RTX 4090 GPUs, showing that it can run effectively on relatively low-end GPUs without encountering out-of-memory (OOM) issues, highlighting its scalability and efficiency. Our key contributions are summarized as follows: • We introduce CityGS- \mathcal{X} , a scalable architecture for efficient and geometrically accurate large-scale scene reconstruction. It leverages a Parallelized Hybrid Hierarchical 3D Representation that eliminates the merge-and-partition process. • We further propose multi-task batch rendering with a batch-level consistent progressive training strategy. Our approach employs robust geometric constraints at the batch level to regularize training by filtering out uncertain depth estimates across multiple views. • Extensive experiments demonstrate that our method outperforms existing large-scale scene reconstruction techniques, establishing a promising foundation for future advancements in the field. 2 Related works 2.1 Neural Rendering Traditional 3D reconstruction

Read the complete text