Voyager : Real-Time Splatting City-Scale 3D Gaussians on Your Phone 1059 DOI: XXXXXXX.XXXXXXX Conference: Make sure to enter the correct conference title from your rights confirmation email; June 03–05, 2018; Woodstock, NY ISBN: 978-1-4503-XXXX-X/2018/06 CCS: Computing methodologies Rendering CCS: C

Zheng Liu, He Zhu, Xinyang Li, Yirun Wang, Yujiao Shi, Wei Li, Jingwen Leng, Minyi Guo, Yu Feng · 2025

Read Voyager : Real-Time Splatting City-Scale 3D Gaussians on Your Phone 1059 DOI: XXXXXXX.XXXXXXX Conference: Make sure to enter the correct conference title from your rights confirmation email; June 03–05, 2018; Woodstock, NY ISBN: 978-1-4503-XXXX-X/2018/06 CCS: Computing methodologies Rendering CCS: C by Zheng Liu, He Zhu, Xinyang Li, Yirun Wang, Yujiao Shi, Wei Li, Jingwen Leng, Minyi Guo, Yu Feng (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2506-02774.txt.

Introduction

Zheng Liu and co-authors published this computer graphics paper in 2025. Photorealistic city scenes can now be rendered with 3D Gaussian splatting, a technique that builds views from millions of soft colored blobs. Phones and other small devices cannot keep up at city scale, because two stages are heavy: choosing the right level of detail and drawing the blobs. The team's system, Voyager, attacks both stages.

Their key insight is that as a user moves normally, the number of newly visible blobs stays roughly constant. Voyager uses that steadiness to search only where the view has changed, and it filters blobs early to lighten the drawing stage. The result is real-time, low-latency city rendering on a phone. Against earlier systems, Voyager ran up to 6.6 times faster, used about 85 percent less energy, and delivered better image quality.

Catalog record

CREATORZheng Liu, He Zhu, Xinyang Li, Yirun Wang, Yujiao Shi, Wei Li, Jingwen Leng, Minyi Guo, Yu Feng
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE42 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2506-02774

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Voyager : Real-Time Splatting City-Scale 3D Gaussians on Your Phone 1059 DOI: XXXXXXX.XXXXXXX Conference: Make sure to enter the correct conference title from your rights confirmation email; June 03–05, 2018; Woodstock, NY ISBN: 978-1-4503-XXXX-X/2018/06 CCS: Computing methodologies Rendering CCS: Computing methodologies Parallel algorithms CCS: Computing methodologies Distributed algorithms Zheng Liu, He Zhu, Xinyang Li, Yirun Wang, Yujiao Shi, Wei Li, Jingwen Leng, Minyi Guo, Yu Feng Abstract . 3D Gaussian Splatting (3DGS) is an emerging technique for photorealistic 3D scene rendering. However, rendering city-scale 3DGS scenes on mobile devices, e.g., your smartphones, remains a significant challenge due to the limited resources on mobile devices. A natural solution is to offload computation to the cloud; however, naively streaming rendered frames from the cloud to the client introduces high latency and requires bandwidth far beyond the capacity of current wireless networks. In this paper, we propose an effective solution to enable city-scale 3DGS rendering on mobile devices. Our key insight is that, under normal user motion, the number of newly visible Gaussians per second remains roughly constant. Leveraging this, we stream only the necessary Gaussians to the client. Specifically, on the cloud side, we propose asynchronous level-of-detail search to identify the necessary Gaussians for the client. On the client side, we accelerate rendering via a lookup table-based rasterization. Combined with holistic runtime optimizations, our system can deliver low-latency, city-scale 3DGS rendering on mobile devices. Compared to existing solutions, Voyager achieves over 100 × \times reduction on data transfer and up to 8.9 × \times speedup while retaining comparable rendering quality. Fig. 1. Left: Illustration of our cloud-client co-rendering, enabling real-time city-scale Gaussian Splatting on mobile devices. Right: Performance comparison. 1. Introduction The field of 3D Gaussian Splatting (3DGS) ( Kerbl et al. 2023 ; Fan et al. 2024 ; Fang and Wang 2024 ; Girish et al. 2024 ; Lee et al. 2024b ; Niemeyer et al. 2024 ; Wang et al. 2024b ; Mallick et al. 2024 ; Gui et al. 2024 ; Radl et al. 2024 ) has made tremendous progress in recreating the 3D world with photo-realistic fidelity. While 3DGS unlocks new possibilities and fuels our imagination, rendering city-scale 3DGS scenes on mobile devices, e.g., the smartphone in your pocket, remains a substantial challenge. Primarily, there are some inherent limitations of mobile devices, such as limited compute resources and GPU memory. Furthermore, as 3DGS models scale up, even with advanced model compression techniques ( Fang and Wang 2024 ; Lee et al. 2024b ; Papantonakis et al. 2024 ) , device storage can be drained quickly. For example, a single scene like Campus from HierarchicalGS ( Kerbl et al. 2024 ) already exceeds 80 GB in size. These constraints make it infeasible to directly render existing large-scale 3DGS models on today’s mobile devices. Given these limitations, a natural proposal arises: why not leverage the more powerful resources available in the cloud to overcome the constraints of mobile devices? A straightforward design is to perform rendering entirely in the cloud and stream the rendered frames to the client. However, this approach has two critical limitations. First, it incurs high round-trip latency due to the strictly sequential pipeline. Second, the approach demands unrealistic data communication, often surpassing the limits of current wireless communication technologies ( Agiwal et al. 2016 ; Thompson et al. 2014 ) . For instance, streaming 1080p images at 60 FPS requires roughly 2.8 \times 10^{3} Mbps of bandwidth, which is at least one order of magnitude higher than the capabilities of wireless connections ( Alsabah et al. 2021 ) . Thus, to enable cloud-client collaborative rendering, an ideal 3DGS algorithm should carefully orchestrate the resources in the device and the cloud to jointly optimize end-to-end latency and data communication between these two. Recall, 3DGS algorithms represent scenes using Gaussian ellipsoids, a.k.a. Gaussians. By examining the state-of-the-art city-scale 3DGS methods ( Kerbl et al. 2024 ; Ren et al. 2024 ; Liu et al. 2024 ) , these algorithms generally consist of two major stages: level-of-detail (LoD) search and splatting . LoD search identifies the set of Gaussians at an appropriate LoD for rendering. Splatting then renders these selected Gaussians on the canvas in a visually consistent order. This stage adheres to the canonical 3DGS rendering pipeline ( Kerbl et al. 2023 ) , which processes Gaussians from nearest to farthest. To deploy such an algorithm between the client and the cloud, our key observation is that, as the user navigates through a 3D scene, the number of newly visible Gaussians introduced by continuous viewpoint changes remains roughly constant , assuming a general case of a smooth user motion. By leveraging this property, our algorithm avoids streaming the final rendered images. Instead, we send the intermediate data, i.e., Gaussians required for the splatting stage, to the client. We show that our algorithm not only fits well within the wireless bandwidth constraints but also exhibits strong scalability, as the wireless bandwidth demand of our algorithm is not susceptible to resolution or frame rate increases. On the cloud side, our rendering pipeline proactively performs LoD search and asynchronously sends the required Gaussians of upcoming frames to the client. This way, we can effectively hide the latency of LoD search by overlapping it with the splatting stage on the client. To further accelerate LoD search, we introduce two GPU-oriented optimizations. First, we propose an efficient tree traversal algorithm that can be highly parallelized on GPUs to accelerate the LoD search process. Second, we design a companion data structure that leverages temporal redundancy across consecutive tree traversals. Rather than recomputing the tree traversal results from scratch, we can reuse previous traversal results to reduce the computation. Compared against the previous LoD search algorithms, we achieve up to 6.5 \times speedup with the same rendering quality. On the client side, we optimize the rasterization process within the splatting stage, which has been identified as a main performance bottleneck in prior work ( Wang et al. 2024b ; Lee et al. 2024a ; Huang et al. 2025 ) . Our analysis shows that the primary source of slowdown during rasterization stems from the per-ray computation of Gaussian transparency. This computation is inefficient due to the heterogeneous design of GPU compute units. To accommodate this issue, we bypass the costly transparency computation by embedding a 128-byte precomputed lookup table (LUT) in GPU shared memory and approximating Gaussian transparency values instead. Meanwhile, we design a runtime Gaussian management system that dynamically maintains the set of received Gaussians in GPU memory. By removing irrelevant Gaussians, our system ensures that the client’s GPU memory usage always remains tight. Finally, we introduce a contribution-aware compression to further reduce data communication between the cloud and the client. Our experiments show that the primary contributor to communication overhead is the spherical harmonic (SH) coefficients of each Gaussian. To address this, we propose a pruning technique that adaptively reduces the SH degrees of individual Gaussians based on their visual contribution. By combining with off-the-shelf compression techniques, our method achieves 100 \times communication reduction compared to directly streaming rendered frames. The contributions of this paper are as follows: • A parallel LoD search algorithm that exploits temporal coherence across frames to achieve 6.5

Read the complete text