NavGSim: High-Fidelity Gaussian Splatting Simulator for Large-Scale Navigation
Jiahang Liu 1,2,∗ Yuanxing Duan 2,∗ Jiazhao Zhang 1,2,∗ Minghan Li 2 Shaoan Wang 1 Zhizheng Zhang 2 , 3 , † {}^{2,3,\dagger}~ He Wang 1,2,3,† 1 Peking University 2 Galbot 3 BAAI · 2026
Read NavGSim: High-Fidelity Gaussian Splatting Simulator for Large-Scale Navigation by Jiahang Liu 1,2,∗ Yuanxing Duan 2,∗ Jiazhao Zhang 1,2,∗ Minghan Li 2 Shaoan Wang 1 Zhizheng Zhang 2 , 3 , † {}^{2,3,\dagger}~ He Wang 1,2,3,† 1 Peking University 2 Galbot 3 BAAI (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-15186.txt.
Introduction
Liu and co-authors present NavGSim, a Gaussian Splatting simulator for large-scale robot navigation. Navigation paths often cross many rooms or whole floors, which strains rendering and collision checks. A hierarchical splatting framework gives photorealistic scenes over hundreds of square meters. A slicing trick pulls navigable areas straight from the reconstructed Gaussians. The package ships with APIs for scene building, robot setup, training, and evaluation across GPUs. A vision-language-action model trained on its trajectories handled varied navigation queries in simulation and the real world.
Catalog record
| CREATOR | Jiahang Liu 1,2,∗ Yuanxing Duan 2,∗ Jiazhao Zhang 1,2,∗ Minghan Li 2 Shaoan Wang 1 Zhizheng Zhang 2 , 3 , † {}^{2,3,\dagger}~ He Wang 1,2,3,† 1 Peking University 2 Galbot 3 BAAI |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 31766 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2603.15186
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
NavGSim: High-Fidelity Gaussian Splatting Simulator for Large-Scale Navigation Jiahang Liu 1,2,∗ Yuanxing Duan 2,∗ Jiazhao Zhang 1,2,∗ Minghan Li 2 Shaoan Wang 1 Zhizheng Zhang 2 , 3 , † {}^{2,3,\dagger}~ He Wang 1,2,3,† 1 Peking University 2 Galbot 3 BAAI Abstract Simulating realistic environments for robots is widely recognized as a critical challenge in robot learning, particularly in terms of rendering and physical simulation. This challenge becomes even more pronounced in navigation tasks, where trajectories often extend across multiple rooms or even entire floors. In this work, we present NavGSim, a Gaussian Splatting-based simulator designed to generate high-fidelity, large-scale navigation environments. Built upon a hierarchical 3D Gaussian Splatting framework, NavGSim enables photorealistic rendering in expansive scenes spanning hundreds of square meters. To simulate navigation collisions, we introduce a Gaussian Splatting-based slice technique that directly extracts navigable areas from reconstructed Gaussians. Additionally, for ease of use, we provide comprehensive NavGSim APIs supporting multi-GPU development, including tools for custom scene reconstruction, robot configuration, policy training, and evaluation. To evaluate NavGSim’s effectiveness, we train a Vision-Language-Action (VLA) model using trajectories collected from the NavGSim and assess its performance in both simulated and real-world environments. Our results demonstrate that NavGSim significantly enhances the VLA model’s scene understanding, enabling the policy to handle diverse navigation queries effectively. NavGSim is publicly available at: https://github.com/2003jiahang/NavGSim I Introduction Simulating realistic environments is widely regarded as a key component of robot learning [ 1 , 2 ] , providing a playground for robots to acquire diverse skills. Existing robotics simulators cover a broad range of applications, including locomotion [ 3 , 4 ] , manipulation [ 5 , 6 , 7 ] , and navigation [ 8 , 9 ] . Notably, unlike locomotion and manipulation tasks, navigation tasks are distinguished by their requirement for high-fidelity, large-scale scene environments—often spanning multiple rooms or even an entire floor. To simulate such large-scale environments, existing navigation simulators (e.g., Habitat [ 10 ] and AI2-THOR [ 11 ] ) rely on reconstructed or synthetic meshes. However, these approaches often result in unrealistic visual rendering. While artists can construct highly realistic scenes in game engines like Unreal or Unity, creating large-scale environments still requires significant effort. In recent years, significant advancements have been made in achieving realistic rendering in navigation simulators through the application of 3D Gaussian splatting (3DGS) [ 12 ] . 3DGS, which provides high-quality visual rendering, has gained traction in various domains, including navigation, due to its ability to easily reconstruct real-world environments by moving a camera and LiDAR around the environment.Recent works [ 13 , 14 , 15 , 16 , 17 , 18 ] have leveraged 3DGS to enhance the fidelity and scalability of navigation tasks. Building on these innovations, we proposed NavGSim, a 3D Gaussian Splatting-based simulator designed for high-fidelity, large-scale navigation tasks. Our method extends hierarchical 3D Gaussian Splatting techniques [ 19 ] and incorporates Gaussian-based collision simulation. Specifically, NavGSim organizes 3D Gaussians into a multi-level hierarchical structure, enabling adaptive level-of-detail (LOD) rendering that dynamically balances visual fidelity and computational efficiency during navigation. To support realistic collision detection, Gaussian ellipsoids are sliced by multiple horizontal planes, and the resulting intersection regions define the object’s occupancy representation on each plane. Consequently, NavGSim converts reconstructed scenes into navigable areas, enabling efficient collision checking and path planning. Building on NavGSim, we introduce NavGSim-API, a Python library for custom scene reconstruction, robot configuration, policy training, and evaluation. Our API enables researchers to reconstruct scenes from their own posed RGB images. The resulting 3D Gaussian Splatting scenes are fully compatible with NavGSim and support core navigation simulator functionalities, as demonstrated in prior work [ 10 , 11 ] . To evaluate the advantages of NavGSim over existing mesh-based navigation simulators, we fine-tune a vision-language-action (VLA) model [ 20 ] using navigation samples collected directly from NavGSim. We gather 4.5K navigation samples to reach 9 annotated targets. Our results show that the fine-tuned VLA model achieves superior navigation performance in NavGSim and demonstrates strong generalizability in real-world environments by effectively interpreting environmental cues to complete navigation tasks. We hope NavGSim will benefit the research community by enabling the construction of customized navigation simulators for diverse applications. II Related Works Navigation Simulator. Navigation simulators [ 21 , 11 , 10 , 22 , 23 , 24 , 25 , 26 , 27 ] play a crucial role in embodied AI and robot learning by offering controllable environments for navigation tasks such as Vision-and-language navigation [ 28 , 29 ] , Object Goal Navigation [ 30 , 31 ] , Embodied Question Answering [ 32 , 33 ] and more. Classic simulators such as Gazebo [ 21 ] , AI2-THOR [ 11 ] and Habitat [ 10 ] provide various levels of realism and interactivity. Note that, the scene environments of navigation simulators often span across multi rooms or one floor. To balance the rendering quality and efficiency, existing navigation simulators adopt conventional rendering techniques [ 34 , 35 ] with reconstrued meshes [ 36 , 37 , 38 ] or synthetic meshes [ 11 , 39 ] , which may limit visual fidelity. In contrast, NavGSim leverages 3D Gaussian Splatting, enabling more realistic and scalable simulations. Gaussian Splatting for Robots. 3D Gaussian Splatting (3DGS) [ 12 ] has recently emerged as a compelling alternative to traditional methods like NeRF [ 40 ] . It models a scene with a set of 3D Gaussian kernels that jointly encode density, color, and opacity. As a significant advancement in 3D reconstruction, 3DGS has high-quality reconstruction results while keeping real-time rendering performance, offering a powerful tool for bridging real-world data to simulated environments, i.e., Real2Sim [ 41 , 42 ] . For navigation tasks, the required reconstructed environments often span multiple rooms or even entire floors. Although numerous previous works [ 43 , 44 , 45 , 46 ] have addressed large-scale scene reconstruction, they cannot be directly applied to navigation tasks, which involve complex layouts with diverse geometries and heavy occlusions. To address this gap, Hierarchical 3D Gaussian Splatting (H3DGS) [ 19 ] proposes a hierarchical region-wise reconstruction framework that spatially decomposes the environment and renders it at multiple levels of detail. This design supports efficient and high-fidelity simulation over large, complex spaces. Fig. 2 : NavGSim’s sample code III NavGSim Platform III-A NavGSim Architecture Fig. 3 : Illustration of Gaussian Slicing for Navigable Areas . The left image shows the 3D Sofa model projected onto multiple horizontal Z-planes ( Z_{i} , Z_{i+1} , Z_{i+2} ) at fixed height intervals. Each plane contains a 2D Gaussian slice that represents the projection of the Sofa at that particular height. These slices are combined to form a 2D collision map, with the right image showing the entire scene’s 2-D occupancy map that serves as geometric prior information for downstream tasks such as navigation cost-map construction or collision checking. Fig. illustrates NavGSim, a modular and scalable simulator for large-scale navigation tasks with photo-realistic rendering path planning, and collision detection. These capabilities are accessible through a simple Python API, supporting the entire pipeline from scene reconstruction to embodied agent training. The usage of APIs is illustrated in Code 2 . Together, these components form a unified architecture that balances