Large-Scale Gaussian Splatting SLAM
Zhe Xin, Chenyang Wu, Penghui Huang, Yanyong Zhang, Yinian Mao, Guoquan Huang · 2025
Read Large-Scale Gaussian Splatting SLAM by Zhe Xin, Chenyang Wu, Penghui Huang, Yanyong Zhang, Yinian Mao, Guoquan Huang (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2505-09915.txt.
Introduction
Zhe Xin and co-authors scale Gaussian splatting mapping to outdoor scenes with stereo cameras in a 2025 paper. Prior neural mapping needed depth sensors and stayed indoors. Their system splits big scenes into chained submaps that fit memory. Pose guesses blend several signal types under wide view shifts.
Feature warping checks curb errors from look alike surfaces. Loop finds between submaps trigger global pose and point cleanup. A polish step then sharpens the final rebuild. Tests on drone and driving datasets beat neural and classic rivals alike. Outdoor robots gain a richer live map from plain stereo vision.
Catalog record
| CREATOR | Zhe Xin, Chenyang Wu, Penghui Huang, Yanyong Zhang, Yinian Mao, Guoquan Huang |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 32 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2505-09915
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Large-Scale Gaussian Splatting SLAM Zhe Xin, Chenyang Wu, Penghui Huang, Yanyong Zhang, Yinian Mao, Guoquan Huang Abstract The recently developed Neural Radiance Fields (NeRF) and 3D Gaussian Splatting (3DGS) have shown encouraging and impressive results for visual SLAM. However, most representative methods require RGBD sensors and are only available for indoor environments. The robustness of reconstruction in large-scale outdoor scenarios remains unexplored. This paper introduces a large-scale 3DGS-based visual SLAM with stereo cameras, termed LSG-SLAM . The proposed LSG-SLAM employs a multi-modality strategy to estimate prior poses under large view changes. In tracking, we introduce feature-alignment warping constraints to alleviate the adverse effects of appearance similarity in rendering losses. For the scalability of large-scale scenarios, we introduce continuous Gaussian Splatting submaps to tackle unbounded scenes with limited memory. Loops are detected between GS submaps by place recognition and the relative pose between looped keyframes is optimized utilizing rendering and feature warping losses. After the global optimization of camera poses and Gaussian points, a structure refinement module enhances the reconstruction quality. With extensive evaluations on the EuRoc and KITTI datasets, LSG-SLAM achieves superior performance over existing Neural, 3DGS-based, and even traditional approaches. Project page: https://lsg-slam.github.io . I Introduction Visual SLAM is an enabling technology for spatial intelligence in autonomous robotics and embodied AI. From the perspective of map representation, SLAM can be categorized into sparse, dense, implicit neural representation, and explicit volumetric representation. Traditional sparse [ 1 , 2 , 3 , 4 , 5 , 6 ] and dense [ 7 , 8 , 9 ] SLAM systems emphasize geometric mapping and heavily rely on handcrafted features. Moreover, these methods only reliably account for the observed portions of the scene during the reconstruction (mapping). Implicit neural representation, particularly Neural Radiance Fields (NeRF) [ 10 ] is learned via differentiable rendering and can create high-quality, novel camera viewpoints. However, per-pixel ray marching remains a significant bottleneck for rendering speed [ 11 ] . Moreover, the implicit features are embedded by multi-layer perceptrons (MLP), which may suffer from catastrophic forgetting [ 12 ] and the implicit scene is not easy to edit [ 13 ] . On the other hand, 3D Gaussian Splatting (3DGS) [ 14 ] explicitly represents a scene using Gaussian points, the rasterization of 3D primitives allows 3DGS to capture high-fidelity 3D scenes while facilitating faster rendering. SplaTAM [ 15 ] enhances the rendering quality by eliminating view-dependent appearance and employing isotropic Gaussian points. MonoGS [ 16 ] adopts a map-centric approach, dynamically allocating Gaussian points to enable the modeling of arbitrary spatial distributions. However, these methods use a simple uniform motion model to predict prior poses, which is easy to drift with significant viewpoint changes. Additionally, they lack an explicit loop closure module to eliminate accumulated errors and are only tested in small-scale indoor environments. Fig. 1: Results on KITTI sequence 00. LSG-SLAM enables precise camera tracking and high-fidelity reconstruction in challenging large-scale scenarios. We showcase the trajectory error before and after loop closure and some sample keyframes with associated submaps. The PSNR is evaluated after the structure refinement. In this paper, we develop an efficient large-scale 3DGS-based stereo visual SLAM system, termed LSG-SLAM , the first of its kind 3DGS-SLAM specifically designed for large-scale (outdoor) environments (e.g., see Fig. 1 ). In particular, we adopt a multi-modality strategy for pose tracking to address large view changes between frames. In pose optimization, we integrate rendering losses and feature-alignment warping constraints. The former helps mitigate detection and matching errors caused by feature points, while the latter alleviates the adverse effects of appearance similarity. These improvements enable our method to operate at low frame rates, catering to data-limited situations. For mapping in large-scale scenarios, we introduce continuous GS submaps to handle scalability issues caused by unbounded scenes with limited memory. Valid loops are carefully detected by place recognition between keyframes in different GS submaps. Leveraging the rasterization of Gaussian Splatting, loop constraints are estimated by minimizing the difference between the rendered and the query keyframes, using the same losses as tracking. Furthermore, a submap-based structure refinement module enhances the reconstruction quality after the global pose graph and point cloud adjustment. In summary, the contributions of our work include: • We develop the first of its kind system of 3DGS-based stereo visual SLAM for large-scale environments, which significantly improves tracking stability, mapping consistency, scalability, and reconstruction quality. • We advocate efficient 3DGS rendering to generate novel views for better image/feature matching, local and global, to improve both tracking and loop closing. • We propose a submap-based structure refinement following the global pose graph and point clouds adjustment to improve the reconstruction quality. • We perform extensive experimental validation showing that the proposed LGS-SLAM is able to improve the tracking accuracy by 70\% and the reconstruction quality by 50\% over the SOTA 3DGS-based SLAM methods. II Related Work Traditional sparse/semi-dense visual SLAM systems can be divided into feature-based and direct methods. Feature-based methods [ 1 , 2 , 17 , 3 ] focus on texture information in the scene and direct methods [ 4 , 5 , 6 ] are based on the grayscale invariant assumption. Traditional dense visual SLAM systems [ 7 , 8 ] use RGB-D cameras to track and build dense maps. These methods only reliably account for the observed portions of the scene during the reconstruction. Implicit SLAM [ 18 , 12 , 19 ] often uses NeRF to represent scenes. iMAP [ 18 ] uses a single MLP to represent the scene, demonstrating the feasibility of this approach. NICE-SLAM [ 12 ] and Co-SLAM [ 20 ] use a hierarchical feature grid with several MLP decoders to represent the map. Point-SLAM [ 19 ] introduces a neural point cloud, further improving reconstruction accuracy. However, the rendering speed of NeRF remains a significant bottleneck and the implicit scene is not easy to edit. The scene represented by 3D Gaussian points is easy to edit while facilitating faster rendering. Photo-SLAM [ 21 ] maintains a hyper primitives map that stores ORB features [ 22 ] and Gaussian physical properties. The tracking and loop closure modules largely rely on ORB-SLAM3 [ 3 ] which uses only a motion-only bundle adjustment. Feature points often encounter repeatability of detection and mismatching errors, which cannot be eliminated during pose optimization. Moreover, the storage of ORB features for Gaussian points is not negligible, especially in large-scale scenarios. LoopSplat [ 23 ] adds global BA to reduce accumulated errors and ensure overall spatial consistency. However, these methods are limited to indoor scenes. III LSG-SLAM Fig. 2: The overview of LSG-SLAM. For each incoming frame, we employ the multi-modality prior pose estimation strategy and subsequently utilize rendering loss and feature warping loss to optimize the current pose. Selected keyframes are then employed to refine the scene and add more Gaussian points. Incorporating loop detection and loop constraint estimation utilizing GS submaps, all keyframe poses are optimized. Subsequently, all Gaussian points are adjusted based on the relative transformation of their associated keyframes. After optimizing the pose of all images, a structure refinement process is executed to enhance the reconstruction quality for novel view synthesis. The proposed LSG-SLAM is a stereo SLAM system that simultaneously tracks the camera