Outdoor Monocular SLAM with Global Scale-Consistent 3D Gaussian Pointmaps
Chong Cheng, Sicheng Yu, Zijian Wang, Yifan Zhou, Hao Wang · 2025
Read Outdoor Monocular SLAM with Global Scale-Consistent 3D Gaussian Pointmaps by Chong Cheng, Sicheng Yu, Zijian Wang, Yifan Zhou, Hao Wang (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2507-03737.txt.
Introduction
Chong Cheng and co-authors present S3PO-GS, an outdoor SLAM system that works from a single camera and builds scenes from 3D Gaussian pointmaps. Their 2025 paper tackles two flaws of earlier Gaussian based systems: tracking pipelines that lean on rendered images, and separate trackers that drift in scale as the camera moves.
Tracking here anchors itself in the pointmap, which keeps scale consistent and converges in fewer steps. A patch based mapping module adds geometric priors while avoiding scale ambiguity. On the Waymo, KITTI, and DL3DV datasets the system set state of the art results for novel view synthesis and beat rival Gaussian SLAM methods on tracking accuracy. The design suits complex outdoor scenes.
Catalog record
| CREATOR | Chong Cheng, Sicheng Yu, Zijian Wang, Yifan Zhou, Hao Wang |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 42 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2507-03737
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Outdoor Monocular SLAM with Global Scale-Consistent 3D Gaussian Pointmaps Chong Cheng, Sicheng Yu, Zijian Wang, Yifan Zhou, Hao Wang Abstract 3D Gaussian Splatting (3DGS) has become a popular solution in SLAM due to its high-fidelity and real-time novel view synthesis performance. However, some previous 3DGS SLAM methods employ a differentiable rendering pipeline for tracking, lack geometric priors in outdoor scenes. Other approaches introduce separate tracking modules, but they accumulate errors with significant camera movement, leading to scale drift . To address these challenges, we propose a robust RGB-only outdoor 3DGS SLAM method: S3PO-GS. Technically, we establish a self-consistent tracking module anchored in the 3DGS pointmap, which avoids cumulative scale drift and achieves more precise and robust tracking with fewer iterations. Additionally, we design a patch-based pointmap dynamic mapping module, which introduces geometric priors while avoiding scale ambiguity. This significantly enhances tracking accuracy and the quality of scene reconstruction, making it particularly suitable for complex outdoor environments. Our experiments on the Waymo, KITTI, and DL3DV datasets demonstrate that S3PO-GS achieves state-of-the-art results in novel view synthesis and outperforms other 3DGS SLAM methods in tracking accuracy. Project page: https://3dagentworld.github.io/S3PO-GS/ . Figure 1 : Localization and novel view synthesis results on KITTI. Our method S3PO-GS maintains robust tracking and high-quality novel view synthesis even in cases of large-angle turns. This is achieved through our self-consistent 3DGS pointmap tracking and the patch-based pointmap dynamic mapping module. † † footnotetext: * Equal contribution. † † footnotetext: † Corresponding author. 1 Introduction Visual Simultaneous Localization and Mapping (SLAM), a core problem in fields like autonomous driving, robotics, and virtual reality (VR), has received substantial attention. Within this area, 3D scene representation has become a primary research focus, resulting in the development of numerous sparse [ 26 , 3 , 25 , 17 ] and dense [ 28 , 29 , 45 ] representation methods, which advance localization accuracy. However, these methods still face significant challenges in novel view synthesis (NVS) capabilities. Given the photorealistic visual effects offered by 3D Gaussian Splatting (3DGS) [ 15 ] scene representations, recent research has focused on integrating 3DGS with SLAM [ 22 , 12 , 41 , 14 , 10 , 44 ] . However, existing 3DGS SLAM methods still face two key challenges in outdoor RGB-only scenarios: lack of geometric priors and scale drift issues. On one hand, some previous RGB-only 3DGS SLAM methods, such as those proposed by [ 22 ] , perform pose estimation via differentiable rendering pipelines. However, this approach lacks geometric priors and struggles with convergence in complex environments, particularly in outdoor settings, where the model is prone to getting stuck in local minima. On the other hand, to enforce geometric constraints, some methods [ 12 , 44 , 46 ] introduce independent tracking modules and pre-trained models to supplement geometric information, enhancing the robustness of pose estimation. Yet, this strategy requires maintaining scale alignment between external modules and the 3DGS map. In scenarios with large rotations and displacements, accumulated errors can easily lead to scale drift in SLAM system, degrading subsequent pose estimation and map reconstruction quality. To address the challenges above, we propose a robust 3D Gaussian Splatting SLAM method— S3PO-GS . Our approach leverages pre-trained pointmap models to compensate for the lack of geometric priors in RGB-only scenarios. By anchoring 3DGS-rendered pointmaps, we establish 2D-3D correspondences, enabling scale self-consistent pose estimation. Through a patch-based design, we align the scale of the pre-trained pointmap with the current 3DGS scene. This allows us to incorporate geometric priors while effectively avoiding the issue of scale drift. Technically, we first design a self-consistent 3DGS pointmap tracking module that estimates poses through pixel-wise 2D-3D correspondences between the input frame and 3DGS-rendered pointmap. The pre-trained model serves solely as a bridge for correspondence without participating in the pose estimation, inherently avoiding scale alignment issues. Combined with the 3DGS differentiable pipeline to optimize poses, even in complex outdoor environments, this approach can achieve more accurate and robust tracking with only 10% of the iterations required. Furthermore, to address the lack of geometric priors in monocular SLAM, we design a patch-based pointmap dynamic mapping. This approach employs a patch-scale alignment algorithm to achieve local geometric calibration between the pre-trained pointmap and the 3DGS scene. A dynamic pointmap replacement mechanism is designed to reduce reconstruction errors. These strategies introduce geometric priors and resolve the issue of scale ambiguity, enabling high-quality scene mapping. Experiments on Waymo [ 36 ] , KITTI [ 9 ] , and DL3DV [ 20 ] datasets show that S3PO-GS outperforms existing 3DGS SLAM methods. It also sets new benchmarks in tracking accuracy and novel view synthesis. Our main contributions include: • We propose a self-consistent 3DGS pointmap tracking module that introduces priors while avoiding scale alignment issues, enhancing tracking accuracy and robustness with a significant reduction in iterations. • Our proposed patch-based pointmap dynamic mapping module leverages a pre-trained model to dynamically adjust the 3DGS pointmap while mitigating scale ambiguities, significantly improving scene reconstruction quality. • Evaluations on multiple datasets demonstrate that our method establishes state-of-the-art performance in tracking accuracy and novel view synthesis within the 3DGS SLAM framework. 2 Related work 2.1 Classical SLAM Classical SLAM methods commonly use sparse feature representations. For example, methods in the ORB-SLAM series [ 26 , 3 , 25 ] combine the FAST corner detector and BRIEF descriptor, tracking and updating only a small number of key points. Similarly, SIFT [ 21 ] and SURF [ 1 ] also rely on feature points for camera pose estimation. Based on this efficient feature tracking idea, PTAM [ 16 ] first parallelizes tracking and mapping, marking the beginning of real-time keypoint-based SLAM research. However, the resulting maps are typically sparse, serving primarily for navigation and localization rather than detailed scene modeling. Dense SLAM [ 28 , 29 , 45 ] generates detailed 3D maps, contrasting with sparse methods focused on pose estimation, and is well-suited for augmented reality and robotics. It includes frame-centered approaches, which are efficient but struggle with global consistency, and map-centered approaches using voxel grids or point clouds to enhance tracking and system compactness [ 30 , 40 ] . Recent advancements like iMAP [ 35 ] integrate neural networks for enhanced detail capture but face significant computational demands, limiting real-time applications. GlORIE-SLAM [ 45 ] utilizes a flexible neural point cloud representation, improving real-time performance without the need for costly backpropagation. However, it still does not achieve photorealistic novel view synthesis. 2.2 NeRF-based and 3DGS-based SLAM NeRF [ 23 ] uses a Multi-Layer Perceptron (MLP) to sample along viewing rays and generate high-quality novel view synthesis via volume rendering, significantly outperforming traditional sparse SLAM methods in reconstruction accuracy [ 34 , 37 , 13 , 43 ] . In the SLAM framework, NeRF optimizes the MLP using multi-view geometric information to achieve high-fidelity scene representation [ 32 , 47 , 48 ] . However, its long training time limits applicability in real-time SLAM [ 8 ] . Recent research introduce explicit structures like multi-resolution voxel grids or hash encodings to improve rendering speed and efficiency [ 24 , 11 ] , yet they still struggle with achieving real-time rendering. Figure 2 : S3PO-GS pipeline for SLAM. The system