Stereo 3D Gaussian Splatting SLAM for Outdoor Urban Scenes
Xiaohan Li, Ziren Gong, Fabio Tosi, Matteo Poggi, Stefano Mattoccia, Dong Liu, Jun Wu · 2025
Read Stereo 3D Gaussian Splatting SLAM for Outdoor Urban Scenes by Xiaohan Li, Ziren Gong, Fabio Tosi, Matteo Poggi, Stefano Mattoccia, Dong Liu, Jun Wu (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2507-23677.txt.
Introduction
Xiaohan Li and six co-authors present BGS-SLAM, the first system to map outdoor city scenes with splatted 3D blobs while tracking itself from stereo cameras alone. Their paper appeared in two thousand twenty-five. Gaussian splatting renders scenes fast and sharply, and robots have begun using it to localize. Prior systems stayed indoors or leaned on depth sensors.
BGS-SLAM uses only paired color cameras, with no laser scanner. Depth guesses from pretrained stereo networks steer the placement of the blobs. A bundle of losses keeps the geometry consistent and the pictures crisp. Tests across several data sets beat other splatting systems outdoors. Tracking stayed accurate in complex street scenes. The work opens large-scale outdoor mapping to cheap camera rigs. Delivery and driving robots are natural users.
Catalog record
| CREATOR | Xiaohan Li, Ziren Gong, Fabio Tosi, Matteo Poggi, Stefano Mattoccia, Dong Liu, Jun Wu |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 36 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2507-23677
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Stereo 3D Gaussian Splatting SLAM for Outdoor Urban Scenes Xiaohan Li, Ziren Gong, Fabio Tosi, Matteo Poggi, Stefano Mattoccia, Dong Liu, Jun Wu Abstract 3D Gaussian Splatting (3DGS) has recently gained popularity in SLAM applications due to its fast rendering and high-fidelity representation. However, existing 3DGS-SLAM systems have predominantly focused on indoor environments and relied on active depth sensors, leaving a gap for large-scale outdoor applications. We present BGS-SLAM, the first binocular 3D Gaussian Splatting SLAM system designed for outdoor scenarios 1 1 1 The code will be released in case of acceptance. . Our approach uses only RGB stereo pairs without requiring LiDAR or active sensors. BGS-SLAM leverages depth estimates from pre-trained deep stereo networks to guide 3D Gaussian optimization with a multi-loss strategy enhancing both geometric consistency and visual quality. Experiments on multiple datasets demonstrate that BGS-SLAM achieves superior tracking accuracy and mapping performance compared to other 3DGS-based solutions in complex outdoor environments. SplaTAM ( Keetha et al. 2024 ) BGS-SLAM (LiDAR) BGS-SLAM (Ours) Figure 1: Comparison of Rendering and Depth Estimation. The top row shows RGB renderings generated by SplaTAM ( Keetha et al. 2024 ) , our BGS-SLAM method trained with LiDAR depth points, and our approach using only stereo RGB pairs with depth maps from deep stereo networks for supervision. The bottom row presents the corresponding depth renderings. Introduction Simultaneous Localization and Mapping (SLAM), a core research area in computer vision, has been widely applied in autonomous driving, metaverse, and robotics. It primarily utilizes sensor data to estimate the state of a robot while simultaneously constructing an accurate scene representation. Traditional methods ( Campos et al. 2021 ; Wang, Schworer, and Cremers 2017 ; Li, Liu, and Wu 2024 ) typically formulate this as a maximum a posteriori (MAP) estimation problem, where both robot ego-motion and scene modeling are described as factors in a graph for joint optimization. In recent years, neural rendering-based methods have made significant advancements. The emergence of Neural Radiance Fields (NeRF) ( Mildenhall et al. 2021 ) has profoundly influenced the community by revolutionizing novel view synthesis and scene representation, shifting the focus towards data-driven and differentiable rendering methods. Lately, 3D Gaussian Splatting (3DGS) ( Kerbl et al. 2023 ) has emerged as a promising alternative. By representing scenes as a collection of 3D Gaussians and leveraging an efficient rasterization strategy, 3DGS achieves fast rendering while providing high-quality scene representation. This naturally aligns with SLAM’s requirements for real-time processing and accurate scene reconstruction, making 3DGS-SLAM ( Keetha et al. 2024 ; Matsuki et al. 2024a ) a rapidly growing research focus in recent years. However, existing 3DGS-SLAM methods mainly rely on dense and accurate depth maps from RGB-D sensors as training supervision for geometric reconstruction, while also being limited to small-scale indoor scenes. These methods achieve high-fidelity representations in controlled indoor environments but encounter severe challenges in large, complex outdoor settings. First, active depth sensors like LiDAR and RGB-D cameras have inherent limitations outdoors. LiDAR systems are expensive, bulky, and power-intensive, making them impractical for many applications. Consumer RGB-D sensors like Microsoft Kinect or Intel RealSense, while more affordable and compact, face even greater limitations outdoors. These devices have significantly shorter effective ranges (typically under 5 meters), and their infrared-based depth sensing becomes unreliable in direct sunlight due to interference with their projected patterns. Second, outdoor scenes typically span much larger scales. For example, in the KITTI dataset ( Geiger, Lenz, and Urtasun 2012a ) , trajectories often extend over kilometers, causing substantial memory consumption during scene reconstruction and making real-time, efficient large-scale mapping particularly challenging. Finally, outdoor environments frequently involve drastic viewpoint changes and limited frame overlap, resulting in insufficient optimization constraints. This leads to convergence difficulties and visual artifacts that destabilize training. To address these challenges, we propose a novel 3DGS-based architecture specifically designed for large-scale outdoor environments such as autonomous driving scenarios. Our approach leverages passive RGB stereo cameras only, which are affordable and lightweight compared to expensive and cumbersome active sensors, and leverages the use of pre-trained deep stereo networks to generate dense depth maps that guide the training of 3D Gaussians, effectively overcoming the lack of reliable depth information in outdoor environments. Additionally, we employ an external tracker based on ORB-SLAM2 ( Mur-Artal, Montiel, and Tardos 2015 ) , which significantly optimizes the entire pipeline and improves the overall system performance. To the best of our knowledge, we are the first to integrate deep binocular stereo networks with 3DGS-SLAM specifically tailored for outdoor scenarios. Compared to the sparse LiDAR point clouds, stereo also provides more complete scene coverage, while demonstrating strong generalization and robustness under challenging lighting ( Tosi, Bartolomei, and Poggi 2025 ) . Furthermore, conversely to ill-posed, single-view depth estimation approaches ( Yang et al. 2024b ; Yang et al. 2024a ; Ke et al. 2024 ) , stereo still provides proper metric estimates, grounded in epipolar geometry. Our experiments confirm that even approximate depth estimations from these networks significantly enhance the optimization process by guiding the positioning of 3D Gaussians and preventing artifacts that typically occur when splats become trapped in incorrect geometric configurations. In summary, our contributions are the following: • We propose BGS-SLAM, the first 3D Gaussian Splatting SLAM system for outdoor environments using passive RGB stereo pairs only. • We integrate pre-trained deep stereo networks for dense depth supervision in 3D Gaussian optimization, showing that passive stereo can effectively replace expensive active sensors for outdoor scene reconstruction. • We introduce a combination of normal-based and smoothness losses alongside depth-from-stereo supervision to enhance geometric consistency, reduce artifacts, and improve overall mapping quality. • We present experiments on multiple large-scale outdoor datasets, including KITTI and KITTI-360, demonstrating that our approach significantly surpasses existing 3DGS-SLAM methods in outdoor scenarios, achieving superior tracking, mapping accuracy, and visual quality. Related Work Our work builds upon neural radiance field-based SLAM ( Tosi et al. 2024 ) , particularly focusing on RGB-only methods and 3DGS for outdoor environments. Neural Implicit Representations for SLAM. Neural implicit representations have revolutionized SLAM research. iMAP ( Sucar et al. 2021 ) pioneered this integration by employing an MLP to map 3D coordinates to color and density. NICE-SLAM ( Zhu et al. 2022 ) addressed scalability through hierarchical representation using multiple pre-trained MLPs. Vox-Fusion ( Yang et al. 2022 ) combined traditional volumetric techniques with neural implicit representations, while Co-SLAM ( Wang, Wang, and Agapito 2023 ) developed hybrid encodings for robust camera tracking. For large-scale environments, GO-SLAM ( Zhang et al. 2023b ) implemented global optimization techniques including loop closure and bundle adjustment, whereas Point-SLAM ( Sandström et al. 2023 ) introduced a dynamic neural point cloud representation that adapts point density based on scene complexity. Most of these methods, however, rely on RGB-D sensors, limiting outdoor applications. RGB-only SLAM with External Supervision. RGB-only SLAM methods overcome depth ambiguity through various external supervision signals. DIM-SLAM ( Li et al. 2023 ) employed neural implicit map representation with multi-resolution volume encoding and photometric warping loss. NICER-SLAM ( Zhu et al. 2024b ) incorporated monocular depth and normal supervision alongside RGB rendering losses. iMODE ( Matsuki et al. 2023 ) utilized ORB-SLAM2 for camera pose estimation while enhancing reconstruction through depth-rendered geometry supervision.