PointSLAM++: Robust Dense Neural Gaussian Point Cloud-based SLAM
Xu Wang, Boyao Han, Xiaojun Chen, Ying Liu, Ruihui Li · 2026
Read PointSLAM++: Robust Dense Neural Gaussian Point Cloud-based SLAM by Xu Wang, Boyao Han, Xiaojun Chen, Ying Liu, Ruihui Li (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2601-11617.txt.
Introduction
Xu Wang, Boyao Han, Xiaojun Chen, Ying Liu, and Ruihui Li present PointSLAM++. Their 2026 preprint builds a dense neural SLAM system. Real-time 3D reconstruction is crucial for robotics and AR. SLAM maps a space while tracking the sensor in it.
Depth noise often breaks structural consistency in such maps. Pose estimation also turns shaky when depth data err. PointSLAM++ uses a Gaussian point cloud representation. The Gaussians are hierarchically constrained to hold structure. Constraints keep walls and edges true as the map grows. Gaussian primitives then render the scene for the map. The system takes RGB-D input, color plus depth. Robust poses under noise are the stated design aim.
Catalog record
| CREATOR | Xu Wang, Boyao Han, Xiaojun Chen, Ying Liu, Ruihui Li |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 31 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2601-11617
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
PointSLAM++: Robust Dense Neural Gaussian Point Cloud-based SLAM Xu Wang, Boyao Han, Xiaojun Chen, Ying Liu, Ruihui Li Abstract Real-time 3D reconstruction is crucial for robotics and augmented reality, yet current simultaneous localization and mapping(SLAM) approaches often struggle to maintain structural consistency and robust pose estimation in the presence of depth noise. This work introduces PointSLAM++, a novel RGB-D SLAM system that leverages a hierarchically constrained neural Gaussian representation to preserve structural relationships while generating Gaussian primitives for scene mapping. It also employs progressive pose optimization to mitigate depth sensor noise, significantly enhancing localization accuracy. Furthermore, it utilizes a dynamic neural representation graph that adjusts the distribution of Gaussian nodes based on local geometric complexity, enabling the map to adapt to intricate scene details in real time. This combination yields high-precision 3D mapping and photorealistic scene rendering. Experimental results show PointSLAM++ outperforms existing 3DGS-based SLAM methods in reconstruction accuracy and rendering quality, demonstrating its advantages for large-scale AR and robotics. Introduction Figure 1: PointSLAM++ outperforms state-of-the-art methods from CVPR 2024 in photorealistic 3D reconstruction and camera tracking, excelling in key metrics. In complex environments where MonoGS fails, it maintains accurate localization and high-quality 3D mapping. Visual SLAM uses monocular, stereo, or RGB-D images to reconstruct 3D scenes and estimate camera trajectories. Its widespread adoption in robotics, VR, and AR has intensified demands for higher-fidelity rendering and robust motion estimation ( 39 ) . Traditional RGB-D SLAM (feature- or voxel-based) ensures stable tracking but yields coarse details ( 7 ; 15 ; 22 ) , while neural implicit methods (e.g., iMAP ( 27 ) , NICE-SLAM ( 37 ) ) achieve dense reconstructions at high computational cost and limited scale. This efficiency–quality trade-off has spurred new SLAM representations ( 1 ; 3 ; 5 ; 23 ; 30 ) . Recently, 3D Gaussian Splatting (3DGS) ( 16 ) emerged as a hybrid paradigm, using anisotropic Gaussians and differentiable splatting to combine point-cloud efficiency with neural-rendering fidelity ( 36 ) . Systems like MonoGS ( 20 ) demonstrate real-time photorealistic reconstruction and joint pose–geometry optimization, though challenges remain with sensor noise, dynamic scenes, and large-scale environments ( 11 ; 14 ; 20 ; 32 ; 10 ) . Figure 2: SLAM System Overview. The system’s input is a sequence of RGB-D frames. We generate a point cloud by downsampling and reprojecting the current depth image, and we estimate the current pose using GICP and ORB features. During tracking, we create anchor points from the point cloud and utilize a neural network to predict the Gaussian distribution in the scene, rendering the scene using a specialized Gaussian rasterizer. We continuously optimize the multi-layer perceptron (MLP) during the mapping process using the RGB-D information. Right: We use anchor points and features as input to the MLP to predict the various attributes of the Gaussians. Current 3DGS-SLAM methods face three major challenges. First, reliance on precise depth information: an overdependence on high-quality depth maps causes the accuracy of tracking and reconstruction to fall in the presence of depth noise, missing data, or occlusions ( 4 ; 6 ) . Second, Gaussian sphere overfitting: existing techniques fit a Gaussian sphere to every training view, ignoring local scene structure, which introduces significant redundancy and limits scalability in complex, large-scale environments ( 34 ) . Third, weak view dependence: view-dependent effects are baked into a single Gaussian parameter, yielding poor interpolation capabilities and low robustness to extensive viewpoint and illumination changes. Addressing these issues is essential for achieving scalable, high-fidelity 3DGS-SLAM. This paper introduces PointSLAM++, a real-time 3D reconstruction system using RGB-D cameras. Using a learnable neural Gaussian representation with hierarchical constraints and progressive pose optimization, it enables precise mapping and realistic rendering of scenes. To eliminate reliance on precise depth information, we propose a progressive optimization scheme to achieve accurate pose estimation: we apply the iterative closest point (ICP) algorithm for rigid registration of depth data and integrate ORB-feature-based visual constraints for joint refinement. Within a multi-scale pyramid, we simultaneously minimize the depth point-cloud residuals and the ORB-based visual reprojection errors ( 2 ) . However, under challenging conditions—such as high-speed motion, low-texture regions, or dynamic interference—tracking can still be lost. To recover the camera pose quickly when conventional tracking fails, we introduce a relocalization mechanism based on global feature matching. To meet the demands of real-time incremental mapping and high-precision reconstruction, stable ORB feature point clouds from tracking are fused with depth sensor data for map construction. The point cloud is then converted into neural Gaussian “anchors” endowed with position, scale, and related parameters, and their distributions are constrained by the scene’s geometric structure. A two-tier anchor mechanism includes primary anchors for global structure and secondary anchors for fine detail, enabling incremental updates and detail enrichment while preserving robust pose estimation and geometric accuracy. Finally, camera-view vectors are embedded into each anchor’s appearance features to compensate for viewpoint-dependent lighting and reflectance effects, thereby enhancing reconstruction quality under complex illumination and varying viewpoints. In summary, our contributions are as follows: • We present PointSLAM++, a real-time RGB-D SLAM system that unifies geometric and visual pose refinement with a hierarchical Neural-Gaussian representation for precise mapping and photorealistic rendering. • We develop a progressive multi-scale pose optimization that jointly minimizes ICP depth residuals and ORB reprojection errors, and we add a global-feature relocalization module to recover from fast motion or low-texture tracking failures. • We propose a two-tier neural-Gaussian anchor framework that fuses ORB feature clouds with depth data and embeds camera-view vectors to adaptively enhance detail and compensate for view-dependent lighting. Related Work Classical RGBD SLAM Traditional RGB-D dense SLAM evolves through three stages: KinectFusion ( 22 ) achieved real-time TSDF reconstruction via ICP ( 8 ) ; ElasticFusion ( 31 ) enhanced large-scale topological consistency through graph-based non-rigid deformation; and BundleFusion ( 5 ) improved robustness via hierarchical optimization and global loop closure. However, voxel and point-based semantic SLAM remain computationally heavy and inconsistent. SDF-based methods, while accurate, suffer from memory and scalability limits due to uniform grids ( 29 ) . Moreover, post-processing like CRF segmentation causes label misalignment and blurred boundaries from decoupled optimization. Figure 3: GICP Mismatches in TUM Scenes. Even with high-precision depth data, real-world noise can lead to misalignments in GICP-based pose estimation, as illustrated here in the TUM dataset. NeRF-based RGBD SLAM The strong scene representation ability of Neural Radiance Fields ( 21 ) (NeRF) has driven their use in 3D reconstruction and localization. NeRF-based SLAM builds continuous implicit functions via MLPs that map 3D coordinates to radiance and density ( 28 ; 13 ) . This overcomes the resolution limits of voxel and point-based models, achieving sub-voxel accuracy in static scenes (e.g., iMAP ( 27 ) , NICE-SLAM ( 37 ) ). Yet, challenges remain in optimization efficiency, dynamic scene disentanglement, and scalability, hindering robustness in large, real-world environments ( 12 ) . Gaussian-based RGBD SLAM 3D Gaussian Splatting ( 16 ) has recently reshaped RGB-D SLAM. Approaches such as Gaussian-Splatting SLAM ( 20 ; 17 ) exploit analytical Jacobians and geometric regularization for photorealistic reconstruction, surpassing NeRF in accuracy. GS-ICP SLAM ( 9 ) further integrates Gaussian covariance into a G-ICP framework, achieving sub-millimeter alignment at twice the speed