Passage-Aware Structural Mapping for RGB-D Visual SLAM
Ali Tourani, Miguel Fernandez-Cortizas, Saad Ejaz, David Pérez Saura, Asier Bikandi-Noya, Jose Luis Sanchez-Lopez, Holger Voos · 2026
Read Passage-Aware Structural Mapping for RGB-D Visual SLAM by Ali Tourani, Miguel Fernandez-Cortizas, Saad Ejaz, David Pérez Saura, Asier Bikandi-Noya, Jose Luis Sanchez-Lopez, Holger Voos (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-24707.txt.
Introduction
Tourani and six colleagues make RGB-D visual SLAM for indoor robots passage-aware. Indoor robots need to know where they can pass from room to room. Doors and openings that robots can pass through matter for navigation, yet are little studied in modern mapping tools. Their method fuses geometric, semantic and topological cues, models doors as flat parts of walls, and infers passages from travel evidence and gaps in wall shape. In vS-Graphs, it adds passage-level structure to scene graphs and improves room links.
Catalog record
| CREATOR | Ali Tourani, Miguel Fernandez-Cortizas, Saad Ejaz, David Pérez Saura, Asier Bikandi-Noya, Jose Luis Sanchez-Lopez, Holger Voos |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 19212 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2604.24707
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Passage-Aware Structural Mapping for RGB-D Visual SLAM Thanks: Interdisciplinary Centre for Security, Reliability, and Trust (SnT), University of Luxembourg, Luxembourg. Holger Voos is also affiliated with the Faculty of Science, Technology, and Medicine at the University of Luxembourg, Luxembourg. {ali.tourani, miguel.fernandez, saad.ejaz, asier.bikandi, joseluis.sanchezlopez, holger.voos}@uni.lu Thanks: Universidad Politécnica de Madrid, Spain. [email protected] Thanks: Faculty of Science, Technology, and Medicine at the University of Luxembourg, Luxembourg. Ali Tourani, Miguel Fernandez-Cortizas, Saad Ejaz, David Pérez Saura, Asier Bikandi-Noya, Jose Luis Sanchez-Lopez, Holger Voos Abstract Doorways and passages are critical structural elements for indoor robot navigation, yet they remain underexplored in modern Visual SLAM (VSLAM) frameworks. This paper presents a passage-aware structural mapping approach for RGB-D VSLAM that detects doors and traversable openings by jointly fusing geometric, semantic, and topological cues. Doors are modeled as planar entities embedded within walls and classified as traversable or non-traversable based on their coplanarity with the supporting wall. Passages are inferred through two complementary strategies: traversal evidence accumulated from camera–wall interactions across consecutive keyframes, and geometric opening validation based on discontinuities in the mapped wall geometry. The proposed method is integrated into vS-Graphs as a proof of concept, enriching its scene graph with passage-level abstractions and improving room connectivity modeling. Qualitative evaluations on indoor office sequences demonstrate reliable doorway detection, and the framework lays the foundation for exploiting these elements in BIM-informed VSLAM. The source code is publicly available at https://github.com/snt-arg/visual_sgraphs/tree/doorway_integration . I Introduction & Related Works Simultaneous Localization and Mapping (SLAM) has emerged as a fundamental capability of modern autonomous robots, allowing them to estimate their pose while incrementally reconstructing the surrounding environment [ 1 ] . Such a capability is crucial for robotic situational awareness [ 2 ] and encompasses a broad range of tasks, including navigation, exploration, and inspection. Among the available sensing modalities in SLAM, vision sensors provide a cost-effective means of capturing rich visual and structural data, leading to the emergence of Visual SLAM (VSLAM) [ 3 ] . With the considerable progress in VSLAM, retrieving geometric information ( e.g., 3D points) is often insufficient for understanding the environment, despite its impact on localization and basic mapping. Accordingly, modern VSLAM approaches also incorporate the semantic and structural information of mapped entities, such as walls, chairs, and tables [ 4 , 5 ] . Fig. 1 : Overview of door and passage mapping within vS-Graphs [ 9 ] , where semantic and geometric cues jointly localize traversable openings, enabling robust downstream tasks such as navigation and path planning. Augmenting VSLAM with semantic information enables more interpretable and structurally meaningful map reconstruction. In this direction, Tao et al. [ 6 ] integrate semantic perception and mapping to generate trajectories that maximize information gain with uncertainty reduction. Despite the rich map reconstructions, the method introduces considerable system complexity and limited scalability. SemanticFusion [ 7 ] produces temporally consistent semantic maps by probabilistically fusing predictions from multiple viewpoints at the expense of high computational cost. Khronos [ 8 ] employs semantic segmentation to identify short-term and long-term scene dynamics; however, its primary focus remains on dynamic objects rather than structural scene understanding. Other approaches emphasize semantic representations of the environment layout, aiming to construct richer, more interpretable maps that include architectural entities such as walls and rooms. vS-Graphs [ 9 ] proposes a tightly coupled framework that jointly optimizes VSLAM and 3D scene graph generation within a unified factor graph. Incorporating building components ( i.e., walls and ground surfaces), structural elements ( i.e., rooms and floors), and their spatial relations produces geometrically grounded and semantically coherent environment representations. However, the framework does not model doorways , largely due to the absence of dense point cloud information. In [ 10 ] , doorway detection and mapping are achieved using fiducial markers placed on door frames. However, the approach relies on prior environmental instrumentation, which limits its practicality and scalability. It should be noted that passages are critical components of indoor spaces and have a special SLAM signature, as they define traversable openings between enclosed regions ( e.g., rooms) and establish their inter-connectivity. From a robotic perspective, passages are topologically meaningful landmarks that indicate transitions between navigable spaces. Their detection extends room modeling beyond wall-only enclosures toward a richer structural-topological abstraction, supporting downstream tasks such as situationally aware navigation [ 14 ] . Furthermore, incorporating prior knowledge from Building Information Modeling (BIM) can provide complementary structural constraints, enabling more reliable validation of passages. Such priors enhance robustness in partially observed environments by aligning reconstructed geometry with known architectural layouts. To address this gap, this paper makes the following contributions: • Formulating passage detection as traversable openings in walls by jointly fusing geometric, semantic, and topological cues. • Integrating passages into a VSLAM system (vS-Graphs [ 9 ] as a proof of concept, extendable to other backbones), enabling improved room connectivity modeling and environment understanding. • Publicly available source code to facilitate reproducibility and further research in the field. II Proposed Method II-A Formalism Given an RGB-D point cloud at the VSLAM KeyFrame level, a panoptic segmentation method such as YOSO [ 11 ] can be used to extract semantically meaningful planar entities, including walls and doors [ 9 ] . Each KeyFrame is defined as K_{t}=\{\mathbf{P}_{t},L_{t},\varepsilon_{t}\}, where \mathbf{P}_{t}=\{\mathbf{p}_{i}\in\mathbb{R}^{3}\} denotes the 3D point cloud, L_{t} the RGB image, and \varepsilon_{t} the associated mapping metadata (e.g., camera pose). Applying panoptic segmentation to L_{t} yields pixel-wise semantic labels and instance-level masks, which are projected onto \mathbf{P}_{t} to obtain semantically segmented point subsets \mathbf{P}_{\Psi}^{K_{t}}=S(\mathbf{P}_{t},L_{t})=\{\mathbf{P}_{wall}^{K_{t}},\mathbf{P}_{door}^{K_{t}},\dots\}, where each \mathbf{P}_{\psi}^{K_{t}}\subset\mathbf{P}_{t} corresponds to a semantic class \psi . To reduce redundancy and sensor noise, each segmented subset is refined through downsampling and range-based filtering, and then processed with RANSAC plane fitting [ 13 ] to estimate semantically validated planar entities. For each subset {\mathbf{P}}_{\psi}^{K_{t}} , a plane \pi=(\mathbf{n},d) is estimated, where \mathbf{n}\in\mathbb{R}^{3} is the normal and d\in\mathbb{R} the plane offset, such that a point \mathbf{p}_{r}\in{\mathbf{P}}_{\psi}^{K_{t}} is considered an inlier if \mathrm{dist}(\mathbf{p}_{r},\pi)\leq\epsilon, with \epsilon denoting the inlier threshold. The validated planar entities detected in KeyFrame K_{t} are subsequently inserted into the map and used for continuous structural reconstruction. Among these semantic entities, locating doors and passages ( e.g., doorways, archways, etc. ) is particularly valuable for downstream robotic tasks such as navigation and exploration. II-A 1 Doors A door \mathbf{P}_{door}^{K_{t}}\subset\mathbf{P}_{\Psi}^{K_{t}} is modeled as a physical planar structural object extracted from RGB-D observations. Since doors are typically embedded within walls, their traversability can be inferred from their geometric relation to the associated supporting wall. Let \pi_{d}=(\mathbf{n}_{d},d_{d}) and \pi_{w}=(\mathbf{n}_{w},d_{w}) be the estimated door and wall planes, respectively. The door is “ closed/non-traversable ” if it is approximately coplanar with its supporting wall: \cos^{-1}\left(|\mathbf{n}_{d}^{\top}\mathbf{n}_{w}|\right)<\tau_{\theta}\quad\text{and}\quad|d_{d}-d_{w}|<\tau_{d}. (1) where \tau_{\theta} and \tau_{d} are predefined thresholds for angular alignment and coplanarity, respectively. Satisfying both conditions indicates that the detected door lies approximately on the same plane as its supporting wall. II-A 2 Passages A passage is defined as Q_{i}=\{\mathbf{P}_{wall},\rho_{i},\eta_{i},m\} , representing an opening (potentially blocked) embedded within a wall. Here, \rho_{i}\in\mathbb{R}^{3} denotes the passage centroid in the global reference frame, \eta_{i}\in\mathbb{R}^{2} encodes its geometric extent ( e.g., width and height), and m stores its semantic variant ( e.g., doorway , archway , or unknown ). When a closed door instance \mathbf{P}_{door} is detected, a