COMPASS: COmpact Multi-channel Prior-map And Scene Signature for Floor-Plan-Based Visual Localization

Muhammad Shaheer, Miguel Fernandez-Cortizas, Asier Bikandi-Noya · 2026

Read COMPASS: COmpact Multi-channel Prior-map And Scene Signature for Floor-Plan-Based Visual Localization by Muhammad Shaheer, Miguel Fernandez-Cortizas, Asier Bikandi-Noya (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-25388.txt.

Introduction

Shaheer and four colleagues put forth COMPASS, a scheme using floor plan shape and meaning to fix a dual-fisheye robot's pose. From the floor plan, rays in 360 azimuth bins are coded into five channels. They also give a fisheye window spotting scheme as a first step to full cross-modal matching. As a proof of concept, they make both descriptors at one known pose, and the two line up closely. The wall-window pattern seen in first frames tracks the floor plan descriptor. This backs cross-modal shape matching.

Catalog record

CREATORMuhammad Shaheer, Miguel Fernandez-Cortizas, Asier Bikandi-Noya
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE17688
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2604.25388

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

COMPASS: COmpact Multi-channel Prior-map And Scene Signature for Floor-Plan-Based Visual Localization Thanks: Authors are with the Automation and Robotics Research Group, Interdisciplinary Centre for Security, Reliability and Trust (SnT), University of Luxembourg (UL). Holger Voos is also associated with the Faculty of Science, Technology and Medicine, University of Luxembourg, Luxembourg. {muhammad.shaheer, miguel.fernandez, asier.bikandi, holger.voos, joseluis.sanchezlopez}@uni.lu Thanks: *This work was partially funded by the Fonds National de la Recherche of Luxembourg (FNR) under the project 19685965/BARCODE. For Open Access, the author has applied a CC BY 4.0 public copyright license to any Author Accepted Manuscript version arising from this submission. Muhammad Shaheer, Miguel Fernandez-Cortizas, Asier Bikandi-Noya Abstract Architectural floor plans are widely available priors which contain not only geometry but also the semantic information of the environment, yet existing localization methods largely ignore this semantic information. To address this, we present COMPASS, an algorithm that exploits both geometric and semantic priors from floor plans to estimate the pose of a robot equipped with dual fisheye cameras. Inspired by scan context descriptor from LiDAR-based place recognition, we design a multi-channel radial descriptor that encodes the geometric layout surrounding a position. From the floor plan, rays are cast in 360 azimuth bins and the results are encoded into five channels: normalized range, structural hit type (wall, window, or opening), range gradient, inverse range, and local range variance. From the image side, the same descriptor structure is populated by detecting structural elements in the fisheye imagery. As a first step toward full cross-modal matching, we present a window detection algorithm for fisheye images that uses a line segment detector to identify window frames via vertical edge clustering and brightness verification. Detected windows are projected to azimuthal bearings through the fisheye camera model, producing the hit-type channel of the visual descriptor. As a proof of concept, we generate both descriptors at a single known pose from the Hilti-Trimble SLAM Challenge 2026 dataset and demonstrate that the wall-window pattern extracted from the first frame of each camera closely matches the floor plan descriptor, validating the feasibility of cross-modal structural matching. I Introduction Indoor localization remains a core challenge for mobile robots in service, logistics, and construction applications. While LiDAR-based SLAM systems have matured considerably [ 1 ] , they rely on expensive range sensors and must build maps from scratch in every new environment. At the same time, 2D architectural floor plans are routinely produced during building design and encode the geometric layout of walls, doors, and windows with sufficient accuracy for navigation. Fig. 1 : Floor plan descriptor. Top left : ray cast overlaid on the floor plan (gray rays \to walls, red \to windows). Top center : polar range profile. Top right : the 5\times 360 descriptor matrix. Bottom : linearized range (blue), gradient (orange), with background shading by hit type. Existing floor-plan-based localization methods, however, underutilize the semantic information that floor plans provide. Particle-filter approaches [ 3 , 4 ] treat all structural boundaries identically, ignoring the distinction between walls and windows. LiDAR-based graph methods [ 6 , 7 ] exploit higher-level semantics but require 3D range sensors. Scan Context [ 8 ] and its variants [ 9 , 10 ] are effective for LiDAR place recognition, but encode only geometric properties (primarily height). They do not encode semantic element types, which limits discriminative power in indoor environments where rooms with similar geometry differ in their wall-window layout. We introduce COMPASS ( CO mpact M ulti-channel P rior-map A nd S cene S ignature), a descriptor for global localization that explicitly encodes both geometry and structural semantics in a unified representation. Our key insight is that the alternating pattern of walls, windows, and openings surrounding any indoor position constitutes a highly discriminative signature, and this pattern is encoded in the floor plan and visually observable in camera images. We propose a multi-channel radial descriptor of shape C\times N_{s} (with C{=}5 channels and N_{s}{=}360 azimuth bins at 1^{\circ} resolution) that captures range, structural element type (wall, window, or opening), range gradient, inverse range, and local range variance. By jointly encoding what an element is and where it is, COMPASS produces a more discriminative descriptor than purely geometric approaches. Our contributions are: (1) a five-channel radial descriptor that jointly encodes geometry and structural semantics from a 2D floor plan, going beyond purely geometric descriptors; (2) a window detection and bearing estimation algorithm for fisheye images that produces the hit-type channel of the same descriptor; and (3) cross-modal comparison demonstrating pattern agreement between floor plan and image descriptors. II COMPASS based Localization COMPASS consists of three components: (A) floor plan descriptor generation via ray casting, (B) visual descriptor generation from dual fisheye images, and (C) pose recovery, comprising descriptor matching for position and yaw via circular cross-correlation, and roll/pitch estimation via vanishing point analysis. II-A Floor Plan Descriptor Generation The floor plan is represented as two binary raster masks (see Fig. 1 ) at metric resolution \rho (m/pixel): a wall mask \mathcal{M}_{w} (dark pixels indicate walls) and a window mask \mathcal{M}_{g} (red-colored pixels mark glazing). II-A 1 Ray Casting From a candidate position \mathbf{p}=(t_{x},t_{y}) and heading \psi , we cast N_{s}=360 rays at uniformly spaced relative bearings \theta_{j}=2\pi j/N_{s} . Each ray is marched at step size \Delta_{s} until hitting a wall pixel, a window pixel, or reaching r_{\max} . This yields a range r_{j} and hit-type label h_{j}\in\{\text{wall},\text{window},\text{open}\} per bin. II-A 2 Five-Channel Descriptor The outputs are encoded into \mathbf{D}^{\text{map}}\in\mathbb{R}^{5\times N_{s}} : Ch. 0—Normalized range: \mathbf{D}(0,j)=r_{j}/r_{\max} . It distinguishes positions that are close to a wall from those in the middle of a large room. Two positions at different distances from the same wall will differ in this channel even if they share the same wall–window pattern. Ch. 1—Hit type: \mathbf{D}(1,j)=1.0 (wall), 0.5 (window), or 0.0 (open). This channel encodes the alternating wall–window pattern characteristic of building facades. Ch. 2—Range gradient: \mathbf{D}(2,j)=\min(|\nabla_{\theta}r_{j}|/r_{\text{clip}},\,1) , highlighting corners and depth discontinuities (clipped at r_{\text{clip}}=5 m). The range is usually smooth along a flat wall but jumps sharply at corners, doorways, and column edges where the range to the nearest surface changes abruptly. Ch. 3—Inverse range: \mathbf{D}(3,j)=1/(1+r_{j}) , correlating with the angular extent of elements in fisheye images. A wall at 2 m distance occupies a much larger angular extent in a fisheye image than the same wall at 20 m. Inverse range captures this relationship. Nearby surfaces produce large values, distant ones produce small values. Ch. 4—Local range variance: \mathbf{D}(4,j)=\text{std}(\{r_{k}:k\in\mathcal{N}_{w}(j)\})/\sigma_{\text{clip}} , capturing structural complexity within a window of half-width w{=}5 bins ( \sigma_{\text{clip}}=10 m). Some positions are surrounded by smooth, featureless walls (low variance), while others are near structurally complex areas such as corridor entrances, columns, or room boundaries, where the range changes rapidly across nearby bearings (high variance). This channel captures that structural complexity at a local scale, providing a complementary cue to the point-wise gradient of Ch. 2. Fig. 1 visualizes an example descriptor. II-B Visual Descriptor from Dual Fisheye Images The Hilti-Trimble 2026 dataset [ 11 ] provides dual fisheye images (front and back) from an Insta360 camera, jointly covering {\sim}360^{\circ} . The goal is to generate a visual descriptor \mathbf{D}^{\text{vis}}\in\mathbb{R}^{5\times N_{s}} using the same channel encoding as the floorplan descriptor. Because both descriptors encode

Read the complete text