UnLoc: Leveraging Depth Uncertainties for Floorplan Localization
Matthias Wüest, Francis Engelmann, Ondrej Miksik, Marc Pollefeys, Daniel Barath · 2025
Read UnLoc: Leveraging Depth Uncertainties for Floorplan Localization by Matthias Wüest, Francis Engelmann, Ondrej Miksik, Marc Pollefeys, Daniel Barath (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2509-11301.txt.
Introduction
Matthias Wüest and four co-authors present UnLoc in this 2025 computer vision paper. It finds where a camera is inside a building. Only a floorplan is used. Floorplans are easy to get. They stay valid for years. Furniture changes do not matter.
Earlier floorplan methods treated depth predictions as certain. They often needed a custom depth network per building. UnLoc models each depth estimate as a probability distribution. The uncertainty flows into the position estimate. General pre-trained depth models replace per-site training. Large synthetic and real datasets were used for evaluation. UnLoc beat prior methods. The biggest gains came on the LaMAR benchmark. Recall rose several-fold on long and short sequences there.
Catalog record
| CREATOR | Matthias Wüest, Francis Engelmann, Ondrej Miksik, Marc Pollefeys, Daniel Barath |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 47 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2509-11301
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
UnLoc: Leveraging Depth Uncertainties for Floorplan Localization Matthias Wüest, Francis Engelmann, Ondrej Miksik, Marc Pollefeys, Daniel Barath Abstract We propose UnLoc, an efficient data-driven solution for sequential camera localization within floorplans. Floorplan data is readily available, long-term persistent, and robust to changes in visual appearance. We address key limitations of recent methods, such as the lack of uncertainty modeling in depth predictions and the necessity for custom depth networks trained for each environment. We introduce a novel probabilistic model that incorporates uncertainty estimation, modeling depth predictions as explicit probability distributions. By leveraging off-the-shelf pre-trained monocular depth models, we eliminate the need to rely on per-environment-trained depth networks, enhancing generalization to unseen spaces. We evaluate UnLoc on large-scale synthetic and real-world datasets, demonstrating significant improvements over existing methods in terms of accuracy and robustness. Notably, we achieve 2.7 2.7 times higher localization recall on long sequences (100 frames) and 16.7 16.7 times higher on short ones (15 frames) than the state of the art on the challenging LaMAR HGE dataset. Figure 1 : The proposed UnLoc processes an input image sequence to predict the floorplan depth (in meters) and associated uncertainty for each image column. Using these predictions, it generates a probability distribution over potential \text{SE}(2) camera poses and outputs the most likely one (blue arrow). The ground truth pose of the last frame is also shown (red arrow), overlapped by the predicted pose. 1 Introduction Camera localization within indoor environments is a fundamental problem in computer vision, essential for applications in augmented reality and robotics. Accurate localization enables devices to understand their spatial context, facilitating tasks such as navigation, object interaction, and autonomous exploration. Traditional localization methods often rely on pre-built 3D models [ 41 , 43 , 30 , 39 , 36 ] or extensive image databases [ 44 , 2 , 23 , 48 ] , which are storage-intensive and require substantial maintenance, limiting their scalability to new or dynamically changing environments. Floorplans offer a lightweight and readily available alternative for indoor localization. As 2D representations of spaces, floorplans are easy to obtain [ 29 , 56 ] and remain unaffected by changes in appearance, such as furniture rearrangements or lighting variations. Recent methods have leveraged floorplans for localization by aligning images with the map [ 18 , 32 , 10 ] , enabling devices to localize within new environments as long as a floorplan is available. Among these, F 3 Loc [ 10 ] has emerged as a recent promising approach for sequential visual floorplan localization, significantly outperforming all previous baselines. It integrates observations over time using a histogram filter, achieving impressive accuracy and computational efficiency on a range of datasets. However, as promising as it is, F 3 Loc has notable limitations that hinder its practical deployment, which we aim to improve upon in this paper: Lack of Uncertainty Modeling: F 3 Loc combines monocular and multi-view depth estimation. However, it assumes that the resulting predictions are all of similar accuracy, and it has no means to represent and predict the uncertainties in the depth predictions. In indoor environments, depth estimation is often unreliable in regions with glass walls, open doorways, or large, featureless walls. When fusing a sequence of predictions, not accounting for uncertainty, inaccurate depth predictions adversely affect the localization process, leading to erroneous pose estimates. Dataset-Specific Depth Networks: F 3 Loc relies on a custom depth prediction network that must be trained separately for each dataset or environment. This per-dataset training requirement poses significant challenges for scalability and robustness. Collecting sufficient depth data for retraining the depth network for every new environment is impractical, especially when rapid deployment is desired. This paper addresses these shortcomings by introducing a novel visual floorplan localization method that incorporates uncertainty estimation into monocular depth prediction and uses it to robustly fuse predictions from a sequence of images. Also, our method enables us to leverage pre-trained monocular depth models. Our contributions are: • Uncertainty-Aware Depth Prediction: We model floorplan depth predictions as explicit probability distributions, enabling us to represent the uncertainty associated with each estimate. This uncertainty-aware approach improves localization by weighting predictions according to their confidence levels, which is particularly beneficial in challenging areas prone to depth estimation errors. • Leveraging Off-the-Shelf Depth Models: Instead of training custom depth networks for each environment, we utilize state-of-the-art monocular depth networks pre-trained on large-scale datasets [ 53 ] . These models provide accurate depth predictions out-of-the-box, eliminating the need for extensive per-environment training and enhancing the method’s generalization to new settings. The proposed UnLoc (see Fig. 1 ) demonstrates significant improvements in accuracy and robustness on multiple datasets compared to the state of the art. 2 Related work Figure 2 : Method overview. At timestep t , UnLoc aligns an image with gravity and processes it through a pretrained monodepth encoder. Features extracted at this step, along with a binary mask from the gravity alignment, are used to predict the floorplan depth \mathbf{\hat{d}}_{t} and its uncertainty \mathbf{\hat{b}}_{t} via a masked attention mechanism. These predictions are used to form equiangular rays to perform uncertainty-aware matching with the floorplan’s occupancy map. Finally, a histogram filter fuses the observation likelihood with the integrated past belief. Visual localization is a fundamental problem in computer vision, addressed through various approaches. Traditional methods include image retrieval techniques [ 12 , 21 , 2 , 23 , 48 ] , which find the most similar images in a database and estimate the pose of the query image based on the retrieved ones. Structure-from-Motion-based approaches [ 1 , 44 , 42 , 36 ] build a 3D model of the environment and establish 2D-3D correspondences by matching local descriptors, computing camera poses using minimal solvers [ 27 ] and RANSAC [ 15 ] or its recent variants [ 4 , 3 ] . Scene coordinate regression methods [ 8 , 9 ] learn to regress the 3D coordinates of image pixels, while pose regression techniques [ 25 , 24 ] use networks to predict a 6-DoF camera pose from input images directly. These methods often rely on pre-built 3D models that are storage-intensive and scene-specific, limiting their applicability in unseen environments. To overcome this, floorplan-based localization methods have emerged, utilizing overhead images or floorplans to estimate the \text{SE}(2) pose of the camera [ 50 , 46 ] . These approaches can localize images in new scenes as long as a floorplan is provided. Floorplan localization is frequently associated with LiDAR sensors [ 33 , 54 , 58 ] , which are impractical for widespread mobile device use. Alternative methods reconstruct 3D geometry using depth cameras [ 49 ] or visual odometry [ 34 ] . Some approaches extract geometric features like room edges to align with the floorplan [ 7 , 28 ] . However, these methods often assume known camera or room height, which is not always feasible. Recent learning-based methods aim to use only RGB images for floorplan localization. LaLaLoc [ 19 ] estimates the position of panoramic images in a floorplan by embedding map and image features into a shared space. LaLaLoc++ [ 18 ] removes the known camera and ceiling height assumption by directly embedding the floorplan. LASER [ 32 ] represents the