MonoSpheres: Large-Scale Monocular SLAM-Based UAV Exploration through Perception-Coupled Mapping and Planning

Tomáš Musil, Matěj Petrlík, Martin Saska · 2025

Read MonoSpheres: Large-Scale Monocular SLAM-Based UAV Exploration through Perception-Coupled Mapping and Planning by Tomáš Musil, Matěj Petrlík, Martin Saska (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2511-17299.txt.

Introduction

Tomáš Musil, Matěj Petrlík, and Martin Saska present MonoSpheres, a system that lets a drone explore unknown spaces with a single camera and no range sensors. Monocular exploration is largely unsolved at scale because one camera yields sparse, uncertain depth. MonoSpheres is built around the quirks of its sparse monocular mapping front end, designing both mapping and planning to respect what that front end can and cannot see.

The mapper oversamples free space where textures are sparse and tracks uncertainty in obstacle positions. The planner replans rapidly and steers the camera's heading to gather the views it needs. The authors show frontier-based exploration still works from sparse depth if parallax and textureless surfaces are handled. Tests in real and simulated indoor and outdoor environments, including the first real-world outdoor demonstrations of this kind, support the design. Code is open-sourced.

Catalog record

CREATORTomáš Musil, Matěj Petrlík, Martin Saska
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE35 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2511-17299

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

MonoSpheres: Large-Scale Monocular SLAM-Based UAV Exploration through Perception-Coupled Mapping and Planning Tomáš Musil, Matěj Petrlík, Martin Saska Abstract Autonomous exploration of unknown environments is a key capability for mobile robots, but it is largely unsolved for robots equipped with only a single monocular camera and no dense range sensors. In this paper, we present a novel approach to monocular vision-based exploration that can safely cover large-scale unstructured indoor and outdoor 3D environments by explicitly accounting for the properties of a sparse monocular SLAM frontend in both mapping and planning. The mapping module solves the problems of sparse depth data, free-space gaps, and large depth uncertainty by oversampling free space in texture-sparse areas and keeping track of obstacle position uncertainty. The planning module handles the added free-space uncertainty through rapid replanning and perception-aware heading control. We further show that frontier-based exploration is possible with sparse monocular depth data when parallax requirements and the possibility of textureless surfaces are taken into account. We evaluate our approach extensively in diverse real-world and simulated environments, including ablation studies. To the best of the authors’ knowledge, the proposed method is the first to achieve 3D monocular exploration in real-world unstructured outdoor environments. We open-source our implementation to support future research. Code— https://github.com/ctu-mrs/monospheres I INTRODUCTION In recent years, significant advances have been presented in mobile robot autonomy, enabling robot systems to explore unknown 3D environments that span kilometers in scale [ 24 , 10 , 17 ] . These advances are critical for allowing the deployment of uncrewed aerial vehicles (UAVs) in real-world applications, such as search-and-rescue, wildfire response or planetary exploration. However, the mapping and planning methods used in unknown environments currently rely on dense range sensors, such as LiDARs or depth cameras. Such sensors are heavy, expensive, and thus severely limit the affordability and flight time of autonomous UAVs. Monocular cameras and inertial measurement units (IMUs) are orders of magnitude lighter and less expensive, but monocular-only exploration of unknown environments has only been demonstrated at the scale of a few indoor rooms [ 25 , 18 , 21 , 23 ] . The main challenge can be attributed to the fact that the existing methods depend on reliable and dense depth estimates and obtaining such estimates from a monocular camera is not yet fully solved [ 12 , 19 ] . Thus, when classical mapping methods are used with any existing monocular depth estimation method, the resulting maps are either too sparse to allow planning in large-scale environments [ 25 , 18 ] , or they contain wrongly estimated free space, which leads to crashes [ 21 , 6 ] . Fig. 1: Illustration of the proposed approach. The mapping pipeline estimates depth using virtual (blue) and tracked (red) points from sparse monocular-inertial SLAM (left) running on board the UAV (top) to construct a large-scale map (right) consisting of free-space spheres (green), obstacle points (red) and frontier points (magenta). In this paper, we identify three core properties of motion-based depth sensing and show that explicitly designing the mapping and planning based on these principles can enable autonomy both indoor and outdoor, and at scales comparable to dense sensing methods. In essence, our mapping approach interpolates depth and intelligently estimates free space in texture-sparse areas, solving the problem of sparse free space, while keeping track of obstacle position uncertainties to avoid wrongly deleting mapped obstacles. Our planning approach handles the uncertain depth estimates by flying in the direction of the camera, rapidly replanning when new information is obtained and ensuring pure translational motion when visiting exploration viewpoints. We evaluate our approach in multiple real-world scenarios, simulations, and ablation studies, demonstrating that it achieves exploration in both indoor and outdoor environments, and at considerably larger scales than existing monocular exploration methods. As a step towards low-cost vision-based UAV autonomy in unknown environments, our paper brings the following contributions: • A novel monocular 3D mapping method with perception-coupled modules that significantly increase the reliability of mapped free space and obstacles with unreliable, sparse, motion-based depth data as input. • A perception-aware exploration approach, enabled by the proposed mapping method, that achieves large-scale 3D outdoor exploration on a UAV equipped with only a monocular camera and IMU, validated in real-world conditions. • Open-sourced code for the proposed methods, along with example simulation scripts for replicating our results, providing a benchmark for new monocular exploration methods. II Problem Statement The problem addressed in this paper is actively building an explicit 3D map of free and occupied space in a bounded unknown environment. In the case of robots equipped with dense depth sensors (most commonly LiDAR, RGBD, stereo cameras), this is a well-studied research problem [ 24 , 17 , 26 ] . These works implicitly assume that from any given viewpoint, the sensor will uncover all obstacles up to its sensing range, and that non-detection of obstacles means that free-space can be initialized in the given direction [ 13 , 9 , 15 , 5 ] . However, this assumption does not apply for monocular depth sensing. Motion-based depth sensing, as used in monocular SLAM algorithms, can only estimate depth for textured surfaces and requires sufficient parallax to do so. Single-image learning-based monocular depth estimation methods [ 12 , 19 ] can provide dense depth estimates, but they are not yet reliable enough for safe navigation in general unknown environments [ 21 , 6 ] . Thankfully, motion-based depth sensing does have some regularities that can be exploited to design mapping and planning that could handle the uncertain and sparse depth estimates. We base our solution to this problem on the following key assumptions/observations about monocular motion-based depth sensing applicable to most of the monocular SLAM algorithms: 1. Depth accuracy generally increases with decreasing distance to obstacles, as the inverse of depth errors are gaussian [ 4 ] and since objects occupy more pixels in the image, making them more likely to be detected. 2. In outdoor environments, the UAV can encounter large textureless areas where no depth can be estimated by classic motion-based methods (e.g. above horizon on a clear day) that initialize depth by tracking texture. 3. Measuring depth requires sufficient translational motion, making the depth measurements trajectory dependent , which is not the case with dense range sensors. III Related Works One approach to solving the monocular exploration problem is to use deep learning-based monocular depth estimation models to essentially turn the monocular camera into a dense depth sensor, and then use classical mapping and planning methods. The authors of [ 21 , 23 ] have demonstrated using learning-based depth estimation models combined with traditional navigation approaches. However, the authors of [ 21 ] demonstrate autonomy only at the scale of a single room, while also encountering collisions and map deformations due to depth estimation errors. The authors of [ 6 ] present navigation with obstacle avoidance using pretrained and finetuned monocular depth models in larger outdoor environments in simulation, but also note a high collision and navigation failure rate due to the same problems. As further discussed in recent surveys [ 12 , 19 ] , current depth estimation models still struggle to provide real-time onboard performance and reliable generalization in domains that the model

Read the complete text