Time-Optimized Safe Navigation in Unstructured Environments through Learning Based Depth Completion
Jeffrey Mao 1, Raghuram Cauligi Srinivas 1, Steven Nogar 2, and Giuseppe Loianno 1 · 2025
Read Time-Optimized Safe Navigation in Unstructured Environments through Learning Based Depth Completion by Jeffrey Mao 1, Raghuram Cauligi Srinivas 1, Steven Nogar 2, and Giuseppe Loianno 1 (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2506-14975.txt.
Introduction
Jeffrey Mao and co-authors present a full onboard navigation system for quadrotor drones, in this 2025 paper. Small drones lack room for heavy laser scanners, yet must dodge obstacles in unknown places in real time. Their system builds a dense 3D map from camera depth alone.
A new depth method fuses stereo and learned single-camera depth, giving longer range and cleaner maps than stereo alone. On that map, a planner computes time-optimal, collision-free paths and refines them as new depth arrives. Both parts beat prior methods on speed while guaranteeing clear paths. Flight tests indoors and outdoors confirmed safe travel in new settings.
Catalog record
| CREATOR | Jeffrey Mao 1, Raghuram Cauligi Srinivas 1, Steven Nogar 2, and Giuseppe Loianno 1 |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 44 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2506-14975
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Time-Optimized Safe Navigation in Unstructured Environments through Learning Based Depth Completion Jeffrey Mao 1, Raghuram Cauligi Srinivas 1, Steven Nogar 2, and Giuseppe Loianno 1 Abstract Quadrotors hold significant promise for several applications such as agriculture, search-and-rescue, and infrastructure inspection. Achieving autonomous operation requires systems to navigate safely through complex and unfamiliar environments. This level of autonomy is particularly challenging due to the complexity of such environments and the need for real-time decision-making—especially for platforms constrained by size, weight, and power (SWaP), which limits flight time and precludes the use of bulky sensors like Light Detection and Ranging (LiDAR) for mapping. Furthermore, computing globally optimal, collision-free paths and translating them into time-optimized, safe trajectories in real time adds significant computational complexity. To address these challenges, we present a fully onboard, real-time navigation system that relies solely on lightweight onboard sensors. Our system constructs a dense 3D map of the environment using a novel visual depth estimation approach that fuses stereo and monocular learning-based depth, yielding longer-range, denser, and less noisy depth maps than conventional stereo methods. Building on this map, we introduce a novel planning and trajectory generation framework capable of rapidly computing time-optimal global trajectories. As the map is incrementally updated with new depth information, our system continuously refines the trajectory to maintain safety and optimality. Both our planner and trajectory generator outperforms state-of-the-art methods in terms of computational efficiency and guarantee obstacle-free trajectories. We validate our system through robust autonomous flight experiments in diverse indoor and outdoor environments, demonstrating its effectiveness for safe navigation in previously unknown settings. {IEEEkeywords} Aerial Systems: Perception and Autonomy, Collision Avoidance, RGB-D Perception, Vision-Based Navigation Video : https://www.youtube.com/watch?v=vC5Dw1idMug † † corresponding: Corresponding author: Jeffrey Mao (email: [email protected]). 1 Introduction Method Devo [ 1 ] MINCO [ 2 ] Saviolo [ 3 ] OUR Rappids [ 4 ] Lee [ 5 ] Super [ 6 ] Zhou [ 7 ] Sensors 1x RGB 1x RGBD 1x RGBD 1x RGBD 2x Stereo Pairs 2x RGBD 1x LiDAR 1x LiDAR Total Sensor Mass 5 g 15 g 72 g 100 g 127 g 200 g 265 g 840 g Sensor Range N/A 3 m 8 m 10 m 3 m 6 m 40 m 100 m Safety Guarantee No No Yes Yes Yes Yes Yes Yes Traj. Planning Learning Global Local Global Local Local Global Local Table 1: Autonomous Navigation Systems Comparisons. Safety Guarantees in our use case is defined as the trajectory solved can never intersect with an obstacle or closer than some safety distance. It should be noted that Super [ 6 ] trajectory generation is based on MINCO. Figure 1: A map of our environment to the left along with the flight path. Right is the color image and our generated camera depth \IEEEPARstart Autonomous Micro Aerial Vehicles (MAVs) offer valuable solutions across a range of application scenarios such as agriculture [ 8 ] , search-and-rescue [ 9 ] , and infrastructure inspection [ 10 ] . To perform these maneuvers, the aerial vehicles have to locate the obstacles in real time while concurrently generating and executing safe and obstacle free trajectories. Many existing systems rely on heavyweight sensors such as Light Detection and Ranging (LiDAR) to ensure collision-free navigation [ 6 ] . However, these sensors are often incompatible with the Size, Weight, and Power (SWaP) constraints of small-scale aerial vehicles, limiting flight time and agility. While lightweight alternatives like cameras are more suitable for SWaP-constrained platforms, they frequently struggle with noisy and inaccurate obstacle localization. Moreover, computing globally optimal, obstacle-free paths in large-scale environments is computationally intensive, and transforming these paths into time-optimal, safe trajectories in real time introduces additional complexity. To address these challenges, we propose an autonomous quadrotor navigation framework that enables real-time exploration and mapping of unknown indoor and outdoor environments. The system operates using a lightweight sensor suite consisting of cameras, an IMU, and GPS (when available), making it well-suited for SWaP-constrained platforms. Our navigation stack can generate high quality depth, convert it to an accurate map, and autonomously plan safe trajectories around obstacles illustrated in Fig. 1 . In this context, safety refers to the system’s ability to provide guarantees for the planned trajectories by ensuring they avoid collisions with obstacles and stay within operational limits, based on the robot’s current environment map. Contributions. The contributions of this work are • We develop a visual perception algorithm capable of generating dense and low-noise point clouds. Our method combines monocular, learning-based depth estimation with a traditional commercial off-the-shelf stereo matching solution. As a result, it produces depth estimates †with longer range, lower noise, and improved structural consistency compared to standard commercial solutions. • We propose the first real-time implementation in unknown environments for shortest path on the graph of convex sets (our path planning method). Our path planning method computation scales well with the size and complexity of maps outperforming other popular methods like Rapidly-exploring Random Tree (RRT). • We develop a unique time-optimized trajectory generation method with safety guarantees. We compare our trajectory generation method to MINCO [ 11 ] another time-optimized trajectory method used in multiple popular works [ 6 , 2 , 11 ] . Our method generates global trajectories more quickly while maintaining comparable optimality and ensuring safety. • We extensively validate our navigation system in both indoor (GPS denied) and outdoor environments for exploration tasks under varying lighting conditions and harsh winds of up to 15$\mathrm{m}\mathrm{p}\mathrm{h}$ , demonstrating reliable performance over areas of up to 60$\mathrm{m}$\times 40$\mathrm{m}$\times 3$\mathrm{m}$ . 2 Related Works Autonomously Navigating environment requires two major components. First the vehicle needs to be able to localize the obstacles in the environments. Next, the vehicle needs to intelligently plan a path that avoids obstacles. Several related works featuring both components are listed in Table 1 . Overall, our approach offers the best sensing range among vision-based methods using lightweight cameras, while maintaining safety guarantees for the planned trajectories. In the following, we first focus on describing relevant works in the mapping area and then planning approaches. Mapping . There are two predominant sensors that are currently employed to generate environment depth onboard a quadrotor: cameras or LiDAR. Although other sensors exist, such as radar [ 12 ] or ultrasounds [ 13 ] , they are far less prevalent on drones due to their size or low resolution. Most works using LiDARs [ 14 , 7 , 6 , 15 ] are able to achieve strong mapping and localization performance. However, the LiDAR’s weight ranges from 250\penalty\ $\mathrm{g}$ to 1000\penalty\ $\mathrm{g}$ which limits their use on smaller aerial platforms. In contrast, stereo cameras offer a much lighter payload, typically less than 100\penalty\ $\mathrm{g}$ . However small stereo camera pairs have low maximum depth sensing range, typically 3\penalty\ $\mathrm{m}$-6\penalty\ $\mathrm{m}$ [ 2 , 4 , 5 ] . Learning based monocular depth estimation methods [ 16 ] offer an exciting new paradigm. Monocular depth estimation inferences depth based on the image’s structure by learning the mapping from images to depth on large datasets. Unfortunately, while the depth structure is relatively consistent, the scale of the depth is wildly off for objects outside the training set. One popular paradigm for addressing this problem is