Aerial Inspection Behaviors via RL-based Quadrotor Control for Under-canopy Forest Environments
Fausto Mauricio Lagos Suarez, Akshit Saradagi, Vidya Sumathy, Viswa Narayanan Sankaranarayanan, and George Nikolakopoulos · 2026
Read Aerial Inspection Behaviors via RL-based Quadrotor Control for Under-canopy Forest Environments by Fausto Mauricio Lagos Suarez, Akshit Saradagi, Vidya Sumathy, Viswa Narayanan Sankaranarayanan, and George Nikolakopoulos (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-19202.txt.
Introduction
Fausto Mauricio Lagos Suarez and four colleagues address forest-canopy inspection with a reinforcement-learning quadrotor controller in a navigation stack. They present an end-to-end policy mapping states to motor speeds for view-pose tracking, combining position and yaw tracking for inspection and forest navigation. A guidance layer pairs a travelling salesman planner for visitation order with a random tree planner for collision-free paths within tracking limits. Five scenarios show the motor-level controller, with guidance support, works effectively as the low-level inspection module.
Catalog record
| CREATOR | Fausto Mauricio Lagos Suarez, Akshit Saradagi, Vidya Sumathy, Viswa Narayanan Sankaranarayanan, and George Nikolakopoulos |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 24190 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2605.19202
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Aerial Inspection Behaviors via RL-based Quadrotor Control for Under-canopy Forest Environments Fausto Mauricio Lagos Suarez, Akshit Saradagi, Vidya Sumathy, Viswa Narayanan Sankaranarayanan, and George Nikolakopoulos Abstract This paper addresses the problem of using a deep Reinforcement Learning (RL)-based low-level Quadrotor controller within an autonomous Quadrotor navigation stack for aerial inspection missions in under-canopy forest environments. Specifically, the article presents an end-to-end (mapping states to RPMs) Quadrotor control policy that achieves inspection view-pose tracking (simultaneous position and yaw reference tracking), which is crucial for various target inspection behaviors and point-to-point navigation in forests. To ensure safe and reliable deployment of the end-to-end RL controller in long-range missions, this article utilizes a higher navigation guidance layer comprising of a Traveling Salesman Problem planner (TSP) and a Rapidly-exploring Random Tree Star (RRT*) planner. Over a known map of a forest and a set of user-specified inspection regions, the TSP planner finds the optimal visitation sequence. Between two target regions, collision-free paths that respect the tracking limitations of the lower end-to-end RL policy are generated by an RRT* planner. Through five target inspection scenarios, this article demonstrates that an RL-based motor-level stabilizing controller, supported by a navigation guidance layer, can be used effectively as the low-level inspection execution module for under-canopy forest inspection missions. I INTRODUCTION Quadrotors are attractive platforms for autonomous inspection and navigation because they can hover, maneuver in confined spaces, and operate in cluttered environments where ground robots or larger aerial systems may be less suitable [ 8 ] . To enable autonomous aerial inspection, however, the vehicle must combine inspection-oriented motion behavior with reliable navigation in cluttered environments. In conventional autonomy pipelines, safe flight is usually achieved by combining a motion planner with a structured control stack [ 13 , 10 ] . On the control side, representative classical works include Proportional Integral and Derivative control (PID) [ 6 ] , and geometric tracking control on SE(3) [ 2 ] . On the planning side, sampling-based methods such as RRT* remain a standard choice for generating collision-free paths with asymptotic optimality guarantees [ 3 ] . These classical approaches are highly effective and remain strong baselines for quadrotor stabilization and tracking. Accordingly, the motivation for this work is whether a learned motor-level controller can serve as a practical alternative execution layer inside a planner-guided autonomy stack. This question is relevant because conventional pipelines often rely on an explicit decomposition into planning, outer-loop position control, inner-loop attitude control, and control allocation, whereas an end-to-end policy can, in principle, map tracking-relevant state errors directly to motor commands. Such a formulation may reduce controller hand-design while preserving the higher-level planner that provides collision-free references [ 11 ] . Research on low-level RL for quadrotors has progressed substantially over the last several years. Early work showed that a neural policy could map state directly to actuator commands for quadrotor stabilization [ 4 ] , and subsequent studies extended this direction to faster training and effective sim-to-real transfer [ 1 ] . Additional results have pushed RL-based aerial control toward high-speed autonomous flight, and champion-level drone racing [ 5 ] . At the same time, recent literature shows that learning-based autonomy is diversifying rather than converging to a single paradigm. Published work has explored multi-agent RL for low-level control of quadrotors, separating the position, roll, and pitch tracking from the yaw tracking as in classical cascade approaches [ 14 ] , RL policies capable of handling multiple aerial tasks like stabilization, autonomous race, and random velocities tracking [ 12 ] , and RL for vision-based autonomous navigation in cluttering environments with speed adaptation [ 17 , 15 ] , and for inspection path planning in industrial like scenarios [ 7 ] . These results are important because they suggest that learned aerial control is no longer limited to hover demonstrations. Compared with other systems questions, less attention has been paid to the highly relevant problem addressed by this work. The main contributions of this work are threefold. First, we present an end-to-end RL-based low-level quadrotor controller that maps state observations directly to motor RPM commands for inspection view-pose tracking, namely simultaneous position and yaw reference tracking. Second, we demonstrate that this learned controller can be reliably deployed as the low-level execution module within a higher-level navigation-guidance framework for long-range under-canopy forest-inspection missions. Third, we integrate the controller with a TSP-based target-visitation planner and an RRT*-based collision-free path planner over a known forest map and user-defined inspection regions, and we validate the complete system across five inspection scenarios. II Problem setup In designing target inspection missions in under-canopy forest environments, this article assumes that a map of the environment is known a priori (built from exploration missions or derived from a digital twin). The focus of the article is not on reactive navigation using onboard perception from cameras and Lidar, but on designing a two-level navigation pipeline with a higher safe path planning layer (over a known map) and a lower RL-based path tracking and inspection behavior layer, assuming odometry derived from the fusion of IMU and GNSS. This article considers typical low-level aerial behaviors necessary in long range inspection missions in forests, such as point-to-point navigation, inspection pose tracking, view scanning, and tracking circular and spiral inspection trajectories. In this article, the inspection behaviors are derived from a base RL policy capable of tracking inspection view poses, wherein position and yaw references are simultaneously tracked, in the presence of state measurement noise and external disturbances. The RL policy aims to track a time-indexed sequence of reference poses r_{t}=(p_{t}^{\ast},\psi_{t}^{\ast}) , where p_{t}^{\ast}\in\mathbb{R}^{3} is the desired position at time t and \psi_{t}^{\ast}\in[-180^{\circ},180^{\circ})^{1} is the desired yaw attitude. Assuming a known map and odometry derived from the fusion of IMU and GNSS and no other external sensing, this article explores the design of a higher navigation guidance layer that effectively solves the macro-level optimal route finding problem and local obstacle avoidance. Such a guidance layer is expected to supply a sequence of inspection view poses to the lower RL policy. The quadrotor, therefore, operates within a hierarchical autonomy architecture in which a TSP high-level planner creates the optimal sequence of targets and an RRT*-based planner provides collision-free paths. III Methodology III-A Autonomy Architecture Figure 1 illustrates the hierarchical navigation architecture used in this work. At the highest level, the TSP planner receives the set of inspection target coordinates and computes an ordered target sequence. This sequence is then passed to the RRT* path planner, which also receives the obstacle map and the current drone odometry to generate collision-free waypoints between successive targets. Finally, these waypoint references, together with the current drone states, are provided to the RL end-to-end controller, which outputs the four motor RPM commands required to track the planned path. In this stack, target ordering is handled by the TSP layer, collision avoidance is handled by the RRT* planner, and low-level path execution is handled by the learned motor-level controller. Fig. 1 : TSP-RRT*-RL navigation stack architecture. III-B Navigation Guidance III-B 1 User interface and TSP-based large-scale planning The TSP planner is designed to take the target inspection poses as input and generate every single possible tour in which the inspection targets could be visited, starting