Vision-based Navigation of Unmanned Aerial Vehicles in Orchards: An Imitation Learning Approach Journal: Computers and Electronics in Agriculture
Peng Wei, Prabhash Ragbir, Stavros G. Vougioukas, Zhaodan Kong · 2025
Read Vision-based Navigation of Unmanned Aerial Vehicles in Orchards: An Imitation Learning Approach Journal: Computers and Electronics in Agriculture by Peng Wei, Prabhash Ragbir, Stavros G. Vougioukas, Zhaodan Kong (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2508-02617.txt.
Introduction
Peng Wei, Prabhash Ragbir, Stavros Vougioukas, and Zhaodan Kong taught a drone to fly orchard rows by watching a human pilot in a 2025 paper. Orchards block satellite signals and crowd the air with branches. Their controller compresses camera views through an autoencoder and learns a flying policy from guided practice.
A custom quadrotor flew real orchards after only a few rounds of correction-based training. It dodged obstacles well, flew farther with less human rescue, and beat rival algorithms. The learned policy also carried to new orchards and held up across speeds and conditions. The authors aim the work at cheaper orchard monitoring and care. Vision alone, they argue, can be enough for row flight.
Catalog record
| CREATOR | Peng Wei, Prabhash Ragbir, Stavros G. Vougioukas, Zhaodan Kong |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 56 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2508-02617
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Vision-based Navigation of Unmanned Aerial Vehicles in Orchards: An Imitation Learning Approach Journal: Computers and Electronics in Agriculture Peng Wei, Prabhash Ragbir, Stavros G. Vougioukas, Zhaodan Kong Abstract Autonomous unmanned aerial vehicle (UAV) navigation in orchards presents significant challenges due to obstacles and GPS-deprived environments. In this work, we introduce a learning-based approach to achieve vision-based navigation of UAVs within orchard rows. Our method employs a variational autoencoder (VAE)-based controller, trained with an intervention-based learning framework that allows the UAV to learn a visuomotor policy from human experience. We validate our approach in real orchard environments with a custom-built quadrotor platform. Field experiments demonstrate that after only a few iterations of training, the proposed VAE-based controller can autonomously navigate the UAV based on a front-mounted camera stream. The controller exhibits strong obstacle avoidance performance, achieves longer flying distances with less human assistance, and outperforms existing algorithms. Furthermore, we show that the policy generalizes effectively to novel environments and maintains competitive performance across varying conditions and speeds. This research not only advances UAV autonomy but also holds significant potential for precision agriculture, improving efficiency in orchard monitoring and management. 1 Introduction Unmanned aerial vehicle (UAV) technology has made significant progress in recent years, particularly for applications in agriculture. The ability to navigate within orchard rows allows UAVs to perform tasks such as crop inspection and yield estimation [ Zhang et al. 2021 ] . This capability provides a valuable tool for remote sensing and precision agriculture [ Chen et al. 2022 ] , leading to more efficient and improved orchard management. However, most existing UAVs still depend on GPS for navigation in agricultural settings. This reliance limits their ability to operate in confined orchard rows, where dense tree canopies can block GPS signals. Additionally, in environments with unknown obstacles, such as tree branches in orchard rows, human pilots are frequently queried to provide avoidance maneuvers, which significantly increases their workload. The ability to navigate autonomously and safely in orchard scenes with weak GPS signals and obstacles presents several challenges and largely hinders the deployment of UAVs in orchard operations. Figure 1: The drone is flying autonomously inside orchard rows without GPS, using its onboard camera to avoid tree branches along the way. The view of the onboard camera is provided. When the GPS signal is attenuated, the UAV may rely on exteroceptive sensors to sense the environment and navigate. Advanced techniques to enable UAV autonomous operations without GPS include: 1) lidar-based, and 2) camera-based approaches. Typical lidar sensors are too large to fit on lightweight UAVs flying between the tree rows and can significantly reduce the flight time when size and endurance are considerations. It leaves the camera-based algorithm a better option for UAV autonomous navigation in orchards where compact size and longer battery life are pursued. Also, a camera typically costs less than a lidar sensor. In general robotics, a common approach to achieving autonomous navigation in unknown environments is to break the system into distinct modules, typically including perception, planning, and control. Each module is developed and optimized separately. For example, a global or local map of the environment can be constructed while the robot’s state is estimated simultaneously. Within this map, a feasible path or trajectory is planned to reach the target point while avoiding obstacles. A tracking algorithm then controls the robot to follow the planned path. Although this modular design scheme has been explored extensively in the literature, the drawback is that the computation load can be intensive and it introduces discrepancies between different stages due to the hierarchical task decomposition. This raises the question of whether such a modular design structure is necessary. Humans, for example, can fly drones relying solely on visual inputs (e.g., first-person-view camera). They directly map the visual information to control commands and provide good reactive behaviors in unknown environments [ Pfeiffer & Scaramuzza 2021 ] . Inspired by this, we aim to develop a similar reactive policy that skips explicit maps and waypoint constructions. Such a visuomotor policy can be trained through modern learning-based approaches. Reinforcement learning (RL) has shown promising results in fields like self-driving car and strategy games. However, RL is sample-inefficient, requiring substantial amounts of data to achieve good results. Designing an effective reward function is also challenging, and the trial-and-error nature of RL hinders its usage in safety-critical systems, where a single failure may lead to enormous losses. One way to address these shortcomings is to train a policy in simulation and transfer it to the real world during deployment. This transfer learning strategy reduces the costs and risks of training a policy by preventing system damage. However, inaccuracies in the simulation model (e.g., modeling of environmental changes can be difficult) may lead to unmatched performance in real-world applications, and minimizing this sim-to-real gap remains an ongoing challenge. In this work, we adopt an imitation learning (IL) framework to train a visuomotor policy. The robot learns a strategy by mimicking an expert’s behavior from a small number of demonstrations. The aim is to leverage human knowledge to guide the learning process and achieve human-like behaviors while overcoming the limitations of the aforementioned methods. In our previous work [ Wei et al. 2022 ] , we proposed a variational autoencoder (VAE)-based controller trained via imitation learning and evaluated it in simulated riverine environments using Unreal Engine. The controller demonstrated competitive results compared to several vision-based navigation algorithms. However, the prior experiments were conducted entirely in simulation, where conditions such as obstacle structure, lighting, and vehicle dynamics were ideal and tightly controlled. In this paper, we extend that work by demonstrating, to the best of our knowledge, for the first time, the real-world deployment of a reactive imitation-based control policy for UAV navigation in complex orchard environments, as illustrated in Figure 1 . The control policy is trained using an interactive imitation learning framework with image data and expert demonstrations collected exclusively in the field. This eliminates the common sim-to-real transfer issue present in many learning-based methods that rely on simulation pre-training. Real-world orchard environment introduces significant challenges compared to simulation, including unstructured obstacles such as protruding branches and foliage, varying illumination conditions, and unpredictable wind disturbances. The actual UAV system also brings uncertainties in dynamics and control, as well as sensor noises. Despite these challenges, our controller enables fully autonomous UAV flight within orchard rows without relying on pre-configured maps or waypoints. It achieves longer flying distances with reduced human intervention and demonstrates strong generalization capabilities in novel environments and under varying speeds. The contributions of this paper are summarized as follows: 1. We propose a reactive strategy to enable UAV navigation in orchard rows using only visual inputs. A variational autoencoder-based controller is developed and trained through an intervention-based learning framework using exclusively real-world flight data. We demonstrate the practical deployment of this controller on a custom-built UAV platform under real orchard conditions. Compared to existing algorithms, our VAE-based controller requires significantly less human intervention and achieves autonomous navigation after just a few iterations of training. 2. We evaluate the generalization performance of our controller in novel environments and under varying speeds. The results show that our VAE-based control policy performs well in unseen environments and