GPS Denied IBVS-Based Navigation and Collision Avoidance of UAV Using a Low-Cost RGB Camera*
Xiaoyu Wang, Yan Rui Tan, William Leong, Sunan Huang, Rodney Teo, Cheng Xiang · 2025
Read GPS Denied IBVS-Based Navigation and Collision Avoidance of UAV Using a Low-Cost RGB Camera* by Xiaoyu Wang, Yan Rui Tan, William Leong, Sunan Huang, Rodney Teo, Cheng Xiang (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2509-17435.txt.
Introduction
Xiaoyu Wang and five co-authors fly a drone with nothing but a cheap color camera. Their 2025 arXiv paper works where GPS fails, indoors or under jamming, so the drone must navigate by sight alone. Their method is image-based visual servoing, which steers by the gap between what the camera sees and what it should see.
The framework needs no explicit path plan. It hops between visual targets in the form of AprilTags, a family of printed markers that cameras can track with ease. Collision avoidance comes from depth guessed by an AI model from the single camera's images, with no stereo pair or ground computer. The whole stack runs onboard a Jetson board, which keeps the system self-contained. Flight tests show the drone crossing several targets and dodging obstacles in GPS-denied settings, a useful trait for warehouses and disaster sites.
Catalog record
| CREATOR | Xiaoyu Wang, Yan Rui Tan, William Leong, Sunan Huang, Rodney Teo, Cheng Xiang |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 29 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2509-17435
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
GPS Denied IBVS-Based Navigation and Collision Avoidance of UAV Using a Low-Cost RGB Camera* Xiaoyu Wang, Yan Rui Tan, William Leong, Sunan Huang, Rodney Teo, Cheng Xiang Abstract This paper proposes an image-based visual servoing (IBVS) framework for UAV navigation and collision avoidance using only an RGB camera. While UAV navigation has been extensively studied, it remains challenging to apply IBVS in missions involving multiple visual targets and collision avoidance. The proposed method achieves navigation without explicit path planning, and collision avoidance is realized through AI-based monocular depth estimation from RGB images. Unlike approaches that rely on stereo cameras or external workstations, our framework runs fully onboard a Jetson platform, ensuring a self-contained and deployable system. Experimental results validate that the UAV can navigate across multiple AprilTags and avoid obstacles effectively in GPS-denied environments. I INTRODUCTION Most UAV applications depend on position estimation provided by global positioning systems (GPS). However, GPS is often unavailable in indoor, mountainous, or forest environments, motivating the use of computer vision for UAV navigation. This paper focuses on image-based visual servoing (IBVS) with an onboard RGB camera. Traditionally, visual servoing algorithms for UAVs are divided into two classes: position-based visual servoing (PBVS) and image-based visual servoing (IBVS) [ 1 , 2 , 3 , 4 ] . PBVS is used to reconstruct a global 3D pose of the target using RGB, stereo vision, or depth information, etc. This introduces a limitation–global localization. IBVS uses the error between detected and desired visual features to control motion. It is effective for missions where the visual features are within the camera’s field of vision. In GPS-denied settings, in some cases, global localization is difficult to achieve by using a Visual-Inertial Odometry (VIO) or Simultaneous Localization and Mapping (SLAM). This often becomes a critical point of failure. IBVS can be used for handling such kinds of environments, leading to a more robust result. However, most existing IBVSs are for one target (stationary or moving target) tracking ( [ 5 , 6 , 7 , 8 , 15 ] ) or landing [ 9 ] . Navigation missions can involve multiple waypoints and require the UAV to switch among multiple waypoints to guide the UAV to achieve the navigation task. Another challenge in the navigation problem is the handling of collision avoidance [ 10 ] . Most existing IBVS results for navigation with collision avoidance use stereo cameras (or other sensors) to obtain depth information. For example, in [ 13 , 14 ] , the authors find a feasible trajectory in 3D Cartesian space which uses PBVS-like method for path planning; in [ 11 , 12 ] , the authors use stereo cameras to obtain the depth and do the navigation; in [ 15 , 16 ] , the authors use the UAV position, LOS information or exact depth for collision avoidance. Although [ 11 , 12 ] present the navigation method based on the stereo cameras, collision avoidance is not discussed. These results need to have the exact UAV position or relative position information. It is not realistic to use exact 3D position information to handle collision avoidance, for the depth information is not always accurate for stereo cameras, especially in a moving drone with stereo cameras, depending on several factors like calibration, lighting, camera baseline, and distance, etc. It is preferable to use a low-cost RGB camera for sensing applications for navigation with collision avoidance. The authors in [ 18 ] utilized a low-cost RGB camera for collision avoidance. However, it requires prior knowledge of the obstacle’s size. In addition, its navigation uses GPS information. In this paper, we present an IBVS-based navigation method, where the collision avoidance is achieved partially by using AI estimation based on an RGB camera only. The proposed method can work in a denied environment without a map, VIO, SLAM, LiDAR, or stereo camera. Unlike approaches that offload heavy perception to external high-performance workstations, our entire framework (including MiDaS inference) runs fully onboard a Jetson platform, ensuring a self-contained and deployable system. The main contributions include • A multiple visual target set is introduced for guiding the UAV for navigation. For each target, IBVS is used for achieving the tracking control. A switching law is developed to complete the transition from one target to the other. During the navigation, only RGB is used without a path planning requirement. • The obstacles are detected by the depth map estimated by AI learning using RGB images, without requiring prior knowledge or explicit encoding as in [ 17 ] . In contrast, the navigation gates are encoded with visual AprilTags, which are identified by IBVS. • A collision avoidance law is developed by using the depth percentage thresholds. During the collision avoidance, the accurate position of UAV [ 16 ] or the relative position information of the obstacles [ 13 , 14 ] is not required. The paper is organized as follows. Section II describes the detailed methodology designed. Section III presents the test results using the proposed method and gives a comparison with existing methods. Finally, the conclusion is given in Section IV. II METHODOLOGY The designed drone, as shown in Fig. 1 , weighs 1.1485 kg with a thrust-to-weight ratio of 4:1, where the arm length is 15.5cm, four T-motor F60 ProV-lv are used, the propellers are F5146, and the battery is a 6-cell LiPo. The motors used are 2020KV. An Intel RealSense D435i camera is mounted on the drone and connected to the Jetson Orin baseboard. The proposed framework integrates image-based visual servoing (IBVS) with AI-driven depth estimation to achieve navigation and collision avoidance in GPS-denied environments using only a low-cost RGB camera. The overall architecture is shown in Fig. 2 and consists of three main components: navigation via AprilTag tracking, collision avoidance using monocular depth estimation, and PX4-based flight control. Navigation is designed around a sequence of visual landmarks placed along the desired path. AprilTags serve as the visual features, each associated with a gate that the UAV must pass through. IBVS is employed to track these tags using image moments, which provide robust visual features for translational and rotational motion control. To enhance safety, a monocular depth estimation module based on the openvino_midas_v21_small model that runs in parallel to IBVS. The incoming RGB stream is processed to generate a relative depth map, which is normalized and thresholded to produce a binary obstacle mask. By analyzing the mask’s centroid and pixel distribution, the system determines the relative position of obstacles to the drone’s field of view and generates appropriate obstacle avoidance commands. The flight control module is implemented in PX4 and is divided into three cascaded loops. This layered structure ensures stable flight performance while also integrating IBVS velocity commands and yaw feedforward inputs for responsive maneuvers. Fig. 1 : Quadrotor drone Fig. 2 : Overall technical pipeline of the proposed IBVS-based navigation and collision avoidance framework. The left branch shows AprilTag detection and IBVS velocity control; the right branch shows MiDaS-based depth estimation and obstacle avoidance; the bottom illustrates PX4 flight control loops II-A IBVS-based navigation A standard navigation for a drone is to start from one point to the destination. In our project, the navigation is composed of three parts: