Real-Time Detection for Small UAVs: Combining YOLO and Multi-frame Motion Analysis
Juanqin Liu, Leonardo Plotegher, Eloy Roura, Cristino de Souza Junior, Shaoming He · 2024
Read Real-Time Detection for Small UAVs: Combining YOLO and Multi-frame Motion Analysis by Juanqin Liu, Leonardo Plotegher, Eloy Roura, Cristino de Souza Junior, Shaoming He (2024) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2411-02582.txt.
Description
Abstract Unmanned Aerial Vehicle (UAV) detection technology plays a critical role in mitigating security risks and safeguarding privacy in both military and civilian applications. However, traditional detection methods face significant challenges in identifying UAV targets with extremely small pixels at long distances.
Catalog record
| CREATOR | Juanqin Liu, Leonardo Plotegher, Eloy Roura, Cristino de Souza Junior, Shaoming He |
|---|---|
| YEAR | 2024 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 42 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2411-02582
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Real-Time Detection for Small UAVs: Combining YOLO and Multi-frame Motion Analysis Juanqin Liu, Leonardo Plotegher, Eloy Roura, Cristino de Souza Junior, Shaoming He Abstract Unmanned Aerial Vehicle (UAV) detection technology plays a critical role in mitigating security risks and safeguarding privacy in both military and civilian applications. However, traditional detection methods face significant challenges in identifying UAV targets with extremely small pixels at long distances. To address this issue, we propose the Global-Local YOLO-Motion (GL-YOMO) detection algorithm, which combines You Only Look Once (YOLO) object detection with multi-frame motion detection techniques, markedly enhancing the accuracy and stability of small UAV target detection. The YOLO detection algorithm is optimized through multi-scale feature fusion and attention mechanisms, while the integration of the Ghost module further improves efficiency. Additionally, a motion detection approach based on template matching is being developed to augment detection capabilities for minute UAV targets. The system utilizes a global-local collaborative detection strategy to achieve high precision and efficiency. Experimental results on a self-constructed fixed-wing UAV dataset demonstrate that the GL-YOMO algorithm significantly enhances detection accuracy and stability, underscoring its potential in UAV detection applications. I Introduction Since UAV technology emerged, its widespread application across various domains has raised significant safety risks and privacy concerns [ 1 , 2 , 3 ] . In response, the development of long-range drone detection technology has become critical, enabling the prompt identification, localization, and intervention of drones to safeguard public safety and personal privacy. However, existing detection technologies face considerable challenges when addressing small-pixel UAV targets at long distances [ 4 , 5 , 6 ] . Drones typically occupy less than 0.1 \% of an image, leading to insufficient feature information. When combined with complex backgrounds, this results in decreased detection accuracy [ 7 , 8 ] . Fig. 1 highlights some of the common challenges associated with detecting drone targets. Fig. 1: Challenging conditions examples in UAV detections: 1) Minuscule targets with limited distinctive features; 2) Intricate backgrounds complicating target identification. While popular object detection methods like Fast-RCNN, YOLO, and DETR are highly effective for larger targets, they suffer from high false positive and false negative rates i+n long-range, small-object drone detection [ 9 , 10 , 11 ] . Recent researchers have developed specialized detection methods optimized for drone characteristics [ 12 , 13 , 14 ] . For example, by integrating appearance and motion features, using techniques like frame differencing or optical flow to extract moving objects, and applying classification methods to distinguish drone targets from other interfering objects. However, due to the diminutive size of drone targets, the amount of useful feature information available for classification is limited, and downsampling often leads to the loss of critical information. Additionally, the presence of diverse noise between drones and complex backgrounds makes it challenging to construct a precisely annotated dataset that can reliably distinguish targets from their surroundings. In this paper, we propose the GL-YOMO detection algorithm, which effectively integrates appearance and motion features. By enhancing the YOLO model, we aim to improve detection accuracy while reducing computational complexity. The algorithm incorporates multi-frame motion detection for secondary validation, ensuring precise detection of small objects without requiring a manually constructed classification dataset. The main contributions of this paper are as follows: 1) Development of the GL-YOMO Detection Algorithm : This algorithm combines YOLO object detection with multi-frame motion detection, leveraging YOLO’s efficient detection capabilities while incorporating motion feature capture to significantly enhance detection accuracy and stability. 2) Improvement of the YOLO Model : The enhancements increase detection accuracy and substantially reduce computational complexity and parameter count, resulting in a more efficient and lightweight model. 3) Design of a Template Matching-Based Motion Detection Algorithm : By analyzing pixel changes and displacement variations across three consecutive frames, this algorithm effectively detects extremely small objects, further improving small-object detection accuracy. 4) Construction of the Fixed-Wings Dataset : This dataset includes 13 video sequences and 24,951 frames, encompassing numerous UAV targets with an average image proportion of 0.01%, providing a robust resource for evaluating UAV detection algorithms. The paper is structured as follows: Section II reviews small object detection and related methods for UAV detection. Section III details our proposed method. Section IV presents experimental results and analysis. Section V concludes the paper and discusses future research directions. II Related Work II-A Small Object Detection Methods Since the introduction of the YOLO algorithm in 2016, its subsequent versions [ 15 , 16 , 17 ] have continually evolved, driving substantial advancements in object detection. To tackle the challenges associated with small object detection, many different useful strategies were proposed in recent works. Among these, multi-scale feature fusion emerged as a critical approach, effectively integrating semantic information across various levels to improve small object detection [ 18 , 19 , 20 , 21 , 22 ] . For example, Gold-YOLO [ 20 ] enhanced feature fusion by incorporating a Gather-and-Distribute mechanism, achieving a 39.9% AP on the COCO val2017 dataset, which is a 2.4% enhancement over the prior state-of-the-art model, YOLOv6., while ASF-YOLO [ 21 ] significantly improved small object detection and segmentation through the Scale Sequence Feature Fusion (SSFF) module and the Triple Feature Encoder (TPE) module. Feature enhancement strategies were also pivotal, with many studies introducing attention mechanisms to amplify target features while suppressing background noise, thereby boosting detection accuracy. Notably, CEAM-YOLOv7 [ 23 ] incorporated global attention mechanisms in both the Backbone and Head, improving the mAP by 20.26% than the original YOLOv7 model. Gong et al. [ 24 ] introduced a normalization-based attention module that incrementally improved detection by focusing on channels and spatial dimensions through coefficient penalization, achieving a 7.1% improvement on the DOTA dataset. The AIE-YOLO [ 25 ] employed a context enhancement module that fuses multi-scale receptive fields with attention mechanisms to optimize feature representation. Additionally, super-resolution techniques led to considerable improvements [ 26 , 27 ] . For instance, Yucong et al. [ 26 ] combined shallow high-resolution geometric details with deep super-resolution semantic features, augmented by channel attention, to significantly elevate detection precision. Collectively, these innovations represented a substantial leap forward in the field of small object detection. Fig. 2: The GL-YOMO architecture: The YOMO Detector combines YOLO Detector with a multi-frame Motion Detector. A global-local strategy and ROI adaptive update enable continuous detection of small UAV targets. II-B UAV Detection Methods Ensuring real-time performance in UAV detection while addressing the challenges posed by small objects and multi-scale variations is crucial. The YOLO series proved to be one of the most effective solutions for these challenges [ 28 , 29 , 30 ] . For example, the work in [ 10 ] integrated the Spatial Pyramid Pooling module into the YOLOv4 model’s prediction head, combining it with a spatial attention mechanism to achieve real-time drone detection at 14.9 fps. Similarly, the authors in [ 31 ] leveraged the lightweight MobileNet as the backbone, incorporating depthwise separable convolution techniques, and reported a processing speed of 82 fps along with an accuracy of 93.52% mAP on a custom UAV dataset. Although these methods excelled at extracting prominent features from single frames and performed well in simpler scenarios, they encountered difficulties in more complex environments. To better handle challenges such