Drone Detection and Tracking with YOLO and a Rule-based Method

Purbaditya Bhattacharya, Patrick Nowak · 2025

Read Drone Detection and Tracking with YOLO and a Rule-based Method by Purbaditya Bhattacharya, Patrick Nowak (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2502-05292.txt.

Introduction

Purbaditya Bhattacharya and Patrick Nowak build a drone detection and tracking system in a two thousand twenty-five computer vision paper. Growing drone traffic creates safety and privacy risks, so spotting unauthorized drones near boundaries matters.

The authors extend an existing open-source image dataset, describe it in full, and train YOLOv7 plus minor variants for detection. Single-image detectors drop detections between video frames, so they add a simple cross-correlation tracker to stabilize tracks. The combined system is summarized end to end. The work offers a practical, reproducible baseline for automated airspace monitoring built from publicly available parts.

Catalog record

CREATORPurbaditya Bhattacharya, Patrick Nowak
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE25 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2502-05292

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Drone Detection and Tracking with YOLO and a Rule-based Method Purbaditya Bhattacharya, Patrick Nowak Abstract Drones or unmanned aerial vehicles are traditionally used for military missions, warfare, and espionage. However, the usage of drones has significantly increased due to multiple industrial applications involving security and inspection, transportation, research purposes, and recreational drone flying. Such an increased volume of drone activity in public spaces requires regulatory actions for purposes of privacy protection and safety. Hence, detection of illegal drone activities such as boundary encroachment becomes a necessity. Such detection tasks are usually automated and performed by deep learning models which are trained on annotated image datasets. This paper builds on a previous work and extends an already published open source dataset. A description and analysis of the entire dataset is provided. The dataset is used to train the YOLOv7 deep learning model and some of its minor variants and the results are provided. Since the detection models are based on a single image input, a simple cross-correlation based tracker is used to reduce detection drops and improve tracking performance in videos. Finally, the entire drone detection system is summarized. I Introduction Drones or unmanned aerial vehicles (UAV) are primarily used in military operations, industrial and commercial applications. But recreational drone flying has also increased in urban areas which can be concerning for public safety and privacy. Hence, regulation in terms of legal zones and other requirements are usually put in place. At the same time, it is necessary to monitor if any violation of such regulations have taken place. An automated drone detection system can therefore generate an alert based on any illegal activity and enable a capturing system to act. Such detection systems can operate based on data processed by different sensors. In this context, infrared and visual cameras are used as two of many sensors which might provide better visibility under different environmental conditions. Fig. 1 : Overview of the drone detection system. A part of this work builds on our previous work [ 1 ] on a published dataset of infrared images. The previous dataset is a collection of annotated infrared images captured by a FLIR and an InfraTec Camera at two distinct locations - the university campus and one of the city harbours. In this work, a set of annotated color images, also captured in the same locations, are added to the existing dataset. Additionally, more videos are recorded at the harbour location with additional backgrounds and the corresponding frames are annotated and added to the dataset. With the incremental improvement in deep learning based methods, they are primarily used for multiple object detection tasks [ 2 , 3 , 4 , 5 ] . More commercial multi-sensor or vision systems now use a trained and properly scaled deep learning model for improved object detection. YOLO is one of the frontrunners in object detection and is widely used for these tasks. Hence, such models are used for drone detection [ 6 , 7 ] . The larger drone dataset is created with the objective of developing and training the YOLO convolutional neural network (CNN) models and integrate them in a drone detection system. The base model and models modified by the addition of smaller modules are trained and compared. The following sections provide an overview of the drone detection system followed by an analysis of the datasets. A brief description of the modified YOLO models are provided in the next section along with an evaluation of their performance. Finally, a simple ensemble method for improving the detection performance and tracking is introduced followed by a conclusion. II System Overview In this section, the system overview as illustrated in Fig. 1 is described. The camera placed in the campus area covered by 5G outdoor network records a flying drone and the processed video stream is transmitted to the indoor network. The transmission is then received by the computer which runs the drone detection algorithm. After detection, the computer can display the results or transmit it further to another machine. In order to send or recieve videos, the GStreamer multimedia application framework [ 8 ] is used. The constructed GStreamer pipelines primarily include data transmission and reception via UDP, processing and conversion, encoding and decoding, and buffering. The received stream is processed by a customized pre-trained YOLOv7 model in a Docker [ 9 ] container which has Python OpenCV built with GStreamer support. Finally, the result is displayed. III Dataset Fig. 2 : Comparison of the image resolution of all cameras: FLIR Scion OTM366 (top left - 640\times 480 pixels), InfraTec VarioCAM HD Z (top right - 1024\times 768 pixels), and Sony \alpha 6000 (bottom - 1920\times 1080 pixels) To create the dataset, videos of flying drones are recorded with three different cameras, followed by the extraction of frames and their annotation by various methods. The following subsections provide a brief description of the process. Fig. 3 : Used cameras: FLIR Scion OTM366 (left), InfraTec VarioCAM HD Z (center), and Sony \alpha 6000 (right). III-A Video Recording The original dataset is constructed from drone videos captured at the university football field and the Wilhelmsburg harbour using a FLIR Scion OTM366 infrared camera and an InfraTec VarioCAM HD Z equipped with a zoom lens (25-150 mm) with image resolutions of 640\times 480 pixels and 1024\times 768 pixels, respectively. The color videos are recorded at the aforementioned locations with a Sony \alpha 6000 camera with an image resolution of 1920\times 1080 pixels. The initial videos are recorded independently with each cameras from multiple perspectives with some videos being recorded on different days. Finally, all the cameras are mounted on a steerable tripod and additional videos are recorded at the Harbour. The new videos have more background information compared to the initial recordings and all cameras have very similar perspectives while recording the drone. Figure 2 shows some example images captured by the cameras. The camera setup on the tripod is shown in Fig. 3 . Example images from each location are also shown in Fig. 4 (a) FLIR-Harbour (b) InfraTec-Campus (c) Sony-Harbour (d) Sony-Campus (e) Multi-channel (Sony, FLIR)-Harbour (f) Multi-channel (Sony, FLIR)-Harbour Fig. 4 : Exemplary images of the dataset recorded with FLIR Scion OTM366 at ( 4(a) ) harbour, with InfraTec VarioCAM HD Z at ( 4(b) ) campus, with Sony \alpha 6000 at ( 4(c) ) harbour and ( 4(d) ) campus, and with FLIR Scion OTM366 and Sony \alpha 6000 at ( 4(e) , 4(f) ) harbour and combined. III-B Dataset Labelling The LabelImg [ 10 ] graphical annotation tool is used to manually annotate the drones in the color images extracted from the video recordings. The annotations are done in the Pascal VOC [ 11 ] format. As described in [ 1 ] , an automated annotation script based on a simple bounding box tracking method is used to accelerate the process followed by intermediate manual correction of any wrong detections. Drones that are difficult to spot are either not annotated or labelled as a difficult example. After the manual annotation of the initial infrared and color datasets the base YOLO model is used to train them. This trained model is used to detect drones in the

Read the complete text