A Multiclass Acoustic Dataset and Interactive Tool for Analyzing Drone Signatures in Real-World Environments
Mia Y. Wang*, Mackenzie Linn, Andrew P. Berg, Qian Zhang* · 2025
Read A Multiclass Acoustic Dataset and Interactive Tool for Analyzing Drone Signatures in Real-World Environments by Mia Y. Wang*, Mackenzie Linn, Andrew P. Berg, Qian Zhang* (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2509-04715.txt.
Introduction
Drones differ in sound as well as shape, and those sounds can reveal them when cameras and radar fall short. Mia Y. Wang, lead author with three co-authors, present an acoustic dataset and interactive tool in a 2025 paper. The dataset covers many categories of drones, separated by brand and model.
For each category it holds raw audio plus spectrogram and mel-frequency cepstral coefficient plots, two visual views of sound. A web application lets users pick a category, listen, and inspect the plots. The authors describe how the dataset was built and report experiments and user feedback for research and teaching.
Catalog record
| CREATOR | Mia Y. Wang*, Mackenzie Linn, Andrew P. Berg, Qian Zhang* |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 36 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2509-04715
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
A Multiclass Acoustic Dataset and Interactive Tool for Analyzing Drone Signatures in Real-World Environments Mia Y. Wang*, Mackenzie Linn, Andrew P. Berg, Qian Zhang* Abstract The rapid proliferation of drones across various industries has introduced significant challenges related to privacy, security, and noise pollution. Current drone detection systems, primarily based on visual and radar technologies, face limitations under certain conditions, highlighting the need for effective acoustic-based detection methods. This paper presents a unique and comprehensive dataset of drone acoustic signatures, encompassing 32 different categories differentiated by brand and model. The dataset includes raw audio recordings, spectrogram plots, and Mel-frequency cepstral coefficient (MFCC) plots for each drone. Additionally, we introduce an interactive web application that allows users to explore this dataset by selecting specific drone categories, listening to the associated audio, and viewing the corresponding spectrogram and MFCC plots. This tool aims to facilitate research in drone detection, classification, and acoustic analysis, supporting both technological advancements and educational initiatives. The paper details the dataset creation process, the design and implementation of the web application, and provides experimental results and user feedback. Finally, we discuss potential applications and future work to expand and enhance the project. I Introduction The rapid proliferation of drones in various industries such as delivery, surveillance, agriculture, and entertainment has introduced significant challenges and opportunities. While drones offer numerous benefits, their widespread use has also raised concerns regarding privacy, security, and noise pollution. Unauthorized drone activity can lead to breaches of privacy and potential security threats, while drones contribute to environmental noise pollution, affecting human health and wildlife. Current drone detection systems primarily rely on visual and radar-based technologies, which face limitations under poor visibility or in cluttered environments. Acoustic-based detection presents a promising complementary approach, but there is a notable lack of comprehensive acoustic datasets encompassing a wide range of drone models and operational conditions. This gap hinders the development of robust detection algorithms and effective noise mitigation strategies. Additionally, there is a need for interactive tools to facilitate research and education in drone acoustics. This journal paper extends our previous work on drone visualization, which was presented in the 2024 Artificial Intelligence x Humanities, Education, and Art (AIxHeart 2024) Conference [ 1 ] . To address these challenges, we present a novel dataset comprising audio recordings, spectrograms, and Mel-frequency cepstral coefficient (MFCC) plots for 32 different drone categories, differentiated by brand and model. Alongside this dataset, we introduce an interactive web application designed to allow users to explore the data intuitively. Users can select specific drone categories, listen to the associated audio recordings, and view the corresponding spectrogram and MFCC plots. This tool aims to enhance research capabilities in drone detection, classification, and acoustic analysis, support noise mitigation efforts, and serve as an educational resource. The publicly available website can be found online 1 1 1 https://mackenzie-jane.github.io/drone-visualization/ . The rest of this paper is organized as follows: Section 2 provides a detailed review of the literature related to drone acoustic detection, classification, and noise pollution, as well as existing datasets and interactive tools. Section 3 describes the dataset, including methods of data collection and the formats of the audio recordings, spectrograms, and MFCC plots. Section 4 discusses the design and implementation of the visualization web application, outlining its user interface and backend architecture. Section 5 presents experimental results, including an analysis of the dataset and user feedback on the web application. In Section 6, we explore potential applications of our dataset and tool, and outline future work to expand and enhance the project. Finally, Section 7 concludes the paper, summarizing our contributions and the impact of our research. II Literature Review The rapid growth of drone technologies and acoustic sensing capabilities has sparked a diverse body of research spanning detection techniques, sensing modalities, dataset development, and interactive tools for education and exploration. This section provides a structured review of prior work in seven key areas. We begin by summarizing general audio-based detection methods, followed by vision-based and radar-based approaches, each offering unique benefits and limitations. We then review detection systems based on radio frequency signatures and explore available datasets designed to support classification and benchmarking tasks. Finally, we highlight interactive tools that promote hands-on learning and simulation-based exploration in both formal education and public-facing research platforms. II-A Audio-Based Methods for UAV Detection Acoustic sensing offers a unique, low cost, and passive modality for unmanned aerial vehicle (UAV) detection, particularly effective in scenarios where visual or radio frequency based systems may be limited by occlusion, range, or signal interference. When drones operate, their motors and rotors emit characteristic sounds that vary across models, providing an opportunity to capture distinctive audio fingerprints. These acoustic signatures can be used not only for detection but also for identification and classification, especially when represented using time frequency features such as spectrograms and Mel Frequency Cepstral Coefficients (MFCCs) [ 2 , 3 ] . Several studies have leveraged these acoustic characteristics to build UAV detection datasets and evaluate various signal processing pipelines. Wang et al. [ 2 ] compared five feature extraction techniques available in the Librosa Python library—MFCCs [ 4 ] , chroma, Mel spectrograms, spectral contrast, and tonnetz—applied to audio recordings collected from DJI Phantom 4 and EVO 2 Pro drones, along with environmental noise samples. Their analysis revealed that combining multiple acoustic features significantly enhanced the discriminative capacity of the data. Other researchers have explored real time detection potential and robustness to noise. Jeon et al. [ 5 ] studied UAV detection within a 150 meter range using Gaussian Mixture Models (GMM), Convolutional Neural Networks (CNN), and Recurrent Neural Networks (RNN). They augmented drone recordings with environmental sounds and evaluated MFCC and Mel spectrogram features. Their results confirmed that acoustic signal fidelity degrades beyond 150 meters, reinforcing the importance of proximity in audio based systems. Seo et al. [ 6 ] used Short Time Fourier Transform (STFT) features with CNNs to evaluate detection accuracy and false alarm rates in open air environments. Their dataset, built from hovering Phantom 3 and Phantom 4 drones, achieved high detection rates exceeding 98% and a low false alarm rate of 1.28%, showcasing the utility of normalized time frequency features for clean drone recordings. To address data scarcity, Al Emad et al. [ 7 ] generated synthetic UAV audio using Generative Adversarial Networks (GANs). Their hybrid dataset supported both binary classification (drone versus noise) and multi class identification tasks. CNN, RNN, and CRNN models trained on this augmented corpus demonstrated improved generalizability, highlighting the potential of synthetic data for expanding UAV sound libraries. More recently, Kim et al. [ 8 ] introduced a self-supervised learning framework to mitigate the limitations of label dependent models. Their approach transforms drone audio into MFCC-based image representations and applies SimCLR, a contrastive learning algorithm, to learn generalized latent features. Without requiring labeled data, their model achieved classification accuracy on par with supervised baselines—reaching a top-1 accuracy of 87.91%. Notably, the system generalized to unseen drone types, demonstrating strong potential for scalable and adaptive drone detection in real world settings. Collectively, these studies emphasize the need for diverse, well annotated, and context rich UAV acoustic datasets to support future research in drone detection and sound based classification. Our work