QUT-DV25: A Dataset for Dynamic Analysis of Next-Gen Software Supply Chain Attacks

Sk Tanzir Mehedi, Raja Jurdak, Chadni Islam, Gowri Ramachandran · 2025

Read QUT-DV25: A Dataset for Dynamic Analysis of Next-Gen Software Supply Chain Attacks by Sk Tanzir Mehedi, Raja Jurdak, Chadni Islam, Gowri Ramachandran (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2505-13804.txt.

Introduction

Sk Tanzir Mehedi and co-authors release a data set for catching a newer breed of software attack in a 2025 paper. Attackers now hide malware inside packages on public code libraries. The nastiest tricks fire only during or after install: multi-stage runs, remote access switched on, payloads built on the fly. Older data sets, built on static code reading, cannot see any of that.

Their data set, QUT-DV25, records what packages actually do when run. The team executed more than fourteen thousand Python packages, about half of them malicious, inside an isolated sandbox built on a packet filter framework. The traces capture install-time and post-install behavior. With behavior on record, detection models can learn the moves of live attacks, not just their code's look. The data set serves the Python Package Index ecosystem first.

Catalog record

CREATORSk Tanzir Mehedi, Raja Jurdak, Chadni Islam, Gowri Ramachandran
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE44 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2505-13804

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

QUT-DV25: A Dataset for Dynamic Analysis of Next-Gen Software Supply Chain Attacks Sk Tanzir Mehedi, Raja Jurdak, Chadni Islam, Gowri Ramachandran Abstract Securing software supply chains is a growing challenge due to the inadequacy of existing datasets in capturing the complexity of next-gen attacks, such as multiphase malware execution, remote access activation, and dynamic payload generation. Existing datasets, which rely on metadata inspection and static code analysis, are inadequate for detecting such attacks. This creates a critical gap because these datasets do not capture what happens during and after a package is installed. To address this gap, we present QUT-DV25, a dynamic analysis dataset specifically designed to support and advance research on detecting and mitigating supply chain attacks within the Python Package Index (PyPI) ecosystem. This dataset captures install and post-install-time traces from 14,271 Python packages, of which 7,127 are malicious. The packages are executed in an isolated sandbox environment using an extended Berkeley Packet Filter (eBPF) kernel and user-level probes. It captures 36 real-time features, that includes system calls, network traffic, resource usages, directory access patterns, dependency logs, and installation behaviors, enabling the study of next-gen attack vectors. ML analysis using the QUT-DV25 dataset identified four malicious PyPI packages previously labeled as benign, each with thousands of downloads. These packages deployed covert remote access and multi-phase payloads, were reported to PyPI maintainers, and subsequently removed. This highlights the practical value of QUT-DV25 , as it outperforms reactive, metadata, and static datasets, offering a robust foundation for developing and benchmarking advanced threat detection within the evolving software supply chain ecosystem. 1 Introduction The exponential growth of Open-Source Software (OSS) has introduced significant cybersecurity challenges, particularly in detecting sophisticated software supply chain attacks targeting ecosystems like the Python Package Index (PyPI) [ 1 , 2 ] . PyPI hosts over 620,000 packages and facilitates billions of daily downloads, underscoring its central role in modern software development [ 3 , 4 ] . However, its open nature and rapid scalability have made it a prime target for adversaries [ 5 ] . As of July 2024, 1.2% of total PyPI packages have been identified as malicious, highlighting growing security concerns [ 6 , 7 , 8 , 9 ] . These attacks are becoming more common as multi-stage threats that exploit vulnerabilities in the OSS ecosystem, including typosquatting, malware execution, remote access, and dynamic payload generation [ 10 , 11 , 12 ] . Such threats compromise the core security principles of confidentiality, integrity, and availability [ 2 , 13 ] . Existing defense mechanisms, such as host-based firewalls and signature or rule-based malware scanners, struggle to counter these threats due to their inability to adapt to evolving, multi-stage adversarial tactics and their limited capacity for granular behavioral code analysis [ 14 , 15 , 16 ] . As a result, Malicious Detection Systems (MDS) have emerged as critical safeguards for the OSS ecosystem, using Machine Learning (ML) or Deep Learning (DL) models to identify and mitigate next-gen attacks [ 17 , 18 , 19 ] . The effectiveness of MDSs relies on their detection performance metrics, which require evaluation against comprehensive datasets containing both benign and malicious package behaviors [ 17 , 5 ] . Widely adopted metadata and static dataset benchmarks, such as the PyPI Malware Registry [ 20 ] , Backstabber’s Knife Collection [ 21 ] , DataDog [ 22 ] , and PyPIGuard [ 23 ] , have served as standards for MDS validation. However, recent studies highlight critical limitations in these datasets [ 5 , 24 ] . For instance, metadata datasets capture only package details like descriptions and author profiles, while static datasets focus on code attributes such as function signatures and import statements, without executing packages during installation or post-installation [ 17 , 5 ] . This omission severely limits their ability to detect dynamic threats such as typosquatting, remote access activation, and install-time-specific payload generation [ 14 , 15 , 16 ] . Hybrid datasets, which combine static and metadata features, partially address some threats but still fail to detect most of these threats, as they lack visibility into complex behaviors that occur during install-time and post-install-time [ 19 , 24 ] . These limitations in existing datasets undermine the reliability of performance metrics, raising concerns about the generalizability of MDS evaluations to next-gen OSS supply chain attacks. To address these challenges, this study introduces the QUT-DV25 dataset, specifically designed to facilitate dynamic analysis of next-gen OSS software supply chain attacks within the PyPI ecosystem. QUT-DV25 captures behavioral traces from 14,271 Python packages, 7,127 of which exhibit malicious behavior, through install and post-install-time in a controlled, isolated sandbox environment using an extended Berkeley Packet Filter (eBPF) kernel and user-level probes. A subset of high-value probes is selected from an initial pool of over 105 eBPF-based probes, focusing on those most effective for capturing behaviors relevant to malware execution. This tool enables real-time tracing without kernel modification and supports flexible, programmable monitoring in C or Python [ 25 ] . The dataset records 36 real-time features for each package, including system calls, network traffic, resource consumption, directory access patterns, dependency resolution, and installation behaviors. These features enable comprehensive analysis of dynamic attack vectors such as multiphase malware execution, remote access activation, and post-install-time-specific payload generation. A detailed characterization of the dataset’s structure, threat coverage, and example is also provided. Furthermore, the performance of MDSs is evaluated based on this dataset as a binary classification task using multiple supervised ML and DL models. By bridging the gap between static and dynamic analysis, QUT-DV25 empowers cybersecurity researchers to develop robust defenses against evolving OSS supply chain threats. The dataset 1 1 1 Dataset: https://doi.org/10.7910/DVN/LBMXJY ; Package List: https://qut-dv25.dysec.io , source code, and execution instructions 2 2 2 Code URL: https://github.com/tanzirmehedi/QUT-DV25 are publicly available, ensuring reproducibility and enabling further research. The key contributions of this study include: • A controlled, isolated testbed framework to generate and collect datasets by installing and executing packages and capturing behaviors such as typosquatting, dynamic payload generation, and multiphase malware execution. • QUT-DV25 , a dataset of 14,271 packages, including 7,127 malicious ones, with 36 features across six categories that capture install-time and post-install-time behaviors previously unexplored for malicious package detection. • A first-hand evaluation of four popular machine learning and two deep learning models on the proposed dataset is also provided as a baseline for further research. This study is organized as follows: Section 2 reviews existing datasets. Section 3 outlines the dataset construction and details of the dataset. Section 4 presents technical validation and benchmarks. Section 5 discusses limitations and usage examples, and Section 6 addresses safety and ethical considerations. Finally, Section 7 concludes the study and outlines future directions. 2 Existing Datasets The effectiveness of MDS datasets depends on two factors: coverage of modern threats and diversity of benign behaviors to reduce false positives [ 5 ] . Datasets lacking realistic adversarial contexts risk misleading evaluations [ 24 ] . Existing benchmarks are categorized as metadata, static, hybrid, and dynamic, each with limitations in modeling next-gen multi-stage attacks. Metadata datasets: Metadata datasets focus on static, non-execution-based features such as package names, descriptions, version histories, and author profiles [ 17 ,

Read the complete text