ConCap : Practical Network Traffic Generation for Flow-based Intrusion Detection Systems

Miel Verkerken 1 , Laurens D’hooge 1 , Bruno Volckaert 1 , Filip De Turck 1 , Giovanni Apruzzese 2 · 2025

Read ConCap : Practical Network Traffic Generation for Flow-based Intrusion Detection Systems by Miel Verkerken 1 , Laurens D’hooge 1 , Bruno Volckaert 1 , Filip De Turck 1 , Giovanni Apruzzese 2 (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2509-16038.txt.

Introduction

Tools that spot intrusions on a network are hard to test, since real traffic data that is both safe and well labeled is scarce. Miel Verkerken and four co-authors present ConCap, a tool that builds a small, isolated network and records its traffic with labels added for free. One settings file captures the whole setup, so other teams can repeat the same test.

Trials cover ten network activities, plus deep checks on variants and repeats. The traffic looks like that of a real network, and its flow records match those from benchmark sets and a smart home. Teams can also replay complex attack chains in safety.

Catalog record

CREATORMiel Verkerken 1 , Laurens D’hooge 1 , Bruno Volckaert 1 , Filip De Turck 1 , Giovanni Apruzzese 2
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE104 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2509-16038

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

ConCap : Practical Network Traffic Generation for Flow-based Intrusion Detection Systems Miel Verkerken 1 , Laurens D’hooge 1 , Bruno Volckaert 1 , Filip De Turck 1 , Giovanni Apruzzese 2 Abstract Network Intrusion Detection Systems (NIDS) have been studied in research for almost four decades. Yet, despite thousands of papers claiming scientific advances, a non-negligible number of recent works suggest that the findings of prior literature may be questionable. At the root of such a disagreement is the well-known challenge of obtaining data representative of a real-world network—and, hence, usable for security assessments. We tackle such a challenge in this paper. We propose ConCap , a practical tool meant to facilitate experimental research on NIDS. Through ConCap , a researcher can set up an isolated and lightweight network environment and configure it to produce network-related data, such as packets or NetFlows, that are automatically labeled—hence ready for fine-grained experiments. ConCap is rooted on open-source software and is designed to foster experimental reproducibility across the scientific community by sharing just one configuration file. Through comprehensive experiments on 10 different network activities, further expanded via in-depth analyses of 21 variants of two specific activities and of 100 repetitions of four other ones, we empirically verify that ConCap produces network data resembling that of a real-world network. We also carry out experiments on well-known benchmark datasets as well as on a real “smart-home” network, showing that, from a cyber-detection viewpoint, ConCap ’s automatically-labeled NetFlows are functionally equivalent to those collected in other environments. Finally, we show that ConCap enables to safely reproduce sophisticated attack chains (e.g., to test/enhance existing NIDS). Altogether, ConCap is a solution to the “data problem” that is plaguing NIDS research. I Introduction There is an anomaly in research on Network Intrusion Detection Systems (NIDS). On the one hand, a deluge of papers continues to expand the boundaries of our knowledge, as shown by [ 1 , 2 , 3 ] . On the other hand, a growing number of recent efforts highlight some “pitfalls” that undermine the foundations of prior research (e.g., [ 4 , 5 , 6 , 7 , 8 ] ). To portray this contrast, we can look at the panorama of open-source datasets used in NIDS-related research, some of which count thousands of citations according to Google Scholar [ 8 ] . As a concrete example, consider the paper presenting the CICIDS17 dataset [ 9 ] : published in 2018, this paper had 1600 citations in Q3 2022, which increased to 4200 in Q4 2024—indicating a substantial growth in NIDS research. Yet, in 2021, Engelen et al. [ 5 ] pinpointed glaring issues in CICIDS17—particularly in terms of ground-truth labeling of attack samples . The flaws of CICIDS17 (and also of its successor, CICIDS18) have been “fixed” in 2022 [ 6 ] . However, the EuroS&P’24 Best Paper Award [ 8 ] revealed that most datasets used by prior research have “bad design smells.” Simply put, the stark reality is that (i) data is required to support a paper’s claims, but (ii) high-quality data is hard to come by in the NIDS context—especially from the viewpoint of an academic researcher [ 2 , 8 , 10 ] . To aggravate this problem, modern NIDS increasingly rely on data-driven techniques, such as machine learning (ML). Therefore, labeled data is necessary to properly evaluate the pros and cons of state-of-the-art NIDS [ 2 ] . Finally, despite the benefits that open-source datasets (under the assumption that they are correctly labeled) can provide to a researcher [ 11 ] , exclusive reliance on such “static benchmarks” prevents one from generating new data . This impairs the assessment of existing NIDS against recent, and more sophisticated threats—such as multi-step attacks [ 12 , 13 ] , or attacks exploiting recently-discovered vulnerabilities [ 14 ] . We aim to rectify such a “data problem.” Our major technical contribution is ConCap , an open-source system to generate (and label) network-traffic data mimicking that of a real-world network . ConCap is particularly suited to generate network data pertaining to malicious activities. Such data can then be used alongside “benign” data taken from the network environment that the NIDS is meant to protect—which is a well-founded assumption [ 15 , 16 , 10 ] . Practically, such environment can be: (a) that of a benchmark dataset [ 11 ] , or of (b) an ad-hoc network testbed for experimental research [ 17 ] , or even that of (c) a real-world network [ 18 ] . We design ConCap so that it is (i) flexible enough to enable reproduction of any (allegedly malicious) network activity, whose generated datapoints are (ii) automatically labeled at the granular level, while also enabling (iii) control of the network conditions (e.g., to simulate resource starvation). As such, ConCap represents a solid foundation to address the “data problem” that affects NIDS research. We will demonstrate this. To develop ConCap , we assembled open-source technologies, such as container-related frameworks, networking utilities, and network flows (NetFlow [ 2 , 19 ] ) extractors. Our design facilitates experimental reproducibility : to (automatically) generate labeled NetFlows pertaining to one (or more) attacks, ConCap only requires the researcher to define a “scenario,” i.e., a file describing the activities of the “attacker” and “target” host(s), as well as the characteristics of the overarching network channel. In this way, other researchers can replicate the same experiments just by running the same “scenario” in their own version of ConCap , thereby removing the need to share data —which can be quite big in size (e.g., the CICIDS18 [ 9 ] dataset is larger than 400GB). Such a property intrinsically fosters scientific reproducibility—which is lacking even in top-tier security venues [ 20 , 2 ] . We empirically validate the “realisticness” of ConCap ’s generated data. Through extensive experiments wherein we compare the network traffic produced by a real-world network with that generated by ConCap , we find that there are negligible differences (at both the packet- and NetFlow-level) between these two setups. We deeply investigate such differences, and confirm that they are due to the well-known “unpredictable” behavior of modern networks [ 21 , 2 ] . Inspired by such a finding, we go one step further and examine if the data generated by ConCap is deterministic—an aspect that received limited attention from related research (e.g., [ 22 ] ). Our analysis, entailing 100 executions of the same set of four distinct network activities, reveals that ConCap ’s output cannot be claimed to be fully deterministic—as is the case for real-world networks, too. However, through other experiments on well-known benchmarks and on a real “smart-home” network, we show that, ML-wise, the data generated by ConCap is functionally equivalent to that of other network setups. Altogether, our evaluations demonstrate that ConCap represents a convenient tool to address the “data problem” that affects NIDS-related research. For instance, we also show how to use ConCap to carry out security assessments of NetFlow- and ML-based NIDS against recent CVE; as well as how to replicate a sophisticated attack chain, resembling nine MITRE ATT&CK tactics, and generate the corresponding (labeled) traffic. Finally, we also show that ConCap is lightweight: it takes

Read the complete text