SoK: Decoding the Enigma of Encrypted Network Traffic Classifiers
Nimesha Wickramasinghe 1 , Arash Shaghaghi 1 , Gene Tsudik 2 , Sanjay Jha 1 · 2025
Read SoK: Decoding the Enigma of Encrypted Network Traffic Classifiers by Nimesha Wickramasinghe 1 , Arash Shaghaghi 1 , Gene Tsudik 2 , Sanjay Jha 1 (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2503-20093.txt.
Introduction
Nimesha Wickramasinghe, Arash Shaghaghi, Gene Tsudik, and Sanjay Jha take stock of a crowded field: machine learning tools that sort encrypted network traffic. Modern encryption hides packet contents, so classic sorting by content fails. Their 2025 systematization paper sorts the studies themselves, building a taxonomy of design choices, test suites, and quiet assumptions. That map lets them judge how the field's claims hold up.
The verdict is sharp: most tools lean on outdated data sets and unstated guesses that flatter their scores. Design oversights add to the gap between lab results and real networks. The authors argue for fresher data and honest reporting of choices. Their taxonomy gives the next wave of studies a common frame to be judged against.
Catalog record
| CREATOR | Nimesha Wickramasinghe 1 , Arash Shaghaghi 1 , Gene Tsudik 2 , Sanjay Jha 1 |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 83 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2503-20093
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
SoK: Decoding the Enigma of Encrypted Network Traffic Classifiers Nimesha Wickramasinghe 1 , Arash Shaghaghi 1 , Gene Tsudik 2 , Sanjay Jha 1 Abstract The adoption of modern encryption protocols such as TLS 1.3 has significantly challenged traditional network traffic classification (NTC) methods. As a consequence, researchers are increasingly turning to machine learning (ML) approaches to overcome these obstacles. This paper analyses ML-based NTC studies by developing a taxonomy of their design choices, benchmarking suites, and prevalent assumptions impacting classifier performance. Through this systematization, we demonstrate widespread reliance on outdated datasets, oversights in design choices, and the consequences of unsubstantiated assumptions. Our evaluation reveals that the majority of proposed encrypted traffic classifiers have mistakenly utilized unencrypted traffic due to the use of legacy datasets. Furthermore, by conducting 348 feature occlusion experiments on state-of-the-art classifiers, we show how oversights in NTC design choices lead to overfitting and validate or refute prevailing assumptions with empirical evidence. By highlighting lessons learned, we offer strategic insights, identify emerging research directions, and recommend best practices to support the development of real-world applicable NTC methodologies. I Introduction Network Traffic Classification (NTC) is a fundamental process that identifies and categorizes traffic into predefined classes. NTC is crucial for various applications, including network management and security, Quality of Service (QoS) provisioning, and lawful interception. However, the increasing adoption of encryption protocols, particularly Transport Layer Security (TLS) 1.3, has introduced significant challenges to traditional NTC methods. Encrypted traffic obscures payload content, rendering many conventional classification techniques ineffective and necessitating new approaches that do not rely on signatures in plain-text payloads (e.g., deep packet inspection [ 21 ] ). As a result, researchers are increasingly turning to machine learning (ML) to address these challenges [ 50 , 92 ] . Despite the pressing need for effective NTC in the context of modern encrypted traffic, current research efforts face several challenges. One of them is the reliance on outdated datasets collected before 2018 [ 27 , 19 , 87 , 65 ] . We show that these legacy datasets do not accurately reflect the characteristics of contemporary network traffic, particularly with the adoption of TLS 1.3. Furthermore, such datasets often contain unencrypted traffic or utilize deprecated cipher suites (e.g., 3DES and RC4), leading to deceptive results when training and evaluating ML models. Another significant challenge stems from design choices when developing NTC models. Many studies overlook the potential for overfitting due to session-specific artifacts, which are often uninformative (i.e., initialized using pseudo-random values during session establishment). We show that this results in classifiers that perform well on test data but fail to generalize to real-world scenarios, undermining their robustness and reliability. Furthermore, the field is fraught with unsubstantiated and often conflicting assumptions. Many studies assume that imperfect randomness of ciphers causes discernible patterns in encrypted payloads, which can be exploited for NTC [ 10 , 55 , 33 , 50 , 74 , 28 , 92 ] . By making this assumption increasingly questionable, TLS 1.3 guarantees that the only learnable characteristic of a ciphertext is its length [ 66 ] . Additionally, there are disputes over the impact of practices such as truncating or padding payload data on classification performance [ 78 ] . These conflicting views create confusion and hinder the development of effective NTC methodologies. To the best of our knowledge, these methodological pitfalls across the entire classification pipeline have not received sufficient scrutiny. Therefore, we address outstanding challenges in NTC through this study by making the following contributions: 1. Systematization of Knowledge : We comprehensively analyse NTC studies, identifying their design choices and benchmarking suites. 2. Discuss pitfalls in NTC : By critically evaluating widely used network traffic datasets, design choices, and common assumptions, we identify and demonstrate common pitfalls in NTC. 3. CipherSpectrum : We introduce CipherSpectrum, a contemporary network traffic dataset, to address the limitations of existing datasets. For cipher-agnostic NTC, the dataset uniformly presents traffic sessions encrypted with all three mandated/recommended cipher suites of TLS 1.3. 4. Strategic insights : Building on lessons learned, we propose best practices and future research directions that lead to accurate, generalizable and real-world applicable network traffic classifiers. Scope of the Paper : This paper concentrates on raw-information based NTC [ 50 , 91 , 28 , 55 ] , which extracts information directly from network traffic, such as packet headers and payloads. While we exclude side-channel based approaches [ 46 , 18 , 64 , 60 ] and multimodal methods [ 2 , 49 , 15 , 48 ] , we recognize that a thorough understanding of raw data is fundamental to NTC. By focusing on how raw data can be meticulously used to classify traffic, we aim to provide insights that can enhance raw information-based classifiers and inform and improve multimodal approaches. The increasing adoption of raw-information-based NTC [ 61 ] further underscores the relevance and timeliness of this study. This paper is organized as follows. In Section II , we present a taxonomy and classification of existing NTC studies, detailing their design choices, benchmarking suites, and prevalent assumptions. Section III provides a systematization of these studies, synthesizing insights and identifying common trends. In Section IV , we outline the unresolved challenges in NTC by formulating specific research questions that address the issues of outdated datasets, design oversights, and unsubstantiated assumptions. Section V presents our empirical investigations, where we prove our conjectures and answer the research questions through extensive experiments. Finally, in Section 6, we discuss the implications of our findings and highlight emerging research directions. II Taxonomy and Classification In this section, we lay the groundwork for our network traffic classification (NTC) study using raw information. We introduce a taxonomy that organizes the various aspects of classifier development, focusing on the key choices made throughout the process. Broadly, these decisions fall into two main categories: design choices and benchmarking choices, which are discussed in Section II-A and Section II-B respectively. This framework serves as a basis for understanding and analyzing the development and evaluation of network traffic classifiers in this paper. II-A Design Choices The design of a Network Traffic Classification (NTC) system involves several ancillary decisions that impact its functionality, accuracy, and suitability for specific tasks. Key design considerations include the granularity of data, the methods used to extract relevant information, and the selection of features for analysis. For instance, MAC addresses, IP addresses, and protocol ports are commonly referred to as Strong Identification Information (SII) [ 50 ] . Incorporating SII constitutes an important design choice within the system’s overall framework. As illustrated in Figure 1 , each choice impacts how the classifier processes network data, which is crucial in refining the classifier’s capability. This section delves into these design considerations, structured to reflect the decision-making paths highlighted in Figure 1 . Figure 1: Taxonomy of design choices in raw information based NTC II-A 1 Traffic Granularity Traffic granularity defines the level of detail at which network traffic is analyzed and classified. To formalize, we represent the set of all traffic packets as P=\left\{p^{1},...,p^{|p|}\right\} , where each packet p^{i}=(x^{i},y^{i},t^{i}) for i\in[1,|P|] . In this notation, x^{i} represents the 5-tuple consisting of the source IP, destination IP, source port, destination port, and protocol; y^{i}