Federated Intrusion Detection System Based on Unsupervised Machine Learning

Maxime Gourceyraud, Rim Ben Salem, Christopher Neal, Frédéric Cuppens, Nora Boulahia Cuppens · 2025

Read Federated Intrusion Detection System Based on Unsupervised Machine Learning by Maxime Gourceyraud, Rim Ben Salem, Christopher Neal, Frédéric Cuppens, Nora Boulahia Cuppens (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2503-22065.txt.

Introduction

Gourceyraud and co-authors design an intrusion detector that learns across companies without pooling their sensitive network data, in this 2025 paper. Labels for attacks are scarce, so the system learns without them. Privacy rules also block the sharing that would make training easier.

Their design pairs unsupervised clustering with federated learning, where each site trains locally and shares only model updates. A new initialization trick for the clustering keeps that federation more private than earlier versions. Moving from a central setup to the federated one cost almost nothing in detection quality. The authors present the balance as workable for real security teams. Cooperation, they show, need not mean exposure.

Catalog record

CREATORMaxime Gourceyraud, Rim Ben Salem, Christopher Neal, Frédéric Cuppens, Nora Boulahia Cuppens
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE33 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2503-22065

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Federated Intrusion Detection System Based on Unsupervised Machine Learning Maxime Gourceyraud, Rim Ben Salem, Christopher Neal, Frédéric Cuppens, Nora Boulahia Cuppens Abstract Recent Intrusion Detection System (IDS) research has increasingly moved towards the adoption of machine learning methods. However, most of these systems rely on supervised learning approaches, necessitating a fully labeled training set. In the realm of network intrusion detection, the requirement for extensive labeling can become impractically burdensome. Moreover, while IDS training could benefit from inter-company knowledge sharing, the sensitive nature of cybersecurity data often precludes such cooperation. To address these challenges, we propose an IDS architecture that utilizes unsupervised learning to reduce the need for labeling. We further facilitate collaborative learning through the implementation of a federated learning framework. To enhance privacy beyond what current federated clustering models offer, we introduce an innovative federated K-means++ initialization technique. Our findings indicate that transitioning from a centralized to a federated setup does not significantly diminish performance. 1 Introduction Cybercrime has become a major concern worldwide, posing significant economic problems. In fact, the World Trade Organization (WTO) estimates that the cost of cybercrime reached $8,150 billion USD in 2023 and could escalate to $13,820 billion USD by 2028 [ 21 ] . For organizations globally, detecting cyberattacks is crucial to mitigating their impact. Furthermore, with the increasing frequency of attacks, automating the detection process through Intrusion Detection Systems (IDS) software has become essential. Traditionally, intrusion detection involves the use of signatures, where the IDS maintains a database of known attacks and compares incoming data against this database. A match with any known attack results in the data being labeled accordingly. While effective at identifying known threats, this method relies on static rules and is inadequate for adapting to new, evolving attacks. However, with advances in Machine Learning (ML), IDS systems have been increasingly been able to identify previously unseen attacks. In recent years, ML-based IDS platforms have predominantly utilized supervised algorithms, to learn attack patterns by analyzing labeled data. However, the sheer volume of data generated by an organization’s normal operations is too vast to label entirely, making it labor-intensive and resource-intensive. To circumvent this issue, unsupervised ML algorithms, which do not require extensive data labeling, can be employed. For instance, data clustering algorithms group data into partitions, or clusters, without prior knowledge of labels. A popular algorithm for data clustering is the K-Means algorithm, introduced by S. Lloyd [ 9 ] , which creates clusters based on the proximity of data points to cluster centroids. ML thrives on large, diverse datasets, which can pose challenges for organizations not primarily focused on data tasks. Collaboratively developing an IDS using varied data can leverage shared insights. However, traditional ML frameworks are centralized, requiring data to be consolidated at a single location. This centralization poses privacy risks and creates a single point of failure. For example, a compromised server holding data from all participants exposes extensive sensitive information. Conversely, decentralized data storage across departments or even different organizations force an attacker to breach each one individually, significantly reducing overall risk. The field of Federated Learning (FL), introduced by McMahan et al. [ 11 ] , addresses these issues by proposing a learning protocol that includes model learning at the client level and model aggregation at the server side, thus keeping the data localized. This paper combines unsupervised and federated learning to develop an IDS. We validate this approach with experiments using the UNSW-NB15 [ 13 ] and CIC-IDS2017 [ 18 ] datasets. We summarize the contributions of this work as follows: • We propose a federated learning-compatible architecture that integrates clustering algorithms for intrusion detection. • We introduce a federated k-means++ initialization that is mathematically equivalent to its centralized counterpart. • We present a method for computing a simplified silhouette score for clustering model selection within a federated framework. The remainder of the paper is outlined as follows. A review of related work is provided in Section 2 . The methodology of this work is detailed in Section 3 . The experimental results of our approach are reported in Section 4 . We discuss our findings in Section 5 and conclude this work in Section 6 . 2 Related Work This section presents an overview of clustering algorithms that are applicable in FL environments, followed by an introduction to relevant centralized and federated IDS frameworks. 2.1 Clustering Algorithms Client Clustering. One part of the federated clustering is not dedicated to cluster the clients’ data but the clients themselves. This way, the clients are grouped in the aggregation step to enhance the performances of a supervised model. For example, CADIS [ 14 ] uses the second last layer of locally learned deep learning models to calculate a customer similarity matrix. Using a layer of the model learned at the customer’s site makes it possible to observe the distribution of data without having access to the data itself. When the models are aggregated by the server, the modifications made locally are weighted by the size of the client’s dataset and the inverse of the number of clients that are similar to it. This way, the weight of clients is reduced for those belonging to a large cluster and increased for those belonging to a small cluster. Federated Clustering. The type of federated clustering algorithms that we are interested in our study are those that cluster the clients’ data. One of the first introduced was K-FED [ 4 ] and it is based on K-Means. The clients perform the clustering algorithm of Aswathi et al. [ 3 ] . The server aggregates the centroids by using Lloyd’s algorithm [ 9 ] . K-FED works in only one round of communication. Each client must not have more than \sqrt{k} of the overall k clusters. Two federated clustering algorithms are presented approximately at the same time. First, the Federated K-Means by Garst and Reinders [ 5 ] uses a K-Means++ initialization [ 8 ] at the client level. Then, the server aggregates the centroids by performing Lloyd’s algorithm with each centroid weighted by the size of the cluster it represents. The clients improve the model by doing one step of Lloyd’s algorithm on their data with the global centroids. A new round of communication begins after the server once again aggregates the clients’ centroids. The algorithm stops after a fixed number of rounds of communication. The other algorithm presented around the same period of time as [ 5 ] is proposed by Holzer et al. [ 7 ] . This algorithm does not require that every client participates in the protocol at the same time. Each selected client updates the global centroids with one step of Lloyd’s algorithm. The server aggregates the new centroids with a weighted average cluster by cluster. The weight of each centroid is the size of its cluster on the client side. This approach is similar to the one that is used in Tensorflow Federated [ 20 ] . But Holzer et al. use a learning rate to bound the updates and use inertia to limit the fluctuations of the global model. 2.2 Unsupervised IDS In this section, we highlight related IDS work based on unsupervised learning that utilizes either a centralized or

Read the complete text