Reducing Communication Overhead in Federated Learning for Network Anomaly Detection with Adaptive Client Selection

William Marfo, Deepak K. Tosh, Shirley V. Moore, Joshua Suetterlein, Joseph Manzano · 2025

Read Reducing Communication Overhead in Federated Learning for Network Anomaly Detection with Adaptive Client Selection by William Marfo, Deepak K. Tosh, Shirley V. Moore, Joshua Suetterlein, Joseph Manzano (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2503-15448.txt.

Introduction

William Marfo and co-authors cut communication costs in federated learning for network anomaly detection in this 2025 paper. Federated setups train across many sites without pooling raw data. Traffic between sites can swamp the savings, though. Diverse client machines and networks make tuning hard. Their framework tunes batch size, picks clients adaptively, and lets updates arrive out of step. Two datasets test it: general traffic and car network traffic.

Communication time fell by over ninety percent in their runs. Detection accuracy stayed level with the unoptimized setup. A standard statistical test checked the difference claims. Security monitors are the end users of such systems. Cars add a second, harsher network setting. The paper is a distributed learning systems study.

Catalog record

CREATORWilliam Marfo, Deepak K. Tosh, Shirley V. Moore, Joshua Suetterlein, Joseph Manzano
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE43 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2503-15448

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Reducing Communication Overhead in Federated Learning for Network Anomaly Detection with Adaptive Client Selection William Marfo, Deepak K. Tosh, Shirley V. Moore, Joshua Suetterlein, Joseph Manzano Abstract Communication overhead in federated learning (FL) poses a significant challenge for network anomaly detection systems, where the myriad of client configurations and network conditions can severely impact system efficiency and detection accuracy. While existing approaches attempt to address this through individual optimization techniques, they often fail to maintain the delicate balance between reduced overhead and detection performance. This paper presents an adaptive FL framework that dynamically combines batch size optimization, client selection, and asynchronous updates to achieve efficient anomaly detection. Through extensive profiling and experimental analysis on two distinct datasets—UNSW-NB15 for general network traffic and ROAD for automotive networks—our framework reduces communication overhead by 97.6% (from 700.0s to 16.8s ) compared to synchronous baseline approaches while maintaining comparable detection accuracy ( 95.10% vs. 95.12% ). Statistical validation using Mann-Whitney U \mathrm{U} test confirms significant improvements ( p < 0.05 ) (p<0.05) over existing FL approaches across both datasets, demonstrating the framework’s adaptability to different network security contexts. Detailed profiling analysis reveals the efficiency gains through dramatic reductions in GPU operations and memory transfers while maintaining robust detection performance under varying client conditions. I Introduction The rapid growth of digital connectivity and network infrastructure, driven by the proliferation of connected devices and critical digital systems, has significantly increased the potential for network anomalies, including cyber-attacks and system faults [ 1 ] . Detecting these anomalies swiftly and accurately is crucial for maintaining the security and reliability of networked environments, particularly in sectors where uninterrupted service is essential [ 2 ] . While network anomaly detection aims to identify deviations in traffic behavior that may indicate threats, traditional centralized machine learning (ML) methods, which aggregate data on central servers, often face issues with latency, scalability, and data transfer costs, making them unsuitable for large-scale network anomaly detection [ 3 ] . Federated learning (FL) has emerged as a viable alternative, enabling decentralized model training across distributed client nodes. FL allows data to remain localized while model updates are communicated to a central server, reducing the need for centralized data collection [ 4 ] . This decentralized approach makes FL particularly suited for time-sensitive applications, such as network anomaly detection, where timely responses to evolving patterns are critical. Despite these advantages, FL introduces a new challenge: managing the communication overhead associated with frequent model updates, especially in time-sensitive applications like network anomaly detection, where delays can compromise real-time detection capabilities [ 5 ] . Efficiently balancing communication overhead with model performance remains a key barrier to the effective deployment of FL for network anomaly detection. Existing approaches to reduce FL communication overhead include techniques like client clustering and selective updates [ 6 ] . While these methods provide useful insights, they often address isolated aspects of the problem and lack a comprehensive framework that dynamically balances communication efficiency with detection performance. This limitation is further compounded by the diverse conditions across clients, such as variations in computational resources and network quality, which can disrupt system robustness and consistency [ 3 , 1 ] . In response to these challenges, we propose an adaptive FL framework specifically designed to optimize communication overhead in network anomaly detection. Our framework incorporates the following contributions: • A dynamic batch size optimization strategy coupled with efficient local training through mixed precision and distributed data parallelism (DDP) to enhance computational efficiency on client devices. • An asynchronous communication approach to minimize idle time and reduce bottlenecks, improving overall communication efficiency. • A gradient alignment-based selective update mechanism that filters out unconstructive updates, ensuring only the most relevant updates contribute to the global model. We validate our framework on two datasets: UNSW-NB15 [ 7 ] , representing modern network traffic, and ROAD [ 8 ] , containing automotive network data with verified attacks. In automotive networks, detecting anomalies like masquerade attacks is critical, as they can manipulate vehicle controls, causing unintended braking or sudden acceleration, posing serious safety risks. Through detailed profiling and experimental analysis, our results demonstrate substantial reductions in communication overhead and enhanced computational efficiency across both datasets, establishing a robust foundation for deploying FL in various network security contexts. To advance the state of the art in FL for network anomaly detection, we make the code for our framework publicly available on GitHub [ 9 ] . This enables other researchers to replicate our results, compare new algorithms, and further explore communication-efficient FL techniques. The remainder of this paper is organized as follows: Section II outlines key FL challenges. Section III reviews related work on communication optimization in FL. Section IV describes our proposed optimization methods. Section V presents experimental setup and results, followed by a discussion in Section VI . Finally, Section VII summarizes the findings and suggests future research directions. II Background II-A Communication Overhead and Synchronous Updates in FL Synchronous FL algorithms, such as FedAvg [ 10 ] , inherently face significant challenges when deployed in real-world environments. The core issue arises from the “straggler effect,” where a central server must wait for all participating clients to complete their local training before model aggregation [ 10 ] . This synchronization requirement means the entire system operates at the speed of the slowest client, creating a fundamental bottleneck in the training process. The impact of these delays is particularly problematic in network anomaly detection scenarios, which demand timely responses to security threats. Delays in aggregating model updates can result in postponed anomaly detection, allowing security threats to persist for extended periods before being addressed [ 6 ] . Traditional solutions that attempt to address this by simply excluding slow clients are problematic, as they can lead to bias in the trained model and potentially miss important anomaly patterns present in the data of slower clients [ 2 ] . II-B Batch Size Considerations in FL Batch size in FL presents unique challenges compared to centralized training due to decentralized devices with varying computational capabilities and data distributions [ 6 ] . In FL, a communication round —where clients perform local training, transmit model updates to the server, and receive an aggregated global model—creates fundamental trade-offs. Larger batch sizes reduce communication rounds [ 5 ] but can impair generalization and increase local computation time, particularly with heterogeneous devices and non-IID data [ 1 ] . While smaller batch sizes enhance generalization and convergence, they increase communication overhead [ 4 ] . This trade-off becomes critical in anomaly detection scenarios, where non-IID data distributions can amplify update variance with larger batches [ 11 ] , while smaller batches, despite enabling faster initial convergence, incur higher network communication costs [ 5 ] . III Related Work Al-Saedi et al. [ 6 ] proposed CA-FL to reduce communication overhead in FL by clustering worker updates based on similarity. Their analysis of human activity recognition (HAR) datasets showed that clustering similar updates effectively reduces communication costs and maintains model accuracy. This makes CA-FL a promising solution for improving efficiency without compromising performance. Hu et al. [ 12 ] introduced dPRO, a performance diagnosis toolkit for distributed deep neural network (DNN) training. Their approach,

Read the complete text