Microsecond Federated SVD on Grassmann Manifold for Real-time IoT Intrusion Detection

Tung-Anh Nguyen, Van-Phuc Bui, Shashi Raj Pandey, Kim Hue Ta, Nguyen H. Tran, Petar Popovski · 2025

Read Microsecond Federated SVD on Grassmann Manifold for Real-time IoT Intrusion Detection by Tung-Anh Nguyen, Van-Phuc Bui, Shashi Raj Pandey, Kim Hue Ta, Nguyen H. Tran, Petar Popovski (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2510-18501.txt.

Introduction

Tung-Anh Nguyen and his five co-authors present FedSVD, a system for spotting intrusions in networks of small internet-connected devices. The devices learn together without pooling their raw data in one place, a pattern called federated learning, and the method needs no labeled examples of attacks. Its core tool is singular value decomposition, a matrix method run here through optimization on a special geometric space known as a Grassmann manifold.

The design targets low-power hardware such as the NVIDIA Jetson AGX Orin, cutting both communication load and computing cost. In experiments, detection quality matched deep learning baselines for both known and unknown intrusions, while answers arrived more than ten times faster. That speed matters for security on live device networks, where a slow detector can miss the moment an attack is still stoppable.

Catalog record

CREATORTung-Anh Nguyen, Van-Phuc Bui, Shashi Raj Pandey, Kim Hue Ta, Nguyen H. Tran, Petar Popovski
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE30 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2510-18501

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Microsecond Federated SVD on Grassmann Manifold for Real-time IoT Intrusion Detection Tung-Anh Nguyen, Van-Phuc Bui, Shashi Raj Pandey, Kim Hue Ta, Nguyen H. Tran, Petar Popovski Abstract This paper introduces FedSVD, a novel unsupervised federated learning framework for real-time anomaly detection in IoT networks. By leveraging Singular Value Decomposition (SVD) and optimization on the Grassmann manifolds, FedSVD enables accurate detection of both known and unknown intrusions without relying on labeled data or centralized data sharing. Tailored for deployment on low-power devices like the NVIDIA Jetson AGX Orin, the proposed method significantly reduces communication overhead and computational cost. Experimental results show that FedSVD achieves performance comparable to deep learning baselines while reducing inference latency by over 10 × 10\times , making it suitable for latency-sensitive IoT applications. I Introduction The deployment of 5G and beyond wireless networks has enabled transformative applications such as Virtual Reality (VR), eXtended Reality (XR), and large-scale Internet of Things (IoT) systems [ 1 ] . These technologies rely on extensive networks of distributed, low-power edge devices that continuously generate and exchange large volumes of data. However, the rapid proliferation of these devices poses significant challenges to system integrity, as anomalies arising from malfunctions, cyber threats, or unexpected data patterns can severely degrade network performance and compromise security. In such a case, the efficacy of traditional centralized anomaly detection methods, such as [ 2 ] , which model normal network behaviour and identify deviations indicative of threats, is limited. Machine learning-based intrusion detection systems (ML-IDS) offer a promising solution for network defense [ 3 ] , typically employing supervised learning approaches from classical classifiers to deep neural networks. However, centralized ML-IDS architectures are increasingly impractical in IoT environments due to data privacy concerns and resource limitations, such as bandwidth and latency constraints. Federated Learning (FL) offers a decentralized alternative by enabling local training while sharing only model parameters [ 4 ] . Despite its advantages, most FL-IDS rely on labeled data, limiting their ability to detect unknown attacks [ 5 , 4 ] . Supervised learning models typically incur substantial computational and memory overhead, posing challenges for deployment on resource-constrained IoT devices. In practice, IoT nodes often host multiple ML models to support diverse functionalities, which further exacerbates memory and processing limitations [ 6 ] . This contention for limited resources hinders real-time performance and diminishes the responsiveness of IDS. Additionally, the recent progress in ML has been predominantly driven by deep learning techniques, which require high-performance hardware accelerators such as Graphics Processing Units (GPUs) or Neural Processing Units (NPUs). These requirements significantly increase deployment costs and scalability challenges in large-scale IoT environments. As a result, legacy IoT devices, lacking such specialized hardware, are unable to accommodate modern ML models, leaving them more vulnerable to security threats. These limitations underscore the urgent need for efficient, lightweight, and privacy-preserving anomaly detection approaches, thereby motivating the investigation of unsupervised and low-complexity alternatives. Fig. 1 : The visualization of the Federated SVD-based anomaly detection system model. To tackle these challenges, we introduce FedSVD , a novel unsupervised federated anomaly detection framework leveraging Singular Value Decomposition (SVD) and Grassmann manifold optimization tailored specifically for decentralized IoT networks. Compared to neural network-based federated methods, FedSVD significantly reduces communication and storage overhead by exchanging only compact subspace representations. Fig. 1 illustrates this with a toy example, highlighting FedSVD’s lightweight nature and its effectiveness in identifying anomalies without heavy computation. This federated approach, which operates on unlabeled data, can identify both known and previously unseen threats, offering a broader range of generalization than traditional supervised methods. Besides, FedSVD effectively captures the intrinsic geometric structure of high-dimensional network traffic data, providing rapid convergence and accurate anomaly detection without labeled data or centralized data collection [ 7 ] . To validate our approach, extensive experiments are performed on the NSL-KDD dataset [ 8 ] , demonstrating that FedSVD significantly outperforms baseline methods in terms of computational efficiency, and scalability, while keeping high detection accuracy, confirming its practical suitability for resource-limited hardware platforms. The main contributions of this work are as follows: (1) We propose FedSVD, a novel FL-based anomaly detection framework leveraging SVD and Grassmann manifold optimization [ 9 ] , specifically designed for decentralized and resource-constrained IoT networks. (2) We develop a distributed optimization algorithm operating on Grassmann manifolds, ensuring efficient and accurate anomaly detection by effectively modeling high-dimensional data. This approach facilitates proactive threat mitigation by efficiently modeling normal behavior and detecting deviations without the need for labeled data or centralized data sharing. (3) Experiments on the NSL-KDD dataset show that FedSVD achieves performance comparable to advanced non-linear baselines while reducing inference latency by over 10\times , confirm its practical deployment feasibility through implementation on the NVIDIA Jetson AGX Orin platform. II System Model This section presents a federated anomaly detection system tailored for interconnected environments such as large-scale IoT and edge computing networks. In these settings, local hubs (e.g., sensors, controllers, or VR/AR headsets) act as FL clients that perform on-device training using their own traffic data, while collaborating with a global server ( CO ) hosted in the cloud. Illustrated in Fig. 1 , the communication process between local hubs ( GW ) and the CO operates as: during training, both CO and GW engage in a collaborative process, where low-dimensional representations of the data are computed using SVD. In each training round, CO sends the global model to the GW s, which update the model based on their locally collected data. These updates are then aggregated by CO to further refine the global model, repeating until convergence. After training is complete, each GW uses the final global model to autonomously detect anomalies in its local data, without requiring labeled datasets. Assuming that each GW collects data and sends the those data to CO , we use \mathbf{X}\in\mathbb{R}^{d\times D} to denote the fully observed dataset, where d is the data dimension and D is the total number of data points. The dataset \mathbf{X}=[\mathbf{X}_{1},\mathbf{X}_{2},\ldots,\mathbf{X}_{N}] is distributed across N clients. Each client i\in\{1,\ldots,N\} contains a local dataset of D_{i} records, denoted by \mathbf{X}_{i}=[\mathbf{x}_{1},\mathbf{x}_{2},\ldots,\mathbf{x}_{D_{i}}]\in\mathbb{R}^{d\times D_{i}} , where each \mathbf{x}_{i}\in\mathbb{R}^{d} represents a single record, and \sum_{i=1}^{N}D_{i}=D . The SVD problem seeks the best rank- k ( k<d ) approximation of the matrix \mathbf{X} by another matrix \tilde{\mathbf{X}} such that the reconstruction error, measured by \|\mathbf{X}-\tilde{\mathbf{X}}\|_{F} , is minimized. Here, \|\cdot\|_{F} denotes the Frobenius norm. The solution \tilde{\mathbf{X}} is typically based on SVD of \mathbf{X} , given by \displaystyle\mathbf{X}=\mathbf{U}\mathbf{\Sigma}\mathbf{V}^{\top}, (1) where \mathbf{U}\in\mathbb{R}^{d\times d} contains the left singular vectors of \mathbf{X} as its columns, \mathbf{\Sigma}=\text{diag}(\sigma_{1},\ldots,\sigma_{d}) contains the singular values ( \sigma_{1}\geq\sigma_{2}\geq\ldots\geq\sigma_{d}\geq 0 ), and \mathbf{V}\in\mathbb{R}^{D\times D} contains the right singular vectors of \mathbf{X} as its columns. Note that the columns of \mathbf{U} are orthonormal. The rewrite the closed-form solution for the local dataset \tilde{\mathbf{X}}_{i} is expressed as \displaystyle\tilde{\mathbf{X}}_{i}=\mathbf{U}_{i}\mathbf{\Sigma}_{i}\mathbf{V}_{i}^{\top}, (2) where \mathbf{U}_{i}\in\mathbb{R}^{d\times k},\mathbf{\Sigma}_{i}\in\mathbb{R}^{k\times k},\mathbf{V}_{i}\in\mathbb{R}^{D\times k} . We stress that computing a rank- k approximation (\mathbf{U}_{i},\mathbf{\Sigma}_{i}\mathbf{V}_{i}) enables dimensionality reduction of the dataset. Specifically, the quantity \tilde{\mathbf{X}}_{i}\in\mathbb{R}^{k\times D_{i}} in ( 2 ) serves as a lower-dimensional representation of \mathbf{X}_{i} that minimizes the reconstruction error. In a distributed setting, the goal is to learn a common representation across all clients’ datasets. This involves minimizing the reconstruction error over all devices while ensuring

Read the complete text