FedLAD: A Linear Algebra Based Data Poisoning Defence for Federated Learning

Qi Xiong, Hai Dong, Nasrin Sohrabi, Zahir Tari · 2025

Read FedLAD: A Linear Algebra Based Data Poisoning Defence for Federated Learning by Qi Xiong, Hai Dong, Nasrin Sohrabi, Zahir Tari (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2508-02136.txt.

Introduction

Qi Xiong, Hai Dong, Nasrin Sohrabi, and Zahir Tari propose a 2025 defense for a style of machine learning in which many sites train one model together without sharing raw data. That setup, called federated learning, can be attacked by fake sites that act as a group to poison the shared model. Defenses based on grouping or robust training can fail when the fake sites form the majority.

Their method, FedLAD, treats the step that merges each site's update as a linear algebra problem. It pulls out the parts of the merged update that stand on their own and filters out parts that are redundant or hostile. Tests show the defense keeps working even when attackers are numerous. The work offers a fresh angle for guarding shared training.

Catalog record

CREATORQi Xiong, Hai Dong, Nasrin Sohrabi, Zahir Tari
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE48 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2508-02136

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

FedLAD: A Linear Algebra Based Data Poisoning Defence for Federated Learning Qi Xiong, Hai Dong, Nasrin Sohrabi, Zahir Tari Abstract Sybil attacks pose a significant threat to federated learning, as malicious nodes can collaborate and gain a majority, thereby overwhelming the system. Therefore, it is essential to develop countermeasures that ensure the security of federated learning environments. We present a novel defence method against targeted data poisoning, which is one of the types of Sybil attacks, called Linear Algebra-based Detection (FedLAD). Unlike existing approaches, such as clustering and robust training, which struggle in situations where malicious nodes dominate, FedLAD models the federated learning aggregation process as a linear problem, transforming it into a linear algebra optimisation challenge. This method identifies potential attacks by extracting the independent linear combinations from the original linear combinations, effectively filtering out redundant and malicious elements. Extensive experimental evaluations demonstrate the effectiveness of FedLAD compared to five well-established defence methods: Sherpa, CONTRA, Median, Trimmed Mean, and Krum. Using tasks from both image classification and natural language processing, our experiments confirm that FedLAD is robust and not dependent on specific application settings. The results indicate that FedLAD effectively protects federated learning systems across a broad spectrum of malicious node ratios. Compared to baseline defence methods, FedLAD maintains a low attack success rate for malicious nodes when their ratio ranges from 0.2 to 0.8. Additionally, it preserves high model accuracy when the malicious node ratio is between 0.2 and 0.5. These findings underscore FedLAD’s potential to enhance both the reliability and performance of federated learning systems in the face of data poisoning attacks. For further details, we have open-sourced our work at https://gitlab.com/qinqin65/fedlad. 1 Introduction Federated learning (FL), proposed by [ McMahan et al.(2017)McMahan, Moore, Ramage, Hampson, and y Arcas ] , is a machine learning (ML) network with a star topology in which computing nodes submit their locally trained ML models to a central server to obtain a global ML model using an average merging method (referred to as FedAVG). The global ML model is then sent back to the nodes to continue their ML tasks. This approach is designed to protect the data privacy of nodes since it allows ML models to be trained without data being sent to a central server. However, this architecture is vulnerable to various attacks in which malicious nodes can attack the global model. Especially in Sybil attacks, malicious nodes can collude with each other and can easily occupy the majority, rendering FL systems unreliable [ Levine et al.(2006)Levine, Shields, and Margolin , Xiao et al.(2023)Xiao, Tang, Li, Xiao, and Li ] . In Sybil attacks, various fundamental attacks can be performed. According to [ Awan et al.(2021)Awan, Luo, and Li ] , these attacks can be classified into model poisoning attacks, such as backdoor attacks [ Bagdasaryan and Shmatikov(2021) , Bagdasaryan et al.(2020)Bagdasaryan, Veit, Hua, Estrin, and Shmatikov ] , and data poisoning attacks, such as label flipping [ Tolpegin et al.(2020a)Tolpegin, Truex, Gursoy, and Liu ] . These attacks can be further classified into targeted attacks and untargeted attacks [ Tolpegin et al.(2020b)Tolpegin, Truex, Gursoy, and Liu , Sandeepa et al.(2024)Sandeepa, Siniarski, Wang, and Liyanage ] . In untargeted attacks, malicious nodes aim purely to lower the performance of the global ML model [ Tolpegin et al.(2020b)Tolpegin, Truex, Gursoy, and Liu ] . In targeted attacks, malicious nodes have specific goals for attacking the FL system [ Tolpegin et al.(2020b)Tolpegin, Truex, Gursoy, and Liu ] . Backdoor attacks [ Bagdasaryan and Shmatikov(2021) , Bagdasaryan et al.(2020)Bagdasaryan, Veit, Hua, Estrin, and Shmatikov ] , which insert triggers into the ML model [ Liu et al.(2022)Liu, Yang, and Mirzasoleiman ] to improve the performance of malicious labels, are a common example of such targeted attacks [ Tolpegin et al.(2020a)Tolpegin, Truex, Gursoy, and Liu , Liu et al.(2022)Liu, Yang, and Mirzasoleiman ] . As highlighted in [ Tolpegin et al.(2020a)Tolpegin, Truex, Gursoy, and Liu ] , targeted label flipping attacks are particularly effective against FL systems and can be executed even by adversaries with limited capabilities. Hence, our work focuses on defending against targeted data poisoning attacks. Existing defence methods that focus on data poisoning defence in FL can be classified into the categories of clustering-alike defence , such as Sherpa [ Sandeepa et al.(2024)Sandeepa, Siniarski, Wang, and Liyanage ] , which focuses on applying clustering techniques such as HDBSCAN to identify malicious clusters base on their ML models’ interpretability; and robust training-based defence , such as the median merging method (i.e., aggregation) [ Yin et al.(2018b)Yin, Chen, Kannan, and Bartlett , Xie et al.(2018)Xie, Koyejo, and Gupta ] , which replaces the average merging method with an attack-aware merging method. All the existing methods have the limitation of only tolerating a certain proportion of malicious nodes. For example, in clustering-alike defence methods, the maximum tolerance of malicious nodes is 50%. If the ratio of malicious nodes exceeds 50%, the major cluster is dominated by malicious nodes, making it unreliable as an indicator of whether the cluster is benign or malicious. This limitation makes federated learning vulnerable to Sybil attacks in which malicious nodes can collude with each other and occupy the majority [ Levine et al.(2006)Levine, Shields, and Margolin , Xiao et al.(2023)Xiao, Tang, Li, Xiao, and Li ] . Robust training-based defence methods consider the impact of malicious ML models during the training or aggregation process. However, when the majority of ML models are malicious, these methods can be overwhelmed. To address these limitations of existing methods, this paper proposes a Linear Algebra-based Defence (FedLAD) to defend against data poisoning attacks in FL. FedLAD models the aggregation process in FL as a linear combination. By finding the independent linear combination from the original linear combination, we can filter out redundant and malicious ML models, hence defend against malicious attacks such as data poisoning attacks. Since the malicious ratio has a low impact on the independent linear combination, FedLAD has a high tolerance for malicious nodes. Furthermore, to improve computational efficiency, we introduce a parallel optimisation algorithm based on sub-matrix splitting, which allows FedLAD to leverage parallel computing. This represents a significant advancement over existing defence approaches, whose reliance on sequential algorithms, such as clustering, limits their parallelizability. The primary contributions of this paper are as follows: • We propose a defence method against targeted data poisoning attacks in Federated Learning (FL), named FedLAD, which is based on linear algebra techniques. This method demonstrates a high tolerance for malicious nodes. For instance, our experiments show that FedLAD can remain effective even when 70% of the nodes are malicious in some datasets such as AG_NEWS. • To the best of our knowledge, we are the first to leverage parallelisation to accelerate the process of finding the independent linear combination from its original linear combination. Moreover, we provide a formal mathematical proof demonstrating that this linear algebra problem can be effectively solved with parallel computing. We conducted experiments with malicious ratios ranging from 0.2 to 0.8 using three datasets: CIFAR10, CIFAR100, and AG_NEWS. The results demonstrate that FedLAD is more robust to attacks compared to existing methods, including Sherpa [ Sandeepa et al.(2024)Sandeepa, Siniarski, Wang, and Liyanage ] , CONTRA [ Awan et

Read the complete text