FL-PLAS: Federated Learning with Partial Layer Aggregation for Backdoor Defense Against High-Ratio Malicious Clients

Jianyi Zhang, Ziyin Zhou, Yilong Li, Qichao Jin, Xiali Hei · 2025

Read FL-PLAS: Federated Learning with Partial Layer Aggregation for Backdoor Defense Against High-Ratio Malicious Clients by Jianyi Zhang, Ziyin Zhou, Yilong Li, Qichao Jin, Xiali Hei (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2505-12019.txt.

Introduction

Jianyi Zhang, Ziyin Zhou, Yilong Li, and Qichao Jin propose FL-PLAS, a federated learning defense against backdoor attacks, in a two thousand twenty-five paper. Federated averaging is vulnerable when malicious clients poison their updates, and attacks keep getting stealthier.

Most defenses fail once half or more of the clients are malicious, or they need an auxiliary server dataset. FL-PLAS instead splits each local model into a feature extractor and a classifier. Clients upload only extractor parameters for aggregation and keep their classifiers private, so poisoned labels cannot spread. Tests on three image datasets kept main-task accuracy high even with ninety percent malicious clients.

Catalog record

CREATORJianyi Zhang, Ziyin Zhou, Yilong Li, Qichao Jin, Xiali Hei
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE53 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2505-12019

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

FL-PLAS: Federated Learning with Partial Layer Aggregation for Backdoor Defense Against High-Ratio Malicious Clients Jianyi Zhang, Ziyin Zhou, Yilong Li, Qichao Jin, Xiali Hei Abstract Federated learning (FL) is gaining increasing attention as an emerging collaborative machine learning approach, particularly in the context of large-scale computing and data systems. However, the fundamental algorithm of FL, Federated Averaging (FedAvg), is susceptible to backdoor attacks. Although researchers have proposed numerous defense algorithms, two significant challenges remain. The attack is becoming more stealthy and harder to detect, and current defense methods are unable to handle 50% or more malicious users or assume an auxiliary server dataset. To address these challenges, we propose a novel defense algorithm, FL-PLAS, F ederated L earning based on P artial L ayer A ggregation S trategy. In particular, we divide the local model into a feature extractor and a classifier. In each iteration, the clients only upload the parameters of a feature extractor after local training. The server then aggregates these local parameters and returns the results to the clients. Each client retains its own classifier layer, ensuring that the backdoor labels do not impact other clients. We assess the effectiveness of FL-PLAS against state-of-the-art (SOTA) backdoor attacks on three image datasets and compare our approach to six defense strategies. The results of the experiment demonstrate that our methods can effectively protect local models from backdoor attacks. Without requiring any auxiliary dataset for the server, our method achieves a high main-task accuracy with a lower backdoor accuracy even under the condition of 90% malicious users with the attacks of trigger, semantic and edge-case. K eywords Federated learning \cdot Backdoor resistant \cdot Data poisoning \cdot Partial layer aggregation 1 Introduction Federated learning (FL) is a machine learning technique that has garnered significant attention due to its ability to protect data privacy in large-scale distributed systems. FL enables collaborative model training without the need to share sensitive data between multiple parties or a central server, making it particularly suitable for cloud and edge computing environments. In these systems, where data is distributed across multiple entities, ensuring privacy and security is critical. The technique allows data to remain secure on each participant’s device or server, avoiding the risks associated with centralized data storage [ 1 , 2 ] . Users train the model locally on their own data, upload updates to a central server, which then aggregates the models into a global model. This iterative process continues until the global model reaches a satisfactory level of accuracy. Privacy concerns have spurred the adoption of federated learning for collaborative training of shared deep learning models [ 2 ] . However, this approach is vulnerable to backdoor attacks [ 3 , 4 ] . These manipulated models function normally on clean data but maliciously misclassify backdoor samples [ 5 ] . In this paper, we focus on trigger [ 6 ] , semantic (like label-flipping) [ 7 , 8 , 9 ] , and edge-case attack [ 10 ] as they are challenging problems in FL. Other attacks like directly modifies local weights and optimize the trigger pattern [ 11 ] , or poisoning backdoor-critical layers [ 12 ] also achieved notable effects under specific conditions [ 13 ] . Existing defenses strategy are divided into two main types. One type aims to restrict model updates within controlled bounds through regularization or processing anomalous data. RSA [ 14 ] and NDC [ 15 ] are examples of such defenses, which can weaken the impact of malicious updates on the model. However, this approach involves trade-offs, necessitating model normalization and noise introduction, which can affect accuracy, attack resilience, and main-task accuracy after being maliciously attacked. The other type relies on the classification of malicious models [ 16 ] to detect and exclude the malicious local update, such as FLTrust [ 17 ] , FLAME [ 18 ] , and Krum [ 19 ] . However, the effectiveness of these methods is based on the assumption that the majority of users are honest, which means that they may not work well when there is a large percentage (e.g., over 50%) of malicious users. Additionally, collecting some user data as an auxiliary dataset for the server, such as in the case of FLTrust, conflicts to some extent with the privacy protection of federated learning. In this paper, we propose FL-PLAS ( F ederated L earning based on P artial L ayer A ggregation S trategy), a backdoor defense algorithm. Our approach involves preserving the local classifier in the client, preventing contamination of benign users’ local models by global backdoor neurons. This is achieved by dividing the local model into two parts: the feature extractor and the classifier. During each iteration, clients upload only the feature extractor’s parameters after local training. The server then aggregates these parameters and shares the results with clients. Each client keeps its own classifier layer to prevent malicious users’ backdoor data from affecting benign users’ models. We experimentally evaluate the effectiveness of our FL-PLAS framework against trigger attacks [ 6 ] , semantic attacks [ 7 ] , and edge-case attacks [ 10 ] . Our results demonstrate that FL-PLAS can successfully defend against all of these attacks without compromising the privacy of user data. Compared to the five defense methods (RSA, NDC, FLTrust, FLAME, and Krum), we find that most existing methods fail to effectively defend against backdoor attacks when the proportion of malicious users exceeds 50%, except FLTrust and FL-PLAS. However, FLTrust requires the collection of user data, which conflicts with the privacy-preserving nature of federated learning.Specifically, our contributions are: • We conducted an in-depth analysis of the role different neural network layers play in defending against backdoor attacks. Using both simple and complex datasets, classification models, and extensive experiments with seven defense models and three attack models, we laid the foundation for understanding how specific layers contribute to backdoor defense. • We implemented a backdoor defense scheme using the partial layer aggregation strategy, specifically targeting scenarios with a high proportion of malicious clients. Our approach effectively addresses the limitations of current methods, particularly in environments with a significant number of malicious clients and scenarios where the server cannot retain user data. • Through rigorous experiments, we demonstrated that our method maintains superior performance even when the proportion of malicious clients exceeds 90%. This highlights the robustness and efficacy of our approach in highly adversarial federated learning environments. 2 Background 2.1 Federated Learning (FL) Federated learning is a type of distributed learning. As Figure 1 shows, FL consists of N users and one server. The user is responsible for training the model and passing the trained model to the server. And the server can aggregate the user’s model to generate a global model. We roughly divide FL into three steps in one iteration (illustrated in Figure 1 ): • Step 1 : The server sends the global model to the client, which gets the global model and starts training. • Step 2 : The client uploads the trained local model to the model aggregator, which is then aggregated by the server. • Step 3 : After the server-side aggregation is completed, the server sends the aggregated global model to the

Read the complete text