A Client-level Assessment of Collaborative Backdoor Poisoning in Non-IID Federated Learning
*Phung Lai, *Guanxiong Liu, NhatHai Phan, Issa Khalil, Abdallah Khreishah, Xintao Wu · 2025
Read A Client-level Assessment of Collaborative Backdoor Poisoning in Non-IID Federated Learning by *Phung Lai, *Guanxiong Liu, NhatHai Phan, Issa Khalil, Abdallah Khreishah, Xintao Wu (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2504-12875.txt.
Introduction
The authors show how a small group of compromised clients can quietly poison a federated learning system. In federated learning, many clients train one shared model on their private data, and the setup looks robust when client data is alike. Trouble starts when client data differs widely, as it does in the real world. The team's attack, CollaPois, hands a Trojan-infected model to a few compromised clients, which then craft updates that pull the shared model toward the infected one.
Because honest clients with scattered data push in many directions, the coordinated pull wins out, and the Trojan's effect grows. The attack needs only a few bad clients, keeps normal accuracy intact, and slips past strong defenses, above all when client data varies most. Clients whose data resembles the attackers' data suffer the worst effects.
Catalog record
| CREATOR | *Phung Lai, *Guanxiong Liu, NhatHai Phan, Issa Khalil, Abdallah Khreishah, Xintao Wu |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 69 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2504-12875
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
A Client-level Assessment of Collaborative Backdoor Poisoning in Non-IID Federated Learning *Phung Lai, *Guanxiong Liu, NhatHai Phan, Issa Khalil, Abdallah Khreishah, Xintao Wu Abstract Federated learning (FL) enables collaborative model training using decentralized private data from multiple clients. While FL has shown robustness against poisoning attacks with basic defenses, our research reveals new vulnerabilities stemming from non-independent and identically distributed (non-IID) data among clients. These vulnerabilities pose a substantial risk of model poisoning in real-world FL scenarios. To demonstrate such vulnerabilities, we develop a novel collaborative backdoor poisoning attack called CollaPois . In this attack, we distribute a single pre-trained model infected with a Trojan to a group of compromised clients. These clients then work together to produce malicious gradients, causing the FL model to consistently converge towards a low-loss region centered around the Trojan-infected model. Consequently, the impact of the Trojan is amplified, especially when the benign clients have diverse local data distributions and scattered local gradients. CollaPois stands out by achieving its goals while involving only a limited number of compromised clients, setting it apart from existing attacks. Also, CollaPois effectively avoids noticeable shifts or degradation in the FL model’s performance on legitimate data samples, allowing it to operate stealthily and evade detection by advanced robust FL algorithms. Thorough theoretical analysis and experiments conducted on various benchmark datasets demonstrate the superiority of CollaPois compared to state-of-the-art backdoor attacks. Notably, CollaPois bypasses existing backdoor defenses, especially in scenarios where clients possess diverse data distributions. Moreover, the results show that CollaPois remains effective even when involving a small number of compromised clients. Notably, clients whose local data is closely aligned with compromised clients experience higher risks of backdoor infections. § § footnotetext: * Equal contribution I Introduction Recent and emerging data privacy regulations [ 1 ] challenge machine learning (ML) applications that collect sensitive user data on centralized servers. Federated learning (FL) [ 2 ] addresses this by enabling collaborative model training without sharing raw data. However, FL often faces performance disparities due to diverse data distributions across clients [ 3 ] . To address this challenge, personalization in FL has gained considerable attention. Personalization allows each client’s model to adjust to its own unique data distribution, and various methods have been proposed to achieve this [ 4 , 5 ] . In contrast to conventional FL methods, personalized FL methods are more suitable for individual clients, especially in situations where there are significant variations in data distributions across clients. In real-world scenarios, clients often employ FL at different geographical locations or serve different user cohorts [ 6 , 7 ] . This often results in significant variations in data distribution, making personalized FL a promising choice. FL has been extensively studied to identify potential adversarial and Trojan vulnerabilities [ 8 , 9 , 10 , 11 ] , given its significance and widespread usage. Despite this, recent research (drawing on various sources) [ 12 ] surprisingly shows that FL remains relatively resilient to previously reported poisoning attacks, even when utilizing low-cost robust training algorithms. However, commonly employed aggregate metrics in previous research, such as the average accuracy across all clients, do not sufficiently reflect the individualized impact of proposed attacks or defenses on each client. This is concerning because a high average accuracy may mask unacceptably low accuracy levels for certain clients, particularly if there is substantial variation in their individual accuracy, which may lead to an underestimation of FL vulnerabilities. Ensuring a well-balanced client-level accuracy is of utmost importance as clients actively participate in FL with the expectation of achieving good performance. Consequently, an attack that substantially impacts the performance of a small subset of clients can pose a significant threat to the entire FL system. The high diversity in data distribution among clients, which is a key feature of FL, becomes even more pronounced when coupled with personalization techniques. As a result, it becomes imperative to thoroughly assess the effects of attacks and defenses on individual clients. Concretely, we seek to answer the question: How many clients are impacted, which ones, and to what extent in terms of attack success rates, and what are the underlying reasons for these impacts? Key Contributions. To close these gaps, we introduce a novel Trojan attack called CollaPois , with the goal of systematically elucidating the connection between the risk of backdoor poisoning and the degree of diversity present in the local data distributions of clients in the context of FL. In contrast to existing backdoor attacks, CollaPois leverages the diverse local data distributions of benign clients and the resulting scattered gradients to steer the federated training model towards a pre-trained Trojaned model X . As a result, backdoors can be transferred to benign clients’ local models through the Trojan-infected federated training model. To achieve this, we adopt a coordinated approach involving a group of compromised clients. With this approach, we generate well-aligned malicious gradients, in stark contrast to the scattered gradients contributed by the benign clients. This compels the federated training model to converge within a tightly confined region surrounding the Trojaned model X , effectively poisoning the federated training model. Our extensive theoretical and empirical analysis show that CollaPois can significantly lower and bound the number of compromised clients required to successfully carry out backdoor poisoning as a function of the attack stealthiness and the degree of diversity in benign clients’ local data distribution. We refer to stealthiness as the ability to prevent the server from approximating the Trojaned model X and identifying compromised clients. In fact, the greater the diversity in benign clients’ local data, the fewer compromised clients are required and the more stealthy the successful poisoning becomes, and vice-versa. This establishes a new theoretical connection among these three key components in FL. The novelty of CollaPois also stems from its Simplicity , as it involves only minor adjustments to classical poisoning techniques in FL [ 13 , 14 ] . These modifications do not necessitate any additional knowledge in the federated training process. Moreover, its Efficiency makes it cost-effective for compromised clients to compute malicious local gradients during a training round. Consequently, CollaPois becomes a practical method to expose backdoor risks in FL. Through comprehensive assessments with client-level metrics, we show that CollaPois outperforms existing attacks and adeptly evades various robust federated training and defense algorithms, with and without personalization. Even with only a modest 0.5% of compromised clients, CollaPois can effectively create a backdoor for 15% of benign clients with an impressive success rate exceeding 70% under robust federated training on benchmark datasets. II Background and Related Work II-A Federated Learning and Personalization Federated Learning (FL). FL is a multi-round protocol between a server and N devices. At each round t , the server sends the global model \theta^{t} to a random subset M^{t} , which trains local models \theta^{t}_{u} on data D_{u} and returns them. The server aggregates these updates using a function \mathcal{G} to produce \theta^{t+1}=\mathcal{G}({\theta_{u}^{t+1}}_{u\in M^{t}}) . FedAvg is a commonly used aggregation method [ 15 ] . Non-IID Data in FL. One of the fundamental challenges that could impair performance and may introduce vulnerabilities in FL models is the non-independent and identically distributed (non-IID) clients’ local data [ 16 , 15