Federated Testing (FedTest): A New Scheme to Enhance Convergence and Mitigate Adversarial Attacks in Federating Learning M. Ghaleb is with the Center for Intelligent Secure Systems, King Fahd University of Petroleum and Minerals (KFUPM), Dhahran 31261, Saudi Arabia. M. Obeed and H. Yanikomeroglu are
Mustafa Ghaleb, Mohanad Obeed, Muhamad Felemban, , Anas Chaaban, , Halim Yanikomeroglu · 2025
Read Federated Testing (FedTest): A New Scheme to Enhance Convergence and Mitigate Adversarial Attacks in Federating Learning M. Ghaleb is with the Center for Intelligent Secure Systems, King Fahd University of Petroleum and Minerals (KFUPM), Dhahran 31261, Saudi Arabia. M. Obeed and H. Yanikomeroglu are by Mustafa Ghaleb, Mohanad Obeed, Muhamad Felemban, , Anas Chaaban, , Halim Yanikomeroglu (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2501-11167.txt.
Introduction
Mustafa Ghaleb and co-authors propose FedTest, a testing scheme for federated learning that speeds convergence and blunts adversarial attacks, published in 2025. Federated learning trains models in parallel at many users' sites, preserving privacy and using distributed computing power. Standard strategies struggle to judge the quality of received models, handle uneven models, and limit the harm from bad ones.
Under FedTest, each user's local data trains that user's model and also tests the models of the others. Users can then score each model accurately. Those scores drive efficient aggregation and expose malicious models. Numerical results showed faster convergence and a reduced influence of malicious users, the authors report. They argue the scheme makes federated systems both more efficient and more robust overall.
Catalog record
| CREATOR | Mustafa Ghaleb, Mohanad Obeed, Muhamad Felemban, , Anas Chaaban, , Halim Yanikomeroglu |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 29 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2501-11167
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Federated Testing (FedTest): A New Scheme to Enhance Convergence and Mitigate Adversarial Attacks in Federating Learning M. Ghaleb is with the Center for Intelligent Secure Systems, King Fahd University of Petroleum and Minerals (KFUPM), Dhahran 31261, Saudi Arabia. M. Obeed and H. Yanikomeroglu are with the Systems and Computer Engineering Department, Carleton University, Ottawa, ON K1S 5B6, Canada. M. Felemban is with the Computer Engineering Department and Center for Intelligent Secure Systems, KFUPM, Dhahran 31261, Saudi Arabia. A. Chaaban is with the School of Engineering, University of British Columbia, Kelowna, BC V1V1V7, Canada. Mustafa Ghaleb, Mohanad Obeed, Muhamad Felemban, , Anas Chaaban, , Halim Yanikomeroglu Abstract Federated Learning (FL) has emerged as a significant paradigm for training machine learning models. This is due to its data-privacy-preserving property and its efficient exploitation of distributed computational resources. This is achieved by conducting the training process in parallel at distributed users. However, traditional FL strategies grapple with difficulties in evaluating the quality of received models, handling unbalanced models, and reducing the impact of detrimental models. To resolve these problems, we introduce a novel federated learning framework, which we call federated testing for federated learning (FedTest). In the FedTest method, the local data of a specific user is used to train the model of that user and test the models of the other users. This approach enables users to test each other’s models and determine an accurate score for each. This score can then be used to aggregate the models efficiently and identify any malicious ones. Our numerical results reveal that the proposed method not only accelerates convergence rates but also diminishes the potential influence of malicious users. This significantly enhances the overall efficiency and robustness of FL systems. I Introduction The growing interest in machine learning (ML) stems from the fact that it provides promising results in various fields, including healthcare, finance, and technology. The power of ML approaches comes from the unprecedented availability of data. In centralized ML, the datasets must be collocated in one device to train an ML model efficiently. The availability of datasets on one device guarantees fast convergence in the training stage and high-accuracy models in the testing stage. However, in many applications, datasets are distributed over users’ devices, which are often not willing to share. Even if users are willing to share their data with a centralized server, the massive amount of data introduces a challenge in transferring them to a server due to the scarcity of communication resources. Fortunately, the advances in storage and computation capabilities in users’ devices open an opportunity for training ML models on these devices in a distributed manner. This attracts researchers and engineers to investigate distributed ML methods to leverage distributed resources, preserve user privacy, and minimize communication cost. A common distributed ML method is called federated learning (FL). There are several approaches to aggregate local models on an FL server. The most common approach is federated averaging (FedAvg) [ 1 ] . In the Fedavg approach, the FL server aggregates the models by averaging them and weighting each model based on the number of its samples. Then it broadcasts the updated global model back to the devices involved for the next round of training. Figure 1 shows the FedAvg method where the models are aggregated based on the dataset sizes. Despite its groundbreaking contributions to decentralized machine learning, FedAvg alone does not completely address the intricate complexities of the federated learning landscape. As we explore this area, we encounter several additional hurdles that demand innovative solutions. Basic federated learning approaches face challenges related to fast convergence, robustness against unbalanced and non-IID data distribution, and resilience against malicious clients. In particular, the global model in traditional FL approaches may diverge in realistic situations, mainly when data are non-identically distributed across devices and/or significant variations in dataset sizes exist. In addition, in some cases, the quality of the data may vary with the users, which traditional FL approaches do not consider in their aggregation procedure. In particular, weighting models according to the number of samples is not efficient, since the value of each model must be based on how much it contributes to improving the model performance. For example, it is not accurate to weight a user’s model which was trained on thousands of samples from two classes higher than a model from another user that was trained on hundreds of samples from all classes [ 2 ] . In addition to the foundational principles and challenges discussed so far, it is also important to consider the inherent risk associated with FL adversarial attacks. These malicious attempts are engineered to impair the performance of the model. FL’s unique structure, leveraging a vast network of untrusted devices and private, non-inspectable datasets for its training process, is markedly different from traditional approaches. However, this characteristic potentially opens up novel attack surfaces during the training phase, which amplifies the risk factor. Adversarial attacks can take various forms, such as model evasion attacks, model update poisoning, and data poisoning. Typically, these attacks are classified according to the stage of their implementation: poisoning attacks occur during the training phase, while evasion attacks occur during the inference phase. As we continue to dig deeper into the domain of FL and confront its multifaceted challenges, it is crucial to keep a vigilant eye on these potential security threats and develop robust countermeasures. For example, one challenge in FedAvg is that it cannot distinguish harmful models from trusted ones. In many cases, some devices may have malicious tendencies and start to share harmful models aiming at slowing down the convergence rate or contaminating the global model. In such cases, FedAvg cannot handle these malicious behaviors and would fail to achieve the required accuracy rate. One way to address these challenges is to implement a fast-convergent federated learning approach that uses test data for model aggregation [ 2 ] . This method automatically adjusts the weights of the client models based on their accuracy in the server-hosted testing data, resulting in an accuracy-based process for updating the weights of the generalized server model. Notably, this approach exhibits robustness against unbalanced and non-IID data distribution compared to the FedAvg method. In addition, it demonstrates resilience against malicious clients. However, the accuracy performance of the received models is difficult to obtain because of the unavailability of testing data at the federated server that should span over all classes. Using such testing data for training rather than for testing would be more beneficial if such data is available. This paper proposes a new FL framework (FedTest) to solve the aforementioned issues and improve the convergence rate. FedTest leverages user-specific data for local model training and evaluation of other user models, thus fully utilizing the distributed nature of FL for both training and testing while ensuring data privacy. This novel technique accelerates convergence rates, mitigates the potential influence of malicious users, and improves the overall efficacy and robustness of FL systems. We demonstrate its potential to effectively counter FL’s challenges and contribute significantly to the evolution of this domain. The key contributions of this paper are as follows. 1. We propose a novel approach called FedTest , which addresses the challenges of assessing model quality,