Efficient Client Selection in Federated Learning

William Marfo, Deepak K. Tosh, Shirley V. Moore · 2025

Read Efficient Client Selection in Federated Learning by William Marfo, Deepak K. Tosh, Shirley V. Moore (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2502-00036.txt.

Introduction

William Marfo and co-authors make federated learning choosier about which devices it learns from, without giving up privacy or robustness. Their 2025 paper proposes a client selection framework for training on decentralized data, where phones or sensors keep raw data local. Two additions distinguish it: differential privacy noise guards the updates, and fault tolerance keeps training alive when clients drop or misbehave.

The number of selected clients adapts to performance and system limits rather than staying fixed. Tested on two network anomaly detection datasets, the method raised accuracy by about seven percent over baselines. It also cut training time by roughly a quarter. Fault tolerance cost little in accuracy. The combination matters because real federated deployments face all three pressures at once: privacy rules, flaky devices, and deadlines. Selection, the authors argue, is where those pressures can be managed together.

Catalog record

CREATORWilliam Marfo, Deepak K. Tosh, Shirley V. Moore
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE7 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2502-00036

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Efficient Client Selection in Federated Learning
William Marfo, Deepak K. Tosh, Shirley V. Moore

Abstract
Federated Learning (FL) enables decentralized machine learning while preserving data privacy. This paper proposes a novel client selection framework that integrates differential privacy and fault tolerance. The adaptive client selection adjusts the number of clients based on performance and system constraints, with noise added to protect privacy. Evaluated on the UNSW-NB15 and ROAD datasets for network anomaly detection, the method improves accuracy by 7% and reduces training time by 25% compared to baselines. Fault tolerance enhances robustness with minimal performance trade-offs.



1
1

1

This material is based upon work supported by the United States Department of Energy’s (DOE) Office of Fossil Energy (FE) Award DE-FE0031744.

I
Introduction

Federated Learning (FL) enables distributed machine learning without centralizing data, addressing critical privacy concerns
[
1
]
. However, efficient client selection and robust privacy preservation mechanisms remain key challenges in FL
[
2
]
. Poor client selection can degrade model performance, while insufficient privacy safeguards may expose sensitive information. Moreover, heterogeneity in client data and system resources can lead to bottlenecks, slowing down training. In this paper, we propose an efficient client selection method that integrates differential privacy (DP) and fault tolerance mechanisms to enhance model performance and system resilience. The adaptive selection process adjusts the number of clients dynamically based on performance and system constraints, with added noise ensuring data privacy
[
2
]
. To evaluate our framework, we apply it to the UNSW-NB15 and ROAD datasets for network anomaly detection
[
3
,
4
]
, demonstrating significant improvements in accuracy and training efficiency compared to baselines.

II
Proposed Client Selection Method

We propose a client selection method for FL that balances accuracy, privacy, and fault tolerance. The method selects a subset of clients based on their potential contribution to the global model while incorporating differential privacy (DP) and fault tolerance mechanisms. Our approach has two main components: (1) an adaptive client selection algorithm and (2) the integration of DP and checkpointing.

In each round, available clients
A_{t}
are evaluated based on utility scores, which are computed using factors such as data quality and computational capacity. The top
K
clients are selected to train local models. Differential privacy is ensured by adding Gaussian noise to the model updates, controlled by the privacy budget
\epsilon
, to prevent the server from inferring individual client data during aggregation. To enhance fault tolerance, a checkpointing mechanism, with intervals determined by
t_{c}^{*}
, allows clients to save and recover from failures during training. Algorithm
1
presents the proposed method, outlining the client selection, privacy protection, and fault tolerance procedures.

Algorithm 1

Client selection with differential privacy and fault tolerance

1:

Set of all clients
C
, number of clients to select
K
, privacy budget
\epsilon
, checkpointing interval
t_{c}^{*}

2:

Selected subset of clients
S_{t}
for each round
t

3:

Initialize utility scores for all clients

4:

for
each round
t

do

5:

Get available clients
A_{t}

6:

Compute utility scores for each client in
A_{t}

7:

Select top
K
clients based on utility scores

8:

for
each selected client
do

9:

Train local model, apply gradient clipping

10:

Add Gaussian noise to gradients for DP

11:

Send noisy gradients to the server

12:

if
checkpoint interval reached
then
Save checkpoint

13:

end

if

14:

if
client failure detected
then
Recover from checkpoint

15:

end

if

16:

end

for

17:

Aggregate updates and update global model

18:

end

for

III
Performance Evaluation

III-A

Experimental Setup

We used two widely recognized network security datasets: the UNSW-NB15
[
3
]
and ROAD
[
4
]
. The experiments were conducted on a system with a 12th Gen Intel Core i9-12900HK, NVIDIA RTX 3080 Ti GPU, and 32GB of RAM, using
Python 3.8
,
TensorFlow 2.6.0
, and
PyTorch 0.5.0
. For baseline comparisons, we used:
-
ACFL

[
5
]
: an active learning-based client selection method.
-
FedL2P

[
6
]
: a meta-learning approach for personalized fine-tuning.

Evaluation metrics include accuracy and AUC-ROC, which are standard for anomaly detection tasks.

III-B

Results and Analysis

III-B
1
Performance Comparison with Baselines

We evaluated the performance of our method against two baseline approaches, ACFL and FedL2P. As depicted in Fig.
1
, our proposed method demonstrates a 7% improvement in accuracy and a 25% reduction in training time compared to the baselines. These gains are particularly pronounced in the ROAD dataset, where our method effectively handles complex anomaly patterns, showcasing its robustness in diverse network conditions.

Fig. 1:
Performance comparison of the proposed method, ACFL, and FedL2P in terms of accuracy, AUC-ROC, and training time.

III-B
2
Impact of Differential Privacy

We analyzed the effect of different privacy budgets (
\epsilon
) on model performance. Fig.
2
shows that increasing the privacy budget leads to improved accuracy and reduced loss across both datasets. For instance, in the UNSW-NB15 dataset, accuracy increased from 86% at
\epsilon=10
to 89% at
\epsilon=100
, while similar trends were observed in the ROAD dataset, where accuracy improved from 73% to 82%. These results demonstrate the balance between maintaining privacy and ensuring model performance.

Fig. 2:
Impact of privacy budgets on accuracy and loss for UNSW-NB15 and ROAD datasets.

III-B
3
Effect of Fault Tolerance

We evaluated the impact of introducing fault tolerance mechanisms through checkpointing. Table
I
shows that while accuracy and AUC-ROC experienced a slight decline (approximately 2-3%), the overall system robustness improved by effectively handling client dropouts. Training time increased by around 5-10%, but this is an acceptable trade-off given the enhanced system reliability.

TABLE I:
Impact of fault tolerance on model performance (UNSW-NB15 and ROAD).

Configuration

Accuracy (%)

AUC-ROC

Training Time (s)

UNSW-NB15

Without Fault Tolerance

94.8

0.93

570

With Fault Tolerance

92.1

0.91

600

ROAD

Without Fault Tolerance

90.3

0.88

680

With Fault Tolerance

88.7

0.86

710

IV
Conclusion

Read the complete text