BACSA: A Bias-Aware Client Selection Algorithm for Privacy-Preserving Federated Learning in Wireless Healthcare Networks

Sushilkumar Yadav, Irem Bor-Yaliniz · 2024

Read BACSA: A Bias-Aware Client Selection Algorithm for Privacy-Preserving Federated Learning in Wireless Healthcare Networks by Sushilkumar Yadav, Irem Bor-Yaliniz (2024) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2411-01050.txt.

Description

Abstract Federated Learning (FL) has emerged as a transformative approach in healthcare, enabling collaborative model training across decentralized data sources while preserving user privacy. However, performance of FL rapidly degrades in practical scenarios due to the inherent bias in non Independent and Identically distributed (non-IID) data among participating clients, which poses significant challenges to model accuracy and generalization.

Catalog record

CREATORSushilkumar Yadav, Irem Bor-Yaliniz
YEAR2024
COLLECTIONPAPERS
FORMATTXT
FILE SIZE26 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2411-01050

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

BACSA: A Bias-Aware Client Selection Algorithm for Privacy-Preserving Federated Learning in Wireless Healthcare Networks Sushilkumar Yadav, Irem Bor-Yaliniz Abstract Federated Learning (FL) has emerged as a transformative approach in healthcare, enabling collaborative model training across decentralized data sources while preserving user privacy. However, performance of FL rapidly degrades in practical scenarios due to the inherent bias in non Independent and Identically distributed (non-IID) data among participating clients, which poses significant challenges to model accuracy and generalization. Therefore, we propose the Bias-Aware Client Selection Algorithm (BACSA), which detects user bias and strategically selects clients based on their bias profiles. In addition, the proposed algorithm considers privacy preservation, fairness and constraints of wireless network environments, making it suitable for sensitive healthcare applications where Quality of Service (QoS), privacy and security are paramount. Our approach begins with a novel method for detecting user bias by analyzing model parameters and correlating them with the distribution of class-specific data samples. We then formulate a mixed-integer non-linear client selection problem leveraging the detected bias, alongside wireless network constraints, to optimize FL performance. We demonstrate that BACSA improves convergence and accuracy, compared to existing benchmarks, through evaluations on various data distributions, including Dirichlet and class-constrained scenarios. Additionally, we explore the trade-offs between accuracy, fairness, and network constraints, indicating the adaptability and robustness of BACSA to address diverse healthcare applications. I Introduction Recent advancements on user equipment, sensors, processors and AI methods are transforming healthcare by generating and processing large volumes of granular data [ 1 ] . However, burdens of preserving the privacy of data and transferring local data to a centralized server to be processed creates many challenges. On the one hand, privacy-preserving distributed AI methods, such as Federated Learning (FL), hit two birds with one stone by allowing the participants to share the trained models instead of raw data, which are compact in size and protects data privacy [ 2 ] . On the other hand, FL provides comparable results to that of centralized machine learning methods solely under ideal conditions [ 3 , 4 , 5 ] , and that is rarely the situation in practical applications. The participating devices would have non-homogeneous data distributions [ 6 , 4 ] , different computation capabilities [ 7 ] , unstable communication channels and additional constraints due to their unique limitations, such as battery level. Among many practical considerations, the focus of this study is data heterogeneity, i.e., non-IID data distributions among clients. Non-IID data may be formed due to a variety of factors, including data size imbalance, for example when a hospital is data-rich whereas some clinics have scarce data, and/or data partitioning imbalance, where clients do not have complete data sets in terms of labels and/or features as illustrated in Fig. 1 via clients with different health concerns [ 1 , 8 ] . There are recent attempts to develop metrics and a through understanding of heterogeneity from the perspective of FL [ 9 ] , however, none of the metrics in the literature are widely adopted by the community yet. Fig. 1 : Illustration of FL in a wireless IoT for healthcare scenario: Clients have different health conditions causing severely non-IID data. A subset of clients need to be selected for each communication round due to system and device limitations: Clients 5 and 6 are omitted in this round. Two benchmark studies in FL with non-IID distributions rely on random client selection [ 10 , 11 ] . On the contrary, recent studies in [ 12 , 13 , 14 , 15 ] employ various client selection (or model combination) strategies to mitigate adverse effects of non-IID data. However, these studies depend on the existence of auxiliary IID data, e.g., by collecting a subset of data from clients. The studies in [ 16 , 17 ] require users to share data characteristics, e.g., distribution of classes and number of samples, to select a statistically favorable client set. Both data collection in the former studies and exposure data characteristics in the latter ones are privacy violations. Instead, studies in [ 18 ] and [ 7 ] investigate model characteristics for client selection. For example, [ 18 ] reduces communication cost and increases accuracy by clustering IoT users based on cosine difference among local models while considering strict networking constraints. However, the proposed architecture necessitates existence of devices that can serve as cluster heads and create new vulnerabilities against adversarial attacks. On the contrary to the limitations of previous studies, the proposed method can estimate the class distribution without additional data or architectural constraints by only investigating model parameters to reveal bias of clients with inspiration from the recent explainable-AI (XAI) studies. We then formulate the client selection problem as a mixed-integer non-linear optimization and use the bias estimations to obtain the most class balanced group while considering fairness among clients. We show that the proposed bias-aware client selection algorithm (BACSA) provides robustness and efficiency against non-IID data without exploiting or exposing clients, and therefore a suitable method to be used in healthcare applications. The rest of the paper is organized as follows. Background information and notations are introduced in Sec. II , followed by the presentation of the proposed method in Sec. III . Then we show the effectiveness of BACSA via experiments in Sec. IV , and conclude the paper with final discussions and future work in Sec. V . II Preliminaries The following is the terminalogy used regarding data sets [ 17 ] : • Local dataset means the local dataset owned by the clients. In this study, it is assumed that the local datasets are heterogenous both in terms of number of sample sizes and the distribution of the sample size over the classes. Therefore, the local data sets are both size imbalanced and class imbalanced. Class imbalance includes one or more data-rich classes, one or more classes with data scarcity and one or more absent classes for each client. • The aggregation of the local dataset from all the clients forms the global dataset . Global dataset is assumed to be class balanced, which means that all classes exist in the global set. • Grouped dataset is the dataset formed after selecting the clients. The goal is to make the grouped data set as balanced as possible in terms of both class and size. We assume there are K clients of an FL scheme, and there is one central server to operate FL. Let E(W) be the error function associated with the global objective function, F(W) where W indicates the model. The central server has an initial model W_{0} , which must be distributed to each client, k , for them to train the model on their local data set \mathbb{D}_{k} . Once the trained initial model by a client k , {W_{0}^{k}} , is receieved, bias towards each class \beta_{i}k , can be estimated as the proportion of number of samples from each class as shown in Sec. III-B . Assume a neural network with one input layer with I+1 input nodes, one output layer with M+1 nodes, and S hidden layers with L+1 nodes. Also let r , s , and u denote input layer, hidden layers, and

Read the complete text