PSI-PFL: Population Stability Index for Client Selection in non-IID Personalized Federated Learning

Daniel M. Jimenez-Gutierrez (✉), David Solans (✉), Mohammed Elbamby, Nicolas Kourtellis · 2025

Read PSI-PFL: Population Stability Index for Client Selection in non-IID Personalized Federated Learning by Daniel M. Jimenez-Gutierrez (✉), David Solans (✉), Mohammed Elbamby, Nicolas Kourtellis (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2506-00440.txt.

Introduction

Daniel Jimenez-Gutierrez and three co-authors propose PSI-PFL, a client selection method for personalized federated learning, in work from 2025. Federated learning trains models across clients without moving their data, but uneven data across clients skews updates and hurts results. Their method uses the Population Stability Index to measure how alike client data are.

Clients with more alike data are picked, which cuts the harm from label skew, a key damage source. Tests span tabular, image and text data, and the method beat leading baselines by clear margins under uneven settings. Local results also grew fairer across clients. Uses where privacy and mixed data meet are the target.

Catalog record

CREATORDaniel M. Jimenez-Gutierrez (✉), David Solans (✉), Mohammed Elbamby, Nicolas Kourtellis
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE32 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2506-00440

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

PSI-PFL: Population Stability Index for Client Selection in non-IID Personalized Federated Learning Daniel M. Jimenez-Gutierrez (✉), David Solans (✉), Mohammed Elbamby, Nicolas Kourtellis Abstract Federated Learning (FL) enables decentralized machine learning (ML) model training while preserving data privacy by keeping data localized across clients. However, non-independent and identically distributed (non-IID) data across clients poses a significant challenge, leading to skewed model updates and performance degradation. Addressing this, we propose PSI-PFL, a novel client selection framework for Personalized Federated Learning (PFL) that leverages the Population Stability Index (PSI) to quantify and mitigate data heterogeneity (so-called non-IIDness). Our approach selects more homogeneous clients based on PSI, reducing the impact of label skew, one of the most detrimental factors in FL performance. Experimental results over multiple data modalities (tabular, image, text) demonstrate that PSI-PFL significantly improves global model accuracy, outperforming state-of-the-art baselines by up to 10% under non-IID scenarios while ensuring fairer local performance. PSI-PFL enhances FL performance and offers practical benefits in applications where data privacy and heterogeneity are critical. The code for our solution will be released after receiving the paper’s acceptance. 1 Introduction Federated Learning (FL) [ 21 ] has emerged as a transformative paradigm in machine learning (ML), enabling decentralized training across multiple clients while preserving data privacy. Unlike centralized learning (CL), where all data is aggregated on a central server, FL operates on distributed datasets, often characterized by non-IID (non-independent and identically distributed) distributions. This so-called non-IIDness (also known as data heterogeneity, non-IID data), arising from client-specific behaviors and contexts, presents significant challenges, including skewed model updates and degraded global performance [ 9 ] . Personalized FL (PFL) extends FL by tailoring models to individual clients, allowing for better adaptation to heterogeneous data. Tan et al. [ 27 ] classify PFL approaches into regularization-based methods, which adjust local objectives to align with global goals, and selection-based strategies that prioritize specific clients for training. The solution proposed in this work falls into the selection-based category. This paper leverages the Population Stability Index (PSI), a metric widely used in credit scoring to measure distributional shifts [ 33 , 7 ] , as a novel tool for client selection in FL. The PSI quantifies the degree of heterogeneity among clients, enabling the identification of more homogeneous subsets for training. We demonstrate the application of the PSI to address label skew, as this form of skewness poses the most significant challenge to model performance in FL [ 9 ] . Extending the use of PSI to other types of data skewness is left as an avenue for future exploration. Motivation Non-IID data, where data distributions differ across examples or individuals, presents a fundamental challenge in many ML systems, including FL. FL relies on decentralized data across clients, often reflecting varying distributions due to diverse user behaviors, preferences, or contexts. This heterogeneity can lead to skewed model updates, slower convergence rates, and a consequential degraded global model performance. Diagnosing and addressing non-IID-ness is critical for ensuring that FL systems can achieve fairness, robustness, and accuracy across various applications. Additionally, heterogeneity diagnostics in FL remains an open challenge, as highlighted by Pei et al. [ 22 ] and Li et al. [ 18 ] , who outline key research objectives in this area. These include developing simple diagnostics to quickly assess the level of heterogeneity in federated networks a priori, exploring methods for conducting heterogeneity analysis and diagnosis while preserving privacy, establishing effective ways to quantify heterogeneity, and investigating whether current or novel definitions of heterogeneity can be leveraged to design federated optimization methods that enhance convergence empirically and theoretically. Contribution. The following points summarize the contributions of our paper: 1. We use the PSI as a metric to efficiently and accurately quantify the degree of non-IIDness in an FL system, highlighting its advantages and comparing it with existing non-IID metrics. 2. We propose PSI-PFL: Population Stability Index for Personalized Federated Learning , a novel approach to mitigate performance degradation in FL models as non-IIDness increases, leveraged on the PSI-based client selection. 3. Our PSI-PFL strategy improves FL global model accuracy by up to 10% compared to state-of-the-art baselines under non-IID scenarios. To the best of our knowledge, this is the first work to employ PSI in FL to quantify data heterogeneity and select clients to enhance global model performance. Paper structure. In the next section, we provide the background and related literature. Section 3 explains our proposed PSI-PFL approach in detail. In Section 4 , we present the experiments carried out and the results obtained. Finally, we conclude and provide some limitations and future work in Section 5 . 2 Background and Related Work Federated Learning Foundations. In Fig. 1 (left), we illustrate the usual training process of a model in a FL setting. It begins with model initialization, where a central server shares an initial global model with participating K clients. Each client performs local computation by training the model on its private dataset, generating updates (a.k.a. weights) that encapsulate learned patterns without exposing sensitive information. These updates are transmitted back to the server, often encrypted using privacy-preserving techniques such as Secure Multi-Party Computation (MPC) [ 3 ] or differential privacy (DP) [ 5 ] to enhance security. The server then performs model aggregation, combining the local updates (e.g., via Federated Averaging - FedAvg) to refine the global model, which is redistributed to clients for further iterations. This iterative process continues until the model converges. A significant challenge in FL arises from the presence of non-IID data across participating clients [ 9 ] . Unlike IID data, where local datasets share similar distributions, non-IID data introduces heterogeneity in the data distribution across clients, as illustrated in Fig. 1 (right). This heterogeneity can lead to divergence between the local model weights ( W_{t}^{i} ) and the global optimal weights ( W_{t}^{(Opt)} ) during training. While IID data allows local updates to align closely with the global objective, non-IID data causes local updates to deviate significantly, resulting in slower convergence and suboptimal global models. Additionally, as illustrated in the figure, ( W_{t}^{(Avg)} ) can fall into local optima, failing to capture the global optimum and consequently hindering the model’s performance. Figure 1 : (Left) FL usual training process with FedAvg. (Right) Weight divergence illustration for FL with non-IID data Measuring and tackling significant disparities in label distribution among clients participating in an FL model is a well-recognized challenge that impacts both the model’s performance and its convergence during training [ 17 , 12 ] . To quantify the degree of non-IIDness, various metrics have been proposed [ 9 ] . In the context of PFL, two prominent strategies for mitigating these challenges are regularization-based and selection-based approaches [ 27 ] . These topics are thoroughly analyzed in the sections that follow. Non-IIDness quantification in FL. The Hellinger distance (HD) is a widely utilized metric for assessing differences in client data distributions. For instance, Tan et al. [ 28 ] employed HD to measure the gap between clients’ local data distributions and an ideal balanced distribution, aiming to reduce model divergence. Similarly, Jimenez et al. [ 15 ] extensively analyzed HD’s performance compared to other metrics in FL scenarios, concluding that HD offers greater granularity

Read the complete text