pFedFair: Towards Optimal Group Fairness-Accuracy Trade-off in Heterogeneous Federated Learning
Haoyu LEI, Shizhan Gong, Qi Dou, Farzan Farnia · 2025
Read pFedFair: Towards Optimal Group Fairness-Accuracy Trade-off in Heterogeneous Federated Learning by Haoyu LEI, Shizhan Gong, Qi Dou, Farzan Farnia (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2503-14925.txt.
Introduction
Haoyu Lei and three co-authors tackle fairness in federated learning in a 2025 paper. Federated learning trains one model across many clients without pooling their data. Its decisions should also be fair across groups, such as by gender or race, but folding a single fairness rule into the shared model can cost accuracy when clients differ.
Their framework, pFedFair, lets each client enforce its own fairness limits during local training. The authors show this reaches the best possible balance between fairness and accuracy in mixed settings. Tests on standard and synthetic data, extended to image tasks through embedding models, confirm the gains over one-size-fits-all methods.
Catalog record
| CREATOR | Haoyu LEI, Shizhan Gong, Qi Dou, Farzan Farnia |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 51 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2503-14925
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
pFedFair: Towards Optimal Group Fairness-Accuracy Trade-off in Heterogeneous Federated Learning Haoyu LEI, Shizhan Gong, Qi Dou, Farzan Farnia Abstract Federated learning (FL) algorithms commonly aim to maximize clients’ accuracy by training a model on their collective data. However, in several FL applications, the model’s decisions should meet a group fairness constraint to be independent of sensitive attributes such as gender or race. While such group fairness constraints can be incorporated into the objective function of the FL optimization problem, in this work, we show that such an approach would lead to suboptimal classification accuracy in an FL setting with heterogeneous client distributions. To achieve an optimal accuracy-group fairness trade-off, we propose the Personalized Federated Learning for Client-Level Group Fairness (pFedFair) framework, where clients locally impose their fairness constraints over the distributed training process. Leveraging the image embedding models, we extend the application of pFedFair to computer vision settings, where we numerically show that pFedFair achieves an optimal group fairness-accuracy trade-off in heterogeneous FL settings. We present the results of several numerical experiments on benchmark and synthetic datasets, which highlight the suboptimality of non-personalized FL algorithms and the improvements made by the pFedFair method. 1 Introduction Figure 1 : Illustration of client-level fairness-aware personalization in heterogeneous federated learning. The fairness-aware global model aggregation often favors majority sensitive groups due to client heterogeneity. Our proposed pFedFair enables each client to learn a personalized fair classifier, optimizing the client-level fairness-accuracy trade-off while using global model knowledge. The increasing deployment of supervised learning models in high-stakes decision-making domains, such as hiring, lending, and criminal justice, necessitates a rigorous analysis of their potential for perpetuating and amplifying societal biases. Specifically, undesired correlations between model predictions and sensitive attributes (e.g., race) present a significant challenge, which has motivated substantial research in fairness-aware machine learning [ 1 , 2 ] . Within this area, group fairness , which aims to ensure statistical parity in predictions across protected groups defined by sensitive attributes, has received considerable attention [ 3 , 4 , 5 ] . While many methods have been proposed for achieving various notions of group fairness (e.g., demographic parity [ 6 ] , equal opportunity, and equalized odds [ 5 ] ) in centralized learning settings, their applicability and effectiveness in distributed settings, particularly federated learning (FL) [ 7 ] , remain relatively underexplored. Existing centralized fairness-aware algorithms often leverage regularization techniques, incorporating penalty terms into the objective function that explicitly discourage statistical dependence between model predictions and sensitive attributes. These penalties are typically based on measures of dependence, such as mutual information [ 8 ] , Pearson correlation [ 9 ] , or the Hirschfeld-Gebelein-Rényi (HGR) maximal correlation [ 10 , 11 ] . These methods have demonstrated empirical success in mitigating bias while maintaining acceptable predictive accuracy. However, the inherent characteristics of FL, notably client heterogeneity [ 12 , 13 ] , pose significant challenges to the direct application of these centralized techniques for boosting group fairness. In standard FL, multiple clients, each possessing a local dataset, collaboratively train a shared global model without explicitly exchanging their data. This collaborative paradigm offers the potential for improved performance by leveraging a larger yet distributed dataset. Nevertheless, heterogeneity in client data distributions, a common characteristic of real-world FL deployments, can induce substantial variations in model performance across clients [ 14 ] . Specifically, when heterogeneity affects the distribution of sensitive attributes, achieving client-level group fairness can become a challenging task. The presence of heterogeneous sensitive attribute distributions across clients leads to the following conflict: the notion of a globally optimal fair classifier would no longer apply as it is used in the centralized case. For example, consider a multi-branch corporation where applicant demographics vary significantly across branches; one branch may have a high proportion of male applicants, while another may have a higher fraction of female applicants. Under such a scenario, enforcing group fairness at the individual branch level can necessitate different client-level decision-making models, thereby undermining the assumption of a single globally shared model in standard FL algorithms. In this work, we introduce the Personalized Federated Learning for Client-Level Group Fairness (pFedFair) framework, specifically designed to address client-level group fairness constraints in heterogeneous FL environments, shown in Figure 1 . The pFedFair approach adopts a targeted personalization strategy, where the model personalization focuses on the fairness constraint , rather than the entire supervised learning setting. Our numerical and theoretical results indicate the potential suboptimality of globally-learned models (e.g., FedAvg [ 7 ] , FedProx [ 12 ] ) and fully-personalized models (e.g., pFedMe [ 15 ] , Per-FedAvg [ 16 ] ) in settings where the underlying Bayes optimal classifier (in the absence of fairness constraints) is shared across clients, but the distributions of sensitive attributes exhibit heterogeneity. This setting is of practical relevance, as data heterogeneity in FL deployments often impacts the marginal distribution of features, P(X) , while the conditional label distribution, P(Y|X) , remains consistent across clients [ 17 ] . Our empirical results supports the theoretical discussion on federated learning under client-level group fairness constraints, indicating an improved performance and better generalization capability of pFedFair in comparison to both baseline and fully personalized FL algorithms when P(Y|X) is shared and sensitive attribute distributions within P(X) are heterogeneous. The enhanced generalization is a consequence of the targeted application of personalization, focusing solely on the fairness component. Furthermore, we leverage image embedding models to apply the proposed group fairness regularization to standard computer vision datasets. To do this, we employ the widely-used CLIP [ 18 ] and DINOv2 [ 19 ] models. Our numerical experiments suggest that both in the centralized and federated learning settings, a simple linear model trained over the embedding can achieve an improved group fairness-accuracy trade-off compared to the direct application of the group-fairness regularization to standard ResNet [ 20 ] , ViT [ 21 ] , and CNN image classifiers. Furthermore, the application of image embedding enables efficient group-fairness-constrained federated training via the pFedFair method. Our numerical analysis over the real CelebA [ 22 ] , UTKFace [ 23 ] , and synthetic image datasets with text-to-image models support applying pFedFair to image-classification problems with group-fairness constraints. The main contributions of this work are summarized as follows: • Analyzing the heterogeneous FL setting with client-level group fairness constraints • Proposing the pFedFair to address personalized federated learning under heterogeneous feature distribution • Proposing the application of image embeddings to improve the performance of group-fairness learning methods in FL on computer vision datasets • Presenting numerical results supporting the application of personalized FL to the sensitive attribute variable under group fairness constraints. 2 Related Works Fairness in Centralized Machine Learning. studies on group fairness aims to minimize the dependence of algorithmic decisions on biased demographic groups. A common strategy involves adding fairness regularization terms to the learning objective, addressing fairness notions like Demographic Parity (DP) and Equalized Odds (EO), as studied in [ 3 , 5 ] . In centralized settings, various methods have been proposed to ensure group fairness, including fairness-aware optimization [ 24 , 9 , 25 ] , reweighting [ 26 , 27 , 28 ] , and adversarial approaches [ 29 , 11 , 30