A Post-Processing-Based Fair Federated Learning Framework
Yi Zhou, Naman Goel · 2025
Read A Post-Processing-Based Fair Federated Learning Framework by Yi Zhou, Naman Goel (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2501-15318.txt.
Introduction
Yi Zhou and Naman Goel propose a fairer way to train models across many separate owners without pooling their data, in a 2025 paper. In federated learning, each party trains locally and shares only model updates. That split makes fairness across groups hard to enforce from the center.
Their framework keeps training standard, then lets each party adjust the finished model on its own data to meet its own fairness goals. Two known adjustment methods are shown to fit this second stage. Tests on four data sets, covering tables, signals, and images, beat three baseline approaches on fairness with little or no loss of accuracy. The gains were largest where parties' data differed most, a common real-world case.
Catalog record
| CREATOR | Yi Zhou, Naman Goel |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 70 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2501-15318
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
A Post-Processing-Based Fair Federated Learning Framework Yi Zhou, Naman Goel Abstract . Federated Learning (FL) allows collaborative model training among distributed parties without pooling local datasets at a central server. However, the distributed nature of FL poses challenges in training fair federated learning models. The existing techniques are often limited in offering fairness flexibility to clients and performance. We formally define and empirically analyze a simple and intuitive post-processing-based framework to improve group fairness in FL systems. This framework can be divided into two stages: a standard FL training stage followed by a completely decentralized local debiasing stage. In the first stage, a global model is trained without fairness constraints using a standard federated learning algorithm (e.g. FedAvg). In the second stage, each client applies fairness post-processing on the global model using their respective local dataset. This allows for customized fairness improvements based on clients’ desired and context-guided fairness requirements. We demonstrate two well-established post-processing techniques in this framework: model output post-processing and final layer fine-tuning. We evaluate the framework against three common baselines on four different datasets, including tabular, signal, and image data, each with varying levels of data heterogeneity across clients. Our work shows that this framework not only simplifies fairness implementation in FL but also provides significant fairness improvements with minimal accuracy loss or even accuracy gain, across data modalities and machine learning methods, being especially effective in more heterogeneous settings. CCS: Computing methodologies Distributed computing methodologies CCS: Computing methodologies Machine learning CCS: Computing methodologies Distributed artificial intelligence CCS: Security and privacy CCS: Human-centered computing 1. Introduction In Federated learning (FL), multiple parties (clients) collaboratively train a model without sharing their local data ( McMahan et al., 2017 ) . In addition to offering a way to use distributed data and compute for machine learning, federated learning is also investigated as a potential privacy-enhancing technology ( Zhao et al., 2024 ) . As a result, FL has attracted much attention ( Zhang et al., 2021 ) , with proposed applications in domains including healthcare, mobile devices and industrial engineering ( Li et al., 2020a ) . Fair machine learning refer to a set of techniques to make machine learning models produce more fair outputs ( Barocas et al., 2023 ) . For example, in some application contexts, the output of a binary classifier, that has been trained with historical data using machine learning, may need to satisfy certain fairness properties like conditional independence from attributes like gender and race ( Hardt et al., 2016 ; Zafar et al., 2017 ) . The literature in fair machine learning focuses mostly on centralized training setting, i.e. when all data used for training the model is located centrally. There has been recent work on understanding the challenges of fairness in federated learning setting as well. Federated learning inspired techniques train a global model with fairness constraints when data is distributed across multiple locations ( Zhang et al., 2020 ; Du et al., 2020 ; Abay et al., 2020 ; Zeng et al., 2022 ) . Although these methods can be effective in improving fairness in FL, they also have a few limitations. Firstly, these methods often lack fairness decentralization. Clients are required to agree on (a) the same fairness definition and the same fairness measurement, and (b) the same fairness requirements including the choice of sensitive attributes and protected groups, the level of fairness-accuracy trade-off, etc. The requirement is problematic for several reasons. One is that clients may have different needs depending on their specific use cases. Another reason is that clients could have very different data distributions due to data heterogeneity in FL. A single fairness constraint may not be suitable or work effectively on all clients, which may produce unpredictable model behavior on certain clients. Secondly, many of these approaches require clients to use their statistics of sensitive attributes during distributed communication, which may raise additional privacy-related concerns. Thirdly, imposing additional fairness-related constraints during global model training may also increase the network communication costs and slow down the training process, reducing the overall training efficiency. To address these limitations, we explore a very simple post-processing-based fair FL framework. In this framework, all clients first collaborate to perform global FL training without any fairness constraints. Once the global training is finished, each client performs local fairness or debiasing post-processing on its own dataset, tailoring the debiasing process towards its specific data distribution and requirements. This method has a high flexibility and decentralization as it allows clients to apply different fairness constraints based on their specific needs, providing customized debiasing strategies. It also addresses data heterogeneity since the debiasing is performed locally, it adapts fairness to the local data distribution. Moreover, no information about sensitive attributes is required during the global training stage, thus offering better sensitive data protection. This also improves training efficiency as there is no additional network communication cost for debiasing. We demonstrate how post-processing debiasing methods from prior work can be integrated in this framework. In our experiments, we use two post-processing methods, but other methods can also be similarly integrated. One is model output post-processing ( Hardt et al., 2016 ) . This method addresses fairness by solving a linear program and computing a derived predictor. It does not need to change the original model weights and instead post-processes the model output. The other one is the final layer fine-tuning technique. This method fine-tunes the last layer of neural network based models, with fairness constraints added to optimization objective. But it may be computationally more expensive and modifies model weights. While the term ‘post-processing’ in fairness literature typically refers to model output post-processing methods, we use the term more broadly to include any kind of fairness post-processing, applied either to model output or model itself. For evaluation, we conducted experiments to compare performance with three baseline methods: FedAvg ( McMahan et al., 2017 ) , FairFed ( Ezzeldin et al., 2023 ) and FairFed combined with Fair Linear Representation (FairFed/FR) ( Ezzeldin et al., 2023 ) . We included four different datasets in our experiments. Two of them are commonly used tabular datasets in the fair ML literature, namely the Adult dataset ( Barry Becker, 1996 ) and the ProPublica COMPAS dataset ( Mattu et al., 2016 ) . The other two are from healthcare domain: a signal dataset, called PTB-XL Electrocardiogram (ECG) dataset ( Wagner et al., 2022 ) , and an image dataset, called NIH Chest X-Ray dataset ( Wang et al., 2017 ) . To simulate the different levels of data heterogeneity across clients, we use three heterogeneity settings for each dataset in the experiments to simulate the situations when the data partition is extremely imbalanced, medium-level imbalanced and slightly imbalanced. Our experiments show that this framework consistently improves fairness across diverse data distributions. Moreover, both post-processing methods achieved these improvements with minimal computational costs, which makes the framework an efficient solution for real-world applications. A significant strength of this framework is also its simplicity and reliance on tried and tested algorithmic components from the literature. Finally, we also discuss the limitations of our work and opportunities for future work. 2. Related Work In this section, we discuss prior work that are