FedCF: Fair Federated Conformal Prediction
Anutam Srinivasan, Aditya Vadlamani, Amin Meghrazi , Srinivasan Parthasarathy · 2025
Read FedCF: Fair Federated Conformal Prediction by Anutam Srinivasan, Aditya Vadlamani, Amin Meghrazi , Srinivasan Parthasarathy (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2509-22907.txt.
Introduction
Anutam Srinivasan and 3 co-authors bring fair uncertainty bounds to learning spread across many sites. Conformal prediction gives sets that should contain the true label with a set chance. Plain versions ignore group traits, so some groups may get weaker coverage. A prior method added fairness for a single site, and this work extends it to federated learning.
In the federated setup, data stays at each site while one model is trained. Their framework, FedCF, also audits the model by group. It checks fairness gaps for distinct demographic groups. Tests on several data sets across domains support the framework. The work leans fully on the exchangeability assumption behind conformal methods.
Catalog record
| CREATOR | Anutam Srinivasan, Aditya Vadlamani, Amin Meghrazi , Srinivasan Parthasarathy |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 83 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2509-22907
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
FedCF: Fair Federated Conformal Prediction Anutam Srinivasan, Aditya Vadlamani, Amin Meghrazi , Srinivasan Parthasarathy Abstract Conformal Prediction (CP) is a widely used technique for quantifying uncertainty in machine learning models. In its standard form, CP offers probabilistic guarantees on the coverage of the true label, but it is agnostic to sensitive attributes in the dataset. Several recent works have sought to incorporate fairness into CP by ensuring conditional coverage guarantees across different subgroups. One such method is Conformal Fairness (CF). In this work, we extend the CF framework to the Federated Learning setting and discuss how we can audit a federated model for fairness by analyzing the fairness-related gaps for different demographic groups. We empirically validate our framework by conducting experiments on several datasets spanning multiple domains, fully leveraging the exchangeability assumption. † † ∗ Equal Contribution, † \dagger This work was done while the author was a student at The Ohio State University. \MHInternalSyntaxOn \MHInternalSyntaxOff 1 Introduction Ensuring model fairness is a critical thrust of trustworthy machine learning (ML). ML models, when not calibrated for fairness, are prone to developing biases at each stage of an ML pipeline, as reflected by their predictions Mehrabi et al. 2021 . We define bias as disparate performance (i.e., accuracy for classification) between different sub-populations. In the data collection phase, measurement bias may occur due to disproportionate data collection on sub-populations, while representation bias manifests from a lack of training data on specific strata. During training, these biases are inductively learned by the model–leading to incorrect predictions in safety-critical tasks. These models are also susceptible to algorithmic bias, resulting from regularization and optimization techniques during model training, which incorrectly generalize for marginalized groups. To mitigate these risks, many ML models must adhere to regulations placed by local governing bodies ( Hirsch et al. 2023 ) . Towards model compliance, Komala et al. 2024 ; Agrawal et al. 2024 ; Jones et al. 2025 have proposed approaches to enhance model fairness in varying tasks, including federated graph learning and representation learning. Developing robust ML frameworks with mathematically rigorous guarantees is also essential for building actionable, trustworthy ML models for safety-critical tasks. In this frontier, researchers have increasingly explored Conformal Prediction (CP)–an uncertainty quantification (UQ) technique that only assumes statistical exchangeability–to develop trustworthy ML models ( Vovk et al. 2005 ) . Unlike traditional point-wise prediction in ML, CP guarantees that the correct outcome will be in a prediction set with a user-specified property. Practitioners have adopted CP due to its model-free assumption and post-hoc application ( Cherian & Bronner 2020 ) . Additionally, users can apply CP to structured data (such as graphs), which cannot be used with traditional IID-based methods ( Maneriker et al. 2025 ) . However, vanilla CP is not calibrated for fairness and can be inherently unfair Cresswell et al. 2025 . Several approaches have been proposed at the intersection of fairness and CP–each catering to different tasks and notions of fairness. Romano et al. 2020a developed a CP approach for the regression setting to ensure equalized coverage across protected groups. Lu et al. 2022 considers equalized coverage in a classification task for medical imaging. Zhou & Sesia 2024 extends Romano et al. 2020a and provides an algorithm adaptive to sensitive groups to increase the predictive power of the CP sets when several sensitive attributes are present, and focuses on the classification task. Lastly, Vadlamani et al. 2025 provides a framework to ensure fair coverage of positive outcomes, without requiring protected attributes at inference time, unlike prior work. Orthogonally, CP has been used to enhance the fairness of other tasks. To mitigate bias in LLM-based recommender systems, Fayyazi et al. 2025 explores iteratively using fairness-aware CP. While there are several approaches to integrating fairness into CP, these methods are not considered when the training data is decentralized (i.e., available only to clients) and the ML model is stored on a centralized server. Extending these CP methods to the federated learning (FL) setting is essential because tasks that benefit from fair uncertainty quantification (such as those in healthcare and finance) also often have privacy considerations, making it infeasible to keep data on a centralized server. Thus, we extend the work of Vadlamani et al. 2025 using recent literature in Federated CP ( Lu et al. 2023 ) . Key Contributions : We extend the Conformal Fairness (CF) framework ( Vadlamani et al. 2025 ) to the FL setting while maintaining the theoretical fairness guarantees provided by CF. We first discuss how to bound conditional coverage according to a user-specified fairness notion when data is decentralized. To facilitate this, we provide a sufficient set of terms that a client can compute using local data, how the server should aggregate these terms to bound the conditional coverage, and theoretically prove the validity of our approach. Next, we consider the client-server communication overhead and its tradeoff with preserving data privacy. Specifically, we propose two term-aggregation approaches, with one having less communication overhead and the other being more privacy-preserving of client data. We also revise the original CF algorithm to reduce the number of communication rounds required to construct a fair conformal predictor. Lastly, we evaluate FedCF on several datasets, including tabular, graph, and image datasets, and for multiple popular fairness metrics, and observe that FedCF can control for a particular coverage gap level while maintaining the original CP coverage guarantee. 2 Background 2.1 Conformal Prediction Conformal Prediction (CP) ( Vovk et al. 2005 ) is a widely used framework for quantifying predictive uncertainty in ML. CP provides rigorous statistical guarantees without imposing assumptions on the model, requiring only that the data are exchangeable –a broader condition than IID and compatible with non-IID or structured settings (e.g., graphs). We focus on split (inductive) CP in the classification setting. Let \bm{x}_{i}\in{\mathcal{X}}={\mathbb{R}}^{d} and y_{i}\in{\mathcal{Y}}=\{0,\dots,C-1\} denote features and labels. Given a calibration dataset, \mathcal{D}_{\mathrm{calib}}=\{(\bm{x}_{i},y_{i})\}_{i=1}^{n} , our goal is to construct a set-valued predictor {\mathcal{C}} such that, for an exchangeable test point (\bm{x}_{\text{test}},y_{\text{test}}) , \textstyle 1-\alpha\leq\Pr[y_{\text{test}}\in{\mathcal{C}}({\bm{x}}_{\text{test}})]\leq 1-\alpha+\frac{1}{\lvert\mathcal{D}_{\mathrm{calib}}\rvert}, (1) where 1-\alpha\in(0,1) is the target coverage level . We refer to Equation 1 as the coverage guarantee . Concretely, given a non-conformity score s:{\mathcal{X}}\times{\mathcal{Y}}\to{\mathbb{R}} , define the conformal quantile as \textstyle\hat{q}(\alpha)=\text{Quantile}(\frac{\lceil(n+1)(1-\alpha)\rceil}{n};\{s(\bm{x}_{i},y_{i})\}_{i=1}^{n}). The resulting prediction set {\mathcal{C}}_{\hat{q}(\alpha)}(\bm{x}_{\text{test}})=\{y\in{\mathcal{Y}}:s(\bm{x}_{\text{test}},y)\leq\hat{q}(\alpha)\,\} satisfies the guarantee in 1 . Evaluating CP : Two standard metrics are used: (1) Coverage , the estimated test-time probability, \Pr[y_{\text{test}}\in{\mathcal{C}}_{\hat{q}(\alpha)}(\bm{x}_{\text{test}})] ; and (2) Efficiency , the average prediction set size, \lvert{\mathcal{C}}_{\hat{q}(\alpha)}(\bm{x}_{\text{test}})\rvert . These are typically in tension as achieving a higher desired coverage often necessitates larger sets. 2.2 Federated Learning A key contributor to developing strong deep learning models is providing a large amount of quality training data ( Kaplan et al. 2020 ) . However, in certain domains, such as healthcare and finance, collecting large amounts of data may be prohibitive due to privacy concerns. Federated learning (FL) is a framework for collaborative learning that keeps training data decentralized and private. Given K clients that will participate in training, each client has its own training data that it wants to keep private. The goal is to optimize a global loss function, L , that is the weighted average of local risk functions, \ell_{k} . Formally, FL finds weights \theta^{*} s.t. \theta^{*}=\text{argmin}_{\theta}\{L(\theta)=\sum_{k=1}^{K}w_{k}\cdot\mathbb{E}_{(x^{(k)},y^{(k)})\sim P_{k}}[\ell_{k}(\theta;x^{(k)},y^{(k)})]\},