Empirical Analysis of Privacy-Fairness-Accuracy Trade-offs in Federated Learning: A Step Towards Responsible AI

Dawood Wasif, Dian Chen, Sindhuja Madabushi, Nithin Alluru, Terrence J Moore, Jin-Hee Cho · 2025

Read Empirical Analysis of Privacy-Fairness-Accuracy Trade-offs in Federated Learning: A Step Towards Responsible AI by Dawood Wasif, Dian Chen, Sindhuja Madabushi, Nithin Alluru, Terrence J Moore, Jin-Hee Cho (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2503-16233.txt.

Introduction

Training one model across many owners' data without pooling the data protects privacy, but fairness and accuracy pull against that protection. Dawood Wasif and co-authors ran a large test of those trade-offs in this 2025 paper. The setup is federated learning, where each site trains locally and shares only updates. Three privacy tools were compared: added noise, encryption of the math, and secret-sharing between parties.

Fairness-aware training rules were layered on top, and tests ran on both tidy and skewed data splits. Data sets ranged from handwriting benchmarks to Alzheimer's scans and credit card fraud records. Encryption and secret-sharing beat noise on fairness under skewed data, though they cost more computing. Odd interactions between the tools also surfaced. The study gives builders a map for responsible design.

Catalog record

CREATORDawood Wasif, Dian Chen, Sindhuja Madabushi, Nithin Alluru, Terrence J Moore, Jin-Hee Cho
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE105 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2503-16233

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Empirical Analysis of Privacy-Fairness-Accuracy Trade-offs in Federated Learning: A Step Towards Responsible AI Dawood Wasif, Dian Chen, Sindhuja Madabushi, Nithin Alluru, Terrence J Moore, Jin-Hee Cho Abstract Federated Learning (FL) enables collaborative model training while preserving data privacy; however, balancing privacy preservation (PP) and fairness poses significant challenges. In this paper, we present the first unified large-scale empirical study of privacy–fairness–utility trade-offs in FL, advancing toward responsible AI deployment. Specifically, we systematically compare Differential Privacy (DP), Homomorphic Encryption (HE), and Secure Multi-Party Computation (SMC) with fairness-aware optimizers including q-FedAvg, q-MAML, Ditto, evaluating their performance under IID and non-IID scenarios using benchmark (MNIST, Fashion-MNIST) and real-world datasets (Alzheimer’s MRI, credit-card fraud detection). Our analysis reveals HE and SMC significantly outperform DP in achieving equitable outcomes under data skew, although at higher computational costs. Remarkably, we uncover unexpected interactions: DP mechanisms can negatively impact fairness, and fairness-aware optimizers can inadvertently reduce privacy effectiveness. We conclude with practical guidelines for designing robust FL systems that deliver equitable, privacy-preserving, and accurate outcomes. 1 Virginia Tech, Blacksburg, Virginia, United States 2 US Army Research Laboratory, Adelphi, Maryland, United States {dawoodwasif, dianc, msindhuja, nithin, jicho}@vt.edu, [email protected] Code — https://github.com/dawoodwasif/Privacy˙vs˙Fairness˙vs˙Accuracy Extended version — https://arxiv.org/abs/2503.16233 Introduction Federated Learning (FL) enables decentralized model training while preserving privacy, yet its deployment in realistic scenarios such as healthcare and finance raises challenges at the intersection of privacy, fairness, and real-world impact. Privacy-preserving techniques like Differential Privacy (DP), Homomorphic Encryption (HE), and Secure Multi-Party Computation (SMC) enhance security but introduce fairness concerns. DP’s noise protects data but degrades utility for underrepresented groups, exacerbating bias ( Bagdasaryan, Poursaeed, and Shmatikov 2019 ) . HE and SMC preserve data integrity and mitigate fairness disparities but impose additional computational costs, potentially limiting participation ( Truex et al. 2019 ; Xu et al. 2023 ) . Despite advancements, privacy-fairness trade-offs in FL remain underexplored, necessitating privacy-aware fairness mechanisms that align with responsible AI to ensure equitable and transparent model performance. A critical but often overlooked issue is client fairness , ensuring equitable model performance across clients with heterogeneous data and resources. Unlike algorithmic fairness, which addresses bias in decisions, client fairness examines FL’s impact on diverse clients. In dermatology, FL models trained on imbalanced client data favored overrepresented skin types, reducing accuracy for underrepresented groups ( Weng et al. 2020 ) , highlighting the need for bias mitigation in healthcare AI. To promote AI for social good, privacy-preserving mechanisms must integrate fairness by collaborating with stakeholders, including healthcare institutions and policymakers. Addressing computational and data heterogeneity while maintaining equitable performance is key to preventing societal inequalities. Our research explores privacy-fairness trade-offs in FL, developing frameworks that align with global fairness initiatives like the United Nations Sustainable Development Goals (SDGs) and the Leave No One Behind (LNOB) Principle ( Bentaleb and Abouchabaka 2024 ) . Prior work in federated learning often treats privacy and fairness separately, with privacy studies focusing on differential privacy and encryption under idealized IID settings while ignoring fairness metrics and realistic adversarial threats ( Truex et al. 2020 ; Wang et al. 2020 ; Zhang et al. 2022 ; Liu et al. 2022 ) . Conversely, fairness-aware approaches assess equity under controlled conditions but omit privacy-preserving mechanisms and attack analyses ( Li, Sanjabi, and Smith 2019 ; Mohri, Sivek, and Suresh 2019 ) . Most evaluations also rely on limited benchmarks or small-scale simulations, leaving open how DP, HE, and SMC interact with fairness optimizers in heterogeneous and practical domains. The goal of this work is to investigate the complex interactions between privacy preservation and fairness in federated learning across both benchmark and real-world scenarios in healthcare and finance. We assess the impact of Differential Privacy (DP), Homomorphic Encryption (HE), and Secure Multi-Party Computation (SMC) on client-level fairness metrics and evaluate whether fairness-aware optimization strategies introduce new privacy vulnerabilities. Our empirical study uses four representative datasets: MNIST and Fashion-MNIST for controlled benchmarks, Alzheimer’s Disease MRI scans for medical applications, and a large-scale credit card fraud detection dataset for financial analysis. By conducting experiments under both IID and non-IID client distributions, we aim to chart the multi-dimensional trade-offs that practitioners face when deploying FL in sensitive domains. By quantifying the trade-offs between privacy and fairness, we deliver actionable guidance for designing federated learning frameworks that uphold strong confidentiality guarantees while ensuring equitable outcomes across diverse clients. Our results offer domain-specific recommendations under regulations such as HIPAA and GDPR for medical use cases and the EU AI Act for financial services. We further propose a set of best practices and parameter guidelines that practitioners can adopt to balance differential privacy budgets, encryption parameters, and fairness weights. This work advances responsible AI by providing empirical evidence and practical strategies that mitigate fairness disparities introduced by privacy mechanisms, enabling trustworthy FL deployment in real-world settings. This work presents the following key contributions : • We present the first unified, large-scale empirical evaluation of DP, HE, and SMC under fairness-aware optimizers on both IID and non-IID client distributions across benchmark and real-world datasets. • We systematically quantify trade-offs between privacy-preserving techniques and client fairness under simulated attacks, offering detailed insights into their behavior in heterogeneous federated learning. • Our analysis shows that HE and SMC achieve a superior balance between privacy and fairness compared to DP, particularly in non-IID scenarios where DP noise disproportionately degrades utility for underrepresented clients, while HE incurs higher computational overhead. • We uncover counterintuitive interactions between privacy mechanisms and fairness optimizers, demonstrating that DP can erode fairness and that fairness-aware updates can weaken privacy defenses. • We propose a comprehensive validation framework integrating privacy-fairness schemes with adversarial threat models, offering practical guidelines for robust federated learning in healthcare and finance applications. Related Work Privacy-Preserving FL Various studies propose privacy-preserving (PP) techniques for FL, often combining DP and SMC to balance accuracy and privacy, as SMC risks inference attacks and DP reduces accuracy ( Truex et al. 2019 ) . Methods like Confined Gradient Descent and blockchain-based optimization reduce cryptographic overhead ( Zhang et al. 2024 ) . Cryptographic tools, Trusted Execution Environments (TEEs), and decentralized frameworks are critical, especially in healthcare FL. HE defends against reconstruction attacks ( Zhang et al. 2022 ) , while TEE-based FL secures clients and servers ( Yazdinejad, Dehghantanha, and Srivastava 2023 ) . Decentralized FL enhances robustness and communication efficiency ( Tian et al. 2023 ) . PP FL models support Alzheimer’s and COVID-19 detection by safeguarding sensitive data ( Li et al. 2022a ) . Despite advances, fairness impacts remain underexplored, and standardized privacy metrics are lacking. Theoretical frameworks dominate, with limited real-world benchmarking, restricting FL applicability. Fairness-Aware FL Existing studies address fairness in FL by ensuring balanced model performance across heterogeneous client data. Most focus on group fairness, aiming for equitable outcomes across demographic groups ( Mohri, Sivek, and Suresh 2019 ) , but overlook client fairness (see Supplementary Material, Section B), which considers variations in dataset sizes, distributions, and resources. Other approaches emphasize fairness in client contributions and performance using aggregation techniques and constrained optimization, particularly in healthcare ( Meerza et al. 2022 ) and finance ( Kamalaruban et al. 2024 ) . However, these primarily maintain fairness at the group level rather than

Read the complete text