Balancing Privacy–Quality–Efficiency in Federated Learning through Round-Based Interleaving of Protection Techniques

Yenan Wang, Carla Fabiana Chiasserini, Elad Michael Schiller · 2026

Read Balancing Privacy–Quality–Efficiency in Federated Learning through Round-Based Interleaving of Protection Techniques by Yenan Wang, Carla Fabiana Chiasserini, Elad Michael Schiller (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-05158.txt.

Introduction

Yenan Wang and team offer Alt-FL, a federated learning method that interleaves differential privacy, homomorphic encryption, and synthetic data round by round. Three methods, Privacy Interleaving, Synthetic Interleaving with DP, and Synthetic Interleaving with HE, let users trade learning quality against leanness while keeping privacy protection. Tests against gradient-rebuild attacks on two image data sets show Privacy Interleaving most balanced at high protection, with DP-based methods better at middle needs. The results offer a basis for choosing defenses under other privacy and resource constraints.

Catalog record

CREATORYenan Wang, Carla Fabiana Chiasserini, Elad Michael Schiller
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE72087
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2603.05158

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Balancing Privacy–Quality–Efficiency in Federated Learning through Round-Based Interleaving of Protection Techniques Yenan Wang, Carla Fabiana Chiasserini, Elad Michael Schiller Abstract In federated learning (FL), balancing privacy protection, learning quality, and efficiency remains a challenge. Privacy protection mechanisms, such as Differential Privacy (DP), degrade learning quality, or, as in the case of Homomorphic Encryption (HE), incur substantial system overhead. To address this, we propose Alt-FL, a privacy-preserving FL framework that combines DP, HE, and synthetic data via a novel round-based interleaving strategy. Alt-FL introduces three new methods, Privacy Interleaving (PI), Synthetic Interleaving with DP (SI/DP), and Synthetic Interleaving with HE (SI/HE), that enable flexible quality–efficiency trade-offs while providing privacy protection. We systematically evaluate Alt-FL against representative reconstruction attacks, including Deep Leakage from Gradients, Inverting Gradients, When the Curious Abandon Honesty, and Robbing the Fed, using a LeNet-5 model on CIFAR-10 and Fashion-MNIST. To enable fair comparison between DP- and HE-based defenses, we introduce a new attacker-centric framework that compares empirical attack success rates across the three proposed interleaving methods. Our results show that, for the studied attacker model and dataset, PI achieves the most balanced trade-offs at high privacy protection levels, while DP-based methods are preferable at intermediate privacy requirements. We also discuss how such results can be the basis for selecting privacy-preserving FL methods under varying privacy and resource constraints. I Introduction Federated Learning (FL) [ 24 , 38 ] enables collaborative model training by sharing only model updates with a central server. FL has thus been widely adopted in privacy-critical domains such as healthcare, banking, and smart cities. However, these applications must also operate under strict communication and computational constraints. Although raw data are not transmitted, repeated update transmissions can still introduce overhead and security vulnerabilities [ 43 , 12 , 5 , 11 ] . Zhu et al. [ 43 ] showed that shared gradients enable data reconstruction via the Deep Leakage from Gradients (DLG) attack, compromising client-level privacy. Geiping et al. [ 12 ] improved this attack with Inverting Gradients (Inverting), achieving higher-fidelity reconstructions. Under stronger attacker models, When the Curious Abandon Honesty (CAH) [ 5 ] and Robbing the Fed (RTF) [ 11 ] can even achieve near-perfect reconstruction. I-A Open Issues and Proposed Solution Fig. 1: Overview of the proposed Alt-FL schemes (left) vs. the baseline Mixed Protections (right). Privacy protection mechanisms involve inherent trade-offs between privacy, learning quality, and efficiency. Namely, Differential Privacy (DP) [ 1 ] degrades accuracy through noise injection, while Homomorphic Encryption (HE) [ 8 ] incurs high communication and computational overhead. Despite extensive research in FL systems, efficiently balancing all these trade-offs remains an open challenge. To tackle this challenge, we propose the Alternating FL (Alt-FL) framework, which interleaves DP, HE, and synthetic data to balance the privacy–quality–efficiency trade-off (see Figure 1 ). Specifically, we develop and use: \bullet Combined privacy protection mechanism. We leverage the combination of DP and Selective Homomorphic Encryption (S-HE) [ 16 ] , with the latter applying HE only to the most sensitive information to reduce overheads. \bullet Interleaved privacy protections. We propose a novel interleaving method that alternates between DP rounds and HE rounds , referred to as Privacy Interleaving (PI), as illustrated in Figure 1 . PI reduces DP-induced quality loss and S-HE overhead while maintaining privacy protection in each round. We control the proportion of DP and HE rounds using a tunable interleaving ratio \rho . \bullet Interleaved authentic and synthetic data. We also propose new interleaving methods that alternate between authentic and synthetic rounds. These methods, denoted as Synthetic Interleaving with DP (SI/DP) and Synthetic Interleaving with HE (SI/HE), apply DP or S-HE protection to protect authentic data during authentic rounds, while training on synthetic data without protection during synthetic rounds (see Figure 1 ). As in PI, the interleaving ratio \rho controls the proportion of synthetic to authentic rounds. \bullet Unified empirical analysis of privacy–quality–efficiency trade-offs. We empirically evaluate privacy, learning quality, and efficiency under the proposed methods (PI, SI/DP, and SI/HE). For privacy, we focus on protecting client-level data by measuring empirical attack success rates under state-of-the-art reconstruction attacks. We then compare the ability of the proposed methods to defend against privacy attacks with a baseline, named Mixed Protections (MP), which applies DP and HE in every training round. I-B Our Contribution \bullet We present a novel framework to empirically quantify privacy protection levels using attacker-centric metrics. By jointly comparing DP and S-HE using combinations of noise multipliers \sigma (used in DP) and encryption ratios \eta (used in S-HE), we define these privacy protection levels based on empirical attack success rates ( Section V ). \bullet We propose three tunable methods (PI, SI/DP, and SI/HE) based on a novel interleaving approach for combining DP, HE, and synthetic data to balance learning quality and efficiency while defending against the studied attacks ( Section IV ). \bullet We systematically evaluate these methods across varying privacy protection levels and data distribution settings ( Sections IV to X ). We show how to identify methods with favorable privacy–quality–efficiency trade-offs for the studied dataset and model by addressing the following research questions. RQ1 Privacy Preservation: To what extent do the combined techniques preserve privacy against data reconstruction attacks? For a given privacy protection level and data distributions, which techniques provide suitable defenses? RQ2 System costs vs. Learning Quality: What are the performance and system costs (e.g., convergence time, communication cost, and computational cost) associated with privacy preservation? For a given privacy defense level and data distribution, which techniques offer the best trade-offs between system costs and learning quality? RQ3 Privacy Preservation vs. System Costs: Under a required accuracy level, how do combinations of DP, S-HE, and synthetic data perform in terms of attack success rates and system costs? For a given accuracy constraint, privacy protection level, and data distribution, which techniques offer the best trade-offs between privacy preservation and system costs? \bullet Our empirical analysis provides guidance for selecting cost-effective privacy-preserving methods evaluated on the LeNet-5 model [ 20 ] with the CIFAR-10 [ 19 ] and Fashion-MNIST dataset [ 36 ] . Our results in Figure 11 answer RQ1–RQ3 and show that the optimal method depends on required privacy and cost constraints, specifically: – At the highest privacy protection levels, PI provides the most balanced privacy–quality-efficiency trade-off; – At intermediate privacy protection levels, DP-based approaches (SI/DP and DP-only) achieve more favorable trade-offs; – At the weakest privacy protection levels, HE-based approaches (MP, SI/HE, and HE-only) become necessary to ensure protection; To allow for the reproducibility of our results and foster further development, we pledge to release the implementation of our solution upon acceptance of the paper. II Related Work and Motivation The challenges of balancing privacy, learning quality, and efficiency have been formalized by Zhang et al. [ 41 ] , who proposed a theoretical framework that quantifies these trade-offs in FL. Under this framework, they proved that no mechanism can simultaneously optimize all three of these objectives. Hence, our study focuses on identifying methods achieving the most favorable trade-offs. Prior work studies how data quality affects convergence [ 17 , 15 ] . Other studies focus on synthetic data generation [ 23 ] , which can improve data diversity but incur additional

Read the complete text