Improving Efficiency in Federated Learning with Optimized Homomorphic Encryption
Feiran Yang · 2025
Read Improving Efficiency in Federated Learning with Optimized Homomorphic Encryption by Feiran Yang (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2504-03002.txt.
Introduction
Feiran Yang speeds up private joint learning in this 2025 paper. In federated learning, many devices train one shared model without handing over their private data. Each device trains locally and sends only updates to a central server. Homomorphic encryption, which lets servers compute on locked data, protects those updates, but it is slow and heavy, above all for large models.
Yang's algorithm encrypts only selected parameters, guided by sensitivity maps showing which values need the most protection, and adds differential privacy noise. He proves the method correct and robust, codes it in C++, and simulates federated training on large models. The result runs three times faster than the best known method while keeping privacy strong.
Catalog record
| CREATOR | Feiran Yang |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 45 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2504-03002
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Improving Efficiency in Federated Learning with Optimized Homomorphic Encryption Feiran Yang Abstract . Federated learning is a method used in machine learning to allow multiple devices to work together on a model without sharing their private data. Each participant keeps their private data on their system and trains a local model and only sends updates to a central server, which combines these updates to improve the overall model. A key enabler of privacy in FL is homomorphic encryption (HE). HE allows computations to be performed directly on encrypted data. While HE offers strong privacy guarantees, it is computationally intensive, leading to significant latency and scalability issues—particularly for large-scale models like BERT. In my research, I aimed to address this inefficiency problem. My research introduces a novel algorithm to address these inefficiencies while maintaining robust privacy guarantees. I integrated several mathematical techniques such as selective parameter encryption, sensitivity maps, and differential privacy noise within my algorithms, which has already improved its efficiency. I have also conducted rigorous mathematical proofs to validate the correctness and robustness of the approach. I implemented this algorithm by coding it in C++, simulating the environment of federated learning on large-scale models, and verified that the efficiency of my algorithm is 3 3 times the efficiency of the state-of-the-art method. This research has significant implications for machine learning because its ability to improve efficiency while balancing privacy makes it a practical solution! It would enable federated learning to be used very efficiently and deployed in various resource-constrained environments, as this research provides a novel solution to one of the key challenges in federated learning: the inefficiency of homomorphic encryption, as my new algorithm is able to enhance the scalability and resource efficiency of FL while maintaining robust privacy guarantees. Keywords : Ethereum. Blockchain. Zero-Knowledge Proofs. Privacy-Preserving. Transparent zk-SNARKs. 1. Introduction Federated learning (FL) became increasingly popular in distributed systems and privacy-preserving machine learning, due to its ability to enable collaborative model training across decentralized datasets without directly sharing sensitive information. In FL, clients train models locally and share encrypted updates with a central server for aggregation, thus preserving data privacy. Unlike traditional centralized machine learning, which requires collecting data in one location, FL keeps data decentralized and ensures that they stay in original locations. However, privacy vulnerabilities persist, as malicious servers may exploit aggregated updates to reconstruct sensitive data or infer private information, since the shared model is updated accordingly with the private data. To address these threats, homomorphic encryption (HE) has been established, allowing computations on encrypted data without decryption. Despite its capability to ensure data privacy, HE faces significant challenges due to its high computational and communication overheads, which limit its scalability and feasibility in federated learning systems. In particular, HE-based FL faces challenges like high latency, increased energy consumption, and resource demands, especially in large-scale models or with limited computational capacity. Traditional HE solutions fail to adequately optimize for the decentralization of FL, making the process inefficient for large foundation models like ResNet and BERT. Existing methods such as selective parameter encryption and adaptive HE strategies still struggle with balancing privacy preservation and computational efficiency. This paper introduces a new algorithm to improve the efficiency of homomorphic encryption in federated learning systems. 2. Related Works Federated Learning (FL) has revolutionized the way organizations collaborate on model training without exposing private data. A seminal contribution was the Federated Averaging (FedAvg) algorithm by McMahan et al. [ 1 ] , which demonstrated how deep networks could be trained efficiently on decentralized data across mobile devices. As the technology matured, researchers became increasingly concerned with privacy and security vulnerabilities, sparking the development of a rich body of defense strategies. One prominent privacy concern is the leakage of training data through shared gradients. Wei et al. [ 2 ] underscored this vulnerability by illustrating how adversaries could exploit gradients to reconstruct sensitive information. To combat such attacks, defenses like Soteria [ 3 ] introduced random perturbations to data representations. Meanwhile, Fed-CDP [ wei2021gradient ] harnessed client-level differential privacy to further protect gradients without significantly compromising model performance. Numerous privacy-preserving approaches have combined cryptographic and statistical methods to secure FL. Truex et al. [ 4 ] introduced a hybrid framework that blends Secure Multiparty Computation (SMC) and Differential Privacy (DP) for balanced security and scalability. Xu and Ma [ 5 ] explored functional encryption in their HybridAlpha solution, aiming to secure FL workflows end to end. Concurrently, Liu et al. [ 7 ] emphasized the importance of Privacy-Preserving Aggregation (PPAgg) protocols to safeguard model updates. Several comprehensive surveys categorize and analyze these techniques. Yin et al. [ 6 ] offer a broad taxonomy of privacy-preserving methods, while Lyu et al. [ 11 ] delve deeper into attacks such as model poisoning and inference attacks. Jiang et al. [ 9 ] extended these discussions into the realm of Vertical Federated Learning (VFL), identifying unique risks at the prediction stage. Additionally, Zhang et al. [ 12 ] explored integrating blockchain and Trusted Execution Environments (TEEs) to bolster FL security. In industrial and healthcare environments, FL faces both resource and data sensitivity constraints. Luo et al. [ 8 ] developed frameworks tailored to industrial AI systems, addressing communication bottlenecks and privacy requirements. Wei et al. [ 10 ] showed how differential privacy mechanisms could be optimized in constrained environments. More recently, Hu et al. [ 13 ] surveyed the latest FL security developments, including methods to deal with data heterogeneity, adversarial robustness, and communication overhead. Emerging defense strategies focus on mitigating gradient leakage while maintaining model performance. NbAFL [ 17 ] introduced adaptive noise injection, striking a balance between accuracy and privacy. Similarly, Sun et al. [ 16 ] proposed more targeted perturbations to data representations, reinforcing resistance to gradient-based attacks. Zhang et al. [ 15 ] advanced the field further by investigating homomorphic encryption (HE) and blockchain-based solutions for secure aggregation. Despite considerable progress, homomorphic encryption remains a challenging bottleneck in large-scale FL deployments. Fully homomorphic schemes often require expensive polynomial operations, frequent relinearization or bootstrapping, and considerable memory for storing encrypted parameters. Although selective encryption methods can reduce overhead, they risk compromising privacy by leaving portions of the data unprotected [ 15 ] . Conversely, fully encrypted solutions sometimes become infeasible in real-time or large-scale scenarios due to the sheer computational load. Addressing these constraints calls for more efficient HE protocols and hybrid solutions that combine cryptography, differential privacy, and robust architectural designs. As FL increasingly supports critical domains such as healthcare [ 9 ] and industrial automation [ 8 ] , research must continue refining homomorphic encryption techniques to ensure both strong privacy guarantees and practical runtime performance. 3. Preliminaries 3.1. Federated Learning Definition 3.1 . ( Federated Learning ) Federated learning is a privacy-preserving framework where multiple clients each hold their own private dataset but collectively wish to train a shared model. The FL process proceeds in rounds: (1) Global Model Initialization: The server initializes a global model M^{(0)} . (2) Local Training: Each participating client C_{i} downloads the global model M^{(t)} (from the previous round t ) and trains it locally with its private data for a fixed number of epochs or until a convergence criterion is