FEDLAD: Federated Evaluation of Deep Leakage Attacks and Defenses
Isaac Baglin, Xiatian Zhu, Simon Hadfield · 2024
Read FEDLAD: Federated Evaluation of Deep Leakage Attacks and Defenses by Isaac Baglin, Xiatian Zhu, Simon Hadfield (2024) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2411-03019.txt.
Description
Abstract Federated Learning is a privacy preserving decentralized machine learning paradigm designed to collaboratively train models across multiple clients by exchanging gradients to the server and keeping private data local. Nevertheless, recent research has revealed that the security of Federated Learning is compromised, as private ground truth data can be recovered through a gradient inversion technique known as Deep Leakage.
Catalog record
| CREATOR | Isaac Baglin, Xiatian Zhu, Simon Hadfield |
|---|---|
| YEAR | 2024 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 37 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2411-03019
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
FEDLAD: Federated Evaluation of Deep Leakage Attacks and Defenses Isaac Baglin, Xiatian Zhu, Simon Hadfield Abstract Federated Learning is a privacy preserving decentralized machine learning paradigm designed to collaboratively train models across multiple clients by exchanging gradients to the server and keeping private data local. Nevertheless, recent research has revealed that the security of Federated Learning is compromised, as private ground truth data can be recovered through a gradient inversion technique known as Deep Leakage. While these attacks are crafted with a focus on applications in Federated Learning, they generally are not evaluated in realistic scenarios. This paper introduces the FEDLAD Framework (Federated Evaluation of Deep Leakage Attacks and Defenses), a comprehensive benchmark for evaluating Deep Leakage attacks and defenses within a realistic Federated context. By implementing a unified benchmark that encompasses multiple state-of-the-art Deep Leakage techniques and various defense strategies, our framework facilitates the evaluation and comparison of the efficacy of these methods across different datasets and training states. This work highlights a crucial trade-off between privacy and model accuracy in Federated Learning and aims to advance the understanding of security challenges in decentralized machine learning systems, stimulate future research, and enhance reproducibility in evaluating Deep Leakage attacks and defenses. 1 Introduction Marked by the proliferation of IoT devices, concerns regarding privacy, and information leakage have spurred the enactment of data protection legislation worldwide, highlighted by the GDPR in the European Union, and the Data Protection Act in the UK [ 7 , 1 ] . Traditional centralized machine learning techniques face challenges in safeguarding privacy during data collection and sharing, prompting the rise of Federated Learning (FL) as a privacy-preserving distributed learning paradigm [ 19 ] . FL enables collaborative model training among participants without the exchange of local private data, a pivotal shift away from centralized methods. It operates by distributing the current model to each client, where local data is utilized for training. Gradient or model updates are subsequently shared with a central server for aggregation, as exemplified in algorithms like FedSGD and FedAvg respectively. This distributed approach not only addresses privacy concerns but also enhances scalability and security by minimizing data transmission, storage, and management overhead. FL finds application across diverse domains, from healthcare to autonomous vehicles, enabling the development of robust machine learning models while seemingly respecting data privacy and security regulations [ 22 , 21 ] . Unfortunately, FL instils a misleading sense of security as in recent years a gradient inversion attack called Deep Leakage has emerged [ 34 ] . This attack aims to uncover private training data by analyzing the shared gradients transmitted to the server by the client. The attacker, often a curious server or a third party intercepting the communications, employs a randomly initialized dummy image and the shared global model to compute dummy gradients. The goal is then to minimize the distance between these dummy gradients and the intercepted shared gradients, thus optimizing the dummy image to closely resemble the ground truth. Although Deep Leakage was initially proposed within the context of Federated Learning, early iterations of the attack were primarily limited to untrained networks [ 34 , 32 ] . Subsequent endeavours have aimed for more realistic scenarios by incorporating gradients from trained networks; however, these efforts typically assume a single steady-state model, failing to sufficiently consider how the recovery changes during training [ 11 , 30 ] . In a realistic scenario with a sustained attack being undertaking throughout the training process the attacker can theoretically achieve more accurate recoveries [ 13 , 14 ] . We call these approaches which leverage information from multiple timestamps Multi-Observation attacks. Previous Deep Leakage techniques have been assessed using differing metrics, across dissimilar datasets, and employing divergent attack protocols [ 34 , 11 , 13 ] . Prior codebases have utilized pretrained models in a stable state and lack implementation within a Federated Context or have minimal evaluation protocols in place [ 12 , 15 , 26 ] . In this paper, we present the FEDLAD Framework (Federated Evaluation of Deep Leakage Attacks and Defenses), which offers a diverse set of evaluation metrics across various datasets, incorporating implementations of numerous state-of-the-art attacks and defenses, and is designed to be extensible for future research. We hope this will help stimulate improved growth in the field, and better allow reproducibility in the future. In FEDLAD, we consider a server that is honest-but-curious. This server conducts training as intended but, in its curiosity, collects gradients at different timestamps to construct its own dataset using the recovered ground truths. To be clear, the attack does not adversely affect the performance of the final FL model, but rather leaks the private data held by the participants. Our threat model in our benchmark assumes the attacker only has access to information known to the FL server and does not allow the attacker to modify the model structure as this would alert the victim of the attack. Auxiliary information is permissible when derived from commonly shared information, such as batch normalization statistics from global models [ 29 ] . Finally, the attacker cannot know the quality of the recovery as they don’t have access to the ground truth. The code for our benchmark is available in the supplementary material. Our main contributions in this paper are as follows: • We present the FEDLAD Framework designed to assess single-observation and Multi-Observation attacks within the context of Federated Learning. • We unify various state-of-the-art attacks into a single joint formulation, and demonstrate the effectiveness of each approach across several widely recognised metrics for a variety of batch sizes, attack paradigms and defences. • We integrate FEDLAD with the popular Flower library for federated learning, and extend Flower to operate in FedSGD mode. We release all relevant code, ensuring that future works can also compare fairly and benefit from the new insights highlighted by the benchmark. 2 Related Work Gradient inversion attacks were first formulated in 2019 by Zhu et al. with an attack called Deep Leakage from Gradients (DLG) [ 34 ] . This attack tries to minimize the Euclidean distance between the dummy gradients generated using a randomly initialized image and the real gradients taken by the attacker. L-BFGS is used to optimize the dummy image based on the Euclidean distance calculated in each iteration [ 18 ] . It achieved successful image reconstruction for the MNIST, CIFAR, SVHN, and LFW datasets however they were only able to realize their attack using gradients sourced from randomly initialized network weights [ 17 , 4 , 16 , 20 ] . Zhao et al. proposed ‘Improved Deep Leakage From Gradients (IDLG)’ which builds upon the initial attack by extracting the ground truth label from the gradients of the last fully connected layer [ 32 ] . Since this attack doesn’t require optimizing the label jointly, it exhibited a faster convergence speed than DLG. IDLG was limited to a batch size of 1 and, akin to DLG, exclusively operated with randomly initialized weights.These limitations make it unrealistic to apply the attack in a real FL setting. Geiping et al. put forward Inverting Gradients which instead used the cosine similarity as their cost function and the Adam optimizer to update