Scrutinizing the Vulnerability of Decentralized Learning to Membership Inference Attacks CCS: Computing methodologies Distributed artificial intelligence CCS: Computer systems organization Peer-to-peer architectures CCS: Security and privacy Privacy-preserving protocols
Ousmane Touat, Jezekael Brunon, Yacine Belal, Julien Nicolas, César Sabater, Mohamed Maouche, Sonia Ben Mokhtar · 2024
Read Scrutinizing the Vulnerability of Decentralized Learning to Membership Inference Attacks CCS: Computing methodologies Distributed artificial intelligence CCS: Computer systems organization Peer-to-peer architectures CCS: Security and privacy Privacy-preserving protocols by Ousmane Touat, Jezekael Brunon, Yacine Belal, Julien Nicolas, César Sabater, Mohamed Maouche, Sonia Ben Mokhtar (2024) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2412-12837.txt.
Introduction
Ousmane Touat and co-authors probe privacy leaks in decentralized learning in a 2024 paper. In that setup, users train a shared model together while data stay on their own machines. Peers swap model updates, not data. Attackers can exploit those swaps for membership inference, guessing whether one person's data trained the model.
The team varied the network's shape, its change over time, and how nodes blend received models. Tests spanned four data sets and many data splits. Two factors ruled the risk: how each node mixes incoming models, and how fast the whole graph mixes. To their knowledge, this mixing link is reported here first. Better mixing also amplified other defenses like differential privacy. The authors distill design lessons for decentralized systems that resist inference by construction.
Catalog record
| CREATOR | Ousmane Touat, Jezekael Brunon, Yacine Belal, Julien Nicolas, César Sabater, Mohamed Maouche, Sonia Ben Mokhtar |
|---|---|
| YEAR | 2024 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 52 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2412-12837
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Scrutinizing the Vulnerability of Decentralized Learning to Membership Inference Attacks CCS: Computing methodologies Distributed artificial intelligence CCS: Computer systems organization Peer-to-peer architectures CCS: Security and privacy Privacy-preserving protocols Ousmane Touat, Jezekael Brunon, Yacine Belal, Julien Nicolas, César Sabater, Mohamed Maouche, Sonia Ben Mokhtar Abstract . The primary promise of decentralized learning is to allow users to engage in the training of machine learning models in a collaborative manner while keeping their data on their premises and without relying on any central entity. However, this paradigm necessitates the exchange of model parameters or gradients between peers. Such exchanges can be exploited to infer sensitive information about training data, which is achieved through privacy attacks ( e . g ., Membership Inference Attacks – MIA). In order to devise effective defense mechanisms, it is important to understand the factors that increase/reduce the vulnerability of a given decentralized learning architecture to MIA. In this study, we extensively explore the vulnerability to MIA of various decentralized learning architectures by varying the graph structure ( e . g ., number of neighbors), the graph dynamics, and the aggregation strategy, across diverse datasets and data distributions. Our key finding, which to the best of our knowledge we are the first to report, is that the vulnerability to MIA is heavily correlated to (i) the local model mixing strategy performed by each node upon reception of models from neighboring nodes and (ii) the global mixing properties of the communication graph. We illustrate these results experimentally using four datasets and by theoretically analyzing the mixing properties of various decentralized architectures. Our paper draws a set of lessons learned for devising decentralized learning systems that reduce by design the vulnerability to MIA. 1. Introduction Federated learning ( McMahan et al. 2017 ) , which allows training machine learning models while keeping users’ data on their premises has gained significant interest in recent years both from academia and industry ( Hard et al. 2018 ; Banabilah et al. 2022 ; Wang et al. 2019 ; Nicolas et al. 2024 ) . However, this approach is often criticized because of the trust it requires on the aggregation server, which may be subject to failures ( Kairouz et al. 2021 ) , attacks ( Bhagoji et al. 2019 ) , scalability issues ( Li et al. 2020 ) , etc . In order to deal with these challenges, Decentralized Learning, which builds on the peer-to-peer exchange of model parameters between participants is gaining an increasing focus ( e . g ., ( Lian et al. 2017a ; Ormándi et al. 2013 ; Hegedüs et al. 2019 ) ). Indeed, decentralized architectures have been heavily studied for decades and their scalability and resilience properties have been extensively documented both theoretically and experimentally in the literature ( Baran 1964 ; Lynch 1996 ; Van Renesse et al. 2003 ) . This makes decentralized learning a natural avenue to explore for large-scale, distributed learning tasks ( Lian et al. 2017b ; Hendrikx et al. 2019 ; Wu et al. 2024 ) . However, whether federated or decentralized, collaborative learning has been shown to be vulnerable to privacy attacks and in particular to Membership Inference Attacks (MIA) ( Nasr et al. 2019 ; Melis et al. 2019 ; Zhang et al. 2020 ) . This family of attacks aims at predicting whether a given data item has been used or not in the model training set, which can reveal sensitive information about the data owner ( e . g ., a model trained to predict the risk of heart disease, could reveal sensitive information such as a patient’s history of cholesterol levels, blood pressure, or family medical history ( Koren et al. 2024 ) ). Moreover, since MIA is closely related to other privacy attacks ( Yeom et al. 2018 ) , the assessment of the vulnerability against such attack provides valuable insight into a model’s overall vulnerability to other privacy attacks ( Pasquini et al. 2023 ) . In this context, an active debate started in the research community to understand whether decentralization increases or decreases the vulnerability to MIA compared to FL architectures. For instance, Pasquini et al. 2023 points out the vulnerability of decentralized topologies, while Ji et al. 2024 contradicts this study by claiming that FL topologies are weaker. While these papers contribute to advancing the global knowledge on this topic, these studies are limited because they mainly focus on static graph topologies, ignoring decades of research on dynamic peer-to-peer systems enabled by their underlying random peer sampling protocols (RPS) ( Jelasity et al. 2007 ; Voulgaris et al. 2005 ) . In this paper, we aim to contribute to this debate by analyzing the key factors that make decentralized architectures more or less vulnerable to MIA. Indeed, there are various ways of deploying a decentralized learning task, which differ according to the graph topology ( e . g ., k -regular graph with variable view sizes), graph dynamics ( e . g ., static graph, vs graph built over RPS protocols), communication synchronicity (synchronous vs asynchronous model exchange) and model mixing and dissemination strategy. In this study, we focus on the MIA vulnerability of decentralized learning over asynchronous, k -regular graphs (also defined as Gossip Learning in ( Hegedűs et al. 2019 ; Ormándi et al. 2013 ) ) and vary all the remaining factors. Specifically, (i) we explore two local model mixing and dissemination strategies by introducing the send-all-merge-once (SAMO) strategy; (ii) we vary graph dynamics; (iii) we vary graph density through the number of neighbors. Beyond these key architectural features, we further consider four commonly used datasets and corresponding models and study the impact of i.i.d and non-i.i.d data distributions. We evaluate the MIA vulnerability of the overall decentralized architecture by considering that the attacker can observe all the messages exchanged in the system and run the MIA against each participant using messages received from its neighbors. Our key finding is that MIA vulnerability is heavily correlated with two factors: (i) the local model mixing and dissemination strategy, which determines how a node aggregates models received from his neighbors and how he disseminates his updated model and (ii) the global mixing properties of the communication graph . For instance, we show that a static highly connected graph has a similar vulnerability to a dynamic graph of the same size. Instead, in weakly connected graphs ( e . g ., 2-regular graphs), graph dynamics brought by RPS protocols clearly decrease MIA vulnerability. Beyond local and global mixing properties, we also observe that learning tasks over non-i.i.d data distributions clearly increase MIA vulnerability. Summarizing, our paper makes the following contributions: • Comprehensive Study of MIA Vulnerabilities in Decentralized Learning : To the best of our knowledge, we propose the first study that scrutinizes how MIA vulnerability is affected by decentralized learning settings, focusing on the roles of graph connectivity, graph dynamics, model mixing, and data distributions. • Insights into Mixing Properties and Privacy : We identify that both local and global model mixing properties are critical determinants of MIA vulnerability. Our findings reveal how dynamic graph settings and enhanced view sizes improve model mixing and mitigate privacy risks. Note that all