Federated Unlearning Made Practical: Seamless Integration via Negated Pseudo-Gradients
Alessio Mora, Carlo Mazzocca, Rebecca Montanari, Paolo Bellavista · 2025
Read Federated Unlearning Made Practical: Seamless Integration via Negated Pseudo-Gradients by Alessio Mora, Carlo Mazzocca, Rebecca Montanari, Paolo Bellavista (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2504-05822.txt.
Introduction
Alessio Mora, Carlo Mazzocca, Rebecca Montanari, and Paolo Bellavista tackle the right to be forgotten inside federated learning, where many devices train one shared model without pooling private data. Even so, the model keeps traces of what it learned from each client. Their method, PUF, reuses the updates clients already send during normal training rounds, treating them as stand-in gradients.
When a client must be forgotten, the server subtracts a scaled copy of that client's updates from the shared model. The trick needs no stored history, no public data set, and no extra traffic, and several clients can be forgotten at once. Tests on two image data sets and a real prostate scan task, across three network designs, matched leading methods for forgetting quality and recovery speed, without the usual impractical assumptions.
Catalog record
| CREATOR | Alessio Mora, Carlo Mazzocca, Rebecca Montanari, Paolo Bellavista |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 54 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2504-05822
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Federated Unlearning Made Practical: Seamless Integration via Negated Pseudo-Gradients Alessio Mora, Carlo Mazzocca, Rebecca Montanari, Paolo Bellavista Abstract The right to be forgotten is a fundamental principle of privacy-preserving regulations and extends to Machine Learning (ML) paradigms such as Federated Learning (FL). While FL enhances privacy by enabling collaborative model training without sharing private data, trained models still retain the influence of training data. Federated Unlearning (FU) methods recently proposed often rely on impractical assumptions for real-world FL deployments, such as storing client update histories or requiring access to a publicly available dataset. To address these constraints, this paper introduces a novel method that leverages negated Pseudo-gradients Updates for Federated Unlearning ( PUF ). Our approach only uses standard client model updates, anyway employed during regular FL rounds, and interprets them as pseudo-gradients. When a client needs to be forgotten, we apply the negated of their pseudo-gradients, appropriately scaled, to the global model. Unlike state-of-the-art mechanisms, PUF seamlessly integrates with FL workflows, incurs no additional computational and communication overhead beyond standard FL rounds, and supports concurrent unlearning requests. We extensively evaluated the proposed method on two well-known benchmark image classification datasets (CIFAR-10 and CIFAR-100) and a real-world medical imaging dataset for segmentation (ProstateMRI), using three different neural architectures: two residual networks and a vision transformer. The experimental results across various settings demonstrate that PUF achieves state-of-the-art forgetting effectiveness and recovery time, without relying on any additional assumptions, thus underscoring its practical applicability. I Introduction In today’s digital landscape, privacy has become a major concern, as reflected by the emergence of robust regulatory frameworks worldwide [ 1 ] . The European Union (EU) has consistently emphasized the importance of protecting personal data, exemplified by the introduction of the General Data Protection Regulation (GDPR) in 2016 [ 2 ] . Most recently, in May 2024, the EU enacted Regulation 2024/1183 [ 3 ] , establishing the European Digital Identity Framework that empowers individuals with fine-grained control over their data. One of the key rights of these regulations is the right to be forgotten , which allows individuals to request the deletion of their previously shared data. Similar rights are central to other major privacy laws worldwide, such as the California Consumer Privacy Act (CCPA) [ 4 ] where the right to delete grants California residents the on-demand removal of personal data held by businesses. Individuals should retain the ability to exercise their privacy rights even in Machine Learning (ML), including withdrawing their contributions from a trained model due to security or privacy concerns [ 5 ] . This can be achieved through Machine Unlearning (MU) [ 6 , 7 , 8 ] , an emerging paradigm designed to selectively erase the influence of specific training data from a model by post-processing the trained model. Fig. 1 : Performance comparison of PUF against state-of-the-art mechanisms using ResNet-18 on CIFAR-100 (non-IID case) in a 10-client setup, where one client requests unlearning. The ideal FU algorithm should (1) minimize the difference with the gold standard retrained model, across forgetting metrics such as Forget Accuracy and various MIAs (in Figure expressed as \Delta Forget Accuracy and \Delta MIAs), (2) ensure a short recovery phase (Recovery Rounds) and (3) preserve the generalization performance (reported in Figure as \Delta Test Accuracy just after unlearning, before recovery starts). A smaller polygon represents better unlearning performances. Experimental details and additional comparisons are available in Section V . The right to be forgotten should also extend to privacy-preserving ML paradigms such as Federated Learning (FL) [ 9 , 10 ] , which enables the collaborative training of a global model across multiple clients without requiring them to share their private data with a central server. In FL, clients train local models using their on-premises data and only share updates (e.g., weight differences) [ 11 ] . Despite offering enhanced privacy, the global model inevitably reflects the influence of client training data [ 12 ] . However, the intrinsic characteristics of FL, such as its non-deterministic and iterative training process, make traditional MU techniques less effective in this context [ 13 ] . This has led to the novel concept of Federated Unlearning (FU) [ 13 , 14 ] , which encompasses unlearning methods tailored for FL settings. The goal of an FU algorithm depends on what we are trying to remove from the global model, which could be either some samples, all the contributions of a client, or all samples belonging to a class. In this work, we address client unlearning , where a client seeks to remove all traces of its previously shared data from the global model. Work No Historical Information No Full Participation No Stateful Clients Task Agnostic No Auxiliary Data No Computational Overhead Simultaneous Unlearning Liu et al. [ 15 ] \times \times \checkmark \checkmark \checkmark \times \times FedEraser [ 16 ] \times \times \checkmark \checkmark \checkmark \times \times FUKD [ 17 ] \times \checkmark \checkmark \times \times \checkmark \times PGA [ 18 ] \checkmark \times \times \times \checkmark \times \times NoT [ 19 ] \checkmark \checkmark \checkmark \checkmark \checkmark \checkmark \checkmark PUF (ours) \checkmark \checkmark \checkmark \checkmark \checkmark \checkmark \checkmark TABLE I : Comparison with other works performing client unlearning in federated settings. An effective mechanism should achieve unlearning while maintaining the overall performance of the global model. Although some FU techniques have started to be proposed, most of them rely on hard assumptions as they usually require maintaining additional information such as historical updates [ 16 , 15 , 17 ] or stateful clients [ 18 ] . Moreover, these works fail to address scenarios where multiple unlearning requests occur in the same time window. This condition cannot be overlooked as clients should be allowed to remove their contributions regardless of others’ willingness. To fill this gap, this paper presents a novel method that leverages negated Pseudo-gradients Updates for Federated Unlearning ( PUF ). Our approach ensures seamless integration into existing FL frameworks as it enables unlearning without modifying the traditional Federated Averaging (FedAvg) [ 9 ] training protocol. Unlike most previous works, PUF eliminates the need for storing historical information (e.g., historical updates), accessing proxy data, maintaining stateful clients, or incurring impractical computational requirements. Since PUF can be seamlessly integrated into standard FedAvg, it also explicitly addresses multiple unlearning requests that concurrently occur. The client who wants to be forgotten sends an unlearning request to the server and performs one final round of FL. The server then adjust s its model updates by flipping and scaling them according to an unlearning rate. To demonstrate the broad applicability of our approach, we implemented PUF and extensively evaluated its performance on two benchmark image classification datasets (CIFAR-10, CIFAR-100) and a real-world medical imaging dataset (ProstateMRI) for segmentation. The evaluation involved two residual networks and a vision transformer. The reported results clearly show the efficiency and effectiveness of PUF in removing client contributions to the global model across a variety of settings. Figure 1 visually compares the performance of PUF against state-of-the-art mechanisms. Contributions. The main contributions of this work can be summarized as follows: • We introduce PUF , a novel approach that enables FU without requiring any modifications or additional overhead to the original FedAvg