Targeted Unlearning Using Perturbed Sign Gradient Methods With Applications On Medical Images
George R. Nahass, Zhu Wang, Homa Rashidisabet, Won Hwa Kim, Sasha Hubschman, Jeffrey C. Peterson, Ghasem Yazdanpanah, Pete Setabutr, Chad A. Purnell, Ann Q. Tran, Darvin Yi, Sathya N. Ravi · 2025
Read Targeted Unlearning Using Perturbed Sign Gradient Methods With Applications On Medical Images by George R. Nahass, Zhu Wang, Homa Rashidisabet, Won Hwa Kim, Sasha Hubschman, Jeffrey C. Peterson, Ghasem Yazdanpanah, Pete Setabutr, Chad A. Purnell, Ann Q. Tran, Darvin Yi, Sathya N. Ravi (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2505-21872.txt.
Introduction
Nahass and a large team teach models to forget chosen training data with a perturbed sign method in twenty twenty-five. Unlearning is framed here as post launch repair, not just privacy scrubbing. Clinics face data drift, dead devices, and rule changes that demand it. Their scheme poses forgetting as a two level optimization with bounds.
Tunable loss terms set the balance between forgetting and keeping. Runs can merge to pool their strengths. Tests on bench and real clinic image sets beat baselines on both scores. Hard cases with odd devices and anatomy were included. The work casts unlearning as routine model upkeep.
Catalog record
| CREATOR | George R. Nahass, Zhu Wang, Homa Rashidisabet, Won Hwa Kim, Sasha Hubschman, Jeffrey C. Peterson, Ghasem Yazdanpanah, Pete Setabutr, Chad A. Purnell, Ann Q. Tran, Darvin Yi, Sathya N. Ravi |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 76 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2505-21872
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Targeted Unlearning Using Perturbed Sign Gradient Methods With Applications On Medical Images George R. Nahass, Zhu Wang, Homa Rashidisabet, Won Hwa Kim, Sasha Hubschman, Jeffrey C. Peterson, Ghasem Yazdanpanah, Pete Setabutr, Chad A. Purnell, Ann Q. Tran, Darvin Yi, Sathya N. Ravi Abstract Machine unlearning aims to remove the influence of specific training samples from a trained model without full retraining. While prior work has largely focused on privacy-motivated settings, we recast unlearning as a general-purpose tool for post-deployment model revision. Specifically, we focus on utilizing unlearning in clinical contexts where data shifts, device deprecation, and policy changes are common. To this end, we propose a bilevel optimization formulation of boundary-based unlearning that can be solved using iterative algorithms. We provide convergence guarantees when first order algorithms are used to unlearn. Our method introduces tunable loss design for controlling the forgetting–retention tradeoff and supports novel model composition strategies that merge the strengths of distinct unlearning runs. Across benchmark and real-world clinical imaging datasets, our approach outperforms baselines on both forgetting and retention metrics, including scenarios involving imaging devices and anatomical outliers. This work establishes machine unlearning as a modular, practical alternative to retraining for real-world model maintenance in clinical applications. keywords Machine Unlearning, Deep Learning Algorithms, Medical Imaging, Computer Vision 1 Main In recent years, the awareness of the public regarding data ownership has continued to increase. As large deep learning models continue to be trained using information from people who may not have explicitly opted into such a procedure, the question naturally arises: how can they ‘opt-out’ post-fact? To this point, in 2016, the General Data Protect Regulation (GDPR) was passed by the EU, stating that individuals have the ‘right to be forgotten’ and businesses have the ‘obligation to erase personal data’ regulation2020art ; Graves_Nagisetty_Ganesh_2021 . As the cost and length of training continues to increase, if an individual decides to exercise their right to be forgotten, retraining the model from scratch without their data may prove to be infeasible from both a logistic and economic point of view cottier2024rising . Machine unlearning has emerged as a primary strategy for such purposes liu2024philip ; liu2024breaking . While machine unlearning was originally developed to satisfy privacy mandates, its potential applications extend well beyond regulatory compliance kurmanji2024towards . In real-world machine learning pipelines—particularly in healthcare—there may be a need to revise models over time due to shifting data distributions, evolving clinical protocols, or the gradual deprecation of imaging devices guo2021systematic ; moreno2012unifying ; futoma2020myth . Continual learning has been proposed as a method to continuously update models, but this does not allow for removal of specific samples which may be necessary in various settings challen2019artificial ; lee2020clinical . In these scenarios, retraining from scratch is often infeasible due to computational cost, regulatory restrictions on data reuse, or lack of access to the full original dataset de2021continual ; verwimp2023continual . Despite this need, very few studies have explored unlearning as a practical mechanism for model maintenance and revision in real world settings. This gap highlights the importance of developing general-purpose, scalable unlearning methods that support targeted removal of specific subsets—whether defined by class, acquisition modality, or anatomical criteria—without compromising overall model utility wang2024machine . Machine unlearning algorithms that have been proposed thus far can be broadly classified as functioning through data reorganization or parameter modifications xu2023machine . Most recent work has been focused on the latter including ours, and we will briefly review some foundational approaches here. Golatkar et al. golatkar2020eternalsunshinespotlessnet used the Fisher Information Matrix (FIM) to inject noise and erase information about the forget set, though this approach is computationally demanding due to the need for Hessian approximations. Subsequent methods aimed to reduce this overhead: Peste et al. peste2021ssse leveraged gradient-based approximations of the FIM, while Mehta et al. mehta2022deep applied L-FOCI to select parameter subsets to update. Recent work by Chien et al. chien2024langevin introduced Langevin dynamics into the unlearning literature, but is limited to modifying only the final classification layer, so features may still remain in deep networks. kurmanji2024towards study unlearning for privacy based applications such as bias removal using an adaptation of the membership interference attack. There has been limited work on machine unlearning on medical images. xue2024erase demonstrate unlearning as a tool for image-to-image translation in MRI recontruction tasks, and nasirigerdeh2024machine provide a broad survey of existing algorithms on standard datasets. Chen et al. chen2023boundary proposed a decision-boundary-based method that is the most relevant for our work. In this method, unlearning is done by relabeling each sample in the forget set to its nearest incorrect class, thereby shifting the decision surface of the model. This approach achieved state-of-the-art (SOTA) performance on many common benchmarks and is simple to implement in deep learning frameworks such as PyTorch. While empirically effective, this approach suffers from key limitations – lacks convergence guarantees and offers limited flexibility in tuning the tradeoff between forgetting and retention. Despite growing interest in machine unlearning, significant limitations remain in both experimental scope and methodological flexibility. Most prior work focuses on benchmark datasets such as CIFAR-10 and MNIST, which lack the resolution, heterogeneity, and domain-specific information of real-world datasets—particularly in medical imaging greenspan2016guest ; litjens2017survey . Furthermore, selective unlearning, in which only specific subsets of data (e.g., based on metadata, image quality, or anatomical thresholds) are removed, is rarely explored. Here, fewer methods provide meaningful control over the forgetting–retention tradeoff, limiting their utility in settings where both privacy and performance must be carefully balanced kurmanji2024towards . Moreover, to the best of our knowledge, no existing methods support compositional reuse of unlearned components to improve downstream performance without full retraining. In this work, we extend the boundary-based unlearning framework of Chen et al. chen2023boundary by recasting it as a bilevel optimization problem solvable by first-order methods. This formulation enables a principled, modular, and scalable approach to deep model unlearning, offering both formal convergence guarantees and empirical improvements across multiple datasets. Our algorithm supports tunable loss design, allowing users to control the tradeoff between forgetting and retention via various design choices. This allows us to compose models unlearned with our algorithm naturally to combine desirable unlearning behaviors. That is, by merging the feature extractor of a strongly forgetting model with the classifier head of a retention-preserving one, we are able to construct hybrid models that outperform both their components and conventional retraining. Importantly, our framework supports both exact and distributional unlearning: in some experiments, we remove specific training samples, while in others we forget entire subgroups defined by clinical attributes such as imaging device or anatomical thresholds. This reflects real-world deployment scenarios where full metadata is often unavailable at test time, but subgroup-based revisions (e.g., removing the influence of outdated scanners or low-quality images) are required. To our knowledge, this is the first general-purpose unlearning framework applied to clinical imaging datasets, and the first to introduce a tunable and composable algorithm for both instance-level and distributional-level model maintenance. Figure 1: Graphical schematic of our proposed unlearning algorithm. We begin with a pretrained CNN f_{w_{0}} and a user-defined forget set F . In the inner optimization loop (top right), we identify boundary points x_{i}^{b} across the decision surface of the original model via our perturbed sign-gradient method. For