WSS-CL: Weight Saliency Soft-Guided Contrastive Learning for Efficient Machine Unlearning Image Classification
Thang Duc Tran, Thai Hoang Le · 2025
Read WSS-CL: Weight Saliency Soft-Guided Contrastive Learning for Efficient Machine Unlearning Image Classification by Thang Duc Tran, Thai Hoang Le (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2508-04308.txt.
Introduction
Thang Duc Tran and Thai Hoang Le teach pic sorters to forget set pics by weight care, in a study from 2025. Law and shame can bid a trained model to drop some data's mark. Full retrain is the sure way and the dear one. Past fast ways oft left ghosts or shook the rest.
Their way, WSS-CL, works in two beats. First, for the drop set, it drives the model's outs far from true tags, a clean first blur. Next, a clash-learn pass pulls kept pics and drop pics far in trait space, with drop pics paired to their own bent twins. Key weights, found by a care score, bear the work. The gap to true retrain shrinks hard.
Catalog record
| CREATOR | Thang Duc Tran, Thai Hoang Le |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 35 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2508-04308
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
WSS-CL: Weight Saliency Soft-Guided Contrastive Learning for Efficient Machine Unlearning Image Classification Thang Duc Tran, Thai Hoang Le Abstract Machine unlearning, the efficient deletion of the impact of specific data in a trained model, remains a challenging problem. Current machine unlearning approaches that focus primarily on data-centric or weight-based strategies frequently encounter challenges in achieving precise unlearning, maintaining stability, and ensuring applicability across diverse domains. In this work, we introduce a new two-phase efficient machine unlearning method for image classification, in terms of weight saliency, leveraging weight saliency to focus the unlearning process on critical model parameters. Our method is called weight saliency soft-guided contrastive learning for efficient machine unlearning image classification (WSS-CL) , which significantly narrows the performance gap with "exact" unlearning. First, the forgetting stage maximizes Kullback–Leibler divergence between output logits and aggregated pseudo-labels for efficient forgetting in logit space. Next, the adversarial fine-tuning stage introduces contrastive learning in a self-supervised manner. By using scaled feature representations, it maximizes the distance between the forgotten and retained data samples in the feature space, with the forgotten and the paired augmented samples acting as positive pairs, while the retained samples act as negative pairs in the contrastive loss computation. Experimental evaluations reveal that our proposed method yields much-improved unlearning efficacy with negligible performance loss compared to state-of-the-art approaches, indicative of its usability in supervised and self-supervised settings. 1 Introduction The increasing use of machine learning models in numerous domains, alongside "the right to forget" and data privacy concerns, has placed in the spotlight [ 2 ] the problem of machine unlearning. Machine unlearning aims to delete effectively and efficiently the contribution of individual training samples in a trained model as if such samples were not experienced at training time. This property is critical for GDPR compliance [ 15 ] , delete request processing, and the protection of model prediction accuracy over biases and inaccuracies in data. Prior work in machine unlearning has involved full retraining, excluding forgetting data, and is computationally infeasible and costly for large datasets and complex models [ 4 ] . Recently, there have been works with a direction towards efficient technique development, such as approximation unlearns and sharded unlearns [ 2 ] . There is, nevertheless, a challenge in achieving effective unlearning with zero performance loss and computational cost. We introduce in this work a new two-step training mechanism for efficient unlearning in image classification, with a direction towards weight saliency and contrastive learning. Our algorithm identifies and updates specific model weights that are most salient to the target forgetting data, rather than retraining in full. Targeted unlearns deliver a significant improvement in efficiency and performance over traditional unlearns. Our proposed scheme consists of a forgetting stage and an adversarial fine-tuning stage. In the forgetting stage, unlearning in logit space is emulated through Kullback–Leibler divergence maximization between model output logits and aggregated pseudo-labels for forgetting samples. This effectively initiates the "forgetting" mechanism. The subsequent stage of adversarial fine-tuning then fine-tunes the model with a new forgetting rotation mechanism derived from self-supervised contrastive learning. This mechanism aims to maximize the feature-space distance between representations for samples to forget and samples to remember. Specifically, samples to forget and their augmented variants act as positive pairs, while samples to remember act as negative pairs in a contrastive loss calculation. This effectively "pushes away" the impact of forgotten data. In addition, weight saliency is soft incorporated in the contrastive loss calculation, such that unlearning activity is concentrated in the most relevant model parameters. Experimental evaluations confirm that our scheme attains much-improved unlearning performance with minor performance drop-off in comparison to state-of-the-art alternatives, with its adaptability in both supervised and self-supervised scenarios. 2 Related Work 2.1 Machine Unlearning in Image Classification Machine unlearning (MU) seeks to remove specific data points or even an entire class’s contribution from trained models, overcoming privacy-related concerns such as membership inference attacks [ 9 ] , [ 12 ] . The most common practice, exact unlearning , relearns the model in its entirety starting with a reduced dataset D_{r} . SISA [ 3 ] and ARCANE [ 30 ] -like methodologies partition data to save computational costs. However, such exact techniques involve high computational expense and sensitivity to partitioning techniques. To overcome such constraints, approximate unlearning techniques have been proposed [ 10 ] . Techniques such as fine-tuning (FT) [ 10 ] , gradient ascent (GA) [ 11 ] , fisher forgetting (FF) [ 10 ] , and influence unlearning (IU) [ 17 ] strike a balance between efficiency and effectiveness. Despite such efficiency, these techniques fall short in terms of unlearning effectiveness, performance in a variety of scenarios, and restricted usability in contexts other than supervised learning. Exact unlearning techniques ensure full erasure of the contribution of the forgetting dataset D_{f} from a trained model. The SISA [ 3 ] -like partition scheme shreds data and relearns only the impacted shreds in the case of an unlearning request, reducing computational expenses compared to full retraining. Likewise, ARCANE [ 30 ] employs partitioning at the class level to support full-class unlearning through relearning of applicable parts. Despite such success, these techniques involve high computational expenses and require efficient partitioning. Approximate unlearning techniques present a pragmatic alternative by minimizing the impact of D_{f} without full retraining. Fine-tuning (FT) [ 10 ] , compared to retraining, involves fine-tuning the initial model \theta over the retention dataset D_{r} for a short training period, generating the updated model \theta_{u} . This process induces catastrophic forgetting of the forgetting dataset D_{f} , a behavior that is widespread in continual training environments. Gradient ascent (GA) [ 11 ] counteracts training over D_{f} by adding respective gradients to the initial model parameters \theta_{o} . This effectively raises the loss for such scheduled erasure examples, thereby unlearning them. Fisher forgetting (FF) [ 10 ] employs an additive Gaussian perturbative scheme to perturb \theta_{o} towards exact unlearning. The Gaussian perturbative distribution is defined with zero mean and covariance with the fourth root of the Fisher information matrix concerning \theta_{o} over D_{r} . Nonetheless, estimating the Fisher information matrix incurs high computational costs and less parallel efficiency concerning GPU architectures compared to alternative unlearning algorithms [ 10 ] . Influence unlearning (IU) [ 17 ] utilizes the theory of influence functions [ 6 ] to estimate the impact of erasing specific training examples on model parameters. It estimates the transition between \theta_{o} and \theta_{u} as \theta_{u}-\theta_{o} . IU is related to \epsilon - \delta forgetting [ 27 ] , but it tends to require additional model and training scheme assumptions [ 27 ] . While these methodologies maximize computational efficiency, they fall short in unlearning effectiveness and robustness across various scenarios. 2.2 Weight Saliency in Machine Unlearning Saliency analysis deepens model interpretability in machine learning by discovering significant input features or model parameters. Saliency maps of inputs, including pixel-space sensitivity maps [ 25 ] and class-discriminative localization techniques [ 31 ] , have become prevalent in model explanation. In addition, attribution techniques for data [ 23 ] estimate the individual contribution of samples of data towards model prediction, contributing to model debugging [ 16 ] , efficient training [ 29 ] , and generalization improvement [