Sequential Subspace Noise Injection Prevents Accuracy Collapse in Certified Unlearning

Polina Dolgova, Sebastian U. Stich, [0.5ex] CISPA Helmholtz Center for Information Security · 2026

Read Sequential Subspace Noise Injection Prevents Accuracy Collapse in Certified Unlearning by Polina Dolgova, Sebastian U. Stich, [0.5ex] CISPA Helmholtz Center for Information Security (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2601-05134.txt.

Introduction

Polina Dolgova and Sebastian U. Stich protect model accuracy during certified unlearning in a 2026 paper. Unlearning removes a trained model's reliance on data that must be forgotten, and certified methods based on differential privacy give strong guarantees. Existing noisy fine-tuning approaches keep those guarantees but severely damage accuracy, making certified unlearning largely impractical for real systems that still need to perform well.

Their fix is sequential subspace noise injection: the noise budget is dealt out over time, one orthogonal subspace at a time, rather than injected all at once. They extend the analysis to this subspace setting and prove the same privacy guarantees hold. Usable unlearning matters for privacy law compliance, where deletion rights mean little if honouring them ruins the product.

Catalog record

CREATORPolina Dolgova, Sebastian U. Stich, [0.5ex] CISPA Helmholtz Center for Information Security
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE74 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2601-05134

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Sequential Subspace Noise Injection Prevents Accuracy Collapse in Certified Unlearning Polina Dolgova, Sebastian U. Stich, [0.5ex] CISPA Helmholtz Center for Information Security Abstract Certified unlearning based on differential privacy offers strong guarantees but remains largely impractical: the noisy fine-tuning approaches proposed so far achieve these guarantees but severely reduce model accuracy. We propose sequential noise scheduling, which distributes the noise budget across orthogonal subspaces of the parameter space, rather than injecting it all at once. This simple modification mitigates the destructive effect of noise while preserving the original certification guarantees. We extend the analysis of noisy fine-tuning to the subspace setting, proving that the same ( ε , δ ) (\varepsilon,\delta) privacy budget is retained. Empirical results on image classification benchmarks show that our approach substantially improves accuracy after unlearning while remaining robust to membership inference attacks. These results show that certified unlearning can achieve both rigorous guarantees and practical utility. 1 Introduction Machine unlearning refers to the task of transforming a machine learning model so that the influence of a specified subset of training data is removed. The topic has gained attention ( 26 ) due to legal requirements such as the GDPR ( 8 ) and the “right to be forgotten” ( 14 ) , as well as practical needs including removing sensitive information and mitigating poisoned or maliciously injected data. The most direct baseline is retraining from scratch on the retained data, but it is typically computationally infeasible. Existing methods are commonly grouped into exact, certified, and empirical approaches ( 11 ; 25 ; 9 ; 15 ) . Exact and certified methods offer formal guarantees but usually rely on restrictive assumptions or architectural changes, whereas empirical methods lack guarantees and instead rely on evaluation tools such as Membership Inference Attacks (MIA) ( 19 ; 15 ) . Among certified approaches, differential-privacy-inspired methods are prominent ( 6 ; 3 ; 22 ; 2 ) but often struggle to preserve utility: the noise required for certified forgetting can cause severe accuracy degradation. A recent line of work, noisy fine-tuning (NFT) with gradient clipping ( 17 ) provides an (\varepsilon,\delta) certificate for arbitrary models and loss functions. However, empirical results indicate that the required noise frequently causes substantial accuracy degradation, limiting the practical applicability of the method. For example, on CIFAR-10 with ResNet-18, NFT shows a significant drop in test accuracy during the unlearning phase and fails to recover afterwards (Figure 1 ). Figure 1: Severe accuracy drop under noisy fine-tuning. On CIFAR-10 with ResNet-18, standard noisy fine-tuning (NFT, 17 ) test accuracy drops sharply from 98\% to below 20\% once the unlearning begins, and does not recover even after 1000 subsequent fine-tuning steps. To address this limitation, we propose a block-wise variant of NFT that preserves accuracy more effectively while retaining certified guarantees. The key idea is to partition the parameter space into orthogonal subspaces (e.g., corresponding to different layers) and to apply the unlearning procedure sequentially across them, distributing the effect of noise over time rather than injecting it all at once. We further condition on the proximity between the fully trained and retrained models under a shared coupling of randomness. Under this proximity condition, our method admits certified guarantees while achieving substantially improved post-unlearning accuracy. Empirically, we demonstrate that the resulting models remain close to the retraining-from-scratch baseline, i.e., preserving utility while successfully forgetting the designated data, as validated by standard unlearning metrics and membership inference attacks. Motivation. The central challenge in certified unlearning is to design methods that simultaneously preserve rigorous differential-privacy-based guarantees and avoid the severe accuracy degradation caused by heavy clipping and noise in current DP-inspired approaches. Our work makes the following contributions : • Method. We introduce Sequential Subspace Noise Injection (also referred to as block-wise noisy fine-tuning ): the model parameters are partitioned into k orthogonal subspaces, and only one block is updated per step. This sequential schedule distributes the required Gaussian noise across blocks and iterations, thereby reducing per-step distortion compared to injecting noise into all parameters simultaneously. • Theory. We extend the certification analysis of noisy fine-tuning to our block-wise schedule and show that it preserves the same (\varepsilon,\delta) budget. Moreover, conditioning on proximity to the retrained model, we show that the initial model clipping step is unnecessary and that the constants in the privacy guarantee can be improved, without weakening privacy. • Practice. In experiments on MNIST and CIFAR-10 with standard architectures, our method consistently reduces the post-unlearning accuracy drop compared to baselines, both for random and class-wise deletions, while maintaining robustness against membership inference attacks. • Insight. Certified unlearning methods that ignore training dynamics and enforce worst-case indistinguishability must either severely degrade utility or incur costs comparable to retraining from scratch, explaining the limitations of existing DP-based approaches. In summary, our approach preserves formal certified unlearning guarantees while substantially mitigating the utility loss that has so far limited differentially private methods in practice. 2 Preliminaries and Problem statement In this section, we establish notation and recall the standard definitions used throughout the remainder of the paper. Setup. A (possibly randomized) learning algorithm \mathcal{A} maps a dataset \mathcal{D} to model parameters \hat{\mathbf{x}}\in\mathbb{R}^{d} , i.e., \hat{\mathbf{x}}=\mathcal{A}(\mathcal{D}) . A deletion request specifies a subset \mathcal{D}_{f}\subseteq\mathcal{D} to be removed; the retained data are \mathcal{D}_{r}:=\mathcal{D}\setminus\mathcal{D}_{f} . An unlearning mechanism \mathcal{U} takes (\hat{\mathbf{x}},\mathcal{D},\mathcal{D}_{f}) and, using randomness, outputs updated parameters \tilde{\mathbf{x}}=\mathcal{U}(\hat{\mathbf{x}},\mathcal{D},\mathcal{D}_{f}) . We adopt the definition from ( 17 ) , where the notion of certified approximate unlearning is introduced, building on an analogy with differential privacy. Definition 1 (( \varepsilon,\delta )-unlearning ( 17 ) ) . Let \varepsilon\geq 0 , \delta\in[0,1] . We say that \mathcal{U} is an (\varepsilon,\delta) -unlearning algorithm for \mathcal{A} if there exists a certifying algorithm \bar{\mathcal{A}} such that, for any forget dataset \mathcal{D}_{f}\subset\mathcal{D} and any observation O\subset\mathbb{R}^{d} , \displaystyle\Pr[\mathcal{U}(\mathcal{A}(\mathcal{D}),\mathcal{D},\mathcal{D}_{f})\in O]\leq e^{\varepsilon}\Pr[\bar{\mathcal{A}}(\mathcal{D}\setminus\mathcal{D}_{f})\in O]+\delta, (1) \displaystyle\Pr[\bar{\mathcal{A}}(\mathcal{D}\setminus\mathcal{D}_{f})\in O]\leq e^{\varepsilon}\Pr[\mathcal{U}(\mathcal{A}(\mathcal{D}),\mathcal{D},\mathcal{D}_{f})\in O]+\delta. Note that, by definition, \bar{\mathcal{A}} may be any algorithm. Following 17 , we focus on guarantees with respect to \bar{\mathcal{A}}(\mathcal{D}\setminus\mathcal{D}_{f})=\mathcal{U}(\mathcal{A}(\mathcal{D}_{r}),\mathcal{D}_{r},\varnothing) . In other words, we study the closeness between the distribution of the unlearning outcome applied to a model trained with the forget set and that of the reference model trained without it. Importantly, this definition provides a framework for reasoning about the indistinguishability of the two models, but it does not by itself guarantee that the resulting model preserves high accuracy. We build upon the noisy fine-tuning method introduced by 17 , which is inspired by the standard DP-SGD algorithm ( 1 ) and applied only to the retained data D_{r} . The method combines gradient clipping with Gaussian noise injection and is defined as follows: Definition 2 (Noisy fine-tuning, 17 ) . \displaystyle\mathbf{x}_{0} \displaystyle=\Pi_{C_{0}}(\hat{\mathbf{x}}), (2a) \displaystyle\mathbf{x}_{t+1} \displaystyle=\mathbf{x}_{t}-\gamma\big(\Pi_{C_{1}}(g_{t})+\lambda\mathbf{x}_{t}\big)+\bm{\xi}_{t+1}. (2b) where \mathbf{x}_{t} are the parameters at iteration t , g_{t} is the gradient at step t (computed on \mathcal{D}_{r} ), \gamma>0 is the learning rate, \lambda\geq 0 is the weight decay parameter, \bm{\xi}_{t+1}\sim\mathcal{N}(0,\sigma^{2}I_{d}) is Gaussian noise, and \Pi_{C_{0}},\Pi_{C_{1}} are clipping operators with radii C_{0},C_{1}>0 , defined as \Pi_{C}(\mathbf{v}):=\mathbf{v}\cdot\min\bigl\{\tfrac{C}{\|\mathbf{v}\|},1\bigr\}. For comparison, we also introduce notation for retrained models. Let \hat{\textbf{x}}^{\prime}=\mathcal{A}(\mathcal{D}_{r}) denote the model parameters obtained by training on the retained dataset \mathcal{D}_{r}=\mathcal{D}\setminus\mathcal{D}_{f} with the same algorithm and a suitably fixed coupling of randomness (e.g., matched random seeds or noise schedules). Accordingly, let \textbf{x}^{\prime}_{t}

Read the complete text