zkUnlearner: A Zero-Knowledge Framework for Verifiable Unlearning with Multi-Granularity and Forgery-Resistance

Nan Wang 1, Nan Wu 1, Xiangyu Hui 2, Jiafan Wang 1, Xin Yuan 1 · 2025

Read zkUnlearner: A Zero-Knowledge Framework for Verifiable Unlearning with Multi-Granularity and Forgery-Resistance by Nan Wang 1, Nan Wu 1, Xiangyu Hui 2, Jiafan Wang 1, Xin Yuan 1 (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2509-07290.txt.

Introduction

Nan Wang and 4 co-authors present zkUnlearner in 2025, a framework for proving that a machine learning model has truly forgotten data. Laws and ethics give people a right to be forgotten, but a model owner could claim data was removed without doing the work. Zero-knowledge proofs let one side prove a claim without revealing the underlying data.

A bit-masking trick lets existing proofs of training cover selective removal at three levels: single samples, features, and whole classes. The design converts to arithmetic circuits, so many proof systems can run it. The authors also block forging attacks, where gradients from removed data are faked using other samples. A working version built on zkSNARK proofs is benchmarked in the paper. Verifiable forgetting could make privacy promises auditable rather than taken on trust.

Catalog record

CREATORNan Wang 1, Nan Wu 1, Xiangyu Hui 2, Jiafan Wang 1, Xin Yuan 1
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE65 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2509-07290

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

zkUnlearner: A Zero-Knowledge Framework for Verifiable Unlearning with Multi-Granularity and Forgery-Resistance Nan Wang 1, Nan Wu 1, Xiangyu Hui 2, Jiafan Wang 1, Xin Yuan 1 Abstract As the demand for exercising the "right to be forgotten" grows, the need for verifiable machine unlearning has become increasingly evident to ensure both transparency and accountability. We present zkUnlearner , the first zero-knowledge framework for verifiable machine unlearning, specifically designed to support multi-granularity and forgery-resistance . First, we propose a general computational model that employs a bit-masking technique to enable the selectivity of existing zero-knowledge proofs of training for gradient descent algorithms. This innovation enables not only traditional sample-level unlearning but also more advanced feature-level and class-level unlearning. Our model can be translated to arithmetic circuits, ensuring compatibility with a broad range of zero-knowledge proof systems. Furthermore, our approach overcomes key limitations of existing methods in both efficiency and privacy. Second, forging attacks present a serious threat to the reliability of unlearning. Specifically, in Stochastic Gradient Descent optimization, gradients from unlearned data, or from minibatches containing it, can be forged using alternative data samples or minibatches that exclude it. We propose the first effective strategies to resist state-of-the-art forging attacks. Finally, we benchmark a zkSNARK-based instantiation of our framework and perform comprehensive performance evaluations to validate its practicality. 1 Introduction Machine unlearning has garnered significant attention due to the increasing demand for exercising the "right to be forgotten". This process involves removing the influence of specific data from trained models, effectively enabling these models to "forget" the data. Machine unlearning is primarily motivated by the following factors [ 16 ] : • Access Revocation. This pertains to cases where sensitive or copyrighted data was inadvertently included in the training process. Once access to such data is revoked, it must be removed from the models to ensure it is no longer utilized or leveraged. • Model Correction. When models are trained on outdated knowledge, toxic content, unethical material or misinformation, unlearning offers a mechanism to correct them, ensuring they are no longer influenced by such harmful data. Verifiable unlearning. Responsible Artificial Intelligence (AI) is a critical and rising trend focused on developing and deploying AI systems that are safe, ethical, and trustworthy, prioritizing fairness and societal well-being. Verifiable unlearning is an essential component of Responsible AI. It empowers data owners to control the use of their personal data, minimizing risks of misuse and unauthorized exploitation, fostering trust with model trainers. Simultaneously, it provides model trainers with a transparent and auditable approach to model correction, enabling compliance with regulatory and ethical standards and building trust with regulators. Privacy is a key consideration in verifiable unlearning. Both model trainers and data owners are driven to safeguard their sensitive information, ensuring that no private information is exposed to unauthorized parties during the unlearning process. Any such exposure could grant adversaries critical insights into the underlying models or datasets, creating serious security vulnerabilities. For example, model trainers aim to protect the privacy of their models, while data owners seek to ensure their datasets are not disclosed to other owners. 1.1 Prior Works and Limitations Although various machine unlearning techniques [ 3 , 13 , 11 , 27 , 24 , 5 , 28 , 25 ] have been studied, verifiable unlearning remains an underexplored field, with only a handful of studies addressing this challenge: Prediction Comparison. Comparing model predictions offers an intriguing avenue for exploring verifiable unlearning. This line of research works [ 20 , 8 , 12 ] achieves unlearning by injecting backdoors into the unlearned data and verifying the success of unlearning by comparing the model’s predictions before and after the process. However, recent research finds this approach less reliable. Shumailov et al. (NeurIPS '21) [ 18 ] demonstrates that data ordering can introduce randomness into model training, showing that using different datasets can produce similar or even identical model updates, resulting in models with undetectable differences in predictions. Based on this finding, a recent work (USENIX Sec '22) [ 25 ] presents a novel forging attack , allowing attackers to use a dataset containing unlearned data to train a model that mimics the expected behavior of a model trained using a different dataset excluding those data. Thus, it becomes challenging to determine whether specific data has been unlearned solely by comparing model parameters or predictions. Moreover, the study redefines verifiable unlearning at the algorithmic level rather than the parameter level, emphasizing verifiable computation as a promising solution for ensuring reliable unlearning. Verifiable Computation. Verifiable computation is considered an ideal solution for defending against forging attacks in verifiable unlearning, as it can provably replicate prescribed computations tied to model training on designated datasets. However, it does not inherently prevent such attacks. Particularly, in model training with Minibatch Stochastic Gradient Descent (MSGD) optimization, where model updates are based on randomly selected minibatches from training datasets, a malicious model trainer can strategically select a forging minibatch excluding unlearned data to generate model updates that closely resemble those produced by a target minibatch containing it. As a result, training the model with the forging minibatch is equivalent to training it with the target minibatch, thereby preserving the influence of the unlearned data. Two recent studies [ 26 , 7 ] utilize different verifiable computation approaches, namely, Trusted Execution Environments (TEEs) and Zero-Knowledge Proofs (ZKPs), to achieve verifiable unlearning, respectively. However, neither of them resolves the fundamental issue of resisting forging attacks. 1.2 Research Gaps To date, two significant research gaps remain unaddressed: Forging Attacks. To date, forging attacks remain a significant threat to the reliability of unlearning [ 14 , 22 ] . For MSGD optimization, the core issue lies in the adversary-controlled randomness, which enables manipulation of minibatches to forge model updates that allow the influence of unlearned data to subtly persist in trained models. The challenge intensifies when a gradient replica of the unlearned data, e.g., a duplicate, exists within the training dataset, capable of producing highly similar gradient updates. Privacy-preserving settings further exacerbate the situation because data owners are unaware of the contributions made by others. Even if one owner’s unlearned data is removed, the presence of its gradient replicas within the dataset allows the influence of the unlearned data to persist after unlearning. Multi-Granular Unlearning. Beyond forging attacks, we uncover a new multi-granular unlearning demand. Traditional studies have primarily focused on sample-level unlearning, which involves removing individual data samples’ impact from trained models [ 21 , 3 ] . For example, a data owner may request the unlearning of specific images from its dataset. However, this paradigm is increasingly falling short of meeting evolving demands, driven by the growing need for more granular and flexible control over the unlearning process: • Feature-Level Unlearning. To address access revocation issues, feature-level unlearning has become indispensable. This paradigm allows for the selective removal of specific input features within data samples, ensuring that only targeted aspects of data owners’ information are erased, while preserving the remaining data crucial for training. For example, a data owner may request the unlearning of specific pixels revealing sensitive objects, such as faces, in multiple images while retaining the rest. • Class-Level Unlearning. To tackle model correction challenges, class-level unlearning is essential for

Read the complete text