De-attribute to Forget for LLM Unlearning

Xinyang Lu, Jiabao Pan, Rachael Hwee Ling Sim, See-Kiong Ng, Anthony Kum Hoe Tung, Bryan Kian Hsiang Low · 2026

Read De-attribute to Forget for LLM Unlearning by Xinyang Lu, Jiabao Pan, Rachael Hwee Ling Sim, See-Kiong Ng, Anthony Kum Hoe Tung, Bryan Kian Hsiang Low (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-30919.txt.

Introduction

Lu and colleagues reframe language-model unlearning as removing data credit rather than tuning loss functions. Standard methods that raise loss on forgotten data often over-forget and damage model utility. Their DareU framework uses reinforcement learning to lower the credit score of responses to the owners of those data, thus de-attributing those data. Tests using a language-model judge as a credit proxy show DareU beats existing baselines, achieving effective forgetting while balancing forget quality and model utility well.

Catalog record

CREATORXinyang Lu, Jiabao Pan, Rachael Hwee Ling Sim, See-Kiong Ng, Anthony Kum Hoe Tung, Bryan Kian Hsiang Low
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE94337
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2605.30919

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

De-attribute to Forget for LLM Unlearning Xinyang Lu, Jiabao Pan, Rachael Hwee Ling Sim, See-Kiong Ng, Anthony Kum Hoe Tung, Bryan Kian Hsiang Low Abstract The rapid development of large language models (LLMs) has raised concerns on the use of inappropriate data for training, which has led to a growing interest in LLM unlearning. Many existing LLM unlearning approaches rely on optimizing prediction loss(es), such as maximizing the loss on the forget set, but often face critical issues like over-forgetting and poor model utility. To address them, this paper novelly frames the optimization objective for LLM unlearning as one of zeroing out data attribution instead. In particular, we propose the first LLM unlearning framework based on data attribution rewards called DareU that performs reinforcement learning to update the LLM by reducing the attribution score of its generated responses (i.e., de-attributing) to the forget data owners. Empirical evaluation using an LLM classifier as an efficient approximation of attribution shows that DareU outperforms existing baselines by achieving effective unlearning while balancing forget quality and model utility well. † † affiliationnotice: Equal contribution 1 Introduction Large language models (LLMs) have been widely deployed in real-world applications in recent years. However, training these LLMs requires collecting massive amounts of training data, which has raised growing concerns about data issues such as intellectual property infringement ( 47 ) and inappropriate content that is copyrighted, private, harmful, or outdated ( 25 ; 28 ) . In addition, there have been increasing regulations on data protection in LLMs, such as the General Data Protection Regulation ( 5 ) and California Consumer Privacy Act ( 3 ) , enforcing the “right to be forgotten” that allow data owners to request their data and its influence to be removed from the trained LLMs. As retraining an LLM from scratch can be impractical due to the massive training data and LLM sizes (e.g., training GPT-4 costs > \$100 million ( 1 ) ), studies on machine unlearning aim to provide an efficient alternative to approximate retraining and remove the influence of these inappropriate data (called the forget set ) from the trained LLMs. Since LLM unlearning aims to “revert” part of the LLM training process, many existing LLM unlearning research focuses on prediction loss-based optimization approaches to maximize the prediction loss on the forget set following a Gradient Ascent (GA) procedure ( 45 ; 48 ; 19 ) . However, Section 3 discusses that these objectives might favor incoherent and gibberish generations, and the target loss value from perfect unlearning (e.g., retraining) can vary across individual data samples and should not be maximized. Therefore, naively maximizing the loss or minimizing the log likelihood on the forget set may result in over-forgetting , where the LLM performance on the retain set significantly degrades after unlearning. These limitations hence motivate a central question: Is there a better, more precise optimization objective for LLM unlearning? To address this question, we draw inspiration from LLM Data Attribution , which aims to identify whether a specific training subset (or its corresponding data owner) influences an LLM-generated response. Formally, attribution functions assign a normalized score \in[0,1] to a data owner, representing the extent/likelihood that its dataset influences the generation. We note that the objective of data attribution aligns naturally with the goal of machine unlearning: if a data owner’s dataset is truly unlearned, it should be de-attributed and should not be identifiable as a contributing source, hence resulting in a near- 0 attribution score. In fact, the connection between data attribution and LLM unlearning is also supported by recent work from 21 , which utilizes text watermarking as a data attribution technique to build an effective evaluation metric for LLM unlearning. Consequently, data attribution offers an alternative optimization perspective: LLM unlearning can be framed as de-attributing (reducing and zeroing out the attributability) of the LLM-generated responses to the forget data owners. In Section 4.1 , we show that this formulation brings several important benefits: (a) it provides a precise objective that does not favor a collapsed unlearned LLM that generates gibberish, and (b) it offers a consistent optimization target value for all forget set samples since the desired attribution score for perfect unlearning is 0 . Figure 1 : An overview of DareU that uses proximal policy optimization (PPO), a reinforcement learning method, to de-attribute LLM-generated responses to forget owners for LLM unlearning. In this paper, we propose D ata A ttribution-based RE inforcement Learning for U nlearning ( DareU ), the first LLM unlearning framework ( Figure 1 ), to our knowledge, that leverages data de-attribution as the optimization objective. Since attribution functions provide scalar feedback signals on LLM-generated responses, they naturally serve as reward models in reinforcement learning (RL). Consequently, we adopt RL algorithms to align the LLM-generated responses and minimize the attributability to the forget set. Specifically, DareU employs Proximal Policy Optimization (PPO), where the transformed attribution score of the LLM generations serves as the reward signal, and the objective is to optimize the LLM to generate responses with zero or low attribution scores to the forget set ( Section 4.2 ). We empirically demonstrate in Section 5 that our DareU can perform effective unlearning by achieving a better balance between forget quality and model utility (i.e., LLM performance on the retain set), outperforming existing LLM unlearning baselines even when utilizing a lightweight classifier as a computationally efficient approximation for attribution to predict the owner based on an LLM-generated response. To summarize, our key contributions in this work are: 1. We introduce a novel and more precise data de-attribution objective for LLM unlearning; 2. We propose a new LLM unlearning framework DareU that adopts PPO with attribution scores as the reward signals to de-attribute LLM-generated responses to the forget set while preserving model utility. 3. We empirically validate the effectiveness of DareU and demonstrate that DareU outperforms existing LLM unlearning baselines by achieving a better balance in forget quality and model utility. 2 Related Works 2.1 Reinforcement Learning for LLMs Reinforcement Learning (RL) has emerged as an important LLM post-training technique, and is effective for aligning LLM-generated responses ( 35 ; 26 ) . RL for LLMs can be categorized into reward-based and reward-free methods. Reward-based methods construct an explicit reward model/function to assign rewards for each query and response and employ algorithms like PPO in ( 35 ; 26 ) and GRPO in ( 32 ) to optimize the reward. Recently, reward-free methods such as Direct Preference Optimization (DPO) ( 29 ) and SIMPO ( 24 ) have emerged, avoiding the direct reliance on an explicit reward model by establishing a mapping between the optimal reward model and the optimal policy. However, reward-free methods usually require collecting an external preference dataset. In LLM unlearning, constructing such a dataset can be non-trivial, especially for certain tasks like text completion (e.g., the ArXiv dataset in Section 5 ), where the true unlearned response is unclear. Recent studies have also shown that PPO surpasses DPO in terms of alignment performance ( 43 ) . In this work, since attribution functions naturally serve as explicit reward models, we employ PPO as a reward-based RL method for aligning LLMs. We discuss the use of RL for LLM

Read the complete text