Wisdom is Knowing What not to Say: Hallucination-Free LLMs Unlearning via Attention Shifting
Chenchen Tan , Youyang Qu , Xinghao Li , Hui Zhang , Shujie Cui , Cunjian Chen , Longxiang Gao Faculty of Information Technology, Monash University, Australia Key Laboratory of Computing Power Network and Information Security, Ministry of Education, Shandong Computer Science Center, Qilu University · 2025
Read Wisdom is Knowing What not to Say: Hallucination-Free LLMs Unlearning via Attention Shifting by Chenchen Tan , Youyang Qu , Xinghao Li , Hui Zhang , Shujie Cui , Cunjian Chen , Longxiang Gao Faculty of Information Technology, Monash University, Australia Key Laboratory of Computing Power Network and Information Security, Ministry of Education, Shandong Computer Science Center, Qilu University (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2510-17210.txt.
Introduction
Chenchen Tan and six co-authors erase set facts from chat models without fake replies in this 2025 paper. Erasing facts can harm a model's skill, or leave gaps it fills with lies. Both flaws hurt trust in fact-heavy work. The team shifts model focus rather than just muting weights.
Their method damps focus on fact-bearing words in the erase set. It boosts focus on core words in the keep set at the same time. A dual loss draws a soft wall between erased and kept facts. Tests beat top rivals at keeping skill while facts stay gone. Gains reached about fifteen percent on one shared test set.
Catalog record
| CREATOR | Chenchen Tan , Youyang Qu , Xinghao Li , Hui Zhang , Shujie Cui , Cunjian Chen , Longxiang Gao Faculty of Information Technology, Monash University, Australia Key Laboratory of Computing Power Network and Information Security, Ministry of Education, Shandong Computer Science Center, Qilu University |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 63 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2510-17210
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Wisdom is Knowing What not to Say: Hallucination-Free LLMs Unlearning via Attention Shifting Chenchen Tan , Youyang Qu , Xinghao Li , Hui Zhang , Shujie Cui , Cunjian Chen , Longxiang Gao Faculty of Information Technology, Monash University, Australia Key Laboratory of Computing Power Network and Information Security, Ministry of Education, Shandong Computer Science Center, Qilu University of Technology (Shandong Academy of Sciences), Jinan, China Shandong Provincial Key Laboratory of Computing Power Internet and Service Computing, Shandong Fundamental Research Center for Computer Science, Jinan, China School of Computer Science and Technology, Anhui University, Hefei, China <[email protected]> , <[email protected]> Abstract The increase in computing power and the necessity of AI-assisted decision-making boost the growing application of Large Language Models (LLMs). Along with this, the potential retention of sensitive data of LLMs has spurred increasing research into machine unlearning. However, existing unlearning approaches face a critical dilemma: Aggressive unlearning compromises model utility, while conservative strategies preserve utility but risk hallucinated responses. This significantly limits LLMs’ reliability in knowledge-intensive applications. To address this, we introduce a novel A ttention- S hifting ( AS ) framework for selective unlearning. AS is driven by two design objectives: (1) context-preserving suppression that attenuates attention to fact-bearing tokens without disrupting LLMs’ linguistic structure; and (2) hallucination-resistant response shaping that discourages fabricated completions when queried about unlearning content. AS realizes these objectives through two attention-level interventions, which are importance-aware suppression applied to the unlearning set to reduce reliance on memorized knowledge and attention-guided retention enhancement that reinforces attention toward semantically essential tokens in the retained dataset to mitigate unintended degradation. These two components are jointly optimized via a dual-loss objective, which forms a soft boundary that localizes unlearning while preserving unrelated knowledge under representation superposition. Experimental results show that AS improves performance preservation over the state-of-the-art unlearning methods, achieving up to 15% higher accuracy on the ToFU benchmark 1 1 1 https://locuslab.github.io/tofu/ and 10% on the TDEC benchmark 2 2 2 https://github.com/google-research/lm-extraction-benchmark , while maintaining competitive hallucination-free unlearning effectiveness. Compared to existing methods, AS demonstrates a superior balance between unlearning effectiveness, generalization, and response reliability. 1 Introduction Large Language Models (LLMs) have recently achieved substantial advancements in natural language understanding and generation li2024snapkv . However, despite their achievements, a growing concern is the potential for LLMs to memorize and subsequently reproduce sensitive data, resulting in serious privacy concerns carlini2021extracting ; wei2024jailbroken . Moreover, regulatory frameworks such as the General Data Protection Regulation (GDPR) grant the “Right to be Forgotten” to the data owner, which mandates that users can request to remove their data from digital systems, including machine learning models voigt2017eu . Under these circumstances, machine unlearning has emerged as a critical approach for preserving data privacy in LLMs jang-etal-2023-knowledge ; chen2023unlearn ; liu2025rethinking ; liu2024large ; shi2024ulmr ; wang2025llm . These privacy-preserving unlearning tasks can be broadly categorised as either aggressive or conservative. Aggressive approaches, such as Gradient Ascent (GA) jang-etal-2023-knowledge , modify the LLMs’ learning objective to erase target knowledge forcibly. This often leads to a degradation in overall model performance, particularly on neighbouring knowledge, which is data with a similar structure or semantic relation to the unlearning target. Others adopt conservative unlearning strategies like the logits manipulation cha2025towards ; ji2024reversing ; huang2024offset to maintain model performance but risk introducing factual hallucinations, where the model confidently generates content detached from underlying facts. These hallucinations pose a serious threat in downstream tasks like question-answering systems, especially in applications such as healthcare or legal scenarios, where precise and reliable outputs are critical huang2025survey ; hao2024quantifying . Achieving effective unlearning in privacy-sensitive LLM applications is challenging due to the conflicting interests and objectives of different stakeholders. On one hand, data providers whose information has been used in LLMs aim to entirely prevent reproducing their data in LLMs’ answer rashid2025forget ; tian2024forget . On the other hand, model deployers try to preserve the model’s general capabilities across broad knowledge domains and to maintain the service quality ji2024reversing ; yuan2025closerlookmachineunlearning . We define this as a multi-stakeholder balanced unlearning setting, where the unlearning strategies should achieve two primary objectives: 1) to enable the LLM to “unlearn” the target data while ensuring the LLM maintains performance both on neighbouring knowledge yuan2025closerlookmachineunlearning and general knowledge; and 2) to prevent the hallucination outputs for the unlearned knowledge. Figure 1 : LLMs tend to assign high attention to semantically important tokens, like “father” and “hairdresser”, when recalling memorized facts. Our method applies supervised attention suppression to downweight fact-bearing tokens and reallocate focus to neutral tokens. This redistribution reduces reliance on target knowledge while maintaining generation fluency, thereby facilitating precise and fluent unlearning. To achieve these goals, we propose a novel Attention-Shifting (AS) unlearning. It is a controlled form of an aggressive method that performs both context-preserving unlearning and hallucination-resistant generation. AS suppresses attention to fact-bearing tokens in the unlearning set while reinforcing attention to semantically important tokens in retained data. This mechanism reduces reliance on target knowledge without compromising fluency or coherence, thereby preserving the contextual integrity of general and neighbouring knowledge. Unlike prior methods cha2025towards ; yuan2025closerlookmachineunlearning that manipulate logits or replace outputs, AS reallocates attention internally, blocking the flow of memorized knowledge during generation (Fig. 1 ). This enables the model to forget through omission rather than substitution, reducing hallucinations by structurally eliminating access to unlearned content. AS derives suppression and reinforcement signals from reference attention maps of the original model, and injects them via lightweight (~12M) adapters in attention modules. A dual-loss objective jointly optimizes unlearning and retention, forming a soft boundary that localizes suppression while stabilizing unrelated knowledge. While neurons in LLMs are known to exhibit representation superposition, shared activations across multiple concepts, our design remains robust under such entanglement, achieving behavioral unlearning without requiring explicit disentanglement elhage2022toy ; hong2025rise . Experiments on the ToFU maini2024tofu and TDEC jang-etal-2023-knowledge benchmarks demonstrate that AS achieves near-zero knowledge leakage while preserving strong performance, with up to 15% and 10% higher accuracy than state-of-the-art baselines, respectively. In contrast to methods such as ULD ji2024reversing and IHL cha2025towards , which suppress target tokens but may still generate misleading completions, AS structurally blocks access to forgotten knowledge and promotes refusal behaviors, thereby effectively minimizing hallucinations. 2 Related Works In this section, we introduce the existing unlearning methods, followed by summarizing the challenges in LLMs unlearning and identifying the gaps in existing methods. We categorize the existing unlearning methods into aggressive unlearning and conservative unlearning, depending on how directly they modify the model’s internal representations yuan2025closerlookmachineunlearning . Aggressive Unlearning removes specific knowledge by actively disrupting its learned representations in the model. This type of approach significantly alters decision boundaries, leading to broader unintended shifts in model behaviour. One example is the GA jang-etal-2023-knowledge approach. It forces the model to learn an inverted objective of the target knowledge to achieve unlearning, which aggressively reverses the influence of target data, pushing the model away from target knowledge uncontrollably and raising catastrophic collapse. To address this limitation, Negative Preference Optimization (NPO) ( zhang2024negative ) was proposed as a more stable and controlled extension of GA. NPO adopts a preference-based loss function, which smooths the optimization process and prevents extreme parameter updates. Several variants wang2025llm ; yao2024large ; wang2025selective ;