Before Forgetting, Learn to Remember: Revisiting Foundational Learning Failures in LVLM Unlearning Benchmarks
JuneHyoung Kwon, MiHyeon Kim, Eunju Lee, JungMin Yun, Byeonggeuk Lim, YoungBin Kim · 2026
Read Before Forgetting, Learn to Remember: Revisiting Foundational Learning Failures in LVLM Unlearning Benchmarks by JuneHyoung Kwon, MiHyeon Kim, Eunju Lee, JungMin Yun, Byeonggeuk Lim, YoungBin Kim (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-03759.txt.
Introduction
JuneHyoung Kwon and five co-authors examine a flaw in benchmarks for unlearning in large vision-language models, systems that should be able to forget sensitive personal information they memorized. Current benchmarks use fictitious identities, but they skip a basic check: whether the model ever learned the target information well in the first place. Without that, unlearning scores are unreliable.
The authors diagnose under-memorization and a multi-hop curse as root causes. They then introduce ReMem, a benchmark built for reliable multi-hop and multi-image memorization. It uses principled data scaling, reasoning-aware questions, and varied visual contexts. A new Exposure metric measures how deeply information is erased from the model's internal probability distribution. That makes both learning and unlearning evaluations more trustworthy.
Catalog record
| CREATOR | JuneHyoung Kwon, MiHyeon Kim, Eunju Lee, JungMin Yun, Byeonggeuk Lim, YoungBin Kim |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 41 KB |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2605.03759
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Before Forgetting, Learn to Remember: Revisiting Foundational Learning Failures in LVLM Unlearning Benchmarks JuneHyoung Kwon, MiHyeon Kim, Eunju Lee, JungMin Yun, Byeonggeuk Lim, YoungBin Kim Abstract While Large Vision-Language Models (LVLMs) offer powerful capabilities, they pose privacy risks by unintentionally memorizing sensitive personal information. Current unlearning benchmarks attempt to mitigate this using fictitious identities but overlook a critical stage 1 failure : models fail to effectively memorize target information initially, rendering subsequent unlearning evaluations unreliable. Diagnosing under-memorization and the multi-hop curse as root causes, we introduce ReMem, a Reliable Multi-hop and Multi-image Memorization Benchmark . ReMem ensures robust foundational learning through principled data scaling, reasoning-aware QA pairs, and diverse visual contexts. Additionally, we propose a novel Exposure metric to quantify the depth of information erasure from the model’s internal probability distribution. Extensive experiments demonstrate that ReMem provides a rigorous and trustworthy framework for diagnosing both learning and unlearning behaviors in LVLMs. The dataset is publicly available at https://huggingface.co/datasets/herbwood27/Remem . 1 Introduction Figure 1: Stage 1 performance comparison across FIUBench, MLLMU-bench, and ReMem using ROUGE, GPT-score, and EM for evaluation. The radar charts highlight a critical stage 1 failure in existing benchmarks showing under-memorization compared to the 100% target (dashed line), whereas ReMem ensures robust foundational learning. Large Vision-Language Models (LVLMs) have demonstrated remarkable capabilities across a wide range of applications by learning from vast web-scale datasets 23 ; 42 ; 8 . However, this success is accompanied by significant privacy risks 17 ; 12 , as these models can unintentionally memorize and reproduce sensitive information contained within their training data. In response to growing privacy regulations like the Right to be Forgotten 15 ; 3 ; 9 , Machine Unlearning (MU) has emerged as a critical field, offering a promising alternative to the computationally prohibitive process of retraining models from scratch 32 . To evaluate unlearning in a controlled yet rigorous manner, the research community has converged on benchmarks that focus on fictitious identities 27 . This paradigm allows for reproducible experiments without invoking real private data. Recent efforts have extended this approach to the multimodal domain through a common two-stage evaluation process 26 ; 11 ; 25 . First, a model is fine-tuned to memorize specific attributes of fictitious identities (stage 1). Subsequently, unlearning algorithms are applied to make the model forget a designated subset of this information (stage 2). Crucially, the validity of this evaluation rests on the premise that the model has successfully encoded the fictitious data during stage 1. In this work, we challenge this premise and demonstrate that prominent LVLM unlearning benchmarks fail at the foundational level: the effective memorization of personal information during the initial learning stage. To investigate this, we fine-tune a model on the full datasets of existing benchmarks 26 ; 25 and evaluate its performance using three complementary metrics: ROUGE-L for verbatim memorization, LLM-as-a-Judge for approximate memorization of semantically equivalent outputs, and Exact Match (EM) for Personally Identifiable Information (PII) (e.g., the person’s name or job) leakage, which represents the core privacy risk and primary target for subsequent unlearning. As shown in Figure 1 , our analysis reveals that models remain significantly under-memorized across all metrics. Specifically, the exceptionally low EM scores indicate that models fail to learn core PII from the outset, which is the precise information intended for removal. We further substantiate in Section 4 that this failure extends beyond surface-level generation to a fundamental absence of internal knowledge circuits required for genuine memorization. This stage 1 failure fundamentally invalidates the subsequent unlearning evaluation, as it is impossible to reliably assess the erasure of information that was never effectively memorized. We attribute this failure to two primary factors: (i) under-memorization from insufficient data repetition 4 ; 5 , and (ii) multi-hop curse, where models struggle with complex reasoning lacking foundational steps 1 ; 40 . To overcome these limitations, we introduce ReMem, a Reliable Multi-hop and Multi-image Memorization Benchmark , a novel framework designed to establish a valid and robust foundation for LVLM unlearning. ReMem scales the dataset in both quantity and quality, associating each identity with extensive QA pairs that strategically mix single-hop and multi-hop questions. For real-world robustness, we further generate multiple images for each identity with varied visual layouts and create dedicated test sets with novel visual and question formats to evaluate generalization. We also introduce a granular privacy measurement suite with a novel Exposure metric that quantifies erasure depth from the model’s internal probability distribution. Finally, we comprehensively evaluate various unlearning algorithms, offering critical insights into their performance and trade-offs. 2 Preliminary To establish a rigorous basis for analyzing their retrieval mechanisms 28 ; 16 ; 2 , we represent factual knowledge regarding fictitious identities as a tuple t=(v,s,r,a) . Here, v denotes the image, s the subject entity (i.e., the name determining the identity), r the relation indicating the category of personal information (e.g., address), and a the target attribute value representing the actual sensitive data (e.g., “123 Maple St”). Based on this formulation, we categorize queries into two types determined by the explicit presence of the subject s . Single-hop QA explicitly provides the subject identity within the prompt, formulated as (v,s,r)\rightarrow a (e.g., “Given that this is Anika Sharma-Nguyen, what is their address?”), evaluating explicit parametric retrieval. Conversely, Multi-hop QA queries the relation without naming the subject, formulated as (v,r)\rightarrow a (e.g., “What is the address of the person in this image?”). This setting necessitates a sequential reasoning process: visual entity grounding ( v\rightarrow s ) followed by attribute retrieval ( s\rightarrow a ). 3 Related Work Benchmark Images /ID QA /ID Test Set Single-hop QA Multi-hop QA FIUBench 1 20 ✗ ✗ ✓ MLLMU-bench 1 1 ✗ ✗ ✓ CLEAR 20 20 ✗ ✗ ✓ ReMem (Ours) 100 100 ✓ ✓ ✓ Table 1: Comparison between existing LVLM unlearning benchmarks and our proposed ReMem. Images/ID and QA/ID denote the number of images and question-answer pairs assigned to each identity, respectively. Figure 2: Internal state analysis. Left: Scatter plot of Min-k% probability versus Inverse Perplexity ( 1/\text{PPL} ) comparing the Real Set with fictitious benchmarks. Middle & Right: Causal tracing heatmaps visualizing internal hidden state activations for a FIUBench sample (Middle) and a Real Set sample (Right). MU aims to efficiently remove the influence of specific data from a trained model, offering a practical alternative to costly retraining 36 ; 32 . A direct approach degrades performance on the forget set by maximizing its loss function through methods like gradient ascent 36 . To preserve the overall model utility, this is often combined with a standard training objective on a retained set 22 . Distillation-based methods train the model to diverge from the forget set while maintaining alignment with a reference model on retained data 46 ; 20 ; 7 ; 18 . More recently, alignment techniques have been adapted for unlearning by training models to prefer refusal responses 31 or directly minimize the generation probability of forgotten content 44 . With the rise of LVLMs and their associated privacy concerns, benchmarks have emerged to evaluate these unlearning algorithms in the multimodal domain. FIUBench targets fictitious facial identities with privacy attack evaluations 26 . MLLMU-Bench offers distinct sets to assess unlearning efficacy,