Contamination Detection for VLMs Using Multi - Modal Semantic Perturbations

Jaden Park, Mu Cai, Feng Yao, Jingbo Shang, Soochahn Lee, Yong Jae Lee · 2025

Read Contamination Detection for VLMs Using Multi - Modal Semantic Perturbations by Jaden Park, Mu Cai, Feng Yao, Jingbo Shang, Soochahn Lee, Yong Jae Lee (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2511-03774.txt.

Introduction

Jaden Park and five colleagues tackle a trust problem for vision-language models: strong benchmark scores may reflect test data leaked into training. Park, Mu Cai, Feng Yao, Jingbo Shang, Soochahn Lee, and Yong Jae Lee study how to detect such contamination in models that handle both images and text.

After deliberately contaminating open models, the team shows older detection methods fail or behave unevenly. Their new test applies controlled meaning-changing perturbations across image and text, and contaminated models fail to generalize under them. The method held up across several realistic contamination strategies. Code and the perturbed dataset were released for others to check and reuse.

Catalog record

CREATORJaden Park, Mu Cai, Feng Yao, Jingbo Shang, Soochahn Lee, Yong Jae Lee
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE55 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2511-03774

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Contamination Detection for VLMs Using Multi - Modal Semantic Perturbations Jaden Park, Mu Cai, Feng Yao, Jingbo Shang, Soochahn Lee, Yong Jae Lee Abstract Recent advances in Vision–Language Models (VLMs) have achieved state-of-the-art performance on numerous benchmark tasks. However, the use of internet-scale, often proprietary, pretraining corpora raises a critical concern for both practitioners and users: inflated performance due to test-set leakage . While prior works have proposed mitigation strategies such as decontamination of pretraining data and benchmark redesign for LLMs, the complementary direction of developing detection methods for contaminated VLMs remains underexplored. To address this gap, we deliberately contaminate open-source VLMs on popular benchmarks and show that existing detection approaches either fail outright or exhibit inconsistent behavior. We then propose a novel simple yet effective detection method based on multi-modal semantic perturbation , demonstrating that contaminated models fail to generalize under controlled perturbations. Finally, we validate our approach across multiple realistic contamination strategies, confirming its robustness and effectiveness. The code and perturbed dataset will be released publicly. Figure 1: Example of our multi-modal semantic perturbation pipeline applied to RealWorldQA benchmark. Using ControlNet trained with Flux models, a new speed limit sign is generated, changing the correct answer from (B) to (C) while preserving the original image’s overall composition. A contaminated model that has memorized the original question is likely to fail on the perturbed version. 1 Introduction Recent advances in Vision-Language Models (VLMs) have resulted in remarkable performance across a wide range of tasks, including visual reasoning ( 31 ; 20 ; 7 ) , real-world understanding ( 28 ) , and complex mathematical problems ( 34 ; 22 ) . A typical VLM training pipeline involves pretraining a vision encoder and language backbone on internet-scale data, followed by a fine-tuning stage on high-quality multimodal instruction-tuning datasets. However, as these training corpora are often proprietary with their exact composition undisclosed, a critical concern has emerged: public benchmark data may have leaked into the training set, leading to inflated and misleading performance metrics. Requirements Reliability Practicality Consistency N-gram Accuracy ( 29 ) ✗ ✗ ✗ Shared Likelihood ( 25 ) ✗ ✗ ✗ Guided Prompting ( 13 ) ✗ ✗ ✗ Multi-modal Leakage ( 7 ) ✗ ✗ \blacktriangle CircularEval ( 20 ) \blacktriangle ✗ ✗ Choice Confusion ( 30 ) ✗ ✓ \blacktriangle BGR Shuffling ( 21 ) ✗ ✗ ✗ Image Masking / Option Shuffling ( 26 ) ✗ ✗ ✗ Multi-modal Semantic Perturbation Ours ✓ ✓ ✓ Table 1: Analysis of existing detection methods on VLMs. We label the detection method with ✓ if it satisfies all of Requirement Requirement 1. , Requirement 2. or Requirement 3. and with ✗ otherwise. \blacktriangle indicates that the requirement is partially observed but not consistently with varying contamination settings. Most existing detection methods fail to meet the requirements and cannot accurately classify contaminated models. Our method, however, satisfies all requirements. Results for N-gram Accuracy, Shared Likelihood and Guided Prompting are in the Appendix B . Test-set leakage presents a practical and significant challenge. For model users, it becomes difficult to disentangle genuine reasoning and generalization from mere memorization. For developers, exhaustively verifying the absence of test examples in massive pretraining corpora is prohibitively expensive ( 3 ) . Although early work on large models proposed decontamination steps by removing n-gram overlaps ( 4 ; 1 ) , many recent models do not report such procedures, leaving the extent of contamination largely unexamined. To address this, several methods have been proposed to detect data contamination. One line of work focuses on verbatim memorization , testing whether a model can reconstruct exact benchmark questions with high confidence ( 29 ; 13 ; 25 ) . Another line of work examines generalization failures , measuring if a model that succeeds on an original question fails on a simpler variant, which is interpreted as an evidence of memorization ( 23 ; 30 ; 15 ) . However, these detection methods were primarily designed for Large Language Models (LLMs) and often overlook the unique, multi-modal nature of VLMs. Applying simple text-based perturbations to a VLM may not be sufficient, as the model could rely on visual features that remain unchanged. This discrepancy exposes a critical gap and raises a key question: Is there a reliable, practical, and consistent method for detecting contamination in VLMs? In this study, we conduct a systematic analysis of the data contamination problem, from which we derive grounded definitions of the core requirements – reliability, practicality, and consistency. Guided by these definitions, we systematically contaminate open-source VLMs under varying fine-tuning epochs, data composition, and training strategies (e.g., standard fine-tuning vs. LoRA ( 14 ) ). Our results show that existing detection methods struggle with the complexities of VLMs, frequently failing to meet the core requirements across diverse contamination scenarios (see Table 1 ). To overcome these limitations, we introduce a novel multi-modal semantic perturbation pipeline. Our method generates new test examples by subtly altering the semantics of the image while preserving its overall composition, thereby creating variants of comparable or lower difficulty (Figure 1 ). The core principle is that contaminated models, which have merely memorized an image-text pair, will fail to generalize to this perturbed input despite the similar or lower difficulty of the questions. In contrast, clean models with genuine reasoning capabilities should perform correctly or even better. This approach enables robust contamination detection without requiring any ground-truth knowledge of the leaked data. Our contributions are threefold: 1. We propose a novel and simple yet effective detection framework based on multi-modal semantic perturbations, which effectively identifies contaminated models by testing for generalization failures in the visual domain. 2. We validate our method across multiple contamination settings, proving that it is reliable, practical, and consistent, satisfying all key requirements for a robust detection method. 3. We conduct the first systematic study of VLM behavior under diverse contamination and detection strategies, demonstrating that existing methods designed for LLMs are often unreliable for detecting contaminated VLMs. 2 Investigation Setup This section establishes the formal framework for our analysis of data contamination. We begin by defining the degree of contamination, state our core assumption about its relationship with model generalization, and finally, outline three essential requirements for a robust detection method. Our analysis is built upon a formal definition of contamination at the data-point level. For a given data point x of a dataset \mathcal{D} and a training process consisting of n epochs, we define: Definition 1. (Degree of Contamination). The degree of contamination for a data point x is: \text{deg}_{\mathcal{D}}(x)=\left(\sum_{d\in\mathcal{D}}\mathbf{1}_{\{x=d\}}\right)\times n. This quantity reflects the total number of times x is seen during training. In our experimental setup, where a model \mathcal{M} is fine-tuned on the entire benchmark dataset \mathcal{D} for n epochs, this simplifies to \text{deg}_{\mathcal{D}}(\mathcal{M})=n . This definition motivates our central assumption, grounded in prior work on model memorization ( 32 ; 6 ; 16 ) : Assumption 1. Data points with a higher degree of contamination are more likely to be memorized, which increases overfitting risk and impairs generalization. In particular, we posit that as the degree of contamination grows, models will exhibit degraded performance on perturbed or out-of-distribution variants of benchmark items, even when the original questions are

Read the complete text