MVTamperBench: Evaluating Robustness of Vision-Language Models

Amit Agarwal, Srikant Panda, Angeline Charles, Hitesh Laxmichand Patel, Bhargava Kumar, Priyaranjan Pattnayak, Taki Hasan Rafi, Tejaswini Kumar, Hansa Meghwani, Karan Gupta, Dong-Kyu Chae, * Equal Contribution Corresponding Authors Correspondence: [email protected], [email protected] · 2024

Read MVTamperBench: Evaluating Robustness of Vision-Language Models by Amit Agarwal, Srikant Panda, Angeline Charles, Hitesh Laxmichand Patel, Bhargava Kumar, Priyaranjan Pattnayak, Taki Hasan Rafi, Tejaswini Kumar, Hansa Meghwani, Karan Gupta, Dong-Kyu Chae, * Equal Contribution Corresponding Authors Correspondence: [email protected], [email protected] (2024) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2412-19794.txt.

Introduction

Amit Agarwal and co-authors build a test for video AI that has been tampered with in a 2024 paper. Models that watch and describe video now drive many tools. Their weakness against edited or faked clips was little measured.

Their bench, MVTamperBench, starts from about three thousand four hundred real videos. Five tamper tricks — rotation, masking, swaps, repeats, and drops — swell that to over seventeen thousand clips. Nineteen tasks probe space and time coherence. Forty-five models from over fifteen families were graded. Resilience varied widely by trick type, and bigger models were not always tougher. All code and data are public, aimed at safer media tools.

Catalog record

CREATORAmit Agarwal, Srikant Panda, Angeline Charles, Hitesh Laxmichand Patel, Bhargava Kumar, Priyaranjan Pattnayak, Taki Hasan Rafi, Tejaswini Kumar, Hansa Meghwani, Karan Gupta, Dong-Kyu Chae, * Equal Contribution Corresponding Authors Correspondence: [email protected], [email protected]
YEAR2024
COLLECTIONPAPERS
FORMATTXT
FILE SIZE64 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2412-19794

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

MVTamperBench: Evaluating Robustness of Vision-Language Models Amit Agarwal, Srikant Panda, Angeline Charles, Hitesh Laxmichand Patel, Bhargava Kumar, Priyaranjan Pattnayak, Taki Hasan Rafi, Tejaswini Kumar, Hansa Meghwani, Karan Gupta, Dong-Kyu Chae, * Equal Contribution Corresponding Authors Correspondence: [email protected], [email protected] Abstract Multimodal Large Language Models (MLLMs), are recent advancement of Vision-Language Models (VLMs) that have driven major advances in video understanding. However, their vulnerability to adversarial tampering and manipulations remains underexplored. To address this gap, we introduce MVTamperBench , a benchmark that systematically evaluates MLLM robustness against five prevalent tampering techniques: rotation, masking, substitution, repetition, and dropping; based on real-world visual tampering scenarios such as surveillance interference, social media content edits, and misinformation injection. MVTamperBench comprises 3.4K original videos, expanded into over 17K tampered clips covering 19 distinct video manipulation tasks. This benchmark challenges models to detect manipulations in spatial and temporal coherence. We evaluate 45 recent MLLMs from 15+ model families. We reveal substantial variability in resilience across tampering types and show that larger parameter counts do not necessarily guarantee robustness. MVTamperBench sets a new benchmark for developing tamper-resilient MLLM in safety-critical applications, including detecting clickbait, preventing harmful content distribution, and enforcing policies on media platforms. We release all code, data, and benchmark to foster open research in trustworthy video understanding. 1 Introduction Multimodal Large Language Models (MLLMs) have catalyzed significant progress in video understanding, enabling a wide array of applications across domains such as surveillance, healthcare, and autonomous systems. However, their growing integration into high-traffic platforms (e.g., Instagram, Facebook, TikTok) has exposed critical vulnerabilities. Specifically, tampered videos are increasingly exploited to bypass platform policies, disseminate harmful content, and promote clickbait, posing serious challenges for content moderation and policy enforcement Kingra et al. (2023) ; Times of India (2024) . These threats underscore the urgent need to improve the robustness of MLLMs against real-world manipulations. Although video tampering can involve audio modifications, synthetic speech overlays, or deepfake generation, our benchmark focuses exclusively on visual-only manipulations. This choice is driven by the current limitations of existing models, most of which currently lack comprehensive audiovisual processing capabilities. Unlike adversarial robustness in static images, an area that has been extensively studied, video tampering introduces unique challenges that arise from the interplay of spatial and temporal dynamics. Common manipulation techniques such as frame dropping, masking, repetition, substitution, and rotation disrupt this coherence, frequently resulting in catastrophic model failures. These methods mirror real-world adversarial tactics: substitution injects objectionable material (e.g., nudity, violence) to circumvent detection; dropping eliminates key surveillance evidence; repetition loops footage to obscure illicit activity; masking occludes critical regions; and rotation induces spatial distortions commonly seen in edited or re-uploaded content. Existing adversarial and traditional approaches, including black-box Jiang et al. (2019) and cross-modal Wei et al. (2021) attacks, primarily address isolated scenarios rather than systematically evaluating diverse tampering types. Furthermore, existing multimodal benchmarks Pattnayak et al. (2024) ; Agarwal (2021) —such as MMBench-Video Fang et al. (2024) , BLINK Fu et al. (2025) , and Video-MME Fu et al. (2024) —focus on multimodal comprehension and temporal reasoning but overlook adversarial robustness. For example, MMBench-Video evaluates cross-modal alignment without adversarial testing; BLINK targets long-form temporal reasoning without addressing tampering impacts; and Video-MME, while effective for vision-language alignment, omits tampering-specific tasks. This leaves a critical gap in systematically assessing how MLLMs withstand real-world manipulations. To bridge this gap, we introduce MVTamperBench , a benchmark specifically designed to evaluate MLLM robustness against five prevalent tampering techniques. Built from 3.4K original videos—expanded into over 17K tampered clips spanning 19 video tasks—MVTamperBench challenges models to detect manipulations by disrupting temporal and spatial coherence in a video. By focusing on tampering resilience, we believe that MVTamperBench provides a critical tool for improving MLLM robustness, and eventually, it enables the development of tamper-resilient models applicable to real-world challenges such as clickbait detection, content moderation, and policy enforcement, advancing adversarial robustness in video understanding for high-stakes domains. Our main contributions are as follows: • We introduce MVTamperBench , a benchmark that systematically evaluates MLLMs on five major video manipulations, focusing on spatial and temporal coherence to stimulate real-world scenarios. • We propose a unified evaluation methodology that frames tampering detection as a multiple-choice task, enabling straightforward, interpretable and consistent performance comparisons. • Through experiments on 45 MLLMs across 15+ families, we identify critical vulnerabilities across MLLM families. across MLLM families, without any correlation between model size and performance. • Our released code enables researchers to integrate additional datasets and adapt or add new tampering, facilitating domain-specific extensions, and supports reproducibility. 2 Related Work The development of benchmarks for MLLMs has significantly advanced the evaluation of image and video understanding tasks. They have covered spatial reasoning, temporal comprehension, object detection, common sense inference, and so on. However, the robustness of MLLMs to adversarial manipulations, particularly video tampering, remains underexplored. This section reviews existing benchmarks, which can be categorized into image-based and video-based evaluations, and analyzes their contributions and shared limitations. 2.1 Image-based Understanding Benchmarks like BLINK Fu et al. (2025) and MuirBench Wang et al. (2024a) focus on evaluating static visual reasoning. BLINK tests foundational tasks such as depth estimation, forensic detection, and visual correspondence, which cover a diverse set of challenges for spatial reasoning. Similarly, MuirBench extends this evaluation to multi-image tasks, including action recognition and geographic reasoning, by synthesizing information from diverse sources. While these benchmarks have advanced static image understanding, their reliance on single or multiple still images excludes temporal dynamics and limits their applicability to scenarios involving sequential manipulations, such as those found in video content. 2.2 Video-based Understanding Video-based benchmarks have expanded the scope of evaluation by incorporating temporal and multimodal reasoning. MVBench Li et al. (2024e) , MMBench-Video Fang et al. (2024) , and Video-MME Fu et al. (2024) focus on tasks such as event detection, episodic reasoning, and contextual understanding. These benchmarks challenge models with diverse tasks spanning object interactions, long-duration video analysis, and domain-specific reasoning. Similarly, LongVU Shen et al. (2024) introduces spatio-temporal compression techniques to enhance efficiency, while MotionEpic Fei et al. (2024a) integrates Spatial-Temporal Scene Graphs (STSG) for fine-grained cognitive tasks. However, while these benchmarks assess temporal coherence and reasoning, they do not systematically address adversarial robustness, particularly in tampering scenarios. Figure 1: Illustration of the five video frame tampering techniques. Each row shows a specific tamper type applied to a video snippet, describing the respective impact on temporal/spatial coherence. Other benchmarks, such as Wolf Li et al. (2024a) and Sharingan Chen et al. (2024a) , target specialized video understanding tasks. Wolf focuses on captioning using a mixture-of-experts strategy, while Sharingan extracts action sequences from desktop recordings using frame-differential approaches. Although these benchmarks achieve high accuracy in their domains, they are limited to specific tasks and lack general mechanisms to evaluate the resilience to tampering. In summary, despite their contributions to advancing MLLM evaluation, existing benchmarks largely focus on performance under ideal conditions and neglect robustness to tampering or adversarial effects. Techniques such as frame substitution, masking, repetition, dropping, and rotation disrupt temporal coherence and pose unique challenges for multimodal models. The absence of systematic evaluations of these tampering techniques highlights a critical gap in ensuring model reliability for real-world applications like forensic analysis, media verification, and misinformation detection. 3 MVTamperBench We

Read the complete text