Watch, Listen, Understand, Mislead: Tri-modal Adversarial Attacks on Short Videos for Content Appropriateness Evaluation

Sahid Hossain Mustakim, S M Jishanul Islam, Ummay Maria Muna, Montasir Chowdhury, Mohammad Jawwadul Islam, Sadia Ahmmed, Tashfia Sikder, Syed Tasdid Azam Dhrubo, Swakkhar Shatabda · 2025

Read Watch, Listen, Understand, Mislead: Tri-modal Adversarial Attacks on Short Videos for Content Appropriateness Evaluation by Sahid Hossain Mustakim, S M Jishanul Islam, Ummay Maria Muna, Montasir Chowdhury, Mohammad Jawwadul Islam, Sadia Ahmmed, Tashfia Sikder, Syed Tasdid Azam Dhrubo, Swakkhar Shatabda (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2507-11968.txt.

Introduction

Sahid Hossain Mustakim and co-authors test, in 2025, whether multimodal models can be fooled into misjudging short videos. Such models are used to check if content is appropriate, but safety tests usually attack one channel at a time. The team built a dataset of short videos carrying guided attacks across sight, sound, and meaning at once.

Their attack method strikes all three channels together and achieved high success rates against leading models. Failures showed biases in both directions, with safe and unsafe content each misread. A model-based judge was used to assess the attack reasoning. The dataset and findings aim to harden future content checkers.

Catalog record

CREATORSahid Hossain Mustakim, S M Jishanul Islam, Ummay Maria Muna, Montasir Chowdhury, Mohammad Jawwadul Islam, Sadia Ahmmed, Tashfia Sikder, Syed Tasdid Azam Dhrubo, Swakkhar Shatabda
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE34 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2507-11968

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Watch, Listen, Understand, Mislead: Tri-modal Adversarial Attacks on Short Videos for Content Appropriateness Evaluation Sahid Hossain Mustakim, S M Jishanul Islam, Ummay Maria Muna, Montasir Chowdhury, Mohammad Jawwadul Islam, Sadia Ahmmed, Tashfia Sikder, Syed Tasdid Azam Dhrubo, Swakkhar Shatabda Abstract Multimodal Large Language Models (MLLMs) are increasingly used for content moderation, yet their robustness in short-form video contexts remains underexplored. Current safety evaluations often rely on unimodal attacks, failing to address combined attack vulnerabilities. In this paper, we introduce a comprehensive framework for evaluating the tri-modal safety of MLLMs. First, we present the Short-Video Multimodal Adversarial (SVMA) dataset, comprising diverse short-form videos with human-guided synthetic adversarial attacks. Second, we propose ChimeraBreak, a novel tri-modal attack strategy that simultaneously challenges visual, auditory, and semantic reasoning pathways. Extensive experiments on state-of-the-art MLLMs reveal significant vulnerabilities with high Attack Success Rates (ASR). Our findings uncover distinct failure modes, showing model biases toward misclassifying benign or policy-violating content. We assess results using LLM-as-a-judge, demonstrating attack reasoning efficacy. Our dataset and findings provide crucial insights for developing more robust and safe MLLMs. Warning: This paper contains content that may be offensive to readers. Figure 1 : Graphical abstract illustrating the overall pipeline. † † footnotetext: ∗ Equal Contributions 1 Introduction The explosive growth of internet connectivity has transformed how we express, consume, and evaluate media. Short-form videos (SVs), more popularly known as “reels” or “shorts”, provide entertainment through multiple blends of visual scenes, spoken language, ambient sound, and textual overlays into highly compressed formats. Despite strict moderation policies, harmful content often bypasses platform rules by being associated with innocuous captions such as “Top 10 facts about BMW…” , while positive, awareness-driven videos may be flagged due to sensitive keywords. These challenges highlight the need for advanced multimodal understanding. Multimodal Large Language Models (MLLMs) offer promise in addressing these challenges, enabling holistic content understanding across modalities [ 16 , 2 , 39 , 27 ] . Yet this modality integration makes them more susceptible to cross-modal bypass. Recent studies show that MLLMs can be misled by subtle manipulations in images [ 40 , 11 , 32 ] , video [ 15 , 23 ] , audio [ 6 ] , and text [ 29 ] , especially when multiple inputs are coordinated, such as including peaceful background music while inappropriate content is displayed. These works overlook the fundamental aspect of machine and human perception: we do not process what we see, hear, or read in isolation. Instead, we integrate cues across modalities to form a unified understanding of our environment. Because of this, small chosen changes across all modalities can lead to unexpected effects. In this paper, we explore methods in which policy-violating short-form content bypasses MLLMs to improve the regulation of content appropriateness. First, we present the Short-Video Multimodal Adversarial (SVMA) dataset, containing a rich collection of offensive and positive short-form videos and their human + synthetic adversarial attacks. This is the first multimodal adversarial dataset for short-form video content moderation. Second, to rigorously test the resistance of MLLMs in evaluating content appropriateness, we introduce ChimeraBreak . This novel coordinated tri-attack strategy attacks and questions the model’s ability to see (video), listen (audio), and understand (perceptual reasoning). We perform it in two steps: we attack the model’s ability to see, hear, and understand, and extract the reasoning of how it perceives the content. Next, we use that reasoning to derive a binary appropriateness label. We perform rigorous experiments using adversarial success rate (ASR) as our primary evaluation metric and show that our methods achieve 90%+ ASR on most state-of-the-art models. The entire methodology is shown in Figure 1 . In summary, our key contributions are as follows: • We create a novel dataset containing harmful and non-harmful short-video content and their adversarial attacks. • We introduce a novel tri-attack strategy that challenges the model’s understanding of the video, audio, and the overall content. • Experimental results demonstrate the effectiveness of our attacks on most state-of-the-art open and closed-sourced models such as GPT-4o mini, LLaMA 4, and so on. The code and datasets are publicly available at https://github.com/sahidmustakim/ChimeraBreak . We conduct this research following responsible disclosure practices, with the constructive goal of strengthening AI safety rather than enabling misuse. Our findings reveal a fundamental weakness in current vision-language alignment and set a new benchmark for multimodal safety evaluation. 2 Related Work Systematic Evaluation of Novel Multimodal Attack Surfaces. A foundational aspect of evaluating the safety of Multimodal Large Language Models (MLLMs) is the development of comprehensive benchmarks. RTVLM is one of the first large-scale datasets with comprehensive benchmarking explicitly designed for red teaming Vision-Language Models (VLMs) that includes both image-text and video-text pairs across an exhaustive taxonomy of potential harms [ 24 ] . In the video domain, the VIDEOJAIL demonstrated that safety vulnerabilities are not confined to static images; rather, by distributing malicious content temporally across video frames, attackers can effectively bypass safety mechanisms of the state-of-the-art VLMs like Gemini and LLaVA [ 15 ] . The audio modality has also emerged as a significant and underexplored vulnerability. The first systematic study on the security of audio-input LMMs showed that malicious audio can achieve higher jailbreak success rates than either text or image inputs alone, proving effective against robust models like GPT-4o [ 41 ] . Figure 2 : Warning. Sensitive words. An example of inappropriate and appropriate short-video contents from the SVMA dataset Adversarial Attacks for Manipulating Visual Modality. Most recent work has focused on the visual domain and revealed numerous attack strategies through investigations. Classic adversarial perturbations , including imperceptible pixel changes, have been shown to force models to output malicious captions [ 36 ] . This approach was later refined by using scenario-matched images in a multi-image collaborative attack [ 12 ] . FigStep , a more recent and potent strategy, involves a semantic obfuscation and distraction strategy that shows that a straightforward insertion of prohibited content into an image using typography can bypass textual safety filters [ 10 ] . Self-generated typographic attack was experimented further, outperforming the previous typographic attacks on VLMs [ 35 ] . HADES exploits the vulnerability by hiding the harmfulness of malicious text prompts within meticulously crafted images to bypass safety alignment mechanisms [ 25 ] . Modern MLLMs are trained on diverse “in-distribution” harmful inputs to make the models recognize and refuse them. Building on that concept, another study explored an “out-of-distribution” version of a standard harmful input by combining harmful and benign input, which effectively breaks safety alignment principles of the SOTA models [ 17 ] . Similarly, universal adversarial suffix , generated using Greedy Coordinate Gradient (GCG), were integrated into harmful user prompts that can systematically bypass safety protocols in several LLMs [ 45 ] . Moreover, overwhelming the model was pushed further by a new concept, Distraction Hypothesis , by providing complicated visual inputs to divert their attention from detecting the harmful query. The visual complexity of an input is created with numerous contrasting sub-images that strategically jailbreak the models [ 42 ] . However, research has been conducted on uncovering vulnerabilities in the broader model ecosystem beyond direct input manipulation. A hijacking attack was proposed, using imperceptible adversarial images in Image

Read the complete text