Adversarial Attacks on Multimodal Large Language Models: A Comprehensive Survey

Bhavuk Jain [email protected], Sercan Ö. Arık [email protected], Hardeo K. Thakur [email protected] · 2026

Read Adversarial Attacks on Multimodal Large Language Models: A Comprehensive Survey by Bhavuk Jain [email protected], Sercan Ö. Arık [email protected], Hardeo K. Thakur [email protected] (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-27918.txt.

Introduction

Jain and co-authors survey adversarial attacks on multimodal language models. These models fuse text, image, audio, and video streams. That fusion opens fresh attack surfaces. Their taxonomy sorts attacks by attacker objective. A second lens ties attacks to shared weaknesses. Integrity, jailbreak, hijack, and poisoning groups are covered. Architecture and representation flaws recur across groups. The frame guides more robust system design.

Catalog record

CREATORBhavuk Jain [email protected], Sercan Ö. Arık [email protected], Hardeo K. Thakur [email protected]
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE99728
LICENSEhttp://creativecommons.org/licenses/by-sa/4.0/
RIGHTSCC BY SA
SOURCEarXiv

Source: https://arxiv.org/abs/2603.27918

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Adversarial Attacks on Multimodal Large Language Models: A Comprehensive Survey Bhavuk Jain [email protected], Sercan Ö. Arık [email protected], Hardeo K. Thakur [email protected] Abstract Multimodal large language models (MLLMs) integrate information from multiple modalities such as text, images, audio, and video, enabling complex capabilities such as visual question answering and audio translation. While powerful, this increased expressiveness introduces new and amplified vulnerabilities to adversarial manipulation. This survey provides a comprehensive and systematic analysis of adversarial threats to MLLMs, moving beyond enumerating attack techniques to explain the underlying causes of model susceptibility. We introduce a taxonomy that organizes adversarial attacks according to attacker objectives, unifying diverse attack surfaces across modalities and deployment settings. Additionally, we also present a vulnerability-centric analysis that links integrity attacks, safety and jailbreak failures, control and instruction hijacking, and training-time poisoning to shared architectural and representational weaknesses in multimodal systems. Together, this framework provides an explanatory foundation for understanding adversarial behavior in MLLMs and informs the development of more robust and secure multimodal language systems. 1 Introduction The rapid development of Large Language Models (LLMs) marks a significant leap in AI ( 12 ) . By integrating and processing information from diverse modalities, such as text, images, and audio, in various combinations, these models mimic human perception to achieve a more holistic understanding of the world ( 51 ) . This advanced capability enables them to tackle complex tasks previously beyond reach, driving breakthroughs in areas such as image captioning ( 88 ) , visual question answering ( 2 ) , audio-visual scene analysis ( 3 ) , robotics ( 71 ) , and more. The power of these models stems from their scalable attention-based architectures ( 87 ) and effective training recipes: pre-training on vast datasets, followed by post-training alignment on a multitude of tasks to suit downstream use cases, thereby achieving state-of-the-art performance. However, the very complexity that fuels the power of LLMs also introduces novel and intricate vulnerabilities ( 33 ) . As illustrated in Figure 1 , unlike text-only LLMs, multimodal LLMs present an expanded attack surface where threats can arise not only from weaknesses within individual modality processing but, crucially, from the complex interplay and fusion mechanisms between the combined modalities ( 9 ) . These cross-modal vulnerabilities can manifest through several key attack vectors, some of which are as follows: • Cross-modal prompt injection ( 6 ) exploits LLMs’ instruction-following nature by embedding malicious commands within non-textual modalities. Attackers can hide instructions in images or audio that the model interprets as textual commands, effectively hijacking behavior without directly manipulating text prompts. • Fusion mechanism attacks target how the core process LLMs integrate information from multiple modalities, exploiting vulnerabilities in how features from different sources are combined and aligned. These attacks can disrupt the fusion process, causing the model to misinterpret or improperly weigh multimodal inputs. • Adversarial illusions exploit the shared embedding space where LLMs align representations across modalities. Attackers can craft inputs in one modality that appear benign but whose embeddings become deceptively aligned with unrelated concepts from another modality, causing the model to hallucinate false semantic connections ( 7 ) . As such powerful models are increasingly deployed in real-world applications, including safety-critical systems, understanding their susceptibility to adversarial manipulation becomes paramount. The landscape of attacks targeting these LLMs is evolving rapidly, encompassing a range of techniques. These include adversarial perturbations designed to cause misclassification or erroneous outputs ( 32 ) , jailbreak attacks that bypass safety alignments ( 97 ) , prompt injection methods that hijack model behavior ( 74 ) , and data poisoning strategies that corrupt the model during training ( 34 ) . Given the increasing sophistication and potential impact of these attacks, a systematic understanding of the current threat landscape is urgently needed. While recent efforts have begun to map the field with surveys on general LLM attacks ( 83 ) and on specific pairs of modalities, such as vision–language models ( 59 ) , a deeper analytical connection between documented attacks and the underlying vulnerabilities they exploit remains limited. A notable peer-reviewed overview by 53 surveys a broad range of security concerns for large language models, including prompt injection, adversarial manipulation, poisoning, and agent-related risks, providing a valuable high-level synthesis of the evolving threat landscape. More narrowly, recent work on multimodal prompt injection characterizes injection vectors and defenses across modality pairs, but does not pursue a unified taxonomy or vulnerability-level explanation beyond prompt-based control failures ( 104 ) . However, existing surveys predominantly organize attacks by modality, attack surface, or application context, and focus on cataloging attack techniques and defenses rather than systematically explaining why diverse attacks recur across different model architectures and deployment settings. To complement this line of work, our survey introduces a taxonomy that classifies adversarial attacks by attack objective, providing a unified organizational framework that cuts across modalities and application domains. Building on this taxonomy, we also adopt a vulnerability-focused perspective that explicitly links attack categories to shared architectural and representational weaknesses in multimodal large language models, including failures in cross-modal interaction, modality-specific processing, instruction following, and control. This combined taxonomy and vulnerability-driven analysis moves beyond enumerating attack instances to explain the root causes of adversarial susceptibility in MLLMs. The remainder of this survey is organized as follows. Section 2 provides background on multimodal large language models, highlighting architectural components and formal abstractions that are most relevant to adversarial analysis. Section 3 introduces a goal-driven taxonomy of adversarial attacks on multimodal LLMs, organizing prior work by primary adversarial objective, and analyzes these attacks under different attacker knowledge assumptions (white-box, gray-box, and black-box). Section 4 shifts the focus from attack constructions to root causes, presenting a vulnerability-centric analysis that systematically links observed attack families to shared architectural, representational, and training-induced weaknesses in multimodal systems. Section 5 briefly discusses representative defense mechanisms and mitigation strategies, contextualized with respect to the attack families in the proposed taxonomy. Section 6 outlines the limitations of this survey and Section 7 discusses the broader impact of this survey paper. The Appendix in the end, details the survey methodology and inclusion criteria, and provides a consolidated table summarizing empirical characteristics of the works covered in the taxonomy diagram. In terms of paper selection, this survey focuses on peer-reviewed works that evaluate adversarial attacks on multimodal large language models with a language-model-based reasoning core processing two or more input modalities. Attacks operating on unimodal surfaces are included when they are evaluated against an MLLM, as they represent baseline threats inherited by multimodal systems. Conversely, works targeting unimodal-only models, non-LLM multimodal systems, or non-adversarial failure modes (e.g., calibration, fairness) are excluded, as are non-peer-reviewed preprints and non-English publications. Full inclusion and exclusion criteria are detailed in Appendix A . Figure 1 : A high-level overview of the adversarial attack landscape for Multimodal LLMs. 2 Background: Understanding LLMs in the Context of Adversarial Attacks This section lays the groundwork for understanding how multimodal LLMs are susceptible to adversarial attacks. We will briefly introduce LLM architectures and their operational principles, focusing on aspects that become relevant when discussing vulnerabilities. We then delve into the mathematical formulation of LLMs as it pertains to the generation and effect of adversarial perturbations, and finally, we

Read the complete text