PHANTOM: A Large-Scale Dataset of Multimodal Adversarial Attacks for Vision-Language Models

Simone Gallivanone, Hossein Khodadadi, Mauro Dore, Mauro Medda, Nicola Franco · 2026

Read PHANTOM: A Large-Scale Dataset of Multimodal Adversarial Attacks for Vision-Language Models by Simone Gallivanone, Hossein Khodadadi, Mauro Dore, Mauro Medda, Nicola Franco (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2606-24388.txt.

Introduction

Gallivanone and colleagues release a ready-made arsenal for stress-testing vision-language models. Generating adversarial attacks, inputs crafted to make a model produce harmful output, is expensive in compute. That keeps robustness research behind paywalls of compute. PHANTOM, their 2026 dataset, pre-generates tens of thousands of adversarial samples. Any team can evaluate defences immediately.

Coverage spans ten high-level categories and fifty-five subtypes of harmful intent. It merges and extends several established benchmarks into thousands of distinct intents. One additional category broadens the set. Attack strategies come from recent state-of-the-art literature, keeping the samples realistic rather than synthetic filler. Intended uses include testing model robustness and alignment, fine-tuning attack-generation models, and testing guardrails. Gallivanone's team frames the open release as lowering the barrier to adversarial research. Defenders, they argue, benefit most from shared, realistic attack data.

Catalog record

CREATORSimone Gallivanone, Hossein Khodadadi, Mauro Dore, Mauro Medda, Nicola Franco
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE68 KB
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2606.24388

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

PHANTOM: A Large-Scale Dataset of Multimodal Adversarial Attacks for Vision-Language Models Simone Gallivanone, Hossein Khodadadi, Mauro Dore, Mauro Medda, Nicola Franco Abstract We introduce a large - scale, open - source dataset of pre - generated adversarial attacks for vision–language models (VLMs). The dataset is designed to be diverse, representative, and practical, extending existing benchmarks by covering 10 10 high - level categories and 55 55 subcategories of harmful intents. Our primary goal is to make adversarial data accessible to the research community, given the computational cost and complexity of generating large numbers of attacks. The dataset comprises 47 524 47\,524 adversarial samples, generated using state - of - the - art attack strategies from recent literature. Our work complements existing efforts by consolidating and extending prior benchmarks from multiple established sources, resulting in 7 826 7\,826 intents, and introduce an additional category to broaden coverage. This provides realistic evaluation resources for studying model robustness and alignment. Our dataset intends to enable researchers and practitioners to systematically evaluate the robustness and safety of VLMs, fine - tune attack - generation models, and develop or stress - test defensive guardrails under diverse adversarial conditions. By releasing this resource, we aim to lower the barrier to adversarial research and foster more reproducible, comprehensive, and comparable evaluations of VLM safety. The dataset has been released at: https://huggingface.co/datasets/it4lia/PHANTOM Disclaimer: This paper and dataset contain content that may be disturbing or offensive, included solely for research purposes. 1 1 footnotetext: Equal contribution. † † footnotetext: Corresponding author: [email protected] 1 Introduction With the rapid public deployment of vision–language models (VLMs) in both open- and closed-source settings, including safety-critical and user-facing applications, their robustness against adversarial prompting has become an increasingly important research concern (see e.g., [ 1 , 2 , 3 , 4 , 5 ] ). Recent studies consistently show that, despite improved alignment and scaling, state-of-the-art multimodal models remain vulnerable to carefully crafted jailbreak attacks, particularly when harmful intents are distributed across visual and textual modalities (see e.g., [ 6 , 7 , 8 , 9 ] ). Unlike unimodal settings, multimodal safety violations often exploit cross-modal reasoning and semantic alignment, significantly expanding the attack surface and complicating both detection and defense. As a consequence, evaluating the robustness of VLMs requires large and diverse collections of adversarial image–text pairs. This cost particularly affects resource-constrained research groups and practitioners, for whom reproducing large-scale multimodal attack generation may be impractical. This is particularly true for vision-language models, where attack generation is typically more resource-consuming than in unimodal settings. Unlike image-only or text-only attacks, multimodal attacks may require optimizing perturbations across multiple input spaces while preserving or exploiting their semantic alignment. As a result, each attack iteration can involve forward and backward passes through multiple modality-specific encoders and the cross-modal alignment module, and the overall search space becomes larger and more constrained. Although the exact overhead is model and attack dependent, the computational cost can be approximated as scaling with the combined cost of the involved modalities. This makes systematic adversarial attack generation especially demanding for resource-constrained actors. While many existing open - source benchmarks (e.g., [ 4 , 10 , 11 , 12 , 13 , 14 , 15 , 1 , 16 , 17 , 3 , 2 , 7 , 18 ] ) provide tools and pipelines to generate and evaluate adversarial attacks, they typically do not release large collections of ready - to - use adversarial samples. Only a limited number of datasets offer such pre - generated attacks (e.g., [ 6 , 19 , 7 , 2 , 12 ] ), often focusing on specific attack types, categories, or linguistic settings. A Ethical & Social B Privacy & Data C Safety & Physical Harm D Criminal & Economic E Cybersecurity Threats F Info & Political G Content & Cultural H IP & Ownership I Decision & Cognitive J Child Safety (new) RISK TAXONOMY 10 categories \cdot 55 subcategories \cdot 7 826 intents BAP IDEATOR MML FC ATTACK CSDJ ATTACK STRATEGIES Attack generation \oplus 47 524 pairs DeepSeek-VL2 GLM-4.6V-Flash Kimi-VL-A3B Qwen3-VL-30B Qwen3.5-27B Qwen3.6-27B Gemma-4-26B LLaVA-v1.6-13B Ministral-3-14B OPEN-SOURCE white-box GPT-5.4 GPT-5.5 Gemini 3.1 Pro Claude Opus 4.6 Claude Opus 4.7 Claude Opus 4.8 CLOSED-SOURCE black-box Judge \Rightarrow ASR per category Attack samples Perturbed Flowchart Flipped Generated Collage intent selection attack selection tested against TRANSFER Figure 1: Overview of PHANTOM. The risk taxonomy ( 10 categories, 55 subcategories, 7\,826 intents) defines the dataset; the multimodal attacks (BAP, IDEATOR, MML, FC ATTACK, CSDJ) turn each intent into a multimodal adversarial sample (harmful text prompt + image), giving 47\,524 (prompt, image) pairs. Each pair is given white-box to nine open-source VLMs and transferred to six closed-source, black-box models; the judge scores every response to obtain per-category ASR. Bottom-left: representative samples from different attack families. In this work, we aim to complement existing efforts by releasing a large - scale collection of ready - to - use multimodal adversarial samples, covering a broader range of attack strategies and safety categories. Our goal is not to replace prior benchmarks, but to provide a practical resource that lowers the barrier to safety evaluation and enables reproducible and comprehensive robustness testing of multimodal models. With this in mind, we designed and produced the PHANTOM dataset, a dataset of adversarial attacks for vision - language models, which aims to fill this gap, and thus lower the barrier to systematic robustness evaluation. The dataset contains attack samples in the form of image–text pairs for both single - turn and conversational attacks. The dataset at a glance: Scale: 47\,524 pre-generated attack samples Coverage: 10 categories, 55 subcategories ( appendix A ) Strategies: BAP [ 8 ] , IDEATOR [ 6 ] , MML [ 9 ] , FC ATTACK [ 20 ] , CSDJ [ 21 ] . For a more detailed discussion on the design and content of the dataset we refer the reader to section 3 . The samples have been generated against a variety of different open-source models, from the following families: Qwen3-VL [ 22 ] , DeepSeek-VL22 [ 23 ] , GLM-4.6V [ 24 ] , Kimi-VL [ 25 ] , Qwen3.5 [ 26 ] , Qwen3.6 [ 27 ] . The generated samples were subsequently evaluated against state - of - the - art proprietary models, including Claude Opus 4.6 - 4.7 - 4.8, GPT - 5.4 - 5.5, Gemini-3.1-pro. The results, which highlight cross - model transferability and robustness trends, are presented in section 3.4 . Our main contributions are: • PHANTOM , a large-scale open-source dataset of multimodal adversarial attacks for VLM safety evaluation. • A curated taxonomy of 7\,826 harmful intents spanning 10 categories and 55 subcategories. • 47\,524 adversarial samples generated using four attack strategies: BAP [ 8 ] , IDEATOR [ 6 ] , MML [ 9 ] , FC ATTACK [ 20 ] and CSDJ [ 21 ] . • A transferability analysis across both open-source and proprietary VLMs. • Structured metadata designed to support reproducibility, benchmarking, and downstream safety research. The paper is organized as follows. Section 2 reviews related work. Section 3 describes the dataset design, generation pipeline, and evaluation protocol. Section 4 discusses the limitations of the current release, and

Read the complete text