QAVA: Query-Agnostic Visual Attack to Large Vision-Language Models

Yudong Zhang, Ruobing Xie, Jiansheng Chen, Xingwu Sun, Zhanhui Kang, Yu Wang, Technology Beijing, Faculty of Science, Technology, University of Macau · 2025

Read QAVA: Query-Agnostic Visual Attack to Large Vision-Language Models by Yudong Zhang, Ruobing Xie, Jiansheng Chen, Xingwu Sun, Zhanhui Kang, Yu Wang, Technology Beijing, Faculty of Science, Technology, University of Macau (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2504-11038.txt.

Introduction

Yudong Zhang and five colleagues craft images that fool vision-language models no matter what question is asked, in a 2025 paper. Standard attacks tune the trick image to one known question, yet real images face many unknown ones.

Their query-agnostic attack needs no knowledge of the coming question. Even so, it matched attacks that did know the target question. Effectiveness and efficiency both improved over question-specific methods when the question was hidden. The authors frame the work as exposing a blind spot in how these models are defended: an image can be poisoned once and mislead every later query. Code is published for others to test and build defenses.

Catalog record

CREATORYudong Zhang, Ruobing Xie, Jiansheng Chen, Xingwu Sun, Zhanhui Kang, Yu Wang, Technology Beijing, Faculty of Science, Technology, University of Macau
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE41 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2504-11038

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

QAVA: Query-Agnostic Visual Attack to Large Vision-Language Models Yudong Zhang, Ruobing Xie, Jiansheng Chen, Xingwu Sun, Zhanhui Kang, Yu Wang, Technology Beijing, Faculty of Science, Technology, University of Macau Abstract In typical multimodal tasks, such as Visual Question Answering (VQA), adversarial attacks targeting a specific image and question can lead large vision-language models (LVLMs) to provide incorrect answers. However, it is common for a single image to be associated with multiple questions, and LVLMs may still answer other questions correctly even for an adversarial image attacked by a specific question. To address this, we introduce the query-agnostic visual attack (QAVA), which aims to create robust adversarial examples that generate incorrect responses to unspecified and unknown questions. Compared to traditional adversarial attacks focused on specific images and questions, QAVA significantly enhances the effectiveness and efficiency of attacks on images when the question is unknown, achieving performance comparable to attacks on known target questions. Our research broadens the scope of visual adversarial attacks on LVLMs in practical settings, uncovering previously overlooked vulnerabilities, particularly in the context of visual adversarial threats. The code is available at https://github.com/btzyd/qava . 1 Introduction Figure 1: Traditional adversarial attacks involve inputting an image x_{i} and a specified target question x_{t,target} into LVLMs, with adversarial images generated through gradient-based methods. This approach typically results in incorrect answers for x_{i} and x_{t,target} ( i.e. , Q1). However, for other questions x_{t,other}\in\{x_{t,other}\in\mathcal{T}|x_{t,other}\neq x_{t,target}\} within the question set \mathcal{T} that are not the same as the x_{t,other} , it remains possible for LVLMs to provide correct answers ( i.e. , Q2-Q6). Our QAVA samples a set of questions x_{\text{t,QAVA}} and performs attacks on these questions, even if they are unrelated to the original image x_{i} . QAVA generates adversarial images that are likely to produce incorrect responses when faced with unknown target questions. With the expansion in model parameters and training datasets, large vision-language models (LVLMs) have gained significant popularity, demonstrating exceptional performance across various tasks, including image classification, image captioning, semantic segmentation, and visual question answering (VQA) Liu et al. (2023a) ; Alayrac et al. (2022) ; Wang et al. (2023) . However, training LVLMs from the ground up is resource-intensive. As a result, the prevailing approach involves fine-tuning pre-trained visual encoders and large language models (LLMs) while training a vision-language alignment module. This process adapts visual tokens to the input space of the LLMs after they pass through the alignment module, enabling the LLMs to effectively process visual tokens. A well-known and efficient visual-language alignment module is Q-former Li et al. (2023) , which is employed by many popular LVLMs to bridge the visual encoder and the LLM Dai et al. (2023) ; Zhu et al. (2023) . Despite their robust capabilities, LVLMs remain vulnerable to adversarial attacks. Attack-Bard Dong et al. (2023) employs surrogate models to manipulate images, causing LVLMs to err on the image captioning task using the fixed prompt, “Describe this image”. Similarly, VLAttack Yin et al. (2023) targets both visual and textual modalities to disrupt the output of LVLMs for a specific question and image. However, these methods focus exclusively on attacks against one image and one question at a time . Consequently, the adversarial examples generated by these attacks may not be effective when confronted with different questions. To develop more potent attacks, our objective is to manipulate images so that they yield incorrect answers to an unknown set of target questions , noted as query-agnostic visual attack (QAVA) . These query-agnostic adversarial examples have the potential to cause significant disruption to the model. For instance, during the inference phase, LVLMs may consistently provide incorrect answers to any question regarding the manipulated image. Moreover, employing these adversarial examples during the training or supervised fine-tuning phase could be even more detrimental, particularly when used for data poisoning. We enhance the attack by scrutinizing both the attack’s location and the selection of questions used. In terms of attack positioning, traditional attack methods typically employ the end-to-end loss function of the entire LVLM as the attack objective function. However, for adversarial attacks, it is crucial to identify and target the most vulnerable component of the LVLM. Given the extensive number of parameters in large language models, we posit that end-to-end attacks on LVLMs may not be as effective as targeting the inputs to the LLMs. Consequently, we focus on attacking the output of the visual-language alignment module . The visual-language alignment module’s output encompasses multimodal interactions, and we can disrupt these critical multimodal interactions by targeting the alignment module, potentially leading to more effective attack outcomes. Regarding the questions employed in attacks, we observed that when targeting the visual-language alignment module, effective attack performance can be achieved even with the use of randomized questions that are unrelated to the image . Furthermore, the attack is enhanced when a larger number of random, irrelevant questions are utilized, which verifies our QAVA’s flexibility and effectiveness. In conclusion, QAVA diverges from traditional attacks in two key aspects: (1) We focus on attacking the output of the visual-language alignment module within LVLMs, which is verified to be more vulnerable to query-agnostic attacks. (2) We utilize multiple randomized, image-independent questions in our attacks, ensuring that the adversarial examples are maximally incorrect when confronted with unknown potential inputs. Our main contributions are summarized as follows: (1) We introduce a query-agnostic attack method, QAVA, which enhances the practicality of adversarial attacks on images within LVLMs. (2) We identify the vulnerability of visual-language alignment modules in LVLMs to adversarial attacks and leverage this vulnerability to execute query-agnostic attacks. (3) Extensive experiments demonstrate the efficacy of our QAVA approach in both white-box and black-box attack scenarios. Additionally, our QAVA method exhibits inter-task transferability, such as transferring from the VQA task to the image captioning task. This serves as an important alert regarding the security of LVLMs. 2 Related Work Large vision-language models. LVLMs are typically composed of a pre-trained LLM, a visual encoder, and a projector that aligns visual and textual modalities. Recent popular LVLMs include InstructBLIP Dai et al. (2023) and MiniGPT-4 Zhu et al. (2023) . Both models utilize EVA-CLIP Sun et al. (2023) as the visual encoder and employ the Q-Former Li et al. (2023) for aligning textual and visual modalities. For the LLM component, models such as Vicuna Chiang et al. () and FlanT5 Chung et al. (2022) are viable options. These LVLMs have demonstrated outstanding performance across various multimodal tasks, including image classification and VQA Antol et al. (2015) , among others. Adversarial Attacks. By introducing small perturbations to the inputs of neural networks, adversarial attacks Szegedy et al. (2014) ; Nguyen et al. (2015) can cause models to produce incorrect outputs. These attacks can be categorized into white-box and black-box (or gray-box) attacks Papernot et al. (2016) . In white-box attacks, the adversary has full access to the model’s parameters. Conversely, in black-box or gray-box attacks, the adversary has limited information, such as the ability to make a certain number of queries to the model or knowledge of some of the model’s parameters. Furthermore, adversarial attacks can be classified as either targeted or untargeted. Untargeted attacks aim to generate incorrect outputs, while targeted attacks strive to manipulate the output to

Read the complete text