An Image Is Worth Ten Thousand Words: Verbose-Text Induction Attacks on VLMs
Zhi Luo, Zenghui Yuan, Wenqi Wei, Daizong Liu, Pan Zhou · 2025
Read An Image Is Worth Ten Thousand Words: Verbose-Text Induction Attacks on VLMs by Zhi Luo, Zenghui Yuan, Wenqi Wei, Daizong Liu, Pan Zhou (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2511-16163.txt.
Introduction
Zhi Luo and four co-authors propose a verbose text induction attack that forces vision language models to generate extremely long, low value outputs. Token consumption drives energy use, latency, and cost for these models. Prior attacks merely delayed the end token, giving unstable and uncontrollable lengthening. Their two stage framework instead optimizes output token length directly as an explicit objective.
Imperceptible perturbations are injected into benign images to trigger the behavior. A malicious prompt embedding is identified first, then used to guide the perturbation. Stability and controllability improve over implicit methods. The attack exposes an efficiency vulnerability distinct from classic content jailbreaks. Defenders must guard output length, not only output content, when vision language models are deployed at scale.
Catalog record
| CREATOR | Zhi Luo, Zenghui Yuan, Wenqi Wei, Daizong Liu, Pan Zhou |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 33 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2511-16163
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
An Image Is Worth Ten Thousand Words: Verbose-Text Induction Attacks on VLMs Zhi Luo, Zenghui Yuan, Wenqi Wei, Daizong Liu, Pan Zhou Abstract With the remarkable success of Vision-Language Models (VLMs) on multimodal tasks, concerns regarding their deployment efficiency have become increasingly prominent. In particular, the number of tokens consumed during the generation process has emerged as a key evaluation metric. Prior studies have shown that specific inputs can induce VLMs to generate lengthy outputs with low information density, which significantly increases energy consumption, latency, and token costs. However, existing methods simply delay the occurrence of the EOS token to implicitly prolong output, and fail to directly maximize the output token length as an explicit optimization objective, lacking stability and controllability. To address these limitations, this paper proposes a novel verbose-text induction attack (VTIA) to inject imperceptible adversarial perturbations into benign images via a two-stage framework, which identifies the most malicious prompt embeddings for optimizing and maximizing the output token of the perturbed images. Specifically, we first perform adversarial prompt search , employing reinforcement learning strategies to automatically identify adversarial prompts capable of inducing the LLM component within VLMs to produce verbose outputs. We then conduct vision-aligned perturbation optimization to craft adversarial examples on input images, maximizing the similarity between the perturbed image’s visual embeddings and those of the adversarial prompt, thereby constructing malicious images that trigger verbose text generation. Comprehensive experiments on four popular VLMs demonstrate that our method achieves significant advantages in terms of effectiveness, efficiency, and generalization capability. 1 Introduction In recent years, Vision-Language Models (VLMs) have advanced rapidly, demonstrating strong performance in multimodal tasks such as image captioning ( Wang et al., 2021 ; Li et al., 2022 ) , visual question answering ( Liu et al., 2023b ; Dai et al., 2023 ) , and visual reasoning ( Zhu et al., 2023 ; Cheng et al., 2024 ) . However, these achievements are largely driven by scaling models to billions of parameters, which renders the model’s deployment highly resource-intensive ( Zhang et al., 2024a ) . With the accelerating commercialization of VLMs, many service providers offer inference services for users through APIs, commonly under token-based billing schemes. This raises a critical challenge for practical deployment, which is to ensure accurate and efficient inference while suppressing redundant token generation. Most state-of-the-art VLMs adopt modular architectures in which an intermediate layer connects the visual encoder and Large Language Models (LLMs) ( Yin et al., 2024 ) . The visual encoder and intermediate layer jointly process the image to extract visual embeddings, which are then combined with the textual embeddings of prompts for response generation by the LLMs. Due to the autoregressive nature of LLMs, each generated token requires a forward pass, and the token is subsequently fed back as input for the next steps ( Cao et al., 2023 ) . As the token sequence grows, the computational cost of each forward pass increases accordingly. Such characteristics expose VLMs to a new type of security threat ( Gao et al., 2024a ; Gao et al., 2024b ) : adversaries can design malicious images that induce the model to generate excessively long outputs. Such behavior not only inflates inference energy consumption and latency, severely degrading server responsiveness, but also substantially increases user costs under token-based pricing. As illustrated in Figure 1 , the inference time increases with the number of generated tokens. When adversarial perturbations remain visually imperceptible, the stealth and practical risk of these attacks become even more severe. Figure 1: The relationship between the time consumed in a single inference and the number of generated tokens. Prior works ( Shumailov et al., 2021 ; Chen et al., 2022b ) have investigated increasing inference energy consumption and latency by adding perturbations to images, but these methods mainly target image-classification models (e.g., ResNet) or small-scale image-to-text models (e.g., ResNet+RNN) and do not readily transfer to modern VLMs. Recent studies ( Gao et al., 2024a ; Gao et al., 2024b ) on VLMs have focused on prolonging outputs by delaying the occurrence of the EOS token: their core idea is to decrease the probability of EOS in the next-step distribution and use that signal to compute gradients for optimizing image perturbations. However, this approach relies solely on the probability distribution obtained from a single forward pass of the image and input text through the VLM, therefore cannot capture the complete information of the subsequent autoregressive generation process. That is because LLMs generate autoregressively, later outputs are highly context-dependent and thus difficult to predict or control. Consequently, adversarial images optimized using single-pass information often lack stability and controllability in their final attack effectiveness. This limitation raises a key question: can we directly use the VLM’s output length as the optimization objective when optimizing an adversarial image for verbose text, thereby improving the stability and controllability of adversarial methods? To address these limitations, in this paper, we propose a novel redundancy-inducing VLM attack, termed Verbose-Text Induction Attack (VTIA). This attack method adopts a two-stage decoupling strategy that explicitly learn the most malicious prompt embedding and maximizes the output token numbers of the perturbed images. In particular, it proceeds in two steps: 1) Adversarial Prompt Search: we train an attacker LLM using reinforcement learning to optimize the generation of a malicious prompt, avoiding the non-differentiability of directly maximizing output token length. The embedding of this prompt, when inserted after the visual embeddings, can trigger the LLM within the VLM to produce excessively long outputs; 2) Vision-Aligned Perturbation Optimization: based on the similarity between the malicious prompt embedding and visual embeddings, gradients are computed to perturb the input image and obtain adversarial examples. This stage operates entirely independently of the target VLM’s textual module, thereby avoiding the substantial overhead of repeatedly invoking large LLMs during iterative optimization. In this manner, our attack can effectively prolong the VLM’s output. The main contributions of this work are as follows: • We propose a novel verbose-text induction attack on VLMs, capable of generating adversarial images while accounting for subsequent outputs with explicit token-aware designs, thereby advancing security research on inducing verbose text generation in VLMs. • We design a two-stage attack framework, which firstly searches for an adversarial prompt through reinforcement learning, and then uses it to optimize adversarial images with the defined similarity loss and standard deviation loss. • We apply our method to four mainstream VLMs (Blip2, InstructBlip, LLaVA, Qwen2-VL) and evaluate it on the MS-COCO dataset. Experimental results show that the generated adversarial images can induce these models to produce token counts that are 121.90×, 87.19×, 9.44×, and 6.48× longer than those generated from the original images. 2 Related Work 2.1 VLMs Currently, mainstream VLMs consist of two key parts, i.e., textual and visual components. Early models such as CLIP ( Radford et al., 2021 ) , BLIP ( Li et al., 2022 ) , and ALIGN ( Jia et al., 2021 ) employed both visual encoders and text encoders, aligning image and text embeddings through contrastive learning. Newer generations of models (e.g., Blip2 ( Li et al., 2023 ) , InstructBlip ( Dai et al., 2023 ) , MiniGPT ( Zhu et al., 2023 ) , LLaVA ( Liu et al., 2023b