GHOST: Hallucination-Inducing Image Generation for Multimodal LLMs
Aryan Yazdan Parast, Parsa Hosseini, Hesam Asadollahzadeh, Arshia Soltani Moakhar, Basim Azam, Soheil Feizi, Naveed Akhtar · 2025
Read GHOST: Hallucination-Inducing Image Generation for Multimodal LLMs by Aryan Yazdan Parast, Parsa Hosseini, Hesam Asadollahzadeh, Arshia Soltani Moakhar, Basim Azam, Soheil Feizi, Naveed Akhtar (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2509-25178.txt.
Introduction
Aryan Yazdan Parast and colleagues build GHOST, a system that manufactures images designed to make vision-language models hallucinate objects. Models seeing things that are not there is a known failure, usually probed with fixed benchmark scenes. Static tests cannot find model-specific weaknesses. GHOST instead optimizes in image embedding space, steering a model toward a target object that stays absent.
A diffusion model conditioned on the deceptive embedding renders natural-looking images. Human checks and metrics confirm the pictures are high quality and genuinely object-free. Success rates passed twenty-eight percent, against about one percent for earlier data-driven hunts. The traps transfer: images tuned on one open model fooled a leading commercial model two times in three. Fine-tuning on GHOST images reduces hallucination, making the attacker also a vaccine.
Catalog record
| CREATOR | Aryan Yazdan Parast, Parsa Hosseini, Hesam Asadollahzadeh, Arshia Soltani Moakhar, Basim Azam, Soheil Feizi, Naveed Akhtar |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 58 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2509-25178
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
GHOST: Hallucination-Inducing Image Generation for Multimodal LLMs Aryan Yazdan Parast, Parsa Hosseini, Hesam Asadollahzadeh, Arshia Soltani Moakhar, Basim Azam, Soheil Feizi, Naveed Akhtar Abstract Object hallucination in Multimodal Large Language Models (MLLMs) is a persistent failure mode that causes the model to perceive objects absent in the image. This weakness of MLLMs is currently studied using static benchmarks with fixed visual scenarios, which preempts the possibility of uncovering model-specific or unanticipated hallucination vulnerabilities. We introduce GHOST ( G enerating H allucinations via O ptimizing S tealth T okens), a method designed to stress-test MLLMs by actively generating images that induce hallucination. GHOST is fully automatic and requires no human supervision or prior knowledge. It operates by optimizing in the image embedding space to mislead the model while keeping the target object absent, and then guiding a diffusion model conditioned on the embedding to generate natural-looking images. The resulting images remain visually natural and close to the original input, yet introduce subtle misleading cues that cause the model to hallucinate. We evaluate our method across a range of models, including reasoning models like GLM-4.1V-Thinking, and achieve a hallucination success rate exceeding 28%, compared to around 1% in prior data-driven discovery methods. We confirm that the generated images are both high-quality and object-free through quantitative metrics and human evaluation. Also, GHOST uncovers transferable vulnerabilities: images optimized for Qwen2.5-VL induce hallucinations in GPT-4o at a 66.5% rate. Finally, we show that fine-tuning on our images mitigates hallucination, positioning GHOST as both a diagnostic and corrective tool for building more reliable multimodal systems. 1 Introduction Multimodal large language models (MLLMs) ( Liu et al. 2024 ; Liu et al. 2023 ; Bai et al. 2025a ; Team et al. 2025 ) have demonstrated impressive performance across a wide range of vision and language tasks, including image captioning, visual question answering, and multimodal reasoning. However, they suffer from a potentially critical failure mode: object hallucination , where the model incorrectly predicts the presence of an object that is not present in the image. Such errors raise concerns about the reliability of MLLMs in safety-sensitive applications and underscore the need for systematic methods to stress-test their visual robustness. Existing evaluations of object hallucination in MLLMs typically rely on static benchmarks, fixed visual scenarios, and curated image sets ( Li et al. 2023 ; Hu et al. 2023 ; Leng et al. 2024 ; Lovenia et al. 2023 ) . While useful, these approaches constrain analysis to a fixed set of visual scenarios and fail to expose model-specific vulnerabilities. Moreover, they lack a systematic way to assess which types of images trigger hallucinations, making it difficult to determine whether these errors are isolated or indicative of deeper, structural failure modes. Identifying such patterns is crucial not only for understanding model behavior but also for mitigating these failures. To address these limitations, we introduce GHOST (Generating Hallucinations via Optimizing Stealth Tokens), a method designed to stress-test MLLMs by synthesizing hallucination-inducing images. Given an input image and a target object, GHOST generates a visually similar image that preserves the absence of the object but causes the model to incorrectly detect it. The edits introduced by GHOST are subtle and semantic, contextual cues that are perceptible to humans but do not introduce the object itself. This is accomplished by optimizing the image’s CLIP embedding to elicit hallucination while regularizing against object insertion, then using it to guide the diffusion model to generate a natural-looking image. Consider the example in Figure 1 . The original image (left) shows a banana on a plate with no knife present, and multiple MLLMs correctly answer “No” when asked whether a knife is in the picture. However, after GHOST introduces subtle changes, such as modifying the banana’s stem to resemble the edge of a knife, the models flip their answer to “Yes,” hallucinating a knife. These misleading cues are not convincing to human observers, yet they are sufficient to push the models across the decision boundary. One key innovation in GHOST is its design that decouples the optimization process from the image generator. Prior work on systematic failure image generation either omits feedback from the target model, limiting their ability to capture model-specific blind spots ( Zhang et al. 2024 ; Wu et al. 2024 ) , or uses resource-intensive and slow pipelines ( Augustin et al. 2025 ) . In contrast, GHOST introduces a mapper that aligns the visual spaces of the target model and the diffusion model, enabling efficient optimization while preserving compatibility across different image generators and vision-language models. Figure 1 : ( Left ) All models correctly answer “No” when asked if there is a knife in the image. ( Right ) GHOST introduces subtle cues, and all models now hallucinate the presence of a knife. Together, these components make GHOST scalable and effective: for instance, on Qwen2.5-VL ( Bai et al. 2025a ) , GHOST generates 2,816 hallucination-inducing images out of 9,423 initial inputs, a 29% success rate–compared to 0.1% in DASH ( Augustin et al. 2025 ) . GHOST also generalizes to reasoning-based MLLMs like GLM-4.1V-Thinking ( Team et al. 2025 ) , where it shifts the model’s reasoning trajectory to justify the presence of a nonexistent object (Figure 7 ). The resulting images are natural and high quality, as demonstrated by the FID results in Table 6 . Figure 2 shows qualitative examples, where each column compares an original image (top) with its GHOST-edited counterpart (bottom). The subtle semantic changes introduced by GHOST cause the model to hallucinate its presence. Human evaluation confirms that GHOST images remain object-free from a human perspective, with 89% of responses agreeing the target object is absent. GHOST also reveals transferable vulnerabilities: images optimized for one model often cause hallucinations in others. For example, images generated for Qwen2.5-VL induce hallucinations in GPT-4o at a 66.5% rate (Table 3 ). GHOST thus exposes not just model-specific blind spots, but systemic vulnerabilities across MLLMs. Finally, we demonstrate that GHOST can also aid in mitigation: fine-tuning on GHOST synthetic images improves model robustness on downstream hallucination benchmarks (Section 6.2 ), highlighting GHOST’s potential as both a diagnostic and corrective tool. Figure 2 : ( Top ) Input images, the MLLM does not hallucinate the target object. ( Bottom ) GHOST images, the MLLM hallucinates the object, despite its absence being clear to a human observer. 2 Related works Systematic Failures in MLLMs. Recent works have introduced frameworks to automatically identify failures in MLLMs ( Tong et al. 2024a ; Tong et al. 2024b ; Hosseini et al. 2025 ) . Tong et al. 2024b highlight MLLMs’ struggles with basic visual understanding, attributing them to limitations in CLIP-based vision encoders. In contrast, Tong et al. 2024a focuses on failures stemming from the language modality. Hosseini et al. 2025 show that MLLMs often over-rely on spurious visual cues, leading to hallucinations when such cues are present but the object itself is absent. A large body of work has specifically examined object hallucination ( Li et al. 2023 ; Leng et al. 2024 ; Lovenia et al. 2023 ; Hu et al. 2023 ; Wang et al. 2023 ) , typically proposing benchmarks and evaluation protocols to quantify the