Verb Mirage: Unveiling and Assessing Verb Concept Hallucinations in Multimodal Large Language Models
Zehao Wang, Xinpeng Liu, Yudonglin Zhang, Xiaoqian Wu, Zhou Fang, Yifan Fang, Junfu Pu, Cewu Lu, Yong-Lu Li · 2024
Read Verb Mirage: Unveiling and Assessing Verb Concept Hallucinations in Multimodal Large Language Models by Zehao Wang, Xinpeng Liu, Yudonglin Zhang, Xiaoqian Wu, Zhou Fang, Yifan Fang, Junfu Pu, Cewu Lu, Yong-Lu Li (2024) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2412-04939.txt.
Introduction
Word sight tools that pair shots and text can dream up things that are not there, and the dreams have been read most for nouns. Zehao Wang and co-authors turn to verbs in a 2024 study: the do words that name what a shot shows a hand do. Their tests show most top tools dream up verbs hard.
Past cures for noun dreams were run on the verb dreams, and they failed to move them. The team then tune a tool on a rich verb lore bank, with verb kinds and ties built in. That tune cut verb dreams by a wide span in their tests. The work names a blind spot in the dream hunt, and a path to close it.
Catalog record
| CREATOR | Zehao Wang, Xinpeng Liu, Yudonglin Zhang, Xiaoqian Wu, Zhou Fang, Yifan Fang, Junfu Pu, Cewu Lu, Yong-Lu Li |
|---|---|
| YEAR | 2024 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 44 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2412-04939
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Verb Mirage: Unveiling and Assessing Verb Concept Hallucinations in Multimodal Large Language Models Zehao Wang, Xinpeng Liu, Yudonglin Zhang, Xiaoqian Wu, Zhou Fang, Yifan Fang, Junfu Pu, Cewu Lu, Yong-Lu Li Abstract Multimodal Large Language Models (MLLMs) have garnered significant attention recently and demonstrate outstanding capabilities in various tasks such as OCR, VQA, captioning, etc . However, hallucination remains a persistent issue. While numerous methods have been proposed to mitigate hallucinations, achieving notable improvements, these methods primarily focus on mitigating hallucinations related to object/noun concepts . Verb concepts, which are crucial for understanding human actions, have been largely overlooked. In this paper, to the best of our knowledge, we are the first to investigate the verb hallucination phenomenon of MLLMs from various perspectives. Our findings reveal that most state-of-the-art MLLMs suffer from severe verb hallucination. To assess the effectiveness of existing mitigation methods for object concept hallucination in relation to verb hallucination, we evaluated these methods and found that they do not effectively address verb hallucination. To address this issue, we propose a baseline method based on fine-tuning with rich verb knowledge, achieving decent superiority. The experiment results demonstrate that our method significantly reduces hallucinations related to verbs. 1 Shanghai Jiao Tong University 2 Shanghai Innovation Institute 3 ARC Lab, Tencent PCG {davidwang200099, rightoverthere, enlighten, joefang, despr0, lucewu, yonglu_li}@sjtu.edu.cn, [email protected], [email protected] Code — https://github.com/davidwang200099/Verb˙Mirage Introduction Multimodal Large Language Models (MLLMs) ( Zhu et al. 2024 ; Liu et al. 2023a ; Chen et al. 2024c ; Bai et al. 2023 ; Li et al. 2024c ) have drawn much attention in both the research and industry communities. Armed with high-quality data, a large number of parameters, and efficient instruction-following fine-tuning, they achieve significant success in various tasks, including OCR, VQA, and image captioning, demonstrating a strong generalization ability. Figure 1: Besides the well-discussed object hallucination, in this paper, we unveil the severe verb hallucination of state-of-the-art MLLMs with our designed benchmarks. All models show low object hallucination (on POPE) but severe verb hallucination. Gemini-1.5-Flash and GPT-4-Turbo are tested with 100 randomly sampled questions. However, MLLMs’ performance improvement could be hindered by hallucination. Typically, hallucination ( Ji et al. 2023 ; Liu et al. 2024b ) means the output of MLLM contains content against facts, irrelevant or nonsensical given context, such as prompt or multimodal input. To test MLLM hallucination in different tasks, many benchmarks ( Liu et al. 2025 ; Cai et al. 2025 ; Fu et al. 2025 ) have been made, allowing people to assess MLLMs’ abilities in various aspects. To mitigate MLLM hallucination, many methods ( Huang et al. 2024 ; Leng et al. 2024 ; Sun et al. 2024 ; Yin et al. 2024 ; Zhou et al. 2024 ) have been proposed, successfully relieving hallucination to a large extent. However, existing benchmarks and methods mainly target hallucination about objects/noun-related concepts. Action/verb-related concepts, which are crucial to understanding human events, are overlooked. To this end, we propose to dig into the verb hallucination problem. We build the first verb-hallucination-oriented benchmark, which is based on existing datasets ( Chao et al. 2015 ; Sigurdsson et al. 2018 ) without the need for extra manual annotations. As MLLMs are a cooperation of vision and language modalities, we probe MLLM verb hallucination given both different visual inputs and language inputs, covering different query conditions, different imaging conditions, and different semantic conditions. Extensive experiments show that all MLLMs perform poorly on many aspects and thus show severe verb hallucination. Moreover, we test existing low-cost hallucination mitigation methods on widely used MLLMs and show that they all fail in mitigating verb hallucination. To somewhat relieve verb hallucination, we propose a baseline method based on parameter-efficient fine-tuning with verb structure knowledge. Experiments show that our method successfully relieves verb hallucination, but its performance is still far from satisfactory. Finally, we explore the reason for verb hallucination and discuss possible future solutions. In conclusion, our contributions are: 1. To our knowledge, we point out and analyze MLLM’s verb hallucination for the first time and probe this phenomenon under different conditions. 2. We study the influence of existing training-free and finetuning-based methods on MLLM verb hallucination. We find that fine-tuning is still the most promising way for verb hallucination mitigation. 3. We probe model behavior from the perspective of vision-language interaction and token uncertainty, and study how well MLLMs learn verbs. Related Work MLLM Benchmarks. Before the emergence of MLLMs, great efforts have been made to build datasets on tasks like image captioning ( Chen et al. 2015 ; Sharma et al. 2018 ; Young et al. 2014 ) , VQA ( Goyal et al. 2017 ; Hudson and Manning 2019 ; Marino et al. 2019 ) , OCR ( Singh et al. 2019 ) , action recognition and detection ( Gu et al. 2018 ; Li et al. 2019 ; Li et al. 2020a ; Li et al. 2020b ; Li et al. 2020c ) , etc . However, they mainly assess domain-specific models. To fully evaluate MLLMs, more benchmarks have been proposed ( Liu et al. 2025 ; Ying et al. 2024 ; Yue et al. 2024 ; Li et al. 2024a ; Tong et al. 2024 ; Li et al. 2025 ) to test different aspects and subtasks. Benchmarks are also proposed to conduct detailed assessments on specific aspects, like BenchLMM ( Cai et al. 2025 ) for robustness against image styles and MMSpuBench ( Ye et al. 2024b ) for robustness against spurious correlations. MLLM Hallucination. Among the emerging benchmarks, hallucination has become a focus. Typically, hallucination means that the contents generated by models are untruthful, against facts, or nonsensical ( Ji et al. 2023 ; Liu et al. 2024b ; Zhang et al. 2025b ) . Many benchmarks on hallucination have been proposed ( Guan et al. 2024 ; Kaul et al. 2024 ; Wang et al. 2025 ; Chen et al. 2024a ; Zhong et al. 2024 ) . Among different types of hallucination, object hallucination ( Rohrbach et al. 2018 ) is deeper explored. Binary questions are used to probe hallucination about a certain class of objects in POPE ( Li et al. 2023 ) . CHAIR score ( Rohrbach et al. 2018 ) is used to measure object hallucination in image captioning. In most previous studies, only object concept hallucinations were covered by identifying whether MLLMs refer to objects nonexisting in the image or incorrect attributes of objects. Though some other phenomena are studied, such as event hallucination ( Jiang et al. 2024 ) , relationship hallucination ( Wu et al. 2024 ) , etc. , verb-related concepts, which are crucial to understanding human actions, were still neglected. Event is a complex combination of objects, verbs, adjectives, adverbs, etc. , and Hal-eval ( Jiang et al. 2024 ) tests event hallucination by introducing nonexisting objects and can be bypassed by mitigating object hallucination. Verbs are a kind of relation, but visual relationship also covers spatial relations, ownership, subject-place relations, attributes , etc. , which account for the majority. In this paper, we focus on the understanding of humans existing in the image , i.e. , a human-centric problem . Hallucination Mitigation. Researchers have revealed the reasons