Instruction Lens Score: Your Instruction Contributes a Powerful Object Hallucination Detector for Multimodal Large Language Models

Runhe Lai, Xinhua Lu, Yanqi Wu, Jinlun Ye, Weijiang Yu, Ruixuan Wang · 2026

Read Instruction Lens Score: Your Instruction Contributes a Powerful Object Hallucination Detector for Multimodal Large Language Models by Runhe Lai, Xinhua Lu, Yanqi Wu, Jinlun Ye, Weijiang Yu, Ruixuan Wang (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-12258.txt.

Introduction

Runhe Lai and five colleagues show that instruction tokens can power object hallucination detection in multi-mode language models. Token embeddings quietly encode visual information while sifting errors from false visual codes. Their Instruction Lens Score joins two scores: a Calibrated Local Score, and a Context Consistency Score gauging match of object tokens. The method works plug-and-play, needing no extra models or extra training. Tests across benchmarks and model designs show it always beats past detection methods.

Catalog record

CREATORRunhe Lai, Xinhua Lu, Yanqi Wu, Jinlun Ye, Weijiang Yu, Ruixuan Wang
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE67997
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2605.12258

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Instruction Lens Score: Your Instruction Contributes a Powerful Object Hallucination Detector for Multimodal Large Language Models Runhe Lai, Xinhua Lu, Yanqi Wu, Jinlun Ye, Weijiang Yu, Ruixuan Wang Abstract Multimodal large language models (MLLMs) have achieved remarkable progress, yet the object hallucination remains a critical challenge for reliable deployment. In this paper, we present an in-depth analysis of instruction token embeddings and reveal that they implicitly encode visual information while effectively filtering erroneous information introduced by misleading visual embeddings. Building on this insight, we propose the Instruction Lens Score (InsLen), which combines a Calibrated Local Score with a Context Consistency Score that measures context consistency of the object tokens. The proposed approach serves as a plug-and-play object hallucination detector without relying on auxiliary models or additional training. Extensive experiments across multiple benchmarks and diverse MLLM architectures demonstrate that InsLen consistently outperforms existing hallucination detection methods, highlighting its effectiveness and robustness. The code is available at https://github.com/Fraserlairh/Instruction-Lens-Score . † † affiliationnotice: Equal contribution 1 Introduction In recent years, Multimodal Large Language Models (MLLMs) have demonstrated impressive abilities in multimodal understanding, reasoning, and interaction, enabling a wide range of real-world applications. However, the object hallucination (OH) issue in MLLMs significantly undermines their reliability in real-world deployment, where models generate responses that are inconsistent with the actual objects present in the input images ( 11 ) . Therefore, detecting hallucinated objects in the responses generated by MLLMs has become a crucial component for building reliable AI systems ( 40 ) . Figure 1 : Illustration of instruction embeddings filtering misleading visual information. By applying the Logit Lens to intermediate embeddings, we observe that instruction embeddings (green) consistently assign higher confidence to image-grounded concepts (e.g., people, snow, and ski), while suppressing hallucinated objects (e.g., bag). See more qualitative examples in Appendix A.4 . Some studies ( 20 ; 15 ; 26 ) detect OH with auxiliary models such as GPT-4 ( 1 ) . However, their deployment comes with considerable computational overhead. Another line of research ( 39 ; 13 ; 14 ; 27 ; 6 ) analyzes potential causes of OH by examining intermediate outputs of the model. In particular, visual information has become a central cue for detection, including attention weights over visual tokens ( 14 ) and similarity between textual answer embeddings and patch-level image embeddings ( 27 ) . However, these vision-based scores can be adversely affected by misleading visual information introduced by the visual encoder ( 10 ; 22 ) or during cross-modal interactions within the language model ( 31 ) , which may result in spuriously high confidence for hallucinated objects. To address these limitations, we delve into the embeddings of instruction tokens and reveal a key finding, i.e., misleading information introduced by visual embeddings can be effectively filtered out by instruction embeddings. As shown in Figure 1, the Logit Lens technique ( 25 ) is employed to interpret the embeddings corresponding to image patches and instruction tokens in MLLM’s vocabulary. We observe that part of the instruction embeddings encodes object-related visual cues grounded in the image alongside the prediction of instruction tokens. Meanwhile, hallucination arising from misleading visual embeddings (e.g., the “bag” in Figure 1 ) is often assigned low confidence in the instruction embeddings. In Section 4.1 , a statistical analysis is also provided to support our observation. These findings highlight an overlooked capability of instruction embeddings for detecting object hallucination. Building on this insight, we design an InsLen score for object hallucination detection, where instruction embeddings are used both to calibrate misleading visual information and to provide object-related contextual cues. Accordingly, the InsLen score consists of two complementary components: (1) Calibrated Local Score, which calibrates spurious high-confidence predictions from vision-based scores; (2) Context Consistency Score, which measures the consistency between the embeddings of generated objects in the textual answer and object-related instruction embeddings. Specifically, the Calibrated Local Score introduces a Calibration Confidence by measuring the maximum confidence assigned to the object answer token across instruction embeddings, thereby leveraging the filtering effect of instruction embeddings. This confidence is combined with vision-based scores adopted in previous work ( 13 ; 14 ; 27 ) to calibrate local visual evidence. On the other hand, existing vision-based scores are derived from patch-level image embeddings, where local visual patterns may overlap between real and hallucinated objects (e.g., similar silver materials for spoons and knives), making it difficult to distinguish hallucinated objects that visually resemble real ones. To address this limitation, we leverage instruction embeddings, which are computed conditioned on all image embeddings through cross-modal attention, and capture the global information about objects. Therefore, instruction embeddings that assign high confidence to the object token are collected to provide global context cues about the object token. The Context Consistency Score then evaluates whether the generated object in the answer output is consistent with such global object context encoded in instruction embeddings, which helps distinguish hallucinations caused by similar local visual patterns from true objects. Combining the two scores, our InsLen score jointly captures calibrated patch-level visual evidence and global contextual consistency, enabling more reliable detection of hallucinated objects. The main contributions of this paper are summarized as follows. • An analysis of instruction embeddings in MLLMs is conducted and reveals a key finding that misleading information introduced by visual embeddings can be effectively filtered out by instruction embeddings. • The Instruction Lens Score is proposed, which integrates a Calibrated Local Score with a Context Consistency Score for object hallucination detection. • Extensive experiments are conducted from multiple perspectives, demonstrating the effectiveness and robustness of the proposed InsLen score on object hallucination detection benchmarks. 2 Related Work Multimodal Large Language Models. Building on the rapid progress of Large Language Models (LLMs), such as LLaMA ( 35 ) and Mixtral ( 12 ) , recent studies have increasingly extended language-centric reasoning to multimodal settings, resulting in various multimodal large language models (MLLMs). LLaVA-1.5 ( 21 ) and InstructBLIP ( 8 ) are widely used open-source representatives of MLLMs, while more recent MLLMs have incorporated advanced techniques (e.g., DeepStack ( 24 ) ), including mPLUG-Owl3 ( 36 ) , Qwen3-VL ( 3 ) , and LLaVA-OneVision1.5-Instruct ( 2 ) . However, hallucination remains a persistent challenge for MLLMs, which can substantially impair their reliability across a variety of vision–language tasks ( 4 ) . Object Hallucination Detection and Mitigration. Object hallucination issue (OH) refers to the phenomenon that MLLMs generate descriptions of objects that do not exist in the visual input. This issue poses significant risks to the reliability of MLLM-based systems, especially in safety-critical applications such as medical imaging ( 40 ) . One line of approaches aims to mitigate hallucination through improved training paradigms ( 37 ; 38 ) and decoding-time interventions ( 9 ; 17 ; 28 ; 34 ; 7 ) . In particular, contrastive decoding methods ( 17 ; 28 ; 7 ) reduce hallucinations by contrasting outputs generated under different visual conditions or decoding trajectories, thereby encouraging stronger reliance on visual evidence and suppressing language priors. Another line of approaches propose to detect hallucination, which can be broadly categorized into methods that rely on auxiliary models and those that exploit internal signals of MLLMs. For example, GAVIE ( 20

Read the complete text