VIHD: Visual Intervention-based Hallucination Detection for Medical Visual Question Answering
Jiayi Chen (✉), Benteng Ma, Zehui Liao, Winston Chong, Yasmeen George, Jianfei Cai · 2026
Read VIHD: Visual Intervention-based Hallucination Detection for Medical Visual Question Answering by Jiayi Chen (✉), Benteng Ma, Zehui Liao, Winston Chong, Yasmeen George, Jianfei Cai (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-20772.txt.
Introduction
Jiayi Chen and five colleagues present VIHD, a visual intervention method for spotting false answers in medical visual question answering. Medical multimodal models can produce fluent answers that lack visual evidence, risking clinical choices. Existing checks rely on uncertainty estimates or on heuristic outside perturbations that ignore internal cross-modal links. VIHD instead masks chosen visual tokens during output to tune meaning entropy, finding visual-heavy decoder layers that drive false tokens.
Catalog record
| CREATOR | Jiayi Chen (✉), Benteng Ma, Zehui Liao, Winston Chong, Yasmeen George, Jianfei Cai |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 21416 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2605.20772
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
VIHD: Visual Intervention-based Hallucination Detection for Medical Visual Question Answering Jiayi Chen (✉), Benteng Ma, Zehui Liao, Winston Chong, Yasmeen George, Jianfei Cai Abstract While medical Multimodal Large Language Models (MLLMs) have shown promise in assisting diagnosis, they still frequently generate hallucinated responses that appear linguistically plausible but lack visual evidence. Such hallucinations pose risks to clinical decision-making and necessitate effective detection. Existing introspective detection methods primarily perform uncertainty estimation or logical verification by analyzing model responses conditioned on original or perturbed inputs. However, such external perturbations are often heuristic and context-agnostic, which overlooks the internal cross-modal dependency between generated tokens and related visual tokens during decoding. To address this issue, we propose VIHD, a V isual I ntervention-based H allucination D etection method that leverages targeted visual token masking to calibrate semantic entropy for more effective hallucination detection. VIHD locates visually dominant decoder layers via Visual Dependency Probing (VDP) , executes Visual Intervention Decoding (VID) via token masking to calibrate the semantic distribution, and quantifies the resulting Calibrated Semantic Entropy (CSE) as a reliable hallucination signal. Extensive experiments on three medical VQA benchmarks with two medical MLLMs demonstrate that VIHD consistently outperforms state-of-the-art methods, underscoring the importance of fine-grained visual dependency for hallucination detection. The code will be available at https://github.com/Jiayi-Chen-AU/VIHD . 1 Introduction Medical multimodal large language models (MLLMs) have shown remarkable efficacy in assisting medical diagnosis, supporting visual question answering (VQA) and automated report generation [ 15 , 21 , 10 , 25 ] . However, these models are susceptible to hallucinated responses that are linguistically coherent yet contradict visual evidence [ 17 , 11 ] . This issue poses risks to clinical decision-making and underscores the need for effective hallucination detection. Existing hallucination detection methods can be broadly categorized into three paradigms: supervised detection, external verification, and introspective detection. Supervised methods [ 6 , 2 , 24 , prabhakaran2025vade ] typically train auxiliary detectors on annotated hallucination datasets. While effective in-distribution, they hinge on labor-intensive annotations and generalize poorly to novel domains or architectures. External verification [ 3 , 27 , 26 , 22 ] leverages auxiliary LLMs, MLLMs, or knowledge bases to validate model outputs, but introduces substantial computational overhead and relies heavily on external tools. In contrast, introspective approaches [ 16 , 5 , 17 , 23 , 11 ] are entirely self-contained, requiring neither extra training nor external resources, making them efficient and deployment-friendly. Existing introspective approaches typically estimate token uncertainty [ 16 , 19 ] , semantic uncertainty [ 5 , 28 , 17 ] , or logical consistency [ 23 , 11 ] by analyzing model responses to original or perturbed inputs. However, such external perturbations are inherently heuristic and context-agnostic [ 9 ] . They treat MLLMs as black boxes, failing to probe the internal causal dependencies between generated tokens and visual evidence during decoding. To mitigate this issue, we propose VIHD, a training-free V isual I ntervention-based H allucination D etection method, that probes the fidelity of cross-modal reasoning through targeted token-level interventions. VIHD operates in three stages. First, we identify visually dominant layers in the LLM decoder where cross-modal attention is most prominent. Secondly, we introduce a visual intervention decoding scheme that masks high-attention visual tokens to produce intervened responses, thereby revealing the model’s dependency on specific visual evidence. Third, we design an adaptive strategy that integrates original and intervened semantic distributions via complementary or contrastive fusion, yielding a calibrated semantic entropy metric for hallucination detection. Our main contributions are threefold: (1) We introduce VIHD, a training-free framework that harnesses fine-grained visual interventions to probe internal causal dependencies for hallucination detection. (2) We design an adaptive pipeline that identifies critical decoder layers, performs attention-guided visual token masking, and derives calibrated semantic entropy to quantify hallucination severity. (3) Extensive experiments on three medical VQA benchmarks and two medical MLLMs demonstrate the superiority of VIHD in hallucination detection. 2 Methodology As illustrated in Fig. 1 , VIHD detects hallucinations via fine-grained and targeted visual interventions. It comprises three components: (1) Visual Dependency Probing , which pinpoints visually dominant decoder layers for targeted intervention; (2) Visual Intervention Decoding , which performs attention-guided token masking to produce intervened responses; (3) Calibrated Semantic Entropy , which calibrates semantic distribution based on normal and intervened responses and quantifies semantic entropy as a hallucination signal. Figure 1: Framework of VIHD. VIHD comprises (a) visual dependency probing, (b) visual intervention decoding, and (c) calibrated semantic entropy. 2.1 Visual Dependency Probing (VDP) Given an input image x_{v} and a textual query x_{q} , a medical MLLM parametrized with \theta generates a response r=(r_{1},\dots,r_{T}) autoregressively, where T is the sequence length. The probability of generating response r [ 14 ] is factorized as: p_{\theta}(r|x_{v},x_{q})=\prod_{t=1}^{T}p_{\theta}(r_{t}\mid x_{v},x_{q},r_{<t}). (1) where r_{t} is the t -th generated token and r_{<t} is the preceding sequence. Hallucinations often arise when tokens are generated primarily from linguistic priors without sufficient visual evidence. To quantify visual dependency during decoding, we first analyze the attention interactions between generated tokens and the input sequence. Let \mathbf{Q}_{r}^{(l)}\in\mathbb{R}^{T\times d} denote the query matrix of generated tokens and \mathbf{K}^{(l)}\in\mathbb{R}^{N\times d} represent the key matrix of the input sequence. The attention matrix \mathbf{A}^{(l,h)}\in\mathbb{R}^{T\times N} for the h -th head is computed as: \mathbf{A}^{(l,h)}=\text{softmax}\left(\frac{\mathbf{Q}_{r}^{(l,h)}{\mathbf{K}^{(l,h)}}^{\top}}{\sqrt{d_{h}}}\right),\quad h\in\{1,\dots,H\}, (2) where d_{h}=\frac{d}{H} denotes the head dimension. We then quantify the layer-wise visual dependency s^{(l)} by aggregating the attention weights assigned to visual tokens (indexed by \mathcal{V} ) across all heads and generation tokens: s^{(l)}=\frac{1}{H\cdot T}\sum_{h=1}^{H}\sum_{t=1}^{T}\sum_{v\in\mathcal{V}}A^{(l,h)}_{t,v}. (3) Finally, we localize a window of w consecutive layers with the strongest visual dependency [l^{*},\ {l^{*}{+}w{-}1}] . The optimal starting layer l^{*} is defined as: l^{*}=\operatorname*{argmax}_{l}\left(\frac{1}{w}\sum_{i=0}^{w-1}s^{(l+i)}\right). (4) 2.2 Visual Intervention Decoding (VID) After identifing visually dominant layers via VDP, we propose the visual intervention decoding algorithm to generate the intervened response r^{\prime} . Given a visual input x_{v} and a textual query x_{q} , VID dynamically intervens the decoding process by applying fine-grained and targeted visual token masking. For each visually dominant layer l , we calculate the attention weights between the generated token and visual tokens at each generation step t . \mathbf{A}_{t,v}^{(l)}=\frac{1}{H}\sum_{h=1}^{H}\mathbf{A}_{t,v}^{(l,h)},\quad(l\in[l^{*},l^{*}{+}w{-}1]). (5) We then mask the top- \rho fraction of visual tokens with the highest attention weight \mathbf{A}_{t,v}^{(l)} to suppress their contribution. The intervened response r^{\prime} is then generated conditioned on the perturbed visual representation. The probability of generating r^{\prime} is formulated as: p_{\theta}(r^{\prime})=\prod_{t=1}^{T}p_{\theta}(r_{t}^{\prime}|x_{v},x_{q},r_{<t}^{\prime}). (6) 2.3 Calibrated Semantic Entropy (CSE) To enhance hallucination detection, we compute semantic entropy [ 5 ] over a calibrated semantic distribution. Specifically, we perform M independent sampling runs to obtain two sets of responses: M normal responses \{r^{(i)}\}_{i=1}^{M} and M visual-intervened responses \{r^{\prime(i)}\}_{i=1}^{M} . Then, we utilize DeBERTa-Large-MNLI [ 7 ] to cluster them into N semantic-equivalence classes [ 12 ] , yielding a normal semantic distribution P(s|x_{v},x_{q}) and a visual-intervened one P(s^{\prime}|x_{v},x_{q}) . Crucially, visual intervention impacts vary by query granularity. General queries ( e.g. , imaging modalities) remain robust to token masking, while detailed ones are relatively susceptible to semantic shifts. Accordingly, we propose an adaptive fusion strategy based on distribution alignment. When the intervened distribution aligns closely with the original, we treat token masking as a weak perturbation and apply complementary fusion to reinforce shared semantics. Conversely, we adopt contrastive