Verification Mirage: Mapping the Reliability Boundary of Self-Verification in Medical VQA
Ruinan Jin, Beidi Zhao, Myeongkyun Kang, Qiong Zhang, Xiaoxiao Li · 2026
Read Verification Mirage: Mapping the Reliability Boundary of Self-Verification in Medical VQA by Ruinan Jin, Beidi Zhao, Myeongkyun Kang, Qiong Zhang, Xiaoxiao Li (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-10850.txt.
Introduction
Ruinan Jin and four colleagues warn that asking a medical vision-language model to check its own answers is far weaker protection than it looks. Self-verification reuses the same model in a fresh context, and teams increasingly treat it as a default safety layer for medical visual question answering.
Their diagnostic tool, VeriMap, splits verifier behavior into discrimination skill and agreement bias. Tests across six open models, five datasets, and seven tasks show the verifier often agrees with wrong answers, creating a mirage of accuracy deepest in knowledge-heavy clinical tasks. Hospitals and builders learn that self-checks are no substitute for independent verification.
Catalog record
| CREATOR | Ruinan Jin, Beidi Zhao, Myeongkyun Kang, Qiong Zhang, Xiaoxiao Li |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 73132 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2605.10850
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Verification Mirage: Mapping the Reliability Boundary of Self-Verification in Medical VQA Ruinan Jin, Beidi Zhao, Myeongkyun Kang, Qiong Zhang, Xiaoxiao Li Abstract Self-verification, re-invoking the same vision language model (VLM) with identical parameters but in a fresh, independent context to check its own generated answer, is increasingly treated as a default safety layer for medical visual question answering (VQA). We argue this practice is fundamentally unreliable. We introduce VeriMap , a diagnostic framework that maps the reliability boundary of medical VLM self-verification. It decomposes verifier behavior along two axes: discrimination capability and agreement bias . In self-verification, the verifier and the answer generator are capacity-coupled, so the verifier overly agrees with the generator, sustaining a high appearance of accuracy for the generator. We call this a verification mirage : a regime where the verifier is simultaneously high in verifier error and high in agreement bias , driven by systematic false acceptance of incorrect answers. In this work, evaluating six open-weight VLMs across five medical VQA datasets and seven medical tasks, we reveal that: (i) The boundary is task-conditioned. Knowledge-intensive clinical tasks sit deepest in the mirage, and simpler tasks are more resistant, with perceptual tasks falling in between. (ii) Verification is not an independent safety signal. Our logistic mixed-effects analysis shows verifier error and agreement bias are significantly more likely when the generator errs, and saliency analyses confirm verifiers under-attend to image evidence relative to generators. We call this phenomenon as lazy verifier . (iii) Cross-verification can reduce verification mirage, though the mirage is not fully eliminated. (iv) The failure is amplified rather than corrected when verification is reused: in multi-turn actor-verifier loops, most initially wrong answers are locked in by false verification. In this work, our setup uses clean benchmarks, the observed boundary likely underestimates failures in real clinical deployment. 1]The University of British Columbia 2]Vector Institute 3]Redmin University of China 1 Introduction Medical visual question answering (VQA) is one of the highest-stakes applications of vision-language models (VLMs). From chest X-ray report generation ( 19 ) to histopathology question answering ( 32 ) , VLMs are increasingly being considered for clinical and biomedical use. However, a fundamental safety question remains: how do we know when a VLM’s output is wrong? Hallucinated findings, misidentified anatomy, incorrect disease labels, and unsupported diagnostic explanations can all become false clinical claims in settings where reliability is critical. A natural response is self-verification : re-invoking the same VLM, with identical parameters but in an independent context, to check its own generated answer at inference time, as shown in Fig. 1 . This strategy is attractive because it is lightweight, requires no additional labeled data or external tools, and integrates directly into existing VLM pipelines. Self-verification has been widely adopted at inference time in VLM tasks ( 41 ; 35 ; 28 ) , and even used as a reward signal in reinforcement learning ( 18 ) . In the medical domain, it underlies clinical fact-checking and report verification approaches ( 8 ; 17 ) . All of these approaches rely on an implicit promise: even when generation fails, recognition may still succeed ( 12 ; 29 ) . We argue that this promise is unreliable in medical VQA tasks, a challenging and high-stakes application field. In self-verification, the verifier and generator share model capacity, training distribution, visual grounding limitations, and medical knowledge boundaries. If the generator fails due to the lack of the relevant visual evidence or clinical knowledge, the verifier may fail for the same reason. Self-verification may therefore become a consistency check over the model’s own answer rather than an independent correctness check. Figure 1 : Overall study pipeline. (a) Medical VQA verification is studied through a generator–verifier setup: a generator answers an image-question pair, and a verifier judges the answer against an oracle correctness label. We evaluate both single-turn verification and multi-turn feedback loops, and compare self- and cross-verification across general-domain and medical-domain VLMs. (b) Experiments cover five medical VQA datasets and seven task types, from perceptual recognition to knowledge-intensive clinical reasoning. (c) VeriMap decomposes verifier behavior into discrimination capability and agreement bias, exposing the high-error, high-bias verification mirage regime. Existing evaluations are often too coarse to expose this problem. By reporting only a single aggregate verifier-accuracy score over all medical VQA tasks ( 42 ; 47 ) , prior work implicitly treats medical VQA as a homogeneous problem and conflates two qualitatively different failure modes: failing to discriminate correct from incorrect answers, and over-accepting whatever the generator proposed. The conflation hides a regime that is uniquely dangerous in medicine: when the verifier and generator share model capacity, the verifier tends to overly agree with the generator’s answer, sustaining the appearance of accuracy while being simultaneously high in verifier error and high in agreement bias , driven by systematic false acceptance of incorrect answers. We call this regime the verification mirage . The failure is especially dangerous in medicine, where marking an incorrect medical answer as correct can carry direct clinical risk. We therefore ask: can VLMs be reliable self-verifiers in medical VQA tasks? To answer this question, we introduce VeriMap , a diagnostic framework for mapping the reliability boundary of medical VLM self-verification. We operationalize verification as error detection over generated answers and evaluate it across five medical VQA benchmarks and diverse VLMs. Whereas prior evaluations report only a single aggregate verifier-accuracy score over all medical VQA tasks, VeriMap introduces three complementary novelties : (i) a task-type decomposition from perceptual tasks (modality recognition, anatomical identification, spatial cognition) to knowledge-intensive clinical tasks (disease classification, differential diagnosis, causal reasoning), along which generator accuracy itself drops sharply; (ii) a two-axis decomposition of verifier behavior into discrimination capability (verifier accuracy, i.e., the ability to distinguish correct from incorrect answers) and agreement bias (the tendency to accept a proposed answer regardless of correctness), instead of a single accuracy number; and (iii) a generator-coupled analysis that studies how verifier accuracy and verifier agreement bias covary with generator accuracy across these categories, pinpointing precisely when the verification mirage emerges, namely the regimes in which the verifier still appears accurate yet disproportionately endorses the generator’s wrong answers. Our analysis reveals four properties of this reliability boundary. (i) The mirage is task-conditioned. Knowledge-intensive clinical tasks (differential diagnosis, causal explanation, disease classification) sit deepest in the mirage quadrant and remain unreliable across all evaluated models, including medical-specialized ones; structured tasks like quantitative measurement are most resistant, while perceptual tasks (modality, anatomy, spatial) span the middle. (ii) Verifiers are lazy, not independent of generators. A logistic mixed-effects analysis shows verifier error is significantly more likely when the generator errs, and saliency analyses reveal a lazy-verifier effect : verifiers attend less to image evidence than generators do, especially on false positives. (iii) Cross-verification can reduce verification mirage. Verification across different model families, training corpora, and parameter scales can lower agreement bias and verification error, even though the mirage is not fully eliminated. (iv) Errors compound rather than self-correct. In multi-turn actor-verifier loops, false verification locks in initially wrong answers, turning isolated verifier mistakes into system-level failures. Our findings highlight that medical VLM self-verification cannot serve as a universal safety layer. The central question is not whether a model agrees with its own