VAUQ: Vision-Aware Uncertainty Quantification for LVLM Self-Evaluation
Seongheon Park, Changdae Oh, Hyeong Kyu Choi, Xuefeng Du, Sharon Li · 2026
Read VAUQ: Vision-Aware Uncertainty Quantification for LVLM Self-Evaluation by Seongheon Park, Changdae Oh, Hyeong Kyu Choi, Xuefeng Du, Sharon Li (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2602-21054.txt.
Description
Large vision-language models hallucinate, and existing self-evaluation methods lean on language priors that fit text better than vision. Seongheon Park, Changdae Oh, Hyeong Kyu Choi, Sean Du, and Sharon Li propose a vision-aware alternative in this 2026 arXiv paper. VAUQ is a framework for self-evaluation that measures how strongly an output depends on visual evidence. Its Image-Information Score captures how much visual input reduces predictive uncertainty.
An unsupervised core-region masking strategy amplifies salient regions, and combining predictive entropy with the masked score yields a training-free measure that tracks answer correctness. Experiments show VAUQ consistently beating existing self-evaluation methods across several datasets. The work gives deployers a reliability signal grounded in what the model actually saw.
Catalog record
| CREATOR | Seongheon Park, Changdae Oh, Hyeong Kyu Choi, Xuefeng Du, Sharon Li |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 45 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2602-21054