VAUQ: Vision-Aware Uncertainty Quantification for LVLM Self-Evaluation

Seongheon Park, Changdae Oh, Hyeong Kyu Choi, Xuefeng Du, Sharon Li · 2026

Read VAUQ: Vision-Aware Uncertainty Quantification for LVLM Self-Evaluation by Seongheon Park, Changdae Oh, Hyeong Kyu Choi, Xuefeng Du, Sharon Li (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2602-21054.txt.

Description

Large vision-language models hallucinate, and existing self-evaluation methods lean on language priors that fit text better than vision. Seongheon Park, Changdae Oh, Hyeong Kyu Choi, Sean Du, and Sharon Li propose a vision-aware alternative in this 2026 arXiv paper. VAUQ is a framework for self-evaluation that measures how strongly an output depends on visual evidence. Its Image-Information Score captures how much visual input reduces predictive uncertainty.

An unsupervised core-region masking strategy amplifies salient regions, and combining predictive entropy with the masked score yields a training-free measure that tracks answer correctness. Experiments show VAUQ consistently beating existing self-evaluation methods across several datasets. The work gives deployers a reliability signal grounded in what the model actually saw.

Catalog record

CREATORSeongheon Park, Changdae Oh, Hyeong Kyu Choi, Xuefeng Du, Sharon Li
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE45 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2602-21054

Browse the full library · About the Tower of Babel