DO-Bench: An Attributable Benchmark for Diagnosing Object Hallucination in Vision-Language Models

JiYang Wang ∗, Jiawei Chen ∗, Mengqi Xiao, Yu Cheng, Yangfu Li, Zhaoxia Yin † · 2026

Read DO-Bench: An Attributable Benchmark for Diagnosing Object Hallucination in Vision-Language Models by JiYang Wang ∗, Jiawei Chen ∗, Mengqi Xiao, Yu Cheng, Yangfu Li, Zhaoxia Yin † (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-22822.txt.

Description

Wang and five colleagues build DO-Bench to diagnose why vision-language models wrongly claim objects exist. Aggregate accuracy hides two separate causes, and the benchmark separates them. One dimension strengthens misleading textual hints while holding the image fixed, testing resistance to prior pressure. The other sharpens visual evidence from full scenes down to object crops, testing perceptual grounding. With two new metrics, tests across open and closed models show hallucination patterns differ by mechanism, not just by overall error rate.

Catalog record

CREATORJiYang Wang ∗, Jiawei Chen ∗, Mengqi Xiao, Yu Cheng, Yangfu Li, Zhaoxia Yin †
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE36439
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2604.22822

Browse the full library · About the Tower of Babel