DO-Bench: An Attributable Benchmark for Diagnosing Object Hallucination in Vision-Language Models
JiYang Wang ∗, Jiawei Chen ∗, Mengqi Xiao, Yu Cheng, Yangfu Li, Zhaoxia Yin † · 2026
Read DO-Bench: An Attributable Benchmark for Diagnosing Object Hallucination in Vision-Language Models by JiYang Wang ∗, Jiawei Chen ∗, Mengqi Xiao, Yu Cheng, Yangfu Li, Zhaoxia Yin † (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-22822.txt.
Description
Wang and five colleagues build DO-Bench to diagnose why vision-language models wrongly claim objects exist. Aggregate accuracy hides two separate causes, and the benchmark separates them. One dimension strengthens misleading textual hints while holding the image fixed, testing resistance to prior pressure. The other sharpens visual evidence from full scenes down to object crops, testing perceptual grounding. With two new metrics, tests across open and closed models show hallucination patterns differ by mechanism, not just by overall error rate.
Catalog record
| CREATOR | JiYang Wang ∗, Jiawei Chen ∗, Mengqi Xiao, Yu Cheng, Yangfu Li, Zhaoxia Yin † |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 36439 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2604.22822