GLSim : Detecting Object Hallucinations in LVLMs via Global-Local Similarity

Seongheon Park, Yixuan Li · 2025

Read GLSim : Detecting Object Hallucinations in LVLMs via Global-Local Similarity by Seongheon Park, Yixuan Li (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2508-19972.txt.

Description

Seongheon Park and co-authors present a detector for object hallucination in vision-language models, in work from 2025. Such models sometimes claim to see objects that are not in the image, a risk for real-world deployment. Past detectors scored each object from either a whole-image view or a local crop view, but not both.

Their framework, GLSim, combines both signals. It compares image and text embeddings at the global level and at the level of local regions, and merges the two similarity scores. The method needs no training. In benchmarks against existing detectors, it won by a clear margin across varied scenarios. The authors argue that pairing the two views catches errors that either view alone would miss.

Catalog record

CREATORSeongheon Park, Yixuan Li
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE56 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2508-19972

Browse the full library · About the Tower of Babel