Acknowledging Focus Ambiguity in Visual Questions

Chongyan Chen, Yu-Yun Tseng, Zhuoheng Li, Anush Venkatesh, Danna Gurari · 2025

Read Acknowledging Focus Ambiguity in Visual Questions by Chongyan Chen, Yu-Yun Tseng, Zhuoheng Li, Anush Venkatesh, Danna Gurari (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2501-02201.txt.

Description

Chongyan Chen and co-authors build the first dataset for focus ambiguity in visual questions, in a 2025 paper. When a question names a thing that appears in several spots of a photo, past question answering work ignored the doubt about which spot is meant. Their dataset grounds every plausible region a question could point to.

The authors compare the new set with older ones to show its distinct traits. They then score modern models on two fresh tasks: spotting whether a question is ambiguous in focus, and marking all plausible regions. Current models found both tasks hard. The dataset and a public scoring server are shared so future work can close the gap.

Catalog record

CREATORChongyan Chen, Yu-Yun Tseng, Zhuoheng Li, Anush Venkatesh, Danna Gurari
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE70 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2501-02201

Browse the full library · About the Tower of Babel