RAcQUEt : Unveiling the Dangers of Overlooked Referential Ambiguity in Visual LLMs

Alberto Testoni, Barbara Plank, Raquel Fernández · 2024

Read RAcQUEt : Unveiling the Dangers of Overlooked Referential Ambiguity in Visual LLMs by Alberto Testoni, Barbara Plank, Raquel Fernández (2024) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2412-13835.txt.

Introduction

Alberto Testoni, Barbara Plank, and Raquel Fernández probe ambiguous questions in image-based AI in a paper from 2024. A question about a picture can point to more than one thing in the scene. People resolve such ambiguity by asking follow-ups, but models may just guess. The team built a curated data set called RAcQUEt that targets several kinds of referential ambiguity.

Leading multimodal models often answered with misplaced confidence. A special subset showed a sharper risk, where unaddressed ambiguity led to stereotyped, biased replies. The authors argue models need honest ways to handle uncertainty. Guessing may look fluent while quietly spreading social bias. Their data set gives the field a focused test for this weakness.

Catalog record

CREATORAlberto Testoni, Barbara Plank, Raquel Fernández
YEAR2024
COLLECTIONPAPERS
FORMATTXT
FILE SIZE67 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2412-13835

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

RAcQUEt : Unveiling the Dangers of Overlooked Referential Ambiguity in Visual LLMs Alberto Testoni, Barbara Plank, Raquel Fernández Abstract Ambiguity resolution is key to effective communication. While humans effortlessly address ambiguity through conversational grounding strategies, the extent to which current language models can emulate these strategies remains unclear. In this work, we examine referential ambiguity in image-based question answering by introducing RAcQUEt , a carefully curated dataset targeting distinct aspects of ambiguity. Through a series of evaluations, we reveal significant limitations and problems of overconfidence of state-of-the-art large multimodal language models in addressing ambiguity in their responses. The overconfidence issue becomes particularly relevant for RAcQUEt-bias , a subset designed to analyze a critical yet underexplored problem: failing to address ambiguity leads to stereotypical, socially biased responses. Our results underscore the urgency of equipping models with robust strategies to deal with uncertainty without resorting to undesirable stereotypes. 1 Introduction Imagine the following situation: Anne and Bob walk through a busy intersection, with traffic from cars and buses all around. While Anne is focused on reading a city tour guide, Bob notices a vintage bus in the distance but is unable to read its destination. He turns to Anne and asks, “Where’s the bus headed?”. Anne has several ways she could respond to this question. She may recognize that the question is ambiguous, as it could refer to multiple buses and ask Bob for clarification. Alternatively, Anne might rely on her familiarity with Bob and infer that he is likely referring to the vintage bus. She could also choose to list all the destinations of the buses within her line of sight or simply glance at one of them and provide its destination. Extensive research in Linguistics and Cognitive Science revealed that ambiguity is an inherent feature of human language ( Piantadosi et al., 2012 ) . Ferreira (2008) discusses how successful communication relies on a “division of labor”, where speakers either minimize effort, leaving interpretation to listeners, or provide more detail to ease their burden. Addressing ambiguity is part of building and maintaining common ground , the information we assume we share with interlocutors, which allows speakers to stay in sync and achieve successful communication ( Clark, 1991 ; Clark, 1996 ) . Figure 1: Examples of ambiguous question-image pairs from RAcQUEt-general (A,B,C) and RAcQUEt-bias (D). While Large Language Models (LLMs) excel at generating fluent text and supporting diverse applications, building common ground remains a significant challenge. Shaikh et al. (2024) found that LLMs rely on far fewer conversational grounding acts than humans, often displaying overconfidence and a bias toward assuming grounding. Similarly, Liu et al. (2023) showed that even advanced LLMs struggle to identify ambiguity. Extending these findings, Pezzelle (2023) observed that Vision & Language Models also face difficulties handling semantic underspecification, a pragmatic feature closely linked to ambiguity. In this paper, we explore how Multimodal Vision & Language LLMs (VLMs) respond to ambiguous questions, such as those shown in Figure 1 . While prior research has primarily focused on syntactic or semantic ambiguity in text-only contexts, our study investigates referential ambiguity in images, where the intended referent is unclear due to multiple potential candidates present in the image. Referential ambiguity can arise for various reasons. For instance, users may not realize their question is ambiguous. This is particularly relevant for individuals with visual impairments, who may unintentionally pose ambiguous questions because their limited perception of the environment restricts their access to contextual information ( Bhattacharya et al., 2019 ) . Ambiguity may also occur if the dialogue history (which could provide context to clarify the question) is not accessible to the model for various reasons. We pay particular attention to analyzing an important and urgent aspect that has been overlooked in previous work, namely how failing to recognize ambiguity may lead to responses that exhibit biases and stereotypes. To address these issues, we introduce RAcQUEt : A dataset of R eferentially A mbiguous Que stions about images. RAcQUEt comprises 740 manually curated pairs of images and ambiguous referential questions in English, and it is divided into two different subsets: RAcQUEt-general , with real-world images from MSCOCO ( Lin et al., 2014 ) , and RAcQUEt-bias , with ad-hoc, generated images (with Dall-E 3 ) and questions that may trigger responses based on social biases and stereotypes if ambiguity is not recognized. Examples from the dataset are reported in Figure 1 . RAcQUEt does not include any ground-truth answers, as there are multiple valid ways to respond to such questions, as discussed above. Instead, we collect a range of human responses, categorize them into three distinct classes to gauge the way they respond to ambiguity, and use these for evaluating model outputs. We then assess several open-source, open-weight, and proprietary VLMs. While humans typically respond to questions in RAcQUEt by seeking clarification or listing multiple valid referents, indicating their recognition of ambiguity, models, on the other hand, tend to be overly confident, acknowledging ambiguity in a minority of instances. As anticipated, the extent of this issue varies across models, and our study highlights the promise of smaller, recently released models like the MOLMo family ( Deitke et al., 2024 ) . Our in-depth analyses, which involve the exploration of CoT and other prompting techniques, as well as an investigation with object localization tools, provide insights into the strengths and limitations of various models and offer inspiration for further research. The results in RAcQUEt-bias are a concerning warning sign about the models’ reliability, as their responses overwhelmingly reflect stereotypical interpretations. Code and data are publicly available at https://github.com/albertotestoni/RACQUET . 2 Related Work 2.1 Referential Ambiguity Referential ambiguity is widespread in human language. It occurs when readers or listeners cannot identify a single referent for a linguistic expression among multiple possible candidates. Nieuwland and Van Berkum (2008) reviewed a series of neuro-cognitive experiments (starting with the pioneering work of Van Berkum et al. 1999 ; Van Berkum et al. 2003 ), focusing on referential ambiguity in sentence and discourse comprehension and highlighted the distinctive neural mechanisms leveraged by humans to address ambiguity. Several behavioral studies found that ambiguous pronouns ( Gernsbacher, 1989 ; MacDonald and MacWhinney, 1990 ) and referentially-ambiguous nouns ( Myers and O’Brien, 1998 ; Stewart et al., 2007 ) slow down reading, indicating the cognitive cost of processing ambiguity. More closely related to our study, in the visual world paradigm ( Trueswell and Tanenhaus, 2005 ; Huettig et al., 2011 ) , previous work has found that when listeners encounter referentially ambiguous expressions, they distribute their eye fixations equally among the possible referents ( Sedivy et al., 1999 ; Spivey et al., 2002 ; Chambers et al., 2002 ; Chambers et al., 2004 ) . Along similar lines, Coco and Keller (2015) investigated the role of visual and linguistic saliency in human ambiguity resolution. In our work, we also investigate the role of the visual saliency of possible referents, but analyze model responses from state-of-the-art VLMs. 2.2 Ambiguity in the Era of (L)LMs Relatively little computational work has focused on addressing referential ambiguity in visual tasks. Berzak et al. (2015) introduced a corpus for grounded language understanding featuring ambiguous sentences that encompass a broad range of syntactic, semantic, and

Read the complete text