Look and Tell: A Dataset for Multimodal Grounding Across Egocentric and Exocentric Views

Anna Deichler, Jonas Beskow · 2025

Read Look and Tell: A Dataset for Multimodal Grounding Across Egocentric and Exocentric Views by Anna Deichler, Jonas Beskow (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2510-22672.txt.

Description

People point and look while they describe an object to someone seeing the room from another angle. Anna Deichler and Jonas Beskow introduce Look and Tell in 2025, a dataset for studying that referential communication across first person and outside views.

Recordings use smart glasses and fixed cameras as twenty five participants told a partner which kitchen ingredients to identify. Synchronized gaze, speech, and video come with three dimensional scene reconstructions. The set holds several hours of material and over two thousand annotated referring expressions. It benchmarks how two or three dimensional, first or third person representations affect grounding words in a shared scene.

Catalog record

CREATORAnna Deichler, Jonas Beskow
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE23 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2510-22672

Browse the full library · About the Tower of Babel