Look and Tell: A Dataset for Multimodal Grounding Across Egocentric and Exocentric Views
Anna Deichler, Jonas Beskow · 2025
Read Look and Tell: A Dataset for Multimodal Grounding Across Egocentric and Exocentric Views by Anna Deichler, Jonas Beskow (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2510-22672.txt.
Description
People point and look while they describe an object to someone seeing the room from another angle. Anna Deichler and Jonas Beskow introduce Look and Tell in 2025, a dataset for studying that referential communication across first person and outside views.
Recordings use smart glasses and fixed cameras as twenty five participants told a partner which kitchen ingredients to identify. Synchronized gaze, speech, and video come with three dimensional scene reconstructions. The set holds several hours of material and over two thousand annotated referring expressions. It benchmarks how two or three dimensional, first or third person representations affect grounding words in a shared scene.
Catalog record
| CREATOR | Anna Deichler, Jonas Beskow |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 23 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2510-22672