PointArena: Probing Multimodal Grounding Through Language-Guided Pointing
Long Cheng, Jiafei Duan, Yi Ru Wang, Haoquan Fang, Boyang Li, Yushan Huang, Elvis Wang, Ainaz Eftekhar, Jason Lee, Wentao Yuan, Rose Hendrix, Noah A. Smith, Fei Xia, Dieter Fox, Ranjay Krishna · 2025
Read PointArena: Probing Multimodal Grounding Through Language-Guided Pointing by Long Cheng, Jiafei Duan, Yi Ru Wang, Haoquan Fang, Boyang Li, Yushan Huang, Elvis Wang, Ainaz Eftekhar, Jason Lee, Wentao Yuan, Rose Hendrix, Noah A. Smith, Fei Xia, Dieter Fox, Ranjay Krishna (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2505-09990.txt.
Description
Cheng and fourteen co-authors present PointArena, a 2025 platform for testing how well AI models point at what language refers to. Pointing grounds words in the visual world, a skill robots and assistive tools need. Earlier benchmarks mostly checked simple object finding. PointArena adds a bench of about 1,000 pointing tasks across five reasoning types. It also adds a live arena where models duel blindly, already holding over 4,500 votes, and a robot arm setup for real-world trials.
Across open and proprietary models, Molmo-72B led, with commercial models closing in. Training aimed at pointing clearly boosted scores. Results across the three stages correlated strongly. The authors argue precise pointing is the hinge between abstract model reasoning and physical action.
Catalog record
| CREATOR | Long Cheng, Jiafei Duan, Yi Ru Wang, Haoquan Fang, Boyang Li, Yushan Huang, Elvis Wang, Ainaz Eftekhar, Jason Lee, Wentao Yuan, Rose Hendrix, Noah A. Smith, Fei Xia, Dieter Fox, Ranjay Krishna |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 35 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2505-09990