Getting to the Point: Why Pointing Improves LVLMs

Simone Alghisi, Massimo Rizzoli, Seyed Mahed Mousavi, Giuseppe Riccardi · 2026

Read Getting to the Point: Why Pointing Improves LVLMs by Simone Alghisi, Massimo Rizzoli, Seyed Mahed Mousavi, Giuseppe Riccardi (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-21746.txt.

Description

Alghisi and co-authors study why asking vision-language models to point first improves their counting. In the Point-then-Count setup, the model lists coordinates for each target object, then gives the total. Across fine-tuned and training-free variants, it earned the highest accuracy on zero-shot counting. The predicted points landed on the right objects in over 94 percent of cases. The gain comes from spatial facts encoded in the coordinates. Pointing also helped on new kinds of images, though grounding strength varied by region.

Catalog record

CREATORSimone Alghisi, Massimo Rizzoli, Seyed Mahed Mousavi, Giuseppe Riccardi
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE54497
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2603.21746

Browse the full library · About the Tower of Babel