LVLM-Count: Enhancing the Counting Ability of Large Vision-Language Models

Muhammad Fetrat Qharabagh, Mohammadreza Ghofrani, Kimon Fountoulakis · 2024

Read LVLM-Count: Enhancing the Counting Ability of Large Vision-Language Models by Muhammad Fetrat Qharabagh, Mohammadreza Ghofrani, Kimon Fountoulakis (2024) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2412-00686.txt.

Description

Counting objects in a photo sounds simple, yet large vision-language models often get it wrong, and a 2024 paper by Muhammad Fetrat Qharabagh, Mohammadreza Ghofrani, and Kimon Fountoulakis tackles the gap. The team tested several models on counting tasks drawn from many data sets.

Small counts were handled fairly well, but errors grew fast as the number of objects rose. Their fix splits the task: the image is cut into parts, each part is counted, and the counts are summed. A guard keeps objects from being split across cuts, which would cause double counts. The method improved scores across the test sets and gives later work a clear baseline to beat.

Catalog record

CREATORMuhammad Fetrat Qharabagh, Mohammadreza Ghofrani, Kimon Fountoulakis
YEAR2024
COLLECTIONPAPERS
FORMATTXT
FILE SIZE74 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2412-00686

Browse the full library · About the Tower of Babel