LVLM-Count: Enhancing the Counting Ability of Large Vision-Language Models
Muhammad Fetrat Qharabagh, Mohammadreza Ghofrani, Kimon Fountoulakis · 2024
Read LVLM-Count: Enhancing the Counting Ability of Large Vision-Language Models by Muhammad Fetrat Qharabagh, Mohammadreza Ghofrani, Kimon Fountoulakis (2024) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2412-00686.txt.
Description
Counting objects in a photo sounds simple, yet large vision-language models often get it wrong, and a 2024 paper by Muhammad Fetrat Qharabagh, Mohammadreza Ghofrani, and Kimon Fountoulakis tackles the gap. The team tested several models on counting tasks drawn from many data sets.
Small counts were handled fairly well, but errors grew fast as the number of objects rose. Their fix splits the task: the image is cut into parts, each part is counted, and the counts are summed. A guard keeps objects from being split across cuts, which would cause double counts. The method improved scores across the test sets and gives later work a clear baseline to beat.
Catalog record
| CREATOR | Muhammad Fetrat Qharabagh, Mohammadreza Ghofrani, Kimon Fountoulakis |
|---|---|
| YEAR | 2024 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 74 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2412-00686