Painting with Words: Elevating Detailed Image Captioning with Benchmark and Alignment Learning

Qinghao Ye *, Xianhan Zeng *, Fu Li, Chunyuan Li, Haoqi Fan · 2025

Read Painting with Words: Elevating Detailed Image Captioning with Benchmark and Alignment Learning by Qinghao Ye *, Xianhan Zeng *, Fu Li, Chunyuan Li, Haoqi Fan (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2503-07906.txt.

Description

Qinghao Ye and co-authors raise the bar for detailed image captioning in a paper from 2025. Vision-language models now write long, rich captions. Judging those captions is the weak link: old metrics are blunt and reference texts are coarse.

Their benchmark, DeCapBench, pairs with a new score called DCScore. The score splits each caption into the smallest self-standing facts. Each fact is then checked for truth and coverage. Hallucinated details get caught instead of averaged away. Human raters agreed with DCScore more than with rival metrics. The benchmark also tracks public model arena standings closely. A companion training method teaches models to earn the higher score.

Catalog record

CREATORQinghao Ye *, Xianhan Zeng *, Fu Li, Chunyuan Li, Haoqi Fan
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE64 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2503-07906

Browse the full library · About the Tower of Babel