Painting with Words: Elevating Detailed Image Captioning with Benchmark and Alignment Learning
Qinghao Ye *, Xianhan Zeng *, Fu Li, Chunyuan Li, Haoqi Fan · 2025
Read Painting with Words: Elevating Detailed Image Captioning with Benchmark and Alignment Learning by Qinghao Ye *, Xianhan Zeng *, Fu Li, Chunyuan Li, Haoqi Fan (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2503-07906.txt.
Description
Qinghao Ye and co-authors raise the bar for detailed image captioning in a paper from 2025. Vision-language models now write long, rich captions. Judging those captions is the weak link: old metrics are blunt and reference texts are coarse.
Their benchmark, DeCapBench, pairs with a new score called DCScore. The score splits each caption into the smallest self-standing facts. Each fact is then checked for truth and coverage. Hallucinated details get caught instead of averaged away. Human raters agreed with DCScore more than with rival metrics. The benchmark also tracks public model arena standings closely. A companion training method teaches models to earn the higher score.
Catalog record
| CREATOR | Qinghao Ye *, Xianhan Zeng *, Fu Li, Chunyuan Li, Haoqi Fan |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 64 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2503-07906