BEiTScore: Reference-free Image Captioning Evaluation with an Efficient Cross-Encoder Model

Gonçalo Gomes, Bruno Martins, Chrysoula Zerva · 2026

Read BEiTScore: Reference-free Image Captioning Evaluation with an Efficient Cross-Encoder Model by Gonçalo Gomes, Bruno Martins, Chrysoula Zerva (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-21728.txt.

Description

Gomes, Martins, and Zerva propose BEiTScore, a reference-free metric for judging image captions without costly large-model judges or coarse CLIP encoders. It is a lightweight cross-encoder initialized from a visual question-answering checkpoint. Training uses a curated mixture with adversarial augmentations that sharpen sensitivity to fine-grained caption errors. A new benchmark for detailed captioning accompanies it. Experiments show state-of-the-art performance at a cost low enough for large-scale benchmarking, quality-aware decoding, or reward guidance.

Catalog record

CREATORGonçalo Gomes, Bruno Martins, Chrysoula Zerva
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE64277
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2605.21728

Browse the full library · About the Tower of Babel