VERT: Reliable LLM Judges for Radiology Report Evaluation

Federica Bologna, Jean-Philippe Corbeil, Matthew Wilkens, Asma Ben Abacha · 2026

Read VERT: Reliable LLM Judges for Radiology Report Evaluation by Federica Bologna, Jean-Philippe Corbeil, Matthew Wilkens, Asma Ben Abacha (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-03376.txt.

Description

Bologna and colleagues test whether language-model judges for radiology reports hold up beyond chest X-rays, across modalities and anatomies. Comparing four existing metrics with their new VERT metric, they find GREEN most robust among prior metrics, while VERT lifts agreement with radiologists up to 26 percent over GREEN. Lightweight fine-tuning adds further gains and cuts latency about 37-fold.

Catalog record

CREATORFederica Bologna, Jean-Philippe Corbeil, Matthew Wilkens, Asma Ben Abacha
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE67230
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2604.03376

Browse the full library · About the Tower of Babel