VERT: Reliable LLM Judges for Radiology Report Evaluation
Federica Bologna, Jean-Philippe Corbeil, Matthew Wilkens, Asma Ben Abacha · 2026
Read VERT: Reliable LLM Judges for Radiology Report Evaluation by Federica Bologna, Jean-Philippe Corbeil, Matthew Wilkens, Asma Ben Abacha (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-03376.txt.
Description
Bologna and colleagues test whether language-model judges for radiology reports hold up beyond chest X-rays, across modalities and anatomies. Comparing four existing metrics with their new VERT metric, they find GREEN most robust among prior metrics, while VERT lifts agreement with radiologists up to 26 percent over GREEN. Lightweight fine-tuning adds further gains and cuts latency about 37-fold.
Catalog record
| CREATOR | Federica Bologna, Jean-Philippe Corbeil, Matthew Wilkens, Asma Ben Abacha |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 67230 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2604.03376