Visual Alignment of Medical Vision-Language Models for Grounded Radiology Report Generation

Sarosij Bose, Ravi K. Rajendran, Biplob Debnath, Konstantinos Karydis, Amit K. Roy-Chowdhury, Srimat T. Chakradhar · 2025

Read Visual Alignment of Medical Vision-Language Models for Grounded Radiology Report Generation by Sarosij Bose, Ravi K. Rajendran, Biplob Debnath, Konstantinos Karydis, Amit K. Roy-Chowdhury, Srimat T. Chakradhar (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2512-16201.txt.

Description

Sarosij Bose and five co-authors improve automated X-ray reporting in an arXiv paper released in 2025. Vision-language models can draft radiology reports from chest X-rays, but they often hallucinate findings the image does not show. The root cause is weak alignment between what the model sees and what it says.

Their system, VALOR, attacks the problem in two stages. First, clinically informed text training rewards reports that use precise terms and cover the right findings. Second, a frozen expert model scores how well each draft matches the actual image, and those scores steer the model toward visually grounded wording. No preference pairs, retrieval databases, or extra labels are needed. Across several benchmarks, VALOR improved report quality and clinical accuracy over leading medical report generators.

Catalog record

CREATORSarosij Bose, Ravi K. Rajendran, Biplob Debnath, Konstantinos Karydis, Amit K. Roy-Chowdhury, Srimat T. Chakradhar
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE35 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2512-16201

Browse the full library · About the Tower of Babel