Rethinking Visual Attribution for Chest X-ray Reasoning in Large Vision Language Models

Guangzhi Xiong, Qiao Jin, Sanchit Sinha, Zhiyong Lu, Aidong Zhang · 2026

Read Rethinking Visual Attribution for Chest X-ray Reasoning in Large Vision Language Models by Guangzhi Xiong, Qiao Jin, Sanchit Sinha, Zhiyong Lu, Aidong Zhang (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-20158.txt.

Description

Guangzhi Xiong and four co-workers test whether visual attribution for chest X-rays reflects the visual evidence behind a vision-language model's decision. Their evaluation framework keeps only samples where the region is verified by counterfactual editing as responsible for the prediction. Across eleven methods, six models and two modes, they often fail to identify the evidence the models use. Their MedFocus method finds meaningful anatomical regions with unbalanced optimal transport, measures their causal effect through interventions, and beats methods on spatial, concept and token attributions.

Catalog record

CREATORGuangzhi Xiong, Qiao Jin, Sanchit Sinha, Zhiyong Lu, Aidong Zhang
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE66090
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2605.20158

Browse the full library · About the Tower of Babel