Rethinking Visual Attribution for Chest X-ray Reasoning in Large Vision Language Models
Guangzhi Xiong, Qiao Jin, Sanchit Sinha, Zhiyong Lu, Aidong Zhang · 2026
Read Rethinking Visual Attribution for Chest X-ray Reasoning in Large Vision Language Models by Guangzhi Xiong, Qiao Jin, Sanchit Sinha, Zhiyong Lu, Aidong Zhang (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-20158.txt.
Description
Guangzhi Xiong and four co-workers test whether visual attribution for chest X-rays reflects the visual evidence behind a vision-language model's decision. Their evaluation framework keeps only samples where the region is verified by counterfactual editing as responsible for the prediction. Across eleven methods, six models and two modes, they often fail to identify the evidence the models use. Their MedFocus method finds meaningful anatomical regions with unbalanced optimal transport, measures their causal effect through interventions, and beats methods on spatial, concept and token attributions.
Catalog record
| CREATOR | Guangzhi Xiong, Qiao Jin, Sanchit Sinha, Zhiyong Lu, Aidong Zhang |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 66090 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2605.20158