DeepTumorVQA: A Hierarchical 3D CT Benchmark for Stage-Wise Evaluation of Medical VLMs and Tool-Augmented Agents
Yixiong Chen, Wenjie Xiao, Pedro R. A. S. Bassi, Boyan Wang, Liang He, Xinze Zhou, Sezgin Er, Ibrahim Ethem Hamamci, Zongwei Zhou, Alan Yuille · 2026
Read DeepTumorVQA: A Hierarchical 3D CT Benchmark for Stage-Wise Evaluation of Medical VLMs and Tool-Augmented Agents by Yixiong Chen, Wenjie Xiao, Pedro R. A. S. Bassi, Boyan Wang, Liang He, Xinze Zhou, Sezgin Er, Ibrahim Ethem Hamamci, Zongwei Zhou, Alan Yuille (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-09679.txt.
Introduction
Chen and nine colleagues built a test that grades medical AI on three-dimensional CT scans of tumors, step by step instead of with one overall score. Their benchmark, DeepTumorVQA, follows the chain of evidence doctors use in tumor diagnosis, from spotting a tumor to measuring it and reasoning about what it means. It covers 42 clinical subtypes across more than 9,000 scan volumes.
The team created 476,000 questions and ran more than 30 model setups through them. Reliable measurement turned out to be the main weak point, and later reasoning steps grew harder still when measurement failed. Giving models outside tools, such as programs that outline tumors and measure them, eased the problem a great deal. Doctors and AI researchers can use the benchmark to find exactly where a medical system breaks down.
Catalog record
| CREATOR | Yixiong Chen, Wenjie Xiao, Pedro R. A. S. Bassi, Boyan Wang, Liang He, Xinze Zhou, Sezgin Er, Ibrahim Ethem Hamamci, Zongwei Zhou, Alan Yuille |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 167 KB |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2605.09679