DeepTumorVQA: A Hierarchical 3D CT Benchmark for Stage-Wise Evaluation of Medical VLMs and Tool-Augmented Agents

Yixiong Chen, Wenjie Xiao, Pedro R. A. S. Bassi, Boyan Wang, Liang He, Xinze Zhou, Sezgin Er, Ibrahim Ethem Hamamci, Zongwei Zhou, Alan Yuille · 2026

Read DeepTumorVQA: A Hierarchical 3D CT Benchmark for Stage-Wise Evaluation of Medical VLMs and Tool-Augmented Agents by Yixiong Chen, Wenjie Xiao, Pedro R. A. S. Bassi, Boyan Wang, Liang He, Xinze Zhou, Sezgin Er, Ibrahim Ethem Hamamci, Zongwei Zhou, Alan Yuille (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-09679.txt.

Introduction

Chen and nine colleagues built a test that grades medical AI on three-dimensional CT scans of tumors, step by step instead of with one overall score. Their benchmark, DeepTumorVQA, follows the chain of evidence doctors use in tumor diagnosis, from spotting a tumor to measuring it and reasoning about what it means. It covers 42 clinical subtypes across more than 9,000 scan volumes.

The team created 476,000 questions and ran more than 30 model setups through them. Reliable measurement turned out to be the main weak point, and later reasoning steps grew harder still when measurement failed. Giving models outside tools, such as programs that outline tumors and measure them, eased the problem a great deal. Doctors and AI researchers can use the benchmark to find exactly where a medical system breaks down.

Catalog record

CREATORYixiong Chen, Wenjie Xiao, Pedro R. A. S. Bassi, Boyan Wang, Liang He, Xinze Zhou, Sezgin Er, Ibrahim Ethem Hamamci, Zongwei Zhou, Alan Yuille
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE167 KB
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2605.09679

Browse the full library · About the Tower of Babel