MedPRMBench: A Fine-grained Benchmark for Process Reward Models in Medical Reasoning Conference: ; ;

Lingyan Wu, Xiang Zheng, Weiqi Zhai, Wei Wang, Xuan Ren, Zifan Zhang, Hu Wei, Bing Zhao · 2026

Read MedPRMBench: A Fine-grained Benchmark for Process Reward Models in Medical Reasoning Conference: ; ; by Lingyan Wu, Xiang Zheng, Weiqi Zhai, Wei Wang, Xuan Ren, Zifan Zhang, Hu Wei, Bing Zhao (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-17282.txt.

Description

Zheng and six colleagues build MedPRMBench, a medical benchmark that grades each step of a model's clinical reasoning rather than only its final answer. Built from seven question sources with review by 86 physicians, it holds 6,500 questions, 13,000 reasoning chains, and over 113,000 step labels across 14 error types. The best prompted critic scored only about 75 percent, while a model trained on the set reached about 87 percent, showing how much room remains for safe medical reasoning checks.

Catalog record

CREATORLingyan Wu, Xiang Zheng, Weiqi Zhai, Wei Wang, Xuan Ren, Zifan Zhang, Hu Wei, Bing Zhao
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE180835
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2604.17282

Browse the full library · About the Tower of Babel