MedPRMBench: A Fine-grained Benchmark for Process Reward Models in Medical Reasoning Conference: ; ;
Lingyan Wu, Xiang Zheng, Weiqi Zhai, Wei Wang, Xuan Ren, Zifan Zhang, Hu Wei, Bing Zhao · 2026
Read MedPRMBench: A Fine-grained Benchmark for Process Reward Models in Medical Reasoning Conference: ; ; by Lingyan Wu, Xiang Zheng, Weiqi Zhai, Wei Wang, Xuan Ren, Zifan Zhang, Hu Wei, Bing Zhao (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-17282.txt.
Description
Zheng and six colleagues build MedPRMBench, a medical benchmark that grades each step of a model's clinical reasoning rather than only its final answer. Built from seven question sources with review by 86 physicians, it holds 6,500 questions, 13,000 reasoning chains, and over 113,000 step labels across 14 error types. The best prompted critic scored only about 75 percent, while a model trained on the set reached about 87 percent, showing how much room remains for safe medical reasoning checks.
Catalog record
| CREATOR | Lingyan Wu, Xiang Zheng, Weiqi Zhai, Wei Wang, Xuan Ren, Zifan Zhang, Hu Wei, Bing Zhao |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 180835 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2604.17282