CMQCIC-Bench: A Chinese Benchmark for Evaluating Large Language Models in Medical Quality Control Indicator Calculation
Guangya Yu, Yanhao Li, Zongying Jiang, Yuxiong Jin, Li Dai, Yupian Lin · 2025
Read CMQCIC-Bench: A Chinese Benchmark for Evaluating Large Language Models in Medical Quality Control Indicator Calculation by Guangya Yu, Yanhao Li, Zongying Jiang, Yuxiong Jin, Li Dai, Yupian Lin (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2502-11703.txt.
Description
Guangya Yu and co-authors build a Chinese test set for language models in a 2025 computing paper. Hospitals grade care with quality indicators, such as rates of infection or readmission. Computing them from patient records takes careful rule work. The team asks whether large language models can do that math reliably on real Chinese records.
Their bench holds 785 cases drawn from real records, covering seventy-six indicators. They also propose a method that splits each case into checking the clinical facts, then applying the rule. That split beat the usual step-by-step prompting across twenty models tested. Error reviews show where models still stumble, which points to safer ways to use them in hospital audits.
Catalog record
| CREATOR | Guangya Yu, Yanhao Li, Zongying Jiang, Yuxiong Jin, Li Dai, Yupian Lin |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 46 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2502-11703