CMQCIC-Bench: A Chinese Benchmark for Evaluating Large Language Models in Medical Quality Control Indicator Calculation

Guangya Yu, Yanhao Li, Zongying Jiang, Yuxiong Jin, Li Dai, Yupian Lin · 2025

Read CMQCIC-Bench: A Chinese Benchmark for Evaluating Large Language Models in Medical Quality Control Indicator Calculation by Guangya Yu, Yanhao Li, Zongying Jiang, Yuxiong Jin, Li Dai, Yupian Lin (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2502-11703.txt.

Description

Guangya Yu and co-authors build a Chinese test set for language models in a 2025 computing paper. Hospitals grade care with quality indicators, such as rates of infection or readmission. Computing them from patient records takes careful rule work. The team asks whether large language models can do that math reliably on real Chinese records.

Their bench holds 785 cases drawn from real records, covering seventy-six indicators. They also propose a method that splits each case into checking the clinical facts, then applying the rule. That split beat the usual step-by-step prompting across twenty models tested. Error reviews show where models still stumble, which points to safer ways to use them in hospital audits.

Catalog record

CREATORGuangya Yu, Yanhao Li, Zongying Jiang, Yuxiong Jin, Li Dai, Yupian Lin
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE46 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2502-11703

Browse the full library · About the Tower of Babel