Large language model assistance for report-based carotid plaque AHA classification: a multi-reader study

Mengfei Wang, Yixiao Tang, Yulu Yang, Yifan Tu, Zhongzheng Cao, Runjianya Ling, Kaiyue Sun, Jian Ma, Zhicheng Zhang, Ruipeng Zhang, Xiaoer Wei, Dan Wang, Yuehua Li · 2026

Read Large language model assistance for report-based carotid plaque AHA classification: a multi-reader study by Mengfei Wang, Yixiao Tang, Yulu Yang, Yifan Tu, Zhongzheng Cao, Runjianya Ling, Kaiyue Sun, Jian Ma, Zhicheng Zhang, Ruipeng Zhang, Xiaoer Wei, Dan Wang, Yuehua Li (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/pmc-13675435.txt.

Description

Mengfei Wang and co-authors test whether a language model looking over a radiologist's shoulder makes plaque grading agree. Doctors classify carotid artery plaques from MRI reports using the American Heart Association scheme, and readers differ. Their 2026 study takes 433 patients from three institutions and has four radiologists grade the reports with and without model assistance.

The help was dramatic. Junior readers' vessel-level agreement with the expert standard jumped from about sixty-two percent to over eighty-three with one model and near eighty-eight with another. Seniors climbed from seventy-seven into the high eighties and low nineties. At the patient level the gains were larger still. A weighted agreement statistic leapt from poor to strong. In a side contest, ten standalone models were tried with plain and with criteria-guided prompts, against a rule-based baseline.

Catalog record

CREATORMengfei Wang, Yixiao Tang, Yulu Yang, Yifan Tu, Zhongzheng Cao, Runjianya Ling, Kaiyue Sun, Jian Ma, Zhicheng Zhang, Ruipeng Zhang, Xiaoer Wei, Dan Wang, Yuehua Li
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE44 KB
VERSION1.0
LICENSECC BY 4.0
RIGHTSCC BY
SOURCEEurope PMC

Source: https://europepmc.org/articles/PMC13675435

Browse the full library · About the Tower of Babel