Systematic Evaluation of the Quality of Synthetic Clinical Notes Rephrased by LLMs at Million-Note Scale

Jinghui Liu, Sarvesh Soni, Anthony Nguyen · 2026

Read Systematic Evaluation of the Quality of Synthetic Clinical Notes Rephrased by LLMs at Million-Note Scale by Jinghui Liu, Sarvesh Soni, Anthony Nguyen (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-17775.txt.

Description

Jinghui Liu, Sarvesh Soni, and Anthony Nguyen test synthetic clinical notes rephrased by language models at million-note scale. They judge the notes on intrinsic quality, task usefulness, and factual truth, using MIMIC records as source. The synthetic notes keep core clinical facts and coarse task value despite heavy rewording, but fine details needed for ICD coding slip away. Rephrasing chunk by chunk restores much detail, though with less factual precision under partial context. Errors come chiefly from misread clinical context, plus time mix-ups, measurement slips, and invented claims.

Catalog record

CREATORJinghui Liu, Sarvesh Soni, Anthony Nguyen
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE50514
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2605.17775

Browse the full library · About the Tower of Babel