A multi-site benchmarking framework for scalable extraction of geriatric care constructs from electronic health records

Sunyang Fu, Min Ji Kwak, Jaerong Ahn, Qiuhao Lu, Zhiyi Yue, Nan Wang, Huipeng Liu, Grace Giles, Alexa Cumming, Keziah M Thomas, Shreyans Sanghvi, Jiang Jun, Ming Huang, Xiaoyang Ruan, Andrew Wen, Liwei Wang, Erin Hommel, Yanshan Wang, Lichao Sun, Huiwen Xu, Chan Mi Park, Jennifer St Sauver, Jeffrey · 2026

Read A multi-site benchmarking framework for scalable extraction of geriatric care constructs from electronic health records by Sunyang Fu, Min Ji Kwak, Jaerong Ahn, Qiuhao Lu, Zhiyi Yue, Nan Wang, Huipeng Liu, Grace Giles, Alexa Cumming, Keziah M Thomas, Shreyans Sanghvi, Jiang Jun, Ming Huang, Xiaoyang Ruan, Andrew Wen, Liwei Wang, Erin Hommel, Yanshan Wang, Lichao Sun, Huiwen Xu, Chan Mi Park, Jennifer St Sauver, Jeffrey (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/pmc-13582951.txt.

Description

Fu and a large team built a benchmarking framework in twenty twenty-six for extracting geriatric care concepts from health records. Doctors' notes hold rich detail on older patients, but in free text computers must mine. Existing tools focus narrowly and miss how geriatric assessment pieces interlock.

Working across four health systems, the team hand-labeled pooled notes for forty-one data elements tied to comprehensive geriatric assessment and the age-friendly 4Ms framework. They then tested three extraction approaches: GPT-4o with in-context learning, a hybrid rule-plus-model system, and a tuned open-source model. The hybrid led on overall balance and one accuracy average, while GPT-4o caught more varied, context-rich concepts. The tuned small model trailed. The authors highlight trade-offs between stability, interpretability, and adaptability.

Catalog record

CREATORSunyang Fu, Min Ji Kwak, Jaerong Ahn, Qiuhao Lu, Zhiyi Yue, Nan Wang, Huipeng Liu, Grace Giles, Alexa Cumming, Keziah M Thomas, Shreyans Sanghvi, Jiang Jun, Ming Huang, Xiaoyang Ruan, Andrew Wen, Liwei Wang, Erin Hommel, Yanshan Wang, Lichao Sun, Huiwen Xu, Chan Mi Park, Jennifer St Sauver, Jeffrey
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE58 KB
VERSION1.0
LICENSECC BY 4.0
RIGHTSCC BY
SOURCEEurope PMC

Source: https://europepmc.org/articles/PMC13582951

Browse the full library · About the Tower of Babel