Evaluating the Accuracy of Medical Information Generated by ChatGPT and Gemini and Its Alignment With International Clinical Guidelines From the Surviving Sepsis Campaign: Comparative Study

Dina Kutbi, Ehab Abou-Bakr, Hassan Mousa Haidar, Alicia Stone, Haitao Zhang · 2025

Read Evaluating the Accuracy of Medical Information Generated by ChatGPT and Gemini and Its Alignment With International Clinical Guidelines From the Surviving Sepsis Campaign: Comparative Study by Dina Kutbi, Ehab Abou-Bakr, Hassan Mousa Haidar, Alicia Stone, Haitao Zhang (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/pmc-12756662.txt.

Description

Kutbi and coauthors grade chat model answers on sepsis care against global guides. Chat models are now weighed as aids for doctors and patients. Their medical accuracy against set guides is still in doubt. Sepsis care has clear global guides to test against.

Two leading chat models were asked 18 guide-based questions. Seven intensive care doctors graded each answer set. Scores checked both factual accuracy and guide alignment. Gaps would flag where models mislead in grave care. The team urges checks before clinic use of such tools. Results may guide safe use in patient teaching.

Catalog record

CREATORDina Kutbi, Ehab Abou-Bakr, Hassan Mousa Haidar, Alicia Stone, Haitao Zhang
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE23 KB
VERSION1.0
LICENSECC BY 4.0
RIGHTSCC BY
SOURCEEurope PMC

Source: https://europepmc.org/articles/PMC12756662

Browse the full library · About the Tower of Babel