Large Language Model–Generated Electronic Consultations: A Blinded Comparative Study of OpenEvidence and Gastroenterologist Electronic Consultations

Christopher R Stephenson, Jithinraj Edakkanambeth Varayil, Bradley R Salonen, Elizabeth C Wight, Phil D Sang, Aditya K Ghosh, Dennis L Shung, Ivana T Croghan, Darrell R Schroeder, Ryan T Hurt · 2026

Read Large Language Model–Generated Electronic Consultations: A Blinded Comparative Study of OpenEvidence and Gastroenterologist Electronic Consultations by Christopher R Stephenson, Jithinraj Edakkanambeth Varayil, Bradley R Salonen, Elizabeth C Wight, Phil D Sang, Aditya K Ghosh, Dennis L Shung, Ivana T Croghan, Darrell R Schroeder, Ryan T Hurt (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/pmc-13676109.txt.

Description

Christopher Stephenson and colleagues ran a blinded comparison of language model e-consults in liver care. Their 2026 study tests the OpenEvidence system on fatty liver disease. Electronic consults let specialists advise without a visit. The study paired 125 real specialist consults with model versions. Both sets answered the same patient questions.

Five blinded doctors rated every consult with a validated tool. A senior liver specialist separately hunted for errors. The review judged how often errors occurred and their harm potential. Cases came from a large academic center over five years. Model answers were produced with standard prompts. The design checks whether AI drafts can match specialist quality. Error patterns matter as much as average scores here.

Catalog record

CREATORChristopher R Stephenson, Jithinraj Edakkanambeth Varayil, Bradley R Salonen, Elizabeth C Wight, Phil D Sang, Aditya K Ghosh, Dennis L Shung, Ivana T Croghan, Darrell R Schroeder, Ryan T Hurt
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE41 KB
VERSION1.0
LICENSECC BY 4.0
RIGHTSCC BY
SOURCEEurope PMC

Source: https://europepmc.org/articles/PMC13676109

Browse the full library · About the Tower of Babel