Evaluating large language models for pharmacotherapy simulations: a mixed-methods study

Ahmed N. Farrag, Amany El-Zeiny, Amani M. Ali · 2026

Read Evaluating large language models for pharmacotherapy simulations: a mixed-methods study by Ahmed N. Farrag, Amany El-Zeiny, Amani M. Ali (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/pmc-13144508.txt.

Description

Ahmed Farrag and co-authors grade chatbots as stand-ins for pharmacy teaching cases in this 2026 paper. Simulated patients help train pharmacy students, but writing cases takes heavy faculty time. Four large language models drafted leukemia cases using expert-shaped prompts. Over a hundred pharmacy students worked through the cases.

Expert panels scored just over half the sessions as passing in every domain. Teaching design and reasoning scored well, but drug accuracy and safety lagged behind. One leukemia type drew all the worst errors, including invented evidence. Students liked the chatbot cases more than standard ones, yet their liking did not track expert quality. The authors insist on expert checks before classroom use.

Catalog record

CREATORAhmed N. Farrag, Amany El-Zeiny, Amani M. Ali
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE71 KB
VERSION1.0
LICENSECC BY 4.0
RIGHTSCC BY
SOURCEEurope PMC

Source: https://europepmc.org/articles/PMC13144508

Browse the full library · About the Tower of Babel