Evaluating large language models for pharmacotherapy simulations: a mixed-methods study
Ahmed N. Farrag, Amany El-Zeiny, Amani M. Ali · 2026
Read Evaluating large language models for pharmacotherapy simulations: a mixed-methods study by Ahmed N. Farrag, Amany El-Zeiny, Amani M. Ali (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/pmc-13144508.txt.
Description
Ahmed Farrag and co-authors grade chatbots as stand-ins for pharmacy teaching cases in this 2026 paper. Simulated patients help train pharmacy students, but writing cases takes heavy faculty time. Four large language models drafted leukemia cases using expert-shaped prompts. Over a hundred pharmacy students worked through the cases.
Expert panels scored just over half the sessions as passing in every domain. Teaching design and reasoning scored well, but drug accuracy and safety lagged behind. One leukemia type drew all the worst errors, including invented evidence. Students liked the chatbot cases more than standard ones, yet their liking did not track expert quality. The authors insist on expert checks before classroom use.
Catalog record
| CREATOR | Ahmed N. Farrag, Amany El-Zeiny, Amani M. Ali |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 71 KB |
| VERSION | 1.0 |
| LICENSE | CC BY 4.0 |
| RIGHTS | CC BY |
| SOURCE | Europe PMC |