Real-world evaluation of large language model for patients medical and administrative queries in nuclear medicine

Arash Latifoltojar, Akintunde Orunmuyi, Michael Wang, Stefan Adrian Vöö, Irfan Kayani, Richard Oyibo, Kabita Gurung, Jennifer Williams, Memuna Rashid, Andre Lopes, Ashley Macallistar Groves, Jamshed Bomanji · 2026

Read Real-world evaluation of large language model for patients medical and administrative queries in nuclear medicine by Arash Latifoltojar, Akintunde Orunmuyi, Michael Wang, Stefan Adrian Vöö, Irfan Kayani, Richard Oyibo, Kabita Gurung, Jennifer Williams, Memuna Rashid, Andre Lopes, Ashley Macallistar Groves, Jamshed Bomanji (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/PMC13635222.txt.

Description

Arash Latifoltojar and eleven colleagues published this 2026 real-world test of a chatbot answering patient questions in a nuclear medicine service. Patients sent real questions, and physicians, office staff, and a large language model each drafted answers. The questions covered drug interactions, medical concerns, and administrative matters. Panels of medical experts, administrative experts, and independent lay raters scored the answers across most dimensions of a quality framework.

For medical questions, expert raters judged the model's answers equal or better than human answers on most dimensions, especially informativeness. Lay raters split differently, finding human answers easier to understand and disagreeing often on overall preference. For office questions, the model shone, with raters calling its answers more informative and preferring them overall. Agreement between raters ran higher on model answers than on human ones. The authors say the tool looks promising, above all for routine queries, but needs more validation.

Catalog record

CREATORArash Latifoltojar, Akintunde Orunmuyi, Michael Wang, Stefan Adrian Vöö, Irfan Kayani, Richard Oyibo, Kabita Gurung, Jennifer Williams, Memuna Rashid, Andre Lopes, Ashley Macallistar Groves, Jamshed Bomanji
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE38807
LICENSEhttps://creativecommons.org/licenses/by/4.0
RIGHTSCC BY
SOURCEEurope PMC

Source: https://europepmc.org/article/MED/PMC13635222

Browse the full library · About the Tower of Babel