Accuracy and comprehensibility of chat-based artificial intelligence for patient information on atrial fibrillation and cardiac implantable electronic devices
Henrike A K Hillmann, Eleonora Angelini, Nizar Karfoul, Sebastian Feickert, Johanna Mueller-Leisse, David Duncker · 2023
Read Accuracy and comprehensibility of chat-based artificial intelligence for patient information on atrial fibrillation and cardiac implantable electronic devices by Henrike A K Hillmann, Eleonora Angelini, Nizar Karfoul, Sebastian Feickert, Johanna Mueller-Leisse, David Duncker (2023) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/pmc-10824484.txt.
Description
Henrike Hillmann and co-authors grade chatbots as sources of patient facts on atrial fibrillation and implanted heart devices in a 2023 study. Chat tools are easy to ask, but wrong medical facts carry real risk.
Questions were put to three chat tools, and experts scored replies for fit, clarity, made-up facts, and missing points. The best tool gave apt replies far more often, while the weakest lagged badly on device topics. Most replies were easy to grasp, yet key facts were often missing. The authors warn that chat answers vary too much to trust alone. Patients and doctors get a clear caution on chatbot use.
Catalog record
| CREATOR | Henrike A K Hillmann, Eleonora Angelini, Nizar Karfoul, Sebastian Feickert, Johanna Mueller-Leisse, David Duncker |
|---|---|
| YEAR | 2023 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 29 KB |
| VERSION | 1.0 |
| LICENSE | CC BY 4.0 |
| RIGHTS | CC BY |
| SOURCE | Europe PMC |