Utility of ChatGPT in Clinical Practice.

Liu J, Wang C, Liu S. · 2023

Read Utility of ChatGPT in Clinical Practice. by Liu J, Wang C, Liu S. (2023) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/europmc-pmc10365580.txt.

Introduction

Liu, Wang, and Liu weighed the use of ChatGPT in daily medical care in 2023. ChatGPT is a chat tool that writes text in reply to prompts. Clinics have begun to test it for real tasks. The authors survey what the tool can do and where it may cause harm.

On the plus side, Liu reports help with lists of possible diagnoses for a case. The tool also drafts patient letters, scan reports, notes, and discharge forms. That work can save staff time and cut errors. The authors still call the tool a double-edged sword. They urge care with wrong answers and patient privacy. Future work may add live tracking and care at a distance.

Catalog record

CREATORLiu J, Wang C, Liu S.
YEAR2023
COLLECTIONPAPERS
FORMATTXT
FILE SIZE30 KB
LICENSECC BY 4.0
RIGHTSCC BY
SOURCEEurope PMC

Source: https://europepmc.org/articles/PMC10365580

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Utility of ChatGPT in Clinical Practice By Jialin Liu, Changyu Wang, Siru Liu, Gunther Eysenbach, Taiane de Azevedo Cardoso, Marc Succi, Arya Rao, Elena Bignami, Valentina Bellini Published in: Journal of Medical Internet Research DOI: 10.2196/48568 ABSTRACT Abstract ChatGPT is receiving increasing attention and has a variety of application scenarios in clinical practice. In clinical decision support, ChatGPT has been used to generate accurate differential diagnosis lists, support clinical decision-making, optimize clinical decision support, and provide insights for cancer screening decisions. In addition, ChatGPT has been used for intelligent question-answering to provide reliable information about diseases and medical queries. In terms of medical documentation, ChatGPT has proven effective in generating patient clinical letters, radiology reports, medical notes, and discharge summaries, improving efficiency and accuracy for health care providers. Future research directions include real-time monitoring and predictive analytics, precision medicine and personalized treatment, the role of ChatGPT in telemedicine and remote health care, and integration with existing health care systems. Overall, ChatGPT is a valuable tool that complements the expertise of health care providers and improves clinical decision-making and patient care. However, ChatGPT is a double-edged sword. We need to carefully consider and study the benefits and potential dangers of ChatGPT. In this viewpoint, we discuss recent advances in ChatGPT research in clinical practice and suggest possible risks and challenges of using ChatGPT in clinical practice. It will help guide and support future artificial intelligence research similar to ChatGPT in health. Keywords: ChatGPT, artificial intelligence, large language models, clinical practice, large language model, natural language processing, NLP, doctor-patient, patient-physician, communication, challenges, barriers, recommendations, guidance, guidelines, best practices, risks INTRODUCTION ChatGPT is a large language model developed by OpenAI. It is based on the GPT architecture and uses deep learning techniques to generate natural language text [1,2]. The model has been developed using supervised and reinforcement learning strategies [3]. ChatGPT can generate coherent, grammatically correct text, which is an important development in artificial intelligence (AI) [4]. It shows great potential for using large language models and reinforcement learning from human feedback to improve clinical decision support (CDS) alert logic and potentially other medical areas involving complex clinical logic, a key step in the development of an advanced learning health care system. ChatGPT has quickly gained worldwide attention for its accurate well-formulated responses to various topics. As physicians, we have the opportunity to help guide and develop new ways of using this powerful tool. It can be used in research and development to analyze large amounts of medical data, identify trends, and provide insights into best clinical practices. Physicians need to consider using ChatGPT in their clinical practice. Furthermore, we are using ChatGPT as a tool to support physicians’ clinical practice, not to replace them. Despite the increasing popularity and performance of ChatGPT, there is still a lack of studies evaluating its use in clinical practice. At the same time, we should be aware that ChatGPT is a double-edged sword, with powerful functions and potential dangers. To better understand the application of ChatGPT in clinical practice, we introduced the recent progress of ChatGPT in clinical practice to help interested researchers effectively grasp the key aspects of this topic and to provide possible future research directions. The purpose of this viewpoint is to provide an overview of the recent advances in ChatGPT in clinical practice (Multimedia Appendix 1 [5-16]), to explore the future direction of ChatGPT in clinical practice, to highlight the risks and challenges of its use in clinical practice, and to propose appropriate mitigation strategies. Although ChatGPT has demonstrated promising prospects in clinical practice, further research is needed to refine and improve its capabilities. Integrating ChatGPT into existing electronic health record (EHR) systems has the potential to improve diagnostic accuracy, treatment planning, and patient outcomes. However, it is essential to regard ChatGPT as a valuable tool that supplements the expertise of health care professionals rather than replacing them. CLINICAL DECISION SUPPORT Clinical decision-making is a complex process. It involves many factors, such as the physician’s clinical thinking, clinical reasoning, individual judgement, and the patient’s condition [17]. These factors can lead to cognitive biases, errors in reasoning, and preventable harm. AI-based CDS can effectively support physicians’ clinical decisions and improve treatment outcomes [18]. Current applications of ChatGPT in CDS include the following: - Differential-diagnosis lists: Hirosawa et al [5] evaluated ChatGPT-3 and general internal medicine physicians to generate clinical cases, correct diagnoses, and five differential diagnoses for 10 common chief complaints. In the 10 differential diagnosis lists, the correct diagnosis rate of ChatGPT-3 was 28 out of 30 (93.3%). In the 5 differential diagnosis lists, the correct diagnosis rate of physicians was superior to ChatGPT-3 (98.3% vs 83.3%; P=.03). In the 10 differential diagnosis lists generated by ChatGPT-3, the consistent differential diagnosis rate of the doctors was 62 out of 88 (70.5%). This study shows that the differential diagnosis list generated by ChatGPT-3 has high diagnostic accuracy for clinical cases with common chief complaints. - Clinical decision-making: Rao et al [6] entered all 36 published clinical vignettes from the Merck Sharp & Dohme (MSD) Clinical Manual into ChatGPT and compared the accuracy of differential diagnosis, diagnostic tests, final diagnosis, and management according to the patient age and gender, and the sensitivity of the case. ChatGPT achieved an overall accuracy rate of 71.7% (95% CI 69.3%-74.1%) across all 36 clinical cases. - Cancer screening: Rao et al [7] compared ChatGPT responses with the American College of Radiology appropriateness criteria for breast pain and breast cancer screening. The ChatGPT prompt formats were open-ended (OE) and select all that apply (SATA). The results of the study showed that breast cancer screening achieved an average OE score of 1.83 out of 2, with an average correct rate of 88.9% for SATA; breast pain achieved an average OE score of 1.125 out of 2, with an average correct rate of 58.3% for SATA. The results show the feasibility of using ChatGPT for radiological decision-making and have the potential to improve clinical workflow. - CDS optimization: Liu et al [8] studied 5 clinicians’ ratings of 36 CDS recommendations generated by ChatGPT and 29 recommendations generated by experts. The research results revealed that 9 of the top 20 recommendations in the survey were generated by ChatGPT. The study found that recommendations generated by ChatGPT provided a unique perspective and were rated as highly understandable and relevant, moderately useful but with low acceptability, bias, inversion, and redundancy. These recommendations can be an important complementary part of optimizing CDS alerts, identifying potential improvements to alert logic and supporting their implementation or even helping experts to develop their recommendations for CDS improvements. ChatGPT has been evaluated for CDS applications. It has been shown to generate accurate lists of differential diagnoses, clinical decision making, optimize CDS, and provide insights for cancer screening decisions. Further research could focus on developing advanced models that integrate ChatGPT with existing CDS systems. These models can leverage the extensive medical literature, clinical guidelines, and patient data to support physicians in making accurate diagnoses, formulating treatment plans, and predicting patient outcomes. By combining the expertise of health care professionals with the capabilities of ChatGPT, comprehensive and personalized decision support is provided. QUESTION-ANSWER (MEDICAL QUERIES) Intelligent question-answering is often used to

Read the complete text