Evaluating ChatGPT on Medical Information Extraction Tasks: Performance, Explainability and Beyond
Wei Zhu · 2026
Read Evaluating ChatGPT on Medical Information Extraction Tasks: Performance, Explainability and Beyond by Wei Zhu (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2601-21767.txt.
Introduction
Wei Zhu examines how well ChatGPT handles a practical medical task: pulling structured facts out of clinical text. Large language models can chat fluently and follow user intent, but hospitals and researchers need systems that extract names, conditions, and treatments with care. His 2026 preprint tests ChatGPT on medical information extraction tasks.
The study looks at performance and at explainability, meaning whether the model can show why it gave an answer. It also looks beyond those two points at wider questions about using such models in medicine. Readers get a grounded check on what a general chatbot can and cannot yet do with sensitive clinical language.
Catalog record
| CREATOR | Wei Zhu |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 34 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2601-21767
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Evaluating ChatGPT on Medical Information Extraction Tasks: Performance, Explainability and Beyond Wei Zhu Abstract Large Language Models (LLMs) like ChatGPT have demonstrated amazing capabilities in comprehending user intents and generate reasonable and useful responses. Beside their ability to chat, their capabilities in various natural language processing (NLP) tasks are of interest to the research community. In this paper, we focus on assessing the overall ability of ChatGPT in 4 different medical information extraction (MedIE) tasks across 6 benchmark datasets. We present the systematically analysis by measuring ChatGPT’s performance, explainability, confidence, faithfulness, and uncertainty. Our experiments reveal that: (a) ChatGPT’s performance scores on MedIE tasks fall behind those of the fine-tuned baseline models. (b) ChatGPT can provide high-quality explanations for its decisions, however, ChatGPT is over-confident in its predcitions. (c) ChatGPT demonstrates a high level of faithfulness to the original text in the majority of cases. (d) The uncertainty in generation causes uncertainty in information extraction results, thus may hinder its applications in MedIE tasks. † † address: University of Hong Kong, Hong Kong, HK, China 1 Introduction Large Language Models (LLMs) (e.g., GPT-3 [ 7 ] , LaMDA [ 84 ] and PaLM [ 9 ] , GPT-4 [ 68 ] ) are the main forces in revolutionizing and advancing the field of Natural Language Processing (NLP) [ 1 , 2 , 76 , 77 , 66 , 36 , 51 , 12 , 90 , 100 , 117 , 121 , 103 , 16 , 102 , 73 , 141 , 129 , 128 , 127 , 52 , 136 , 109 , 138 , 25 , 130 , 122 , 80 , 115 , 116 , 94 , 131 , 145 , 120 , 89 , 56 , 46 , 110 , 108 , 148 ] . LLMs are known for its amazing abilities: (a) instruction and demonstration learning. With a proper instruction of the task at hand and a few demonstrations [ 70 , 11 , 96 , 62 , 53 ] , the LLMs can perform tasks they are yet trained for. (b) chain-of-thought (CoT) [ 99 , 93 , 41 ] capabilities. LLMs have demonstrated great performances in solving a wide range of reasoning tasks by reasoning step-by-step. This reasoning capability is not observed in smaller models, thus is referred as an emergent ability in the literature [ 98 , 86 , 29 , 135 , 134 , 57 , 101 , 12 , 123 , 137 , 21 , 150 , 118 , 81 , 140 , 147 , 54 , 144 , 132 , 126 , 110 , 91 , 58 , 107 , 85 ] . ChatGPT 1 1 1 https://chat.openai.com/ has became the most popular AI based product within a short time span after its launch [ 45 ] . As a LLM, ChatGPT is known for its impressive ability to comprehend the user intents in the queries and repond with human-like contents. ChatGPT is built on the GPT-3 model series [ 7 , 79 , 70 ] using reinforcement learning from human feed-back (RLHF) [ 10 , 50 ] and high-quality human-annotated datasets of user queries and responses. Apart from its ability to chat with humans, ChatGPT has many other aspects that are of interest to NLP researchers. A series of research work have emerged, investigating the capabilities of ChatGPT for various NLP tasks, like sentiment analysis [ 83 , 97 ] , natural language inference [ 72 ] , machine reading comprehension [ 105 ] . The capabilities of ChatGPT as a general NLP task solver have been preliminarily explored in the above research and valuable insights are drawn. There are also work addressing the potential impact of ChatGPT on the society and human every-day life [ 28 , 149 , 82 , 4 ] . In this work, we conduct a comprehensive analysis of ChatGPT’s abilities in medical information extraction (MedIE) tasks. MedIE requires the model to have a deep understanding of the medical texts, and extract structured factual knowledge of diversified forms [ 27 , 95 , 71 , 130 , 139 ] , thus it is an ideal test-bed for evaluating ChatGPT’s capabilities. We conduct our experiments and analysis based on 6 datasets belonging to 4 fine-grained MedIE tasks. Through our experiments, we find that with carefully designed task instructions and demonstrations, ChatGPT still has clear performance gaps compared with fine-tuned baseline models, as depicted in Figure 1 . In addition to the performance evaluation, we also assess the explainability, faithfulness, confidence and uncertainty of the ChatGPT’s responses through both automatic evaluations and manual evaluations by domain experts. Our contributions are summarized as follows: • We comprehensively evaluate the overall performance of ChatGPT on various MedIE tasks and compare it with other popular models. • To assess the overall ability of ChatGPT, we conduct a systematic evaluation from five dimensions: performance, explainability, faithfulness, confidence and uncertainty. Our codes are publicly available for future research. Figure 1: Performance comparisons of ChatGPT and the baseline models. 2 Related work 2.1 Pretrained Large Language Models Recently, both the research field and the industry has seen the raise of large language models (LLMs). LLMs typically contain more than ten billion or even a hundred billion parameters, such as GPT-4 [ 68 ] , GPT-3 [ 7 ] , Gopher [ 74 ] , Chinchilla [ 30 ] , PaLM [ 9 ] , Megatron-turing-NLG [ 78 ] , etc. Scaling up the size of LLMs has resulted in a series of interesting observations: (a) scaling up the model size brings impressive abilities in few-shot and zero-shot learning scenarios, such as producing reasonable results with very few task demonstrations or task descriptions [ 7 , 9 ] . (b) scaling up the number of tasks in fine-tuning LLMs with instruction tuning improves the generalizability on unseen tasks [ 59 ] . (c) Emergent capabilities are unlocked when the model size is scaled up to hundreds of billions, which were not observed in smaller models [ 98 ] . Notably, the chain of thought capability is observed in LLMs [ 99 , 93 , 41 , 61 ] . With its impressive ability to understand user in-tent and generate human-like responses, ChatGPT has become the most popular language model within a short period of time after its lanuch. It is trained on the GPT family [ 7 , 79 , 70 ] and high-quality conversational-style datasets using reinforcement learning from human feedback (RLHF) [ 10 , 50 ] . Besides its dialogue ability, ChatGPT is being extensively studied by the researchers. Some literature focus on the ethical or other risks brought by the powerful LLMs like ChatGPT [ 28 , 149 , 43 ] . chatGPT has also revolutionized the traditional fields like education [ 4 , 42 ] and medicine [ 83 , 87 , 67 ] , and what will these industries advance with ChatGPT is analyzed. There are also research work investigating how ChatGPT performs in various natural language processing tasks. There are work testing ChatGPT on a wide range of NLP tasks, but usually a random test subset of the original benchmark tasks is tested [ 73 ,