Automated Auditing of Hospital Discharge Summaries for Care Transitions
Akshat Dasula 1 , Prasanna Desikan 1 , and Jaideep Srivastava 2 · 2026
Read Automated Auditing of Hospital Discharge Summaries for Care Transitions by Akshat Dasula 1 , Prasanna Desikan 1 , and Jaideep Srivastava 2 (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-05435.txt.
Introduction
Dasula and four colleagues check hospital discharge notes by machine, since gaps in these notes split care and send patients back to hospital. They turn the DISCHARGED guide into a 46-question checklist and test 11 language models on 50 notes from the MIMIC-IV base, scored by doctors. Mean scores run from about 55 to 74 percent, and top models match doctors only fairly well, missing vague notes most.
Catalog record
| CREATOR | Akshat Dasula 1 , Prasanna Desikan 1 , and Jaideep Srivastava 2 |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 13414 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2604.05435
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Automated Auditing of Hospital Discharge Summaries for Care Transitions Thanks: This work used data from the MIMIC-IV Clinical Database and PhysioNet. We thank Beth Israel Deaconess Medical Center and the MIT Laboratory for Computational Physiology for maintaining these resources [ 8 , 6 ] . Akshat Dasula 1 , Prasanna Desikan 1 , and Jaideep Srivastava 2 Abstract Incomplete or inconsistent discharge documentation is a primary driver of care fragmentation and avoidable readmissions. Despite its critical role in patient safety, auditing discharge summaries relies heavily on manual review and is difficult to scale. We propose an automated framework for large-scale auditing of discharge summaries using locally deployed Large Language Models (LLMs). Our approach operationalizes core transition-of-care requirements such as follow-up instructions, medication history and changes, patient information and clinical course, etc. into a structured validation checklist of questions based on DISCHARGED framework. Using adult inpatient summaries from the MIMIC-IV database, we utilize a privacy-preserving LLM to identify the presence, absence, or ambiguity of key documentation elements. This work demonstrates the feasibility of scalable, automated clinical auditing and provides a foundation for systematic quality improvement in electronic health record documentation. I Introduction High-quality discharge documentation is essential for patient safety and a key determinant of readmission risk after hospitalization, as it facilitates a seamless transition from hospital to home through the effective transfer of necessary information [ 13 , 1 ] about medications and follow‑up, and preventable adverse events in the early post‑discharge period. Studies of patients hospitalized with heart failure and other high‑risk conditions have shown that discharge summaries containing key content elements such as medication changes, pending tests, and clear follow‑up plans, are associated with lower odds of 30‑day readmission [ 2 ] , showing the importance of patient‑centered documentation in safe transitions of care. In most clinical workflows, physicians write the formal discharge note while clinical nurses are responsible for educating the patient and family before discharge, using that same documentation as a reference. When the discharge note is vague or incomplete, it increases the risk of miscommunication and missed education points. Manual auditing of these notes is time and labor intensive making it difficult to perform at scale. Our work addresses this gap by designing an automated audit system that evaluates the completeness and consistency of discharge documentation against a set of audit questions which are formulated from the DISCHARGED Framework [ 11 ] and are validated by a nurse. The discharge summaries present in MIMIC-IV [ 8 ] are validated against a set of audit questions and a locally deployed LLM is used to flag these questions determining missing or unclear elements in real time. Such system allows clinicians and nurses to identify and address documentation gaps before finalizing the discharge summary. By improving the quality of discharge documentation prior to the transition from hospital to home, this approach helps support safer discharges and better patient safety during care transitions. Contributions : This work makes two key contributions. First, we propose a scalable, locally deployable automated system for auditing discharge documents that preserves privacy while enabling large-scale evaluation. Second, We introduce a benchmark of clinically reviewed audit questions and their clinician labeled answers for evaluating the quality of discharge documentation using LLMs. II Related Works Automated auditing of discharge documentation lies at the intersection of guideline-based discharge interventions, natural language processing (NLP) for electronic health records, and recent applications of large language models (LLMs) to clinical documentation. Prior NLP work has focused on extraction such as diagnoses, medications, and adverse events from free-text EHR data using rule-based and supervised machine learning approaches [ 9 , 7 ] , which typically require extensive feature engineering and task-specific annotations. More recent transformer-based models, including ClinicalBERT [ 3 ] and domain-specific GPT-style models [ 14 , 10 , 4 ] , have improved performance on clinical information extraction and summarization tasks. However, most existing efforts emphasize clinical prediction or automated generation of patient-centric summaries [ 5 ] , rather than structured identification of missing or ambiguous elements in discharge documentation. In contrast, our work focuses on auditing discharge summaries using clinically grounded questions derived from the DISCHARGED mnemonic [ 11 ] , enabling systematic assessment of documentation completeness and consistency during care transitions. III Methodology This work presents a retrospective audit of hospital discharge summaries by using a set of audit questions. The goal is to assess the completeness and internal consistency of discharge documentation at scale, rather than the appropriateness of clinical care. Therefore, no new clinical content is generated. We use data from MIMIC-IV, a publicly available, de-identified critical care database containing structured electronic health record (EHR) data and clinical notes for hospital admissions. Adult inpatient admissions with a discharge summary are included, excluding those resulting in in-hospital death to focus on hospital-to-home transitions. TABLE I: Component-wise Audit Information Component # Qs Audit Questions Regarding ( D )emographic Information 3 Patient identity (Name, age, ID) and document placement ( I )mportant Alerts 3 Alerts for allergies, clinical risks and precautions ( S )ocial Set up 2 Lifestyle habits and social status ( C )omprehensive Medical History 4 Previous diagnoses, and pre-admission medications ( H )istory & Examinations 8 Admission reasons, vital signs, and physical exams ( A )ssessment & Clinical Course 8 Diagnoses, severity, hospital course, and management ( R )ecorded Medication Changes 6 Rationale for changes, purposes, and restart plans ( G )oals of Care 1 Advance directives and serious illness conversations ( E )xpected Follow-up 3 PCP contact, instructions, and outpatient investigations ( D )ischarge-related information 8 Discharge date, disposition, specialty, and writer info We adopt a conservative auditing strategy in which components of DISCHARGED framework are operationalized to a checklist comprising a set of audit questions, as shown in I . For each discharge summary, questions are answered as Yes , No , or Unclear . A question is marked Yes if the discharge summary explicitly answers it, Unclear if the answer is ambiguous due to ambiguities in clinical writing or LLM’s uncertainty, and No if no relevant information is provided. Missing documentation is interpreted strictly as a documentation gap and does not imply that care was not delivered. Audit labeling is performed using a locally deployed Qwen 2.5-7B [ 12 ] . We used an indirect Chain-of-Thought (CoT) prompting [ 15 ] , dividing the 46 (34 previously) audit questions into six prompts, resulting in six LLM calls per discharge summary. The LLM is instructed to answer each question, provide the exact evidence sentences from the discharge summary to support its answer, and a brief justification. Our preliminary study cohort consists of 200 discharge summaries from 196 unique patients. The dataset was stratified by discharge location and ICU stay flag, as suggested by clinical experts. Patient ages ranged from 18 to 91 years ( \mu=58.96 ), with a gender distribution of 55.61% male and 44.38% female. The mean ICU length of stay was 3.92 days, and the average admission length of stay was 7.56 days. To improve audit precision, the initial 34 complex questions were decomposed into 46 granular questions. IV Results The audit of 200 summaries using the locally deployed Qwen 2.5 7B model provides a baseline for automated documentation completeness. The