FactsR: A Safer Method for Producing High Quality Healthcare Documentation

Victor Petrén Bach Hansen, Lasse Krogsbøll, Jonas Lyngsø, Mathias Baltzersen, Andreas Motzfeldt, Kevin Pelgrims, Lars Maaløe · 2025

Read FactsR: A Safer Method for Producing High Quality Healthcare Documentation by Victor Petrén Bach Hansen, Lasse Krogsbøll, Jonas Lyngsø, Mathias Baltzersen, Andreas Motzfeldt, Kevin Pelgrims, Lars Maaløe (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2505-10360.txt.

Introduction

Victor Hansen and co-authors present a safer method for AI drafted clinical notes in a 2025 paper. Many scribe tools listen to a visit and write the note in one shot afterward. That habit invites invented details and forces tired clinicians to proofread long drafts, a risky mix for patient safety.

Their method pulls out key clinical facts live, as the visit unfolds, and shows them to the clinician. The final note is then built step by step from those checked facts. Early results point to shorter, more faithful notes. Keeping the clinician inside the loop also opens live decision support during the visit. The team frames the design as safety first automation.

Catalog record

CREATORVictor Petrén Bach Hansen, Lasse Krogsbøll, Jonas Lyngsø, Mathias Baltzersen, Andreas Motzfeldt, Kevin Pelgrims, Lars Maaløe
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE24 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2505-10360

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

FactsR: A Safer Method for Producing High Quality Healthcare Documentation Victor Petrén Bach Hansen, Lasse Krogsbøll, Jonas Lyngsø, Mathias Baltzersen, Andreas Motzfeldt, Kevin Pelgrims, Lars Maaløe Abstract There are now a multitude of AI-scribing solutions for healthcare promising the utilization of large language models for ambient documentation. However, these AI scribes still rely on one-shot, or few-shot prompts for generating notes after the consultation has ended, employing little to no reasoning. This risks long notes with an increase in hallucinations, misrepresentation of the intent of the clinician, and reliance on the proofreading of the clinician to catch errors. A dangerous combination for patient safety if vigilance is compromised by workload and fatigue. In this paper, we introduce a method for extracting salient clinical information in real-time alongside the healthcare consultation, denoted Facts, and use that information recursively to generate the final note. The FactsR method results in more accurate and concise notes by placing the clinician-in-the-loop of note generation, while opening up new use cases within real-time decision support. 1 Introduction The clinical consultation is the cornerstone of a safe patient care journey, but it faces numerous threats. The healthcare professional must extract all relevant information from the patient within a limited time frame [ Caldwell 2019 ] while simultaneously considering diagnostic and therapeutic options; a process that risks being imperfect. The resulting documentation must accurately and concisely encapsulate the consultation details, enabling seamless handovers between clinicians, and serve as legal documentation. The process of creating the note also serves as a time for reflection on the case, which makes it a sensitive phase for ensuring quality. The manual generation of clinical notes is widely recognized as a time-intensive process [ Baumann et al. 2018 ] . This documentation burden not only consumes valuable clinician time but may also compromise either the thoroughness of the record or the quality of patient interaction [ Hart et al. 2025 ] in particular if threatened by time constraints or fatigue. In response to this challenge, Ambient Scribes, systems leveraging automated abstractive summarization of medical dialogues, have seen rapid adoption, particularly following recent advances in large language models (LLMs) [ Ma et al. 2024 ] . These systems promise to reduce administrative overhead while maintaining or even enhancing the clarity and utility of clinical documentation [ Tierney et al. 2024 , Albrecht et al. 2025 ] . However, accurately summarizing healthcare consultations remains a significant challenge for LLMs [ Van Veen et al. 2024 , Kruse et al. 2025 ] . Clinical conversations are characterized by complex medical terminology, diverse linguistic expressions, and a high degree of variability in dialogue structure. Crucially, clinically relevant information is often sparsely distributed and interwoven with extraneous or non-clinical dialogue, making it difficult to identify and extract salient content [ Joshi et al. 2020 ] . This task is further complicated by the need for precise structuring of information according to clinical documentation standards (e.g., SOAP notes). Even human experts can struggle with this level of abstraction and organization. Evidence of this difficulty is reflected in performance on benchmark tasks such as the United States Medical Licensing Examination (USMLE), where annotators are required to identify key clinical concepts (rubric features) and correctly categorize them under the appropriate sections of a patient note [ Park et al. 2016 , Jin et al. 2021 ] . These challenges underscore the complexity of training and evaluating LLMs for accurate and clinically coherent summarization. Recent advances in LLM reasoning techniques offer promising avenues to address the limitations of both prompt engineering and finetuning in clinical summarization. Methods such as chain-of-thought prompting, retrieval-augmented generation, and modular reasoning pipelines enable models to decompose complex consultations into intermediate reasoning steps, improving accuracy and interpretability Kojima et al. 2022 , Wei et al. 2022 . By structuring the summarization process as a sequence of clinically-informed decisions, e.g., identifying relevant entities, mapping them to SOAP sections, and abstracting them into concise text, LLMs can achieve higher fidelity outputs while reducing reliance on brittle, large prompts, or domain-specific finetuning. FactsR introduces a modular reasoning pipeline designed to produce accurate and concise clinical notes by orchestrating multiple LLMs. The design places the clinician at the center of this, achieving a degree of LLM-explainability by design. It operates in real time during healthcare consultations, continuously extracting relevant clinical information, performing structured clinical reasoning on the findings, and generating abstractive summaries tailored to the required documentation format. In conventional scribe systems, it is the clinician’s job to review and edit the LLM-generated note, which is sometimes viewed as tedious and time consuming. FactsR is designed for ease of overview and understanding, by separating medical facts from formatting, phrasing, and allocation of information into a given note structure. In addition to greater clarity, it enables interactive engagement with intermediate clinical findings, allowing clinicians to refine and validate information on the fly, akin to glance at the notepad in classic note-taking. By extracting clinical findings in real time, FactsR unlocks vast opportunities for implementing AI-driven decision support systems at the point of care. This paper makes three primary contributions: 1. it introduces FactsR, a novel framework that performs real-time clinical reasoning in tandem with the clinician during patient consultations; 2. it proposes a model-based evaluation method tailored to assess the outputs of ambient scribe systems; 3. and it presents a comparative analysis using the publicly available Primock57 benchmark, demonstrating the effectiveness of FactsR relative to a strong few-shot prompted ambient scribe baseline. Our findings indicate that the FactsR method significantly enhances the clinical relevance of generated notes by increasing the inclusion of pertinent information while simultaneously reducing extraneous content. This leads to notes that are both more accurate and more concise. Furthermore, when clinicians interact with the intermediate clinical findings produced by FactsR, we observe an additional improvement in both accuracy and conciseness, highlighting the value of clinician-guided refinement in the generation process. 2 Motivation for FactsR Due to the unstructured nature of clinical dialogues and the computational expense associated with LLMs, most Ambient Scribe systems adopt a post-hoc generation approach, producing documentation only after the consultation has concluded. This strategy allows the model to process the entire conversation in a single pass, maximizing coherence by leveraging the full dialogue context during inference. However, in addition to risking performance deterioration in long consultations, retrospective generation imposes challenges on structuring the input, as decomposing the raw transcript into intermediate reasoning steps post hoc is non-trivial [ Mathur et al. 2023 , Kirstein et al. 2025 ] . To compensate, these systems often rely on few-shot prompting to guide the model’s summarization behavior. While effective to some extent, this approach can be brittle and labor-intensive to scale, especially given the variability in clinical discourse. The example in Figure 1 illustrates a minimal prompt, comprising approximately 65 tokens, used to steer the generation process. Write a structured SOAP note based on the following clinical transcript. S (Subjective): Patient’s reported symptoms, concerns, history. O (Objective): Vitals, physical findings, labs, imaging. A (Assessment): Diagnosis or differential. P (Plan): Treatment, tests, follow-up. Use clear, professional medical language like the following example: [Insert example here] Transcript: [Insert transcript here] Figure 1 : Example of a simple prompt template that, given

Read the complete text