Editing with AI: How Doctors Refine LLM-Generated Answers to Patient Queries

Rahul Sharma, Pragnya Ramjee, Kaushik Murali, Mohit Jain · 2025

Read Editing with AI: How Doctors Refine LLM-Generated Answers to Patient Queries by Rahul Sharma, Pragnya Ramjee, Kaushik Murali, Mohit Jain (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2511-19940.txt.

Introduction

Rahul Sharma, Pragnya Ramjee, Kaushik Murali, and Mohit Jain study how doctors edit answers that language models draft for patients. Patient message volume strains health systems, and model drafts could help, but how clinicians actually revise them was little known. The study works with eye doctors, a group facing many routine surgery questions.

Nine ophthalmologists answered many cataract surgery questions three ways: writing alone, editing model drafts directly, and giving instructions for indirect edits. Model drafts were mostly accurate, but rare errors and automation bias showed why human oversight matters. Most editing adapted generic answers to local practice and patient expectations. Direct editing was more precise but heavier; indirect editing saved effort but added errors.

Catalog record

CREATORRahul Sharma, Pragnya Ramjee, Kaushik Murali, Mohit Jain
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE44 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2511-19940

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Editing with AI: How Doctors Refine LLM-Generated Answers to Patient Queries Rahul Sharma, Pragnya Ramjee, Kaushik Murali, Mohit Jain Abstract Patients frequently seek information during their medical journeys, but the rising volume of digital patient messages has strained healthcare systems. Large language models (LLMs) offer promise in generating draft responses for clinicians, yet how physicians refine these drafts remains underexplored. We present a mixed-methods study with nine ophthalmologists answering 144 cataract surgery questions across three conditions: writing from scratch, directly editing LLM drafts, and instruction-based indirect editing. Our quantitative and qualitative analyses reveal that while LLM outputs were generally accurate, occasional errors and automation bias revealed the need for human oversight. Contextualization—adapting generic answers to local practices and patient expectations—emerged as a dominant form of editing. Editing workflows revealed trade-offs: indirect editing reduced effort but introduced errors, while direct editing ensured precision but with higher workload. We conclude with design and policy implications for building safe, scalable LLM-assisted clinical communication systems. \workshoptitle The Second Workshop on GenAI for Health: Potential, Trust, and Policy Compliance 1 Introduction Patients seek information throughout their medical journeys 9 . Effectively addressing these information needs is central to patient-centered care 30 , supporting informed decision making 9 and improving health outcomes like treatment adherence and emotional well-being 24 . Digital communication platforms, such as chat groups, instant messengers, and web portals, have emerged as powerful tools for meeting these needs, by enabling healthcare providers to deliver timely, accurate responses to patient concerns 20 ; 28 ; 29 . However, the increasing ubiquity of these platforms, accelerated by the COVID-19 pandemic and a surge in telemedicine, has strained healthcare systems with unprecedented volumes of interactions 12 ; 18 . The advent of generative AI has raised the possibility that large language models (LLMs) could help manage this burden by assisting physicians in patient communication 20 ; 22 ; 29 . Early studies evaluating the quality of LLM responses to medical questions found physicians frequently rate these answers as ‘safe’, and sometimes even prefer them to peer-written responses 23 . However, LLMs can still output inaccurate, outdated or inappropriate information 3 ; 5 , and patients report lower trust in invalidated LLM responses 20 . Thus, doctor oversight remains indispensable. One promising approach is using LLMs to generate draft responses to patient queries for clinicians to refine, rather than replace them 4 ; 20 . Initial deployments report clear benefits such as reduced workload on doctors and improved response quality 7 ; 25 .However, challenges remain, including physicians over-relying on LLM output instead of exercising their own clinical judgment 5 ; 7 ; 27 and producing verbose answers 25 , potentially due to the labor required in correcting and shortening LLM responses.Thus, understanding how clinicians refine LLM drafts, and how different co-authoring strategies align with their workflows to maximize usability and effectiveness, is essential 1 ; 5 ; 10 . While the existing body of work has examined LLM response quality and physician acceptance, the specific approaches for refining LLM drafts remain understudied. We address this gap with a mixed-methods study comparing three answer generation approaches: writing from scratch (doctor writes answer, no LLM involved), direct editing (manually correcting LLM-generated drafts), and instruction-based editing (providing instructions to the LLM for correction). We evaluate accuracy, completeness, and safety of the answers, along with doctor’s efficiency and preferences, to answer these research questions: How do different LLM co-authoring approaches affect physician efficiency and response quality when answering patient queries? What are physicians’ perceptions of usability and workflow compatibility across different LLM co-authoring approaches? To ground our investigation in a concrete clinical context, we focus on cataract surgery, the most common ophthalmic procedure worldwide and the second highest surgical procedure globally 17 . Doctor-patient communication becomes critical for surgical procedures, as patients seek reassurance about surgical risks and detailed information about post-operative care 9 . High patient query volumes have prompted development of LLM-based communication systems, including standardized patient education materials 26 and doctor-in-the-loop chatbots 20 ; 22 . We worked with 9 ophthalmologists who answered 144 cataract surgery questions across the three conditions, then participated in focus group discussions and evaluated answers generated by their peers. Doctors found LLM-generated answers to be generally accurate and complete, but occasional factual errors and the risk of automation bias underscored the need for human oversight. A central form of editing was contextualization—adapting otherwise generic answers to local practices, terminology, and patient expectations. Editing workflows revealed trade-offs: instruction-based editing reduced effort compared to direct text editing, yet introduced occasional technical errors and ambiguities. Finally, while doctors valued the polished language of LLM drafts, they often had to simplify and reframe answers into shorter, clearer, and more conversational forms suitable for patients. Together, these results extend prior work by shifting attention from LLM response quality alone to the process of refinement, illuminating design and policy directions for safe, scalable integration of LLMs into patient communication. 2 Methods We conducted a mixed-method controlled user study during June-July 2025 in collaboration with Sankara Eye Hospital, a leading tertiary eye care and teaching hospital in India. The study took place at its Jaipur and Hyderabad branches. Approval was obtained from the Scientific and Ethics Committees of both sites. In line with hospital policy, participants received no financial compensation. Participants Nine practicing ophthalmologists (4 female) from Sankara Eye Hospital (4 Hyderabad, 5 Jaipur) participated in the study (Table 1 ). All performed at least 10 cataract surgeries per week. Their mean age was 37.1 \pm 5.5 years, with 11.6 \pm 5.1 years of professional experience. Figure 1: Web-based study interface. (Left) Condition 1: Writing from Scratch (Write), where doctors write answers in text box B . (Middle) Condition 2: Direct Editing (Edit), where doctors edit pre-generated LLM answers (in the textbox D ). (Right) Condition 3: Indirect Editing (Instruct), where doctors provide instructions for revision ( I ), with changes visually highlighted ( F ). Interface Design We designed a custom web-based application powered by GPT-4o (Figure 1 ) to compare the three conditions. Condition 1 ( Writing from Scratch ) aka Write : Doctors answered questions in a blank text box (Figure 1 B, without the pre-generated LLM answer). Condition 2 ( Direct Editing ) aka Edit : Doctors revised an LLM-generated draft in an editable text box (Figure 1 D). Condition 3 ( Indirect Editing ) aka Instruct : Doctors received an LLM draft in a non-editable text box (Figure 1 F) and indirectly edited it by providing instructions in a separate text box (Figure 1 I). The system generated revised responses with changes highlighted (green for additions, red strikethrough for deletions), along with an optional toggle button (Figure 1 G) to hide/show differences. Navigation arrows (Figure 1 H) enabled participant to review past versions of the answer and selecting one for further editing or submission. All conditions included a timer (Figure 1 C), which doctors could pause only for interruptions. The order of conditions was randomized across participants for counterbalancing. All interactions were automatically logged. Procedure After a pilot study, we conducted the main study in three phases (Figure 2 ): Phase 0: Pilot Study . We conducted four training sessions with 9 doctors to

Read the complete text