Stop Listening to Me! How Multi-turn Conversations Can Degrade Diagnostic Reasoning

Kevin H. Guo, B.S. 1, Chao Yan, Ph.D. 1, Avinash Baidya, Ph.D. 2, Katherine Brown, Ph.D. 3, Xiang Gao, Ph.D. 2, Juming Xiong, B.S. 1, Zhijun Yin, Ph.D. 1,3, Bradley A. Malin, Ph.D. 1,3 · 2026

Read Stop Listening to Me! How Multi-turn Conversations Can Degrade Diagnostic Reasoning by Kevin H. Guo, B.S. 1, Chao Yan, Ph.D. 1, Avinash Baidya, Ph.D. 2, Katherine Brown, Ph.D. 3, Xiang Gao, Ph.D. 2, Juming Xiong, B.S. 1, Zhijun Yin, Ph.D. 1,3, Bradley A. Malin, Ph.D. 1,3 (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-11394.txt.

Introduction

Kevin Guo and coauthors show that long conversations quietly erode language model reliability, a risk static benchmarks miss entirely, with direct stakes for medical chatbots. Their stick-or-switch framework splits questions into sequential presentations and scores two behaviors: holding a correct answer against wrong suggestions, and switching when a correct suggestion arrives. Across seventeen models and three clinical benchmarks, a pervasive conversation tax cuts accuracy and sound abstention by up to thirty percent on average. Models also abandon initial abstentions for wrong and right suggestions at nearly identical rates.

Catalog record

CREATORKevin H. Guo, B.S. 1, Chao Yan, Ph.D. 1, Avinash Baidya, Ph.D. 2, Katherine Brown, Ph.D. 3, Xiang Gao, Ph.D. 2, Juming Xiong, B.S. 1, Zhijun Yin, Ph.D. 1,3, Bradley A. Malin, Ph.D. 1,3
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE30947
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2603.11394

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Stop Listening to Me! How Multi-turn Conversations Can Degrade Diagnostic Reasoning Kevin H. Guo, B.S. 1, Chao Yan, Ph.D. 1, Avinash Baidya, Ph.D. 2, Katherine Brown, Ph.D. 3, Xiang Gao, Ph.D. 2, Juming Xiong, B.S. 1, Zhijun Yin, Ph.D. 1,3, Bradley A. Malin, Ph.D. 1,3 Abstract \institutes 1 Vanderbilt University, Nashville, TN, USA; 2 Intuit AI Research, Mountain View, CA; 3 Vanderbilt University Medical Center, Nashville, TN, USA Abstract Patients and clinicians are increasingly using chatbots powered by large language models (LLMs) for healthcare inquiries. While state-of-the-art LLMs exhibit high performance on static diagnostic reasoning benchmarks, their efficacy across multi-turn conversations, which better reflect real-world usage, has been understudied. In this paper, we evaluate 17 LLMs across three clinical datasets to investigate how partitioning the decision-space into multiple simpler turns of conversation influences their diagnostic reasoning. Specifically, we develop a “stick-or-switch” evaluation framework to measure model conviction (i.e., defending a correct diagnosis or safe abstention against incorrect suggestions) and flexibility (i.e., recognizing a correct suggestion when it is introduced) across conversations. Our experiments reveal the conversation tax, where multi-turn interactions consistently degrade performance when compared to single-shot baselines. Notably, models frequently abandon initial correct diagnoses and safe abstentions to align with incorrect user suggestions. Additionally, several models exhibit blind switching, failing to distinguish between signal and incorrect suggestions. Introduction Large language models (LLMs) are increasingly being deployed in the medical domain, quickly approaching safety-critical settings in clinical care 21 , 1 , 20 . At the same time, patients are adopting these systems to support their own inquiries, using proprietary chatbots to triage symptoms, interpret complex clinical documentation, and seek personalized medical advice 40 , 13 , 6 , 3 , 5 . This rapid, widespread adoption is driven by the combination of vast, expert-level biomedical fluency and an accessible interface that affords the flexibility for personalized care in a conversational setting 3 . While patients historically faced systemic barriers to healthcare—such as difficulty understanding their clinicians 2 , 24 , 22 , reluctance in disclosing information and asking questions 32 , 24 , 22 , or general anxiety toward medical visits 32 —the accessibility of LLMs is democratizing the opportunity for patients to actively engage in conversations about their health 3 , 5 . Figure 1: Measuring conviction and flexibility in LLM clinical decision-making through multi-turn conversational exchange. (a) Positive conviction, where a model must defend a correct initial diagnosis against subsequent incorrect suggestions. (b) Negative conviction, where the model must maintain an initial safe abstention against subsequent incorrect suggestions. (c) Flexibility, where the model must recognize the introduction of the clinical truth after abstaining against an incorrect option. Note that positive and negative conviction may extend up to four turns. The true answer for the example question is highlighted in green. The current enthusiasm and confidence surrounding LLMs in healthcare are largely inspired by their high evaluation performance. Historically, these evaluations have relied on benchmarks, popularized in the machine learning community as a way to demonstrate progress in model performance 38 , 17 . For example, one popular clinical benchmark is MedQA, which comprises multiple-choice question-answer pairs (MCQA) derived from the United States Medical Licensing Exam (USMLE) 17 , which LLMs have almost mastered. These benchmarks operate in idealized decision spaces, assuming a closed-world setting where the correct diagnosis and the evidence required to deduce it are present. However, the reality of clinical decision-making is far from this. In practice, clinicians must navigate unstructured and incomplete patient profiles to discern extraneous noise from true diagnostic signal 35 , 9 . In addition, this process is dynamic. As new information emerges, clinicians must iterate over, and potentially revise, their initial hypotheses 37 , 23 , 16 . Patient-LLM interactions follow similar processes, but introduce their own complexities. Notably, without formal clinical education, patients naturally explore their concerns in fragmented, conversational trial-and-error, iterating their inquiry over multiple exchanges 29 , 31 . These challenges necessitate a safety-centric evaluation approach. There is an emerging body of literature highlighting the inefficacy of LLMs in clinical settings. Bedi and colleagues demonstrated that simply removing and replacing the ground truth in MedQA questions with “ None of the other answers ” causes accuracy to drop over 30%, suggesting that LLMs utilize pattern matching rather than true reasoning in clinical settings 8 . In addition, Chen et al. demonstrated that the helpfulness encoded in LLMs leads them to frequently comply with illogical medical requests that would generate false information, despite having the knowledge to identify the request as illogical 11 . Beyond the clinical AI domain, LLM researchers have recently found that models get lost in multi-turn conversations 19 . In settings where there is under-specification in user queries, LLMs tend to make early assumptions that they then rely on in prematurely jumping to generate final solutions 19 . This behavior is quite pertinent in the medical domain. Since patients turn to LLMs to fill gaps in their knowledge, under-specification is the default state of interaction 31 , 29 , 14 . While a trained clinician can proactively recognize false assumptions and request additional labs or history to resolve them, patients lack this intuition and may be more susceptible to misinformation 25 . Notably, under-specification can be present in LLM-clinician interactions as well, where patient profiles may initially be incomplete and evolve over time 37 , 23 , 16 . Despite these limitations, commercial vendors are rapidly deploying specialized services, such as OpenAI’s ChatGPT Health and Anthropic’s Claude for Healthcare, to facilitate personalized medical dialogue. Early evaluations of these services align with previously observed vulnerabilities. For example, Ramaswamy and colleagues found that ChatGPT Health under-triaged more than 50% of simulated medical emergencies 30 . While conversational chatbots present clear safety vulnerabilities, there has been little formal investigation into how multi-turn conversation influences diagnostic reasoning in LLMs. We address this gap by investigating the conviction and flexibility of LLM clinical decision-making under conversational pressure. Specifically, we partition traditional MCQA answer-spaces into sequential multi-turn exchanges. In doing so, we prompt a model with an initial binary choice between two options, and upon selecting one, proceed to subsequent turns where the model must either 1) stick to their initial diagnosis or 2) switch to a newly introduced suggestion. We formalize two behavioral metrics to evaluate these multi-turn interactions. The first is positive conviction , which is measured by a model’s ability to defend a correct diagnosis against incorrect suggestions, which we refer to as distractors (Figure 1 a). The second is negative conviction , which is measured by the model’s capacity to maintain a safe abstention when subsequently pressured with incorrect suggestions (Figure 1 b). Finally, we investigate model flexibility , in terms of the capacity to recognize the true clinical signal when it is eventually introduced to the answer space (Figure 1 c). To demonstrate the generalizability of our findings, we evaluate this multi-turn framework across 17 LLMs including both open-source models and commercial frontier models on two medical benchmarks and one set of real-world clinical vignettes, enabling us to quantify multi-turn reliability across context complexity and model scale. Consequently, this study investigates the conversation tax in clinical dialogue, a penalty to diagnostic performance incurred when engaging

Read the complete text