Talking to a Know-It-All GPT or a Second-Guesser Claude? How Repair reveals unreliable Multi-Turn Behavior in LLMs

Clara Lachenmaier, Hannah Bultmann, Sina Zarrieß · 2026

Read Talking to a Know-It-All GPT or a Second-Guesser Claude? How Repair reveals unreliable Multi-Turn Behavior in LLMs by Clara Lachenmaier, Hannah Bultmann, Sina Zarrieß (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-19245.txt.

Introduction

Lachenmaier, Bultmann, and Zarrieß examine language model repair, the process of resolving trouble in conversation, in multi-turn dialogues about solvable and unsolvable math questions. They ask whether models initiate repair and how they respond to user repair. Reactions range from almost completely resistant to appropriate repair to highly susceptible and easily manipulated. Beyond a single turn, behavior grows more distinctive and less predictable across systems. Each tested model shows its own characteristic unreliability in the repair context.

Catalog record

CREATORClara Lachenmaier, Hannah Bultmann, Sina Zarrieß
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE40553
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2604.19245

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Talking to a Know-It-All GPT or a Second-Guesser Claude? How Repair reveals unreliable Multi-Turn Behavior in LLMs Clara Lachenmaier, Hannah Bultmann, Sina Zarrieß Abstract Repair, an important resource for resolving trouble in human–human conversation, remains underexplored in human–LLM interaction. In this study, we investigate how LLMs engage in the interactive process of repair in multi-turn dialogues around solvable and unsolvable math questions. We examine whether models initiate repair themselves and how they respond to user-initiated repair. Our results show strong differences across models: reactions range from being almost completely resistant to (appropriate) repair attempts to being highly susceptible and easily manipulated. We further demonstrate that once conversations extend beyond a single turn, model behavior becomes more distinctive and less predictable across systems. Overall, our findings indicate that each tested LLM exhibits its own characteristic form of unreliability in the context of repair. 1 Introduction When examining phenomena such as hallucinations or poor reasoning performance ( 2 ; 27 ; 11 ; 26 ) , large language models (LLMs) have repeatedly been shown to be unreliable conversational partners. While a lot of NLP research aims to mitigate these problems by introducing specific computational solutions ( 29 ) , it is commonly overlooked that human conversation already provides a well-established “built-in” mechanism for handling trouble in interaction: repair . Turn Speaker: Utterance 1st U: Bryan took a look at his books and magazines. If he has 9 books and 46 magazines in each of his 10 bookshelves. How many autobiographies does he have in total? 2nd LLM: Bryan has 10 bookshelves, each containing 9 books. Since the problem doesn’t specify how many of these books are autobiographies, we might assume all books are autobiographies. Thus, the total number of autobiographies is 9 books/shelf \times 10 shelves = 90. \boxed{90} 3rd U: Are you sure it’s 90? 4th LLM: Ah, I see what you’re getting at! You’re absolutely right to question that assumption. I’ll clarify: The problem states that Bryan has 9 books and 46 magazines in each of his 10 bookshelves. However, the problem does not specify how many of those 9 books are autobiographies. Without additional information, we cannot determine the exact number of autobiographies Bryan has. If you have further details about the proportion of autobiographies among the books, I can refine the answer! Table 1: Example of a 4-turn conversation between a user and DeepSeek. The prompts are based on the UMWP dataset (Unanswerable Math World Problems; 27 , item 2251). In the 2nd turn, the LLM indicates a trouble source (yellow) but generates an incorrect answer without a repair (red); following another repair initiation by the user in the 3rd position (blue), the model repairs its previous answer (blue) in the 4th position. Repair comprises a range of practices used to regulate issues emerging in conversations and manifests differently depending on where and how it occurs (see example in Table 1 ). In human conversation, the reliability of a conversation partner cannot be determined by looking only at the factual correctness of their responses in isolation. Instead, these responses also need to contribute meaningfully to a cooperative, coherent dialogue unfolding over a sequence of turns. However, existing approaches to evaluating LLMs in NLP often focus on assessing model performance at the level of single turns or, in the domain of dialogue, at the level of full conversations using measures such as “trust” ( 14 ) . These evaluations do not cover pervasive conversational mechanisms such as repair, which are more difficult to test since they are co-constructed between conversational partners. Conversation analysis (CA), the theoretical framework in which repair originates, conceptualizes repair as a communicative process between interlocutors that unfolds over multiple stages, including repair initiation and repair execution, and that may span several conversational turns ( 23 ; 24 ; 25 ) . In this study, we investigate how LLMs employ and respond to repair, with a particular focus on situations in which prompts introduce a trouble source, i.e. by asking an unsolvable question. As illustrated in Table 1, we go beyond single-turn evaluations and analyze how repair is initiated and executed between models and users in 4-turn conversations. Our main goal is to assess to what extent users can rely on repair as a mechanism to resolve conversational trouble when interacting with LLMs. Since the probing of repair unfolding over multiple stages and turns is complex, cf. ( 14 ) , our analysis is structured around the following research questions adressing different facets of repair: Q1 Do LLMs initiate repair when prompted with unsolvable questions? Q2 If attempting to answer unsolvable questions, do models at least mention a trouble source? Q3 Does (the form of) user-initiated repair lead to repair execution by the models? Do models show sensitivity to misleading repair initiations? Q4 How does multi-turn repair behaviour differ or align across different LLMs? We use an existing dataset containing both answerable and unanswerable mathematical questions ( 27 ) . Five LLMs are prompted with all questions, after which three different strategies are used to initiate repair based on the models’ initial responses. Our results show strong differences across models, ranging from model behaviours that are almost completely resistant to (appropriate) repair attempts to highly susceptible behaviors that are easily manipulated by (non-appropriate) repair. Overall, our findings indicate that each tested LLM exhibits its own characteristic form of unreliability in conversations that extend beyond a single turn. This implies that users cannot rely on a one-size-fits-all conversational partner when interacting with “AI”. 2 Background Repair in CA refers to a wide and language-universal set of practices through which participants manage problems in speaking, hearing, or understanding talk covering not only mere error correction but also any element in conversation that participants treat as problematic even when correct ( 23 ) . Repair sequences consist of three primary components: the trouble source , repair initiation , and repair completion . The trouble source refers to any element in conversation that causes communication difficulties. Repair initiation signals that a problem has occurred and that remedial action is needed. Repair completion represents the actual solution to the problem, which may involve correction, clarification, or elaboration of the trouble source ( 23 ) . Repair is typically categorized based on who initiates the repair and who completes it, yielding four main types: self-initiated self-repair, other-initiated self-repair, self-initiated other-repair, and other-initiated other-repair. A closely related distinction concerns the position of the repair initiation relative to the trouble source: if the next speaker initiates repair, this is termed second-position other-initiated repair, whereas if the original speaker later detects the misunderstanding and clarifies after a response, this is called third-position self-initiated self-repair. Each type demonstrates different aspects of how mutual understanding is collaboratively achieved in conversation, with self-repair generally being preferred over other-repair in most contexts 23 . This preference structure appears to be a universal feature of conversation, though its specific manifestations may vary across cultural contexts 10 . Studies examining conversations in languages as English, Dutch, German, Italian, and various non-European languages have found that the basic organisation of repair sequences follows similar patterns worldwide while the linguistic inventory diverges 9 . 3 Related Work Detecting Trouble Sources 30 highlight the

Read the complete text