When the Chain Breaks: Interactive Diagnosis of LLM Chain-of-Thought Reasoning Errors Volume: 45 Issue: 3
Shiwei Chen 1 , Niruthikka Sritharan 1 , Xiaolin Wen 1 , Chenxi Zhang 1 , Xingbo Wang 2 , Yong Wang 1 1 College of Computing and Data Science, Nanyang Technological University, Singapore 2 Bosch Research North America, Sunnyvale, CA, United States · 2026
Read When the Chain Breaks: Interactive Diagnosis of LLM Chain-of-Thought Reasoning Errors Volume: 45 Issue: 3 by Shiwei Chen 1 , Niruthikka Sritharan 1 , Xiaolin Wen 1 , Chenxi Zhang 1 , Xingbo Wang 2 , Yong Wang 1 1 College of Computing and Data Science, Nanyang Technological University, Singapore 2 Bosch Research North America, Sunnyvale, CA, United States (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-21286.txt.
Introduction
Chen and co-authors build ReasonDiag, an interactive system for diagnosing errors in chain-of-thought reasoning. Long reasoning traces can hide logical and factual slips, which makes them hard for users to check. Their detection pipeline pairs external fact-checking with symbolic logic validation to flag errors step by step. ReasonDiag shows step distributions and error spread in an arc diagram, plus a node-link view of the flow. In tests and interviews with sixteen users, it helped people find faulty steps and root causes.
Catalog record
| CREATOR | Shiwei Chen 1 , Niruthikka Sritharan 1 , Xiaolin Wen 1 , Chenxi Zhang 1 , Xingbo Wang 2 , Yong Wang 1 1 College of Computing and Data Science, Nanyang Technological University, Singapore 2 Bosch Research North America, Sunnyvale, CA, United States |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 71788 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2603.21286
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
When the Chain Breaks: Interactive Diagnosis of LLM Chain-of-Thought Reasoning Errors Volume: 45 Issue: 3 Shiwei Chen 1 , Niruthikka Sritharan 1 , Xiaolin Wen 1 , Chenxi Zhang 1 , Xingbo Wang 2 , Yong Wang 1 1 College of Computing and Data Science, Nanyang Technological University, Singapore 2 Bosch Research North America, Sunnyvale, CA, United States Abstract Current Large Language Models (LLMs), especially Large Reasoning Models, can generate Chain-of-Thought (CoT) reasoning traces to illustrate how they produce final outputs, thereby facilitate trust calibration for users. However, these CoT reasoning traces are usually lengthy and tedious, and can contain various issues, such as logical and factual errors, which make it difficult for users to interpret the reasoning traces efficiently and accurately. To address these challenges, we develop an error detection pipeline that combines external fact-checking with symbolic formal logical validation to identify errors at the step level. Building on this pipeline, we propose ReasonDiag , an interactive visualization system for diagnosing CoT reasoning traces. ReasonDiag provides 1) an integrated arc diagram to show reasoning-step distributions and error-propagation patterns, and 2) a hierarchical node-link diagram to visualize high-level reasoning flows and premise dependencies. We evaluate ReasonDiag through a technical evaluation for the error detection pipeline, two case studies, and user interviews with 16 participants. The results indicate that ReasonDiag helps users effectively understand CoT reasoning traces, identify erroneous steps, and determine their root causes. \SpecialIssuePaper \CGFccby ccs Human-centered computing Visual analytics ccs Human-centered computing Interactive systems and tools † † year: 2026 † † year: 2026 † † editors: N. Andrienko, M. Chen, and B. Wang † † subject: Eurographics Conference on Visualization CGF Vol No † † orcid: 0009-0007-9106-7989 † † orcid: 0009-0007-3322-3218 † † orcid: 0000-0001-5693-1128 † † orcid: 0000-0002-0092-0793 1 Introduction In the past few years, large language models (LLMs) have become foundational across diverse real-world tasks, such as information seeking, decision-making, and practical guidance [ 7 ] . Chain-of-Thought (CoT) prompting [ 43 ] improves task performance by encouraging models to output intermediate reasoning steps in natural language, producing a human-readable reasoning trace. Building on this idea, large reasoning models (LRMs) go further by producing reasoning traces natively during inference [ 30 , 37 , 15 , 47 ] 1 1 1 See Appendix A for a summary of how some major LRM providers expose reasoning traces through user interfaces and APIs. . Apart from performance improvements, these reasoning traces offer user-centric value: they enable early detection of model misbehavior [ 4 , 14 , 20 ] , facilitate the calibration of user trust by revealing the model reasoning [ 5 , 43 ] , and can even serve as an interactive medium to steer model output [ 33 ] . However, the utility of CoT reasoning traces is often undermined by two primary challenges: verbosity and possible unreliability . First, long CoT reasoning traces have become a common feature of most LRMs [ 9 ] . These traces are characterized by a large set of reasoning steps that explore diverse paths as well as steps that revisit earlier decisions [ 9 ] . Consequently, the verbose reasoning traces and their non-linear structures make it time-consuming for common users to understand the reasoning process and mentally reconstruct the complex dependencies among various exploratory claims or revised statements. Second, due to the lack of internal verification mechanisms, LRMs often generate reasoning traces that suffer from logical and factual errors [ 38 ] . Such errors are often distributed in different parts of the lengthy CoT reasoning traces, and the verification of a statement also depends on the context and premise statements, making it difficult to identify reasoning errors and often resulting in users’ misplaced trust in the model output. Limited research has been done on the interpretation and diagnosis of CoT reasoning traces. Existing LLM interfaces (e.g., ChatGPT [ 29 ] ) often summarize or selectively hide intermediate reasoning steps, which strips away critical context and undermines the verifiability of the model reasoning process. More recent visualization approaches, like HIPPO [ 33 ] , iGraph [ 48 ] and ReasonGraph [ 23 ] , provide a graph-based organization of LLM reasoning traces. But they do not enable diagnostic support, and users still need to fully rely on the original CoT reasoning traces to understand and diagnose errors. The research in the AI field has attempted to reduce the errors in the LLM CoT reasoning traces via self-consistency checking [ 42 ] and process rewarding [ 24 ] . However, these techniques can only reduce errors to some extent in CoT reasoning traces, which makes tedious human examination still necessary. Therefore, an effective method to efficiently understand and diagnose CoT reasoning traces is still missing and urgently needed. To fill the research gap, we propose ReasonDiag , an interactive visual analytics approach to help LLM users effectively interpret and diagnose CoT reasoning traces . Specifically, ReasonDiag focuses on human-in-the-loop diagnosis of factual and logical errors in CoT reasoning traces, instead of error correction. Our system targets general LRM users who rely on model outputs and need to review CoT reasoning traces for trust calibration. It aims to help LRM users explore individual complex reasoning traces ranging from dozens to over a hundred reasoning steps. ReasonDiag is designed based on the requirements distilled from a formative study with nine experienced LRM users, which examined their challenges and strategies when diagnosing CoT reasoning traces. ReasonDiag integrates an automated error detection pipeline with interactive visualizations. The error detection pipeline combines two complementary verification paradigms: external fact-checking and formal logic verification, which collectively address the challenge of possible unreliability in CoT reasoning traces. External fact-checking is invoked for claims that rely on real-world facts, domain-specific knowledge, or commonsense reasoning that cannot be captured by formal logic alone (e.g., the claim “The Hubble Space Telescope was launched in 1992” shown in Figure 1 ). Formal logic verification operates on reasoning steps and checks whether each step logically follows its stated premises (e.g., we verify whether the step “So we compute 2025-1992” in Figure 1 is really warranted by the premise “The Hubble Space Telescope was launched in 1992” ). Two coordinated visualizations are developed to enable effective exploration and diagnosis of CoT reasoning traces: an arc diagram provides an overview of error propagation patterns across the chain ( Figure 2 A ), and a hierarchical node-link diagram exposes the high-level reasoning structure and premise–conclusion dependencies ( Figure 2 B ), where the original CoT reasoning traces can also be revealed on demand to show the reasoning context. This design allows users to rapidly navigate, filter, trace CoT reasoning dependencies, and understand root causes of errors while preserving the full contextual nuance and enabling human verification. We evaluate ReasonDiag through a technical evaluation of our error-detection pipeline, two case studies, and user interviews with 16 participants. The results show that ReasonDiag effectively helps users comprehend long CoT reasoning traces, pinpoint erroneous steps, and diagnose their root causes compared to reading plain texts alone. In summary, our main contributions are as follows: • A formative study that systematically characterizes the limitations of raw textual CoT for human oversight; • An interactive visualization system named ReasonDiag