Improving Human Verification of LLM Reasoning through Interactive Explanation Interfaces
Runtao Zhou, Giang Nguyen, Nikita Kharya, Anh Totti Nguyen, Chirag Agarwal · 2025
Read Improving Human Verification of LLM Reasoning through Interactive Explanation Interfaces by Runtao Zhou, Giang Nguyen, Nikita Kharya, Anh Totti Nguyen, Chirag Agarwal (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2510-22922.txt.
Introduction
Runtao Zhou leads a team of five researchers who study how people can check the step-by-step reasoning of large language models. Such models now help with tutoring and study, and they often show long chains of thought. Those chains can run to thousands of tokens, so errors are hard for a reader to spot.
The team built three interactive tools that let users probe the reasoning, a program form, and a graph form. Their work asks which layout helps people find mistakes and judge answers with more care. It offers design ideas for classrooms where AI help must stay open to human checks.
Catalog record
| CREATOR | Runtao Zhou, Giang Nguyen, Nikita Kharya, Anh Totti Nguyen, Chirag Agarwal |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 47 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2510-22922
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Improving Human Verification of LLM Reasoning through Interactive Explanation Interfaces Runtao Zhou, Giang Nguyen, Nikita Kharya, Anh Totti Nguyen, Chirag Agarwal Abstract The reasoning capabilities of Large Language Models (LLMs) have led to their increasing employment in several critical applications, particularly education, where they support problem-solving, tutoring, and personalized study. Chain-of-thought (CoT) reasoning capabilities [ 1 , 2 ] are well-known to help LLMs decompose a problem into steps and explore the solution spaces more effectively, leading to impressive performance on mathematical and reasoning benchmarks. As the length of CoT tokens per question increases substantially to even thousands of tokens per question [ 1 ] , it is unknown how users could comprehend LLM reasoning and detect errors or hallucinations. To address this problem and understand how reasoning can improve human-AI interaction, we present three new interactive reasoning interfaces: interactive CoT (iCoT), interactive Program-of-Thought (iPoT), and interactive Graph (iGraph). That is, we ask LLMs themselves to generate an interactive web interface wrapped around the original CoT content, which may be presented in text (iCoT), graphs (iGraph) or code (iPoT). This interface allows users to interact with and provide a novel experience in reading and validating the reasoning chains of LLMs. Across a study of 125 participants, interactive interfaces significantly improve user performance. Specifically, iGraph users score the highest error detection rate ( 85.6 % 85.6\% ), followed by iPoT ( 82.5 % 82.5\% ), iCoT ( 80.6 % 80.6\% ), all outperforming standard CoT ( 73.5 % 73.5\% ). Interactive interfaces also lead to faster user validation time—iGraph users are faster ( 57.9 57.9 secs per question) than the users of iCoT and iPoT ( 60 60 secs) and the standard CoT ( 64.7 64.7 secs). A post-study questionnaire shows that users prefer iGraph, citing its superior ability to enable them to follow the LLM’s reasoning. We discuss the implications of these results and provide recommendations for the future design of reasoning models. Try our interactive interfaces on HuggingFace . 1 Introduction Large language models (LLMs) are now woven into high-stakes, real-world workflows, including education, where they assist with problem solving, tutoring, and personalized study [ 3 , 4 , 5 ] . A key driver of their recent success on complex tasks is chain-of-thought (CoT) prompting [ 6 ] : eliciting step-by-step intermediate reasoning often yields dramatic accuracy gains on arithmetic, commonsense, and symbolic reasoning benchmarks, with state-of-the-art performance on GSM8K and related math datasets. However, the current format for presenting LLM explanations may be far from optimal [ 7 ] . Figure 1: Given a GSM8K question, LLMs typically provide step-by-step reasoning followed by the final answer. However, such output presentation is often static and long, posing a higher cognitive load to users and leading to slower and more erroneous answer verification. In contrast, we prompt LLMs to generate an interactive HTML/JavaScript application wrapped around the reasoning. This interface enables users to verify the reasoning more efficiently via tools of (a) navigation buttons (inspired by those in common IDEs) and (b) colored highlights [ 8 ] . While CoT outputs contain rich information, their long-text presentation introduces significant challenges for human interpretation [ 9 , 10 , 11 ] . In practice, especially in modern reasoning LLMs [ 1 ] , CoT often appears as a long “ wall of text ” that can be time-consuming, obscure structure, increase cognitive load, and make error detection harder precisely when it matters. For example, when an explanation contains a subtle mistake in one intermediate step, detecting that error often requires carefully parsing multiple sentences and mentally reconstructing the reasoning flow [ 12 ] . More broadly, the explainable AI (XAI) literature shows that explanation techniques are frequently designed around what researchers can produce rather than what end users need; users instead report wanting practically useful information that improves collaboration, trust calibration, and feedback loops with AI systems [ 13 , 14 , 15 ] . This gap motivates rethinking how reasoning is surfaced to end-users in contexts like education, where clarity, verification, and engagement are essential. Prior work has demonstrated that the design of LLM explanations, which includes factors such as visual structure, interactivity, and information hierarchy, can significantly influence users’ trust and understanding [ 16 , 17 , 18 , 19 ] . However, most existing research on CoT focuses on improving the reasoning process within the model rather than optimizing the presentation of the reasoning [ 20 , 21 ] . As a result, LLM explanations remain largely static, text-heavy, and difficult to navigate [ 22 ] . This disconnect raises critical questions: How can explanation formats be redesigned to reduce cognitive load and enable users to effectively detect errors and understand LLM-generated reasoning steps? Present work. To address these questions, we propose an interactive explanation interface, an approach that explores interactive and structured alternatives to traditional text-based reasoning outputs as shown in Fig. 1 . Rather than presenting explanations as static and dense paragraphs, we introduce three novel formats designed to enhance clarity and interpretability: i) interactive CoT (iCoT), a format that preserves the text-based explanation but introduces features such as color-coded highlights for key steps, a clear step-by-step breakdown, and a concise summary for quick reference, ii) interactive graph (iGraph), a format where reasoning steps are represented as nodes connected by edges in a left-to-right flow diagram, allowing users to easily identify the logical progression of steps and visually detect errors or inconsistencies and iii) interactive Program-of-Thought (iPoT), a code-based format that presents reasoning as a sequence of pseudo-code lines. Each line represents a logical operation or variable update, showing how intermediate values lead to the final solution. To evaluate the effectiveness of these formats, we conducted a controlled user study using problems from GSM8K, a multi-step mathematical reasoning benchmark. Each participant was randomly assigned to one of the four explanation formats, including a traditional text baseline, and asked to review ten LLM-generated (using Claude 3.7 Sonnet) explanations. Participants were tasked with determining whether each explanation was correct or incorrect. For incorrect explanations, the user has to identify the exact step where the error occurred. This experimental design allows us to measure two key performance metrics: verification accuracy, which reflects participants’ ability to correctly identify errors and locate faulty steps, and time per question, which indicates the efficiency of error detection. Finally, we performed a post-experiment study, where we took users’ subjective feedback and measured the user engagement during the experiment. Our study aims to answer three central research questions: RQ1) Do interactive explanation formats help users improve verification accuracy compared to traditional text outputs? RQ2) How do these formats influence the time and effort required for users to verify reasoning? RQ3) Do users prefer interactive explanation formats over traditional text-based outputs? By systematically comparing these formats, we aim to uncover design principles that enhance the interpretability of LLM-generated explanations. Our work contributes not only a practical evaluation of interactive explanation designs but also broader implications for building trustworthy systems. When users can efficiently and accurately verify reasoning steps, they are better equipped to detect model errors, avoid over-reliance on incorrect outputs, and make informed decisions. These findings have potential applications in educational tools, auditing systems,