DataScout: Automatic Data Fact Retrieval for Statement Augmentation with an LLM-Based Agent

Chuer Chen, Yuqi Liu, Danqing Shi, Shixiong Cao, Nan Cao · 2025

Read DataScout: Automatic Data Fact Retrieval for Statement Augmentation with an LLM-Based Agent by Chuer Chen, Yuqi Liu, Danqing Shi, Shixiong Cao, Nan Cao (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2504-17334.txt.

Introduction

Chuer Chen, Yuqi Liu, Danqing Shi, Shixiong Cao, and Nan Cao introduce a software tool for data storytellers, in a 2025 paper. A data story weaves facts from many angles into one account, but hunting down those facts takes time and skill. Their system, DataScout, uses a language-model agent to fetch supporting facts for a claim the user wants to make.

The agent builds its search as a branching tree, shown on screen as a mind map. Users can steer the branches, widening or narrowing the hunt, and weigh facts that back different stances. Case studies and interviews with experts showed the tool pulled in facts from many sides of an issue. Users said it helped them check their claims and write stories that readers could trust more.

Catalog record

CREATORChuer Chen, Yuqi Liu, Danqing Shi, Shixiong Cao, Nan Cao
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE53 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2504-17334

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

DataScout: Automatic Data Fact Retrieval for Statement Augmentation with an LLM-Based Agent Chuer Chen, Yuqi Liu, Danqing Shi, Shixiong Cao, Nan Cao Abstract . A data story typically integrates data facts from multiple perspectives and stances to construct a comprehensive and objective narrative. However, retrieving these facts demands time for data search and challenges the creator’s analytical skills. In this work, we introduce DataScout, an interactive system that automatically performs reasoning and stance-based data facts retrieval to augment the user’s statement. Particularly, DataScout leverages an LLM-based agent to construct a retrieval tree, enabling collaborative control of its expansion between users and the agent. The interface visualizes the retrieval tree as a mind map that eases users to intuitively steer the retrieval direction and effectively engage in reasoning and analysis. We evaluate the proposed system through case studies and in-depth expert interviews. Our evaluation demonstrates that DataScout can effectively retrieve multifaceted data facts from different stances, helping users verify their statements and enhance the credibility of their stories. DOI: XXXXXXX.XXXXXXX Conference: Make sure to enter the correct conference title from your rights confirmation emai; June 03–05, 2018; Woodstock, NY ISBN: 978-1-4503-XXXX-X/18/06 CCS: Human-centered computing Human computer interaction (HCI) CCS: Human-centered computing Visualization application domains Figure 1. DataScout enables automatic stance-based data fact retrieval to enhance user statements. Generally, the retrieval process typically begins with (a) the user selecting a specific statement in the editor. The user can then (b) browse and expand the retrieval tree within the retrieval space view. Once a node is clicked, (c) the retrieval details view appears, showing the query and retrieved data facts, allowing the user to select appropriate facts and add them to the editor. An example data story about "Global income inequality continues to widen" is shown in (d), with the three retrieved facts supporting the argument. 1. Introduction Data-driven storytelling, with its rich data content and expressive visualizations, has become a widely adopted method of information dissemination in the digital era. It often goes beyond merely presenting data to focus on persuading the audience through effective argumentation, which involves presenting, supporting, reinforcing, contradicting, or discussing a given statement ( Riche et al., 2018a ) . To achieve compelling argumentation, it is crucial to present accurate and relevant data facts ( Srinivasan et al., 2019 ) in the story to augment the statement thereby enhancing the credibility of the narrative. However, retrieving comprehensive data facts is a complicated and labor-intensive process that demands expertise in data analysis. To alleviate creator’s burdens, researchers in data visualization have explored various methods for automatic data facts generation ( Wang et al., 2020 ; Shi et al., 2020 ; Lu et al., 2021 ) . For example, DataShot ( Wang et al., 2020 ) extracts data facts from the tabular data by computing various facts within each enumerated subspace and scoring them for ranking. The enumeration method generates many redundant data facts, and manual scoring rules struggle to adapt to complex semantic environments. Recent advances in Large Language Models (LLMs) offer new opportunities for automating data analysis. Some studies ( Shen et al., 2024 ; Cheng et al., 2023 ) employ LLMs with carefully crafted prompts to extract insights from data. Although the strong understanding and reasoning abilities of LLMs enable efficient fact extraction, they still cannot extract facts that align with a specific argumentative direction. On the other hand, most studies are limited to extracting facts from the dataset provided by the user and cannot actively retrieve multidimensional data to strengthen the argument. Users must invest significant effort in data search and then apply data fact extraction methods to complete the entire workflow. While recent works have enabled fast task-driven search ( Wang and Fernandez, 2023 ; Herzig et al., 2021 ) , there remains a need for an iterative interface ( Hulsebos et al., 2024 ) that allows users to dynamically adjust the search direction based on argumentative needs. To better understand the workflow and challenges of retrieving data facts, we conducted an interview-based formative study with four data storytelling experts. The formative study found that retrieving data facts is a challenging and time-consuming task. To enhance the credibility of the story, creators generally need to prepare comprehensive data facts. This requires breaking down search objectives into keywords that allow for the retrieval of diverse data sources, and then analyzing the collected data to extract valuable facts that will strengthen the argument. To address the above challenges, we introduce DataScout, an intelligent system designed to automatically retrieve data facts for statement augmentation. In particular, we propose an LLM-based agent that collaborates with users to jointly construct a retrieval tree based on argumentative needs. The retrieval tree takes the statement to be augmented as the root node and expands nodes based on the user’s expected stance, with each node containing a query and its retrieved facts. Users simply select the node and desired stance, and the agent executes the stance-based data fact retrieval automatically: First, the query decomposition module breaks down the selected node’s query into multifaceted sub-queries. Then, the data search module performs text-to-SQL generation and filters sub-tables related to sub-queries. Finally, the fact extraction module uses Chain-of-Thought (CoT) reasoning to extract facts from sub-tables, and further evaluates the relevance and predicted stance of them to assist users in assessing the facts. Additionally, the planning module of the agent will recommend a node worth further exploration based on the retrieval results, guiding users in choosing the next argumentative direction. All the modules are instructed to consider the expected stance through carefully crafted prompts to ensure that the retrieved facts align with the user’s argumentative needs. The system also features an iterative interface with a mind map layout retrieval space, which allows users to clearly view the retrieval results and efficiently manage the tree expansion. In summary, we make the following contributions: • We present DataScout, a system that enables stance-based data facts retrieval for augmenting the user’s statement with an LLM-based agent. The system allows users to write a statement and retrieve supporting or opposing facts within a mind map layout space. • We conduct a formative study with four data storytelling experts that identifies the workflow and challenges of retrieving data facts. • We demonstrate the utility of the proposed system via interviews and case studies with three expert users. 2. Related Work In this section, we discuss prior studies that are closely related to our work, namely, data-driven storytelling, information retrieval system, and natural language interfaces for visualization. 2.1. Data-driven Storytelling Data-driven storytelling is a technique that constructs narratives supported or enhanced by data, often utilizing visualizations to vividly integrate data into the story’s presentation ( Riche et al., 2018b ) . This method has gained prominence in visualization, driven by the need to effectively communicate complex data and leading to the development of advanced techniques ( Tong et al., 2018 ) . These techniques aim to create structured visual narratives that facilitate data comprehension and improve memory retention ( RECALL, 2016 ; Hullman et al., 2013 ; Dove and Jones, 2012 ; Segel and Heer, 2010 ) . Theoretical design spaces of data-driven storytelling have been explored in previous studies ( Segel and

Read the complete text