Facts&Evidence : An Interactive Tool for Transparent Fine-Grained Factual Verification of Machine-Generated Text
Varich Boonsanong, Vidhisha Balachandran, Xiaochuang Han, Shangbin Feng, Lucy Lu Wang, Yulia Tsvetkov · 2025
Read Facts&Evidence : An Interactive Tool for Transparent Fine-Grained Factual Verification of Machine-Generated Text by Varich Boonsanong, Vidhisha Balachandran, Xiaochuang Han, Shangbin Feng, Lucy Lu Wang, Yulia Tsvetkov (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2503-14797.txt.
Introduction
Varich Boonsanong and five colleagues build an interactive fact-checking workbench that shows its reasoning instead of stamping true or false, in a 2025 paper. Machine-generated text floods every channel, and automated verifiers usually answer with a bare score. The authors argue such verdicts, without visible evidence, cannot earn trust.
Their tool, Facts&Evidence, breaks a document into individual claims. Each claim gets a credibility view, an explanation of the model's decision, and pointers to multiple, diverse evidence sources. Users can drill into any claim and judge for themselves. The design aims to give readers agency: understand, verify, and selectively trust. The paper positions transparency as a feature, not a luxury, in verification tools. Fine-grained, sourced checking, the authors suggest, fits how careful humans actually vet a text.
Catalog record
| CREATOR | Varich Boonsanong, Vidhisha Balachandran, Xiaochuang Han, Shangbin Feng, Lucy Lu Wang, Yulia Tsvetkov |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 27 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2503-14797
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Facts&Evidence : An Interactive Tool for Transparent Fine-Grained Factual Verification of Machine-Generated Text Varich Boonsanong, Vidhisha Balachandran, Xiaochuang Han, Shangbin Feng, Lucy Lu Wang, Yulia Tsvetkov Abstract With the widespread consumption of AI-generated content, there has been an increased focus on developing automated tools to verify the factual accuracy of such content. However, prior research and tools developed for fact verification treat it as a binary classification or a linear regression problem. Although this is a useful mechanism as part of automatic guardrails in systems, we argue that such tools lack transparency in the prediction reasoning and diversity in source evidence to provide a trustworthy user experience. We develop Facts&Evidence —an interactive and transparent tool for user-driven verification of complex text. The tool facilitates the intricate decision-making involved in fact-verification, presenting its users a breakdown of complex input texts to visualize the credibility of individual claims along with an explanation of model decisions and attribution to multiple, diverse evidence sources. Facts&Evidence aims to empower consumers of machine-generated text and give them agency to understand, verify, selectively trust and use such text. Figure 1: The pipeline figure of Facts&Evidence . The user input for verification goes through atomic claim and query generation, evidence retrieval, and factuality judgement processes. The system output is aggregated from the judgements over atomic claims, providing users with sources of evidence and an overall credibility score. 1 Introduction In our time of proliferating use and adoption of AI-generated text and AI-assisted writing, the need for robust and transparent fact verification tools to help users verify the accuracy of machine-generated content has never been more pressing. Errors and hallucinations generated by AI models are already translating into real-world problems through errors in generated code introducing unintended bugs ( Shrestha, 2024 ) , nonexistent books and references propagating misinformation ( Ryan, 2022 ; Dolan, 2024 ; Bohannon, 2023 ) , and incorrect medical advice causing health complications ( Alstin, 2023 ) , which cost stakeholders time, money, and in some cases leading to physical harm ( Metz and Blumenthal, 2019 ; Johnson et al., 2022 ) . Although fact-verification of machine-generated texts has been studied extensively in recent research ( Manakul et al., 2023 ; Gao et al., 2023 ; Huang et al., 2023 ; Li et al., 2024 ) , this work has not resulted in practical tools that are accessible to users, easy to use, and transparent ( Do et al., 2024 ) . As such, developing fact-verification tools aimed at informing users of the veracity of AI-generated content is necessary to enable users to understand, verify, and trust such content. Recent research has developed methods for automatically detecting factual errors and hallucinations through self-checking with Large Language Models (LLMs) ( Manakul et al., 2023 ) , uncertainty calibration ( Farquhar et al., 2024 ; Zhang et al., 2023 ; Feng et al., 2024 ) or fine-tuning specific factuality classifiers ( Mishra et al., 2024 ) , and tools for visualizing such errors for users ( Fatahi Bayat et al., 2023 ; Krishna et al., 2024 ) . The primary intent of this research has been the binary classification (factual vs. non-factual) of complex text to serve as an intrinsic guardrail in AI systems. As a result, their decisions are categorical, often not explainable, and can be noisy ( Mishra et al., 2024 ) . On the other hand, real-world human fact-checking is significantly more complex, involving verification against diverse sources with varying levels of reliability and leanings ( Augenstein et al., 2019 ; Dias and Sippitt, 2020 ; Glockner et al., 2022 ) . Evidence for verifying facts is traced through various sources, and claims are verified against each source. The authenticity and reliability of each source or news outlet is considered when aggregating and deciding the veracity of each claim. Such fine-grained views into each claim per source provide a detailed understanding of the correctness of long, complex texts, allowing consumers of the text to assess which specific claims to trust and use. In this work, we take a step towards addressing this gap. We present Facts&Evidence —a user-driven, transparent and interactive fact-verification tool to empower consumers of AI-generated text to understand the factual accuracy of the text. Facts&Evidence takes any long, complex text from a user as input and presents a breakdown of the text into individual claims. Each claim is searched on the web to identify multiple, diverse evidence items and verify against each of them. Ultimately, decisions from multiple pieces of evidence and claims are aggregated to compute a credibility score for the entire text. In addition to aggregate decisions, Facts&Evidence presents the per-claim, per-evidence decision, along with a model-generated rationale explaining the decision and a source tag indicating the source category of the evidence. Further, Facts&Evidence is interactive, allowing users to include or exclude any source type from the verification process based on personal preferences and specific needs. We evaluate the reliability of decisions produced by Facts&Evidence using the FAVA dataset Mishra et al. (2024) and show that the predicted scores are competitive with strong baselines, outperforming previous systems by \sim 40 F1 points, and establishing a high-quality system in claim verification of open-ended generation tasks. In summary, our contribution is Facts&Evidence ---a high-quality, fine-grained, and interactive tool providing transparency and access to real-time information in the fact-verification process which can inform and empower users, giving them the ability to inspect and validate the veracity of each part of the content they use. 1 1 1 Demo URL: https://factsandevidence.cs.washington.edu/ Video URL: https://www.youtube.com/watch?v=_MaAI2H7c3w 2 Facts&Evidence – User Interface This section presents the user interface of Facts&Evidence when it is used to inspect the veracity of machine-generated texts. 2.1 Landing Page: Upload Panel: The first screen (ref: Figure 2 ) presents a panel for the user to upload the text they want to verify. Additionally, the user can configure different parameters associated with their search: (i) LLM: choice of 2 backend LLMs ( gpt-3.5-turbo-0301 and Llama3-8B ) used for verifying claims; (ii) Retrieval Mode: choice of dense (embedding-based) or sparse (keyword-based) retrieval for extracting relevant evidence from web search text; (iii) Evidence Configuration: choice of top- k web results to parse, top- k relevant passages within each search result, and context size of each passage. For each of these parameters, default values are set based on internal evaluations for best claim verification performance and user experience as outlined in § 4 . Once the text is provided and the user is satisfied with the parameters, they can submit their request to verify the text. Figure 2: Facts&Evidence Upload Panel Readme: The home screen also includes a README that explains the objectives of the tool and a brief explanation of how the system conducts fact verification behind the scenes to provide full transparency to users. It describes how a user can use the tool and what level of interaction they can expect from the tool. In addition, it includes an explanation for each configurable parameter and possible choices available to the user. 2.2 Fact Visualization Page: Once the user submits their text, we run our fact verification engine on our back-end and present a detailed view of the final results to the user. Figure