GraphCheck: Multipath Fact-Checking with Entity-Relationship Graphs

Hyewon Jeon, Jay-Yoon Lee · 2025

Read GraphCheck: Multipath Fact-Checking with Entity-Relationship Graphs by Hyewon Jeon, Jay-Yoon Lee (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2502-20785.txt.

Introduction

Hyewon Jeon and Jay-Yoon Lee present a graph-based fact checker in this 2025 study. Checking a claim against evidence is easy for simple claims, but tangled claims need several hops of reasoning, where errors creep in. Their system, GraphCheck, rewrites a claim as a graph of entities and their links, including hidden entities the text implies, then explores many reasoning paths across that graph.

For simple claims the full machinery is overkill, so a second version adds a light selector that picks direct answering or the graph route case by case. On two public data sets built for multi-hop claims, the approach beat prior methods on accuracy while staying efficient. The selector also lifted other checking pipelines it was added to, which suggests broad use.

Catalog record

CREATORHyewon Jeon, Jay-Yoon Lee
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE63 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2502-20785

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

GraphCheck: Multipath Fact-Checking with Entity-Relationship Graphs Thanks: Code available at: https://github.com/windowh1/graphcheck Hyewon Jeon, Jay-Yoon Lee Abstract Automated fact-checking aims to assess the truthfulness of textual claims based on relevant evidence. However, verifying complex claims that require multi-hop reasoning remains a significant challenge. We propose GraphCheck , a novel framework that transforms claims into entity-relationship graphs for structured and systematic fact-checking. By explicitly modeling both explicit and latent entities and exploring multiple reasoning paths, GraphCheck enhances verification robustness. While GraphCheck excels in complex scenarios, it may be unnecessarily elaborate for simpler claims. To address this, we introduce DP-GraphCheck , a variant that employs a lightweight strategy selector to choose between direct prompting and GraphCheck adaptively. This selective mechanism improves both accuracy and efficiency by applying the appropriate level of reasoning to each claim. Experiments on the HOVER and EX-FEVER datasets demonstrate that our approach outperforms existing methods in verification accuracy, while achieving strong computational efficiency despite its multipath exploration. Moreover, the strategy selection mechanism in DP-GraphCheck generalizes well to other fact-checking pipelines, highlighting the broad applicability of our framework. 1 Introduction Automated fact-checking is a task that assesses the truthfulness of claims based on relevant evidence. With a standard pipeline that includes claim detection, evidence retrieval, and veracity assessment, automated systems enhance efficiency and accuracy in fact-checking Guo et al. (2022) . However, verifying complex claims that require multi-hop reasoning remains a significant challenge. Such claims often consist of interwoven subclaims, making them difficult to verify at once. Also, relevant evidence is likely dispersed across multiple documents, complicating the retrieval process ( Jiang et al., 2020 ; Ma et al., 2024 ) . Another key obstacle is the existence of latent entities—references not explicitly stated in the text. For example, in the claim “The musician, who is part of Tall Birds, is a percussionist for a band that formed in Issaquah, Washington” , the phrases “The musician” and “a band” are latent entities. While these phrases correspond to specific entities ( Davey Brozowski and Modest Mouse , respectively), the claim only implies relationships to these entities without explicitly revealing them. Identifying latent entities is crucial, as they can provide pivotal information for evidence retrieval and claim verification. Also, the order of latent entity identification matters, as some entities can be inferred more easily due to stronger contextual clues, which in turn help identify others as well. Conversely, initially misidentifying a challenging entity introduces false information, hindering subsequent identification steps. Thus, latent entity identification plays an important role in fact-checking. Figure 1: Overview of GraphCheck. Compared to prior approaches, GraphCheck offers a comprehensive yet fine-grained claim decomposition. It also systematically explores multiple paths instead of following a fixed path. The overall process consists of three steps: (1) A claim is converted into a structured entity-relationship graph in which both explicit and latent entities are represented. (2) Latent entities are then identified through text infilling. Multiple infilling paths are explored via graph traversal, resulting in multiple infilled graphs. (3) For each infilled graph, every triplet is individually verified. The claim is predicted as Supported if at least one path yields a graph in which all triplets are verified as Supported ; otherwise, the claim is predicted as Not Supported . Recent work has examined the application of large language models (LLMs) for verifying multi-hop claims, relying solely on few-shot prompting without additional task-specific training ( Brown et al., 2020 ; Dmonte et al., 2024 ) . This approach is appealing due to its scalability and generality, yet it still faces notable limitations. Prior methods leverage LLMs to generate verification paths by identifying “check-worthy” components Guo et al. (2022) , such as subclaims to be verified and question-answering steps for latent entity identification ( Pan et al., 2023b ; Pan et al., 2023a ; Wang and Shu, 2023 ) . However, due to the inherent ambiguity of check-worthiness, verification paths often lack granularity or omit key components. Moreover, these methods typically rely on an LLM-generated, fixed verification path that may not be optimal, ultimately limiting verification accuracy. To address these limitations, we propose GraphCheck , in which LLMs transform text-based claims into structured entity-relationship graphs through which diverse verification paths can be generated. These graphs consist of fact triplets, each defining a relationship between entities and serving as an independently verifiable subclaim. Compared to prior approaches that extract check-worthy components without a clear structure, GraphCheck effectively performs fine-grained claim decomposition while preserving key components, enabling more comprehensive verification. Furthermore, by enabling flexible graph traversal, GraphCheck avoids reliance on a single reasoning path and allows multiple orders of latent entity identification. This flexibility increases the likelihood of capturing an optimal reasoning path, improving the robustness of verification. While GraphCheck thoroughly verifies complex claims, it may be unnecessarily elaborate for simpler cases. Some relatively simple claims can be verified more efficiently and effectively through direct prompting ( DP or Direct ), where the LLM directly assesses a claim’s truthfulness based on relevant documents. To leverage the complementary strengths of Direct and GraphCheck, we introduce DP-GraphCheck , which employs a lightweight strategy selector to choose between the two methods adaptively. Notably, this strategy selector is modular and can be easily integrated into diverse fact-checking systems beyond GraphCheck. Experimental results on multi-hop fact-checking datasets ( Jiang et al., 2020 ; Ma et al., 2024 ) demonstrate that both GraphCheck and DP-GraphCheck outperform existing methods on the complex multi-hop fact-checking task, highlighting the effectiveness of structuring claims as entity-relationship graphs. Despite its multipath exploration, GraphCheck achieves superior computational efficiency compared to multipath baselines. Moreover, the strategy selector improves performance not only within GraphCheck but also across other baseline fact-checking systems, underscoring its broad applicability. 2 Related Work Multi-hop Fact-Checking Fact-checking involves assessing the veracity of claims based on supporting evidence. Early research primarily focuses on single-hop fact-checking , where the evidence necessary to validate a claim is contained within a single document or passage ( Vlachos and Riedel, 2014 ; Wang, 2017 ; Thorne et al., 2018 ) . To better reflect real-world situations, where claim verification often depends on dispersed or interconnected information, subsequent work proposes multi-hop fact-checking , which demands reasoning across multiple pieces of evidence ( Jiang et al., 2020 ; Ma et al., 2024 ; Aly et al., 2021 ) . Early approaches to multi-hop fact-checking rely on task-specific supervised training of neural models with annotated datasets ( Jiang et al., 2020 ; Ostrowski et al., 2021 ; Khattab et al., 2022 ) . While these methods demonstrate strong in-domain performance and maintain computational efficiency during inference through lightweight architectures, they are fundamentally limited by the high cost of large-scale annotation and poor cross-domain generalization. The advent of large language models (LLMs) has shifted the field toward more flexible, context-aware reasoning ( Guo et al., 2022 ; Dmonte et al., 2024 ) . LLM-based approaches often combine retrieval-augmented generation (RAG) ( Lewis et al., 2021 ; Gao et al., 2024 ) with in-context learning Brown et al. (2020) to support veracity prediction without additional task-specific training. Recent work has explored various strategies, such as iterative RAG Shao et al. (2023) and claim decomposition ( Chen and Shu, 2023 ; Zhang and Gao, 2023 ; Pan

Read the complete text