WildGraphBench: Benchmarking GraphRAG with Wild-Source Corpora

Pengyu Wang, Benfeng Xu, Licheng Zhang, Shaohan Wang, Mingxuan Du, Chiwei Zhu, Zhendong Mao, [0.5em] University of Science, Technology of China, Hefei, China · 2026

Read WildGraphBench: Benchmarking GraphRAG with Wild-Source Corpora by Pengyu Wang, Benfeng Xu, Licheng Zhang, Shaohan Wang, Mingxuan Du, Chiwei Zhu, Zhendong Mao, [0.5em] University of Science, Technology of China, Hefei, China (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2602-02053.txt.

Description

Pengyu Wang and colleagues offer WildGraphBench, testing GraphRAG in the wild, where outside knowledge forms a layered graph. Current GraphRAG benchmarks rely on short texts, failing real long-context tests. Using Wikipedia's structure, they sample pieces across topics, using outside sources as corpus, with linked claims as ground truth, yielding 1,100 questions spanning single-fact and multi-fact QA and recaps. Tests reveal GraphRAG helps on multi-fact pooling from a modest number of sources, but stress high-level claims over fine-grained details, hurting recaps.

Catalog record

CREATORPengyu Wang, Benfeng Xu, Licheng Zhang, Shaohan Wang, Mingxuan Du, Chiwei Zhu, Zhendong Mao, [0.5em] University of Science, Technology of China, Hefei, China
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE44195
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2602.02053

Browse the full library · About the Tower of Babel