GraphOmni : A Comprehensive and Extensible Benchmark Framework for Large Language Models on Graph-theoretic Tasks
2025
Read GraphOmni : A Comprehensive and Extensible Benchmark Framework for Large Language Models on Graph-theoretic Tasks (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2504-12764.txt.
Introduction
Hao Xu and co-authors introduce GraphOmni in 2025, a test suite that grades large language models on graph problems stated in plain words. Graphs model networks of points and links, and many real tasks take that form. Earlier test sets were narrow, so scores were hard to compare across studies.
GraphOmni varies the graph types, the text formats used to write graphs down, and the ways questions are asked. Those choices interact, and each one can swing a model's score a lot. Top models scored best in the tests, yet even they left wide room to improve. The suite gives model builders a shared, broad yardstick and shows which test choices change results most.
Catalog record
| YEAR | 2025 |
|---|---|
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 268 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2504-12764