HalluHard : A Hard Multi-Turn Hallucination Benchmark
Dongyang Fan, Sebastien Delsad, Nicolas Flammarion, Maksym Andriushchenko · 2026
Read HalluHard : A Hard Multi-Turn Hallucination Benchmark by Dongyang Fan, Sebastien Delsad, Nicolas Flammarion, Maksym Andriushchenko (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2602-01031.txt.
Description
Dongyang Fan and co-authors build HalluHard, a tough test of made-up facts in long chats, drawn from law, research, medicine, and code. A claim counts as grounded only when an in-line cited source backs it, and a judge loop fetches full sources, PDFs included, to check each cite. Even the best model-plus-search setup still made up facts about three times in ten in their runs. How often models stray shifts with model size, chat turn, depth of thought, and the kind of fact asked for.
Catalog record
| CREATOR | Dongyang Fan, Sebastien Delsad, Nicolas Flammarion, Maksym Andriushchenko |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 43728 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2602.01031