HalluHard : A Hard Multi-Turn Hallucination Benchmark

Dongyang Fan, Sebastien Delsad, Nicolas Flammarion, Maksym Andriushchenko · 2026

Read HalluHard : A Hard Multi-Turn Hallucination Benchmark by Dongyang Fan, Sebastien Delsad, Nicolas Flammarion, Maksym Andriushchenko (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2602-01031.txt.

Description

Dongyang Fan and co-authors build HalluHard, a tough test of made-up facts in long chats, drawn from law, research, medicine, and code. A claim counts as grounded only when an in-line cited source backs it, and a judge loop fetches full sources, PDFs included, to check each cite. Even the best model-plus-search setup still made up facts about three times in ten in their runs. How often models stray shifts with model size, chat turn, depth of thought, and the kind of fact asked for.

Catalog record

CREATORDongyang Fan, Sebastien Delsad, Nicolas Flammarion, Maksym Andriushchenko
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE43728
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2602.01031

Browse the full library · About the Tower of Babel