Detecting Hallucinations in Large Language Models via Internal Attention Divergence Signals

Gijs van Dijk · 2026

Read Detecting Hallucinations in Large Language Models via Internal Attention Divergence Signals by Gijs van Dijk (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-05025.txt.

Description

Gijs van Dijk proposes detecting language model hallucinations from the model's own attention patterns in a single pass. Many uncertainty methods need repeated sampling or extra models, which adds cost. His method measures how far each attention head's distribution sits from a uniform one, using a divergence measure, and feeds those values to a simple logistic probe.

Across datasets, task types, and model families, that signal predicted answer correctness well and rivalled established uncertainty methods. The signal sits in middle layers and on factual tokens such as names and numbers. That pattern makes those dynamics a cheap and readable white-box sign of when a model is unsure.

Catalog record

CREATORGijs van Dijk
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE43 KB
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2605.05025

Browse the full library · About the Tower of Babel