Detecting Hallucinations in Large Language Models via Internal Attention Divergence Signals
Gijs van Dijk · 2026
Read Detecting Hallucinations in Large Language Models via Internal Attention Divergence Signals by Gijs van Dijk (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-05025.txt.
Description
Gijs van Dijk proposes detecting language model hallucinations from the model's own attention patterns in a single pass. Many uncertainty methods need repeated sampling or extra models, which adds cost. His method measures how far each attention head's distribution sits from a uniform one, using a divergence measure, and feeds those values to a simple logistic probe.
Across datasets, task types, and model families, that signal predicted answer correctness well and rivalled established uncertainty methods. The signal sits in middle layers and on factual tokens such as names and numbers. That pattern makes those dynamics a cheap and readable white-box sign of when a model is unsure.
Catalog record
| CREATOR | Gijs van Dijk |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 43 KB |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2605.05025