AURORA: Asymmetry and Update-Induced Rotation for Robust Hallucination Detection in Large Language Models
Zishuai Zhang, Hainan Zhang, Zhiming Zheng · 2026
Read AURORA: Asymmetry and Update-Induced Rotation for Robust Hallucination Detection in Large Language Models by Zishuai Zhang, Hainan Zhang, Zhiming Zheng (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2606-29545.txt.
Description
Zhang, Zhang, and Zheng propose AURORA, a detector for hallucinations in large language models, the confident but false outputs that block use in high-stakes settings. Existing detectors rely on costly consistency checks, or on static probes of hidden states that learn shallow dataset habits.
AURORA instead watches weight-gradient dynamics, how a model's parameters would move during training. Faithful and hallucinated answers, the authors argue, trigger qualitatively different gradient update patterns. Two features capture that split. One measures skewness in the cosine similarity between weight matrices and their gradient directions. The other, a rotation ratio, measures how much an update reorients the singular-vector basis of a weight matrix, found through singular value decomposition. Across four model families and four benchmark datasets, detection stays strong. The method also scales across model sizes and transfers to new domains.
Catalog record
| CREATOR | Zishuai Zhang, Hainan Zhang, Zhiming Zheng |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 39 KB |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2606.29545