Probing for Knowledge Attribution in Large Language Models
Ivo Brink, Alexander Boer, Dennis Ulmer · 2026
Read Probing for Knowledge Attribution in Large Language Models by Ivo Brink, Alexander Boer, Dennis Ulmer (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2602-22787.txt.
Description
Ivo Brink and two co-authors trace language-model hallucinations to their source. Fluent but false outputs split into faithfulness failures, where provided context is misused, and factuality failures, where internal knowledge itself errs. Choosing the right fix requires knowing which source dominates each answer.
Their study of contributive attribution shows a simple linear probe on hidden representations can identify the dominant source reliably. AttriWiki, a self-supervised pipeline, generates labelled training data by prompting recall of withheld entities from memory or reading from context, without leaning on knowledge conflicts. Probes hit about ninety-six percent on Llama, Mistral, and Qwen models, transfer strongly to SQuAD and WebQuestions, and beat a prior probe zero-shot on conflicting settings. Attribution mismatches also raise error rates sharply.
Catalog record
| CREATOR | Ivo Brink, Alexander Boer, Dennis Ulmer |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 43 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2602-22787