What Is Seen Cannot Be Unseen: The Disruptive Effect of Knowledge Conflict on Large Language Models
Kaiser Sun, Fan Bai, Mark Dredze, [email protected], [email protected] · 2025
Read What Is Seen Cannot Be Unseen: The Disruptive Effect of Knowledge Conflict on Large Language Models by Kaiser Sun, Fan Bai, Mark Dredze, [email protected], [email protected] (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2506-06485.txt.
Description
Sun, Bai, and Dredze show that clashes between a model's memory and its prompt play out differently by task. Language models blend context with stored knowledge, and the two can conflict. Past work mostly tested question answering, where leaning on context is assumed right.
Their diagnostic frame holds the facts fixed while varying task demands and conflict setup. Across open and closed models, harm grew with task reliance on memory and with conflict plausibility. Tricks like adding rationales boosted context use. That helped context-only tasks but hurt memory-based ones. The same skew distorts model judging, casting doubt on models as neutral graders.
Catalog record
| CREATOR | Kaiser Sun, Fan Bai, Mark Dredze, [email protected], [email protected] |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 64 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2506-06485