PRISM: Probing Reasoning, Instruction, and Source Memory in LLM Hallucinations

Yuhe Wu, Guangyu Wang, Yuran Chen, Jiatong Zhang, Yutong Zhang, Yujie Chen, Jiaming Shang, Guang Zhang, Zhuang Liu Corresponding authors. · 2026

Read PRISM: Probing Reasoning, Instruction, and Source Memory in LLM Hallucinations by Yuhe Wu, Guangyu Wang, Yuran Chen, Jiatong Zhang, Yutong Zhang, Yujie Chen, Jiaming Shang, Guang Zhang, Zhuang Liu Corresponding authors. (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-16909.txt.

Description

Wu and eight colleagues reframe language-model hallucination as a diagnostic puzzle. They separate failures of missing knowledge, wrong knowledge, faulty reasoning, and missed instructions across memory, instruction, and reasoning stages. Their PRISM benchmark spans 9,448 instances over 65 tasks, and tests of 24 models reveal trade-offs: fixes that help one dimension often cost another.

Catalog record

CREATORYuhe Wu, Guangyu Wang, Yuran Chen, Jiatong Zhang, Yutong Zhang, Yujie Chen, Jiaming Shang, Guang Zhang, Zhuang Liu Corresponding authors.
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE104520
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2604.16909

Browse the full library · About the Tower of Babel