How do Humans Process AI-generated Hallucination Contents: a Neuroimaging Study

Shuqi Zhu, Yi Zhong, Ziyi Ye, Bangde Du, Yujia Zhou, Qingyao Ai, Yiqun Liu · 2026

Read How do Humans Process AI-generated Hallucination Contents: a Neuroimaging Study by Shuqi Zhu, Yi Zhong, Ziyi Ye, Bangde Du, Yujia Zhou, Qingyao Ai, Yiqun Liu (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-16953.txt.

Introduction

Zhu's team records brain signals from 27 people judging whether image descriptions from a multimodal language model are correct. Mean event-related potentials show distinct patterns for hallucinated versus accurate content across semantic integration, inference, memory retrieval, and cognitive load. Notably, neural responses differ between hallucinations people got wrong and those they got right. The authors conclude wrong items failed to trigger the standard neurocognitive fact-checking pathway.

Catalog record

CREATORShuqi Zhu, Yi Zhong, Ziyi Ye, Bangde Du, Yujia Zhou, Qingyao Ai, Yiqun Liu
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE51712
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2605.16953

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

How do Humans Process AI-generated Hallucination Contents: a Neuroimaging Study Shuqi Zhu, Yi Zhong, Ziyi Ye, Bangde Du, Yujia Zhou, Qingyao Ai, Yiqun Liu Abstract While AI-generated hallucinations pose considerable risks, the underlying cognitive mechanisms by which humans can successfully recognize or be misled by these hallucinations remain unclear. To address this problem, this paper explores humans’ neural dynamics to characterize how the brain processes hallucinated content. We record EEG signals from 27 participants while they are performing a verification task to judge the correctness of image descriptions generated by a multi-modal large language model (MLLM). Based on an averaged event-related potential (ERP) study, we reveal that multiple cognitive processes, e.g., semantic integration, inferential processing, memory retrieval, and cognitive load, exhibit distinct patterns when humans process hallucinated versus non-hallucinated content. Notably, neural responses to hallucinations that were misjudged versus correctly judged by human participants showed significant differences. This indicates that misjudged AI-generated hallucinations failed to trigger the standard neurocognitive fact verification pathway. The detailed code can be accessed openly through the url https://github.com/Promise-Z5Q2SQ/EEG-Hallucination . 1 Introduction Over the past few years, AI models have made impressive progress, scaling in size, architecture sophistication, and capability ( 30 ; 54 ; 45 ) . These advances have enabled them to perform a wide range of tasks, from image captioning and generation ( 4 ) to open-ended conversation ( 42 ; 46 ) and multi-modal understanding ( 40 ; 48 ; 14 ) . However, one of their key drawbacks, hallucinations, i.e., the tendency to generate plausible yet factually incorrect content, has become a growing concern. A series of studies has shown that such hallucinations can easily mislead humans to make erroneous decisions ( 39 ) in critical domains such as healthcare, law, and finance. To address hallucinations in AI models, researchers have attempted to understand the origins of AI hallucinations, especially in multi-modal large language models (MLLMs) and large language models LLMs ( 16 ; 15 ) . Much of existing research has investigated hallucinations from the perspective of the model, i.e., exploring how aspects such as training data, prompt design, decoding or sampling strategies, and internal uncertainty or confidence measures contribute to the occurrence of hallucinations ( 28 ) . Based on the investigations, researchers further work on detecting hallucinated content automatically and further deriving mechanisms to generate factually consistent content. For example, ( 22 ) introduced retrieval-augmented generation to augment the LLMs with factual knowledge. 11 proposes using several verification steps during generation to check the consistency of the generated content. On the other hand, the effects of AI hallucinations on humans have been extensively studied ( 53 ; 18 ) . Most of these studies are based on users’ explicit, post-hoc judgments and behaviors during their interactions with AI hallucinations ( 2 ) . For example, 19 conducted a user study examining AI hallucinations with varying levels of fluency and presentation tone. It reveals that humans are prone to being misled by content characterized by high fluency and professionalism. This indicates that AI-generated hallucinations vary significantly in their deceptiveness, resulting in different levels of risk to human cognition and decision-making. However, few studies have examined, from a neuroscience perspective, how human brain activity patterns differ when viewing hallucinated versus non-hallucinated content generated by AI models. Existing theory has segmented human perception of information content into several stages based on humans’ EEG signals, progressing from early sensory encoding and attentional allocation to higher-order semantic integration and memory retrieval ( 26 ) . Building on this theoretical framework, a critical question arises: at which processing stage does the detection of AI hallucinations succeed or fail? Investigating these temporal dynamics is essential to understanding why humans are susceptible to “plausible but incorrect” AI hallucinations. To fill this gap, we investigate the neurological mechanisms by which humans recognize hallucinations and gain insight into the development of MLLMs. Specifically, we have the following research questions. • RQ1. Do neural signals exhibit significant differences across distinct temporal stages when participants view hallucinated versus non-hallucinated contents? • RQ2. If yes, is this difference modulated by whether participants correctly recognize the hallucination content? • RQ3. Can we predict whether AI-generated content contains hallucinations based on human neural signals? To address these research questions, we collected EEG data from 27 participants. Each participant viewed textual stimuli generated by an MLLM that included both hallucinated and non-hallucinated content. Participants were asked to judge whether the textual stimuli matched the image content (i.e., whether they recognized any hallucinations). On the basis of this paradigm, we conducted averaged event-related potential (ERP) analyses (detailed in Section 4.3 ). Based on the EEG/ERP methods, we obtain a series of findings about the underlying mechanisms when humans are perceiving AI-generated hallucinations. The ERP analysis reveals a significant difference in brain signals when participants are processing hallucination words and non-hallucination words. And it suggests that multiple cognitive processes, such as semantic-thematic integration, inferential processing, memory retrieval, and cognitive loading, are engaged in hallucination recognition. However, we also noticed a significant difference between the brain signals when the hallucination words are misjudged and correctly judged by participants. In-depth analysis across different temporal stages suggests that misjudged AI hallucinations exhibit different neurocognitive patterns, specifically affecting humans’ allocation of attention and inferential reasoning. Inspired by those analyses, we further conduct a prediction experiment and show that EEG signals can be used to predict, at both the word-level and sentence-level, whether content contains hallucinations. However, this prediction is not as effective for instances where human subjects fail to correctly identify the hallucinations. This indicates that deceptive AI hallucinations may deceive humans at both neural and behavioral levels. 2 Related Work 2.1 Hallucination in LLMs Hallucination in LLMs denotes fluent but factually incorrect outputs ( 16 ; 31 ) . Prior work separates intrinsic drivers from extrinsic causes and advances two main strands: detection and mitigation. For detection, post-hoc verification with retrieval/KBs checks factuality in knowledge-intensive tasks ( 22 ) , while black-box consistency methods flag unstable generations without instrumenting the model ( 27 ) . AMBER offers an LLM-free, type-controlled benchmark, and object-level studies document captioning-specific hallucinations ( 43 ; 34 ) . Complementary strategies include self-critique and verifier pipelines to reject dubious claims and improved cross-modal alignment in MLLMs to curb object and attribute hallucinations ( 27 ; 34 ) . Despite progress, most evaluations remain outcome-based, leaving open when and how humans neurally register hallucinations. 2.2 Neuroscience & AI Event-related potentials (ERPs) provide time-resolved markers of cognitive processing ( 26 ) . N100 and P200 index perceptual and attentional allocation; P300 relates to task-relevant salience; N400 tracks semantic integration and expectancy violations; and P600 reflects late reanalysis and monitoring, including “semantic P600” effects ( 5 ) . Computational–neuroscience links show partial convergence between language-model representations and brain activity, and surprisal robustly correlates with N400 amplitude in sentence comprehension ( 36 ; 12 ; 50 ) . Beyond language, images are widely regarded as strong cognitive stimuli, and previous EEG studies have demonstrated promising performance in image-related tasks such as visual stimulus classification and image reconstruction from neural signals ( 56 ; 57 ) . Furthermore, EEG studies of short-video polarization show that cognitive impact may remain invisible

Read the complete text