A comprehensive taxonomy of hallucinations in Large Language Models
2025
Read A comprehensive taxonomy of hallucinations in Large Language Models (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2508-01781.txt.
Introduction
Manuel Cossio compiled in 2025 a full taxonomy of hallucinations in large language models. Hallucination, where a model states plausible falsehoods as fact, is a central risk of the technology. The report starts with a formal definition and a framework arguing hallucination is unavoidable in any computable model of this kind. It then sorts the phenomenon along several axes.
One split separates statements that clash with the given input from those that clash with the world. Another separates bare correctness from faithfulness to the prompt. The catalog runs through factual errors, logic slips, time confusion, ethical breaches, and domain-specific failures in code and multimodal work. Causes are grouped into data, model, and prompt factors. The report closes with detection benchmarks and mitigation strategies. Its core message: plan for oversight, not elimination.
Catalog record
| YEAR | 2025 |
|---|---|
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 104 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2508-01781
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
A comprehensive taxonomy of hallucinations in Large Language Models Abstract Large language models (LLMs) have revolutionized natural language processing, yet their propensity for ”hallucination”—generating plausible but factually incorrect or fabricated content—remains a critical challenge. This report provides a comprehensive taxonomy of LLM hallucinations, beginning with a formal definition and a theoretical framework that posits its inherent inevitability in computable LLMs, irrespective of architecture or training. It explores core distinctions, differentiating between intrinsic (contradicting input context) and extrinsic (inconsistent with training data or reality), as well as factuality (absolute correctness) and faithfulness (adherence to input). The report then details specific manifestations, including factual errors, contextual and logical inconsistencies, temporal disorientation, ethical violations, and task-specific hallucinations across domains like code generation and multimodal applications. It analyzes the underlying causes, categorizing them into data-related issues, model-related factors, and prompt-related influences. Furthermore, the report examines cognitive and human factors influencing hallucination perception, surveys evaluation benchmarks and metrics for detection, and outlines architectural and systemic mitigation strategies. Finally, it introduces web-based resources for monitoring LLM releases and performance. This report underscores the complex, multifaceted nature of LLM hallucinations and emphasizes that, given their theoretical inevitability, future efforts must focus on robust detection, mitigation, and continuous human oversight for responsible and reliable deployment in critical applications. Manuel Cossio MMed, MEng Universitat de Barcelona [email protected] 1 Introduction Large language models (LLMs) represent a significant advancement in natural language processing (NLP), fundamentally altering how information is acquired and processed 38 ; 27 . These models have enabled a paradigm shift, facilitating diverse applications ranging from sophisticated content creation to advanced decision support systems 38 ; 27 . Their capacity to generate human-like text has led to remarkable progress in various tasks, including complex question-answering systems, abstractive summarization, and interactive conversational agents 82 . The widespread adoption of LLMs underscores their transformative potential across numerous industries and research domains. Despite their impressive capabilities, a critical and widely acknowledged limitation of LLMs is their propensity for ”hallucination” 38 ; 27 ; 42 ; 47 . This phenomenon describes the generation of content that, while often plausible and coherent, is factually incorrect, inconsistent, or entirely fabricated 38 ; 27 . Unlike the medical definition of hallucination, which refers to sensory experiences in the absence of external stimuli, in the context of LLMs, it signifies the creation of nonfactual information to respond to a user’s query, frequently without any explicit indication of its fabricated nature 68 . Such generated content is characterized as incorrect, nonsensical, and lacking justifiable basis, making its detection challenging for users. The prevalence of hallucinations raises significant concerns regarding the reliability and trustworthiness of LLMs, particularly as their integration into real-world information retrieval (IR) systems and critical decision-making processes continues to expand 38 . This report provides a comprehensive taxonomy of hallucinations in Large Language Models (LLMs), delving into the critical challenge of their propensity for generating plausible but factually incorrect or fabricated content. It begins by formally defining hallucination, including a framework that posits its inherent inevitability in computable LLMs, irrespective of their architecture or training. The core distinctions of hallucination are explored, differentiating between intrinsic (contradicting input context) and extrinsic (inconsistent with training data or reality), as well as factuality (absolute correctness) and faithfulness (adherence to input) 38 . The report then details specific manifestations of hallucinations, such as factual errors, contextual and logical inconsistencies, temporal disorientation, ethical violations, and task-specific hallucinations in domains like code generation and multimodal applications 94 . A thorough analysis of the underlying causes is presented, categorizing them into data-related issues (e.g., quality, biases), model-related factors (e.g., auto-regressive nature, decoding strategies, lack of reasoning), and prompt-related influences (e.g., adversarial attacks) 38 ; 42 . The report further examines the cognitive and human factors influencing hallucination perception, including user trust, interpretability, and various cognitive biases, alongside their implications for design and mitigation strategies 102 . It provides a comprehensive overview of evaluation benchmarks and metrics for hallucination detection, surveying principal datasets and quantitative metrics, as well as their current limitations. Additionally, a detailed exploration of hallucination mitigation strategies is included, covering both architectural approaches (e.g., Toolformer-style augmentation, factual grounding through retrieval mechanisms) and systemic approaches (e.g., guardrails, symbolic integration) 86 ; 42 . Finally, the report introduces crucial web-based resources for monitoring LLM releases and performance, offering insights into tools and leaderboards that track hallucination rates and model reliability in real-world scenarios. This report underscores the complex, multifaceted nature of LLM hallucinations and emphasizes that, given their theoretical inevitability, future efforts must focus on robust detection, mitigation, and continuous human oversight for responsible and reliable deployment in critical applications. 2 Defining hallucination in LLMs This section formally defines LLM hallucination and presents a theoretical framework arguing for its inherent inevitability. 2.1 General conceptual definition In the domain of LLMs, hallucination is broadly understood as the generation of ”plausible yet nonfactual content” 38 . This implies that an LLM produces ”false or fabricated information” or outputs that are ”inaccurate, irrelevant, or simply does not make factual sense” 42 ; 47 . A key distinction from the medical definition of hallucination (sensory experiences without corresponding external stimuli) is that in LLMs, it refers to the creation of nonfactual content in response to a user’s question, often without the model clarifying the fabricated nature of its answer 38 . This characteristic underscores the challenge of relying on LLM outputs without external verification. 2.2 Formal definition and inevitability The paper ”Hallucination is Inevitable: An Innate Limitation of Large Language Models” offers a formal framework for understanding hallucination, defining it within a ”formal world” of computable functions to rigorously analyze its inherent inevitability in LLMs 100 . 2.2.1 Formal definition Hallucination is formally defined as an inconsistency between a computable LLM, denoted as h , and a computable ground truth function, f . • Formal world of f (ground truth function): this is conceptualized as a set G_{f}=\{(s,f(s))|s\in S\} , where f(s) represents the sole correct output for any given input string s from the set of all finite-length strings S 100 . • Training samples T : these are defined as a collection of input-output pairs \{(s_{0},y_{0}),(s_{1},y_{1}),...|y_{i}=f(s_{i})\} derived from the formal world of f . This set T serves as a generalized corpus representing the expected outputs of f for corresponding inputs 100 . • Hallucination condition: an LLM h is considered to be ”hallucinating” with respect to a ground truth function f if, across all training stages i (meaning, after being trained on any finite number of samples), there exists at least one input string s for which the LLM’s output h[i](s) does not match the correct output f(s) 100 . This condition is formally expressed as \forall i\in\mathbb{N},\exists s\in S\text{ such that }h[i](s)\neq f(s) . 2.2.2 Implications for inevitability The paper posits that hallucination is an inevitable characteristic of LLMs, irrespective of their architectural design, learning algorithms, prompting techniques, or the specific training data employed, provided they are considered ”computable LLMs” operating within the defined formal world 100 . The central argument supporting this claim is rooted in diagonalization, a proof technique used in computability theory to demonstrate that certain infinite sets are inherently larger than others, implying limitations on what can be computed.