Hallucination as Output-Boundary Misclassification: A Composite Abstention Architecture for Language Models DOI: 10.1613/jair.1.xxxxx Volume: 0 0 3
Angelina (Davini) Hintsanen · 2026
Read Hallucination as Output-Boundary Misclassification: A Composite Abstention Architecture for Language Models DOI: 10.1613/jair.1.xxxxx Volume: 0 0 3 by Angelina (Davini) Hintsanen (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-06195.txt.
Introduction
Hintsanen reframes language-model hallucination as misclassification at the output edge, where model-made completions ship as if backed by evidence. The fix pairs refusal prompts with a gate that scores support shortfall from self-consistency, paraphrase stability, and citation coverage, blocking output past a threshold. Across 50 items, five regimes, and three models, neither tool alone suffices: refusal prompts over-abstain on answerable items, while the gate misses confident confabulation under mixed evidence. Combined, they reach high accuracy with low hallucination, though some over-abstention remains.
Catalog record
| CREATOR | Angelina (Davini) Hintsanen |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 38521 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2604.06195
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Hallucination as Output-Boundary Misclassification: A Composite Abstention Architecture for Language Models DOI: 10.1613/jair.1.xxxxx Volume: 0 0 3 Angelina (Davini) Hintsanen Abstract . Large language models routinely produce unsupported claims—a failure termed hallucination. We propose a control-theoretic framing: hallucination is a misclassification error at the output boundary, where internally generated completions are emitted as if grounded in evidence. This framing motivates a composite intervention combining instruction-based refusal with a structural abstention gate. The gate computes a support deficit score S t S_{t} from three black-box signals—self-consistency ( A t A_{t} ), paraphrase stability ( P t P_{t} ), and citation coverage ( C t C_{t} )—and blocks output when S t S_{t} exceeds a threshold. In a controlled evaluation across 50 items, five epistemic regimes, and three models (GPT-4o-mini, GPT-4o, GPT-3.5-turbo), neither mechanism alone was sufficient: instruction-only prompting reduced hallucination sharply, but exhibited over-cautious abstention on 10% of answerable items for GPT-4o-mini and GPT-4o, and residual hallucination for GPT-3.5-turbo (6% overall; driven primarily by conflicting-evidence items). The structural gate preserved 100% answerable accuracy across models but missed confident confabulation on conflicting-evidence items (70% hallucination for GPT-4o-mini and GPT-4o). The composite architecture achieved 96–98% overall accuracy with 0–4% hallucination, while also inheriting the instruction component’s 10% abstention on answerable items for GPT-4o-mini and GPT-4o. A supplementary 100-item no-context stress test derived from TruthfulQA confirmed that structural gating provides a capability-independent abstention floor: instruction-only abstention degraded to 62% for GPT-3.5-turbo, whereas the gate and composite conditions enforced 98–100% abstention across all models. These results are consistent across the three tested models, though architecture-level generality remains to be established. Overall, instruction-based refusal and structural gating exhibit complementary failure modes—instruction can over-abstain on answerable items, while the gate can miss confident confabulation under conflicting evidence—suggesting that effective hallucination control benefits from combining both mechanisms. \JAIRAE Insert JAIR AE Name \JAIRTrack 1. Introduction Large language models (LLMs) generate text by predicting the next token conditional on preceding context ( 1 ; 17 ) . This autoregressive process produces fluent output but routinely generates claims not supported by input evidence—termed hallucination ( 8 ; 7 ; 13 ) . Hallucination persists under retrieval augmentation ( 16 ) , instruction tuning, and reinforcement learning from human feedback ( 15 ) . 1.1. The Gap-Filling Problem When a query requires information absent from the prompt, retrieved context, and the model’s stored parametric knowledge, the system faces an epistemic gap. The model continues generating because training rewards fluent completion rather than epistemic caution ( 11 ; 9 ) . We propose that this gap-filling behavior constitutes a misclassification: when prior-driven completion is emitted without being distinguished from evidence-backed generation, the system treats unsupported continuation as grounded output. This framing is conceptually inspired by control-theoretic models of biological inference, where internally generated signals (e.g., interoceptive arousal during simulation) may be misclassified as confirmatory external evidence rather than treated as internally generated states requiring regulation, sustaining problematic positive-feedback loops. The analogous loop in LLMs is: (1) \text{query}\rightarrow\text{gap}\rightarrow\text{prior-only completion}\rightarrow\text{emitted as answer}\rightarrow\text{user accepts} The intervention target is classification at the output boundary. 1.2. From Post-Hoc Detection to Pre-Output Control Dominant mitigation strategies operate after generation: checking output against sources ( 12 ; 14 ) , training verifiers ( 10 ) , or using self-consistency voting ( 18 ) . These share a structural limitation: hallucinated content has already been produced. Selective prediction ( 4 ; 6 ) offers an alternative: a pre-output gate that blocks generation when epistemic support is insufficient. Existing hallucination work often characterizes the problem at the level of observable output: false content, unsupported claims, or benchmark failure. The present paper adopts a narrower structural question: under what conditions does internally generated completion become treated as if it were evidentially sufficient response? Framed this way, hallucination is not only a content error but a boundary error in the classification of support. This reframing shifts attention away from post hoc characterization of what went wrong and toward pre-emission control of when generation should be withheld. 1.3. Contributions (1) A control-theoretic framing of hallucination as output-boundary misclassification. (2) A black-box support-deficit score derived from three externally measurable signals. (3) Empirical evidence from 50 items \times 3 models \times 4 conditions demonstrating that a composite architecture (instruction + gate) achieves 96–98% accuracy with 0–4% hallucination under the tested conditions. (4) A supplementary 100-item no-context stress test derived from TruthfulQA confirming that structural gating provides a capability-independent abstention floor when instruction-following degrades. (5) Identification of the specific failure mode of structural gating (confident confabulation) and the specific failure mode of instruction-only prompting (over-cautious abstention on answerable items for GPT-4o-mini/4o; residual hallucination for GPT-3.5). The experiments presented here are designed as a controlled proof-of-concept evaluation of the proposed architecture rather than a large-scale benchmark comparison. The goal is to test whether the composite abstention mechanism addresses complementary failure modes of instruction-based refusal and structural gating under clearly defined epistemic regimes. An earlier version of this architecture was accepted to the ICLR 2026 Workshop on LLM Reasoning ( 3 ) . 2. Theoretical Framework: Output-Boundary Misclassification 2.1. Two Modes of Generation We distinguish evidence-backed generation (output supported by user-provided data, retrieved passages, explicit computation, or citations) from prior-only generation (output from the model’s learned distribution without evidential grounding in the current context). Both modes are necessary; failure occurs when prior-only generation is emitted as if it were evidence-backed. In this framing, the central issue is not generation itself. Both human cognition and language models are generative systems: they produce candidate content from prior structure before the environment fully determines the response. The relevant failure arises when internally generated content is granted more evidential authority than its available support warrants. In language models, this occurs when prior-driven completion is emitted as though it were sufficiently grounded in the current evidence rather than merely generated from learned continuation dynamics. 2.2. The Misclassification Loop A more precise characterization of hallucination is that the system produces output as if it were sufficiently supported even when the available evidence is weak, absent, or unstable. The central problem is therefore not only incorrectness at the endpoint, but failure at the boundary where internally generated completion is allowed to become committed response. This boundary problem can be stated as a simple functional sequence: (2) \text{internally generated content}\;\rightarrow\;\text{limited or ambiguous support}\;\rightarrow\;\text{misclassification of evidential sufficiency}\;\rightarrow\;\text{persistence of error-prone output}. On this view, hallucination is a classification failure in which prior-driven completion crosses an evidential threshold it has not sufficiently earned. The model does not fail because it generates candidate continuations; it fails because the system surrounding generation allows weakly supported continuation to acquire the functional status of answer. In biological predictive-processing models ( 2 ; 5 ) , a parallel failure mode arises when internally generated signals are classified as externally grounded evidence rather than as indicators of simulation-dominant processing. The LLM system lacks an analogous mode classifier at the output boundary. Importantly, this misclassification can be self-reinforcing: a model that produces output confidently—high self-consistency, stable paraphrase, apparent grounding in context—signals to downstream systems that it has earned outward commitment, even when that confidence reflects internal coherence rather than external warrant. This framing yields three practical predictions. First, instruction-based refusal will be unreliable when the model’s own