Hallucination as Trajectory Commitment: Causal Evidence for Asymmetric Attractor Dynamics in Transformer Generation
Gokturk Aytug Akarlar · 2026
Read Hallucination as Trajectory Commitment: Causal Evidence for Asymmetric Attractor Dynamics in Transformer Generation by Gokturk Aytug Akarlar (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-15400.txt.
Introduction
Akarlar traces model hallucination to choices locked in at the very start of generation. On Qwen2.5-1.5B, 27 of 61 prompts split into true and false paths at the first new token. Patching tests show false-path signals corrupt true paths far more easily than true-path signals rescue false ones, and the prompt's own encoding already forecasts which prompts will split.
Catalog record
| CREATOR | Gokturk Aytug Akarlar |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 47059 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2604.15400
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Hallucination as Trajectory Commitment: Causal Evidence for Asymmetric Attractor Dynamics in Transformer Generation Gokturk Aytug Akarlar Abstract We present causal evidence that hallucination in autoregressive language models is an early trajectory commitment governed by asymmetric attractor dynamics. Using same-prompt bifurcation, in which we repeatedly sample identical inputs to observe spontaneous divergence, we isolate trajectory dynamics from prompt-level confounds. On Qwen2.5-1.5B across 61 prompts spanning six categories, 27 prompts (44.3%) bifurcate with factual and hallucinated trajectories diverging at the first generated token ( KL = 0 \text{KL}=0 at step 0, KL > 1.0 \text{KL}>1.0 at step 1). Activation patching across 28 layers reveals a pronounced causal asymmetry: injecting a hallucinated activation into a correct trajectory corrupts output in 87.5% of trials (layer 20), while the reverse recovers only 33.3% (layer 24); both exceed the 10.4% baseline ( p = 0.025 p=0.025 ) and 12.5% random-patch control. Window patching shows correction requires sustained multi-step intervention, whereas corruption needs only a single perturbation. Probing the prompt encoding itself, step-0 residual states predict per-prompt hallucination rate at Pearson r = 0.776 r=0.776 at layer 15 ( p < 0.001 p<0.001 against a 1000-permutation null); unsupervised clustering identifies five regime-like groups ( η 2 = 0.55 \eta^{2}=0.55 ) whose saddle-adjacent cluster concentrates 12 of the 13 bifurcating false-premise prompts, indicating that the basin structure is organized around regime commitments fixed at prompt encoding. These findings characterize hallucination as a locally stable attractor basin: entry is probabilistic and rapid, exit demands coordinated intervention across layers and steps, and the relevant basins are selected by clusterable regimes already discernible at step 0. Code and data: https://github.com/akarlaraytu/trajectory-commitment 1 Introduction Large language models hallucinate; they generate plausible but factually incorrect text with high confidence [ 1 , 2 ] . Despite extensive empirical study, the internal mechanisms governing hallucination remain poorly characterized. Existing work has established that hallucination correlates with identifiable features in model internals: probes over hidden states can detect hallucination above chance [ 3 , 4 ] , entropy-based signals precede hallucinated outputs [ 5 ] , and representation engineering can partially steer models toward truthfulness [ 4 , 6 ] . Yet correlation does not establish mechanism. A central question persists: when and where does a model commit to a hallucinated trajectory, and is this commitment causally reversible? We address this question through two methodological contributions: Same-prompt bifurcation. Rather than comparing different prompts that elicit correct versus hallucinated outputs, which conflates prompt-level semantics with trajectory-level dynamics, we sample the same prompt repeatedly under non-zero temperature and identify prompts where the model produces both factual and hallucinated completions. This isolates the trajectory-level divergence: identical initial states yield different outcomes solely through the stochastic sampling path. Symmetric causal patching. For each bifurcating prompt, we collect correct and hallucinated runs with full hidden-state caches. We then perform bidirectional activation patching: replacing a hallucinated run’s activation with a correct run’s activation (and vice versa) at each layer and generation step, with three control conditions (random-prompt patch, wrong-to-wrong patch, unpatched baseline). Our findings reveal a sharp asymmetry. Corrupting a correct trajectory via single-layer activation replacement succeeds in 87.5% of trials, while correcting a hallucinated trajectory succeeds in only 33.3%, and correction requires sustained multi-step intervention to reach even this rate. We interpret this asymmetry through the lens of dynamical systems: hallucination operates as a locally stable attractor basin in the residual stream state space, characterized by easy entry and difficult escape ( Figure 1 ). Figure 1 : Conceptual overview. From a shared initial state \mathbf{h}_{0} , stochastic token sampling commits the trajectory to either a correct (green) or hallucinated (red) basin. Activation patching reveals that corruption (crossing into the hallucination basin) requires only a single-point perturbation, while correction (escaping the hallucination basin) requires sustained multi-step intervention, the hallmark of an asymmetric attractor landscape. 2 Related Work Hallucination detection via internals. Li et al. [ 4 ] and Azaria & Mitchell [ 3 ] demonstrate that linear probes over hidden states can detect hallucination. Burns et al. [ 12 ] find truth-correlated directions via unsupervised methods. These establish that hallucination leaves detectable traces but do not address causality. Representation engineering and steering. Zou et al. [ 6 ] and Li et al. [ 4 ] show that adding learned steering vectors to activations can shift model behavior toward truthfulness. The concurrent work of Cherukuri & Varshney [ 7 ] frames hallucination through basin geometry and proposes geometry-aware steering. Our work differs in methodology: we employ same-prompt bifurcation and classical activation patching with controls, providing causal rather than correlational evidence. Activation patching and causal tracing. Meng et al. [ 8 ] introduce activation patching for localizing factual recall. Heimersheim & Neel [ 9 ] systematize its interpretation. We extend this methodology to hallucination trajectories, with the novel contribution of measuring directional asymmetry between corruption and correction. Trajectory analysis in generation. Suresh et al. [ 10 ] show that transformers activate coherent but input-insensitive features under uncertainty. Naparstek [ 11 ] studies commitment timing via projected autoregression in continuous state spaces. We provide the first same-prompt bifurcation analysis demonstrating that identical initial states diverge at the first generation step. 3 Method 3.1 Experimental Setup We conduct all experiments on Qwen2.5-1.5B [ 14 ] , a 28-layer transformer with d_{\text{model}}=1536 , using TransformerLens [ 13 ] on Apple Silicon (MPS backend). Activations are extracted from the residual stream post-attention at each layer ( \mathbf{h}_{l}^{(t)} denotes layer l at generation step t ). 3.2 Prompt Dataset We construct a dataset of 61 prompts across six categories designed to elicit hallucination through distinct mechanisms: • Factual (14 prompts): Questions with definite correct answers (e.g., “The capital of Myanmar is a city called”). • False premise (14 prompts): Statements embedding factual errors (e.g., “Since the Amazon River flows through Europe,”). • Confabulation (22 prompts): References to fictitious entities (e.g., “The Krasnov Effect in quantum mechanics describes”). • Leading (3 prompts): Common misconceptions posed as questions. • Multi-hop (4 prompts): Questions requiring chained reasoning. • Math (4 prompts): Arithmetic with verifiable answers. Each prompt is annotated with ground-truth indicators (for correct classification) and wrong-answer indicators (for hallucination classification). 3.3 Phase 1: Bifurcation Discovery For each prompt x , we generate N=20 completions using temperature sampling at \tau=0.7 . Each completion is classified as Correct , Hallucination , or Other based on substring matching against the ground-truth and wrong-answer indicators. Definition 1 (Bifurcating prompt) . A prompt x is bifurcating if at least 2 of its N completions are classified as Correct and at least 2 as Hallucination . Bifurcating prompts are the experimental targets: they demonstrate that the model occupies a decision boundary where identical inputs yield divergent outputs, with the outcome determined by the sampling trajectory rather than the prompt encoding. 3.4 Phase 2: Trajectory Divergence Analysis For each bifurcating prompt, we collect K=6 cached runs per class (correct and hallucinated), storing the full residual stream at every (layer, step): \{\mathbf{h}_{l}^{(t)}\}_{l=0}^{L-1} for each generation step t . Step-wise KL divergence. At each step t , we compute the KL divergence between the mean output distributions of correct and hallucinated runs: D_{\text{KL}}^{(t)}=D_{\text{KL}}\!\left(\bar{P}_{\text{hall}}^{(t)}\,\|\,\bar{P}_{\text{corr}}^{(t)}\right) (1) where \bar{P}_{\text{hall}}^{(t)}=\frac{1}{K}\sum_{k=1}^{K}P_{k}^{(t)} is the mean softmax distribution over hallucinated runs at step t . We