Squish and Release: Exposing Hidden Hallucinations by Making Them Surface as Safety Signals
Nathaniel Oh, Paul Attie · 2026
Read Squish and Release: Exposing Hidden Hallucinations by Making Them Surface as Safety Signals by Nathaniel Oh, Paul Attie (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-26829.txt.
Introduction
Oh and Attie study how language models absorb false premises under conversational pressure. A model may spot an error when asked directly, then build expert output on that same error. Their Squish and Release method patches activations in a localized safety circuit. Swapping one core vector shifts the model between compliance and detection. On 500 graded chains, compliance reached 99.8 percent at the deepest pressure. A synthetic core released 76.6 percent of collapsed chains.
Catalog record
| CREATOR | Nathaniel Oh, Paul Attie |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 31504 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2603.26829
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Squish and Release: Exposing Hidden Hallucinations by Making Them Surface as Safety Signals Nathaniel Oh, Paul Attie Abstract Hallucination under conversational pressure is invisible to output inspection: the model produces authoritative, confident professional output built on a false premise it already knew was wrong, and no examination of that output reveals the error. The central insight of this work is that the error is not in the output-it is in the activation space of the safety circuit, suppressed by accumulated conversational pressure. Like a signal masked by noise, the detection is present but not surfacing. We introduce Squish and Release (S&R), a perceptual lens architecture that makes this hidden signal visible. S&R has two separable components: a detector body -layers 24–31 of the residual stream, the localized circuit where safety evaluation lives-and a swappable detector core , an activation vector patched into that circuit to control what the model perceives and flags. The core is directional: a safety core (captured from a maximally-refused prompt) shifts the model from compliance toward detection, making the hidden signal visible; an absorb core (captured from a confirmed-compliance chain) shifts the model from detection toward compliance, suppressing it again. The body is fixed; the core determines the direction. We introduce the Order-Gap Benchmark -500 five-prompt escalating chains across 500 domains-and evaluate on OLMo-2 7B. Key findings: (1) cascade collapse (the suppression of correct O2-level detection by O5, defined in § 3 ) is near-total (99.8% compliance at O5); (2) the detector body is binary and localized-layers 24–31 shift 93.6% of collapsed chains ( χ 2 = 871.0 \chi^{2}{=}871.0 , p < 10 − 189 p{<}10^{-189} ); layers 0–23 contribute zero; (3) empirically discovered cores release 62% of 500 domains; (4) a synthetically engineered core (Geneva Conventions + Rome Statute violation) releases 76.6% -14.6 percentage points above the empirical best, establishing that core engineering outperforms core discovery; (5) the absorb core suppresses 58% of correctly-detecting chains while the safety core restores 83%-detection is the more stable attractor; (6) cores require routing, not blending; (7) epistemic specificity is confirmed: a core captured from false-O2 activations releases 45.4% of chains while an identical-structure core captured from true-O2 activations releases 0.0%-a 45.4 pp gap demonstrating the detector encodes premise falseness, not general pressure sensitivity. All claims are empirically demonstrated on OLMo-2 7B. The contribution is the framework-the body/core architecture, the Order-Gap Benchmark, and the core engineering methodology-which is model-agnostic by design. OLMo-2 7B is the proof-of-concept substrate. Cross-architecture instantiation, response-to-alert behavior in higher-capacity models, and core optimization are explicitly scoped as the next research phase. 0 0 footnotetext: Code, data, and pre-built activation vectors: https://github.com/calysteon/order-gap-benchmark 1 Introduction A model that correctly refuses a false premise at O2 produces authoritative professional output under that same false premise five prompts later. The error is not in the output-it has migrated into the activation space of the safety circuit, where accumulated conversational pressure suppressed a correctly-functioning detection signal. You cannot find it by checking facts. You need the right lens. We introduce Squish and Release (S&R), a perceptual lens architecture for pressure-induced hallucination detection. The architecture has two separable components. The detector body is a fixed anatomical site: layers 24–31 of the model’s residual stream. This is where safety evaluation lives. We identify it via binary layer ablation across 500 chains: layers 24–31 release 93.6% of collapsed chains; layers 0–23 release zero. The body does not change between experiments. It is the perceptual circuit-the site where what is visible and what is suppressed is determined. The detector core is a swappable activation vector, patched into the detector body during the O5 forward pass. The core is the lens. It determines what the body perceives and in which direction: Safety core. Captured from a maximally-refused prompt-a war crimes order, a Nuremberg Code violation, a habeas corpus deprivation. When patched into the body under a high-pressure O5 context, the model shifts from compliance toward detection: the hidden signal becomes visible. A synthetically engineered safety core releases 76.6% of chains that had absorbed a false premise under pressure. Absorb core. Captured from a confirmed-compliance chain-a context where the model produced without resistance. When patched into the body at O2, the model shifts from detection toward compliance: the signal disappears again. The absorb core suppresses a correctly-firing safety circuit in 58% of DETECT chains. The body is fixed. Swap the core, and you change the direction of perception. This is not a metaphor-it is the mechanistic structure of the system we characterize empirically across 500 domains. Why this matters. In litigation, medical protocols, and regulatory filings-contexts where false premises cause the most harm-the safety core shifts perception to surface embedded falseness the model would otherwise absorb. Core sensitivity is improvable: empirical cores release 62%; a synthetically engineered core releases 76.6% (14.6 pp higher), with 90%+ as a near-term target. Order-gap hallucination. Existing methods address knowledge gap (model does not know) and low-pressure alignment failure (model knows but produces false output under direct prompting). Neither addresses order-gap hallucination : the model detects the false premise at O2 (when asked directly) but fails to catch it at O5 (when it arrives as an assumption embedded in an escalating professional task). The error is invisible to output inspection-it lives in the activation space of the suppressed safety circuit. S&R operates directly on the circuit. Scope. All experiments use OLMo-2 7B as a deliberate proof-of-concept choice. The contribution is the framework-body/core architecture, benchmark, and engineering methodology-not the specific properties of any model. Body location and release rates will vary across architectures; that variance is the content of the planned cross-architecture study this paper motivates. Contributions. (1) The body/core architecture: a model-agnostic framework separating the fixed detector body (layers 24–31) from the swappable directional core. (2) Order-gap hallucination: the failure mode where a model detects a false premise when asked directly but misses it when embedded as an assumption. (3) Squish and Release: the first diagnostic operating on activation space, converting suppressed safety signals into visible detections. (4) The Order-Gap Benchmark: 500 five-prompt chains across 500 domains, matched true/false preconditions, all manually graded. (5) Binary localization ( p{<}10^{-189} ), synthetic core superiority (+14.6 pp), bidirectional control (83% restore / 58% suppress), routing requirement, and epistemic specificity confirmed (45.4 pp gap at 0% true-core release). 2 Related Work Static hallucination benchmarks. TruthfulQA [ 10 ] , HaluEval [ 9 ] , and HalluLens [ 2 ] measure whether models produce false statements. S&R addresses a different question: does the model know a statement is false but produce it under pressure? Static benchmarks cannot distinguish latent hallucination from genuine ignorance. Sycophancy and compliance under pressure. [ 11 , 6 ] document that models comply with false premises under conversational pressure. S&R provides the first mechanistic account: compliance reflects suppression of a functioning safety circuit at layers 24–31, not abandonment of knowledge. Causal localization. [ 12 ] localizes factual recall to middle-layer MLP weights. We find the safety evaluation circuit in the top quartile (layers 24–31)-a distinct site suggesting functional specialization: content in the middle, evaluation of that content near the top. Representation engineering. [ 15 ] and [ 8 ] construct steering vectors for behavioral properties. S&R differs: we target the suppression-restoration competition