ARREST : Adversarial Resilient Regulation Enhancing Safety and Truth in Large Language Models
Sharanya Dasgupta, Arkaprabha Basu, Sujoy Nath, Swagatam Das · 2026
Read ARREST : Adversarial Resilient Regulation Enhancing Safety and Truth in Large Language Models by Sharanya Dasgupta, Arkaprabha Basu, Sujoy Nath, Swagatam Das (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2601-04394.txt.
Introduction
Sharanya Dasgupta and three co-authors treat two of language models' worst habits as one disease in a 2026 arXiv paper. Hallucinated falsehoods and unsafe outputs, they argue, both grow from drift in the model's internal activation patterns. A misalignment in the space where meaning is represented, rather than from two distinct failures needing two distinct cures.
Their system, ARREST, trains an external network to watch those fluctuations and step in selectively, steering drifted features back. Correcting falsehoods into truthful answers and unsafe continuations into refusals, soft or hard as the case demands — without retraining the model itself. In their tests the regulator not only corrected misalignment but produced softer, more graded refusals than models aligned by the standard reinforcement approach, thanks to adversarial training. The code is released publicly.
Catalog record
| CREATOR | Sharanya Dasgupta, Arkaprabha Basu, Sujoy Nath, Swagatam Das |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 51 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2601-04394
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
ARREST : Adversarial Resilient Regulation Enhancing Safety and Truth in Large Language Models Sharanya Dasgupta, Arkaprabha Basu, Sujoy Nath, Swagatam Das Abstract Human cognition, driven by complex neurochemical processes, oscillates between imagination and reality and learns to self-correct whenever such subtle drifts lead to hallucinations or unsafe associations 1 1 1 Warning: The materials presented in this paper might be disturbing or offensive. . In recent years, LLMs have demonstrated remarkable performance in a wide range of tasks. However, they still lack human cognition to balance factuality and safety. Bearing the resemblance, we argue that both factual and safety failures in LLMs arise from a “ representational misalignment ” in their latent activation space, rather than addressing those as entirely separate alignment issues. We hypothesize that an external network, trained to understand the fluctuations, can selectively intervene in the model to regulate falsehood into truthfulness and unsafe output into safe output without fine-tuning the model parameters themselves. Reflecting the hypothesis, we propose ARREST (Adversarial Resilient Regulation Enhancing Safety and Truth), a unified framework that identifies and corrects drifted features, engaging both soft and hard refusals in addition to factual corrections. Our empirical results show that ARREST not only regulates misalignment but is also more versatile compared to the RLHF-aligned models in generating soft refusals due to adversarial training. We make our codebase available at https://github.com/sharanya-dasgupta001/ARREST . Fig. 1 : ARREST in action: Left: Effects of alignment strategies on base-model responses for hallucination (top) and safety (bottom). Right: Schematic of internal-state distributions, showing how ARREST shifts states from an undesired distribution (unsafe) towards a safe/factual and desired distribution (ARREST) with human akin generations. Keywords: Large Language Model, Safety Alignment, Hallucination, Mitigation I Introduction Imagine asking a Large Language Model (LLM) about treating a rare disease. It confidently recommends a nonexistent drug [ 1 ] . Later, it provides detailed cyberattack instructions [ 2 ] despite being designed to refuse such requests. These failures, factual hallucination and safety bypass, appear distinct but may share a fundamental connection. Consider GPT-4 [ 3 ] : it refused to describe securities fraud when asked directly but provided these details when requests bypassed its safety mechanisms- Jailbreaking [ 4 ] . When asked about the fictional physicist “Gabriela Alveraga Lopes,” it confidently described her nonexistent contributions to quantum mechanics- Hallucination [ 5 ] . These failures present breakdowns in different guardrails, involving the ability of LLMs to recognize and respond appropriately to sensitive or uncertain content. What if these seemingly separate problems share an underlying mechanism? Recent research suggests specific attention heads may serve as “hidden guardians” of both factuality and safety [ 6 , 7 ] , while models activate different internal representations when encountering known versus unknown entities [ 8 , 9 ] . Qi et al. [ 10 ] reveal that safety alignment is superficial, residing “a few tokens deep,” and demonstrate that models can recover safely even after beginning harmful generations. Zhou et al. [ 7 ] show that small changes to specific attention heads dramatically affect safety behaviors. These findings raise two central questions: Do multi-head attention mechanisms and internal representations govern both safety and hallucination behaviors? Can black-box prompting alone [ 11 , 12 ] address these challenges, or do they demand modeling of latent decision boundaries in LLM feature spaces? However, current approaches reveal an asymmetry: safety largely relies on RLHF-based mechanisms [ 13 , 14 , 15 ] that score candidate responses—reminiscent of post-hoc filtering, while hallucination mitigation uses geometric and feature-based methods [ 16 , 17 , 18 ] to model uncertainty. This divergence exposes a challenge: RLHF-driven advances in safety have not produced comparable breakthroughs for factual accuracy. Furthermore, the RLHF-aligned feature space remains underexplored, positioning us to investigate confirmation bias [ 19 ] that may enable novel jailbreaking mechanisms [ 20 , 21 , 22 ] . Fig. 2 : Illustration of ARREST . Training Stage 1: A decision network identifies optimal intervention layers with maximum representational misalignment. Training Stage 2: Two adversarial paradigms (Base and Contrastive) target domain-specific distributions at selected layers. For hallucination, target distributions formed by hidden states from answer-prompted generation. For safety, we use RLHF-aligned model states. Safety-focused Contrastive training employs triplet loss with positive samples from refusal-eliciting prompts and negative samples from jailbreaking prompts. Inference: The trained generator performs real-time hidden state alignment at the specified layer, steering representations toward truthfulness and safety. To address this, we turn to Generative Adversarial Networks (GANs) [ 23 , 24 ] . While diffusion models [ 25 ] excel at gradual generation, they lack the adversarial min-max dynamics critical for modeling sharp decision boundaries between safe/unsafe and factual/fictional distributions in LLM feature spaces. Adversarial training pits a critic against the generator to learn these boundaries, mirroring the real-time tug-of-war between jailbreaking prompts and safety mechanisms. We wonder: how does a simple adversarial min-max game transform noise into meaningful distributions in tasks like super-resolution [ 26 ] and style transfer [ 27 ] ? This motivates our core exploration: an external adversarial mitigator modeling the divergence between factual/fictional and safe/unsafe distributions within LLM feature spaces [ 28 ] , drifting states toward desired distributions rather than artificial hard refusal strings [ 29 ] . Below, we outline our key contributions. • We introduce ARREST, a framework that arrests the emergence of two distinct misalignment issues and reframes the curvature of factuality and safety as “ representational misalignment ,” a distribution shift within embedding space. This offers us an advantage in human-centric evaluations where the precision of facts and safety are crucial, ensuring more impactful responses. • After tracing the evolution of the most undesirable distribution marked in LLM layers, we vanguard the attempt to propagate it along an informed trajectory (i.e., RLHF) and define it as an adversarial drift through informational training. • Furthermore, we expand this concept into a unique paradigm employing a contrastive approach, which delineates various prompt-based mechanisms to intentionally jailbreak or safety generations. Such a mechanism not only enhances performance significantly, but also theoretical analysis indicates that ARREST places greater emphasis on generating “soft refusals” in contrast to “hard refusals” typically produced by RLHF-aligned models. Consequently, we introduce the initial series of ARREST mitigators, which are capable of producing “soft refusals” without requiring fine-tuning the LLMs. • We perform extensive experiments using contemporary baselines in conjunction with prompt-based qualitative results across various foundation models. Our findings indicate that we only require training \sim 33M parameters instead of comprehensive fine-tuning of the entire LLM while producing more insightful and human-centric conjectures. II Related Works In recent years, the reliability of LLMs has posed a considerable obstacle to practical applications, centered on two intertwined challenges: Factuality and Safety [ 30 , 31 ] . A model may align with human values yet produce factually inaccurate content or deliver precise information while generating ethically contentious outputs [ 32 ] . We categorize this into three interrelated dimensions: detecting factuality and safety features, correcting falsehoods, and mitigating unsafe behaviors. Detection of Factuality and Safety features initially manifested as prompt-engineering approaches, notably structured reasoning [ 11 ] and multi-branch exploration [ 12 ] . However, these methodologies treated models as “black boxes,” providing limited insight