Ablating Safety: Mechanisms for Removing Alignment in Language Models for Security Applications

Isaac, Arthur Gervais · 2026

Read Ablating Safety: Mechanisms for Removing Alignment in Language Models for Security Applications by Isaac, Arthur Gervais (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-17413.txt.

Introduction

Isaac David and Gervais study alignment removal as a controlled evaluation protocol for authorized security tasks, where refusals can masquerade as missing capability. They compare prompting, activation projection, representation control and LoRA adaptation on Security-AR, a 60-prompt suite. Single-vector projection barely lifts security scores while spiking unsafe compliance, but task-only LoRA reaches 0.87 security with 0.83 general score and modest spillover, framing the issue as a utility-risk frontier.

Catalog record

CREATORIsaac, Arthur Gervais
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE43093
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2605.17413

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Ablating Safety: Mechanisms for Removing Alignment in Language Models for Security Applications Isaac, Arthur Gervais Abstract Safety-aligned language models often refuse cybersecurity requests whose wording resembles misuse, even when the task is authorized and defensive. This makes security evaluation ambiguous: a failed answer may reflect missing capability or refusal-policy intervention. Ablating Safety studies alignment removal as a controlled transformation-evaluation protocol for authorized security tasks, comparing authorized-context prompting, reversible refusal-direction activation projection, representation-control projections, and LoRA-based de-alignment or task adaptation. We evaluate refusal, attempt rate, validated security success, general-capability retention, instability, and out-of-scope unsafe compliance on Security-AR , a 60-prompt suite of authorized security, benign general, and non-operational spillover probes. The reported runs include a four-model projection pilot with 416 completions, a three-model Qwen2.5 LoRA extension with 1,980 held-out completions, representation and robustness sweeps, and executable secure-repair validators. Single-vector refusal projection raises mean security score only from 0.46 to 0.50 while increasing unsafe compliance from 0.10 to 0.47; rank-4 refusal-subspace projection reaches 0.51 while matching the aligned spillover rate. Task-only LoRA raises mean security score to 0.87 with general score 0.83 and unsafe compliance 0.13, while refusal-suppression with retention raises spillover to 0.27. These results support evaluating alignment removal as a utility-risk frontier, not as an uncensoring recipe, and treating compliance alone as neither competence nor safe deployment. 1 Introduction Language models are increasingly used in security workflows that require adversarial reasoning: vulnerability triage, binary reverse engineering, exploitability assessment, secure patch analysis, and controlled red-team exercises. These workflows are legitimate when they operate on authorized systems, isolated challenge targets, or defensive audit tasks. They also overlap lexically and procedurally with prompts that safety-aligned assistants are trained to refuse. As a result, refusal behavior can become a measurement confounder: an aligned model may fail a security benchmark because it refuses the task, not because it lacks the underlying capability. Existing evaluations often treat this behavior as a property of the deployed assistant. A model either complies, refuses, or can be induced to comply with a jailbreak prompt. Recent mechanistic work suggests a different view: refusal can be mediated by low-dimensional activation directions in some open-weight models [ 3 ] , and practitioner workflows such as abliteration apply related transformations to suppress refusal behavior without full retraining [ 21 ] . These observations raise a scientific question that is distinct from prompt jailbreak research: when alignment is removed through model-level transformations, what changes besides refusal? This paper studies alignment removal as a controlled model transformation. The goal is not to release an “uncensored” model or to optimize harmful behavior. The goal is to measure whether safety behavior is mechanistically separable from task competence, and to identify which removal methods preserve useful reasoning while avoiding broad unsafe spillover. This framing matters for security evaluation because prompt-level bypasses, model edits, and fine-tuning changes are not equivalent interventions. They may expose different capabilities, induce different failure modes, and require different governance controls. We ask: Can refusal behavior be reduced for authorized security tasks while preserving general capability and bounding unsafe spillover outside the evaluation scope? Ablating Safety answers this question as an evaluation protocol and controlled empirical study. In this paper, “ablating safety” means applying a controlled transformation that weakens one measurable safety behavior—refusal—and then auditing what else changes. The evidence is organized in two layers. A projection pilot instantiates the prompt-baseline and reversible activation-projection setting across four open-weight models. An extended evaluation then exercises the protocol’s fine-tuning-based arm with LoRA adapters on three Qwen2.5 models, using the same task suite, scoring rules, and responsible-release constraints. The paper makes three contributions: • We formalize alignment removal as a transformation-evaluation problem, with metrics and controls that separate refusal reduction from task success, general capability retention, and unsafe spillover. • We define Security-AR , a controlled benchmark and release design for authorized security tasks, including redacted public artifacts and decision rules for interpreting utility-risk tradeoffs. • We implement a projection pilot and a LoRA extension showing that prompt, activation, representation-control, and fine-tuning interventions induce distinct utility-risk tradeoffs. The paper is scoped to open-weight models and controlled security evaluations. It does not evaluate attacks on deployed third-party systems, does not recommend releasing transformed checkpoints, and does not publish operational exploit payloads. The empirical claims are bounded to the reported open-weight models, task suite, transformation families, and scoring rules; they are not claims that the observed frontier generalizes to frontier-scale systems or to all de-alignment methods. 2 Background and Related Work Guardrails, refusal, and safety alignment. Modern assistants build on foundation models whose broad capabilities also create broad misuse surfaces [ 9 , 8 , 37 , 20 ] . Instruction-tuned assistants are commonly trained to follow benign requests while refusing unsafe or policy-sensitive requests [ 25 , 5 ] . Deployment systems also add external guardrails through programmable dialogue policies, input-output classifiers, and agent monitors [ 34 , 19 , 13 ] . These layers are important in practice, but they differ from model-internal refusal. A runtime filter can block or rewrite an output without changing the model’s computation; safety fine-tuning changes the distribution the model itself samples from. This paper focuses on the latter: transformations that alter refusal behavior inside an open-weight model or its inference pass. Refusal is useful for deployment but problematic as a capability-measurement primitive. A failed answer on a security benchmark may indicate lack of competence, successful safety enforcement, over-refusal, guardrail-triggered truncation, or a task-template artifact. Recent work argues that safety behavior can be shallowly expressed in early response tokens [ 31 ] , and that fine-tuning can erode safety even when the fine-tuning data are benign [ 32 ] . Follow-on work proposes constraining safety-token behavior during fine-tuning as a way to prevent alignment drift [ 39 ] . These results motivate evaluating task competence and refusal policy as separate outcomes. Representation engineering and activation steering. Representation engineering treats high-level model behaviors as directions or subspaces in activation space [ 42 ] . Activation addition and contrastive activation addition show that inference-time activation edits can steer behaviors without full optimization [ 38 , 27 ] . This family of methods is directly relevant to alignment removal because it supplies both the measurement tools for finding behavioral directions and the intervention tools for adding, subtracting, projecting, or gating them. Mechanistic refusal directions and circuits. Prior work finds that refusal in multiple open-weight chat models is mediated by a low-dimensional residual-stream direction: adding the direction can induce refusal, while erasing it can suppress refusal [ 3 ] . Later work generalizes and complicates this picture. Affine concept editing combines projection and activation addition to control refusal more precisely across models where pure projection can produce incoherence [ 23 ] . COSMIC automates refusal-direction selection without assuming output-level refusal templates [ 35 ] . Sparse-autoencoder steering identifies refusal-related features but also reports capability tradeoffs, suggesting that refusal-relevant features may be partly entangled with ordinary language-model competence [ 26 ] . Recent preprints further argue that refusal should be understood as routing from detected concepts to output policy, not merely as a detectable concept vector or a surface refusal string [ 14 , 15 ] . We treat these papers as mechanistic motivation rather than settled consensus:

Read the complete text