Refusal Lives Downstream of Persona in Chat Models

Viola Zhong, Qirui Li · 2026

Read Refusal Lives Downstream of Persona in Chat Models by Viola Zhong, Qirui Li (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2606-26161.txt.

Introduction

Viola Zhong and Qirui Li show that a chat model's persona can switch its refusals off. Refusal and persona each correspond to directions in the model's activation space. The two were studied apart until now. Working with Qwen and Llama instruction-tuned models, the pair extract a compliant-persona direction and a refusal direction. Interventions on both reveal the interaction directly.

Steering toward a compliant persona crushes refusal. In the Llama model, refusal falls from near total to almost none. Adding the refusal direction back restores refusal only at late layers. Early layers stay suppressed. Removing the persona direction in a late window brings refusal back to baseline. A random direction does nothing. Refusal, then, is expressed late, downstream of the persona gate. Safety work that treats refusal as one isolated direction misses its dependence on persona.

Catalog record

CREATORViola Zhong, Qirui Li
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE36 KB
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2606.26161

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Refusal Lives Downstream of Persona in Chat Models Thanks: Accepted to the ICML 2026 Mechanistic Interpretability Workshop. Viola Zhong, Qirui Li Abstract Linear directions in activation space have been identified for both refusal and persona traits in instruction-tuned chat models, but the two have been studied as separate mechanisms. We show they interact: a compliant persona gates refusal. In Qwen2.5-7B-Instruct and Llama-3.1-8B-Instruct, we extract a compliant model-persona direction and a refusal direction and intervene on both. Compliant persona steering suppresses refusal — in Llama, the refusal rate falls from 97% to 2%. Reintroducing the refusal direction partially restores refusal at late layers but not at early ones. Projecting out the persona direction in a late-layer window restores it to baseline; projecting out a random direction does not. Refusal is therefore gated at the late-layer expression stage, downstream of where it is computed. Treating refusal as a single isolated direction misses its dependence on persona. \workshoptitle Mechanistic Interpretability Workshop 1 1 1 Code and data: https://github.com/violazhong/refusal-downstream-persona 1 Introduction Refusal in chat models is mediated by a single direction in the residual stream ( Arditi et al. 2024 ) . This mediation unfolds across layers in three stages: input-side harmfulness detection, aggregation along the refusal direction, and late-layer expression ( Lee et al. 2025 ) . Lee et al. identify content-axis features upstream of refusal—what the prompt is about—leaving the late-layer expression stage largely unexamined. Recent work challenges the single-direction view, showing refusal is multi-dimensional within its own subspace ( Wollschläger et al. 2025 ) and that its differentiation refines gradually across late layers ( Hildebrandt et al. 2025 ) . We explore the final stage of the refusal pipeline, and show that refusal is gated by an identity-axis model persona. Model persona is of interest because identity may function as a control surface for model behavior. Recent work extracts linear directions for traits like sycophancy, evil, and steer behavior at inference ( Chen et al. 2025 ) . Less attention has gone to how persona interacts with other safety-relevant directions across layers. We show that compliant persona steering intervenes in refusal at the late-layer expression stage, not at the earlier computation stages. Persona and refusal have been studied as separate mechanisms; we show they are coupled. Persona representations at late layers gate whether refusal is expressed. In Llama-3.1-8B, compliant persona steering drops the refusal rate from 97.4% at baseline to 1.6%. Projecting out the persona direction at layer 20 restores refusal to 96.8%; projecting out a random direction at the same layer leaves it at 1.6%. Qwen2.5-7B shows the same pattern, with the effect concentrated in a narrow late-layer window (L20–L22). We also introduce a three-way refusal/bypass/degenerate classification that separates real compliance from incoherent or partially-leaking outputs — failure modes that single-metric attack-success-rate evaluations conflate. These results show that refusal in chat models is not a self-contained safety mechanism; it depends on persona representations at the late-layer expression stage. 2 Setup Models. We study Qwen2.5-7B-Instruct and Llama-3.1-8B-Instruct. Model-persona directions. For a trait t , we extract a model-persona direction v_{t} from contrastive persona prompts. We compute the mean residual-stream activation difference between positive-trait and negative-trait prompts at a fixed layer and token position. Additive steering applies h_{\ell}\leftarrow h_{\ell}+\alpha v_{t}, (1) where h_{\ell} is the residual-stream activation at layer \ell . For behavioral characterization, we use eight relational traits in four opposing pairs: evil/nurturing, callous/supportive, hostile/patient, and arrogant/diplomatic. For safety experiments, we use a compliant model-persona direction v_{\mathrm{MP}} . Refusal directions. We extract refusal directions following Arditi et al. 2024 . We use positive refusal addition and refusal ablation. Positive refusal addition is layer-sensitive, so we validate it with a benign-refusal induction sanity check before using it in tension experiments. Tension and knockout interventions. The main tension intervention adds v_{\mathrm{MP}} and a positive refusal direction in the same forward pass. We test early refusal addition at the validated refusal-induction layer, and late refusal addition at L22 or L22+L24. We also test whether the persona projection mediates refusal suppression by projecting out v_{\mathrm{MP}} : h_{\ell}\leftarrow h_{\ell}-\langle h_{\ell},\hat{v}_{\mathrm{MP}}\rangle\hat{v}_{\mathrm{MP}}. (2) We compare this intervention to a random projection knockout at the same layer. Evaluation. For behavioral signatures, GPT-4o scores responses from 0–100 on hostility, emotional attunement, and coherence. For safety, we evaluate on the 313-prompt StrongREJECT forbidden-prompt set ( Souly et al. 2024 ) . Because attack-success metrics can miss refusals, degeneracy, and partial leakage, we use three complementary labels: refusal, bypass, and degenerate. We also report StrongREJECT ASR, Llama-Guard-3 unsafe rate, and a leakage score for partial harmful information. 3 Geometry of Persona and Refusal Directions To rule out trivial explanations of the persona–refusal interaction, we measure pairwise cosines among four directions at the steering layer (L20): the compliant model persona \mathbf{v}_{\mathrm{MP}} , the refusal direction \hat{r} , the assistant axis \mathbf{v}_{A} , and a random unit direction \mathbf{v}_{\mathrm{rand}} . The assistant axis is extracted following Lu et al. 2026 : the difference-in-means direction between activations on prompts that elicit the default assistant persona and prompts that disrupt it. As shown in the table 1 , compliant persona is approximately orthogonal to refusal: \cos(\mathbf{v}_{\mathrm{MP}},\,\hat{r}) is -0.180 in Llama and -0.279 in Qwen, far from the -1.0 that anti-parallel directions would show. Persona-mediated refusal suppression therefore cannot be explained by direct cancellation in activation space. Both \mathbf{v}_{\mathrm{MP}} and \hat{r} are approximately orthogonal to the assistant axis: \cos(\mathbf{v}_{\mathrm{MP}},\,\mathbf{v}_{A})={+0.100} / {+0.127} and \cos(\hat{r},\,\mathbf{v}_{A})={-0.118} / {-0.060} in Llama / Qwen. Compliant persona is distinct from the default-assistant representation, not a relabeling of it; refusal is similarly distinct. These are non-trivial distinctions, not noise. Cosines involving the random baseline \mathbf{v}_{\mathrm{rand}} are an order of magnitude smaller ( |\cos|<0.045 across all pairs), confirming the meaningful directions share more structure with each other than they do with chance, even when none of the pairs is collinear. \cos(\hat{r},\,\mathbf{v}_{A}) is stable across layers (Appendix X). Table 1 : Pairwise cosine similarities between the compliant persona direction ( \mathbf{v}_{\mathrm{MP}} ), refusal direction ( \hat{r} ), assistant axis ( \mathbf{v}_{A} ), and a random baseline ( \mathbf{v}_{\mathrm{rand}} ) at steering layer L20, for Llama and Qwen. Direction Pair Llama Qwen \cos(\mathbf{v}_{\mathrm{MP}},\,\hat{r}) -0.180 -0.279 \cos(\mathbf{v}_{\mathrm{MP}},\,\mathbf{v}_{A}) +0.100 +0.127 \cos(\hat{r},\,\mathbf{v}_{A}) -0.118 -0.060 \cos(\mathbf{v}_{\mathrm{MP}},\,\mathbf{v}_{\mathrm{rand}}) +0.012 +0.001 \cos(\hat{r},\,\mathbf{v}_{\mathrm{rand}}) +0.015 -0.032 \cos(\mathbf{v}_{A},\,\mathbf{v}_{\mathrm{rand}}) -0.042 +0.002 4 Behavioral Signatures of Persona Directions Before testing persona’s effect on refusal, we verify that model-persona directions encode genuine behavioral structure rather than merely perturbing the model. We extract directions for eight relational traits in four opposing pairs — evil/nurturing, callous/supportive, hostile/patient, arrogant/diplomatic — and score steered responses on hostility, emotional attunement, and coherence. Because each pair is extracted independently, agreement between its two directions is not built in. Steering produces trait-specific behavioral signatures Figure 1 : antisocial traits raise hostility, prosocial traits raise emotional attunement. Within each pair, the two directions trace approximately mirror-image gradients — a symmetry that would not arise from noise or generic degradation. Coherence stays high where these behavioral effects appear and varies independently of the other two dimensions. Model-persona directions therefore encode behavioral dispositions, not surface style, which motivates our central question: whether a compliant persona also gates refusal. Figure 1 : Model-persona directions induce structured behavioral signatures. Opposing traits, extracted independently, produce approximately mirror-like gradients over hostility, emotional attunement, and

Read the complete text