Intrinsic Guardrails: How Semantic Geometry of Personality Interacts with Emergent Misalignment in LLMs

Krishak Aneja, Manas Mittal, Anmol Goel, Ponnurangam Kumaraguru, Vamshi Krishna Bonagiri · 2026

Read Intrinsic Guardrails: How Semantic Geometry of Personality Interacts with Emergent Misalignment in LLMs by Krishak Aneja, Manas Mittal, Anmol Goel, Ponnurangam Kumaraguru, Vamshi Krishna Bonagiri (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-10633.txt.

Introduction

Krishak Aneja and four colleagues map how personality structure guards against emergent misalignment in language models. Fine-tuning models on benign narrow data can sometimes trigger broad harmful behaviors. Prior work ties these failures to particular directions in activation space, but not to the model's wider persona. Their 2026 paper maps the latent personality space through profiles like the Big Five, Dark Triad, and model-specific behaviors.

The authors show the semantic geometry holds steady from aligned models to their corrupted fine-tunes. Directions isolating social valence, such as the Evil persona vector and a new Semantic Valence Vector, function as intrinsic guardrails. Ablating them drives misalignment rates above 40 percent, while amplifying them suppresses failures to less than 3 percent. Vectors extracted in advance from an instruct-tuned model transfer zero-shot to regulate misalignment in corrupted fine-tunes.

Catalog record

CREATORKrishak Aneja, Manas Mittal, Anmol Goel, Ponnurangam Kumaraguru, Vamshi Krishna Bonagiri
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE55 KB
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2605.10633

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Intrinsic Guardrails: How Semantic Geometry of Personality Interacts with Emergent Misalignment in LLMs Krishak Aneja, Manas Mittal, Anmol Goel, Ponnurangam Kumaraguru, Vamshi Krishna Bonagiri Abstract Fine-tuning Large Language Models (LLMs) on benign narrow data can sometimes induce broad harmful behaviors, a vulnerability termed emergent misalignment (EM) ( 4 ) . While prior work links these failures to specific directions in the activation space, their relationship to the model’s broader persona remains unexplored. We map the latent personality space of LLMs through established psychometric profiles like the Big Five, Dark Triad, and LLM-specific behaviors (e.g. evil, sycophancy), and show that the semantic geometry is highly stable across aligned models and their corrupted fine-tunes. Through causal interventions, we find that directions isolating social valence, such as the ‘Evil’ persona vector, and a Semantic Valence Vector (SVV) that we introduce, function as intrinsic guardrails: ablating them drives the misalignment rates above 40 % 40\% , while amplifying them suppresses the failure mode to less than 3 % 3\% . Leveraging the structural stability of the personality space, we show that vectors extracted a priori from an instruct-tuned model transfer zero-shot to successfully regulate EM in corrupted fine-tunes. Overall, our findings suggest that harmful fine-tuning does not overwrite a model’s internal representation of personality, allowing conserved representations to serve as robust, cross-distribution guardrails. † † affiliationnotice: Equal contribution Figure 1 : Overview of experimental framework and core findings. (1) Setup: Evaluation of 12 psychometric traits across aligned ( Q_{a} ) and misaligned ( Q_{m} ) models. (2) Extraction: Persona vectors are derived via 5 ’s pipeline; the Semantic Valence Vector ( v_{SVV} ) is constructed by aggregating prosocial and sign-inverted antisocial vectors. (3) Stability: Geometric analysis proves the personality space remains structurally invariant across fine-tuning. (4) Interaction: Causal interventions reveal a Guardrail Effect ; ablating valence-adjacent directions exacerbates misalignment frequency, while amplification suppresses it. Base-model vectors ( V_{a} ) transfer zero-shot to successfully regulate misaligned fine-tuned variants. 1 Introduction Large Language Models (LLMs) are typically aligned using targeted fine-tuning methods such as Reinforcement Learning from Human Feedback (RLHF) or targeted instruction tuning to suppress harmful outputs and improve helpfulness ( 16 ) . However, alignment is known to be brittle under many circumstances ( 28 ; 19 ) . Recent work demonstrates that fine-tuning on narrow, seemingly benign domains can induce unexpected and often undesired shifts in the model’s behavior. For instance, fine-tuning on insecure code or specific ‘bad advice’ datasets can cause a model to become broadly misaligned, exhibiting harmful behavior far outside the training context ( 4 ; 26 ) a phenomenon termed ‘Emergent Misalignment’ (EM). EM has motivated a line of inquiry suggesting that this failure mode can be explained through movement along a small number of “misaligned” linear directions in the model’s activation space ( 22 ; 27 ) . 5 systemize this, showing that shifts towards various personality traits like ‘evil’ or ‘sycophancy’, induced by prompting or fine-tuning, can be largely captured by such linear directions, operationalized as “persona vectors”. These findings point towards personality and alignment being linearly controllable. Recent explorations map out a structured role vector space spanning hundreds of character archetypes, identifying a prominent “Assistant Axis” ( 12 ) . Related hypotheses, such as the Persona Selection Model ( 13 ) , propose that models maintain a stable internal repertoire of personas; rather than overwriting fundamental concepts, fine-tuning primarily alters the probability distribution over which persona is selected during generation. These complementary views prompt our central research question: How does the specific failure mode of EM relate to the model’s broader geometric personality space? Does EM fine-tuning fundamentally corrupt the model’s internal representation of traits, or does it merely shift the active region within a stable representational structure? To investigate this, we adopt an exploratory top-down approach. We map the high-dimensional “personality space” of LLMs by extracting 12 persona vectors corresponding to a range of traits, encompassing the Big Five ( 8 ) , the Dark Triad ( 18 ) , and LLM-relevant behaviors (Evil, Sycophancy, Apathy, and Impoliteness) from both aligned instruction-tuned models and their EM variants. Through a comparative analysis using metrics of structural isomorphism, specifically Linear Centered Kernel Alignment (CKA) and Procrustes analysis, we establish that the semantic topology of the personality space is conserved across fine-tuning, providing empirical support for the hypothesis that the internal representations of personality remain intact. We then systematically test the causal relationship between the personality space and the expression of misalignment. We ablate and amplify several candidate valence directions derived from our mapped space: unsupervised Principal Components (PCs), a Semantic Valence Vector (SVV) constructed by aggregating prosocial and sign-inverted antisocial vectors, and persona trait vectors. We observe that intervening along the Evil persona and SVV vectors demonstrates the highest efficacy in modulating EM, reducing it to near zero when ablated for the Qwen2.5 family. Strongly supporting the view that EM operates by activating an antisocial assistant persona. Finally, we leverage this structural stability for alignment control. As the geometric orientation of traits is conserved during EM fine-tuning, we hypothesize that intervention vectors do not need to be calculated post-hoc on a corrupted model. We demonstrate that the ‘Evil’ vector extracted a priori from a safe, base instruct model can be applied zero-shot to successfully suppress harmful outputs in misaligned fine-tunes. Figure 2 : Projection of trait vectors onto the first two Principal Components for the Qwen 2.5 7B Instruct model (a) and the Misaligned variant (bad medical) (b) from layer 16. The semantic arrangement of traits along PC_{1} and PC_{2} is consistent across models. 2 The Personality Space We define the ‘Personality Space’ as the linear subspace spanned by activation differences between opposing behavioral instructions. To investigate the geometry of the LLM personality space and its relationship to alignment, we employ a pipeline that extracts high-level behavioral representations and evaluates their structural stability across a suite of controlled model organisms. All experiments were run on Instruct and EM-tuned variants ( 15 ) of two model families: Qwen-2.5 and Llama-3.1/3.2. We specifically utilize variants fine-tuned on “Bad Medical Advice” to ensure a testbed with minimal semantic bias and broad behavioral generalization. This setup allows for a direct comparison between internal representations of safe base models and those with known, induced misalignment. 2.1 Extracting Personality Representations To construct this space, we curate a set of system prompts and neutral evaluation questions designed to elicit 12 specific psychological dispositions. These traits were selected to encompass a broad range of the behavioral spectrum: • The Big Five ( 8 ) : Openness, Conscientiousness, Extraversion, Agreeableness, and Neuroticism. • The Dark Triad ( 18 ) : Narcissism, Machiavellianism, Psychopathy. • LLM-Relevant Behaviors : Sycophancy, Apathy, Impoliteness, and a generalized “Evil” persona. We utilize the automated data generation pipeline proposed by 5 to extract these linear representations. Refer to Appendix A for further details. Figure 3 : Cosine similarity matrices comparing the base (a) Qwen 2.5 7B model with the misaligned (b) Qwen 2.5 7B Bad Medical variant at Layer 16. 2.2 Semantic Organization and Dimensionality Reduction To uncover the latent geometric structure organizing these directions, we construct a matrix M\in\mathbb{R}^{12\times d_{model}} by stacking the extracted persona vectors. We compute the pairwise cosine

Read the complete text