Persona Vectors in Games: Measuring and Steering Strategies via Activation Vectors

Johnathan Sun, Andrew Zhang · 2026

Read Persona Vectors in Games: Measuring and Steering Strategies via Activation Vectors by Johnathan Sun, Andrew Zhang (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-21398.txt.

Introduction

Sun and Zhang build persona vectors for traits like altruism, forgiveness, and expectations of others in strategic games. They make the vectors with contrastive activation addition in large language models. Steering with them shifts both the choices models make in classic games and the reasons models give. Yet words and actions can pull apart under steering. Vectors for own behavior and for beliefs about others also partly differ, the authors report.

Catalog record

CREATORJohnathan Sun, Andrew Zhang
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE35670
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2603.21398

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Persona Vectors in Games: Measuring and Steering Strategies via Activation Vectors Johnathan Sun, Andrew Zhang Abstract Large language models (LLMs) are increasingly deployed as autonomous decision-makers in strategic settings, yet we have limited tools for understanding their high-level behavioral traits. We use activation steering methods in game-theoretic settings, constructing persona vectors for altruism, forgiveness, and expectations of others by contrastive activation addition. Evaluating on canonical games, we find that activation steering systematically shifts both quantitative strategic choices and natural-language justifications. However, we also observe that rhetoric and strategy can diverge under steering. Moreover, vectors for self-behavior and expectations of others are partially distinct. Our results suggest that persona vectors offer a promising mechanistic handle on high-level traits in strategic environments. 1 Introduction Large language models are rapidly moving from purely generative tools to decision-making agents, increasingly acting as proxies for human users in strategic environments ( 10 ) . A growing literature studies LLMs playing repeated games, bargaining, and pricing strategies, documenting emergent cooperative and collusive behaviors. The common approach is to probe models through prompting—prepending instructions like “act selfishly” or “act cooperatively”—but this treats the model as a black box and offers limited insight into the internal mechanisms that implement behavioral shifts. Recent work on persona vectors shows that certain high-level traits can be associated with approximately linear directions in activation space, and perturbing hidden states along these directions can reliably steer behavior without changing the surface prompt ( 5 ) . We extend this approach to strategic settings, asking: Can persona vectors measure and control behavior in game-theoretic environments? Do steered models change not just rhetoric but actual strategies? And do models represent their own behavioral tendencies separately from their expectations about others? Our contributions are as follows: • We construct persona vectors corresponding to altruism, forgiveness, and expectations of others from LLM-generated contrastive data in Qwen 2.5-7B. • Across a suite of canonical games, activation steering systematically shifts both LLM-rated behavior and quantitative strategic choices (e.g., dollars shared). • Rhetoric and strategy can diverge under steering, and self-behavior and expectations of others are partially distinct representations, suggesting LLMs maintain at least partially separable notions of “I am altruistic” and “other agents are altruistic.” 2 Background and Related Work Economics and experimental game theory provide a rich toolkit for probing cooperation, fairness, and altruism. Human experiments document substantial heterogeneity in cooperative and punitive behavior across individuals and games ( 6 ; 7 ; 3 ) . Several recent papers study LLMs as players in repeated games and economic environments. 1 find that chat models exhibit stable behavioral signatures (such as levels of cooperation and spite) across a suite of repeated games. 9 show that some LLMs behave more cooperatively than humans in Prisoner’s Dilemma variants. The Alympics benchmark explores strategic decision making of language agents across diverse games ( 12 ; 2 ) , and work on algorithmic collusion raises concerns about LLM-based pricing agents learning tacit collaboration in repeated markets ( 8 ) . Beyond game theory, 10 provide large-scale evidence on how deployed users employ LLMs for economic tasks, underscoring the practical importance of understanding model behavior in decision problems. Our work builds on a growing literature on activation steering. 14 introduce Activation Addition (ActAdd), and 13 scale this idea to contrastive activation addition. Our work is methodologically closest to 5 , who use steering vectors to detect and intervene on higher-level traits such as sycophancy, hallucination, and evil. 3 Methods We use altruism as a case study to explain our approach, then apply the same procedure to construct vectors for forgiveness and expectations of other agents. 3.1 Training Questions and Responses Figure 1: Pipeline for constructing the altruism persona vector: a trait description and moral dilemmas are passed through altruistic and non-altruistic prefixes to obtain mean activation differences. We begin with a description of responses that exhibit the target trait. For altruism, we use the following: “Responses that emphasize benefiting other people, often at a cost or risk to the speaker, without expecting something in return.” Using Claude Sonnet 4.5 ( claude-sonnet-4-5-20250929 ), we generate 50 moral dilemmas as training questions, covering topics such as charitable giving, helping coworkers, and volunteering time. For each question, we elicit two types of model responses via prompt prefixes: altruistic responses and non-altruistic responses. This yields paired sets of prefix-question combinations: \{P_{1},\dots,P_{n}\} for altruistic responses and \{N_{1},\dots,N_{n}\} for non-altruistic responses. With 5 positive and 5 negative prefixes applied to each of 50 questions, we obtain 500 prefix-question pairs per trait. 3.2 Activation Extraction and Vector Definition We study the behavior of Qwen 2.5-7B in this paper as a case study. For each response, we run the model in teacher-forcing mode and record hidden activations at each transformer layer, taking the mean activation across all tokens in the response. We use GPT-4.1-mini ( gpt-4.1-mini-2025-04-14 ) to rate each response from 0 to 100 by how strongly it exhibits the target trait. To ensure clean contrast, we filter to the subset S of prefix-question pairs where the positive response scores \geq 50 and the negative response scores <50 . Let P_{i}^{(\ell)} and N_{i}^{(\ell)} denote the activation vectors at layer \ell for the i -th positive and negative example. For each layer \ell , we define the persona vector as the mean difference: x^{(\ell)}\;=\;\frac{1}{|S|}\sum_{i\in S}\bigl(P_{i}^{(\ell)}-N_{i}^{(\ell)}\bigr), (1) so that x^{(\ell)} points from non-altruistic to altruistic activations. For Qwen 2.5-7B ( \ell\in\{1,\dots,28\} ), we focus on layer 20, which produced stable and interpretable effects—consistent with findings that later layers contain more crystallized representations amenable to steering ( 4 ) . Our workflow is summarized in Fig. 1 . 3.3 Game Suite We evaluate on six canonical games involving distributional or cooperative choices (Table 1 ). In each, the model plays as Agent 1 and faces a clear numeric or binary decision. Each game prompt concludes with a concrete decision question (e.g., “How many dollars will you give to Agent 2?”). We ask the model for its decision and a brief justification. Game Action Space Description Dictator $0–100 to give A1 receives $100 and chooses how much to give to A2, who makes no decision. Trust $0–100 to send A1 sends an amount to A2; it is tripled. A2 decides how much to return. Ultimatum $0–100 to offer A1 proposes a split of $100. A2 accepts or rejects (both get $0). Overfishing 0–100 fish Both agents simultaneously harvest from a shared lake; if total > 100, the stock collapses. Prisoner’s Dilemma Cooperate / Defect Simultaneous choice; mutual cooperation pays moderately, mutual defection pays zero. Apology $0–100 to transfer A1 previously caused A2 to lose $100. A1 now chooses reparations. Table 1: Game suite used for altruism evaluation. A1/A2 denote Agent 1 and Agent 2. 3.4 Measurement We measure the effect of persona vectors using three complementary methods that capture different aspects of model behavior. • LLM-rated trait expression. Following the procedure used to construct persona vectors, we prompt GPT-4.1-mini to rate each model response from 0 to 100 based on how strongly it expresses the target trait. • Activation projection. For each trial, we extract the hidden activation a^{(20)} at layer 20 (averaged across response tokens) and compute its projection onto the persona vector: s_{\text{trait}}\;=\;\langle

Read the complete text