Dissecting Persona-Driven Reasoning in Language Models via Activation Patching
Ansh Poonia, Maeghal Jain · 2025
Read Dissecting Persona-Driven Reasoning in Language Models via Activation Patching by Ansh Poonia, Maeghal Jain (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2507-20936.txt.
Introduction
Ansh Poonia and Maeghal Jain published a computing paper in 2025 on how giving a language model a persona changes its reasoning. Models can adopt many personas with ease. The team asked how a persona shapes work on an objective task. They used a method called activation patching, which swaps inner signals between runs to find which parts carry the persona effect.
Early layers of the model handled both the form of the input and its meaning. They turned persona tokens into richer forms, which middle attention layers then used to shape the output. The study also found certain attention heads that focus heavily on racial and color-based identities. The authors frame this as a first step toward reading persona effects inside models.
Catalog record
| CREATOR | Ansh Poonia, Maeghal Jain |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 22 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2507-20936
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Dissecting Persona-Driven Reasoning in Language Models via Activation Patching Ansh Poonia, Maeghal Jain Abstract Large language models (LLMs) exhibit remarkable versatility in adopting diverse personas. In this study, we examine how assigning a persona influences a model’s reasoning on an objective task. Using activation patching, we take a first step toward understanding how key components of the model encode persona-specific information. Our findings reveal that the early Multi-Layer Perceptron (MLP) layers attend not only to the syntactic structure of the input but also process its semantic content. These layers transform persona tokens into richer representations, which are then used by the middle Multi-Head Attention (MHA) layers to shape the model’s output. Additionally, we identify specific attention heads that disproportionately attend to racial and color-based identities. 1 Introduction Recent advances in large language models (LLMs) have demonstrated their striking ability to adopt a wide range of personas, enabling context-sensitive and tailored responses ( Zhang et al. 2024 , Joshi et al. 2024 , Sun et al. 2025 ). However, studies such as those by Salewski et al. 2023 , Deshpande et al. 2023 , Gupta et al. 2024 , Zheng et al. 2024 show that persona assignment can significantly influence reasoning and, in some cases, amplify underlying social biases. While these works focus on identifying and quantifying such effects, they do not examine the causal mechanisms within a pre-trained language model (PLM) that give rise to them. In this study, we take a step toward bridging that gap by investigating the roles of key model components—namely, the MLP layers, MHA layers, and individual attention heads—in shaping the variation in reasoning induced by persona assignments. Using activation patching, we probe the internal circuitry of LLMs to trace the origins of persona-driven variation in objective tasks. Our findings challenge the prevailing assumption that early MLP layers are concerned solely with syntactic processing. We show that these layers also encode semantic features related to persona. Furthermore, we identify a small number of attention heads that disproportionately focus on tokens associated with race-based persona cues. Although our work is limited to uncovering the origin of persona-driven behavior, it contributes to a deeper understanding of LLMs and lays groundwork for future efforts to mitigate deep-seated biases in these systems. 2 Experimental Setup 2.1 Dataset Details We chose the MMLU dataset ( Hendrycks et al. 2021 ) for this study, which contains 14,024 multiple-choice questions spanning 57 subjects. We selected this dataset for two main reasons. First, the objective, multiple-choice format allowed us to focus on a fixed set of four answer tokens, giving us a well-defined target. Second, the wide range of subject areas helped reduce domain-specific or persona-driven biases. The identities or personas we examined in our study fall into four broad categories: racial identities, color-based identities, and identities defined by positive or negative attributes; details of each can be found in the Appendix A . To maintain consistency and minimize variance, we used "student" as a gender-neutral subject across all defined identities. For instance: "Asian student", "white student", "good student", etc. 2.2 Model and Prompt We use the LLaMA 3.2 1B Instruct model ( Meta 2024b ) due to computational constraints. Its compact size makes it well-suited for efficient experimentation, while still delivering strong performance relative to other open-source models in its class. Our methods are scalable and can be extended to larger models with sufficient computational resources and minor adjustments. The Instruct variant of the LLaMA family also permits the use of system prompts 1 1 1 System prompts are instructions given to the AI before any user input. They define the AI’s behavior, role, and response style throughout an interaction. , allowing us to specify the identity the model should adopt in its responses. A standard system prompt serves as the base for each question, enabling identity shifts by modifying only two tokens in the entire prompt—just one token distinguishes each identity. We used the prompt structure defined by Meta for MMLU dataset ( Meta 2024a ) , with the addition of the system prompt, see Appendix B . 3 Persona Evaluation We computed model outputs using zero-shot prompts to isolate the variation introduced solely by changes in the persona token, avoiding any influence from patterns introduced by few-shot prompting. This also reduced the length of each prompt, allowing for faster computation. For each prompt, we calculated the probability of the next token, which, by design, corresponds to the selected answer for the given question. This process was repeated for all 16 identities, and also the base identity. Our main focus is the change in the probability of the correct token for each persona relative to the base identity, as shown in Figure 1 . This highlights shifts in reasoning attributable to persona alone. In some cases, the differences in probability followed patterns that appeared to have a semantic basis. For instance, the negatively attributed student persona performed significantly worse than those described with positive attributes, having an average probability difference of -0.0045 (T = 14.36, p < 0.001). In contrast, the results for racially or color-coded personas were less consistent, and no definitive conclusion could be drawn about whether the patterns reflect stereotypical associations. A similar trend was observed when examining accuracy across identities, see Appendix C for details. Overall, our results suggest that the model’s reasoning ability varies even with minimal changes to the persona being imitated. Figure 1: Average difference in the probability of the correct token for each identity, relative to the base prompt. MLP layer patching MHA layer patching Figure 2: Relative logit difference ( \Delta_{r} ) when MLP layer (left) and MHA layer (right) is patched. Accompanying bar chart shows the average \Delta_{r} across identity pairs. 4 Interpretability Investigation 4.1 Methods We focus on activation patching, also referred to as Resample Ablation, or Causal Mediation Analysis ( Vig et al. 2020 , Meng et al. 2022 ), to understand the influence of individual components on the model’s selection of the correct answer. Specifically, we employ "de-noising" variant of activation patching, where the activation of a component from a corrupted run is replaced with the corresponding activation from a clean run ( Heimersheim and Nanda 2024 ) . The clean and corrupted inputs are constructed using Symmetric Token Replacement, a technique in which only one or a few tokens are altered ( Meng et al. 2022 , Wang et al. 2023 ). This approach doesn’t throw the model’s internal state out-of-distribution and preserves the syntactic structure of the input ( Zhang and Nanda 2024 ) . For each experiment, we select a pair of personas to generate the clean (ID1) and corrupted (ID2) prompts. A total of ten persona pairs were chosen keeping computational constraints in mind; details are provided in the Appendix D . Care was taken to balance pairings identities both within and across categories to ensure reliable results. Pairings with a base identity were also included for comparison. For each pair, we divide the full set of questions into four subsets, Appendix E . From these, we select the subset in which the first persona (ID1) answers correctly while the second persona (ID2) answers incorrectly. In each such pair of prompts, the only difference