Spotting Out-of-Character Behavior: Atomic-Level Evaluation of Persona Fidelity in Open-Ended Generation
Jisu Shin Juhyun Oh Eunsu Kim Hoyun Song Alice Oh · 2025
Read Spotting Out-of-Character Behavior: Atomic-Level Evaluation of Persona Fidelity in Open-Ended Generation by Jisu Shin Juhyun Oh Eunsu Kim Hoyun Song Alice Oh (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2506-19352.txt.
Introduction
Jisu Shin, Juhyun Oh, Eunsu Kim, Hoyun Song, and Alice Oh grade chatbots on staying in character, sentence by sentence. A model handed a persona often slips out of it mid-answer, and whole-reply scores blur exactly where the slip happened. Their atomic-level framework inspects small units of open-ended text instead. Three metrics track alignment and consistency inside one reply and across several.
The finer lens caught persona breaks that older scoring missed entirely. Tests across tasks and personality types showed that task shape and how likable a persona is both sway a model's grip. Staying in character, it turns out, is uneven work.
Catalog record
| CREATOR | Jisu Shin Juhyun Oh Eunsu Kim Hoyun Song Alice Oh |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 94 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2506-19352
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Spotting Out-of-Character Behavior: Atomic-Level Evaluation of Persona Fidelity in Open-Ended Generation Jisu Shin Juhyun Oh Eunsu Kim Hoyun Song Alice Oh Abstract Ensuring persona fidelity in large language models (LLMs) is essential for maintaining coherent and engaging human-AI interactions. However, LLMs often exhibit Out-of-Character (OOC) behavior, where generated responses deviate from an assigned persona, leading to inconsistencies that affect model reliability. Existing evaluation methods typically assign single scores to entire responses, struggling to capture subtle persona misalignment, particularly in long-form text generation. To address this limitation, we propose an atomic-level evaluation framework that quantifies persona fidelity at a finer granularity. Our three key metrics ( ACC atom \text{ACC}_{\text{atom}} , IC atom \text{IC}_{\text{atom}} , and RC atom \text{RC}_{\text{atom}} ) measure the degree of persona alignment and consistency within and across generations. Our approach enables a more precise and realistic assessment of persona fidelity by identifying subtle deviations that real users would encounter. Through our experiments, we demonstrate that our framework effectively detects persona inconsistencies that prior methods overlook. By analyzing persona fidelity across diverse tasks and personality types, we reveal how task structure and persona desirability influence model adaptability, highlighting challenges in maintaining consistent persona expression. 1 Introduction Instruction You are [gray!30]neither extrovert nor introvert. Write an essay about today. Responses Gen A : [gray!30]Today was just another day. [gray!30]Had coffee in the morning, finished some work, and took a short walk. [gray!30]Talked to a few people, nothing too exciting. [gray!30]Spent the evening reading and watching a show. [gray!30]Nothing special, nothing bad—just steady, like most days. [gray!30]Maybe tomorrow will bring something different. Gen B : [blue!20]Today was amazing! Morning coffee with friends was fun, [red!10]but honestly, a bit draining. [blue!20]Brainstorming was exciting—I love bouncing ideas around! [red!10]Then suddenly, I just wanted to be alone. Read a book, felt peaceful. [red!10]Later, friends called me out, and I went… but maybe I should’ve stayed home instead. Overall Assessment Prev.: “Both Gen A and Gen B are on average.” Ours: “ Gen A is but Gen B is mixed of and .” Persona : [red!10]Introvert( )-[gray!30]Neutral( )-[blue!20]Extrovert( ) Table 1: Generation examples from GPT-4o assigned “ neither extrovert nor introvert ( )” persona. Previous evaluation treats both as equivalent, but ours distinguishes them, revealing Out-of-Character behavior. Assigning personas to large language models (LLMs) is essential for realistic and engaging human-AI interactions. The ability of LLMs to generate long-form text enables them to engage in complex interactions, such as dialogues Zhang et al. 2018 ; Lee et al. 2022 , role-playing Park et al. 2023 ; Shao et al. 2023 , narrative generation Malik et al. 2024 , and social simulation Argyle et al. 2023 ; Ge et al. 2024 ; Hu and Collier 2024 . However, ensuring consistent persona adherence in these complex interactions remains challenging, as even subtle inconsistencies can affect user perception and model reliability. One key challenge is Out-of-Character (OOC) behavior, where models deviate from their assigned persona. In the real world or fictional contexts, OOC behavior disrupts immersion, such as a well-known character acting against their established traits 1 1 1 For example, in ¡Harry Potter¿ , Voldemort genuinely apologizing to humanity, or Hermione Granger skipping a class. . Similarly, LLMs can inconsistently express personas, leading to confusion. Table 1 illustrates this issue: while Gen A maintains a balanced persona (a person who is neither extrovert nor introvert), Gen B fluctuates between extroverted and introverted tendencies, demonstrating persona misalignment. Therefore, detecting such misalignment and inconsistencies is essential for ensuring high persona fidelity in LLMs. Existing studies have focused on assessing persona fidelity at the response level, assigning a single score or representation to the entire generated text Wang et al. 2024 ; Wright et al. 2024 . While these approaches provide a general overview of persona adherence, they often struggle to capture the nuances of persona expression, especially in long-form text. As shown in Table 1 , different generations may receive similar scores under previous evaluations despite varying degrees of persona alignment and consistency, underscoring the need for a more fine-grained evaluation approach. To address this limitation, we propose an atomic-level evaluation framework that quantifies persona fidelity at a finer granularity. Unlike previous approaches, our framework identifies OOC behaviors at the atomic level, providing a more precise measure of persona alignment. By analyzing small textual units, we offer deeper insights into how well LLMs maintain their assigned personas throughout a response. We introduce three key metrics to assess multiple aspects of persona fidelity. \text{ACC}_{\text{atom}} measures persona alignment, detecting off-character sentences within a response. \text{IC}_{\text{atom}} and \text{RC}_{\text{atom}} assess intra- and inter-generation consistency, capturing fluctuations in persona expression. Our study focuses on personality-based personas, examining how well models maintain assigned personality traits in diverse open-ended generation tasks. Through experiments, we demonstrate that our framework identifies subtle persona misalignment better than previous methods. By analyzing persona fidelity across different tasks and persona types, we underscore the behavior of persona-assigned models under varying conditions. Our contributions are as follows: • This study is the first to explore subtle OOC behavior in persona-assigned LLMs during open-ended text generation, where deviations from the expected persona can undermine user trust and model reliability. • We propose a fine-grained evaluation framework with three atomic-level metrics— \text{ACC}_{\text{atom}} , \text{IC}_{\text{atom}} , and \text{RC}_{\text{atom}} —to capture subtle persona misalignment and enable a more precise measurement of persona fidelity. • Our experiments demonstrate the effectiveness of our framework in assessing persona fidelity across diverse conditions, emphasizing the challenges in maintaining persona fidelity in each of these contexts. 2 Related Work Persona-Assigned LLM The effects of persona on LLMs have been studied in many tasks, such as dialogue Zhang et al. 2018 ; Wan et al. 2023 , reasoning Kong et al. 2024 ; Gupta et al. 2024 ; Salewski et al. 2024 , and LLM safety tasks Deshpande et al. 2023 ; Ko et al. 2024 . For subjective tasks, the persona-assigned LLMs have been analyzed to identify their opinions on personality Safdari et al. 2023 ; Jiang et al. 2024a , social value Miotto et al. 2022 ; Durmus et al. 2023 , political orientation Feng et al. 2023 ; Liu et al. 2024 , and moral decision-making Benkler et al. 2023 ; Rao et al. 2023 ; Scherrer et al. 2024 , as well as to investigate which groups these opinions aligned with Santurkar et al. 2023 ; Hwang et al. 2023 ; Sun et al. 2023 . Persona alignment in subjective tasks is crucial for pluralism, enabling models to represent and speak for diverse individuals fairly and inclusively Sorensen et al. 2024 . Persona Fidelity Evaluation The desire to ensure that models assigned a persona accurately reproduce and simulate the given persona has driven research into persona fidelity measurement Argyle et al. 2023 . While early evaluations focused on whether the average measured personality traits aligned with the given persona Jiang et al. 2024a , more recent work has expanded to assess the consistency of measured personality across various settings Shu et al. 2024 ; Wang et al. 2024 . Previous research has often identified inconsistencies in large language models (LLMs) when exposed to spurious variations in prompt format (e.g., colons, sentence endings, order bias) Shu et al. 2024