IMPersona: Evaluating Individual Level LM Impersonation
Quan Shi, Carlos E. Jimenez, Stephen Dong, Brian Seo · 2025
Read IMPersona: Evaluating Individual Level LM Impersonation by Quan Shi, Carlos E. Jimenez, Stephen Dong, Brian Seo (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2504-04332.txt.
Introduction
Quan Shi and co-authors build IMPersona in 2025, a test for how well language models impersonate real people. A model that copies one person's style and private knowledge raises privacy and security stakes. Their framework scores both style mimicry and personal fact recall.
Fine-tuning plus a layered memory retrieval system let a modest open model impersonate at worrying strength. In blind chats, people mistook the tuned model for the real human in over four in ten talks. The best prompting-only method fooled people far less often. The authors propose detection and defense ideas, and press for care in deploying personalized models.
Catalog record
| CREATOR | Quan Shi, Carlos E. Jimenez, Stephen Dong, Brian Seo |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 49 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2504-04332
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
IMPersona: Evaluating Individual Level LM Impersonation Quan Shi, Carlos E. Jimenez, Stephen Dong, Brian Seo Abstract As language models achieve increasingly human-like capabilities in conversational text generation, a critical question emerges: to what extent can these systems simulate the characteristics of specific individuals? To evaluate this, we introduce IMPersona, a framework for evaluating LMs at impersonating specific individuals’ writing style and personal knowledge. Using supervised fine-tuning and a hierarchical memory-inspired retrieval system, we demonstrate that even modestly sized open-source models, such as Llama-3.1-8B-Instruct, can achieve impersonation abilities at concerning levels. In blind conversation experiments, participants (mis)identified our fine-tuned models, with memory augmentation, in 44.44% of interactions, compared to just 25.00% for the best prompting-based approach. We analyze these results to propose detection methods and defense strategies against such impersonation attempts. Our findings raise important questions about both the potential applications and risks of personalized language models, particularly regarding privacy, security, and the ethical deployment of such technologies in real-world contexts. 1 Introduction * * footnotetext: Code, data, examples: https://impersona-website.vercel.app/ . State-of-the-art language models (LMs) have rapidly advanced in their ability to pass conventional Turing tests ( Oppy & Dowe, 2021 ) by mimicking human behavior ( Jones & Bergen, 2024a ) . As these models become more sophisticated, a particularly concerning question emerges: can these models convincingly impersonate specific individuals, even to people who know them well? This capability raises large implications. While it could enable malicious applications like sophisticated social engineering attacks, identity theft, or targeted misinformation campaigns, it also presents opportunities for beneficial use cases in areas such as cybersecurity testing, educational simulations, and therapeutic applications ( Wang et al., 2025a ; Bommasani et al., 2021 ) . Understanding these models’ capacity for individual impersonation is therefore crucial for both protecting against potential misuse and responsibly developing beneficial applications. Creating convincing impersonations presents significant challenges across two key dimensions. Stylistically, models must replicate an individual’s communication patterns, which often vary depending on the conversation partner, topic, and context: including humor, sarcasm, formality shifts, and other pragmatic features signaling authenticity ( Lee et al., 2024 ) . Contextually, models must not only access relevant personal knowledge but also respect its boundaries, avoiding expertise on topics the impersonated individual would lack knowledge of, while demonstrating appropriate depth on subjects within their domain of expertise. While recent research has explored generative agents simulating human individual decision-making and conversation ( Park et al., 2023 ; Park et al., 2024 ; Lan et al., 2023 ; Zhou et al., 2023 ) , these approaches fall short of capturing this full spectrum of communication, as they primarily address interactions in more constrained environments or focus on closed-ended questions that lack the pragmatic gaps characteristic of genuine human dialogue. We introduce IMPersona, a framework for evaluating and developing personalized language models through prompting, fine-tuning, and a novel hierarchical memory architecture. Our evaluation adapts the ”Human or Not?” game ( Jannai et al., 2023 ) , where participants with varying familiarity levels engage in 3 -minute conversations with different IMPersona configurations before rating their authenticity. We hand-craft conversational prompts testing contextual personal knowledge (e.g., ”what’s your favorite vacation”) and stylistic mimicry (e.g., ”debate on pineapple on pizza”) to assess performance across both dimensions. Our study included 114 participants evaluating 12 different IMPersonas. We find that fine-tuned models with memory integration can achieve significant success in mimicking individual communication patterns: our best configuration achieves a 44.44% pass rate compared to just 25.00% for the best prompting based model. For context, Jones & Bergen (2024a) reported that Llama-3.1-405B was identified as human 56% of the time in a general Turing test where participants simply distinguished between human and non-human authorship rather than specific individuals. Particularly notable was the minimal data required for effective impersonation: models fine-tuned on only 500 examples could exceed the performance of state-of-the-art prompted models. Even participants with close personal relationships to the impersonated individuals (such as family) were susceptible to deception. We additionally outline qualitative failure modes and successful antagonistic detection methods that consistently expose impersonation attempts across different model configurations and contexts. Figure 1: Model performance across different configurations. Pass rate indicates % of conversations where participants identified the model as human, while humanness rating (1-7), where 7 represents most human-like, reflects participants’ confidence in their human/AI assessment. Blue bars indicate prompted models, orange/red bars indicate finetuned models. More details in Section 5 . Our findings demonstrate both the capabilities and limitations of current LM-based impersonation techniques, while highlighting crucial directions for future research. The success of our minimal-data approach in achieving convincing impersonation raises immediate concerns about potential misuse, particularly given the low computational requirements (less than $ 5 of compute on together.ai) and the abundance of public personal data available through social media and online platforms. Of particular concern, we found that all tested models readily agreed to engage in deceptive impersonation scenarios when prompted, including fabricating emergency situations to solicit money. While these technologies could enable beneficial applications in education, historical preservation, and automated testing environments, their potential for enabling sophisticated social engineering attacks and targeted misinformation campaigns cannot be ignored. The remainder of this paper details our methodology, presents comprehensive experimental results, and discusses specific implications for security and ethics in the age of increasingly sophisticated language models. 2 Related Work Turing Test with LMs Significant research has been conducted in the domain of Turing tests ( Sejnowski, 2023 ) , which evaluate whether humans can distinguish between human-generated and AI-generated content. Studies by Jones & Bergen (2024a) ; Wu et al. (2024) ; Jones & Bergen (2024b) show GPT-4 approaches but may not match human performance in standard tests. Jannai et al. (2023) implemented a large-scale in-the-wild study revealing diverse identification strategies between randomly matched players and models, tasked with identifying each other’s nature. Our methodology differs in two ways: we focus on distinguishing between specific individuals rather than general human-AI differences, and we employ multi-turn dialogues instead of questionnaires, creating a more realistic environment where humans can interact freely with IMPersonas. Role Playing/Persona LMs Previous work has explored AI role playing as specific entities, and evaluated its successes and dangers ( Deshpande et al., 2023 ; Zhao et al., 2025 ; Liu et al., 2023 ) . Park et al. (2023) ; Wang et al. (2025b) creates generative agents in simulated societies, while Park et al. (2024) ; Gui & Toubia (2023) evaluates LMs’ ability to replicate individuals’ opinions from interview data. Xu et al. (2024a) used LMs for professional roles in software companies, Wu et al. (2023) had LMs function as doctors through prompting, and Xu et al. (2024b) assessed LMs’ capacity to emulate literary characters’ decision-making. Our research extends this by having LMs imitate specific individuals, including their memories and speech patterns. Unlike prior prompt-based approaches, we show the efficacy of fine-tuning combined with memory inspired retrieval systems. Episodic Memory for LMs Our memory module builds upon episodic memory systems ( Shinn et al., 2023 ; Zhang et al., 2024 ; Pink et al., 2025 ) for agents. ( Sumers et al., 2023 ) outlines memory types for cognitive agents, including episodic memory. Related approaches include ( Wang et al., 2024 ) , which stores