PersonaTwin: A Multi-Tier Prompt Conditioning Framework for Generating and Evaluating Personalized Digital Twins

Sihan Chen, John P. Lalor, Yi Yang, Ahmed Abbasi · 2025

Read PersonaTwin: A Multi-Tier Prompt Conditioning Framework for Generating and Evaluating Personalized Digital Twins by Sihan Chen, John P. Lalor, Yi Yang, Ahmed Abbasi (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2508-10906.txt.

Introduction

Sihan Chen, John Lalor, Yi Yang, and Ahmed Abbasi present PersonaTwin, a method for building digital twins of individual people with large language models. Their paper came out in 2025. A digital twin here is a model that answers in the style of one real person.

The method layers three kinds of information into the prompt. It uses basic facts about the person, records of past behavior, and survey measures of personality and mood. Tests used health data from more than eight thousand people. Twins built this way matched the fidelity of best-case settings. Models trained on twin answers came close to models trained on the real people, on both accuracy and fairness.

Catalog record

CREATORSihan Chen, John P. Lalor, Yi Yang, Ahmed Abbasi
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE48 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2508-10906

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

PersonaTwin: A Multi-Tier Prompt Conditioning Framework for Generating and Evaluating Personalized Digital Twins Sihan Chen, John P. Lalor, Yi Yang, Ahmed Abbasi Abstract While large language models (LLMs) afford new possibilities for user modeling and approximation of human behaviors, they often fail to capture the multidimensional nuances of individual users. In this work, we introduce PersonaTwin , a multi-tier prompt conditioning framework that builds adaptive digital twins by integrating demographic, behavioral, and psychometric data. Using a comprehensive data set in the healthcare context of more than 8,500 individuals, we systematically benchmark PersonaTwin against standard LLM outputs, and our rigorous evaluation unites state-of-the-art text similarity metrics with dedicated demographic parity assessments, ensuring that generated responses remain accurate and unbiased. Experimental results show that our framework produces simulation fidelity on par with oracle settings. Moreover, downstream models trained on persona-twins approximate models trained on individuals in terms of prediction and fairness metrics across both GPT-4o-based and Llama-based models. Together, these findings underscore the potential for LLM digital twin-based approaches in producing realistic and emotionally nuanced user simulations, offering a powerful tool for personalized digital user modeling and behavior analysis. 1 Introduction Large language models (LLMs) present exciting opportunities for user modeling, behavior analysis, and understanding and improving the human condition. Opportunities abound across an array of contexts including healthcare, education, etc. For instance, a pressing healthcare challenge is the development of conversational systems that truly account for the nuanced experiences and identities of individual patients Davenport and Kalakota 2019 ; Jiang et al. 2017 . In telemedicine or mental health coaching scenarios, clinicians require tools that adapt dynamically to each patient’s demographic, behavioral, and psychological profile, rather than offering generic responses. Although large language models such as GPT-4 Achiam et al. 2023 and Llama-3-70b Dubey et al. 2024 have shown substantial improvement in natural language processing tasks–demonstrated by benchmarks in medical QA datasets, automated note taking, and patient triage use cases–they still struggle to model the multifaceted nature of personal identity in real world settings Laranjo et al. 2018 . Numerous persona-based conversational frameworks have begun to address this gap by incorporating basic user attributes into language models, and studies have demonstrated modest gains in engagement and trust when even minimal demographic cues are included Abuelezz et al. 2024 . However, many of these frameworks remain limited by static or simplistic representations that fail to capture evolving factors. In the health setting, for instance, these frameworks fail to represent health behaviors over time, emotional states during stressful events, and shifting attitudes toward medical professionals Huang et al. 2024 ; Guo and Chen 2024 . To overcome these limitations, we draw on the concept of digital twins, originally popularized in engineering, to represent physical systems virtually Grieves 2014 . In our adaptation, a “digital twin” for conversational AI is a virtual replica of a user (e.g., a patient) that encapsulates not only demographic information (e.g., age, gender, and socioeconomic status), but also behavioral data (e.g., physical activity, dialogue habits, and compliance with medications), along with psychological attributes (e.g., anxiety levels, trust, and perceived literacy) Meijer et al. 2023 ; Lukaniszyn et al. 2024 . This framework is particularly relevant in scenarios such as mental health chatbots or chronic disease management systems, where the emotional and psychological realism of the dialogue can directly impact patient adherence and satisfaction. However, creating such multidimensional and adaptive representations raises several methodological hurdles. First, many existing language-based approaches provide only a narrow view of a user’s identity, focusing predominantly on stylistic or linguistic features while neglecting deeper demographic or psychometric attributes. Second, static systems do not adapt to shifting contexts, including new symptoms or a gradual erosion of trust, resulting in repetitive or misaligned conversations. Third, there is a lack of comprehensive evaluation benchmarks that jointly measure factual correctness, emotional coherence, and alignment with actual user expressions. For instance, in clinical contexts, much of the previous NLP work has focused on factual accuracy, leaving emotional nuance and user alignment underexplored Jiang et al. 2017 . To address these challenges, we introduce PersonaTwin , a multi-tier prompt conditioning framework that systematically integrates demographic, behavioral, and psychological data into a comprehensive digital twin. Our approach employs a structured methodology in which each level of user information is processed and encoded into the model prompt Lester et al. 2021 ; Chen et al. 2024 . PersonaTwin consists of two parts, Multi-tiered Conditioning for Digital Twin Creation and Conversation Update Loop . In the first part, step 1 involves mapping person-level persona metadata to persona information tiers such as demographics, behavioral, and psychological information; whereas step 2 initializes the digital twin. In the second part, the instantiated digital twin is iteratively updated with the real person’s previous conversational responses to psychometric questions (e.g., related to numeracy, anxiety, etc.). This layered technique enables the model to produce simulated dialogues that are not only contextually relevant but also capable of reflecting shifting user states as new data are introduced Reimers and Gurevych 2019 . We tested our framework using a large-scale psychometric dataset of more than 8,500 respondents Abbasi et al. 2021 , which provides a rich combination of survey-based measures, user-generated text, and demographic information. By incorporating real responses on health numeracy, medical visit anxiety, and trust in healthcare providers, we ensure that our simulations reflect authentic user experiences while maintaining privacy through deidentification and ethical safeguards Cascella et al. 2023 . To rigorously evaluate PersonaTwin , we implemented a dual-pronged strategy. First, we employ state-of-the-art text similarity metrics to measure how closely the digital twin-generated output matches the actual user responses Reimers and Gurevych 2019 ; Song et al. 2020 ; Wang et al. 2020 . Second, we use a downstream NLP prediction task to examine the efficacy of the generated twins, relative to the actual users, in terms of the fine-tuned model’s predictive performance and fairness assessments across key demographic dimensions Hardt et al. 2016 ; Barocas et al. 2023 . Our key contributions are: (i) we introduce PersonaTwin , a multi-tier framework that integrates demographic, behavioral, and psychological data to generate adaptive digital twins, enhancing realism with LLM-driven personal insights, (ii) we generate 8,500+ digital twins representing diverse personas and validate response fidelity using conditioned experiments and advanced similarity metrics, and (iii) we conduct a rigorous downstream evaluation of models trained/tested on generated personas versus actual users and show that the persona-based models achieve comparable predictive power and fairness outcomes. 1 1 1 Our code is available on GitHub: https://github.com/nd-hal/psych-agent-llm . 2 Related Work 2.1 Simulative Persona Construction and the Importance of Digital Twins A pioneering study by Park et al. 2023 laid the groundwork for persona-based conversational systems by simulating a small town of 25 virtual characters using simplified models of human cognition to enable dialogue. Recent advances in generative agents have begun to explore the ability of LLMs to emulate more precise human behaviors. For instance, Park et al. 2024 simulate survey responses for 1,000 individuals based on audio interviews with participants. Similarly, Xu et al. 2024 benchmark LLM agents on consequential real-world tasks. In parallel, Chuang et al. 2024 develop digital twins using a belief network to capture open-domain dimensions–such as those revealed in the Controversial Beliefs

Read the complete text