Creating and Evaluating Personas Using Generative AI: A Scoping Review of 81 Articles
Danial Amin, Joni Salminen, Farhan Ahmed, Sonja M.H. Tervola, Sankalp Sethi, Bernard J. Jansen · 2025
Read Creating and Evaluating Personas Using Generative AI: A Scoping Review of 81 Articles by Danial Amin, Joni Salminen, Farhan Ahmed, Sonja M.H. Tervola, Sankalp Sethi, Bernard J. Jansen (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2504-04927.txt.
Introduction
Personas — fictional user profiles that guide design — are increasingly written by generative AI rather than researchers. Danial Amin and co-authors reviewed 81 articles from 2022 to 2025 in 2025 to see how the field uses these tools for creating, testing, and applying them.
Sharing looked decent: 61 percent of articles shared personas, code, or data, and chat-style persona interfaces increasingly accompany static profiles. The gaps were evaluation and variety — 45 percent of articles never evaluated their profiles at all, and 86 percent relied only on GPT models. In some studies the same model both generated and judged the output, a circular setup. The authors also note that AI shrinks the human developer's role. They close with practical guidelines for using these tools in persona work responsibly.
Catalog record
| CREATOR | Danial Amin, Joni Salminen, Farhan Ahmed, Sonja M.H. Tervola, Sankalp Sethi, Bernard J. Jansen |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 111 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2504-04927
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Creating and Evaluating Personas Using Generative AI: A Scoping Review of 81 Articles Danial Amin, Joni Salminen, Farhan Ahmed, Sonja M.H. Tervola, Sankalp Sethi, Bernard J. Jansen Abstract . As generative AI (GenAI) is increasingly applied in persona development to represent real users, understanding the implications and limitations of this technology is essential for establishing robust practices. This scoping review analyzes how 81 articles (2022-2025) use GenAI techniques for the creation, evaluation, and application of personas. The articles exhibited good level of reproducibility, with 61% of articles sharing resources (personas, code, or datasets). Furthermore, conversational persona interfaces are increasingly provided alongside traditional profiles. However, nearly half (45%) of the articles lack evaluation, and the majority (86%) use only GPT models. In some articles, GenAI use creates a risk of circularity, in which the same GenAI model both generates and evaluates outputs. Our findings also suggest that GenAI seems to reduce the role of human developers in the persona-creation process. To mitigate the associated risks, we propose actionable guidelines for the responsible integration of GenAI into persona development. Conference: Proceedings of the 2026 CHI Conference on Human Factors in Computing Systems; April 13–17, 2026; Barcelona, Spain Proceedings of the 2026 CHI Conference on Human Factors in Computing Systems (CHI ’26), April 13–17, 2026, Barcelona, Spain DOI: 10.1145/3772318.3790608 ISBN: 979-8-4007-2278-3/2026/04 CCS: Human-centered computing HCI theory, concepts and models CCS: Human-centered computing User models † † cc-license: by 1. Introduction User personas (‘personas’ for short) are fictitious characters representing archetypal real users of a system, product, or service presented in a humanized form ( Cooper, 1999 ) . Since their introduction into human-computer interaction (HCI), personas have been adopted to support user-centered design (UCD) in domains such as software development ( Blomquist and Arvola, 2002 ; Aoyama, 2005 ; Adlin et al., 2001 ) , design ( Lee et al., 2010 ; Duda, 2018 ; Chen et al., 2011 ) , and healthcare ( Hendriks et al., 2013 ; Högberg et al., 2008 ; Gonzalez de Heredia et al., 2018 ) . Personas help system designers focus on user needs throughout the design process by providing empathetic and memorable representations of core user segments ( Pruitt and Adlin, 2010 ) . As such, personas are a critical component of HCI research, user experience (UX) studies, and UCD of systems and technology. Persona development methods were originally based on qualitative data collection with manual analysis, which can be time-consuming, resource-intensive, and prone to staling ( Salminen et al., 2021 ) . However, generative artificial intelligence (GenAI), particularly large language models (LLMs), creates opportunities for automating persona development ( Huang et al., 2024 ; Shin et al., 2024 ; Jung et al., 2025 ) . Automatic persona development is the ability to generate personas without (or minimal) human involvement and can overcome the challenges of manual persona development. This is why GenAI is being researched to support persona development. These GenAI technologies can be applied to various stages of persona development, and the personas created by such a process are called GenAI personas, which will be the focus of this study (see Figure 1 for examples). Although various articles have applied GenAI in persona development ( Salminen et al., 2024a ; Shin et al., 2024 ; Schuller et al., 2024 ; Jung et al., 2025 ) , there is limited systematic synthesis of how GenAI technologies are applied in persona development practices. This lack of knowledge raises serious questions for the HCI community regarding the use of GenAI for persona creation. (a) (b) Figure 1 . Examples of GenAI personas. The persona in (a) is generated by Survey2Persona ( Jung et al., 2025 ) , (b) is generated by Persona-L ( Sun et al., 2025 ) . These systems illustrate that LLMs are increasingly used for generating persona profiles, but also to afford decision-makers access to dialogue with the personas. The figures are annotated to explain different components of GenAI personas. The reader is encouraged to zoom in for better readability. Two AI-generated persona examples. Panel A shows a persona profile for a young woman named after Survey2Persona system, displaying demographic information, personality traits, and behavioral characteristics in a structured format with percentages and data visualizations. Panel B shows a Persona-L generated interface featuring a professional woman's profile with chat functionality, demonstrating how LLMs enable both persona profiles and dialogue access for decision-makers. Moreover, the application of GenAI in persona development suffers from a lack of standardization and best practices, there is yet no clear consensus on optimal approaches. The application of GenAI in persona development is currently uncharted territory, making it difficult for persona developers to make informed decisions about adopting GenAI technologies. The evolution of GenAI technologies has also increased the challenges faced by persona developers, as discussed in detail by Amin et al. ( Amin et al., 2025 ) . Similar to the development of data-driven personas (see a review ( Salminen et al., 2021 ) ), we can observe varying methodological choices and technical implementations. These choices involve a variety of factors, such as the selection of LLM family (e.g., GPT or Claude or Llama), versions of LLMs (e.g., GPT 3.5 or GPT 4.0), hyperparameters (i.e., parameters that impact the behavior of the model ( Jansen et al., 2021c ) ), and prompts (i.e., instructions given to the LLM to perform certain tasks). Although researchers have suggested guidelines for persona development in general ( Häyhänen et al., 2025 ; Jansen et al., 2021a ; Cooper, 1999 ; Nielsen et al., 2015 ; Pruitt and Grudin, 2003 ) , how researchers specifically use GenAI in persona development remains unclear. Another domain that is prone to challenges is the evaluation of GenAI personas. Traditional persona validation methods generally focused on user perceptions of personas ( Jansen et al., 2021b ; Salminen et al., 2020b ) , but GenAI personas require additional consideration of factors, such as output consistency, prevention of hallucinations (the ability of LLMs to fabricate information), and prompt reliability ( Sattele and Carlos Ortiz, 2024 ; Lazik et al., 2025 ) . Moreover, integrating GenAI raises questions about evaluating the quality of GenAI-crafted versus human-crafted personas ( Amin et al., 2025 ) . Evaluation approaches vary widely, from automated metrics to user studies, without a clear understanding of how researchers validate and evaluate GenAI personas. The ethical aspects of using GenAI technologies may extend beyond traditional concerns about persona development. Though prior work has addressed issues of stereotyping and representation in personas ( Turner and Turner, 2011 ; Goodman-Deane et al., 2018 ; Goodman-Deane et al., 2021 ) , it appears that GenAI amplifies certain challenges, such as algorithmic bias, data privacy, and transparency ( Amin et al., 2025 ; Gupta et al., 2024 ; Prpa et al., 2024 ; Hämäläinen et al., 2023 ) . These challenges may become particularly acute as personas represent diverse user groups and influence design decisions that affect these populations, prompting the need to understand how researchers factor in ethical concerns when using GenAI in persona development. Against the backdrop of these research challenges, we put forth three research questions (RQs): • RQ1: How are GenAI technologies used in persona development? • RQ2: How are