Deterministic AI Agent Personality Expression through Standard Psychological Diagnostics
Kruijssen & Emmons · 2025
Read Deterministic AI Agent Personality Expression through Standard Psychological Diagnostics by Kruijssen & Emmons (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2503-17085.txt.
Introduction
Kruijssen and Emmons test whether AI agents can be given stable, measurable personalities using standard questionnaires of psychology. Language model agents tend to sound alike, which limits their appeal in roles from tutoring to care. The authors instructed several models to act as specified personalities and scored answers on Big Five and Myers-Briggs assessments. The models differed in how faithfully they held the assigned character.
The strongest models, GPT-4o and o1, expressed the target personalities most accurately, suggesting the skill grows with general reasoning power. The expression seemed to come from whole-pattern reasoning rather than gaming each question. Response-level scores varied more than test-level ones; fine-tuning changed a model's style without changing its accuracy at holding a personality. The authors present the work as groundwork for agents with distinct, consistent characters — for checking, with numbers, that the character is there.
Catalog record
| CREATOR | Kruijssen & Emmons |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 68 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2503-17085
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Deterministic AI Agent Personality Expression through Standard Psychological Diagnostics Kruijssen & Emmons Abstract Artificial intelligence (AI) systems powered by large language models have become increasingly prevalent in modern society, enabling a wide range of applications through natural language interaction. As AI agents proliferate in our daily lives, their generic and uniform expressiveness presents a significant limitation to their appeal and adoption. Personality expression represents a key prerequisite for creating more human-like and distinctive AI systems. We show that AI models can express deterministic and consistent personalities when instructed using established psychological frameworks, with varying degrees of accuracy depending on model capabilities. We find that more advanced models like GPT-4o and o1 demonstrate the highest accuracy in expressing specified personalities across both Big Five and Myers-Briggs assessments, and further analysis suggests that personality expression emerges from a combination of intelligence and reasoning capabilities. Our results reveal that personality expression operates through holistic reasoning rather than question-by-question optimization, with response-scale metrics showing higher variance than test-scale metrics. Furthermore, we find that model fine-tuning affects communication style independently of personality expression accuracy. These findings establish a foundation for creating AI agents with diverse and consistent personalities, which could significantly enhance human-AI interaction across applications from education to healthcare, while additionally enabling a broader range of more unique AI agents. The ability to quantitatively assess and implement personality expression in AI systems opens new avenues for research into more relatable, trustworthy, and ethically designed AI. Deterministic AI Agent Personality Expression through Standard Psychological Diagnostics J. M. Diederik Kruijssen & Nicholas Emmons Allora Foundation 1 Introduction Major advances in natural language-based machine intelligence ( Vaswani et al., 2017 ; Brown et al., 2020 , e.g.,) have led to an accelerated development of artificial intelligence (AI) systems, often referred to as large language models (LLMs). Language-based AI systems have significantly lowered the threshold for interacting with AI, allowing for the creation of systems that can perform a wide range of tasks and have become an integral part of modern society. At its core, an LLM is a probabilistic model that uses a neural network to predict the next token in a sequence of tokens, given the previous tokens. By operating in vectorized language space, LLMs are able to generate text that is fluent, coherent, and contextually appropriate ( OpenAI, 2023 , e.g.) . This quality has turned LLMs into a powerful tool for a wide range of applications, extending from language translation to code generation and decision making. The combination of LLMs’ decision making functionality with the ability to execute actions (often referred to as ‘tool calling’ or ‘function calling’) has led to the development of AI agents, which are autonomous systems that can perform increasingly complex tasks ( OpenAI, 2023 ; Schick et al., 2023 ; Yao et al., 2023 , e.g.) . Their language-based output can be used to control external code and infrastructure, allowing integrations with any form of digital system across a wide range of applications, including quantitative inference (which LLMs themselves perform poorly at), both in centralized and decentralized forms ( Kruijssen et al., 2024 , e.g.) , as well as trading, robotics, social media, and more. It has become increasingly clear that AI agents will proliferate and rapidly become a prevalent part of our daily lives. Despite their impressive capabilities, the interaction with AI agents often still feels unnatural, as agents struggle to express themselves in a human-like manner ( Li et al., 2016 ; Zhou et al., 2019 ; Pal et al., 2023 , see e.g.) . In part, this is caused by the training data of the LLM that powers the agent, but it is also due to product design choices related to the presentation of the agent’s output. This has led to relatively bland and generic AI expressiveness, which promises to be particularly problematic in a world where AI agents will become increasingly numerous. In such a future, the ‘sameness’ of AI agents will limit their appeal and adoption. Only if AI agents can develop unique personalities, they might be able to distinguish themselves from each other and become more appealing to users ( Reeves & Nass, 1996 ; Bickmore & Cassell, 2001 , e.g.) . More generally, the ability to express personality is a key prerequisite for the realization of human-like AI systems. While initial steps have been made to direct and quantify AI agent personality expression ( Cheng et al., 2024 ; Park et al., 2024 ; Ren & Xu, 2025 , e.g.) , no systematic framework exists to specify and evaluate the personality of AI agents. In this paper, we address the challenge of achieving a form of deterministic and versatile personality expression for AI agents, with the goal of enabling the diversification of AI agent personalities and user experiences. This requires the use of a quantitative framework to define personality. Within the psychological literature, the gold standard for personality assessment is the Big Five Personality Test, which quantifies personality along five main dimensions: extraversion, agreeableness, conscientiousness, neuroticism (or emotional stability), and openness (or intellect) ( McCrae & Costa, 1987 ; John & Srivastava, 1999 ; Roccas et al., 2002 , e.g.) . Our main hypothesis is that it is possible to specify the personality of an AI agent in a deterministic and replicable manner by using this quantitative personality framework. We test our hypothesis by generating a set of agents with different Big Five personality types, as well as a consistent Myers-Briggs Type Indicator (MBTI) personality type 1 1 1 The MBTI schema is widely known to be a pseudoscientific instrument that is mostly used in corporate settings ( Pittenger, 2005 ) , and we are including it here exclusively for its comparative popularity. , and subsequently letting these agents take the Big Five and MBTI personality tests. The personality type assignment is accomplished by providing a personality description to the agent’s system prompt. We then quantify the consistency of the test results with the input personalities of the agents. We survey how the accuracy of the agents’ personality expression depends on the AI model used, on any fine-tuning of its communication style, and on whether we require the agents to provide a brief motivation of each answer given during the tests. These experiments enable a first quantitative assessment of deterministic personality expression in AI agents. The paper is structured as follows. In § 2 , we describe the design of the agents used in the experiments, the experimental setup, and provide an overview of the experiments. In § 3 , we introduce a number of key metrics used to quantify the consistency of the test results with the input personalities of the agents, and systematically assess the accuracy of the agents’ personality expression as a function of model type, fine-tuning, and the model’s reasoning context. We conclude with a discussion of the results and their implications in § 4 . 2 Agent Creation and Experimental Setup The experiment design is aimed at testing the ability of AI agents to express different personality types according to standard psychological diagnostics. This requires a multi-step process, wherein agents are created, optionally have their communication style fine-tuned, and then subjected to personality tests. In this section,