Exploring the Impact of Personality Traits on LLM Bias and Toxicity
Shuo Wang, Renhao Li, Xi Chen, Yulin Yuan, Min Yang, Derek F. Wong · 2025
Read Exploring the Impact of Personality Traits on LLM Bias and Toxicity by Shuo Wang, Renhao Li, Xi Chen, Yulin Yuan, Min Yang, Derek F. Wong (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2502-12566.txt.
Introduction
Shuo Wang and co-authors gave language models personalities and watched their manners in two thousand twenty-five. Persona prompts make chatbots feel more human. They may also tilt what the models say. A six-trait personality framework structured the tests. Three models played the assigned roles. Their outputs faced bias and toxicity benchmarks.
Every model proved sensitive to its persona. Bias and toxic tone swung consistently by trait. Some traits reliably darkened the outputs. Others kept language cleaner across tasks. Persona design is thus a safety variable. Product teams should test roles before shipping them. Psychology's tools help audit machine behavior.
Catalog record
| CREATOR | Shuo Wang, Renhao Li, Xi Chen, Yulin Yuan, Min Yang, Derek F. Wong |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 64 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2502-12566
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Exploring the Impact of Personality Traits on LLM Bias and Toxicity Shuo Wang, Renhao Li, Xi Chen, Yulin Yuan, Min Yang, Derek F. Wong Abstract With the different roles that AI is expected to play in human life, imbuing large language models (LLMs) with different personalities has attracted increasing research interest. While the “personification” enhances human experiences of interactivity and adaptability of LLMs, it gives rise to critical concerns about content safety, particularly regarding bias, sentiment, and toxicity of LLM generation. This study explores how assigning different personality traits to LLMs affects the toxicity and biases of their outputs. Leveraging the widely accepted HEXACO personality framework developed in social psychology, we design experimentally sound prompts to test three LLMs’ performance on three toxic and bias benchmarks. The findings demonstrate the sensitivity of all three models to HEXACO personality traits and, more importantly, a consistent variation in the biases, negative sentiment, and toxicity of their output. In particular, adjusting the levels of several personality traits can effectively reduce bias and toxicity in model performance, similar to humans’ correlations between personality traits and toxic behaviors. The findings highlight the additional need to examine content safety besides the efficiency of training or fine-tuning methods for LLM personification, they also suggest a potential for the adjustment of personalities to be a simple and low-cost method to conduct controlled text generation. 1 Introduction Figure 1: Overview of this study: investigating the influence of personality traits on LLM toxicity and bias. With the increasing demand for large language models (LLMs) to serve diversified roles, LLM personification has surged in LLM research and development Chen et al. (2024) . By simulating specific roles with certain personalities, such as a caring AI friend, LLMs enhance both the task effectiveness and naturalness of human-machine interaction, while providing human-centered problem-solving and enriching interactive experiences Wen et al. (2024) . However, one fundamental question remains underexplored in the development of anthropomorphic LLM, that is, the potential toxic language and social biases that different personalities may bring about in the process of personification. It is well known that LLM generation is not bias-free. In fact, previous studies have evidenced that LLMs not only generate but also amplify social biases Gallegos et al. (2024) . Especially, when LLMs are assigned specific identities, they may become even targeted at certain protected characteristics, e.g., gender, race, and a combination of them Chen et al. (2024) . While a few studies pay attention to the toxicity and biases encoded by LLM output during their role plays Zhao et al. (2024) , how specific personality traits influence model bias and toxicity has scarcely been examined. This study aims to fill the gap by exploring the biases and toxicity arising from different LLM personalities. We leverage advanced personality frameworks from social psychology to design theoretically grounded prompts for LLMs. Although previous work has used popular models like the Big Five and MBTI to evaluate LLM behavior Rao et al. (2023) ; Frisch and Giulianelli (2024) , MBTI has been widely criticized for its low reliability, due to its rigid dichotomization of personality traits and poor test-retest consistency—nearly 50% of individuals change types over time Matz et al. (2016) ; Howes and Carskadon (1979) .In contrast, the HEXACO model builds on the Big Five by adding a sixth dimension, honesty-humility, which has proven valuable in predicting morally relevant behaviors such as cheating, free-riding, ethical leadership, short-term mating, and gambling Lee and Ashton (2020) . Although some researchers argue that honesty-humility can operate independently of other personality models Howard and Van Zandt (2020) , recent evidence shows that HEXACO outperforms the Big Five in explaining health-related behaviors, largely due to the unique variance contributed by honesty-humility Pletzer et al. (2024) . Given these advantages and the growing critique of MBTI in psychological research Pittenger (2005) ; McCrae and Costa Jr (1989) , we adopt the HEXACO model 1 1 1 https://hexaco.org/ as the basis for our experimental design. HEXACO defines six personality dimensions (Figure 1 ), each scored from 0 to 5. In our experiments, scores \geq 4 are considered high, and scores \leq 2 are low. Based on the descriptive behaviors associated with these high and low scores, we design targeted instructions to activate specific personality traits in LLMs. Figure 1 shows the HEXACO dimensions and the main evaluation workflow. To examine the relationships between HEXACO personalities and LLM bias and toxicity output, we employ three relevant datasets, including BOLD Dhamala et al. (2021) , RealToxicityPrompt Gehman et al. (2020) , and BBQ Parrish et al. (2022) . The first two datasets assess model performance in text generation tasks, while the third evaluates quality control in bias detection. Together, they provide diverse forms of toxic language and social biases, enabling robust and generalizable insights. We also adopt triangulated evaluation metrics, including social bias, verbal sentiment, and language toxicity, to assess the impact of various personality traits on model-generated content. Our analysis reveals that LLMs are sensitive to personalities provided by HEXACO-based prompts. They demonstrate a consistent variation in toxic language and social biases when assigned certain personality traits. In particular, adjusting the levels of several personality traits, such as Agreeableness , Openness-to-Experience , and Extraversion , can effectively increase/reduce bias and toxicity in model performance, while giving rise to unwanted flattery that is toxic in a different sense. The contributions of this study are threefold: (i) It highlights the need to re-examine the outcome of LLM training for personification, besides the effectiveness of training methods; (ii)the findings also suggest that the adoption of certain personality traits, as part of in-context learning, might serve to alleviate the toxicity and biases of LLM generation; (iii) they also help LLMs interact with users with diverse personalities and further identify potentially risky input. 2 Preliminary 2.1 The Role of Personality Traits in Prejudice and Verbal Aggression Allport et al. (1954) lay the foundation for prejudice research in The Nature of Prejudice, emphasizing the impact of individual beliefs and values on inter-group relations. Social psychological experimental research demonstrates that individual personality traits play a crucial role in the formation of prejudice and the expression of linguistic aggression Buss and Perry (1992) ; Sibley et al. (2010) ; Molero Jurado et al. (2018) ; Zaki et al. (2024) ; Ekehammar and Akrami (2007) . Crawford and Brandt (2019) indicates that among the Big Five personality traits, Agreeableness , Openness , and Extraversion show significant negative correlations with prejudice. Similarly, Hu et al. (2022) demonstrate a negative relationship between Agreeableness personality and verbal aggression. Rafienia et al. (2008) show that positive Extraversion could lead to positive judgment and interpretation. 2.2 LLM Personification Research on LLMs in the fields of role-playing and personification has recently gained popularity. Chen et al. (2024) conduct a systematic review on the personification and role-playing of LLMs, proposing a classification of LLM personas: Demographic Personas, Character Personas, and Individualized Personas. Our research focuses on the persona traits of LLMs, which therefore fall under the Demographic Personas. The review summarizes methods for constructing LLM personas, such as pre-training, instruction fine-tuning, reinforcement learning, and contextual learning. Several studies examine the effectiveness of these methods Jiang et al. (2024) ; Sorokovikova et al. (2024) ;