Hateful Person or Hateful Model? Investigating the Role of Personas in Hate Speech Detection by Large Language Models

Shuzhou Yuan 1 , Ercong Nie 2,3 , Mario Tawfelis 1 , Helmut Schmid 2 , Hinrich Schütze 2,3 and Michael Färber 1 1 ScaDS.AI and TU Dresden 2 LMU Munich 3 Munich Center for Machine Learning (MCML) [email protected], [email protected] · 2025

Read Hateful Person or Hateful Model? Investigating the Role of Personas in Hate Speech Detection by Large Language Models by Shuzhou Yuan 1 , Ercong Nie 2,3 , Mario Tawfelis 1 , Helmut Schmid 2 , Hinrich Schütze 2,3 and Michael Färber 1 1 ScaDS.AI and TU Dresden 2 LMU Munich 3 Munich Center for Machine Learning (MCML) [email protected], [email protected] (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2506-08593.txt.

Introduction

Shuzhou Yuan and co-authors wrote this 2025 computing paper on how personas change hate speech detection by language models. Labeling hate speech is a touchy, subjective task, and human judgments vary with personal traits. The team asks whether giving a model a persona shifts its labels in like ways.

A human survey first confirmed that personality traits, measured by the MBTI scheme, affect how people label posts. The team then prompted four open models with MBTI personas and tested them on three hate speech data sets. The personas drove wide swings in output, with bias visible even in the raw scores behind each label. The authors warn that persona prompts in labeling work need careful design, to keep fairness and match human values.

Catalog record

CREATORShuzhou Yuan 1 , Ercong Nie 2,3 , Mario Tawfelis 1 , Helmut Schmid 2 , Hinrich Schütze 2,3 and Michael Färber 1 1 ScaDS.AI and TU Dresden 2 LMU Munich 3 Munich Center for Machine Learning (MCML) [email protected], [email protected]
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE62 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2506-08593

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Hateful Person or Hateful Model? Investigating the Role of Personas in Hate Speech Detection by Large Language Models Shuzhou Yuan 1 , Ercong Nie 2,3 , Mario Tawfelis 1 , Helmut Schmid 2 , Hinrich Schütze 2,3 and Michael Färber 1 1 ScaDS.AI and TU Dresden 2 LMU Munich 3 Munich Center for Machine Learning (MCML) [email protected], [email protected] Abstract Content Warning: This paper contains examples of hate speech, which may be disturbing or offensive to some readers. Hate speech detection is a socially sensitive and inherently subjective task, with judgments often varying based on personal traits. While prior work has examined how socio-demographic factors influence annotation, the impact of personality traits on Large Language Models (LLMs) remains largely unexplored. In this paper, we present the first comprehensive study on the role of persona prompts in hate speech classification, focusing on MBTI-based traits. A human annotation survey confirms that MBTI dimensions significantly affect labeling behavior. Extending this to LLMs, we prompt four open-source models with MBTI personas and evaluate their outputs across three hate speech datasets. Our analysis uncovers substantial persona-driven variation, including inconsistencies with ground truth, inter-persona disagreement, and logit-level biases. These findings highlight the need to carefully define persona prompts in LLM-based annotation workflows, with implications for fairness and alignment with human values. Hateful Person or Hateful Model? Investigating the Role of Personas in Hate Speech Detection by Large Language Models Shuzhou Yuan † † thanks: Equal contribution. 1 , Ercong Nie 1 1 footnotemark: 1 2,3 , Mario Tawfelis 1 1 footnotemark: 1 1 , Helmut Schmid 2 , Hinrich Schütze 2,3 and Michael Färber 1 1 ScaDS.AI and TU Dresden 2 LMU Munich 3 Munich Center for Machine Learning (MCML) [email protected], [email protected] 1 Introduction Figure 1: Our study demonstrates that different personas influence hate speech detection for both humans and large language models. Figure 2: Assigning different MBTI-based personas to the LLM results in varied responses in hate speech detection. The predicted logits reveal clear differences in classification tendencies and confidence across personas. Notably, even a single personality dimension difference between ESFP and ENFP leads to divergent model outputs. The proliferation of hate speech on online platforms poses a persistent threat to inclusive digital spaces, necessitating robust and scalable detection systems (Röttger et al., 2021 ; Fortuna et al., 2022 ) . Traditionally, the effectiveness of automated hate speech detectors has hinged on the quality of human-labeled data (Kim et al., 2022 ; Yuan et al., 2022 ) . However, hate speech annotation is inherently subjective: as shown in Figure 1 , what one annotator deems hateful, another may consider benign, with disagreement often rooted in personal beliefs, backgrounds, and identities (Sap et al., 2022 ; Fleisig et al., 2023 ; Astorino et al., 2023 ) . Recent research has highlighted that socio-demographic factors such as age, gender, and cultural background significantly influence how annotators perceive and label hate speech, leading to biases that can propagate into downstream models (Mostafazadeh Davani et al., 2022 ; Wang and Plank, 2023 ) . Large Language Models (LLMs) can be prompted to perform a wide range of classification, generation, and evaluation tasks (Zhang et al., 2023 ; Yang et al., 2024b ; Wu et al., 2024 ) . Recent work has demonstrated that LLMs, when provided with clear task instructions, are capable of matching or even surpassing the average accuracy of human annotators in a variety of labeling tasks, including hate speech detection, natural language inference, and sentiment analysis (Tan et al., 2024 ; Movva et al., 2024 ; Horych et al., 2025 ) . As a result, LLM-as-a-annotator paradigms are being actively explored as alternatives or supplements to traditional human labeling pipelines (He et al., 2024 ) . However, recent studies question the reliability of LLM annotations and indicate that LLMs can exhibit significant annotation variation (Borah and Mihalcea, 2024 ; Gligoric et al., 2025 ) . To systematically study and control this variation, researchers have introduced persona-based prompting (Zhu et al., 2025 ) , a technique that conditions LLMs to emulate specific annotator identities, backgrounds, or psychological profiles (Deshpande et al., 2023 ; Joshi et al., 2024 ) . For example, LLMs can be prompted to annotate text as if they were a “young adult from Europe”, a “conservative American”, or a “first-generation immigrant”, allowing researchers to probe how such identities influence model behavior (Joshi et al., 2024 ; Hu and Collier, 2024 ; Liu et al., 2024 ) . This approach not only helps to audit for biases and blind spots within LLMs but also offers a pathway to generate more diverse and representative annotation data (Fröhling et al., 2024 ; Prpa et al., 2024 ) . Despite its promise, most persona-based LLM research has focused on socio-demographic factors (e.g., age, gender, geographic background), with limited attention given to more fundamental and personally subjective traits such as personality (Orlikowski et al., 2023 ; Masud et al., 2024 ; Giorgi et al., 2024 ) . In psychology and the social sciences, personality frameworks like the Myers–Briggs Type Indicator (MBTI) have long been used to explain individual differences in perception, judgment, and decision-making (Myers and Myers, 2010 ) . The MBTI theory categorizes individuals along four dichotomous dimensions (e.g., Introversion-Extraversion, Judging-Perceiving), which together are hypothesized to shape core aspects of a person’s worldview and evaluative tendencies. In the NLP community, MBTI and similar psychological frameworks such as the Big Five Personality model (Goldberg, 2013 ) have been used both for personality detection from text (Plank and Hovy, 2015 ; Stajner and Yenikent, 2021 ; Li et al., 2025 ) and, more recently, to construct LLM personas for controlled generation and analysis (Jiang et al., 2024 ) . Yet, a systematic investigation of how personality-based personas influence subjective annotation tasks, such as hate speech detection, remains lacking. Most existing work treats personality as a downstream application or as a tool for behavioral simulation (Cheng et al., 2023 ; Lee and Ram, 2024 ; Choi and Li, 2024 ) , rather than as a source of annotation variation in its own right. This raises important open questions: To what extent does personality drive annotator disagreement in subjective NLP tasks? Can LLMs, when prompted with different personality profiles, replicate or even amplify these effects? And what are the implications for the reliability, fairness, and interpretability of LLM-generated annotations? In this work, we present the first comprehensive study investigating the influence of MBTI-based personas on hate speech detection by LLMs. We begin with a human annotation survey, in which participants report their MBTI personality types and annotate a curated set of hate speech examples. The results reveal that MBTI personality traits significantly affect individual judgments, particularly highlighting consistent differences between the Feeling and Thinking types. Building on this insight, we apply persona-based prompting to four open-source LLMs across three hate speech datasets. Our analysis shows substantial disagreement between model predictions and the original dataset labels. While each model displays distinct patterns of bias, we also observe notable variability in predictions across different personas within the same model. Further, as shown in Figure 2 , a logit-level analysis reveals that even small changes in MBTI dimensions can lead to systematic shifts in model confidence

Read the complete text