The Effects of Demographic Instructions on LLM Personas Conference: Proceedings of the 48th International ACM SIGIR Conference on Research and Development in Information Retrieval; July 13–18, 2025; Padua, Italy. Proceedings of the 48th International ACM SIGIR Conference on Research and Development

Angel Felipe Magnossão de Paula, J. Shane Culpepper, Alistair Moffat, Sachin Pathiyan Cherumanal, Falk Scholer, Johanne Trippas · 2025

Read The Effects of Demographic Instructions on LLM Personas Conference: Proceedings of the 48th International ACM SIGIR Conference on Research and Development in Information Retrieval; July 13–18, 2025; Padua, Italy. Proceedings of the 48th International ACM SIGIR Conference on Research and Development by Angel Felipe Magnossão de Paula, J. Shane Culpepper, Alistair Moffat, Sachin Pathiyan Cherumanal, Falk Scholer, Johanne Trippas (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2505-11795.txt.

Introduction

Angel Felipe Magnossao de Paula, J. Shane Culpepper, and colleagues study how demographic instructions change model personas in a 2025 study. Platforms must filter sexist content under government rules, yet what counts as sexist varies between people. Standard detectors use one fixed definition and miss that spread of views.

Taking a perspectivist stance, the authors keep diverse annotations instead of forcing one gold label. Language models receive demographic information drawn from social media users and judge content from those standpoints. The study measures how such instructions shift model judgments. Findings bear on fair moderation that respects group differences without giving up enforcement.

Catalog record

CREATORAngel Felipe Magnossão de Paula, J. Shane Culpepper, Alistair Moffat, Sachin Pathiyan Cherumanal, Falk Scholer, Johanne Trippas
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE23 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2505-11795

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

The Effects of Demographic Instructions on LLM Personas Conference: Proceedings of the 48th International ACM SIGIR Conference on Research and Development in Information Retrieval; July 13–18, 2025; Padua, Italy. Proceedings of the 48th International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR ’25), July 13–18, 2025, Padua, Italy ISBN: 979-8-4007-1592-1/25/07 DOI: 10.1145/3726302.3730255 CCS: Information systems Retrieval effectiveness CCS: Information systems Task models CCS: Information systems Sentiment analysis Angel Felipe Magnossão de Paula, J. Shane Culpepper, Alistair Moffat, Sachin Pathiyan Cherumanal, Falk Scholer, Johanne Trippas Abstract . Social media platforms must filter sexist content in compliance with governmental regulations. Current machine learning approaches can reliably detect sexism based on standardized definitions, but often neglect the subjective nature of sexist language and fail to consider individual users’ perspectives. To address this gap, we adopt a perspectivist approach, retaining diverse annotations rather than enforcing gold-standard labels or their aggregations, allowing models to account for personal or group-specific views of sexism. Using demographic data from Twitter, we employ large language models ( LLMs ) to personalize the identification of sexism. Our empirical results show that OpenAI’s LLMs ( GPT-3.5 , GPT-4 , and GPT-4o ) and two open-source LLMs ( Mistral and Qwen ) exhibit higher Krippendorff’s alpha label agreement with female annotators than with male annotators. As well, each LLM presents higher Krippendorff’s alpha agreement with a specific annotator age group. We then sought to counter these trends by providing “persona” instructions as part of the LLM prompt, with somewhat surprising outcomes, highlighting the potential of user-centered perspectivist methods to improve content moderation systems. 1. Introduction and Motivation Relevance judgments are usually undertaken to develop a set of gold-standard labels, seeking relevance consensus; with those labels then used to support measurement of the extent to which the documents retrieved by some information retrieval ( IR ) system align with users’ information needs, thereby allowing benchmarking of systems. One major challenge in relevance judgments is the high annotator costs for the labeling that is required. To reduce that cost, researchers have proposed the use of LLMs , which have been shown to usefully supplement human labeling and at scale ( Thomas et al. 2024 ) . Bias and fairness in IR systems have also received attention ( Dai et al. 2024 ; Lunardi et al. 2024 ) . Nor are LLMs immune – they too can be affected by bias, stereotypical associations ( Basta et al. 2019 ; Kurita et al. 2019 ) , and adverse sentiments towards specific groups ( Hutchinson et al. 2020 ) . For example, gender bias evaluation in natural language processing is a topic that has received much attention ( Costa-jussà et al. 2019 ) , with de-biasing techniques having been also been proposed ( Bigdeli et al. 2023 ) . Faggioli et al. 2023 propose a human-machine collaboration spectrum that categorizes judgment strategies based on how much humans rely on machines, and suggest that “AI Assistance” is a likely path for employment of LLMs . Faggioli et al. 2023 ’s pilot study finds a reasonable correlation between highly-trained human assessors and a fully automated LLM , concluding that while the technology is promising, it requires further study. Use of LLMs for relevance judgment is thus an emerging area of interest ( Rahmani et al. 2024 ; Schnabel et al. 2025 ) . Here, we explore if LLMs can be directed to adopt a persona when conducting relevance judgments. In particular, different annotators might react differently when asked “is this tweet sexist”, with their answers coming from subjective viewpoints influenced by, amongst other factors, gender and age. That is, the “is it sexist” question may not always have a single “right” answer. Hasler et al. 2015 suggest the use of augmented test collections that include user-centric evaluation and anonymized demographic information such as age, gender, and education level, plus task-specific details such as the assessor’s expertise, interest, motivation, confidence, and degree of document relevance. Given that range of influencing factors, we are interested in whether an LLM – a “stochastic parrot” ( Bender et al. 2021 ) – is capable of reflecting different demographic responses. For example, can an LLM be (reliably) instructed to “be a male over 45”? To investigate if LLMs can mimic subjectivity, we use the Social neTworks ( EXIST ) Shared Task at CLEF 2023 ( Plaza et al. 2023a ) test collection for sEXism Identification. This dataset contains labels (opinions) from diverse human judges for a set of tweets 1 1 1 User-provided ground truth labels are not publicly available, meaning that this dataset could not have been used as training by LLM , an important and necessary assurance. , labels which do indeed exhibit demographic patterns. By comparing the human labels with LLM -generated labels, we are thus able to infer a “persona” for several commercial and open-source LLM models. The specific research questions we consider are: (i) Do LLMs exhibit bias toward certain demographics when classifying text as sexist or non-sexist; and (ii) Can adopting a demographic-based persona mitigate bias in LLMs when classifying text as sexist or non-sexist. Krieg et al. 2022 suggest that female stereotypes are influential in relevance judgments. Our experiments show a similar outcome, with all five tested LLMs correlating more closely with female opinions than with male. The second part of our work here then asks the same set of LLMs to adopt a range of specific demographic personas as they respond to the “is this tweet sexist” question. Surprisingly, all of the LLMs tested seemed to be incapable of doing so. That is, the LLMs were unable to “empathize” and take on different patterns of opinion; and their “personalities” seem to be relatively inflexible. 2. Background Perspectivism in Text Classification In traditional text classification annotation, disagreements are resolved into a single “gold standard” label via aggregation ( Frenda et al. 2024 ) . This approach has recently been challenged, especially in subjective tasks like hate speech and sexism detection ( Plaza et al. 2023a ) , as it risks enforcing a single ground truth. Perspectivism is a machine learning approach that takes data annotated by different individuals and models the varied perspectives that influence their opinions and world view ( Frenda et al. 2024 ) . We adopt the perspectivist approach to examine biases in sexism detection; and then consider the specific question to whether LLMs can simulate personas based on demographic attributes. Sexism Detection Sexism detection is the task of deciding if text contains sexist content. Traditional sexism detection systems have relied on predefined labels and fixed perspectives, overlooking the nuanced and subjective nature of sexist statements; moreover, as social media have expanded their influence, researchers have focused on developing scalable approaches to sexism detection. A significant advancement towards addressing this issue is the EXIST (sEXism Identification in Social neTworks) Lab at CLEF ( Plaza et al. 2023a ) , designed for perspectivist learning by highlighting annotation disagreements rather than imposing gold-standard labels. In particular, different annotators might react differently when asked if a given tweet “is sexist”. The EXIST initiative acknowledges the inherent subjectivity in sexism classification, and aims to improve model robustness by incorporating diverse perspectives in the annotation process.

Read the complete text