Who Gets Which Message? Auditing Demographic Bias in LLM-Generated Targeted Text

Tunazzina Islam · 2026

Read Who Gets Which Message? Auditing Demographic Bias in LLM-Generated Targeted Text by Tunazzina Islam (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2601-17172.txt.

Introduction

Tunazzina Islam audits slant in chatbot texts made for set crowds. Chatbots can now write apt pitches for each crowd at scale. That skill raises fair-use fears in new ways. Her 2026 preprint gives the first set check of such acts. Three top models face the same check frame. They are GPT-4o, Llama-3.3, and Mistral-Large 2.

Each model writes texts set for set crowd traits. Shifts in tone and pitch by crowd then show. Some shifts may cross from apt to unfair. Clear audits help set rules for such tools. They also warn firms that use them blind.

Catalog record

CREATORTunazzina Islam
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE76 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2601-17172

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Who Gets Which Message? Auditing Demographic Bias in LLM-Generated Targeted Text Tunazzina Islam Abstract Large language models (LLMs) are increasingly capable of generating personalized, persuasive text at scale, raising new questions about bias and fairness in automated communication. This paper presents the first systematic analysis of how LLMs behave when tasked with demographic-conditioned targeted messaging. We introduce a controlled evaluation framework using three leading models—GPT-4o, Llama-3.3, and Mistral-Large 2.1—across two generation settings: Standalone Generation , which isolates intrinsic demographic effects, and Context-Rich Generation , which incorporates thematic and regional context to emulate realistic targeting. We evaluate generated messages along three dimensions: lexical content , language style , and persuasive framing . We instantiate this framework on climate communication and find consistent age- and gender-based asymmetries across models: male- and youth-targeted messages emphasize agency , innovation , and assertiveness , while female- and senior-targeted messages stress warmth , care , and tradition . Contextual prompts systematically amplify these disparities, with persuasion scores significantly higher for messages tailored to younger or male audiences. Our findings demonstrate how demographic stereotypes can surface and intensify in LLM-generated targeted communication, underscoring the need for bias-aware generation pipelines and transparent auditing frameworks that explicitly account for demographic conditioning in socially sensitive applications. 1 Introduction Large language models (LLMs) Brown et al. 2020 are increasingly capable of generating demographically conditioned and persuasive text, enabling fine-grained personalization in domains such as public communication, policy outreach, and marketing Liu et al. 2025 ; Hackenburg and Margetts 2024 ; Breum et al. 2024 . While such capabilities improve relevance and engagement, they also raise fundamental questions about fairness and representational bias in automated communication Lin et al. 2024 ; Fang et al. 2024 ; Kumar et al. 2023 ; Li et al. 2023b ; Li et al. 2023a ; Sag 2023 ; Urman and Makhortykh 2023 ; Kotek et al. 2023 ; Esiobu et al. 2023 . In particular, when demographic attributes such as gender or age are explicitly provided as conditioning signals, LLMs may differentially adjust not only what they say , but how persuasively they say it potentially reinforcing social stereotypes through linguistic framing. A growing body of NLP research has documented demographic and social biases in Natural Language Generation (NLG) systems, including gendered and social biases Bender et al. 2021 ; Sheng et al. 2020 ; Dinan et al. 2020 ; Sheng et al. 2019 , which can potentially cause harm to underrepresented groups when deployed in sensitive domains Ovalle et al. 2023 . Such biases have been observed in diverse contexts—ranging from dialogue systems Liu et al. 2021 ; Dinan et al. 2020 , text summarization Jia et al. 2023 , and story or creative generation Lucy and Bamman 2021 to automated professional and assistive writing Wan et al. 2023 ; Khan et al. 2023 ; Madera et al. 2009 . However, most prior work evaluates bias in generic or unconstrained generation settings, without examining how explicit demographic conditioning reshapes linguistic behavior. As a result, we lack a systematic understanding of how LLMs behave when tasked with generating targeted messages—a setting that is increasingly plausible in real-world deployments. In this paper, we argue that demographic-conditioned persuasive generation constitutes a distinct and underexplored evaluation problem for NLG systems. Unlike generic generation, targeted messaging requires models to strike a balance between personalization and representational neutrality, making it especially prone to stereotype amplification. Moreover, persuasion is not reducible to sentiment or emotional tone alone. Persuasive language operates through agentic framing, certainty expression, and directive intent, which determine how strongly a message asserts control, obligation, or action Wang et al. 2019 ; Sap et al. 2017 . Existing bias audits, which predominantly rely on sentiment, toxicity, or lexical polarity measures Ovalle et al. 2023 ; Sheng et al. 2021 ; Nozza et al. 2021 , are therefore insufficient to capture these dimensions. These concerns are particularly salient in settings where language models are used for targeted outreach. In recent years, microtargeting strategies have become increasingly prominent in social media and digital campaigns Eldar and Hidir 2025 ; Islam 2025b ; Nistor 2024 . Microtargeting refers to the fine-grained tailoring of messages to specific demographic segments such as age, gender, location, and interests by leveraging extensive user data Islam 2025a ; Prummer 2020 ; Hersh 2015 ; Barbu 2014 . In high-stakes domains such as political, public-interest, and policy communication, microtargeting can improve relevance and engagement but also raises ethical and transparency concerns regarding fairness and accountability in demographically targeted messaging Islam and Goldwasser 2025a ; Islam and Goldwasser 2025b ; Islam et al. 2023b . To address this gap, we formalize the auditing of demographic-conditioned generation as a new evaluation task and introduce a general, model-agnostic framework for analyzing how linguistic content, style, and persuasive framing vary across demographic targets. Our framework disentangles intrinsic demographic bias from context-amplified bias through two complementary generation paradigms. Standalone Generation (SG) isolates latent associations learned by the model by conditioning only on demographic attributes, while Context-Rich Generation (CRG) incorporates thematic and regional cues to approximate realistic microtargeting scenarios. This design enables systematic measurement of when and how demographic stereotypes surface under increasing contextual pressure. We operationalize this task through a unified set of linguistically grounded metrics spanning three dimensions: (i) lexical content , (ii) language style , and (iii) persuasive framing . We introduce Persuasion Bias Index (PBI), a composite measure that captures agentic framing, modal certainty, and imperative usage—core mechanisms of persuasion that remain largely unexamined in prior bias audits. By grounding PBI in established theories of agency and connotation ( Abele and Wojciszke 2018 ; Sap et al. 2017 ) , we provide a principled way to quantify disparities in persuasive force across demographic targets. We apply our framework to three state-of-the-art LLMs, such as GPT-4o ( OpenAI 2024 ) , Llama-3.3 ( Touvron et al. 2023 ) , and Mistral-Large-2.1 ( Jiang et al. 2023 ) , and analyze targeted message generation across gender and age groups. While we instantiate our analysis in the context of climate communication , this domain serves as a case study; the proposed framework is domain-agnostic and applicable to any setting involving demographic conditioning in generative language systems. Across both generation settings, we find systematic demographic framing biases in all three LLMs. Male- and younger-targeted messages consistently exhibit more agentic , assertive , and persuasive framing, while female- and senior-targeted messages emphasize warmth , communality , and hedging . These asymmetries are substantially amplified under CRG, where demographic cues interact with thematic and regional context to produce stronger lexical, stylistic, and persuasive disparities. Together, these results indicate that personalization can magnify latent demographic stereotypes in LLM-generated targeted communication. In summary, this paper makes three contributions: (1) a controlled framework for isolating demographic effects in text generation via standalone and context-rich settings; (2) the Persuasion Bias Index, a linguistically grounded metric for measuring demographic differences in persuasive intensity; and (3) an empirical study of demographic-conditioned persuasion in climate-related generation across multiple LLMs. More broadly, this work has direct implications for NLP system design, highlighting the need for evaluation benchmarks that account for demographic conditioning and for deployment practices that ensure personalization does not systematically amplify persuasive bias.

Read the complete text