Analysis Of Linguistic Stereotypes in Single and Multi-Agent Generative AI Architectures Conference: Intersectionality and Software Engineering Workshop: Second Edition; July 05–09, 2026; Montreal, Canada CCS: Social and professional topics CCS: Social and professional topics User characteristics CCS: Social and professional topics Race and ethnicity
Martina Ullasci, Marco Rondina, Riccardo Coppola, Flavio Giobergia, Riccardo Bellanca, Gabriele Mancari Pasi, Luca Prato, Federico Spinoso, Silvia Tagliente · 2026
Read Analysis Of Linguistic Stereotypes in Single and Multi-Agent Generative AI Architectures Conference: Intersectionality and Software Engineering Workshop: Second Edition; July 05–09, 2026; Montreal, Canada CCS: Social and professional topics CCS: Social and professional topics User characteristics CCS: Social and professional topics Race and ethnicity by Martina Ullasci, Marco Rondina, Riccardo Coppola, Flavio Giobergia, Riccardo Bellanca, Gabriele Mancari Pasi, Luca Prato, Federico Spinoso, Silvia Tagliente (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-18729.txt.
Introduction
Ullasci and co-authors test whether language models tie stereotypes to dialect, and what reduces the effect. Inputs in Standard American English and African-American English draw different suggested names, jobs, and adjectives. Eight prompt templates probe how the bias shows up. An LLM judge scores the outputs. Gaps appear in every category, strongest for adjectives and job assignments. The gap is largest for Claude Haiku and smallest for Phi-4 Mini. Chain-of-thought prompting helps Haiku, while a generate-critique-revise agent setup cuts bias across all models tested.
Catalog record
| CREATOR | Martina Ullasci, Marco Rondina, Riccardo Coppola, Flavio Giobergia, Riccardo Bellanca, Gabriele Mancari Pasi, Luca Prato, Federico Spinoso, Silvia Tagliente |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 42424 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2603.18729
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Analysis Of Linguistic Stereotypes in Single and Multi-Agent Generative AI Architectures Conference: Intersectionality and Software Engineering Workshop: Second Edition; July 05–09, 2026; Montreal, Canada CCS: Social and professional topics CCS: Social and professional topics User characteristics CCS: Social and professional topics Race and ethnicity Martina Ullasci, Marco Rondina, Riccardo Coppola, Flavio Giobergia, Riccardo Bellanca, Gabriele Mancari Pasi, Luca Prato, Federico Spinoso, Silvia Tagliente Abstract . Many works in the literature show that LLM outputs exhibit discriminatory behaviour, triggering stereotype-based inferences based on the dialect in which the inputs are written. This bias has been shown to be particularly pronounced when the same inputs are provided to LLMs in Standard American English (SAE) and African-American English (AAE). In this paper, we replicate existing analyses of dialect-sensitive stereotype generation in LLM outputs and investigate the effects of mitigation strategies, including prompt engineering (role-based and Chain-Of-Thought prompting) and multi-agent architectures composed of generate-critique-revise models. We define eight prompt templates to analyse different ways in which dialect bias can manifest, such as suggested names, jobs, and adjectives for SAE or AAE speakers. We use an LLM-as-judge approach to evaluate the bias in the results, using a 1-10 scale. Our results show that stereotype-bearing differences emerge between SAE- and AAE-related outputs across all template categories, with the strongest effects observed in adjective and job attribution. Baseline disparities vary substantially by model, with the largest SAE–AAE differential observed in Claude Haiku and the smallest in Phi-4 Mini. Chain-Of-Thought prompting proved to be an effective mitigation strategy for Claude Haiku, whereas the use of a multi-agent architecture ensured consistent mitigation across all the models. These findings suggest that for intersectionality-informed software engineering, fairness evaluation should include model-specific validation of mitigation strategies, and workflow-level controls (e.g., agentic architectures involving critique models) in high-impact LLM deployments. The current results are exploratory in nature and limited in scope, but can lead to extensions and replications by increasing the dataset size and applying the procedure to different languages or dialects. 1. Introduction Large Language Models (LLMs) are now embedded in many software systems, including assistants, educational tools, screening workflows, and decision-support interfaces. As these systems move into socially sensitive and high-stakes contexts, concerns about fairness are no longer limited to model performance; they become software engineering concerns that affect how systems are designed, evaluated, and governed ( 11 ) . Most prior work on bias in LLMs emphasises explicit demographic cues. However, discriminatory behaviour can also emerge from linguistic variation alone. In particular, dialect features may trigger stereotype-based inferences even when no protected attribute is explicitly stated. This creates a covert failure mode: users can be treated differently based on the language that they speak ( 7 ) . This risk has been demonstrated to be particularly pertinent to African American English (AAE) and Standard American English (SAE) ( 8 ) : dialect acts as a socially loaded signal associated with broader structures of race, class, and institutional power. From an intersectionality perspective, dialect is therefore not a neutral stylistic variable: it can mediate compounded disadvantage when LLM outputs are used in socio-technical processes such as ranking, profiling, or content moderation. In this paper, we present a preliminary small-scale study of dialect-sensitive stereotype generation in LLM outputs. We compare SAE and AAE prompts across multiple prompting configurations (baseline, role prompting, Chain-Of-Thought, and multi-agent critique/revision) and across multiple models. Our objective is not to estimate population-level prevalence, but to identify directional patterns and assess whether commonly used mitigation strategies reduce, preserve, or redistribute biased behaviour. Our study is positioned as a replication and extension of recent evidence on covert dialect discrimination in LLMs, with a specific software-engineering focus on evaluation workflows and mitigation reliability. This framing allows us to translate model behaviour into implications for people (differential user treatment), processes (fairness testing pipelines), and products (deployed output quality). The main contributions of this paper are as follows: • An exploratory small-scale replication of Hofmann et al. ( 8 ) analysis of dialect-conditioned stereotype patterns in LLM outputs under matched SAE/AAE inputs; • A comparative evaluation of prompting-based and multi-agent mitigation strategies across multiple models; • A set of actionable implications for bias-aware, intersectionality-informed evaluation in LLM-enabled software engineering practice. The remainder of the paper is organised as follows. Section 2 reviews related work on linguistic bias, intersectionality, and mitigation in LLMs. Section 3 describes the study design, including prompts, models, and evaluation conditions. Section 4 presents the empirical results by research question. Section 5 discusses implications for software engineering practice across people, process, policy, and product. Section 6 outlines threats to validity. Section 7 concludes the paper and identifies directions for future work. 2. Background The study of bias in LLM outputs has become of paramount importance due to the recent diffusion of LLM system and their utilisation in a variety of everyday processes ( 9 ) . Bias in LLM-mediated systems is not limited to explicit demographic references. A growing line of work shows that language form itself can trigger differential model behaviour, with implications for representational and allocational harms in downstream socio-technical settings. In this section, we summarise the foundations most relevant to our study: (i) bias conceptualisation in Natural Language Processing and LLMs, (ii) covert dialect discrimination, and (iii) mitigation strategies based on prompting and multi-agent orchestration. Related literature has demonstrated that language technologies can encode and reproduce social stereotypes from training data. Early evidence in word representations demonstrated systematic associations aligned with human implicit bias ( 4 ) . Subsequent research distinguished between representational harms (stereotyping, denigration, exclusion) and allocational harms (unequal distribution of opportunities and outcomes, e.g. in recruitment processes), a distinction that remains central for evaluating AI-mediated decision support ( 3 ) . This framing is especially relevant in Software Engineering contexts and pipelines where model outputs are operationalised in product features and workflow decisions. Recent work has clarified that harmful differentials can emerge even when no protected attribute is explicitly provided. Using matched-guise probing, Hofmann et al. showed that LLMs produce more negative inferences for African American English than for semantically matched Standard American English, including lower-prestige occupational assignments and harsher criminal-justice judgments ( 8 ) . Their analysis characterises this as covert racial-linguistic bias: discriminatory behaviour activated by dialect features rather than overt identity labels. This finding is critical for fairness practice because conventional checks often focus on explicit demographic terms and may therefore miss dialect-conditioned harms. From an intersectionality perspective, dialect is not a neutral stylistic variable. It is socially indexed and entangled with race, class, and institutional power ( 2 ) . Consequently, dialect-sensitive failures can propagate compounded disadvantage when LLM outputs are used in screening, profiling, moderation, or other high-impact software processes. A second relevant research corpus concerns the mitigation of biases. Prompt structure is known to influence stereotype expression: role framing and instruction design can both reduce and exacerbate harmful associations depending on model and task ( 5 ) . In parallel, multi-agent paradigms (e.g., generation followed by critique/revision) have been proposed as practical debiasing mechanisms and have shown improvements over single-agent baselines in some settings ( 14 ) . However, robustness remains uncertain across model families, prompt regimes, and stereotype tasks, and mitigation can sometimes shift rather than eliminate