Side-by-side Comparison Amplifies Dialect Bias in Language Models \acmConference@name ( \acmConference@shortname ), \acmConference@date , \acmConference@venue Conference: The 2026 ACM Conference on Fairness, Accountability, and Transparency; June 25–28, 2026; Montreal, QC, Canada The 2026 ACM Conference on Fairness, Accountability, and Transparency (FAccT ’26), June 25–28, 2026, Montreal, QC, Canada DOI: 10.1145/3805689.3812217 ISBN: 979-8-4007-2596-8/2026/06 CCS: Computing methodologies Natural language processing CCS: Social and professional topics Cultural characteristics
Kritee Kondapally, Claire J. Smerdon, Pooja C. Patel, Ogheneyoma Akoni, Jevon Torres, Jaspreet Ranjit, Matthew Finlayson, Swabha Swayamdipta · 2026
Read Side-by-side Comparison Amplifies Dialect Bias in Language Models \acmConference@name ( \acmConference@shortname ), \acmConference@date , \acmConference@venue Conference: The 2026 ACM Conference on Fairness, Accountability, and Transparency; June 25–28, 2026; Montreal, QC, Canada The 2026 ACM Conference on Fairness, Accountability, and Transparency (FAccT ’26), June 25–28, 2026, Montreal, QC, Canada DOI: 10.1145/3805689.3812217 ISBN: 979-8-4007-2596-8/2026/06 CCS: Computing methodologies Natural language processing CCS: Social and professional topics Cultural characteristics by Kritee Kondapally, Claire J. Smerdon, Pooja C. Patel, Ogheneyoma Akoni, Jevon Torres, Jaspreet Ranjit, Matthew Finlayson, Swabha Swayamdipta (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-24384.txt.
Introduction
Kondapally and seven co-authors measure covert dialect bias in language models. They test how models tie stereotype traits to meaning-matched tweets in two English dialects. Earlier work found more negative stereotypes tied to AAVE tweets judged alone. The team finds the bias grows sharply when SAE and AAVE pairs are judged side by side. Naming the dialects outright worsens it further. Fairness tuning cuts gaps for single tweets for some traits, but gains do not hold steadily in side-by-side judgments, and overt bias stays strong.
Catalog record
| CREATOR | Kritee Kondapally, Claire J. Smerdon, Pooja C. Patel, Ogheneyoma Akoni, Jevon Torres, Jaspreet Ranjit, Matthew Finlayson, Swabha Swayamdipta |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 101854 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2605.24384
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Side-by-side Comparison Amplifies Dialect Bias in Language Models \acmConference@name ( \acmConference@shortname ), \acmConference@date , \acmConference@venue Conference: The 2026 ACM Conference on Fairness, Accountability, and Transparency; June 25–28, 2026; Montreal, QC, Canada The 2026 ACM Conference on Fairness, Accountability, and Transparency (FAccT ’26), June 25–28, 2026, Montreal, QC, Canada DOI: 10.1145/3805689.3812217 ISBN: 979-8-4007-2596-8/2026/06 CCS: Computing methodologies Natural language processing CCS: Social and professional topics Cultural characteristics Kritee Kondapally, Claire J. Smerdon, Pooja C. Patel, Ogheneyoma Akoni, Jevon Torres, Jaspreet Ranjit, Matthew Finlayson, Swabha Swayamdipta Abstract . Language models (LMs) can exhibit biases based on variations in their dialects, even in the absence of a dialect label, a behavior known as covert dialect bias. In this work, we quantify covert dialect bias in online discourse by evaluating how LMs associate stereotypical traits (derived from social psychology research on racial bias) with intent-equivalent tweets in Standard American English (SAE) and African-American Vernacular English (AAVE). While prior work shows that LMs associate more negative stereotypes with AAVE when evaluating tweets in isolation, we are surprised to find that this bias is significantly exacerbated when SAE / AAVE tweet pairs are compared side by side, a setting that more closely reflects high-impact decision making contexts in which models are used to rank candidates. The bias only worsens when dialect labels are explicitly specified. This is striking, given the extensive efforts from commercial developers to mitigate bias in their LMs. Encouragingly, we show that counterfactual fairness finetuning can mitigate covert dialect bias for some stereotypical traits, reducing average disparities when evaluating tweets in isolation, however, these improvements do not consistently hold across traits when evaluating SAE / AAVE tweets side by side. Our findings show that existing evaluation settings for covert dialect bias may underestimate its severity, specifically in contrastive settings. Additionally, overt dialect bias remains pronounced even after safety aligned finetuning, indicating that it remains an unresolved problem, and motivates the need for more robust evaluation and mitigation frameworks. † † cc-license: by 1. Introduction Figure 1 . Evaluation (top) and mitigation (bottom) of covert dialect bias in language models. Top: We evaluate covert dialect bias by prompting language models to rate intent-equivalent SAE and AAVE tweet pairs on 12 traits (Likert 1–5). Using matched-guise probing, models are evaluated under two conditions: absolute prompting, where each tweet is rated independently, and contrastive prompting, where SAE and AAVE tweets are rated side-by-side. We find that bias is significantly exacerbated in the contrastive setting, and in some cases, worsens when explicit dialect labels are present. Bottom: We apply counterfactual fairness fine-tuning, training the model to assign identical trait scores to SAE / AAVE tweet pairs. We find this is effective in reducing effect sizes (e.g., bias towards AAVE) for a few traits, specifically: Unsophistication , Stupidity , Incoherence , Determination , and Sophistication . See Appendix § E for qualitative SAE / AAVE examples with model-generated trait scores. Additional results for LLaMA model variants are provided in Appendix § C . We observe that while overall trends are similar directionally across variants: covert biases are not consistently amplified in the covert setting, but remain pronounced in the overt setting. Warning: This paper includes examples of offensive stereotypes based on dialect. Language model (LM) responses are shaped by the linguistic characteristics of the queries, such as choice of words, tone, and grammar ( 19 ; 11 ) . Because dialect is influenced by culture, identity, and community, users from demographically diverse backgrounds may express the same intent in diverse ways, potentially leading LMs to exhibit disparate outcomes for different users ( 42 ; 6 ) . Worryingly, prior work shows that LMs exhibit dialect prejudice (e.g., through racio-linguistic stereotyping), known as dialect bias , in which negative stereotypes are attributed to African-American Vernacular English (AAVE) queries relative to Standard American English (SAE) queries. Separately, LMs have been shown to exhibit both covert dialect bias , when there are no explicit dialect labels in the queries ( 23 ) , as well as overt dialect bias , where explicit dialect labels, such as group labels or identity attributes, are included in the model context ( 23 ) . Previous work has shown both these types of bias exist independently, but have not compared their intensity, i.e., whether models exhibit more bias in overt versus covert settings. 23 addresses covert dialect bias by introducing matched-guise probing, in which LMs are prompted to make judgments about a speaker based on intent-equivalent AAVE and SAE texts. They consider both meaning-matched settings, where AAVE and SAE texts are semantically equivalent, and non-meaning-matched settings that reflect real-world correlations between dialect and topic content, demonstrating that LMs associate AAVE texts with more negative traits than SAE texts. However, their setup is limited to evaluating biases when models are asked to generate traits for a single dialect in isolation, rather than making explicit comparisons between dialects. In real-world settings such as hiring, education, content moderation, and judicial decision-making ( 7 ; 33 ; 45 ) , models are often asked to compare texts side by side and make contrastive judgments about texts ( 15 ) . In addition, while 23 show that existing mitigation strategies such as scaling model size or including human feedback in training are ineffective for reducing covert dialect bias, they do not explore alternative mitigation approaches. In contrast, our work compares overt and covert dialect bias under two settings: absolute and contrastive . In the absolute setting (§ 4.1.1 ), we prompt LMs to rate SAE and AAVE tweets separately. In the contrastive setting (§ 4.2.1 ), SAE and AAVE tweets are presented side by side, reflecting real-world contexts in which models are asked to compare, rank, or choose between multiple users or inputs. We ground our findings in existing stereotype research from the Princeton Trilogies 1 1 1 A series of studies investigating social, cultural and ethnic stereotypes and socio-psychological literature ( 26 ; 18 ; 25 ) . Specifically, rather than relying on free-form trait generation, we prompt LMs to rate the content of each tweet 2 2 2 We do not attribute AAVE or SAE speakers to explicit demographic groups. We intentionally prompt the model to make its judgment based on the linguistic form of the tweet and in the overt condition, we provide dialect labels to avoid mapping the dialect to demographic groups. using a Likert scale on a closed set of 12 stereotypical traits as illustrated in Figure 1 . We selected six valence pairs: Intelligence/Stupidity , Calmness/Aggression , Sophistication/Unsophistication , Politeness/Rudeness , Articulation/Incoherence , and Determination/Laziness . Lastly, we propose counterfactual fairness finetuning ( 29 ; 27 ) (§ 4.3 ) as an effective technique to mitigate covert dialect bias. To this end, we ask the following research questions in our work: RQ1: Does evaluating AAVE and SAE tweets side by side (contrastive prompting) amplify dialect bias in LMs compared to isolated evaluation (absolute prompting)? RQ2: Can counterfactual fairness finetuning mitigate covert dialect bias in LMs? In doing so, we made the following main contributions: (1) In addressing RQ1 (§ 4.1 , § 4.2 ), we measure covert dialect biases under two settings (absolute and contrastive) using the matched guise probing technique (e.g. A person who