I Think, Therefore I Am Under-Qualified? A Benchmark for Evaluating Linguistic Shibboleth Detection in LLM Hiring Evaluations

Julia Kharchenko, Tanya Roosta, Aman Chadha, Chirag Shah · 2025

Read I Think, Therefore I Am Under-Qualified? A Benchmark for Evaluating Linguistic Shibboleth Detection in LLM Hiring Evaluations by Julia Kharchenko, Tanya Roosta, Aman Chadha, Chirag Shah (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2508-04939.txt.

Introduction

Four authors build a hire-bias test for language models in 2025. Small speech marks can leak who a speaker is, by sex, class, or home zone, and models may dock those marks in job reads. One hundred checked ask-answer pairs drive mock talks with set speech tweaks.

Hedged words, with like facts, drew scores about a quarter low on mean in the tests. Score gaps split by model, which lets the bench name which builds dock which marks. The frame aims at fair auto calls in hire and past it.

Catalog record

CREATORJulia Kharchenko, Tanya Roosta, Aman Chadha, Chirag Shah
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE66 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2508-04939

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

I Think, Therefore I Am Under-Qualified? A Benchmark for Evaluating Linguistic Shibboleth Detection in LLM Hiring Evaluations Julia Kharchenko, Tanya Roosta, Aman Chadha, Chirag Shah Abstract This paper introduces a comprehensive benchmark for evaluating how Large Language Models (LLMs) respond to linguistic shibboleths: subtle linguistic markers that can inadvertently reveal demographic attributes such as gender, social class, or regional background. Through carefully constructed interview simulations using 100 validated question-response pairs, we demonstrate how LLMs systematically penalize certain linguistic patterns, particularly hedging language, despite equivalent content quality. Our benchmark generates controlled linguistic variations that isolate specific phenomena while maintaining semantic equivalence, which enables the precise measurement of demographic bias in automated evaluation systems. We validate our approach along multiple linguistic dimensions, showing that hedged responses receive 25.6% lower ratings on average, and demonstrate the benchmark’s effectiveness in identifying model-specific biases. This work establishes a foundational framework for detecting and measuring linguistic discrimination in AI systems, with broad applications to fairness in automated decision-making contexts. 1 Introduction As artificial intelligence (AI) systems increasingly mediate high-stakes decisions, the detection and mitigation of subtle biases has become a critical challenge Mehrabi et al. 2022 ; Obermeyer et al. 2019 ; Angwin et al. 2016 ; Borah and Mihalcea 2024 . Although explicit demographic discrimination is often readily identifiable, many AI systems exhibit bias through linguistic shibboleths: linguistic markers that correlate with demographic characteristics without explicitly referencing them Blodgett et al. 2020 ; Bolukbasi et al. 2016 ; Hovy 2015 ; Larson 2017 . These phenomena, ranging from hedging patterns to accent markers, can serve as inadvertent proxies for protected attributes, enabling discrimination that appears linguistically neutral but has a disparate impact in different demographics Sap et al. 2022 ; Dinan et al. 2020 ; Buolamwini and Gebru 2018 ; Shah et al. 2020 ; Chandu et al. 2019 . The challenge of shibboleth detection is particularly acute in employment contexts, where automated screening systems are becoming more common Raghavan et al. 2020 ; Ajunwa et al. 2016 ; Parasurama and Ipeirotis 2025 ; Sánchez-Monedero et al. 2020 ; Kroll 2017 . Research has shown that women use hedging language more frequently than men in professional settings, with female interviewees using an average of 22.1 hedges per 1000 words compared to 20.32 for men Arnell 2020 ; Holmes 1990 ; Lakoff 1973 ; Coates 2015 ; Tannen 1994 . Similarly, linguistic research demonstrates that accent patterns, article usage, and other speech markers can correlate with regional, class, and ethnic backgrounds Labov 1973 ; Hall and Coupland 2009 ; Fought 2003 ; Rickford 1999 . When AI systems are trained on data that reflect human biases against these linguistic patterns, they risk perpetuating systemic discrimination in new and less detectable forms Barocas and Selbst 2016 ; Sandvig et al. 2014 ; Mehrabi et al. 2022 ; Noble 2018 ; Eubanks 2018 . This paper presents a comprehensive benchmark designed to detect and measure how LLMs respond to linguistic shibboleths in evaluative contexts Bommasani et al. 2022 . Our approach focuses on the systematic construction of controlled linguistic variations that maintain semantic equivalence while isolating specific sociolinguistic phenomena Moradi and Samwald 2021 ; Doshi-Velez and Kim 2017 ; Prabhakaran et al. 2019 ; Garg et al. 2018 ; Caliskan et al. 2017 ; Wang et al. 2022 . We demonstrate this methodology through hedging language patterns and establish a framework that can be extended to other linguistic shibboleths, including accent markers, register variations, and syntactic patterns associated with different demographic groups Blodgett et al. 2021 ; Dinan et al. 2021 ; Davidson et al. 2019 ; Kiritchenko and Mohammad 2018 . This paper addresses three key research questions: 1. How can we systematically detect and measure LLM responses to linguistic shibboleths that serve as inadvertent proxies for demographic characteristics in evaluative contexts? 2. What methodology can effectively isolate specific sociolinguistic phenomena while maintaining semantic equivalence to enable fair bias assessment? 3. How can our approach be extended beyond hedging patterns to detect other linguistic shibboleths, including accent markers, register variations, and demographic-correlated syntactic patterns? Our datasets and codebase will be released to the public as free and open-source. 2 Related Work and Theoretical Foundation Understanding how language patterns can inadvertently signal demographic characteristics is essential for building fair AI evaluation systems Bender et al. 2021 ; Hovy and Prabhumoye 2021 ; Shah et al. 2020 . This section examines the sociolinguistic foundations of demographic shibboleths and how these subtle markers can lead to systematic discrimination in automated assessments Selbst et al. 2019a ; Binns 2021 ; Corbett-Davies et al. 2017 . 2.1 Linguistic Shibboleths as Demographic Markers The term "shibboleth" originates from a biblical account where pronunciation differences were used to identify group membership, ultimately determining life or death outcomes. To prevent fleeing Ephraimites from crossing the Jordan River during a blockade, the Gileadites tested whether fleeing individuals could pronounce the word "shibboleth". The Ephraimites spoke a dialect with a different pronunciation, so they would say "sibboleth", identifying them as the enemies Chambers 2003 ; Trudgill 2000 . In sociolinguistics, shibboleths encompass any linguistic feature that can signal social identity, often unconsciously Niedzielski and Preston 2000 ; Silverstein 2003 ; Eckert 2008 . These markers are subtle indicators of demographic characteristics, creating what Labov termed "linguistic stratification" where language variations correlate with social positioning Labov 1973 ; Labov 2001 ; Labov 2006 . Research shows that hedging patterns are a good example of gender shibboleths Mills 2003 ; Holmes and Wilson 2022 . Women consistently employ more hedging devices across cultures and contexts, using phrases such as "I think," "perhaps," and "it seems" more frequently than men Arnell 2020 ; Leaper and Robnett 2011 ; Palomares 2008 ; Carli 1990 . Critically, these patterns persist even when controlling for confidence levels and domain expertise, suggesting that they reflect learned communicative strategies rather than genuine uncertainty Schmauss and Kilian 2023 . Studies on job interviews show that women use lexical hedges more frequently than men KARPOWITZ et al. 2012 ; Mendelberg et al. 2014 . On average, female interviewees used 22.1 hedges per 1000 words, compared to 20.32 for men. Women also relied more on lexical verbs (10.95 per 1000 vs. 6.96), while men used adverbs and modal verbs slightly more often Arnell 2020 . These patterns are consistent across professional domains, from academic presentations to corporate boardrooms Nemeth 2002 ; Okimoto and Brescoll 2010 . We discuss more of another case of demographic shibboleths, accent patterns, in Appendix A.1 . 2.2 The Problem of Shibboleth-Based Discrimination The tricky nature of shibboleth-based discrimination lies in its apparent neutrality Friedman and Nissenbaum 2017 ; Nissenbaum 1996 ; Winner 1980 . An AI system that penalizes "uncertain" language patterns appears to make quality-based distinctions rather than demographic ones Selbst et al. 2019b ; Binns 2021 ; Wachter et al. 2021 . However, when these linguistic patterns strongly correlate with protected characteristics, the result can be systematic demographic discrimination disguised as fair evaluation Barocas and Selbst 2016 ; Chouldechova 2016 ; Hardt et al. 2016 . For example, the interpretation of hedging varies by context Hyland 1996 ; Salager-Meyer 2011 . In scientific discourse, hedging is a valuable linguistic tool that

Read the complete text