The Impact of Disability Disclosure on Fairness and Bias in LLM-Driven Candidate Selection
Mahammed Kamruzzaman, Gene Louis Kim · 2025
Read The Impact of Disability Disclosure on Fairness and Bias in LLM-Driven Candidate Selection by Mahammed Kamruzzaman, Gene Louis Kim (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2506-00256.txt.
Introduction
Mahammed Kamruzzaman and Gene Louis Kim test how disability notes affect hiring choices made by language models, in a study from two thousand twenty-five. Fake candidates were matched on sex, race, skill, and work history. The jobs were ones where hiring gaps by disability are small.
Models kept picking the candidate who said they had no disability. Candidates who shared that they had a disability fared worse. Even candidates who said nothing about disability did worse than those who clearly said they had none. The result raises fair-use worries for firms that let models screen job seekers.
Catalog record
| CREATOR | Mahammed Kamruzzaman, Gene Louis Kim |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 27 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2506-00256
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
The Impact of Disability Disclosure on Fairness and Bias in LLM-Driven Candidate Selection Mahammed Kamruzzaman, Gene Louis Kim Abstract As large language models (LLMs) become increasingly integrated into hiring processes, concerns about fairness have gained prominence. When applying for jobs, companies often request/require demographic information, including gender, race, and disability or veteran status. This data is collected to support diversity and inclusion initiatives, but when provided to LLMs, especially disability-related information, it raises concerns about potential biases in candidate selection outcomes. Many studies have highlighted how disability can impact CV screening, yet little research has explored the specific effect of voluntarily disclosed information on LLM-driven candidate selection. This study seeks to bridge that gap. When candidates shared identical gender, race, qualifications, experience, and backgrounds, and sought jobs with minimal employment rate gaps between individuals with and without disabilities (e.g., Cashier, Software Developer), LLMs consistently favored candidates who disclosed that they had no disability. Even in cases where candidates chose not to disclose their disability status, the LLMs were less likely to select them compared to those who explicitly stated they did not have a disability. Our dataset and code are available at: https://github.com/kamruzzaman15/Disability-Disclosure-effect-on-LLM 0 0 footnotetext: This work has been accepted at The 38th International FLAIRS Conference (FLAIRS 2025). Introduction LLMs are being increasingly utilized in workforce recruitment and human resource management, offering the potential to optimize tasks like resume screening and candidate assessment [ 2023 , 2023 , 2023 ] . However, emerging research indicates that these models can inadvertently perpetuate biases, particularly against individuals with disabilities. Previous studies found that LLMs exhibited prejudice towards resumes with disability-related enhancements and often mirror subtle yet harmful stereotypes encountered by individuals with disabilities [ 2024 , 2023 , 2024 , 2022 ] . These biases are not isolated to disability alone; LLMs have also been shown to reflect prejudices related to age, race, and gender [ 2023 , 2019 , 2024 ] . The act of disclosing a disability in the workplace is complex and involves nuanced decisions shaped by various factors such as stigma, identity, and anticipated reactions from employers or colleagues. Research highlights that individuals carefully weigh the risks and benefits of disclosure, including the potential for discrimination, stereotyping, or even unintended biases in workplace interactions [ 2010 , 2019 , 2020 , 2018 ] . Our research builds on these findings by investigating how disability disclosure, influences candidate selection in LLM-based recruitment systems. This exploration aims to shed light on how such models interact with sensitive personal information and to develop strategies to mitigate biases, ensuring equitable treatment for individuals with disabilities in AI-mediated hiring decisions. Many companies request demographic information, such as gender, race, and disability status, during the hiring process, often under the premise of supporting diversity and inclusion initiatives. While previous studies have primarily focused on the impact of disability in traditional CV screening, this paper extends the inquiry by examining how demographic information, specifically disability disclosure, often requested separate from the CV in the hiring process, influences LLM-driven candidate selection. Our study focuses in on disability disclosure by comparing candidates with identical qualifications. By doing so, we aim to uncover the ethical implications of LLM decision-making and provide insights into how these systems can be designed to ensure fairness, inclusivity, and equitable treatment for all candidates. In this research paper, we address three pivotal research questions. RQ1: What is the impact of disability disclosure on the fairness of LLM-driven candidate selection processes? RQ2: How does disability disclosure intersect with affects of gender in LLM-driven candidate selection? RQ3: How does disability disclosure intersect with affects of race in LLM-driven candidate selection? Names and Occupations Collection We collect 320 first names, and corresponding race and gender from ? ( ? ). The dataset includes names associated with two genders (male and female) and four racial groups (White, Black, Hispanic, and Asian). We select 16 occupations from U.S. Bureau of Labor Statistics. To ensure that job position is not a confounding factor in the results, this study focuses on occupation categories where the difference in employment rates between “Persons with a disability” and “Persons without a disability” is less than 2%, 1 1 1 https://www.bls.gov/news.release/disabl.t03.htm and collect the specific occupation names from Occupational Employment and Wage Statistics. 2 2 2 https://www.bls.gov/oes/current/oes_stru.htm The occupations that we used in our study are Software Developer (Soft Dev.), Data Scientist (Data Sci.), Administrative Services Manager (Admin Mgr.), Financial Manager (Finance Mgr.), Human Resources Specialist (HR Spec.), Market Research Analysts and Marketing Specialist (Mkt Analyst.), Forest and Conservation Technician (Forest Tech.), Sociologist, Educational, Guidance, and Career Counselor and Advisor (Career Couns.), Paralegals and Legal Assistant (Legal Asst.), Library Technician (Lib Tech.), Commercial and Industrial Designer (Ind Designer.), Art Director (Art Dir.), Cashier, Insurance Sales Agent (Ins Sales.), Customer Service Representative (Cust Serv.). Experimental Setup We use 5 different LLMs in our experiments namely GPT4o-mini, Gemma2-9B, Mistral-7B, Qwen2.5-7B, Llama3.2-3B. We use all the default parameters to run these models in our experiments. Figure 1: Model-wise results for candidate selection of Experiment 1. Figure 2: Model-wise results for candidate selection of Experiment 2. Experiment 1 Candidate Profile Creation. We created three profiles, differing only in their disability disclosure information. We provide three options for disability disclosure, reflecting common hiring practices: ‘Yes, I have a disability or have had one in the past’ , ‘No, I do not have a disability and have not had one in the past’ , and ‘I do not want to answer’ . To isolate the impact of disability disclosure on LLM behavior, we kept all other attributes—such as candidate name, gender, and race information— identical to ensure these factors did not influence the results. In this experiment, one candidate profile disclosed ‘Yes, I have a disability or have had one in the past’, one disclosed ‘No, I do not have a disability and have not had one in the past’, and another disclosed ‘I do not want to answer’. We also explicitly mention that all the candidates have identical qualifications, education, and experience. The baseline task prompt for this experiment 1 is: “Select only one candidate from the following list of candidates you deem most appropriate for the { Occupation } position. The candidates possess similar qualifications, education, and experience…” Additionally, we use three prompting templates: one baseline and two that involve rephrased versions of the baseline ( rephrase prompt 1 : Choose the candidate you consider the most suitable for the {Occupation} position from the list provided. All candidates have comparable qualifications, education, and experience…; rephrase prompt 2 : Choose the single candidate from the following list whom you consider most suitable for the {Occupation} position. All candidates have comparable qualifications, education, and experience…) and report our results averaged across all three prompting templates. The gender disclosure options we used are: ‘Male’ , ‘Female’ , and ‘I choose not to disclose’ . The race disclosure options we used are: ‘White’ , ‘Black’ , ‘Hispanic’ , ‘Asian’ , and ‘I choose not to disclose’ . 3 3 3 We used four race categories as the collected names are from these 4 racial groups. See Exp.1’s candidate profile in Table 1 for an example. We have 102k samples for experiment