AccessEval: Benchmarking Disability Bias in Large Language Models

Srikant Panda, Amit Agarwal, Hitesh Laxmichand Patel · 2025

Read AccessEval: Benchmarking Disability Bias in Large Language Models by Srikant Panda, Amit Agarwal, Hitesh Laxmichand Patel (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2509-22703.txt.

Introduction

Srikant Panda, Amit Agarwal, and Hitesh Laxmichand Patel benchmark disability bias across twenty-one language models. Their benchmark, AccessEval, spans six real-world domains and nine disability types. Each query comes in two forms: a neutral version and a disability-aware version. Outputs are scored for sentiment, social perception, and factual accuracy.

Responses to disability-aware queries skewed more negative in tone. They also showed more stereotyping and more factual errors than neutral replies. The gaps varied by domain and disability type. Hearing, speech, and mobility disabilities were hit hardest. The authors argue these patterns reflect ableism in model behavior with tangible harms for disabled users. The data set is public.

Catalog record

CREATORSrikant Panda, Amit Agarwal, Hitesh Laxmichand Patel
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE94 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2509-22703

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

AccessEval: Benchmarking Disability Bias in Large Language Models Srikant Panda, Amit Agarwal, Hitesh Laxmichand Patel Abstract Large Language Models (LLMs) are increasingly deployed across diverse domains but often exhibit disparities in how they handle real-life queries. To systematically investigate these effects within various disability contexts, we introduce AccessEval (Accessibility Evaluation) , a benchmark evaluating 21 closed- and open-source LLMs across 6 real-world domains and 9 disability types using paired Neutral and Disability-Aware Queries. We evaluated model outputs with metrics for sentiment, social perception, and factual accuracy. Our analysis reveals that responses to disability-aware queries tend to have a more negative tone, increased stereotyping, and higher factual error compared to neutral queries. These effects show notable variation by domain and disability type, with disabilities affecting hearing, speech, and mobility disproportionately impacted. These disparities reflect persistent forms of ableism embedded in model behavior. By examining model performance in real-world decision-making contexts, we better illuminate how such biases can translate into tangible harms for disabled users. This framing helps bridges the gap between technical evaluation and user impact, reinforcing importance of bias mitigation in day-to-day applications. Our dataset is publicly available at: https://huggingface.co/datasets/Srikant86/AccessEval 1 Introduction LLMs have achieved remarkable advances in natural language understanding and generation OpenAI et al. 2023 ; Brown et al. 2020 . As they become increasingly embedded in real-world decision-making & assistive technologies, their social impact continues to expand. However, growing concerns remain about fairness and bias in these models, particularly regarding their potential to reinforce societal inequalities Sun et al. 2023 ; Wan et al. 2023 ; Kumar et al. 2024 . Extensive research has explored biases related to gender, race, and political ideology Bolukbasi et al. 2016 ; Fulay et al. 2024 , leading to significant advancements in fairness-aware AI. Despite more than 1.3 billion people around the world experiencing some sort of disability World Health Organization 2023 , disability bias remains fairly under-examined. Unlike other demographic biases, disability bias manifests itself in distinct and often subtle ways Panda et al. 2025a . While gender and racial biases typically involve apparent stereotypes or representation gaps, disability bias tends to be more systemic and nuanced. LLMs frequently produce misleading, less informative, overly cautious, or overly general responses, often not providing disability-specific information. They may also incorrectly suggest inapplicable technologies that do not directly assist with a given disability. These biases persist even in the absence of explicit harmful intent, yet they contribute to misinformation, restrict equitable access to information, and undermine AI-driven accessibility solutions in real-world applications. Existing fairness benchmarks focus mainly on biases related to gender, race, and political ideology Abid et al. 2021 ; Panda et al. 2025b . Although efforts such as AUTALIC Rizvi et al. 2024 and BITS Venkit et al. 2023 have examined explicit ableism in AI-generated text, they remain limited in scope. Most prior datasets focus on specific disability groups, emphasize explicit rather than subtle biases, or lack comparative frameworks to assess whether LLM responses degrade when disability is referenced. As a result, current methodologies fail to capture the full spectrum of biases that can emerge in AI systems deployed in real-world settings. To address these gaps, we introduce AccessEval , a evaluation framework to systematically assess disability bias in LLMs. Our contributions include: • Dataset of paired neutral and disability aware queries, from 6 domains & 9 disability types. • An evaluation framework that incorporates 3 bias assessment metrics, including VADER Score, Regard Score, and LLM Judge . • An evaluation of total 21 closed- and open- source models. Our analysis reveals systematic bias in responses to disability aware queries, including higher factual errors, more negative tone, and increased stereotyping compared to neutral queries • We validated LLM Judge’s reliability as an automated assessment tool through statistical correlation with human annotations. Our findings highlight the prevalence of disability bias in AI systems, and AccessEval enables researchers to quantify disability bias, fostering more inclusive and socially responsible NLP systems. 2 Related Work With the rapid integration of LLMs into everyday products and workflows, scholarly attention to their social impacts especially bias has accelerated (see Appendix A ). Examples include applications in document processing Xu et al. 2019 ; Agarwal et al. 2025 , resume screening Raghavan et al. 2019 , and medical decision support Deo and Borgwardt 2015 . Within this growing literature, however, research specifically on disability bias remains comparatively sparse. Prior work on adjacent AI systems, such as AI-driven hiring platforms and healthcare recommendation tools, documents disproportionate screening of disabled candidates and inaccuracies in accessibility-related guidance Hutchinson et al. 2020 . Yet, to our knowledge, there has been no comprehensive effort to benchmark and quantify disability bias across multiple domains in LLMs themselves. This gap motivates the present study. Figure 1: Overview of our proposed AccessEval Pipeline. Disability Bias in NLP and AI Systems Despite increasing attention to fairness in AI, disability bias remains significantly underexplored compared to other demographic biases. Prior efforts have primarily focused on detecting explicit ableist language. AUTALIC dataset Rizvi et al. 2024 targets anti-autistic ableist expressions, while the BITS dataset Venkit et al. 2023 examines explicit ableism in the generated text. Li et al. 2024 paper examines ableist biases in large language models (LLMs) by exploring how disability intersects with gender and social class. The study evaluates bias using two tasks: Persona Creation and Story Generation. Although all these datasets provide valuable insights, they exhibit notable limitations. They primarily focus on detecting readily apparent ableism rather than measuring subtle forms of bias, such as response avoidance or over cautious framing. Additionally, they are constrained either to small subset of disabilities, predominantly autism and neurodivergence, limiting their generalizability. Additionally, they don’t offer a comparison framework for examining how LLM replies deteriorate across several domains when asked questions with context connected to disabilities. Other studies have noted broader issues with disability representation in AI Hutchinson et al. 2020 , emphasizing the lack of comprehensive benchmarks to evaluate how AI models respond to disabled individuals in diverse real-world contexts. Recent work highlights that while LLMs are increasingly used for accessibility guidance, many disability groups remain underserved by their advice Dash et al. 2025 . Unlike prior datasets, our work systematically measures how LLM-generated responses change when disability-related terms are introduced, capturing both explicit and implicit biases across a wider range of disabilities and domains. Bias Evaluation Metrics in NLP Measuring bias in NLP models has been approached using a variety of techniques, from word embedding to full-scale text generation analysis. Lexical-based sentiment analysis tools such as VADER Hutto and Gilbert 2015 are commonly used for bias detection, while sentiment-based metrics such as the Regard Score Sheng et al. 2019 assess stereotypes and sentiment polarity in generated text. More recently, LLM Judge has been proposed as an automated evaluation mechanism, where a language model is used to assess the coherence, fairness and quality of responses from another model Gu et al. 2025 . The LLM Judge framework has gained traction in assessing text generation fairness Liang et al. 2022 , but concerns remain regarding its reliability due to potential self-reinforcing biases in LLM-based evaluations Bedemariam et al. 2025 . To address these concerns, we performed statistical correlation tests comparing

Read the complete text