“Accessibility people, you go work on that thing of yours over there”: Addressing Disability Inclusion in AI Product Organizations

Sanika Moharana, Cynthia L. Bennett, Erin Buehler, Michael Madaio, Vinita Tibdewal, Shaun K. Kane · 2025

Read “Accessibility people, you go work on that thing of yours over there”: Addressing Disability Inclusion in AI Product Organizations by Sanika Moharana, Cynthia L. Bennett, Erin Buehler, Michael Madaio, Vinita Tibdewal, Shaun K. Kane (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2508-16607.txt.

Introduction

Sanika Moharana and five co-authors published this paper in 2025. The title quotes a line the authors heard in the field: accessibility staff told to go work on their own thing, apart from the main team. The study asks how AI product groups handle disability inclusion as generative AI spreads.

The team interviewed twenty-five AI workers across engineering, research, design, and responsible AI roles. Workers described friction when fairness work and accessibility work pulled against each other. Rules from the two fields sometimes clashed, and data on disabled users was thin. Much of the progress rested on informal volunteer groups inside companies. The authors offer practical changes: better shared guidance, better data, and a real seat for accessibility staff in product decisions.

Catalog record

CREATORSanika Moharana, Cynthia L. Bennett, Erin Buehler, Michael Madaio, Vinita Tibdewal, Shaun K. Kane
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE59 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2508-16607

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

“Accessibility people, you go work on that thing of yours over there”: Addressing Disability Inclusion in AI Product Organizations Sanika Moharana, Cynthia L. Bennett, Erin Buehler, Michael Madaio, Vinita Tibdewal, Shaun K. Kane Abstract The rapid emergence of generative AI has changed the way that technology is designed, constructed, maintained, and evaluated. Decisions made when creating AI-powered systems may impact some users disproportionately, such as people with disabilities. In this paper, we report on an interview study with 25 AI practitioners across multiple roles (engineering, research, UX, and responsible AI) about how their work processes and artifacts may impact end users with disabilities. We found that practitioners experienced friction when triaging problems at the intersection of responsible AI and accessibility practices, navigated contradictions between accessibility and responsible AI guidelines, identified gaps in data about users with disabilities, and gathered support for addressing the needs of disabled stakeholders by leveraging informal volunteer and community groups within their company. Based on these findings, we offer suggestions for new resources and process changes to better support people with disabilities as end users of AI. Introduction The tech industry is increasingly orienting itself around developing and propagating generative AI (genAI) models, integrating them into mainstream applications and operating systems. Simultaneously, software companies and community organizations are raising concerns about AI’s potential impacts on society, including effects on education ( Anthropic 2025 ; OpenAI Staff 2025 ; Holmes and Porayska-Pomsta 2023 ) and employment ( Demirci, Hannane, and Zhu 2024 ; Kochhar 2023 ) . Specific attention has also been placed on AI’s negative impacts on marginalized groups. These concerns are marked by high profile examples of AI-based discrimination through race, ethnicity, gender, and other sociodemographics, such as the racist labeling of photos ( Hern 2018 ; Mac 2021 ) . In response, researchers have conducted various studies to understand and mitigate these harms ( Buolamwini and Gebru 2018 ) , while companies have implemented responsible AI (RAI) guidelines (e.g., Microsoft 2025 ; Google 2025 ) and have even withdrawn products due to problematic AI output ( Grant 2024 ) . Journalists covering AI impacts have also reported on AI’s role in perpetuating discrimination against people with disabilities (e.g., e smith 2024 ; Lecher 2018 ). Advances in technology often lead to new barriers for people with disabilities (hereafter PWD) ( Williamson 2019 ; Holmes and Maeda 2020 ) . Researchers have identified a breadth of negative impacts downstream from AI applications, in domains from housing to employment to education ( Trewin et al. 2019 ; Aboulafia and Claypool 2025 ) . For example, the user interface for AI chatbots may be inaccessible ( Torres, Franklin, and Martins 2019 ) , and AI resume reviewers have been shown to demonstrate ableist bias ( Glazko et al. 2024 ) . These concerns are effectively expressed by Trewin et al. 2019 stating, “the prospects of AI for PWD are promising yet fraught with challenges.” Simultaneously, widespread reputable digital accessibility best practices such as the Web Content Accessibility Guidelines (WCAG) do not yet cover novel interactions and outputs generated by emergent AI systems ( Montgomery et al. 2024 ) . For example, they do not provide guidance in ensuring accessibility of model outputs, which are often the defining novel features of genAI tools like large language models (LLMs), nor do they advise developers on mitigating disability representation biases pervasive in these outputs ( Gadiraju et al. 2023 ) . Thus, there is an opportunity to understand how AI practitioners currently approach disability inclusion in their work, what gaps remain in AI product organizations, and how we should ensure future AI systems are inclusive of users with disabilities. Our research is guided by the following questions: • RQ1: How are AI practitioners encountering disability and accessibility exclusion in genAI product development? • RQ2: What obstacles do AI practitioners encounter in identifying and handling disability and accessibility? • RQ3: What strategies do AI practitioners leverage to successfully handle disability and accessibility exclusion? To investigate these questions, we conducted a semi-structured interview study with 25 AI practitioners at a large software company, to discuss how AI is changing the work that they do, and particularly how their work may or may not be inclusive of disabled people. Participants held a range of roles, including engineers, researchers, UX practitioners, and people working in the responsible AI space (e.g., safety analysts) (see Table 1 ). We found: • Decisions that may affect users with disabilities may appear across a variety of work contexts that lie outside the bounds of traditional accessibility roles, including model development and safety evaluation; • Existing practices around AI safety and responsibility evaluation may emphasize specific identity categories, and conversely pay less attention to users with disabilities as stakeholders; • Existing methods for evaluating and verifying accessibility may be ineffective, due to not being used, not being prioritized, or lacking in guidelines relevant to AI. These findings point to a broader need to reconsider and understand accessibility and disability inclusion in the context of AI. Specifically, this work contributes: • The first study of how AI practitioners navigate disability and accessibility in generative AI product development; • Identification of gaps in how problems impacting users with disabilities may be overlooked in AI; • Suggestions from practitioners for improving how users with disabilities are accounted for in the AI development and release process. Related Work Studies of Accessibility Practitioners While the International Association of Accessibility Professionals has issued over 8500 certifications ( IAAP 2025 ) —there exists relatively limited scholarship on the work they perform. Early studies of web professionals ( Lazar, Dudley-Sponaugle, and Greenidge 2004 ; Rosson et al. 2005 ) , product designers ( Vanderheiden and Tobias 1998 ) , and UX experts ( Putnam et al. 2012 ; Yesilada et al. 2015 ) noted that adherence to accessibility standards was low, citing barriers including confusing guidelines, lack of time, training, and support from managers. Other studies have examined professional practices around accessibility within specific communities or regions (e.g., Freire, Russo, and Fortes 2008 ; AlMeraj et al. 2023 ; Inal, Rızvanoğlu, and Yesilada 2019 ; Gupta, Gjøsæter, and Giannoumis 2021 ). Across these examples, researchers identified challenges including insufficient time, educational resources, and knowledge of available accessibility tools. Similar challenges persist today, although the rise of social networking communities has provided additional peer support and learning opportunities ( Huq et al. 2023 ) . More recent studies have focused on the motivations and work conducted by accessibility professionals. Shinohara et al. Shinohara et al. 2018 found that about half of the US education institutions they reached out to had at least one accessibility educator, but their work was sometimes limited by unclear objectives and insufficient curriculum development support. Leitner et al. Leitner, Strauss, and Stummer 2016 surfaced three motivators of industry accessibility professionals: economic (e.g., increasing the customer base), demonstrating social commitments, and technical (e.g., improving site design). However, Azenkot et al. Azenkot, Hanley, and Baker 2021 and Pereira and Duarte Seixas Pereira and Duarte 2025 surfaced the advocacy required of accessibility professionals; ( Azenkot, Hanley, and Baker 2021 ) noted that educating others was a core job function. Challenges cited by ( Seixas Pereira and Duarte

Read the complete text