LLM impact on BLV programming
Prashant Chandrasekar, Mariel Couvillion, Ayshwarya Saktheeswaran, Jessica Zeitz · 2025
Read LLM impact on BLV programming by Prashant Chandrasekar, Mariel Couvillion, Ayshwarya Saktheeswaran, Jessica Zeitz (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2504-17018.txt.
Introduction
Blind and low-vision programmers gain and lose ground with language model tools, Prashant Chandrasekar and co-authors report in a 2025 study. Language models are now integral to many tools and workflows in software development. They help professionals and students write code, and that reliance is reshaping how programming work gets done in teams and in classrooms.
Prior literature shows models ease some challenges for blind and low-vision developers, yet introduce new forms of inaccessibility. The team evaluated five popular model-powered development environments across a broad set of programming tasks. They found unsupported scenarios, incorrect model output, and limits in interaction support. Observations of blind developers coding add first-hand evidence. Readers get a clear map of where these tools fail their users.
Catalog record
| CREATOR | Prashant Chandrasekar, Mariel Couvillion, Ayshwarya Saktheeswaran, Jessica Zeitz |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 35 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2504-17018
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
LLM impact on BLV programming Prashant Chandrasekar, Mariel Couvillion, Ayshwarya Saktheeswaran, Jessica Zeitz Abstract . Large Language Models (LLMs) are rapidly becoming integral to a wide range of tools, tasks, and problem-solving processes, especially in software development. Originally designed for natural language processing tasks such as text generation, LLMs are increasingly being used to assist both professionals and students in writing code. This growing reliance on LLM-based tools is reshaping programming workflows and task execution. In this study, we explore the impact of these technologies on blind and low-vision (BLV) developers. Our review of existing literature indicates that while LLMs help mitigate some of the challenges faced by BLV programmers, they also introduce new forms of inaccessibility. We conducted an evaluation of five popular LLM-powered integrated development environments (IDEs), assessing their performance across a comprehensive set of programming tasks. Our findings highlight several unsupported scenarios, instances of incorrect model output, and notable limitations in interaction support for specific tasks. Through observing BLV developers as they engaged in coding activities, we uncovered key interaction barriers that go beyond model accuracy or code generation quality. This paper outlines the challenges and corresponding opportunities for improving accessibility in the context of generative AI-assisted programming. Addressing these issues can meaningfully enhance the programming experience for BLV developers. As the generative AI revolution continues to unfold, it must also address the unique burdens faced by this community. DOI: XXXXXXX.XXXXXXX Conference: Make sure to enter the correct conference title from your rights confirmation email; June 03–05, 2018; Woodstock, NY ISBN: 978-1-4503-XXXX-X/2018/06 CCS: Human-centered computing Accessibility systems and tools CCS: Human-centered computing Accessibility theory, concepts and paradigms CCS: Human-centered computing Accessibility technologies 1. Introduction As LLMs and GenerativeAI (GenAI) have become more widely used by the public, they can be used by BLV developers to address difficulties when coding (shown in Figure 1 ). However, LLMs and GenAI introduce new problems for users and often contain accessibility issues ( Adnin and Das, 2024 ; Seo et al., 2024 ; Cheema, 2024 ; Alharbi et al., 2024 ; Pang et al., 2025 ; Penuela et al., 2025 ) . One significant issue is the difficulty BLV users may face in verifying the correctness of AI-generated code or explanations, as they cannot easily rely on visual inspection or compare results with visual representations ( Adnin and Das, 2024 ; Penuela et al., 2025 ; Seo et al., 2024 ) . In some cases, rather than simplifying tasks, these tools may complicate workflows by requiring users to navigate between multiple GenAI platforms and development environments just to read or edit responses. This can ultimately undermine the efficiency gains these technologies aim to provide ( Adnin and Das, 2024 ) . To evaluate the real-world impact, we assessed the performance of five popular LLM-powered Integrated Development Environments (IDEs) across a comprehensive set of programming tasks. This evaluation revealed various scenarios that were not adequately supported by these IDEs, as well as instances where the LLMs provided incorrect responses. A significant finding was the lack of standardization in LLM output across different IDEs for the same prompt, forcing BLV developers to grapple with the challenge of skimming these diverse responses. We conducted a user study to observe the first-hand experiences of BLV individuals using LLMs for coding-related tasks. The study involved participants working with two Python programs with introduced errors while their programming behavior, tool usage, and ChatGPT queries were observed. The goal was to understand the integration of LLMs into their existing workflows as they tackled code comprehension, editing, debugging, skimming, and navigation tasks. This direct engagement revealed specific issues such as difficulties in testing program behavior, unexpected reliance on ChatGPT’s potentially incorrect suggestions, and an apparent tendency to overlook detailed code comments, all contributing to a deeper understanding of the obstacles faced by BLV developers. The remainder of this paper is structured as follows: Section 2 provides a review of relevant literature. Section 3 details the results from our evaluation of LLM-powered IDEs. Section 4 details the study setup, including participant recruitment and the tasks assigned. We highlight key insights derived observations of the BLV developers’ programming behaviors. We collates the learnings from these interactions, alongside an overview of the current integration of LLMs into development workflows, to offer suggestions for future efforts aimed at better supporting the BLV community in programming. It is critical that the generative AI “revolution” must address the specific burdens faced by BLV developers to ensure equitable access to these powerful tools. 2. Related Efforts Table 1. Solutions and Problems Introduced by LLMs ID Issues References LLM-fix? LLM References 1 GUI interfaces (featutes/buttons) in IDEs cannot be easily navigated by BLV users ( Mountapmbeme et al., 2022 ; Potluri et al., 2018 ) Yes ( Kodandaram et al., 2024 ) 2 Table outputs from CLIs are not easily interpreted by screen readers ( Sampath et al., 2021 ) Yes ( Alharbi et al., 2024 ) 3 Screen readers make it difficult to navigate, skim, comprehend, edit, or debug code ( Mountapmbeme et al., 2022 ; Albusays and Ludi, 2016 ; Mealin and Murphy-Hill, 2012 ) Yes ( Kodandaram et al., 2024 ; Seo et al., 2024 ) 4 BLV developers cannot easily skim code ( Sampath et al., 2021 ; Mountapmbeme et al., 2022 ; Albusays and Ludi, 2016 ) Yes ( Adnin and Das, 2024 ; Pang et al., 2025 ) 5 Finding a specific element in the code can be difficult; once found, developers may lose their original place in the code ( Mealin and Murphy-Hill, 2012 ) Yes ( Adnin and Das, 2024 ; Pang et al., 2025 ) 6 Attempting to understand the structural information about code is hard to do with a screen reader ( Baker et al., 2015 ) Yes ( Adnin and Das, 2024 ; Pang et al., 2025 ) 7 Screen readers make it difficult to gain a holistic view of the code base ( Albusays and Ludi, 2016 ; Baker et al., 2015 ) Yes ( Adnin and Das, 2024 ; Pang et al., 2025 ) 8 Screen readers make it difficult to comprehend what a program is doing ( Stefik et al., 2007 ) Yes ( Adnin and Das, 2024 ; Pang et al., 2025 ) 9 Most coding tools created for BLV developers often rely on providing spatial context when semantic context is more valuable ( Stefik et al., 2009 ) Yes ( Adnin and Das, 2024 ; Pang et al., 2025 ) 10 Most built-in debugging tools are inaccessible, so many BLV developers rely on basic techniques ( Albusays et al., 2017 ; Mealin and Murphy-Hill, 2012 ; Albusays and Ludi, 2016 ; Sampath et al., 2021 ; Mountapmbeme et al., 2022 ; Potluri et al., 2018 ; Baker et al., 2015 ) Yes ( Adnin and Das, 2024 ; Pang et al., 2025 ) 11 Modern IDEs have inaccessible debugging tools ( Mountapmbeme et al., 2022 ; Albusays and Ludi, 2016 ) Yes ( Kodandaram et al., 2024 ) 12 BLV developers often lose their place when editing code directly in the source file ( Mountapmbeme et al., 2022 ) Yes ( Adnin and Das, 2024 ; Pang et al., 2025 )