An Extension-Based Accessibility Framework for Making Blockly Accessible to Blind and Low-Vision Users

Rubel Hassan Mollik, Vamsi Krishna Kosuri, Hans Djalali, Stephanie Ludi, Aboubakar Mountapmbeme · 2026

Read An Extension-Based Accessibility Framework for Making Blockly Accessible to Blind and Low-Vision Users by Rubel Hassan Mollik, Vamsi Krishna Kosuri, Hans Djalali, Stephanie Ludi, Aboubakar Mountapmbeme (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2601-10688.txt.

Introduction

Rubel Hassan Mollik, Vamsi Krishna Kosuri, Hans Djalali, Stephanie Ludi, and Aboubakar Mountapmbeme work on access to block-based coding for blind and low-vision learners. Tools like Scratch and Code.org are now standard in school computer science classes. Yet they remain mostly out of reach for blind students. Their visual blocks demand sight at every step.

Past fixes changed the Blockly library itself, which made them hard to add to live platforms. The team's framework works as an extension instead, leaving the base library alone. That choice could help schools adopt it without rebuilding their tools. The goal is coding classes where blind learners build programs on equal terms.

Catalog record

CREATORRubel Hassan Mollik, Vamsi Krishna Kosuri, Hans Djalali, Stephanie Ludi, Aboubakar Mountapmbeme
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE41 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2601-10688

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

An Extension-Based Accessibility Framework for Making Blockly Accessible to Blind and Low-Vision Users Thanks: This paper has been accepted at the 1st International Workshop on User Interface and Experience for Software Engineering (UISE 2026), co-located with ICSE 2026. The final published version is available at https://doi.org/10.1145/3786169.3788398 . CCS: Human-centered computing Accessibility systems and tools CCS: Human-centered computing Accessibility technologies CCS: Human-centered computing Empirical studies in accessibility CCS: Software and its engineering Software prototyping Rubel Hassan Mollik, Vamsi Krishna Kosuri, Hans Djalali, Stephanie Ludi, Aboubakar Mountapmbeme Abstract . Block-based programming environments (BBPEs) such as Scratch and Code.org are now widely used in K-12 computer science classes, but they remain mostly inaccessible to blind or visually impaired (BVI) learners. A major problem is that prior accessibility solutions have relied on modifications to the Blockly library, making them difficult to apply in existing BBPEs and thereby limiting adoption. We present an Extension-based Accessibility Framework (EAF) to make BBPEs accessible for BVI students. The framework uses a modular architecture that enables seamless integration with existing Blockly-based BBPEs. We present an innovative three-dimensional (3D) hierarchical navigation model featuring stack labeling and block numbering, mode-based editing to prevent accidental modifications, and WAI-ARIA implementation to ensure compatibility with external screen readers. We evaluated our approach by integrating the EAF framework into two BBPEs (covering 177 test cases) and conducting semi-structured interviews with four participants using VoiceOver, JAWS, and NVDA. Participants reported clearer spatial orientation and easier mental model formation compared to default Blockly keyboard navigation. EAF shows that modular architecture can provide comprehensive accessibility while ensuring compatibility with existing BBPEs. 1. Introduction The Computer Science for All (CSForAll) ( 26 ) initiative has boosted participation in computer science (CS) and computational thinking (CT) education among K-12 students. Through this initiative, block-based programming has become widespread in K-12 CS courses. Block-based programming ( 33 ) replaces the complex syntax of text-based programming with visual, drag-and-drop blocks, making learning programming more accessible for novices. Students find visual programming more engaging and learn fundamental programming logic and computational thinking faster ( 32 ) . Platforms such as Scratch ( 25 ) , Microsoft MakeCode ( 3 ) , and Code.org ( 5 ) have emerged as block-based programming environments (BBPEs), which have become an integral part of K-12 CS curricula ( 14 ) . However, the BBPEs are not accessible to learners who are blind or visually impaired (BVI) due to their over-reliance on visual elements and animations ( 27 ) . Moreover, drag-and-drop operations like moving blocks involve mouse-based interaction and visual feedback, which is challenging for BVI learners ( 19 ) . As a result, BVI learners face barriers to participating in CS courses, which leaves them behind their sighted peers ( 20 ) . Since many popular BBPEs, such as Scratch, MakeCode, and Code.org, are built on the Blockly library, making it accessible can benefit all Blockly-based platforms. Google Blockly recently added a default keyboard navigation ( 10 ) that offers limited support for keyboard interaction. However, it remains in an experimental stage and lacks screen reader compatibility, making it inaccessible to BVI learners. While promising prototypes such as Accessible Blockly ( 21 ) and GridWorld ( 30 ) have shown potential for keyboard-based alternative navigation for BVI learners, these efforts primarily focus on small-scale programs and specific navigation tasks, with limited code editing support. Furthermore, these approaches inherit architectural constraints by modifying the Blockly codebase, which impedes interoperability and prevents integration into existing Blockly-based environments. Several implementations also rely on internal speech synthesis ( 7 ; 30 ) , which conflicts with screen readers, creating compatibility issues. This work is motivated by the need to develop an accessible solution for BBPEs that supports structured navigation and editing of complex programs while maintaining architectural modularity. We propose a novel accessibility framework that can be seamlessly integrated into Blockly-based systems without modifying the core codebase. This approach provides a scalable, interoperable, and screen reader–compatible solution, improving accessibility of BBPEs. The main contributions of this paper are as follows: • We present an Extension-based Accessibility Framework (EAF) that integrates accessibility features into Blockly-based environments. Unlike previous methods that require forking the Blockly repository, EAF extends across platforms and Blockly versions while maintaining compatibility and structural stability. • We introduce a three-dimensional (3D) navigation and editing model with stack labels and sequential block numbers. The design establishes a predictable structural navigation and editing experience for BVI learners. • We validate EAF ’s viability through integration testing with Blockly-based platforms, WCAG 2.1 accessibility compliance assessment, and expert evaluation. Our results demonstrate that EAF enables accessible block-based programming while working with external screen readers (NVDA, JAWS, VoiceOver). 2. Related Work Extensive research has been conducted to improve the accessibility of BBPEs for BVI individuals. Previous studies explored approaches that require Blockly code modification ( 21 ; 7 ; 30 ) , and extension-based architectures remain underexplored even though they have potential for modularity and maintainability ( 16 ) . Google initially offered a text-based Blockly separately for BVI users, replacing the visual drag-and-drop block UI with a text-only interface ( 15 ) . Ludi et al. ( 16 ) then proposed an alternative to the visual drag-and-drop user interface, adding keyboard input and screen reader compatibility. This effort suggested adding functionalities via files that could be applied to Blockly-based projects. Accessible Blockly ( 21 ) was developed following this approach, augmenting the Blockly codebase, which demonstrated success in navigating block-based code using keyboard and screen reader support. Google later added an experimental keyboard navigation in Blockly ( 10 ) , which makes blocks navigable using a keyboard but has no support for audio feedback or screen readers. Das et al. ( 7 ) an accessible BBPE by modifying Blockly with synthetic speech, which does not provide audio feedback for all interactions and has no support for program editing. Moumita et al. ( 30 ) took a similar approach to introduce a web application that implements Code.org’s Maze Game puzzles with a minimal set of blocks. Other researchers explored creating entirely new systems or using fundamentally different design principles to achieve accessibility ( 4 ; 17 ; 28 ) . Blocks4All ( 17 ) introduced a successful touchscreen-based BBPE specifically designed for children with visual impairments that requires specific hardware (iPad) and a Dash robot for tangible output. However, the application is not suitable for sighted learners and is incompatible with mainstream BBPEs used by K-12 learners. Similarly, OctoStudio ( 4 ) was designed with tinkerability for the Android platform, while it remains in progress. In contrast, Quorum Blocks ( 28 ) proposes a new accessible block language incorporating a hardware-accelerated graphics pipeline, but it is not purely block-based. As shown in the Table 1 , prior studies primarily employ either Blockly library modifications or new systems. These approaches face fundamental trade-offs between architectural integration and full accessibility. Blockly modification creates isolated silos and version dependencies, blocking integration with mainstream BBPEs, while new systems differ from K-12 BBPE practices. Moreover, current implementations lack structured navigation models and provide only partial support for keyboard-only interaction and screen reader feedback. These gaps underscore the need for a modular architecture with comprehensive accessibility support with full

Read the complete text