VeasyGuide: Personalized Visual Guidance for Low-vision Learners on Instructor Actions in Presentation Videos Conference: The 27th International ACM SIGACCESS Conference on Computers and Accessibility; October 26–29, 2025; Denver, CO, USA The 27th International ACM SIGACCESS Conference on Computers
Yotam Sechayk, Ariel Shamir, Amy Pavel, Takeo Igarashi · 2025
Read VeasyGuide: Personalized Visual Guidance for Low-vision Learners on Instructor Actions in Presentation Videos Conference: The 27th International ACM SIGACCESS Conference on Computers and Accessibility; October 26–29, 2025; Denver, CO, USA The 27th International ACM SIGACCESS Conference on Computers by Yotam Sechayk, Ariel Shamir, Amy Pavel, Takeo Igarashi (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2507-21837.txt.
Introduction
Yotam Sechayk, Ariel Shamir, Amy Pavel and Takeo Igarashi wrote a 2025 conference paper on a tool that highlights teacher actions in lesson videos for low-vision learners. Teachers point, mark and sketch, often without saying what they did. Low-vision students must hunt for those cues or miss them. The team co-designed the tool with three low-vision participants.
Motion sensing spots the teacher's actions as they happen. The tool then highlights and enlarges them in familiar styles. Settings adapt to each learner and subject in real time. In tests with eight low-vision learners, detection improved and mental load fell. Sighted testers also paid closer attention with it on.
Catalog record
| CREATOR | Yotam Sechayk, Ariel Shamir, Amy Pavel, Takeo Igarashi |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 85 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2507-21837
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
VeasyGuide: Personalized Visual Guidance for Low-vision Learners on Instructor Actions in Presentation Videos Conference: The 27th International ACM SIGACCESS Conference on Computers and Accessibility; October 26–29, 2025; Denver, CO, USA The 27th International ACM SIGACCESS Conference on Computers and Accessibility (ASSETS ’25), October 26–29, 2025, Denver, CO, USA DOI: 10.1145/3663547.3746372 ISBN: 979-8-4007-0676-9/2025/10 CCS: Human-centered computing Accessibility systems and tools CCS: Applied computing E-learning CCS: Applied computing Interactive learning environments CCS: Human-centered computing Web-based interaction CCS: Human-centered computing User studies Yotam Sechayk, Ariel Shamir, Amy Pavel, Takeo Igarashi Abstract . Instructors often rely on visual actions such as pointing, marking, and sketching to convey information in educational presentation videos. These subtle visual cues often lack verbal descriptions, forcing low-vision (LV) learners to search for visual indicators or rely solely on audio, which can lead to missed information and increased cognitive load. To address this challenge, we conducted a co-design study with three LV participants and developed VeasyGuide, a tool that uses motion detection to identify instructor actions and dynamically highlight and magnify them. VeasyGuide produces familiar visual highlights that convey spatial context and adapt to diverse learners and content through extensive personalization and real-time visual feedback. VeasyGuide reduces visual search effort by clarifying what to look for and where to look. In an evaluation with 8 LV participants, learners demonstrated a significant improvement in detecting instructor actions, with faster response times and significantly reduced cognitive load. A separate evaluation with 8 sighted participants showed that VeasyGuide also enhanced engagement and attentiveness, suggesting its potential as a universally beneficial tool. Figure 1 . VeasyGuide’s interface includes: (a) a video player with highlighted areas (red rectangle and hand pointer), (a.1) zoom settings toggle, (a.2) highlight settings toggle, (b) a zoomed window (toggled with the Z key), and (c) zoom and highlight settings panels. While watching a video, VeasyGuide auto-highlights pointing, marking, and sketching activities. Users can zoom into highlighted portions with the Z key, adjust zoom with arrow keys, and customize highlight and zoom appearance in real time. Illustration of the VeasyGuide player and its settings. From left to right. First, the player interface showing a video of a "Machine Learning" slide, where the phrase "incomplete information" is highlighted with a red rectangle, and standard video controls are visible below; with two additional buttons "Highlight personalization panel," and "Zoom personalization panel." Then, illustration of the z-key with the text "Toggle", atop a magnified view of the highlighted portion of the slide with the phrase "incomplete information" at the center. Finally, multiple personalization option panels. 1. Introduction Presentation videos play a central role in modern education, spanning both formal and informal learning environments ( Navarrete et al. 2023 ; Aljedaani et al. 2023 ; Ghosh and Figueroa 2023 ) . These presentations frequently incorporate slides enriched with visual aids such as videos ( Hartsell and Yuen 2006 ) , figures ( Peng et al. 2021a ) , and animations ( Grice and Hughes 2009 ) to convey key concepts. Instructors often interact with slides in real-time using digital pens or pointers to direct viewer attention, annotate slide elements, or add new dynamic content ( Navarrete et al. 2023 ) , typically in coordination with their speech. However, low-vision (LV) learners, who experience limited visual access, often struggle to perceive these visual interactions as they occur, leading to missed details. Although universal design for learning and accessible presentation guidelines ( Burgstahler and Cory 2010 ; Ladner and Rector 2017 ; D’Agostino 2021 ) recommend verbally describing all visual content, instructors frequently omit such descriptions. For example, instructors may use demonstrative pronouns (“this”) without clarifying the referent, or fail to mention when marking key elements with digital pens. In some cases, instructors do not verbalize complex spatial or relational information when adding sketches to slide content ( D’Agostino 2021 ) . For LV learners, identifying and interpreting these visual activities constitutes a visual search problem, which increases cognitive load and hinders comprehension ( Zhao et al. 2016 ) . Similar to prior work ( Peng et al. 2021a ) , we analyzed 300 presentation videos across five domains to examine the frequency of visual activities. We define presentation videos as those that feature screen-shared slides, optionally accompanied by a video of the instructor. Visual activities were present in all domains, with 20% to 50% of videos containing at least one such activity (Appendix A ). The highest proportions were in Natural Sciences (50% of videos) and Formal Sciences (43.3% of videos). We also examined the types of visual activities used. In Natural Sciences , sketching and pointing were more frequent. In Formal Sciences , sketching was more frequent, while in Social Sciences , marking appeared more frequently than sketching or pointing. These findings show that access to visual activities—pointing, marking, and sketching—is essential for equitable access for LV learners. To address this gap and support visual access for LV learners, we developed VeasyGuide , co-designed with 3 LV participants. First, we explored how participants perceive visual activities in educational presentation videos. Then, collaborated with participants to iteratively design VeasyGuide, addressing challenges associated with visual search. VeasyGuide enhances presentation videos by highlighting visual activities during playback, and enabling magnification that transitions automatically on new activities. The system has two components: (1) activity recognition and (2) activity visualization. The activity recognition pipeline employs computer vision motion detection techniques ( Parveen and Shah 2021 ) and uses a graph-based representation to identify instructor interactions. Then, the activity visualization module augments video playback with personalized highlights and zooming capabilities. To assess VeasyGuide’s effectiveness, we conducted a user study with 8 LV participants, evaluating their ability to detect visual activities and examining their interaction with presentation videos. We used real-world presentation videos featuring an instructor’s voice and screen-shared slides, where the instructor interacted directly with the slide content by pointing, marking, or sketching. Our findings show that VeasyGuide significantly increases the number of detected visual activities, with a mean of 88% detection rate, compared with 61%. VeasyGuide also improves the speed of detection, with a mean detection time of 1.53 seconds, compared with 2.57 seconds. Additionally, using VeasyGuide results in reduced cognitive load and enhanced learning experience, which participants perceive as more accessible. To assess broader applicability, we also evaluated VeasyGuide on 8 sighted participants. We show that VeasyGuide improves engagement and attentiveness for sighted participants, highlighting its potential as a universally beneficial assistive feature, similar to how captions have become standard across media platforms. VeasyGuide is available online as a web application, visit https://veasyguide.github.io/ for more information. In summary, our contributions are: • A co-design study with LV participants to identify and address access barriers in presentation videos. • VeasyGuide, a personalized tool that highlights and magnifies visual activities during playback. • A user evaluation with LV participants, demonstrating the impact on accessibility of visual activities. • A user evaluation with sighted participants, highlighting broad applicability. 2. Background VeasyGuide addresses visual search challenges posed by instructor interactions in educational presentation videos—a common barrier for low-vision (LV) learners. We build on existing research in LV accessibility, content magnification, and personalization to improve access to visual activities in presentation videos. 2.1. Video Accessibility for Visual Impairments Traditionally, video accessibility for blind and