DiG-Net: Enhancing Quality of Life through Hyper-Range Dynamic Gesture Recognition in Assistive Robotics Journal: Computer Vision and Image Understanding
Eran Bamani Beeri, Eden Nissinman, Avishai Sintov · 2025
Read DiG-Net: Enhancing Quality of Life through Hyper-Range Dynamic Gesture Recognition in Assistive Robotics Journal: Computer Vision and Image Understanding by Eran Bamani Beeri, Eden Nissinman, Avishai Sintov (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2505-24786.txt.
Introduction
Eran Bamani Beeri, Eden Nissinman, and Avishai Sintov present DiG-Net for gesture control of robots in this 2025 paper. Hand gestures give a natural, touch-free way to direct assistive robots. That helps people with limited mobility, but most systems work only at short range.
DiG-Net reads dynamic gestures from as far as thirty meters away. It combines alignment blocks that adjust for depth with graph modules that track motion over time. A new loss function trains the model to stay robust as distance weakens the signal. On a tough test set the model reached high accuracy. The authors aim to make home robots easier to command from across a room.
Catalog record
| CREATOR | Eran Bamani Beeri, Eden Nissinman, Avishai Sintov |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 47 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2505-24786
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
DiG-Net: Enhancing Quality of Life through Hyper-Range Dynamic Gesture Recognition in Assistive Robotics Journal: Computer Vision and Image Understanding Eran Bamani Beeri, Eden Nissinman, Avishai Sintov Abstract Dynamic hand gestures play a pivotal role in assistive human-robot interaction (HRI), facilitating intuitive, non-verbal communication, particularly for individuals with mobility constraints or those operating robots remotely. Current gesture recognition methods are mostly limited to short-range interactions, reducing their utility in scenarios demanding robust assistive communication from afar. In this paper, we introduce a novel approach designed specifically for assistive robotics, enabling dynamic gesture recognition at extended distances of up to 30 meters, thereby significantly improving accessibility and quality of life. Our proposed Distance-aware Gesture Network (DiG-Net) effectively combines Depth-Conditioned Deformable Alignment (DADA) blocks with Spatio-Temporal Graph modules, enabling robust processing and classification of gesture sequences captured under challenging conditions, including significant physical attenuation, reduced resolution, and dynamic gesture variations commonly experienced in real-world assistive environments. We further introduce the Radiometric Spatio-Temporal Depth Attenuation Loss (RSTDAL), shown to enhance learning and strengthen model robustness across varying distances. Our model demonstrates significant performance improvement over state-of-the-art gesture recognition frameworks, achieving a recognition accuracy of 97.3% on a diverse dataset with challenging hyper-range gestures. By effectively interpreting gestures from considerable distances, DiG-Net significantly enhances the usability of assistive robots in home healthcare, industrial safety, and remote assistance scenarios, enabling seamless and intuitive interactions for users regardless of physical limitations. 1 Introduction The growing number of individuals living with disabilities and requiring assistance has created a pressing demand for assistive technologies that enhance users’ independence, safety, and quality of life [ 1 ] . Among these, assistive robotic systems are increasingly integrated into environments where intuitive, nonverbal communication is essential for enabling natural interaction with individuals of varied abilities. Gesture-based interaction is particularly important in scenarios where speech is not an option. To contextualize our contribution, Table 1 presents a comparative overview of recent systems in this area, outlining their target users, sensing modalities, application domains, and level of human involvement. Our method is the only one to support dynamic gesture recognition at hyper-range distances, defined here as up to 30 meters, and to operate reliably in both indoor and outdoor environments, making it uniquely suited for real-world assistive deployment. Recent research has catalyzed a new generation of assistive systems capable of perceiving complex environments and interacting with humans in context-aware, natural ways [ 2 , 3 , 4 ] . Equally important, human-in-the-loop approaches are being developed to ensure these systems operate safely and reliably alongside people. These methods incorporate human feedback, predictive planning, and adaptive control to support trust and safety during close interactions [ 5 , 6 , 7 ] . To enable practical deployment, recent studies stress the importance of user-centered design and usability evaluation, ensuring assistive robots are intuitive, reliable, and effective [ 8 , 9 ] . A key area of research supporting these goals is human-robot interaction (HRI), which focuses on enabling smooth, natural collaboration between people and robots, both in assistive contexts and everyday life [ 10 , 11 ] . This reflects a broader shift from viewing robots as tools to recognizing them as partners that augment and support human capabilities [ 12 ] . Table 1: Comparative Summary of Gesture-Based Assistive Robotics Systems Paper Population Env Modality Application Range Human-in-the-Loop Boboc et al. [ 13 ] General users Indoor RGB-D Home robot control Short Yes Haseeb et al. [ 14 ] Motor-impaired Indoor IMU Head-based robot control N/A Yes Rudigkeit et al. [ 15 ] Tetraplegic Indoor IMU Robot arm use N/A Yes Yang et al. [ 16 ] Upper-limb impaired Indoor EMG Mobile manipulation Long Yes Ababneh et al. [ 17 ] Elderly, wheelchair Indoor RGB-D Arm control via gesture Short Yes Neto et al. [ 18 ] Factory workers Indoor IMU Assembly support Mid Partial Werner et al. [ 19 ] Elderly Indoor RGB-D Bathing assistant Short Partial Muñoz et al. [ 20 ] Older adults Indoor RGB-D Rehab & exercises Short Partial Oudah et al. [ 21 ] Speech-impaired elderly Indoor RGB-D Emergency alerting Mid Yes Bandara et al. [ 22 ] Wheelchair users Indoor RGB-D Wheelchair navigation Short Yes This work General users Both RGB Remote HRI guidance Hyper Yes Intuitive interaction mechanisms are essential to enable non-expert users to effectively communicate their intentions to robots. Hand and arm gestures are intuitive forms of nonverbal communication, widely used in daily human interactions, making them well-suited for HRI [ 23 , 24 , 25 ] . Gesture-based interactions reduce the need for complex verbal or physical interfaces, improve user experience, and allow for intuitive and rapid communication with robots, even for users with no technical expertise [ 26 ] . With gestures, a user can convey nonverbal and simple commands even from a long distance without the need to shout. For instance, a user may direct robot movements with pointing gestures [ 27 ] . Figure 1: Demonstration of a user instructing a robot to go back by sweeping an open palm forward and backward, from a hyper-range distance. In addition to the low-resolution view of the user’s hand, the robot may confuse the dynamic gesture with the static stop gesture. Research in the field of gesture recognition has made significant progress, particularly in recognizing static gestures [ 28 , 29 , 30 ] . However, most gesture recognition approaches are limited to short-range interactions, typically within a few meters [ 31 , 26 , 24 ] . Moreover, gesture recognition methods, often described to be effective in the long range, are typically limited to around seven meters [ 32 , 33 ] . However, this limitation hinders their applicability in real-world scenarios that demand longer-range HRI. Recognizing gestures from a truly long distance can significantly expand the potential applications of robots in environments such as public spaces, industrial settings, and emergencies, where natural, non-contact interactions are necessary [ 34 , 35 ] . However, one of the key challenges in achieving effective long-range gesture recognition is the degradation of visual information due to factors such as reduced resolution, lighting variations, and occlusions [ 36 , 37 ] . While our recent work [ 38 ] successfully demonstrated ultra-range recognition of static hand gestures using a simple web camera at distances up to 25 meters, recognizing dynamic gestures presents additional, significant challenges. Static gesture recognition relies primarily on spatial features captured in a single frame, whereas dynamic gesture recognition demands the extraction and analysis of temporal sequences across multiple frames, significantly increasing complexity due to motion blur, occlusions, and ambiguity between similar gestures. The transition from static to dynamic gestures represents a fundamental shift, requiring entirely new approaches rather than incremental extensions of existing methods. Dynamic gesture recognition at hyper-range presents a unique challenge that demands the fusion of spatial and temporal information across multiple scales and distances. At such long ranges, the visual signal of the performer is severely diminished, the region of interest occupies only a small portion of the frame, resulting in low-resolution observations, and environmental noise (e.g., background clutter, illumination changes, atmospheric effects) can significantly degrade each frame. In this scenario, temporal cues become as crucial as spatial cues