The interplay of user preference and precision in different gaze-based interaction methods
Björn R. Severitt, Yannick Sauer, Alexander Neugebauer, Rajat Agarwala, Nora Castner, Siegfried Wahl · 2025
Read The interplay of user preference and precision in different gaze-based interaction methods by Björn R. Severitt, Yannick Sauer, Alexander Neugebauer, Rajat Agarwala, Nora Castner, Siegfried Wahl (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2501-06073.txt.
Introduction
Björn Severitt and co-authors set four gaze tricks twixt want and skill in a game world, in a study from 2025. Eyes can pick screen marks by dwell, or lock a pick by head turn, nod, or a smooth chase of a roving mark. Each trick trades speed for slips in its own way.
Fifty-two souls played a hunt game in a fake world, all four ways. Scores took load marks from a NASA form, hunt time, and points won. The tricks split clean on all three. A twist: men and women leaned to unlike tricks, with unlike scores to match. Fit the trick to the user, the team says, and gaze talk will feel less like work and more like sight.
Catalog record
| CREATOR | Björn R. Severitt, Yannick Sauer, Alexander Neugebauer, Rajat Agarwala, Nora Castner, Siegfried Wahl |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 42 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2501-06073
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
The interplay of user preference and precision in different gaze-based interaction methods Björn R. Severitt, Yannick Sauer, Alexander Neugebauer, Rajat Agarwala, Nora Castner, Siegfried Wahl Abstract . In this study, we investigated gaze-based interaction methods within a virtual reality game with a visual search task with 52 participants. We compared four different interaction techniques: Selection by dwell time or confirmation of selection by head orientation, nodding or smooth pursuit eye movements. We evaluated both subjective and objective performance metrics, including NASA-TLX for subjective task load as well as time to find the correct targets and points achieved for objective analysis. The results showed significant differences between the interaction methods in terms of NASA TLX dimensions, time to find the right targets, and overall performance scores, suggesting differential effectiveness of gaze-based approaches in improving intuitive system communication. Interestingly, the results revealed gender-specific differences, suggesting interesting implications for the design of gaze-based interaction paradigms that are optimized for different user needs and preferences. These findings could help to develop more customized and effective gaze interaction systems that can improve accessibility and user satisfaction. XR Extended Reality VR Virtual Reality AR Augmented Reality MR Mixed Reality AOI Areas of Interest AI Artificial Intelligence VE Virtual Environment NLP Natural Language Processing SVM Support Vector Machine HRI Human-Robot Interaction HCI Human-Computer Interaction UI User Interface ET Eye Tracking CCS: Human-centered computing CCS: Human-centered computing Interaction design CCS: Human-centered computing Empirical studies in interaction design 1. Introduction Humans naturally rely on their gaze to perceive, explore and interact with their environment. Extending this ability to system interaction via gaze as an input method seems intuitive, because it reflects our natural focus on objects or regions of interest. However, developing a system that correctly interprets gaze is a major challenge. Systems must not only accurately capture gaze, but also interpret the user’s intentions in the correct interaction syntax. There are already a number of systems that have effectively incorporated gaze input for support in immersive games ( Smith and Graham, 2006 ) , smart wearables ( Mastrangelo et al., 2018 ) , and even medical devices that support communication or mobility ( Pannasch et al., 2008 ; Subramanian et al., 2019 ) . However, gaze can sometimes be pushed aside in favor of other communication approaches in human-machine interfaces. Effective communication in UI often need to be designed for a specific user-need or goal. Often, this comes with customization challenges that can affect how intuitive the experience can be ( Dey et al., 2019 ; Macaranas et al., 2015 ) . Traditional communication approaches that have evolved over the years to be more user intuitive are grounded in physical actions, w.r.t. button clicks or scrolling with a mouse, touch gestures like swiping or pinching. But the pitfalls of these devices are that they are exclusive to able-bodied individuals ( Gür et al., 2020 ) . Verbal-based modalities are a viable alternative, especially with the recent boom in nlp ( nlp ) models . This interaction modality is increasingly preferred as it is very natural and can quickly extract the context in which the user wishes to accomplish their specific task: The best example being chatbots. Despite these advantages, nlp -based systems face other challenges. Mainly, there are sometimes unpredictable outputs from the black box -style of how the model learns ( Lin et al., 2024 ; Gou et al., 2024 ) . For a user, this can result in a system being slightly annoying but also safety critical. Certain systems, for example controlling a robotic arm, can be susceptible to a user not appropriately describing the object they wish to have the robot grasp. They may not know to specify the tea kettle should be grabbed by the handle since they plan to pour it into a cup. This challenge of understanding a user’s implicit or unconscious understanding of a given context is precisely where gaze input can supplement UI . Going back to the tea kettle example, a user would fixate momentarily on the handle moments before proceeding to other look ahead fixations indicating the next steps in the task ( Bovo et al., 2020 ; Pelz and Canosa, 2001 ) . This fixation input can be enough to communicate to a system, grasp here . Though eye tracking technology for gaze-based communication has been around for nearly forty years, it is still a modality that is highly accessible and natural. It can be performed with relatively low-cost devices that offer high accuracy (within 1 degree) ( Lee et al., 2020 ; Rakhmatulin, 2020 ) and can provide scene analysis through efficient object detection methods ( Jha et al., 2021 ) . However, as with any input modality, there are challenges; mainly how to distinguish between an accidental gaze and a deliberate command – The Midas Touch Problem . This issue has prompted numerous solutions, which we will overview in section 2 , but when we try to understand the user experience behind these approaches, there is not enough information available. Considering that a satisfactory user experience is important for a user’s opinion of whether a ui ( ui ) is useful, comfortable, or intuitive, we wanted to investigate aspects of different gaze-based interaction paradigms could contribute to the overall experience. In this paper, we present and evaluate four common gaze- and head-movement-based interaction methods and compare their performance in an immersive environment where participants perform a visual search task. Specifically, we investigated gaze-based selection by dwell time and methods in which gaze-based selection is confirmed by head direction, nodding, or a specific eye movement. By investigating these paradigms in terms of both objective and subjective factors, such as task performance, signal accuracy, and preference, we aim to identify interaction strategies that maximize the efficiency and usability of gaze-driven systems. 2. Related work Gaze-based interaction has been studied in detail and summarized in review articles ( Duchowski, 2018 ; Plopski et al., 2022 ) . Research demonstrates that gaze can be effectively leveraged for various input tasks, such as text entry ( Hansen et al., 2004 ; Majaranta and Bates, 2009 ; Majaranta and Räihä, 2002 ; Ward and MacKay, 2002 ; Wobbrock et al., 2008 ) and PIN entry ( Best and Duchowski, 2016 ; Hoanca and Mock, 2006 ) . Furthermore, gaze-based systems have proven useful for navigating hierarchical interfaces ( Huckauf and Urbina, 2007 ; Huckauf and Urbina, 2008 ) . These findings highlight the versatility of gaze as an interaction modality, making it a powerful tool for engaging with digital environments. The most intuitive way to select an object with gaze alone is the dwell time introduced by Jacob ( Jacob, 1990 ) . This can also be used as a metric for interest in an object ( Starker and Bolt, 1990 ) . As mentioned above, this method leads to the problem of the Midas Touch , as there is no way to recognize which look is a real look of interest. To address this challenge, additional modalities such as gestures have been explored, as demonstrated by Špakov and Majaranta ( Špakov and Majaranta, 2012 ) . They investigated the use of various head gestures for different activities, such as item