Classifying Subjective Time Perception in a Multi-robot Control Scenario Using Eye-tracking Information
Till Aust, Julian Kaduk, Heiko Hamann · 2025
Read Classifying Subjective Time Perception in a Multi-robot Control Scenario Using Eye-tracking Information by Till Aust, Julian Kaduk, Heiko Hamann (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2504-06442.txt.
Introduction
People guiding robot swarms can lose track of time under load, and that warped sense of time betrays their mental strain. Till Aust and co-authors test whether eye movements reveal it in this 2025 paper. An operator steered a swarm of small mobile robots while a tracker logged gaze, and questionnaires captured how time felt.
A classifier learned to sort the eye data by the operator's reported time sense. A half minute of personal calibration data sharpened the sorting further. The team aims at robots that sense operator strain and adapt on their own, easing off before overload bites. Subjective time, they argue, is a fast, sensitive gauge of well-being that needs no extra sensors beyond the eye tracker.
Catalog record
| CREATOR | Till Aust, Julian Kaduk, Heiko Hamann |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 28 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2504-06442
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Classifying Subjective Time Perception in a Multi-robot Control Scenario Using Eye-tracking Information Till Aust, Julian Kaduk, Heiko Hamann Abstract As automation and mobile robotics reshape work environments, rising expectations for productivity increase cognitive demands on human operators, leading to potential stress and cognitive overload. Accurately assessing an operator’s mental state is critical for maintaining performance and well-being. We use subjective time perception, which can be altered by stress and cognitive load, as a sensitive, low-latency indicator of well-being and cognitive strain. Distortions in time perception can affect decision-making, reaction times, and overall task effectiveness, making it a valuable metric for adaptive human-swarm interaction systems. We study how human physiological signals can be used to estimate a person’s subjective time perception in a human-swarm interaction scenario as example. A human operator needs to guide and control a swarm of small mobile robots. We obtain eye-tracking data that is classified for subjective time perception based on questionnaire data. Our results show that we successfully estimate a person’s time perception from eye-tracking data. The approach can profit from individual-based pretraining using only 30 seconds of data. In future work, we aim for robots that respond to human operator needs by automatically classifying physiological data in a closed control loop. I Introduction In today’s rapidly evolving work environments, driven increasingly by automation, prioritizing the mental health of the workforce is becoming essential [ 1 ] . Workplace stressors can negatively impact well-being, decrease productivity, and potentially lead to burnout. A potential indicator is subjective time perception, which may be experienced as slower under stress [ 2 ] . When a person is positively engaged, they tend to perceive time as passing more quickly. In our project ChronoPilot [ 3 ] , we attempt to actively modulate time perception of workers in virtual (VR) or augmented reality (AR) automation scenarios in order to increase their well-being and productivity. We aim to develop a device that both adjusts time perception and simultaneously measures the user state by obtaining human feedback. We modulate users’ time perception through haptic [ 4 ] , visual [ 5 ] auditory [ 6 ] , or situational stimuli [ 7 ] . A user’s time perception state can be estimated by non-invasively measuring their physiological signals [ 8 , 9 ] . A promising physiological signal is eye-tracking due to its great availability, minimal intrusiveness, and reliable measurement across a variety of settings [ 10 ] . Many current and future tasks/jobs can be performed or supported using VR or AR devices, such as the Vision Pro 1 1 1 https://www.apple.com/de/apple-vision-pro/ or Meta Quest 3. 2 2 2 https://www.meta.com/de/quest/quest-3/ These devices capture eye-tracking data as part of their functionality, hence, requiring no additional hardware. One such task, considering the rise of mobile robots, multi-robot systems, and swarm robotics [ 11 , 12 ] , could be to guide or control semi-autonomous groups of robots. This human-robot interaction or even more so human-swarm interaction [ 13 , 14 ] may have high demands for a human operator and may potentially be stressful. Research has shown that passively observing [ 15 ] or controlling [ 16 ] a larger number of robots moving around, and also smoothness in robot motion [ 17 ] can influence the participant’s well-being. Participants reported a faster passage of time when controlling a larger number of robots [ 7 ] . Possible approaches to moderating stressful effects of controlling a robot swarm include the use of automated after-action reviews [ 18 ] or monitoring the participants’ heart rate variability (HRV) [ 19 ] . In automated after-action reviews, the human-robot task is replayed to the participant directly after execution and questionnaires need to be filled. This is not applicable in our case, as we aim to monitor the time perception online in order to actively modify the work environment. Moreover, interrupting the task to review time perception may skew the results as by disturbing the participant’s workflow. Instead, measurements should occur in parallel with the participant’s task, ideally without the participant’s conscious awareness. We prefer to use the participant’s physiological data, such as HRV and eye-tracking. A common approach to process eye-tracking data is to extract features, such as the pupil size, eye movement, or blinking. These are compiled into a feature vector and classified using machine learning (ML) algorithms [ 20 ] . Utilizing this approach, eye-tracking information can be used to detect stress [ 21 ] , monitor mental workload [ 22 ] , or recognize emotion [ 23 ] . A common limitation of these studies is the ad hoc selection of ML models, with no clear rationale for choosing one over another. Model selection often seems to rely on manual parameter tuning or comparisons within a limited set of models, lacking a systematic approach. Using automated machine learning (AutoML) is a potential solution providing justification and ensuring thorough exploration of search spaces for ML models and their hyperparameter configurations. AutoML methods automatically compose ML algorithms into a pipeline and choose appropriate hyperparameters to optimize a given metric [ 24 ] . Existing frameworks like auto-sklearn [ 25 , 26 ] and GAMA [ 27 ] provide ready-to-use implementations. More recently, Mohr and Wever [ 28 ] introduced the Naive AutoML framework, which achieves comparable performance with a substantial reduction in computation time. In this paper, we study how to derive subjective time perception feedback from eye-tracking data obtained during a multi-robot controlling scenario, using an automated ML approach based on Naive AutoML [ 28 ] , with the goal of closing the feedback loop of the ChronoPilot device. II Experiments and Methodology The eye-tracking data were collected in robot experiments with participants controlling a robot swarm [ 16 ] . We preprocess the eye-tracking data for an AutoML approach to optimize an ML pipeline and its hyperparameters. II-A Robot experiment Fig. 1: POV of participant during the robot experiment. Participants control a swarm of small mobile robots (Thymio II [ 29 ] ) using a single-button interface (see Fig. 1 ) across 24 randomized trials, while eye-tracking and questionnaires capture physiological responses and perceived time during varying trial durations and counts of active robots. A more detailed description is given by Kaduk et al. [ 16 ] . In the experiment, we differentiate between active and passive robots. The active robots follow a random walk with obstacle avoidance and user input, while the passive robots are stationary at random locations. The participant has a single-button interface with the task to keep all active robots within a rectangle (2.2 m by 1.6 m) marked by black tape on the floor. When the button is pressed, all active robots rotate on the spot in random direction until either the button is released or a 3-second timer has elapsed. The experiment was split into 24 different trials randomized in order for each participant. The two variable parameters were the trial duration of either 1 min, 3 min, or 5 min and the number of actively moving robots N_{\text{active}}\in\{1,3,\dots,15\} . Before each trial, the participant was asked to watch a relaxing aquatic video for two minutes to provide a neutral baseline of the physiological data [ 30 ]