Benchmarking Microsaccade Recognition with Event Cameras: A Novel Dataset and Evaluation
Waseem Shariff*, Timothy Hanley, Maciej Stec, Hossein Javidnia, Peter Corcoran · 2025
Read Benchmarking Microsaccade Recognition with Event Cameras: A Novel Dataset and Evaluation by Waseem Shariff*, Timothy Hanley, Maciej Stec, Hossein Javidnia, Peter Corcoran (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2510-24231.txt.
Introduction
Waseem Shariff and four co-authors introduce a dataset and evaluation for recognizing microsaccades with event cameras. Microsaccades are tiny involuntary eye movements that matter for vision and brain processing. Standard studies use eye trackers or frame based analysis, which are precise but costly and limited in speed and scale.
Event cameras capture fine changes with high speed and low delay, offering a new route. The team rendered eye movement scenes in Blender and simulated microsaccades from half a degree to two degrees, split into seven classes. They converted the scenes to event streams with a simulator tool, preserving fine timing. The dataset supports work on small eye movements for cognitive computing.
Catalog record
| CREATOR | Waseem Shariff*, Timothy Hanley, Maciej Stec, Hossein Javidnia, Peter Corcoran |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 33 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2510-24231
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Benchmarking Microsaccade Recognition with Event Cameras: A Novel Dataset and Evaluation Waseem Shariff*, Timothy Hanley, Maciej Stec, Hossein Javidnia, Peter Corcoran Abstract Microsaccades are small, involuntary eye movements essential for visual perception and neural processing. Traditional microsaccade research often relies on eye trackers and frame-based video analysis. While eye trackers offer high precision, they can be expensive and have limitations in scalability and temporal resolution compared to alternative methods. In contrast, event-based sensing offers a more efficient and precise alternative, as it captures high-resolution spatial and temporal information with minimal latency. This work introduces a pioneering event-based microsaccade dataset, designed to support efforts in studying small eye movement data within cognitive computing. Using Blender, we generate high-fidelity renderings of eye movement scenarios and simulate microsaccades with angular displacements ranging from 0.5° to 2.0°, divided into seven distinct classes. These sequences are simulated into event streams using v2e, preserving the temporal dynamics of real microsaccades. The event streams, with durations as small as 0.25 milliseconds and as large as 2.25 milliseconds, have such high temporal resolution, which prompted us to investigate whether SNNs could effectively detect and classify these movements. We evaluate the proposed dataset using Spiking-VGG11, Spiking-VGG13, and Spiking-VGG16, and further introduce Spiking-VGG16Flow - an optical flow - enhanced variant-implemented with SpikingJelly. Across experiments, these models achieve an average accuracy of approximately 90%, effectively classifying microsaccades based on angular displacement, irrespective of event count or duration. These results highlight the suitability of SNNs for fine motion classification and establish a benchmark for future research in event-based vision. To facilitate further work in neuromorphic computing and visual neuroscience, both the dataset and trained models will be released publicly. The dataset and code will be made available here- https://waseemshariff126.github.io/microsaccades/ Microsaccade Recognition † † email: [email protected] † † email: [email protected] † † email: [email protected] † † email: [email protected] † † email: [email protected] † † affiliation: C3I Imaging Lab, School of Engineering, University of Galway, Ireland † † affiliation: School of Computer Science, University of Galway, Ireland † † affiliation: Department of Electronic and Electrical Engineering, Trinity College Dublin, Ireland 1 Introduction Microsaccades are small, involuntary eye movements typically under 1^{\circ} to 2^{\circ} in amplitude, distinct from larger, voluntary saccades due to their subtlety and small movements. While they share some kinematic properties with larger saccades, such as being conjugate in nature [ Ditchburn and Ginsborg(1953) ] and following a similar amplitude-velocity relationship [ Cook et al.(1966)Cook, Stark, and Zuber ] , microsaccades are much finer in movement and serve a different function. Predominantly binocular, they often exhibit a horizontal directional bias [ Hauperich et al.(2020)Hauperich, Young, and Smithson ] . These brief, involuntary movements play a crucial role in maintaining visual clarity during fixation, subtly shifting the retinal image to prevent fading, a phenomenon that can occur when a stimulus remains stationary on the retina [ Hung et al.(2023)Hung, Barbot, and Carrasco ] . Unlike larger saccades, which are voluntary and are used for noticeable shifts in visual attention, microsaccades help preserve perceptual stability and visual sensitivity without any obvious change in gaze direction. The changes are very small, yet they are essential for preserving the clarity of our visual experience. Microsaccades are attracting increased attention due to their sensitivity to underlying cognitive processes. Variations in their frequency, direction, and amplitude have been linked to attentional shifts, mental workload, and other internal neural states [ Hung et al.(2023)Hung, Barbot, and Carrasco ] . As brief, involuntary movements, they offer a noninvasive means of probing attention and cognitive function, making them relevant to both basic neuroscience and applied computational modeling [ Hung et al.(2023)Hung, Barbot, and Carrasco , Krejtz et al.(2020)Krejtz, Żurawska, Duchowski, and Wichary , Ditchburn and Ginsborg(1953) ] . They are also being explored as potential indicators for neurological and psychiatric conditions such as Parkinson’s disease, schizophrenia, and attention deficit disorders [ Hauperich et al.(2020)Hauperich, Young, and Smithson , Winterson and Collewun(1976) , Bridgeman and Palca(1980) ] . Despite this promise, microsaccades are difficult to analyze due to their small magnitude and transient nature. Current detection methods rely heavily on high-resolution eye trackers that produce numerical gaze coordinates, limiting the use of image- or event-based techniques. The absence of visual or spatiotemporal datasets tailored specifically for microsaccade detection further hinders the development of advanced models. In particular, it remains unclear whether artificial neural networks, especially those designed for vision tasks, can reliably detect and interpret such subtle motion signals amid noise and sparse data. Despite the promise of microsaccades as indicators of cognitive and neurological states, their detection remains technically challenging [ Chaudhary and Pelz(2019) ] . Traditional frame-based cameras, such as standard RGB sensors, lack the temporal resolution needed to reliably capture these rapid, subtle eye movements, which occur on the order of milliseconds [ Iddrisu et al.(2024)Iddrisu, Shariff, Corcoran, O’Connor, Lemley, and Little ] . Achieving sufficiently high frame rates (e.g., \geq 1000 Hz) demands expensive hardware, large memory capacity, and generates vast amounts of mostly redundant data, complicating efficient analysis [ Iddrisu et al.(2024)Iddrisu, Shariff, Corcoran, O’Connor, Lemley, and Little ] . To address these limitations, event-based cameras also known as dynamic vision sensors (DVS) have emerged as a powerful alternative. Unlike conventional cameras that capture full image frames at fixed intervals, event cameras asynchronously record changes in brightness with microsecond-level precision and operate at effective sampling frequencies of around 10 kHz [ Angelopoulos et al.(2020)Angelopoulos, Martel, Kohli, Conradt, and Wetzstein , Gallego et al.(2020)Gallego, Delbrück, Orchard, Bartolozzi, Taba, Censi, Leutenegger, Davison, Conradt, Daniilidis, et al. , Shariff et al.(2024)Shariff, Dilmaghani, Kielty, Moustafa, Lemley, and Corcoran ] . This approach offers exceptionally high temporal resolution and data efficiency, making event cameras particularly well-suited for detecting rapid, subtle movements such as microsaccades. Previous studies have demonstrated the effectiveness of event cameras for high-speed eye tracking [ Angelopoulos et al.(2020)Angelopoulos, Martel, Kohli, Conradt, and Wetzstein , Zhao et al.(2023)Zhao, Yang, Liu, Chen, Shen, Wen, and Lan , Lenz et al.(2020)Lenz, Ieng, and Benosman ] , further motivating their use in this domain. Many event-based studies indicate that Spiking Neural Networks (SNNs) are particularly well-suited for processing event camera data due to their biological plausibility and dynamic neural behavior [ Cordone et al.(2021)Cordone, Miramond, and Ferrante , Gallego et al.(2020)Gallego, Delbrück, Orchard, Bartolozzi, Taba, Censi, Leutenegger, Davison, Conradt, Daniilidis, et al. , Shariff et al.(2024)Shariff, Dilmaghani, Kielty, Moustafa, Lemley, and Corcoran ] .However, while these models have demonstrated success in capturing spatiotemporal dynamics, it remains unclear whether they can reliably detect the small, brief eye movements characteristic of microsaccades, which typically last between 0.5 and 2.5 milliseconds. To investigate this, we frame the classification of eye motion angles based on angular bins, not to replicate biological function, but to evaluate whether neural networks can recognize such subtle motion patterns. This proof-of-concept task lays the groundwork for future, more complex objectives like trajectory reconstruction or cognitive state inference. In this work, we introduce the first synthetic microsaccades dataset created using Blender. It comprises 175,000 annotated sequenced samples containing event streams for left-eye and right-eye microsaccades, over seven amplitudes ranging from 0.5° to 2°. This data set provides a controlled environment for systematic evaluation and supports reproducibility in neuromorphic vision. We benchmarked the dataset