Modeling Issues with Eye Tracking Data
Gregory Camilli · 2025
Read Modeling Issues with Eye Tracking Data by Gregory Camilli (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2512-15950.txt.
Introduction
Gregory Camilli compares procedures for modeling binary eye tracking data in a 2025 paper. Eye tracking series are correlated over time within a person, and standard logistic mixed models with random effects for persons and items ignore that serial structure. Several fixes exist, and their differences matter for reading research conclusions.
Camilli illustrates three newer approaches. Each avoids using the observed lagged outcome as a predictor. One is an autoregressive model. One is a moving average model from generalized estimating equations. One is a recurrent two state survival model for run length encoded data. Five analyses in total point to unresolved issues in eye tracking analysis. A traditional lag 1 model is included for comparison.
Catalog record
| CREATOR | Gregory Camilli |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 29 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2512-15950
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Modeling Issues with Eye Tracking Data Gregory Camilli Abstract I describe and compare procedures for binary eye-tracking (ET) data. These procedures are applied to both raw and compressed data. The basic GLMM model is a logistic mixed model combined with random effects for persons and items. Additional models address autocorrelation eye-tracking serial observations. In particular, two novel approaches are illustrated that address serial without the use of an observed lag-1 predictor: a first-order autoregressive model obtained with generalized estimating equations, and a recurrent two-state survival model. Altogether, the results of five different analyses point to unresolved issues in the analysis of eye-tracking data and new directions for analytic development. Eye-Tracking Models \authorsaffiliations Rutgers University \authornote Please send correspondence to [email protected]. keywords eye-tracking modeling generalized linear mixed model data compression generalized estimating equations survival analysis autocorrelation 1 Introduction Modeling the cognitive processes with which students engage in psychological tasks in eye tracking studies has important implications for theory development. It may also enable the construction of more informative test scores ( 11 ) . A number of models have been used for the analysis of eye-tracking data ( 1 ; 6 ; 3 ) . The basic features of these models include binary or categorical data for eye fixations, and multiple measurements of subject responses over time. The data then manifest as subject-level time series, often composed of Bernoulli observations. 7 extended the original work of 1 using a generalized linear mixed model (GLMM) to control autocorrelation, a common feature of time series that may bias standard errors. In this paper, I also present an alternative procedure that features run length encoding (RLE) combined with a two-state survival model. After a brief review of previous studies, two methods of compressing data for eye-tracking analyses are described. In part, compression leads to more efficient analysis and can reduce observed serial correlation in eye-tracking time series. Then I describe six methods for analyzing eye-tracking data, where a method refers to a statistical model combined with a set of raw or compressed data. After analyses are completed, model coefficients are reported with primary attention placed on the experimental effects. Discussion follows concerning further directions for modeling in educational eye-tracking studies. 2 Relevant Literature The original multilevel model for analyzing eye-tracking data was constructed by 1 in terms of a cross-classified (subjects by items) design. This logistic regression model included fixed effects for experimental variables. 22 applied a mixed-effects logistic regression model to cross-classified eye-tracking data to examine how listeners use a speaker’s perspective to identify referents during unscripted conversational instructions. Several studies have updated mixed effects modeling to include effects for autocorrelated data and time ( 10 ; 3 ; 8 ; 4 ; 9 ). The subject observations analyzed in the current study are eye-tracking fixations for visual targets, originally collected by 22 . The hierarchical structure of the data is characterized by trial-level data nested within subjects and items. For a visual presentation of the data structure, see Figure 3 of 7 . On each trial, the speaker and the listener participated together in a brief conversational exchange aimed at identifying a target object (the different objects constitute a set of items). Although they were seated in separate rooms, they communicated naturally through wireless microphones while their eye movements were recorded simultaneously with two remote eye trackers. The variable Contrast captures whether the speaker uniquely identified the target object or whether multiple objects in the listener’s visual scene could match the speaker’s descriptions. It reflects the amount of referential competition the listener must cognitively manage during real-time interpretation. Referential competition was hypothesized to make the task more difficult. The variable Privileged reflects whether listeners could reduce referential competition based on information they infer from the speaker’s perspective; this variable was hypothesized to make the task easier. 9 addressed several issues with GLMM models in eye-tracking studies related to how observations are structured. In particular, binary time series are generated as runs of 0s and 1s, and longer gazes generate longer runs as do higher sampling rates. However, longer runs necessarily result in higher autocorrelation which can affect the quality of estimates and standard errors. For this reason, 9 constructed a generalized mixed model (GLMM) with a lag-1 outcome variable as a predictor in addition to other covariates. This resulted in estimating an autoregression coefficient AR(1) for observed data. Random effects were also included for subject and items as well as the AR(1) coefficient to account for differing levels of autocorrelation by subject and by item. 9 showed that autoregressive GLMM models can recover parameters accurately in a simulation study, but they noted that "alternative methods for modeling AR effects in binary time series data are still in the nascent stages" (p. 652). The goal of this paper is to contribute to this effort. 3 Data The data structure is organized around repeated measures, where eye-tracking observations are collected for subject–item–trial combinations. Each subject completed multiple trials, each associated with a visual display ( 22 ) . Each trial included two perspective-taking conditions ( Contrast and Privileged ) as previously described; these two conditions were assigned as the item level and thus varied across items. In the original data, observations consisted of n=112 observations at .01 second intervals. Data are recorded as the number of discrete instances in which a person is gazing at a target area (1) versus off-target (0). The total number of data points usually manifests as strings of 1s and 0s. The original data were presumably recorded at a frequency of 1000Hz and compressed to .01 second intervals. The resulting data file consisted of 995,232 records in long format for 152 subjects. 3.1 Run Length Encoding Consider an example string of 10 samples of observations taken at equal intervals: 1110001111, where each sample fixation is .01 second long. (Note this is a simplification because recorded data depend to some degree on how data are compressed by the eye-tracking apparatus prior to data file construction.) Assume recorded instances of 1 (on target) and 0 (off target) are collected beginning at start time 0 and ending at 1 second, so that each 0-1 value corresponds to a .1 second time lapse. Table 1: Run Length Encoding Run y n StopTime 1 1 3 0.03 sec 2 0 3 0.06 sec 3 1 4 0.10 sec run length encoding (RLE) is illustrated in Table 1. The 10 records are compressed into three, which would seem like a loss of information. However, knowing the bin size is .01 seconds, or the total time interval and number of bins, would allow the original data set to be reconstructed in its entirety. This suggests there is no more or less information in the compressed than in the original data. Thus, RLE is lossless compression. The RLE data are used with the survival model described below. 3.2 Data Selection for Analysis I modified the data by excluding two types of subject response. First, in the original study there were multiple trials in which the same item could be presented more than once for a subject. I retained only the first trial of an item for each subject. Second, there were subject-by-item time series with only a