Performance of a computer system for recording eye fixations using limbus reflection

A computer system was developed to measure and record locus and duration of the eye axis of gaze using a limbus reflection technique. System hardware and operating procedures for on-line data collection and correction are described. Algorithms are presented that separate fixations from movements. Based on these algorithms, system performance was measured in terms of spatial accuracy of eye fixations and temporal accuracy of saccadic movements.     

Temporal characteristics of overt attentional behavior during category learning

Many theories of category learning incorporate mechanisms for selective attention, typically implemented as attention weights that change on a trial-by-trial basis. This is because there is relatively little data on within-trial changes in attention. We used eye tracking and mouse tracking as fine-grained measures of attention in three complex visual categorization tasks to investigate temporal patterns in overt attentional behavior within individual categorization decisions. In Experiments 1 and 2, we recorded participants’ eye movements while they performed three different categorization tasks. We extended previous research by demonstrating that not only are participants less likely to fixate irrelevant features, but also, when they do, these fixations are shorter than fixations to relevant features. We also found that participants’ fixation patterns show increasingly consistent temporal patterns. Participants were faster, although no more accurate, when their fixation sequences followed a consistent temporal structure. In Experiment 3, we replicated these findings in a task where participants used mouse movements to uncover features. Overall, we showed that there are important temporal regularities in information sampling during category learning that cannot be accounted for by existing models. These can be used to supplement extant models for richer predictions of how information is attended to during the buildup to a categorization decision.     

Regression analyses as a tool for studying reading processes: Comment on Just and Carpenters eye fixation theory

Just and Carpenter (1980) presented a theory of reading based on eye fixations wherein their “psycholinguistic” variables accounted for 72% of the variance in word gaze durations. This comment raises some statistical and theoretical problems with their use of simultaneous regression analysis of gaze duration measures and with the resulting theory of reading. A major problem was the confounding of perceptual with psycholinguistic factors. New eye fixation data are presented to support these criticisms. Analysis of fixations within words revealed that most gaze duration variance was contributed by number of fixations rather than by fixation duration.     

Dynamic emotional messages differentially affect 6-month-old infants’ attention to eyes and gaze cues

Infants often experience interactions in which caregivers use dynamic messages to convey their affective and communicative intent. These dynamic emotional messages may shape the development of emotion discrimination skills and shared attention by influencing infants’ attention to internal facial features and their responses to eye gaze cues. However, past research examining infants’ responses to emotional faces has predominantly focused on classic, stereotyped expressions (e.g., happy, sad, angry) that may not reflect the variability that infants experience in their daily interactions. The present study therefore examined forty-two 6-month-old infants’ attention to eyes vs. mouth and gaze cueing responses across multiple dynamic emotional messages that are common to infant-directed interactions. Overall, infants looked more to the eyes during messages with negative affect, but this increased attention to the eyes during these message conditions did not directly facilitate gaze cueing. Infants instead showed reliable gaze cueing only after messages with positive and neutral affect. We additionally observed gender differences in infants’ attention to internal face features and subsequent gaze cueing responses. Female infants spent more time looking at the eyes during the dynamic emotional messages and showed increased initial orienting and longer looking to gaze-cued objects following positive messages, whereas male infants showed these gaze cueing effects following neutral messages. These results suggest that variability in caregivers' communication can shape infants’ attention to and processing of emotion and gaze information.     

Gaze behavior in audiovisual speech perception: the influence of ocular fixations on the McGurk effect

We conducted three experiments in order to examine the influence of gaze behavior and fixation on audiovisual speech perception in a task that required subjects to report the speech sound they perceived during the presentation of congruent and incongruent (McGurk) audiovisual stimuli. Experiment 1 showed that the subjects' natural gaze behavior rarely involved gaze fixations beyond the oral and ocular regions of the talker's face and that these gaze fixations did not predict the likelihood of perceiving the McGurk effect. Experiments 2 and 3 showed that manipulation of the subjects' gaze fixations within the talker's face did not influence audiovisual speech perception substantially and that it was not until the gaze was displaced beyond 10 degrees - 20 degrees from the talker's mouth that the McGurk effect was significantly lessened. Nevertheless, the effect persisted under such eccentric viewing conditions and became negligible only when the subject's gaze was directed 60 degrees eccentrically. These findings demonstrate that the analysis of high spatial frequency information afforded by direct oral foveation is not necessary for the successful processing of visual speech information.     

Temporal Sequences Quantify the Contributions of Individual Fixations in Complex Perceptual Matching Tasks

Perceptual tasks such as object matching, mammogram interpretation, mental rotation, and satellite imagery change detection often require the assignment of correspondences to fuse information across views. We apply techniques developed for machine translation to the gaze data recorded from a complex perceptual matching task modeled after fingerprint examinations. The gaze data provide temporal sequences that the machine translation algorithm uses to estimate the subjects' assumptions of corresponding regions. Our results show that experts and novices have similar surface behavior, such as the number of fixations made or the duration of fixations. However, the approach applied to data from experts is able to identify more corresponding areas between two prints. The fixations that are associated with clusters that map with high probability to corresponding locations on the other print are likely to have greater utility in a visual matching task. These techniques address a fundamental problem in eye tracking research with perceptual matching tasks: Given that the eyes always point somewhere, which fixations are the most informative and therefore are likely to be relevant for the comparison task?     

Is human classification by experienced untrained observers a gold standard in fixation detection?

Manual classification is still a common method to evaluate event detection algorithms. The procedure is often as follows: Two or three human coders and the algorithm classify a significant quantity of data. In the gold standard approach, deviations from the human classifications are considered to be due to mistakes of the algorithm. However, little is known about human classification in eye tracking. To what extent do the classifications from a larger group of human coders agree? Twelve experienced but untrained human coders classified fixations in 6 min of adult and infant eye-tracking data. When using the sample-based Cohen’s kappa, the classifications of the humans agreed near perfectly. However, we found substantial differences between the classifications when we examined fixation duration and number of fixations. We hypothesized that the human coders applied different (implicit) thresholds and selection rules. Indeed, when spatially close fixations were merged, most of the classification differences disappeared. On the basis of the nature of these intercoder differences, we concluded that fixation classification by experienced untrained human coders is not a gold standard. To bridge the gap between agreement measures (e.g., Cohen’s kappa) and eye movement parameters (fixation duration, number of fixations), we suggest the use of the event-based F1 score and two new measures: the relative timing offset (RTO) and the relative timing deviation (RTD).     

One algorithm to rule them all? An evaluation and discussion of ten eye movement event-detection algorithms

Almost all eye-movement researchers use algorithms to parse raw data and detect distinct types of eye movement events, such as fixations, saccades, and pursuit, and then base their results on these. Surprisingly, these algorithms are rarely evaluated. We evaluated the classifications of ten eye-movement event detection algorithms, on data from an SMI HiSpeed 1250 system, and compared them to manual ratings of two human experts. The evaluation focused on fixations, saccades, and post-saccadic oscillations. The evaluation used both event duration parameters, and sample-by-sample comparisons to rank the algorithms. The resulting event durations varied substantially as a function of what algorithm was used. This evaluation differed from previous evaluations by considering a relatively large set of algorithms, multiple events, and data from both static and dynamic stimuli. The main conclusion is that current detectors of only fixations and saccades work reasonably well for static stimuli, but barely better than chance for dynamic stimuli. Differing results across evaluation methods make it difficult to select one winner for fixation detection. For saccade detection, however, the algorithm by Larsson, Nyström and Stridh (IEEE Transaction on Biomedical Engineering, 60(9):2484–2493,2013) outperforms all algorithms in data from both static and dynamic stimuli. The data also show how improperly selected algorithms applied to dynamic data misestimate fixation and saccade properties.     

Towards an express-diagnostics for level of processing and hazard perception

The analysis of eye movements can provide rich information about driver's attention and the course of behaviour in hazardous situations. We present data from a driving simulation study showing that the switching between preattentive and attentive processing is reflected in visual fixations. For this initial analysis, we considered fixations from the perspective of their duration and the amplitude of related saccades. Since fixation durations may change instantaneously from one fixation to the next, we further selected the temporal vicinity of the emerging hazard for a closer analysis of fixations around this time. With this second type of analysis, the fixations that actually “detect” a critical event can be discovered and their duration measured. Upon detection of an immediate hazard, there is an increase in fixation duration and a corresponding increase in occurrence of attentive fixations on the cost of preattentive ones. This switching from one level of processing to another is recognisable on a short, phasic time scale. We finally discuss attentional conditions where overlooked or not sufficiently processed hazards do not lead to the appropriate breaking reaction on the part of the driver.     

ASTEF: A simple tool for examining fixations

In human factors and ergonomics research, the analysis of eye movements has gained popularity as a method for obtaining information concerning the operator's cognitive strategies and for drawing inferences about the cognitive state of an individual. For example, recent studies have shown that the distribution of eye fixations is sensitive to variations in mental workload---dispersed when workload is high, and clustered when workload is low. Spatial statistics algorithms can be used to obtain information about the type of distribution and can be applied over fixations recorded during small epochs of time to assess online changes in the level of mental load experienced by the individuals. In order to ease the computation of the statistical index and to encourage research on the spatial properties of visual scanning, A Simple Tool for Examining Fixations has been developed. The software application implements functions for fixation visualization, management, and analysis, and includes a tool for fixation identification from raw gaze point data. Updated information can be obtained online at www.astef.info, where the installation package is freely downloadable.     

Fixation identification: The optimum threshold for a dispersion algorithm

It is hypothesized that the number, position, size, and duration of fixations are functions of the metric used for dispersion in a dispersion-based fixation detection algorithm, as well as of the threshold value. The sensitivity of the I-DT algorithm for the various independent variables was determined through the analysis of gaze data from chess players during a memory recall experiment. A procedure was followed in which scan paths were generated at distinct intervals in a range of threshold values for each of five different metrics of dispersion. The percentage of points of regard (PORs) used, the number of fixations returned, the spatial dispersion of PORs within fixations, and the difference between the scan paths were used as indicators to determine an optimum threshold value. It was found that a fixation radius of 1° provides a threshold that will ensure replicable results in terms of the number and position of fixations while utilizing about 90% of the gaze data captured.     

The malleability of age-related positive gaze preferences: training to change gaze and mood

Older adults show positive gaze preferences, but to what extent are these preferences malleable? Examining the plasticity of age-related gaze preferences may provide a window into their origins. We therefore designed an attentional training procedure to assess the degree to which we could shift gaze and gaze-related mood in both younger and older adults. Participants completed either a positive or negative dot-probe training. Before and after the attentional training, we obtained measures of fixations to negatively valenced images along with concurrent mood ratings. We found differential malleability of gaze and mood by age: for young adults, negative training resulted in fewer posttraining fixations to the most negative areas of the images, whereas positive training appeared more successful in changing older adults' fixation patterns. Young adults did not differ in their moods as a function of training, whereas older adults in the train negative group had the worst moods after training. Implications for the etiology of age-related positive gaze preferences are considered.     

Heuristic filtering and reliable calibration methods for video-based pupil-tracking systems

Methods for enhancing the accuracy of fixation and saccade detection and the reliability of calibration in video gaze-tracking systems are discussed. The unique aspects of the present approach include effective low-delay noise reduction prior to the detection of fixation changes, monitoring of gaze position in real time by the operator, identification of saccades as small as 0.5° while eliminating false fixations, and a quick, high-precision, semiautomated calibration procedure.     

Gaze motion clustering in scan-path estimation

Visual attention is considered nowadays a paramount ability both in Cognitive Sciences and in Cognitive Vision to bridge the gap between perception and higher level reasoning functions, such as scene interpretation and decision making. Bottom-up gaze shifting is the main mechanism used by humans when exploring a scene without a specific task. In this paper we investigated which criteria allow for the generation of plausible fixation clusters by analysing experimental data of human subjects. We suggest that fixations should be grouped in cliques whose saliency can be assessed through an innovation factor encompassing bottom-up cues, proximity, direction and memory components.     

Visual disengagement in young infants in relation to age,sex, SES,developmental level and adaptive functioning

Visual attention plays a key role in infants’ interaction with the environment, and shapes their behavioral and brain development. As such, early problems with flexibly switching gaze from one stimulus to another (visual disengagement) have been hypothesized to lead to developmental difficulties (e.g. joint attention and social skills) over time. This study aimed to identify cross-sectional associations between performance in the Gap task (gaze shift latencies and visual attention disengagement) and measures of development and adaptive behavior in conjunction to any sex or socioeconomic status effects in infancy. We measured visual attention disengagement in 436 5-month-old infants and calculated its association with cognitive developmental level, adaptive behaviours, socioeconomic status (SES) and biological sex. In the Gap task, participants must redirect their gaze from a central stimulus to an appearing peripheral stimulus. The three experimental conditions of the task (Gap, Baseline and Overlap) differ on the timepoint when the central stimuli disappears in relation to the appearance of the peripheral stimulus: 200 ms before the peripheral stimulus appears (Gap), simultaneously to its appearance (Baseline), or with peripheral stimulus offset (Overlap). The data from the experimental conditions showed the expected pattern, with average latencies being the shortest in the Gap and longest in the Overlap condition. Females were faster (p = .004) than males in the Gap condition, which could indicate that arousal-related effects differ as a function of biological sex. Infants from higher SES were slower (p = .031) in the Overlap condition compared to lower SES infants. This suggests that basic visual attention may differ by socio-cultural background, and should be considered when studying visual attention and its developmental correlates. We observed no significant association to concurrent developmental level or adaptive function. Given its large sample size, this study provides a useful reference for future studies of visual disengagement in early infancy.     

阅读研究中的主要眼动指标评述

眼跳和注视是阅读过程中的两种基本眼动现象.目前在对阅读的眼动研究中分析指标主要包括两类,一类是与眼睛何时移动有关的时间维度的眼动指标,具体包括以字或词为兴趣区的眼动指标,如单一注视时间、首次注视时间、第二次注视时间、凝视时间、离开目标后的首次注视时间、回视时间和总注视时间等,以及以短语或句子为兴趣区的眼动指标,如第一遍阅读时间、向前阅读时间、第二遍阅读时间、回视路径阅读时间、重读时间等.另一类是与眼睛移动位置有关的空间维度的眼动指标,具体包括眼跳距离、注视位置、注视次数、跳读率、再注视比率和回视次数等.在使用眼动指标时,需要注意眼动指标的分类、原始数据的删除标准以及眼动指标的选择等问题.     

Using machine learning to detect events in eye-tracking data

Event detection is a challenging stage in eye movement data analysis. A major drawback of current event detection methods is that parameters have to be adjusted based on eye movement data quality. Here we show that a fully automated classification of raw gaze samples as belonging to fixations, saccades, or other oculomotor events can be achieved using a machine-learning approach. Any already manually or algorithmically detected events can be used to train a classifier to produce similar classification of other data without the need for a user to set parameters. In this study, we explore the application of random forest machine-learning technique for the detection of fixations, saccades, and post-saccadic oscillations (PSOs). In an effort to show practical utility of the proposed method to the applications that employ eye movement classification algorithms, we provide an example where the method is employed in an eye movement-driven biometric application. We conclude that machine-learning techniques lead to superior detection compared to current state-of-the-art event detection algorithms and can reach the performance of manual coding.     

An adaptive algorithm for fixation,saccade, and glissade detection in eyetracking data

Event detection is used to classify recorded gaze points into periods of fixation, saccade, smooth pursuit, blink, and noise. Although there is an overall consensus that current algorithms for event detection have serious flaws and that a de facto standard for event detection does not exist, surprisingly little work has been done to remedy this problem. We suggest a new velocity-based algorithm that takes several of the previously known limitations into account. Most important, the new algorithm identifies so-called glissades, a wobbling movement at the end of many saccades, as a separate class of eye movements. Part of the solution involves designing an adaptive velocity threshold that makes the event detection less sensitive to variations in noise level and the algorithm settings-free for the user. We demonstrate the performance of the new algorithm on eye movements recorded during reading and scene perception and compare it with two of the most commonly used algorithms today. Results show that, unlike the currently used algorithms, fixations, saccades, and glissades are robustly identified by the new algorithm. Using this algorithm, we found that glissades occur in about half of the saccades, during both reading and scene perception, and that they have an average duration close to 24 msec. Due to the high prevalence and long durations of glissades, we argue that researchers must actively choose whether to assign the glissades to saccades or fixations; the choice affects dependent variables such as fixation and saccade duration significantly. Current algorithms do not offer this choice, and their assignments of each glissade are largely arbitrary.     

Attention to faces and gaze-following in social anxiety: preliminary evidence from a naturalistic eye-tracking investigation

Social attentional biases are a core component of social anxiety disorder, but research has not yet determined their direction due to methodological limitations. Here we present preliminary findings from a novel, dynamic eye-tracking paradigm allowing spatial–temporal measurement of attention and gaze-following, a mechanism previously unexplored in social anxiety. 105 participants took part, with those high (N?=?27) and low (N?=?25) in social anxiety traits (HSA and LSA respectively) entered into the analyses. Participants watched a video of an emotionally-neutral social scene, where two actors periodically shifted their gaze towards the periphery. HSA participants looked more at the actors’ faces during the initial 2s than the LSA group but there were no group differences in proportion of first fixations to the face or latency to first fixate the face, although HSA individuals’ first fixations to the face were shorter. No further differences in eye movements were found, nor in gaze-following behaviour, although these null effects could potentially result from the relatively small sample. Findings suggest attention is biased towards faces in HSA individuals during initial scene inspection, but that overt gaze-following may be impervious to individual differences in social anxiety. Future research should seek to replicate these effects.     

Human ostensive signals do not enhance gaze following in chimpanzees,but do enhance object-oriented attention

The previous studies have shown that human infants and domestic dogs follow the gaze of a human agent only when the agent has addressed them ostensively—e.g., by making eye contact, or calling their name. This evidence is interpreted as showing that they expect ostensive signals to precede referential information. The present study tested chimpanzees, one of the closest relatives to humans, in a series of eye-tracking experiments using an experimental design adapted from these previous studies. In the ostension conditions, a human actor made eye contact, called the participant’s name, and then looked at one of two objects. In the control conditions, a salient cue, which differed in each experiment (a colorful object, the actor’s nodding, or an eating action), attracted participants’ attention to the actor’s face, and then the actor looked at the object. Overall, chimpanzees followed the actor’s gaze to the cued object in both ostension and control conditions, and the ostensive signals did not enhance gaze following more than the control attention-getters. However, the ostensive signals enhanced subsequent attention to both target and distractor objects (but not to the actor’s face) more strongly than the control attention-getters—especially in the chimpanzees who had a close relationship with human caregivers. We interpret this as showing that chimpanzees have a simple form of communicative expectations on the basis of ostensive signals, but unlike human infants and dogs, they do not subsequently use the experimenter’s gaze to infer the intended referent. These results may reflect a limitation of non-domesticated species for interpreting humans’ ostensive signals in inter-species communication.