GazeParser: an open-source and multiplatform library for low-cost eye tracking and analysis

Eye movement analysis is an effective method for research on visual perception and cognition. However, recordings of eye movements present practical difficulties related to the cost of the recording devices and the programming of device controls for use in experiments. GazeParser is an open-source library for low-cost eye tracking and data analysis; it consists of a video-based eyetracker and libraries for data recording and analysis. The libraries are written in Python and can be used in conjunction with PsychoPy and VisionEgg experimental control libraries. Three eye movement experiments are reported on performance tests of GazeParser. These showed that the means and standard deviations for errors in sampling intervals were less than 1 ms. Spatial accuracy ranged from 0.7° to 1.2°, depending on participant. In gap/overlap tasks and antisaccade tasks, the latency and amplitude of the saccades detected by GazeParser agreed with those detected by a commercial eyetracker. These results showed that the GazeParser demonstrates adequate performance for use in psychological experiments.     

Saccade latency and warning signals: Stimulus onset,offset, and change as warning events

Two experiments investigated saccade latency to a peripheral target under various warning signal conditions. In Experiment I, the effects of warning stimulus onset, change, and two offset conditions were compared at warning intervals of 0, 100, 300, and 600 msec. Warning stimulus onset, change, and offset were all effective in reducing saccade latency as compared to a no-warning control condition, but warning stimulus offset resulted in shorter saccade latency than onset or change at all warning intervals. Experiment 2 compared onset and offset warning conditions at ?300-, ?250-, ?200-, ?150-, ?100-, ?50-, 0-, and 50-msec intervals. Responses following onset were slower than those following offset at the latter five intervals, while warning onset resulted in slower saccades than no-warning control conditions at ?150-, ?100-, and ?50-msec intervals. These results indicate that the onset of a visual warning signal can have an interfering effect on the programming or execution of a saccade.     

Fixation point offsets facilitate endogenous saccades

Subjects produced saccades to continuously visible targets that were signaled by the pitch, not the location, of an auditory signal. Such endogenous saccades were initiated more quickly when the visual fixation point disappeared 200 msec before the signal (thus producing a “gap”), even though the alerting benefits of such a warning were eliminated by an earlier warning tone. The presence of the gap effect under these circumstances shows that the effect is more general than was previously believed: Visual fixation point offsets facilitate saccades by affecting oculomotor processes related to both visually elicited (exogenous) and centrally produced (endogenous) saccades. In addition, the magnitude of the gap effect for endogenous saccades was significantly smaller than that for exogenous saccades, suggesting that at least some of the effect arises in relatively early processes, such as those involved in the processing of sensory signals, and not exclusively in later processes, such as those involved in the preparation and production of saccades.     

Saccadic reaction times of dyslexic and age-matched normal subjects

Saccadic reaction times (SRT) were measured in a simple task: subjects had to make saccades from a central fixation point to peripheral targets, which appeared randomly 4 deg to the left or to the right. In the first test the fixation point went off before the target appeared (gap trials); in the second test it remained on the screen (overlap trials). The distribution of SRTs for trained normal adults (N = 4), untrained normal adults (N = 11), untrained normal children (aged 9-11 years, N = 9), untrained normal teenagers (aged 15-17 years, N = 8), dyslexic children (aged 9-11 years, N = 15), and dyslexic teenagers (aged 15-17 years, N = 5) were compared, with special emphasis on the number of express saccades, ie saccades with extremely short reaction times (100-120 ms, under the present conditions). In normal adults with the gap paradigm, the distribution of reaction times typically exhibits two or three modes (express saccades, fast regular saccades, and very few slow regular saccades), whereas in the overlap paradigm only one or two modes (few fast regular saccades and many slow regular saccades) are obtained. On average, normal children produce more express saccades than naive normal adults. Dyslexic children produce more express saccades than the normal age-matched controls. Among the dyslexic children, four different types of abnormalities in their reaction times were encountered. The group of dyslexic teenagers was characterized by a larger number of express saccades at the expense of fast regular saccades in gap trials and by fewer express saccades and fewer fast regular saccades in overlap trials when compared to the age-matched control group. It is concluded that the abnormal patterns of saccadic reaction times reflect defects in the system of visual attention and/or in its control over the oculomotor system, rather than indicating a defect in the oculomotor system itself. In this context, symptoms of dyslexia appear as a combination of attentional deficits and irregular timing of saccadic eye movements.     

Growing older does not always mean moving slower: examining aging and the saccadic motor system

Although humans typically move more slowly as they age, one exception may be the saccadic motor system. To fully determine whether the execution of saccades is affected by age, the authors examined detailed kinematics of vertical and horizontal saccades across a range of saccadic amplitudes (4 degrees, 8 degrees, and 12 degrees). Ten younger and 20 older adults participated in each experiment. Whereas in the 1st experiment, the authors assessed volitionally generated saccades, in the 2nd experiment, they evaluated reflexively generated saccades. The results of those experiments showed that the saccadic motor system is relatively impervious to the effects of aging; in fact, the differences between vertical and horizontal saccades were more evident than were differences between saccades produced by younger and older adults. The authors discuss possible reasons for that relative resistance to aging.     

Presaccadic attention allocation and express saccades

Express saccades are visually-guided saccades that are characterized by an extremely short latency of about 100 ms. The present experiments tested the hypothesis that a disengagement of visual attention is necessary for the generation of express saccades. All subjects produced large numbers of express saccades in the gap paradigm, in which the fixation stimulus is removed 200 ms before target onset (Exp. 1), but not in the overlap paradigm, in which the fixation stimulus remains on during the entire trial (Exp. 2). By means of peripheral cues (Exps. 3–5) and central cues (Exps. 6–7), visual attention was directed at the target location for the saccade before the actual appearance of the saccade target. In all experiments, the location cues facilitated rather than abolished express saccades. The generation of express saccades was facilitated even when the currently fixated visual stimulus was not removed before target onset (fixation-overlap; Exps. 5–7). The results are explained by the hypothesis that a disengagement of a separate fixation system is necessary for the generation of express saccades, a hypothesis that is in line with current neurobiological findings.     

Strategic control over saccadic eye movements: studies of the fixation offset effect

We studied the strategic (presumably cortical) control of ocular fixation in experiments that measured the fixation offset effect (FOE) while manipulating readiness to make reflexive or voluntary eye movements. The visual grasp reflex, which generates reflexive saccades to peripheral visual signals, reflects an opponent process in the superior colliculus (SC) between fixation cells at the rostral pole, whose activity helps maintain ocular position and increases when a stimulus is present at fixation, and movement cells, which generate saccades and are inhibited by rostral fixation neurons. Voluntary eye movements are controlled by movement and fixation cells in the frontal eye field (FEF). The FOE--a decrease in saccade latency when the fixation stimulus is extinguished--has been shown to reflect activity in the collicular eye movement circuitry and also to have an activity correlate in the FEF. Our manipulation of preparatory set to make reflexive or voluntary eye movements showed that when reflexive saccades were frequent and voluntary saccades were infrequent, the FOE was attenuated only for reflexive saccades. When voluntary saccades were frequent and reflexive saccades were infrequent, the FOE was attenuated only for voluntary saccades. We conclude that cortical processes related to task strategy are able to decrease fixation neuron activity even in the presence of a fixation stimulus, resulting in a smaller FOE. The dissociation in the effects of a fixation stimulus on reflexive and voluntary saccade latencies under the same strategic set suggests that the FOEs for these two types of eye movements may reflect a change in cellular activity in different neural structures, perhaps in the SC for reflexive saccades and in the FEF for voluntary saccades.     

The control of fixation duration in visual search

A study is reported how fixation durations are affected as observers voluntarily use information in the visual environment to direct saccades in search of a target. In experiments with direction-coded displays, search fixation durations for correct and incorrectly directed saccades were comparable during image-driven/bottom-up search. In contrast, for knowledge-driven search, the relationship depended on peripheral preview. With ample access to peripheral preview, search fixation durations preceding correct saccades were shorter than those preceding incorrectly directed saccades. However, they were longer when preview was constrained by a gaze-contingent moving window. Fixation control was modeled as sigmoid functions.     

Backward and forward masking associated with saccadic eye movement

Visual masking effects on test flash thresholds were measured under real and simulated eye movement conditions to determine whether visual masking is primarily responsible for elevations in threshold that are sometimes associated with saccadic eye movements. Brief luminous flashes presented to the central retina before, during, and after saccades were masked by stimuli presented either pre- or postsaccadically. The amount and time course of masking were quantitatively dependent on stimulus parameters of intensity and temporal separation and were unaffected by eye movement parameters (amplitude, velocity, direction) as long as retinal stimulus conditions were constant. The duration of forward masking was longer than that of backward masking. When retinal conditions during saccades were mimicked while the eyes were held steady, masking interactions were identical to those obtained during real saccades. These results indicate that masking effects during saccades in ordinary environments are determined solely by the stimulus situation at the retina. Putative nonvisual, centrally originating saccadic suppression suggested by other authors is evidently not additive with visually determined masking during saccades.     

Differential roles of the frontal and parietal cortices in the control of saccades

Although externally as well as internally-guided eye movements allow us to flexibly explore the visual environment, their differential neural mechanisms remain elusive. A better understanding of these neural mechanisms will help us to understand the control of action and to elucidate the nature of cognitive deficits in certain psychiatric populations (e.g. schizophrenia) that show increased latencies in volitional but not visually-guided saccades. Both the superior precentral sulcus (sPCS) and the intraparietal sulcus (IPS) are implicated in the control of eye movements. However, it remains unknown what differential contributions the two areas make to the programming of visually-guided and internally-guided saccades. In this study we tested the hypotheses that sPCS and IPS distinctly encode internally-guided saccades and visually-guided saccades. We scanned subjects with fMRI while they generated visually-guided and internally-guided delayed saccades. We used multi-voxel pattern analysis to test whether patterns of cue related, preparatory and saccade related activation could be used to predict the direction of the planned eye movement. Results indicate that patterns in the human sPCS predicted internally-guided saccades but not visually-guided saccades in all trial periods and patterns in the IPS predicted internally-guided saccades and visually-guided saccades equally well. The results support the hypothesis that the human sPCS and IPS make distinct contributions to the control of volitional eye movements.     

Saccades compress space, time and number

It has been suggested that space, time and number are represented on a common subjective scale. Saccadic eye movements provide a fascinating test. Saccades compress the perceived magnitude of spatial separations and temporal intervals to approximately half of their true value. The question arises as to whether saccades also compress number. They do, and compression follows a very similar time course for all three attributes: it is maximal at saccadic onset and decreases to veridicality within a window of approximately 50ms. These results reinforce the suggestion of a common perceptual metric, which is probably mediated by the intraparietal cortex; they further suggest that before each saccade the common metric for all three is reset, possibly to pave the way for a fresh analysis of the post-saccadic situation.     

Aging and the strategic control of the fixation offset effect

A study was conducted to examine potential age-related differences in the strategic control of exogenous and endogenous saccades within the context of the fixation offset effect (FOE; i.e., faster saccades when a fixation point is removed than when it is left on throughout a trial). Subjects were instructed to make rapid saccades either on the basis of a suddenly appearing peripheral visual stimulus (exogenous saccade) or in response to a tone (endogenous saccade). On half of the trials the fixation point was removed simultaneously with the occurrence of the cue stimulus. Subjects' preparatory set was varied by manipulating the proportion of saccades generated to a visual and auditory stimulus within a trial block. Young and old adults both produced FOEs, and the FOEs were strategically modulated by preparatory set. The data are discussed in terms of aging and oculomotor control.     

视觉搜索过程中的眼跳及其机制

该文对视觉搜索过程中的眼跳及其时间进程、神经机制及相关的理论与模型等方面研究进行了回顾。发现内外源性眼跳得到了研究者的普遍关注,对眼运动记忆、返回抑制及眼跳时间进程的研究尚存在分歧。关于眼跳的神经机制,额叶眼动区与上丘分别被认为是眼跳的关键区与指令发出者。尽管不同的眼跳理论与模型对眼跳现象给出了各自的解释,但都不尽完善,尚需对这些理论进行整合或者提出新的解释模型。文章还对未来的研究进行了展望     

The effects of flicker on eye movement control

Groups of typists with extensive experience of screen-based editing and groups of students with no such experience carried out a reading task under three conditions of illumination (50-Hz flicker, 100-Hz flicker, and steady illumination). Subjects read a sentence, which was followed by the presentation of a single stimulus word on the same line to the right-hand side of the display. The task was to decide whether or not the stimulus was present in the sentence. Subjects were free to re-inspect the sentence when making the decision. Eye movements were measured as subjects completed the task. In comparison with students, typists adopted a more cautious reading style, making more right-to-left saccades, shorter saccades, and more corrective eye movements. Flicker affected the performance of both groups of subjects in the first pass, leading to shorter saccades. In the second pass, its effect for students was to shorten the extent of large saccades made to check the presence of the stimulus word. In the group of typists, flicker led to an increase in the variability of saccade extent and a doubling in the number of small corrective saccades. The results are consistent with the view that flicker has two distinct effects on reading, both of which are potentially disruptive. The first relates to an increase in the number of prematurely triggered saccades, which are, as a result, less accurate. The second is an increase in the number of saccades perturbed in flight, which land short of their intended target. These two mechanisms may have different consequences for readers, depending on their reading style.     

Oculomotor interference during manual response preparation: evidence from the response-cueing paradigm

Preparation provided by visual location cues is known to speed up behavior. However, the role of concurrent saccades in response to visual cues remains unclear. In this study, participants performed a spatial precueing task by pressing one of four response keys with one of four fingers (two of each hand) while eye movements were monitored. Prior to the stimulus, we presented a neutral cue (baseline), a hand cue (corresponding to left vs. right positions), or a finger cue (corresponding to inner vs. outer positions). Participants either remained fixated on a central fixation point or moved their eyes freely. The results demonstrated that saccades during the cueing interval altered the pattern of cueing effects. Finger cueing trials in which saccades were spatially incompatible (vs. compatible) with the subsequently required manual response exhibited slower manual RTs. We propose that interference between saccades and manual responses affects manual motor preparation.     

Perisaccadic parietal and occipital gamma power in light and in complete darkness

Our objective was to determine perisaccadic gamma range oscillations in the EEG during voluntary saccades in humans. We evaluated occipital perisaccadic gamma activity both in the presence and absence of visual input, when the observer was blindfolded. We quantified gamma power in the time periods before, during, and after horizontal saccades. The corresponding EEG was evaluated for individual saccades and the wavelet transformed EEG averaged for each time window, without averaging the EEG first. We found that, in both dark and light, parietal and occipital gamma power increased during the saccade and peaked prior to reaching new fixation. We show that this is not the result of muscle activity and not the result of visual input during saccades. Saccade direction affects the laterality of gamma power over posterior electrodes. Gamma power recorded over the posterior scalp increases during a saccade. The phasic modulation of gamma by saccades in darkness--when occipital activity is decoupled from visual input--provides electrophysiological evidence that voluntary saccades affect ongoing EEG. We suggest that saccade-phasic gamma modulation may contribute to short-term plasticity required to realign the visual space to the intended fixation point of a saccade and provides a mechanism for neuronal assembly formation prior to achieving the intended saccadic goal. The wavelet-transformed perisaccadic EEG could provide an electrophysiological tool applicable in humans for the purpose of fine analysis and potential separation of stages of 'planning' and 'action'.     

Saccade control in natural images is shaped by the information visible at fixation: evidence from asymmetric gaze-contingent windows

When people view images, their saccades are predominantly horizontal and show a positively skewed distribution of amplitudes. How are these patterns affected by the information close to fixation and the features in the periphery? We recorded saccades while observers encoded a set of scenes with a gaze-contingent window at fixation: Features inside a rectangular (Experiment 1) or elliptical (Experiment 2) window were intact; peripheral background was masked completely or blurred. When the window was asymmetric, with more information preserved either horizontally or vertically, saccades tended to follow the information within the window, rather than exploring unseen regions, which runs counter to the idea that saccades function to maximize information gain on each fixation. Window shape also affected fixation and amplitude distributions, but horizontal windows had less of an impact. The findings suggest that saccades follow the features currently being processed and that normal vision samples these features from a horizontally elongated region.     

Saccadic exploration and perceptual-motor learning

A cognitive model of perceptual-motor learning by saccadic exploration is outlined. The model proceeds from the assumption that saccades are guided by anticipating their specific retinal change (intentional control of saccades). Perceptual-motor learning by saccadic exploration is described as the process of detecting the invariance which determines the relationship between efference and reafference.     

Estimating peak velocity of rapid eye movements from video recordings

Although video offers many advantages for recording human eye orientation, it involves such low temporal resolution (60 Hz) that it seems an unpromising method for evaluating the dynamics of rapid (saccadic) eye movements. This study demonstrates, nevertheless, that such measurements can provide surprisingly reliable estimates of the peak velocity of larger saccades. Simulations of 60-Hz sampling of eye position during idealized saccades provided replicated estimates of “apparent peak velocity.” The results indicate that when saccadic amplitude is about 10° or larger, estimates of peak velocity would on average be biased downward by less than 10%, with standard deviations due to measurement timing of less than 5%. Experimental data (from recordings of 10° and 20° saccades with customized video) demonstrate that these theoretical sources of uncertainty are considerably smaller than the trialto- trial variability in performance of real saccades. Reliability of video recording, however, rapidly deteriorates when saccades become smaller than about 10°.     

Prioritization of new objects in real-world scenes: evidence from eye movements

The authors examined the prioritization of abruptly appearing objects in real-world scenes by measuring the eyes' propensity to be directed to the new object. New objects were fixated more often than chance whether they appeared during fixations (transient onsets) or saccades (nontransient onsets). However, onsets that appeared during fixations were fixated sooner and more often than those coincident with saccades. Prioritization of onsets during saccades, but not fixations, were affected by manipulations of memory: Reducing scene viewing time prior to the onset eliminated prioritization, whereas prior study of the scenes increased prioritization. Transient objects draw attention quickly and do not depend on memory, but without a transient signal, new objects are prioritized over several saccades as memory is used to explicitly identify the change. These effects were not modulated by observers' expectations concerning the appearance of new objects, suggesting the prioritization of a transient is automatic and that memory-guided prioritization is implicit.