An eye movement analysis system (EMAS) for the identification of cognitive processes on figural tasks

EMAS is a software system (written in VAX-11 FORTRAN) for the analysis of eye movement data recorded during the performance of figural tasks. Its main functions are: (1) Calibration of raw coordinates of eye movements to determine their actual position on the stimulus display. Different kinds of measurement distortion may be corrected. (2) Identification of eye fixations and the determination of their locations and durations. (3) Analysis of fixation sequences. The frequency of transitions of fixations among specified sectors of the stimulus display is computed. A sequential list is made of the successive fixations in which the fixated sector and the fixation duration are graphically indicated. (4) Plotting of raw or calibrated eye movement data and fixation points. The sequence of fixations in specified display sectors can also be plotted in real time. Applications of the programs to the Embedded Figures Test and the Hidden Figures Test are illustrated.     

Eye movement research on the propositional structure of short texts

The present paper describes the application of computer-based programs to the evaluation of eye movements during reading of short texts. These programs operate in background, that is, after an experimental session is completed and the raw data are collected on magnetic tape. The first program reduces the raw data into a sequence of fixation locations and durations, eye movements, and eye blinks. A second program utilizes calibration coordinates and line-of-text information to transform the reduced data into a standard grid format. Fixation order, locations, and durations for each line of text read are output with respect to the line of text. The final program summarizes fixation locations, frequencies, and durations with respect to analyses of the texts into levels within a hierarchy of propositions in the text base (Kintsch, 1974).     

The relevance of the first two eye fixations for recognition memory processes

ABSTRACT

Stimuli can be recognised based on information from only one or two eye fixations. With only one fixation, item recognition is typically above chance level and performance generally saturates by the second fixation. Thus, the first two eye fixations play an important role for recognition memory performance. However, little is known about the involved processes. Therefore, two experiments were conducted to investigate hypotheses regarding the role of the first two eye fixations for specific recognition memory processes, that is, familiarity and recollection. In addition, we looked in detail at the unique contributions of (a) longer input duration and (b) additional information provided by a second fixation for familiarity- and recollection-based recognition, using a gaze-contingent stimulus presentation technique. The experiments showed that recollection- but not familiarity-based recognition increased with two compared to only one fixation, and that the second fixation boosted recollection both due to longer availability of the input and additional stimulus information gathered.     

A rapid effect of stimulus quality on the durations of individual fixations during reading

We developed a variant of the single fixation replacement paradigm (Yang & McConkie, 2001, 2004) in order to examine the effect of stimulus quality on fixation duration during reading. Subjects' eye movements were monitored while they read passages of text for comprehension. During critical fixations, equal changes to the luminance of the background produced either an increase (Up-Contrast) or a decrease (Down-Contrast) of the contrast of the text. The durations of critical fixations were found to be lengthened in the Down-Contrast but not the Up-Contrast condition. Ex-Gaussian modelling of the distributions of fixation durations showed that the reduction in stimulus quality lengthened the majority of fixations, and a survival analysis estimated the onset of this effect to be approximately 141 ms following fixation onset. Because the stimulus quality of the text during critical fixations could not be predicted or parafoveally previewed prior to foveation, the present effect can be attributed to an immediate effect of stimulus quality on fixation duration.     

Eye movements of large populations: II. Deriving regions of interest, coverage, and similarity using fixation maps

The analysis of eye movement traces (i.e., the patterns of fixations in a search) is more complex than that of such parameters as mean fixation duration, and as a result, previous attempts have focused on a qualitative appraisal of the form of an eye movement trace. In this paper, the concept of thefixation map is introduced. Its application to the quantification of similarity of traces and the degree of coverage by fixations of a visual stimulus is discussed. The ability of fixation maps to aid in the understanding and communication of large numbers of eye movement traces is examined.     

Modeling Lag‐2 Revisits to Understand Trade‐Offs in Mixed Control of Fixation Termination During Visual Search

An important question about eye‐movement behavior is when the decision is made to terminate a fixation and program the following saccade. Different approaches have found converging evidence in favor of a mixed‐control account, in which there is some overlap between processing information at fixation and planning the following saccade. We examined one interesting instance of mixed control in visual search: lag‐2 revisits, during which observers fixate a stimulus, move to a different stimulus, and then revisit the first stimulus on the next fixation. Results show that the probability of lag‐2 revisits occurring increased with the number of target‐similar stimuli, and revisits were preceded by a brief fixation on the intervening distractor stimulus. We developed the Efficient Visual Sampling (EVS) computational model to simulate our findings (fixation durations and fixation locations) and to provide insight into mixed control of fixations and the perceptual, cognitive, and motor processes that produce lag‐2 revisits.     

A software system for the collection of retrospective protocols prompted by eye fixations

A software system is capable of recording eye position, reducing these data to a sequence of eye fixations, and immediately replaying this fixation sequence superimposed over the original stimulus. The replay can be controlled by the subject to produce various speeds, to pause, or to back up to earlier fixations. The purpose of the replay software is to enable the eye fixations to prompt a retrospective verbal protocol. Such a prompted protocol should reduce the forgetting and fabrication problems that are often associated with retrospective protocols. In a preliminary experimental test, the prompted protocol method yielded longer protocols and contained more words than those generated by either the concurrent or retrospective protocol methods.     

Manipulation of stimulus onset delay in reading: evidence for parallel programming of saccades

On-line eye movement recording of 12 subjects who read short stories on a cathode ray tube enabled a test of direct control and preprogramming models of eye movements in reading. Contingent upon eye position, a mask was displayed in place of the letters in central vision after each saccade, delaying the onset of the stimulus in each eye fixation. The duration of the delay was manipulated in fixed or randomized blocks. Although the length of the delay strongly affected the duration of the fixations, there was no difference due to the conditions of delay manipulation, indicating that fixation duration is under direct control. However, not all fixations were lengthened by the period of the delay. Some ended while the mask was still present, suggesting they had been preprogrammed. But these "anticipation" eye movements could not have been completely determined before the fixation was processed because their fixation durations and saccade lengths were affected by the spatial extent of the mask, which varied randomly. Neither preprogramming nor existing serial direct control models of eye guidance can adequately account for these data. Instead, a model with direct control and parallel programming of saccades is proposed to explain the data and eye movements in reading in general.     

Some temporal characteristics of processing during reading

College students read passages displayed on a cathode-ray tube as their eye movements were being monitored. During occasional fixations, all letters to the left of the directly fixated letter or all letters more than four to the right of the fixated letter were replaced by other letters. This replacement occurred either for only the first 100 ms of the fixation or only after the first 100 ms of the fixation. The eye movement data indicated that the eyes can respond to change in the visual stimulus within less than 100 ms and to orthographic irregularity in the text within less than 160 ms. No evidence was found for a left-to-right attentional scan during a fixation. The results were interpreted within the framework of a chronology of processing events occurring during a fixation in reading.     

The distribution of fixation durations during reading: effects of stimulus quality

Participants' eye movements were recorded as they read single sentences presented normally, presented entirely in faint text, or presented normally except for a single faint word. Fixations were longer when the entire sentence was faint than when the sentence was presented normally. In addition, fixations were much longer on a single faint word embedded in normal text, compared to when the entire sentence was faint. The primary aim of the study was to examine the influence of stimulus quality on the distribution of fixation durations. Ex-Gaussian fitting revealed that stimulus quality affected the mean of the Normal component, but in contrast to results from single-word tasks (Plourde & Besner, 1997), stimulus quality did not affect the exponential component, regardless of whether one or all words were faint. The results also contrast with the finding (Staub, White, Drieghe, Hollway, & Rayner, 2010) that the word frequency effect on fixation durations is an effect on both of the critical distributional parameters. These findings are argued to have implications for the interpretation of the role of stimulus quality in word recognition, and for models of eye movement control in reading.     

Eye movements as a function of response contingencies measured by blackout technique

A program may have a low error rate but, at the same time, require little of the student and teach him little. A measure to supplement error rate in evaluating a program has recently been developed. This measure, called the blackout ratio, is the percentage of material that may be deleted without increasing the error rate. In high blackout-ratio programs, obtaining a correct answer is contingent upon only a small portion of the item. The present study determined if such low response-contingent material is read less thoroughly than programmed material that is heavily response-contingent. Eye movements were compared for two versions of the same program that differed only in the choice of the omitted words. The alteration of the required responses resulted in a version with a higher blackout ratio than the original version, which had a low blackout ratio. Eighteen undergraduates received half their material from the high and half their material from the low blackout-ratio version. The order was counterbalanced. Location and duration of all eye fixations in each item were recorded by a Mackworth Eye Marker Camera. On high blackout-ratio material, subjects used fewer fixations, shorter fixation time, and shorter scanning time. High blackout-ratio material failed to evoke the students' attention.     

Picture perception: effects of luminance on available information and information-extraction rate

In each of four experiments, complex visual stimuli--pictures and digit arrays--were remembered better when shown at high luminance than when shown at low luminance. Why does this occur? Two possibilities were considered: first that lowering luminance reduces the amount of available information in the stimulus, and second that lowering luminance reduces the rate at which the information is extracted from the stimulus. Evidence was found for both possibilities. When stimuli were presented at durations short enough to permit only a single eye fixation, luminance affected only the rate at which information is extracted: decreasing luminance by a factor of 100 caused information to be extracted more slowly by a factor that ranged, over experiments, from 1.4 to 2.0. When pictures were presented at durations long enough to permit multiple fixations, however, luminance affected the total amount of extractable information. In a fifth experiment, converging evidence was sought for the proposition that within the first eye fixation on a picture, luminance affects the rate of information extraction. If this proposition is correct and, in addition, the first eye fixation lasts until some criterion amount of information is extracted, then fixation duration should increase with decreasing luminance. This prediction was confirmed.     

How many faces can be processed during a single eye fixation?

The purpose of our study was to estimate the perceptual span for facial information: how many faces can be processed during a single eye fixation. We used a visual-search task, in which the targets and distractors were facial photographs. The task of the observer was to search for and identify a target face in an array of faces. We measured the time needed for one search--threshold search time--by using a multiple-alternative staircase method. The threshold represents the duration of stimulus presentation at which the probability of correct responses was 79%. The array size was varied from 2 x 2 to 8 x 8 faces. Simultaneously with the performance measurements we measured eye movements with a video eye tracker. We found that threshold search time increased with increasing set size nearly linearly. The number of fixations also increased linearly from unity at the smallest set size to about fifteen at the largest set size. The result of 2 x 2 faces during a single fixation gave an estimate of 4 faces for the perceptual span. If, on average, only half of the elements had to be scanned for finding the target, 15 fixations at the largest set size (8 x 8) gave another estimate of 2.13 faces. The mean fixation duration was around 200 ms. Thus, the results suggest that 2-4 faces can be processed during one fixation of about 200 ms.     

Measuring the effect of multiple eye fixations on memory for visual attributes.

Because of limited peripheral vision, many visual tasks depend on multiple eye fixations. Good performance in such tasks demonstrates that some memory must survive from one fixation to the next. One factor that must influence performance is the degree to which multiple eye fixations interfere with the critical memories. In the present study, the amount of interference was measured by comparing visual discriminations based on multiple fixations to visual discriminations based on a single fixation. The procedure resembled partial report, but used a discrimination measure. In the prototype study, two lines were presented, followed by a single line and a cue. The cue pointed toward one of the positions of the first two lines. Observers were required to judge if the single line in the second display was longer or shorter than the cued line of the first display. These judgments were used to estimate a length threshold. The critical manipulation was to instruct observers either to maintain fixation between the lines of the first display or to fixate each line in sequence. The results showed an advantage for multiple fixations despite the intervening eye movements. In fact, thresholds for the multiple-fixation condition were nearly as good as those in a control condition where the lines were foveally viewed without eye movements. Thus, eye movements had little or no interfering effect in this task. Additional studies generalized the procedure and the stimuli. In conclusion, information about a variety of size and shape attributes was remembered with essentially no interference across eye fixations.     

Measuring the effect of multiple eye fixations on memory for visual attributes

Because of limited peripheral vision, many visual tasks depend on multiple eye fixations. Good performance in such tasks demonstrates that some memory must survive from one fixation to the next. One factor that must influence performance is the degree to which multiple eye fixations interfere with the critical memories. In the present study, the amount of interference was measured by comparing visual discriminations based on multiple fixations to visual discriminations based on a single fixation. The procedure resembled partial report, but used a discrimination measure. In the prototype study, two lines were presented, followed by a single line and a cue. The cue pointed toward one of the positions of the first two lines. Observers were required to judge if the single line in the second display was longer or shorter than the cued line of the first display. These judgments were used to estimate a length threshold. The critical manipulation was to instruct observers either to maintain fixation between the lines of the first display or to fixate each line in sequence. The results showed an advantage for multiple fixations despite the intervening eye movements. In fact, thresholds for the multiple-fixation condition were nearly as good as those in a control condition where the lines were foveally viewed without eye movements. Thus, eye movements had little or no interfering effect in this task. Additional studies generalized the procedure and the stimuli. In conclusion, information about a variety of size and shape attributes was remembered with essentially no interference across eye fixations.     

Regression analyses as a tool for studying reading processes: Comment on Just and Carpenters eye fixation theory

Just and Carpenter (1980) presented a theory of reading based on eye fixations wherein their “psycholinguistic” variables accounted for 72% of the variance in word gaze durations. This comment raises some statistical and theoretical problems with their use of simultaneous regression analysis of gaze duration measures and with the resulting theory of reading. A major problem was the confounding of perceptual with psycholinguistic factors. New eye fixation data are presented to support these criticisms. Analysis of fixations within words revealed that most gaze duration variance was contributed by number of fixations rather than by fixation duration.     

Not fixating at the line of text comes at a cost

Previous research on eye guidance in reading has investigated systematic tendencies with respect to horizontal fixation locations on letters within words and the relationship between fixation location in a word and the duration of the fixation. The present study investigates where readers place their eyes vertically on the line of text and how vertical fixation location is related to fixation duration. Analyses were based on a large corpus of eye movement recordings from single-sentence reading. The vertical preferred viewing location was found to be within the vertical extent of the font, but fixations beyond the vertical boundaries of the text also frequently occurred. Analyzing fixation duration as a function of vertical fixation location revealed a vertical optimal viewing position (vOVP) effect: Fixations were shortest when placed optimally on the line of text, and fixation duration gradually increased for fixations that fell above or below the line of text. The vOVP effect can be explained by the limits of visual resolution along the vertical meridian. It is concluded that vertical and horizontal landing positions in single-sentence reading are associated with differences in fixation durations in opposite ways.     

The perception of eye contact

Ss made judgments of whether or not they were being looked in the eye as an E fixated several points on and off their faces.Distance between sender and receiver, sex, and whether the sender made a sequence of fixation sprior to the terminal fixation were variables of interest. The sender-receiver distance produced less effect than predicted from the hypothesis that receiver judgments were determined solely by the discrepancy between the sender’s iris/sclera configuration (ISC) during true eye contact and the current fixation point. There was no stable differencein accuracy as a function of whether the sender’s terminal fixation was preceded by other fixations or not. These findings cast doubt on the belief expressed in recent studies that the ISC can be used to accurately discriminate eye gazes from other gazes. The results also suggest that fixations on some portions of the face yield a judgment of eye contact which might be predicted on the basis of social experience.     

Information processing during saccadic eye movements

Saccadic eye movements are made at least 100,000 times each day. It is well known that sensitivity to visual input is suppressed during saccades; recent evidence suggests that some kinds of information processing are suppressed as well. Suppression during saccades implies that processing occurs discretely (during eye fixations only), rather than continuously (during both fixations and saccades). We examined this issue in the context of the Posner and Snyder (1975) primed letter-matching task. We found that a prime viewed in one fixation had a larger influence on targets viewed in a second fixation when a long rather than a short saccade separated the two fixations. This result demonstrates that at least some information processing occurs during saccades.