Manipulation of stimulus onset delay in reading: evidence for parallel programming of saccades

On-line eye movement recording of 12 subjects who read short stories on a cathode ray tube enabled a test of direct control and preprogramming models of eye movements in reading. Contingent upon eye position, a mask was displayed in place of the letters in central vision after each saccade, delaying the onset of the stimulus in each eye fixation. The duration of the delay was manipulated in fixed or randomized blocks. Although the length of the delay strongly affected the duration of the fixations, there was no difference due to the conditions of delay manipulation, indicating that fixation duration is under direct control. However, not all fixations were lengthened by the period of the delay. Some ended while the mask was still present, suggesting they had been preprogrammed. But these "anticipation" eye movements could not have been completely determined before the fixation was processed because their fixation durations and saccade lengths were affected by the spatial extent of the mask, which varied randomly. Neither preprogramming nor existing serial direct control models of eye guidance can adequately account for these data. Instead, a model with direct control and parallel programming of saccades is proposed to explain the data and eye movements in reading in general.     

Foveal vs. parafoveal attention-grabbing power of threat-related information

We investigated whether threat words presented in attended (foveal) and in unattended (parafoveal) locations of the visual field are attention grabbing. Neutral (nonemotional) words were presented at fixation as probes in a lexical decision task. Each probe word was preceded by 2 simultaneous prime words (1 foveal, 1 parafoveal), either threatening or neutral, for 150 ms. The stimulus onset asynchrony (SOA) between the primes and the probe was either 300 or 1,000 ms. Results revealed slowed lexical decision times on the probe when primed by an unrelated foveal threat word at the short (300-ms) delay. In contrast, parafoveal threat words did not affect processing of the neutral probe at either delay. Nevertheless, both neutral and threat parafoveal words facilitated lexical decisions for identical probe words at 300-ms SOA. This suggests that threat words appearing outside the focus of attention do not draw or engage cognitive resources to such an extent as to produce interference in the processing of concurrent or subsequent neutral stimuli. An explanation of the lack of parafoveal interference is that semantic content is not extracted in the parafovea.     

Masking of foveal and parafoveal vision during eye fixations in reading

A window or visual mask as moved across text in synchrony with the reader's eye movements. The size of the window or mask was varied so that either information in foveal or parafoveal vision was masked on each fixation. In another experiment, the onset of the mask was delayed for a certain amount of time following the end of the saccade. The results of the experiments point out the relative importance of foveal and parafoveal vision for reading and further indicate that most of the visual information necessary for reading can be acquired during the first 50 msec that information is available during an eye fixation.     

Eye movement control during reading: Evidence for direct control

In three experiments, subjects read text as their eye movements were monitored and display changes in the text were made contingent upon the eye movements. In one experiment, a window of text moved in synchrony with the eyes. In one condition, the size of the window was constant from fixation to fixation, while in the other condition the size of the window varied from fixation to fixation. In the other experiments, a visual mask was presented at the end of each saccade which delayed the onset of the text, and the length of the delay was varied. The pattern of eye movements was influenced by both the size of the window and the delay of the onset of the text, even when the window size or text delay was varying from fixation to fixation. However, there was also evidence that saccade length was affected by the size of the window on the prior fixation and that certain decisions to move the eye are programmed either before the fixation begins or are programmed during the fixation but without regard to the text fixated on. The results thus provide support for a mixed control model of eye movements in reading, in which decisions about when and where to move the eyes are based on information from the current fixation, the prior fixations, and possibly, other sources as well.     

Emotional scenes in peripheral vision: selective orienting and gist processing, but not content identification

Emotional-neutral pairs of visual scenes were presented peripherally (with their inner edges 5.2 degrees away from fixation) as primes for 150 to 900 ms, followed by a centrally presented recognition probe scene, which was either identical in specific content to one of the primes or related in general content and affective valence. Results indicated that (a) if no foveal fixations on the primes were allowed, the false alarm rate for emotional probes was increased; (b) hit rate and sensitivity (A') were higher for emotional than for neutral probes only when a fixation was possible on only one prime; and (c) emotional scenes were more likely to attract the first fixation than neutral scenes. It is concluded that the specific content of emotional or neutral scenes is not processed in peripheral vision. Nevertheless, a coarse impression of emotional scenes may be extracted, which then leads to selective attentional orienting or--in the absence of overt attention--causes false alarms for related probes.     

Eye Movements and Visual Encoding During Scene Perception

ABSTRACT— The amount of time viewers could process a scene during eye fixations was varied by a mask that appeared at a certain point in each eye fixation. The scene did not reappear until the viewer made an eye movement. The main finding in the studies was that in order to normally process a scene, viewers needed to see the scene for at least 150 ms during each eye fixation. This result is surprising because viewers can extract the gist of a scene from a brief 40- to 100-ms exposure. It also stands in marked contrast to reading, as readers need only to view the words in the text for 50 to 60 ms to read normally. Thus, although the same neural mechanisms control eye movements in scene perception and reading, the cognitive processes associated with each task drive processing in different ways.     

The limits of visual resolution in natural scene viewing

We examined the limits of visual resolution in natural scene viewing, using a gaze-contingent multiresolutional display having a gaze-centred area-of-interest and decreasing resolution with eccentricity. Twelve participants viewed high-resolution scenes in which gaze-contingent multiresolutional versions occasionally appeared for single fixations. Both detection of image degradation (five filtering levels plus a no-area-of-interest control) in the gaze-contingent multiresolutional display, and eye fixation durations, were well predicted by a model of eccentricity-dependent contrast sensitivity. The results also illuminate the time course of detecting image filtering. Detection did not occur for fixations below 100 ms, and reached asymptote for fixations above 200 ms. Detectable filtering lengthened fixation durations by 160 ms, and interference from an imminent manual response occurred by 400-450 ms, often lengthening the next fixation. We provide an estimate of the limits of visual resolution in natural scene viewing useful for theories of scene perception, and help bridge the literature on spatial vision and eye movement control.     

Some temporal characteristics of processing during reading

College students read passages displayed on a cathode-ray tube as their eye movements were being monitored. During occasional fixations, all letters to the left of the directly fixated letter or all letters more than four to the right of the fixated letter were replaced by other letters. This replacement occurred either for only the first 100 ms of the fixation or only after the first 100 ms of the fixation. The eye movement data indicated that the eyes can respond to change in the visual stimulus within less than 100 ms and to orthographic irregularity in the text within less than 160 ms. No evidence was found for a left-to-right attentional scan during a fixation. The results were interpreted within the framework of a chronology of processing events occurring during a fixation in reading.     

Affective significance enhances covert attention: Roles of anxiety and word familiarity

To investigate the processing of emotional words by covert attention, threat-related, positive, and neutral word primes were presented parafoveally (2.2° away from fixation) for 150 ms, under gaze-contingent foveal masking, to prevent eye fixations. The primes were followed by a probe word in a lexical-decision task. In Experiment 1, results showed a parafoveal threat–anxiety superiority: Parafoveal prime threat words facilitated responses to probe threat words for high-anxiety individuals, in comparison with neutral and positive words, and relative to low-anxiety individuals. This reveals an advantage in threat processing by covert attention, without differences in overt attention. However, anxiety was also associated with greater familiarity with threat words, and the parafoveal priming effects were significantly reduced when familiarity was covaried out. To further examine the role of word knowledge, in Experiment 2, vocabulary and word familiarity were equated for low- and high-anxiety groups. In these conditions, the parafoveal threat–anxiety advantage disappeared. This suggests that the enhanced covert-attention effect depends on familiarity with words.     

Affective significance enhances covert attention: roles of anxiety and word familiarity

To investigate the processing of emotional words by covert attention, threat-related, positive, and neutral word primes were presented parafoveally (2.2 degrees away from fixation) for 150 ms, under gaze-contingent foveal masking, to prevent eye fixations. The primes were followed by a probe word in a lexical-decision task. In Experiment 1, results showed a parafoveal threat-anxiety superiority: Parafoveal prime threat words facilitated responses to probe threat words for high-anxiety individuals, in comparison with neutral and positive words, and relative to low-anxiety individuals. This reveals an advantage in threat processing by covert attention, without differences in overt attention. However, anxiety was also associated with greater familiarity with threat words, and the parafoveal priming effects were significantly reduced when familiarity was covaried out. To further examine the role of word knowledge, in Experiment 2, vocabulary and word familiarity were equated for low- and high-anxiety groups. In these conditions, the parafoveal threat-anxiety advantage disappeared. This suggests that the enhanced covert-attention effect depends on familiarity with words.     

Recognition advantage of happy faces in extrafoveal vision: Featural and affective processing

Happy, surprised, disgusted, angry, sad, fearful, and neutral facial expressions were presented extrafoveally (2.5° away from fixation) for 150 ms, followed by a probe word for recognition (Experiment 1) or a probe scene for affective valence evaluation (Experiment 2). Eye movements were recorded and gaze-contingent masking prevented foveal viewing of the faces. Results showed that (a) happy expressions were recognized faster than others in the absence of fixations on the faces, (b) the same pattern emerged when the faces were presented upright or upside-down, (c) happy prime faces facilitated the affective evaluation of emotionally congruent probe scenes, and (d) such priming effects occurred at 750 but not at 250 ms prime–probe stimulus–onset asynchrony. This reveals an advantage in the recognition of happy faces outside of overt visual attention, and suggests that this recognition advantage relies initially on featural processing and involves processing of positive affect at a later stage.     

Eye movements of older and younger readers when reading disappearing text

Older and younger readers read sentences in which target words were masked 40 to 60 ms after fixation onset. Masking only the target word caused more disruption than did masking each word in the sentence, and this effect was stronger for the younger readers than for the older readers. Although older readers had longer eye fixations than did younger readers, the results indicated that the masking effect was comparable for the 2 groups. However, for both groups, how long the eyes remained in place was strongly influenced by the frequency of the fixated word (even though it had been rapidly replaced by the mask and was no longer there when the eyes did move). This is compelling evidence that for both older and younger readers, cognitive/lexical processing has a very strong influence on when the eyes move in reading.     

Parafoveal semantic processing of emotional visual scenes

The authors investigated whether emotional pictorial stimuli are especially likely to be processed in parafoveal vision. Pairs of emotional and neutral visual scenes were presented parafoveally (2.1 degrees or 2.5 degrees of visual angle from a central fixation point) for 150-3,000 ms, followed by an immediate recognition test (500-ms delay). Results indicated that (a) the first fixation was more likely to be placed onto the emotional than the neutral scene; (b) recognition sensitivity (A') was generally higher for the emotional than for the neutral scene when the scenes were paired, but there were no differences when presented individually; and (c) the superior sensitivity for emotional scenes survived changes in size, color, and spatial orientation, but not in meaning. The data suggest that semantic analysis of emotional scenes can begin in parafoveal vision in advance of foveal fixation.     

A rapid effect of stimulus quality on the durations of individual fixations during reading

We developed a variant of the single fixation replacement paradigm (Yang & McConkie, 2001, 2004) in order to examine the effect of stimulus quality on fixation duration during reading. Subjects' eye movements were monitored while they read passages of text for comprehension. During critical fixations, equal changes to the luminance of the background produced either an increase (Up-Contrast) or a decrease (Down-Contrast) of the contrast of the text. The durations of critical fixations were found to be lengthened in the Down-Contrast but not the Up-Contrast condition. Ex-Gaussian modelling of the distributions of fixation durations showed that the reduction in stimulus quality lengthened the majority of fixations, and a survival analysis estimated the onset of this effect to be approximately 141 ms following fixation onset. Because the stimulus quality of the text during critical fixations could not be predicted or parafoveally previewed prior to foveation, the present effect can be attributed to an immediate effect of stimulus quality on fixation duration.     

Scene exploration with Fourier-filtered peripheral information.

In a previous moving-window study it was found that scene exploration benefits more from peripheral information of high spatial frequency than of low spatial frequency. In the present study, degraded versions of realistic scenes were presented peripherally during the initial 150 ms of fixations, while the undegraded scene was presented foveally. The undegraded version of the scene was visible both foveally and peripherally during the later part of fixations. During the initial 150 ms, the peripheral part of scenes was low-pass, bandpass, or high-pass filtered, blanked, or decreased in luminance. In a no-change condition, the undegraded scene was presented throughout the whole fixation. Participants freely explored the scenes in the context of an object-decision task. It was found that degrading peripheral information during the initial part of fixations had minimal effect on scene exploration. No reliable differences were found among the three filter types. The results indicate that, in the context of an object-search task, peripheral information is of minor importance during the initial part of fixations.     

Spatiotopic and retinotopic components of iconic memory

Summary Recently, there has been considerable interest in whether information in iconic memory is stored in retinotopic or spatiotopic coordinates. The present experiment examined the issue using a masking paradigm. In one set of conditions, subjects maintained fixation while a row of four letters appeared for 19 ms, centered about three degrees to the right of fixation. After a 153 ms ISI, the letters were followed by a blank field (no mask), a mask in the same position as the letters, or a mask displaced three degrees to the right of the letters. In a second set of conditions, the stimuli were the same but subjects were asked to shift fixation from the fixation point to the middle of the letter row during the interval between the letters and the mask. Subjects' eye movements were monitored in all conditions. Accuracy of report for the letters was lowered only with the mask over the letters with the no-eye-movement conditions and in both masking conditions with the eye movements. The results suggest that the icon includes two components, one that is retinotopic and one that is spatiotopic.     

Reading with a filtered fovea: The influence of visual quality at the point of fixation during reading

Reading relies critically on processing text in foveal vision during brief fixational pauses, and high-quality visual input from foveal text is fundamental to theories of reading. However, the quality of visual input from foveal text that is actually functional for reading and the effects of this input on reading performance are unclear. To investigate these issues, a moving, gaze-contingent foveal filtering technique was developed to display areas of text within foveal vision that provided only coarse, medium, or fine scale visual input during each fixational pause during reading. Normal reading times were unaffected when foveal text up to three characters wide at the point of fixation provided any one visual input (coarse, medium, or fine). Wider areas of coarse visual input lengthened reading times, but reading still occurred, and normal reading times were completely unaffected when only medium or fine visual input extended across the entire fovea. Further analyses revealed that each visual input had no effect on the number of fixations made when normal text was read, that adjusting fixation durations helped preserve reading efficiency for different visual inputs, and that each visual input had virtually no effect on normal saccades. These findings indicate that, despite the resolving power of foveal vision and the emphasis placed on high-quality foveal visual input by theories of reading, normal reading functions with similar success using a range of restricted visual inputs from foveal text, even at the point of fixation. Some implications of these findings for theories of reading are discussed.     

The effect of the first glimpse at a scene on eye movements during search

Previewing scenes briefly makes finding target objects more efficient when viewing is through a gaze-contingent window (windowed viewing). In contrast, showing a preview of a randomly arranged search display does not benefit search efficiency when viewing during search is of the full display. Here, we tested whether a scene preview is beneficial when the scene is fully visible during search. Scene previews, when presented, were 250 ms in duration. During search, the scene was either fully visible or windowed. A preview always provided an advantage, in terms of decreasing the time to initially fixate and respond to targets and in terms of the total number of fixations. In windowed visibility, a preview reduced the distance of fixations from the target position until at least the fourth fixation. In full visibility, previewing reduced the distance of the second fixation but not of later fixations. The gist information derived from the initial glimpse of a scene allowed for placement of the first one or two fixations at information-rich locations, but when nonfoveal information was available, subsequent eye movements were only guided by online information.     

Direct control of fixation times in scene viewing: Evidence from analysis of the distribution of first fixation duration

Participants' eye movements were monitored in two scene viewing experiments that manipulated the task-relevance of scene stimuli and their availability for extrafoveal processing. In both experiments, participants viewed arrays containing eight scenes drawn from two categories. The arrays of scenes were either viewed freely (Free Viewing) or in a gaze-contingent viewing mode where extrafoveal preview of the scenes was restricted (No Preview). In Experiment 1a, participants memorized the scenes from one category that was designated as relevant, and in Experiment 1b, participants chose their preferred scene from within the relevant category. We examined first fixations on scenes from the relevant category compared to the irrelevant category (Experiments 1a and 1b), and those on the chosen scene compared to other scenes not chosen within the relevant category (Experiment 1b). A survival analysis was used to estimate the first discernible influence of the task-relevance on the distribution of first-fixation durations. In the free viewing condition in Experiment 1a, the influence of task relevance occurred as early as 81 ms from the start of fixation. In contrast, the corresponding value in the no preview condition was 254 ms, demonstrating the crucial role of extrafoveal processing in enabling direct control of fixation durations in scene viewing. First fixation durations were also influenced by whether or not the scene was eventually chosen (Experiment 1b), but this effect occurred later and affected fewer fixations than the effect of scene category, indicating that the time course of scene processing is an important variable mediating direct control of fixation durations.     

Detection of emotional faces: low perceptual threshold and wide attentional span

In two experiments, prime face stimuli with an emotional or a neutral expression were presented individually for 25 to 125 ms, either in foveal or parafoveal vision; following a mask, a probe face or a word label appeared for recognition. Accurate detection and sensitivity (A') were higher for angry, happy, and sad faces than for nonemotional (neutral) or novel (scheming) faces at short exposure times (25-75 ms), in both the foveal and the parafoveal field, and with both the probe face and the probe word. These results indicate that there is a low perceptual threshold for unambiguous emotional faces, which are especially likely to be detected both within and outside the focus of attention; and that this facilitated detection involves processing of the affective meaning of faces, not only discrimination of formal visual features.