Temporal relationships between eye fixations and manual reactions in visual search

Observers freely searched for, and manually responded to, the presence of a target in multistimulus displays. The stimuli were presented on a cinema screen such that each display subtended a large visual angle to encourage the use of eye movements. Times taken to initially fixate the target (T1Fs) were compared to manual response times (MRTs). The results of two experiments were qualitatively similar, despite different levels of difficulty between them. MRTs were a linear function of T1Fs, but only when fixations did not occur very early after the onset of the stimulus display. When fixations were made very soon after the onset of the display, T1Fs were independent of MRTs. The findings were described within the framework of a one-way synchronization model which was modified to accommodate attention effects in visual search. Finally, the methodology provides a novel means of quantifying the contributions of eye movements to manual acknowledgements in real-world vision-guided tasks.     

Coarse-to-fine eye movement behavior during visual search

It has previously been argued that, during visual search, eye movement behavior is indicative of an underlying scanning “strategy” that starts on a global, or “coarse,” scale but then progressively focuses to a more local, or “fine,” scale. This conclusion is motivated by the finding that, as a trial progresses, fixation durations tend to increase and saccade amplitudes tend to decrease. In the present study, we replicate these effects but offer an alternative explanation for them—that they emerge from a few stochastic factors that control eye movement behavior. We report the results of a simulation supporting this hypothesis and discuss implications for future models of visual search.     

Parafoveal processing of words and saccade computation during eye fixations in reading

Studied parafoveal word processing during eye fixations in reading to answer two questions: (a) Is the processing of parafoveally available words limited to the identification of beginning letters? (b) Does the parafoveal processing of words affect the following interword saccade? Reading afforded either no parafoveal preview, preview of beginning trigrams, preview of ending trigrams, or preview of the whole parafoveal word. Previews were controlled by replacing original letters either with X's or dissimilar letters. Preview benefits were larger for the whole word previews than for beginning or ending trigram previews. X-masks yielded preview benefits from intact beginning and ending trigrams but dissimilar letter masks yielded benefits from beginning trigrams only. Saccades were larger for whole word previews than for no previews. These results support Logogen-type models of word recognition and a model of saccade computation that posits a time-locked functional relation between the acquisition of parafoveal word information and the positioning of each fixation.     

Fast priming during eye fixations in reading.

Near-threshold primes were "flashed" in a target location prior to the onset of a target word while Ss read. The type and duration of the prime were manipulated. In Exp. 1, identical, related, and unrelated primes were presented for 60, 45, or 30 ms from onset of an eye fixation. The prime was then replaced with the target word, which remained in place while Ss finished reading the sentence. Fixation time on the target word was measured. Exp. 2 replicated Exp. 1, with two exceptions: A random letter string replaced the identical prime condition, and prime durations of 39, 30, or 21 ms were used. In both experiments, significant priming effects (related vs. unrelated) were obtained when the prime was presented for 30 ms. Results are discussed with regard to subliminal priming effects. Applications to the study of word recognition processes are also discussed.     

Emotion words affect eye fixations during reading

Emotion words are generally characterized as possessing high arousal and extreme valence and have typically been investigated in paradigms in which they are presented and measured as single words. This study examined whether a word's emotional qualities influenced the time spent viewing that word in the context of normal reading. Eye movements were monitored as participants read sentences containing an emotionally positive (e.g., lucky), negative (e.g., angry), or neutral (e.g., plain) word. Target word frequency (high or low) was additionally varied to help determine the temporal locus of emotion effects, with interactive results suggesting an early lexical locus of emotion processing. In general, measures of target fixation time demonstrated significant effects of emotion and frequency as well as an interaction. The interaction arose from differential effects with negative words that were dependent on word frequency. Fixation times on emotion words (positive or negative) were consistently faster than those on neutral words with one exception-high-frequency negative words were read no faster than their neutral counterparts. These effects emerged in the earliest eye movement measures, namely, first and single fixation duration, suggesting that emotionality, as defined by arousal and valence, modulates lexical processing. Possible mechanisms involved in processing emotion words are discussed, including automatic vigilance and desensitization, both of which imply a key role for word frequency. Finally, it is important that early lexical effects of emotion processing can be established within the ecologically valid context of fluent reading.     

Distractor ratio influences patterns of eye movements during visual search

We examined the flexibility of guidance in a conjunctive search task by manipulating the ratios between different types of distractors. Participants were asked to decide whether a target was present or absent among distractors sharing either colour or shape. Results indicated a strong effect of distractor ratio on search performance. Shorter latency to move, faster manual response, and fewer fixations per trial were observed at extreme distractor ratios. The distribution of saccadic endpoints also varied flexibly as a function of distractor ratio. When there were very few same-colour distractors, the saccadic selectivity was biased towards the colour dimension. In contrast, when most of the distractors shared colour with the target, the saccadic selectivity was biased towards the shape dimension. Results are discussed within the framework of the guided search model.     

Parallel processing in visual search asymmetry

The difficulty of visual search may depend on assignment of the same visual elements as targets and distractors-search asymmetry. Easy C-in-O searches and difficult O-in-C searches are often associated with parallel and serial search, respectively. Here, the time course of visual search was measured for both tasks with speed-accuracy methods. The time courses of the 2 tasks were similar and independent of display size. New probabilistic parallel and serial search models and sophisticated-guessing variants made predictions about time course and accuracy of visual search. The probabilistic parallel model provided an excellent account of the data, but the serial model did not. Asymptotic search accuracies and display size effects were consistent with a signal-detection analysis, with lower variance encoding of Cs than Os. In the absence of eye movements, asymmetric visual search, long considered an example of serial deployment of covert attention, is qualitatively and quantitatively consistent with parallel search processes.     

Distinct subsystems for the parafoveal processing of spatial and linguistic information during eye fixations in reading

Two experiments examined readers' use of parafoveally obtained word length information for word recognition. Both experiments manipulated the length (number of constituent characters) of a parafoveally previewed target word so that it was either accurately or inaccurately specified. In Experiment 1, previews also either revealed or denied useful orthographic information. In Experiment 2, parafoveal targets were either high- or low-frequency words. Eye movement contingent display changes were used to show the intact target upon its fixation. Examination of target viewing duration showed completely additive effects of word length previews and of ortho-graphic previews in Experiment 1, viewing duration being shorter in the accurate-length and the orthographic preview conditions. Experiment 2 showed completely additive effects of word length and word frequency, target viewing being shorter in the accurate-length and the high-frequency conditions. Together these results indicate that functionally distinct subsystems control the use of parafoveally visible spatial and linguistic information in reading. Parafoveally visible spatial information appears to be used for two distinct extralinguistic computations: visual object selection and saccade specification.     

Looking versus seeing: Strategies alter eye movements during visual search

Visual search can be made more efficient by adopting a passive cognitive strategy (i.e., letting the target “pop” into mind) rather than by trying to actively guide attention. In the present study, we examined how this strategic benefit is linked to eye movements. Results show that participants using a passive strategy wait longer before beginning to move their eyes and make fewer saccades than do active participants. Moreover, the passive advantage stems from more efficient use of the information in a fixation, rather than from a wider attentional window. Individual difference analyses indicate that strategies also change the way eye movements are related to search success, with a rapid saccade rate predicting success among active participants, and fewer and larger amplitude saccades predicting success among passive participants. A change in mindset, therefore, alters how oculomotor behaviors are harnessed in the service of visual search.     

Electrophysiological evidence for parallel and serial processing during visual search

Event-related potentials were recorded from young adults during a visual search task in order to evaluate parallel and serial models of visual processing in the context of Treisman's feature integration theory. Parallel and serial search strategies were produced by the use of feature-present and feature-absent targets, respectively. In the feature-absent condition, the slopes of the functions relating reaction time and latency of the P3 component to set size were essentially identical, indicating that the longer reaction times observed for larger set sizes can be accounted for solely by changes in stimulus identification and classification time, rather than changes in post-perceptual processing stages. In addition, the amplitude of the P3 wave on target-present trials in this condition increased with set size and was greater when the preceding trial contained a target, whereas P3 activity was minimal on target-absent trials. These effects are consistent with the serial self-terminating search model and appear to contradict parallel processing accounts of attention-demanding visual search performance, at least for a subset of search paradigms. Differences in ERP scalp distributions further suggested that different physiological processes are utilized for the detection of feature presence and absence.     

Parafoveal and foveal processing of abbreviations during eye fixations in reading: making a case for case

The processing of abbreviations in reading was examined with an eye movement experiment. Abbreviations were of 2 distinct types: acronyms (abbreviations that can be read with the normal grapheme-phoneme correspondence [GPC] rules, such as NASA) and initialisms (abbreviations in which the GPCs are letter names, such as NCAA). Parafoveal and foveal processing of these abbreviations was assessed with the use of the boundary change paradigm (K. Rayner, 1975). Using this paradigm, previews of the abbreviations were either identical to the abbreviation (NASA or NCAA), orthographically legal (NUSO or NOBA), or illegal (NRSB or NRBA). The abbreviations were presented as capital letter strings within normal, predominantly lowercase sentences and also sentences in all capital letters such that the abbreviations would not be visually distinct. The results indicate that acronyms and initialisms undergo different processing during reading and that readers can modulate their processing based on low-level visual cues (distinct capitalization) in parafoveal vision. In particular, readers may be biased to process capitalized letter strings as initialisms in parafoveal vision when the rest of the sentence is normal, lowercase letters.     

Factors affecting processing mode in visual search

Visual search was studied under a variety of conditions to clarify some differences among the results of previous investigations and to provide a testing ground for models of visual information processing. Display configuration, target and field composition, exposure duration, and display size (up to 16 elements) were among the parameters investigated. In some conditions, mean reaction time was essentially invariant with display size, while in other conditions it increased substantially and linearly with display size. Current models of visual information processing were evaluated in the light of these and previous findings; all were found wanting. The data seem to demand a system subject to flexible cognitive control processes.     

Activation of phonological codes during eye fixations in reading.

Two experiments addressed the issue of whether phonological codes are activated early in a fixation during reading using the fast-priming technique (S. C. Sereno & K. Rayner, 1992). Participants read sentences and, at the beginning of the initial fixation in a target location, a priming letter string was displayed, followed by the target word. Phonological priming was assessed by the difference in the gaze duration on the target word between when the prime was a homophone and when it was a control word equated with the homophone on orthographic similarity to the target. Both experiments demonstrated homophonic priming with prime durations of about 35 ms, but only for high-frequency word primes, indicating that lexicality was guiding the speed of the extraction of phonological codes early in a fixation. Evidence was also obtained for orthographic priming, and the data suggest that orthographic and phonological priming effects interact in a mutually facilitating manner.     

Task-dependent modulation of word processing mechanisms during modified visual search tasks

During visual search for words, the impact of the visual and semantic features of words varies as a function of the search task. This event-related potential (ERP) study focused on the way these features of words are used to detect similarities between the distractor words that are glanced at and the target word, as well as to then reject the distractor words. The participants had to search for a target word that was either given literally or defined by a semantic clue among words presented sequentially. The distractor words included words that resembled the target and words that were semantically related to the target. The P2a component was the first component to be modulated by the visual and/or semantic similarity of distractors to the target word, and these modulations varied according to the task. The same held true for the later N300 and N400 components, which confirms that, depending on the task, distinct processing pathways were sensitized through attentional modulation. Hence, the process that matches what is perceived with the target acts during the first 200?ms after word presentation, and both early detection and late rejection processes of words depend on the search task and on the representation of the target stored in memory.     

Time course of visual information utilization during fixations in reading

College students read short texts from a cathode-ray tube as their eye movements were being monitored. During selected fixations, the text was briefly masked and then it reappeared with one word changed. Subjects often were unaware that the word had changed. Sometimes they reported seeing the first presented word, sometimes the second presented word, and sometimes both. When only one word was reported, two factors were found to determine which one it was: the length of time a word was present during the fixation and the predictability of a word in its context. The results suggested that visual information is utilized for reading at a crucial period during the fixation and that this crucial period can occur at different times on different fixations. The pattern of responses suggested that the first letter of a word is not utilized before other letters and that letters are not scanned from left to right during a fixation.     

Parafoveal processing of prefixed words during eye fixations in reading: evidence against morphological influences on parafoveal preprocessing

Two eye movement experiments were conducted to investigate whether the morphological constituents of a prefixed word influenced early word processing when English was read. Participants read sentences containing free-stem, bound-stem, or pseudoprefixed words, and the availability of the prefixed word morphemes in the parafovea was manipulated. Although preview benefit was greatest for the entire word, there was evidence that subsequent word processing was facilitated in both the prefix-only and the stem-only conditions. This effect was not influenced by word type. There was no evidence that morphological preprocessing occurred when morphological information was available in the parafovea. In addition, reading times for the target word did not differ for the different word types. Thus, there was no evidence to suggest that morphological constituents influence early word processing during reading. It is possible that morphological effects tend to be obscured when examined within a sentence context (although this phenomenon may be specific to English).     

Measuring the effect of multiple eye fixations on memory for visual attributes

Because of limited peripheral vision, many visual tasks depend on multiple eye fixations. Good performance in such tasks demonstrates that some memory must survive from one fixation to the next. One factor that must influence performance is the degree to which multiple eye fixations interfere with the critical memories. In the present study, the amount of interference was measured by comparing visual discriminations based on multiple fixations to visual discriminations based on a single fixation. The procedure resembled partial report, but used a discrimination measure. In the prototype study, two lines were presented, followed by a single line and a cue. The cue pointed toward one of the positions of the first two lines. Observers were required to judge if the single line in the second display was longer or shorter than the cued line of the first display. These judgments were used to estimate a length threshold. The critical manipulation was to instruct observers either to maintain fixation between the lines of the first display or to fixate each line in sequence. The results showed an advantage for multiple fixations despite the intervening eye movements. In fact, thresholds for the multiple-fixation condition were nearly as good as those in a control condition where the lines were foveally viewed without eye movements. Thus, eye movements had little or no interfering effect in this task. Additional studies generalized the procedure and the stimuli. In conclusion, information about a variety of size and shape attributes was remembered with essentially no interference across eye fixations.     

Collaboration during visual search

Two experiments examine how collaboration influences visual search performance. Working with a partner or on their own, participants reported whether a target was present or absent in briefly presented search displays. We compared the search performance of individuals working together (collaborative pairs) with the pooled responses of the individuals working alone (nominal pairs). Collaborative pairs were less likely than nominal pairs to correctly detect a target and they were less likely to make false alarms. Signal detection analyses revealed that collaborative pairs were more sensitive to the presence of the target and had a more conservative response bias than the nominal pairs. This pattern was observed even when the presence of another individual was matched across pairs. The results are discussed in the context of task-sharing, social loafing and current theories of visual search.