Eye movements during search and detection in comparative visual search

Motivated by the fact that previous visual memory paradigms have imposed encoding and retrieval constraints, the present article presents two experiments that address how observers allocate eye movements in memory and comparison processes in the absence of constraints. A comparative visual search design (Pomplun, Sichelschmidt, et al., 2001) was utilized in which observers searched for a difference between two images presented side by side. Robust time course effects were obtained, whereby search was characterized by brief fixations and a high proportion of comparative saccades. Then, upon target detection, fixations were extended, more comparative saccades were elicited, and the search focus was narrowed. The saliency and presence of differences did not guide attention, and detection was contingent upon direct fixation of the targets. The results indicate that, when full control is given, observers adopt a strategy that cuts down on memory usage in favor of restricted encoding and active scanning.     

Eye movements reveal the on-line computation of lexical probabilities during reading

Skilled readers are able to derive meaning from a stream of visual input with remarkable efficiency. In this article, we present the first evidence that statistical information latent in the linguistic environment can contribute to an account of reading behavior. In two eye-tracking studies, we demonstrate that the transitional probabilities between words have a measurable influence on fixation durations, and using a simple Bayesian statistical model, we show that lexical probabilities derived by combining transitional probability with the prior probability of a word's occurrence provide the most parsimonious account of the eye movement data. We suggest that the brain is able to draw upon statistical information in order to rapidly estimate the lexical probabilities of upcoming words: a computationally inexpensive mechanism that may underlie proficient reading.     

Eye movements and attention in reading,scene perception,and visual search

Eye movements are now widely used to investigate cognitive processes during reading, scene perception, and visual search. In this article, research on the following topics is reviewed with respect to reading: (a) the perceptual span (or span of effective vision), (b) preview benefit, (c) eye movement control, and (d) models of eye movements. Related issues with respect to eye movements during scene perception and visual search are also reviewed. It is argued that research on eye movements during reading has been somewhat advanced over research on eye movements in scene perception and visual search and that some of the paradigms developed to study reading should be more widely adopted in the study of scene perception and visual search. Research dealing with “real-world” tasks and research utilizing the visual-world paradigm are also briefly discussed.     

Eye movements in search in visual neglect

We report data on eye movements in a patient (MP) with unilateral visual neglect, in a task of searching a real-world scene. We demonstrate that MP missed some contralesional targets after fixating on them. On such “miss”; trials, MP's eye movements were similar to those on objects in target-absent trials trials, where MP was cued to search for a target that was not actually present. In addition, MP showed little evidence of memory for the locations of objects that remained across a trial, though poor memory fails to explain performance on trials where targets were fixated. We suggest that, in this case, neglect reflected the poor uptake of information from the contralesional side of space, so that even fixated targets sometimes failed to match a “template” held in his memory.     

Watching diagnoses develop: Eye movements reveal symptom processing during diagnostic reasoning

Finding a probable explanation for observed symptoms is a highly complex task that draws on information retrieval from memory. Recent research suggests that observed symptoms are interpreted in a way that maximizes coherence for a single likely explanation. This becomes particularly clear if symptom sequences support more than one explanation. However, there are no existing process data available that allow coherence maximization to be traced in ambiguous diagnostic situations, where critical information has to be retrieved from memory. In this experiment, we applied memory indexing, an eye-tracking method that affords rich time-course information concerning memory-based cognitive processing during higher order thinking, to reveal symptom processing and the preferred interpretation of symptom sequences. Participants first learned information about causes and symptoms presented in spatial frames. Gaze allocation to emptied spatial frames during symptom processing and during the diagnostic response reflected the subjective status of hypotheses held in memory and the preferred interpretation of ambiguous symptoms. Memory indexing traced how the diagnostic decision developed and revealed instances of hypothesis change and biases in symptom processing. Memory indexing thus provided direct online evidence for coherence maximization in processing ambiguous information.     

Eye movements and processing stages in reading: relative contribution of visual,lexical, and contextual factors

The independent and the combined influence of word length, word frequency, and contextual predictability on eye movements in reading was examined across processing stages under two priming-context conditions. Length, frequency, and predictability were used as predictors in multiple regression analyses, with parafoveal, early, late, and spillover eye movement measures as the dependent variables. There were specific effects of: (a) length, both on where to look (how likely a word was fixated and in which location) and how long to fixate, across all processing stages; (b) frequency, on how long to fixate a word, but not on where to look, at an early processing stage; and (c) predictability, both on how likely a word was fixated and for how long, in late processing stages. The source of influence for predictability was related to global rather than to local contextual priming. The contribution of word length was independent of contextual source. These results are relevant to determine both the time course of the influence of visual, lexical, and contextual factors on eye movements in reading, and which main component of eye movements, that is, location or duration, is affected.     

Eye movements and picture processing during recognition

Eye movements were monitored during a recognition memory test of previously studied pictures of full-color scenes. The test scenes were identical to the originals, had an object deleted from them, or included a new object substituted for an original object. In contrast to a prior report (Parker, 1978), we found no evidence that object deletions or substitutions could be recognized on the basis of information acquired from the visual periphery. Deletions were difficult to recognize peripherally, and the eyes were not attracted to them. Overall, the amplitude of the average saccade to the critical object during the memory test was less than 4.5 degrees of visual angle in all conditions and averaged 4.1 degrees across conditions. We conclude that information about object presence and identity in a scene is limited to a relatively small region around the current fixation point.     

Eye movements reveal distinct search and reasoning processes in comprehension of complex graphs

Hierarchical graphs (e.g. file system browsers, family trees) represent objects (e.g. files, folders) as graph nodes, and relations (subfolder relations) between them as lines. In three experiments, participants viewed such graphs and carried out tasks that either required search for two target nodes (Experiment 1A), reasoning about their relation (Experiment 1B), or both (Experiment 2). We recorded eye movements and used the number of fixations in different phases to identify distinct stages of comprehension. Search in graphs proceeded like search in standard visual search tasks and was mostly unaffected by graph properties. Reasoning occurred typically in a separate stage at the end of comprehension and was affected by intersecting graph lines. The alignment of nodes, together with linguistic factors, may also affect comprehension. Overall, there was good evidence to suggest that participants read graphs in a sequential manner, and that this is an economical approach of comprehension. Copyright © 2010 John Wiley & Sons, Ltd.     

Visual-shape competition during language-mediated attention is based on lexical input and not modulated by contextual appropriateness

Visual attention can be directed immediately, as a spoken word unfolds, towards conceptually related but nonassociated objects, even if they mismatch on other dimensions that would normally determine which objects in the scene were appropriate referents for the unfolding word (Huettig & Altmann, 2005 Huettig, F. and Altmann, G. T. M. 2005. Word meaning and the control of eye fixation: Semantic competitor effects and the visual world paradigm. Cognition, 96: B23–B32. [Crossref], [PubMed], [Web of Science ®] , [Google Scholar]). Here we demonstrate that the mapping between language and concurrent visual objects can also be mediated by visual-shape relations. On hearing “snake”, participants directed overt attention immediately, within a visual display depicting four objects, to a picture of an electric cable, although participants had viewed the visual display with four objects for approximately 5 s before hearing the target word—sufficient time to recognize the objects for what they were. The time spent fixating the cable correlated significantly with ratings of the visual similarity between snakes in general and this particular cable. Importantly, with sentences contextually biased towards the concept snake, participants looked at the snake well before the onset of “snake”, but they did not look at the visually similar cable until hearing “snake”. Finally, we demonstrate that such activation can, under certain circumstances (e.g., during the processing of dominant meanings of homonyms), constrain the direction of visual attention even when it is clearly contextually inappropriate. We conclude that language-mediated attention can be guided by a visual match between spoken words and visual objects, but that such a match is based on lexical input and may not be modulated by contextual appropriateness.     

Eye movements in active visual search: A computable phenomenological model

We present a computational model and corresponding computer simulations that mimic phenomenologically the eye movement trajectories observed in a conjunctive visual search task. The element of randomness is captured in the model through a Monte Carlo selection of a particular eye movement based on its probability, which depends on three factors, adjusted to match to the observed saccade amplitude distribution, forward bias in consecutive saccades, and return rates. Memory is assumed to operate through tagging of objects already recognized as nontargets, which, in turn, requires their processing within the attentional area of conspicuity (AC). That AC is adjusted so that computer simulations optimally reproduce the distribution of the number of saccades, the failure rate for capturing the target, and the return rate to previously inspected locations. For their viability, computer simulations critically depend on memory’s being long-ranged. In turn, the simulations confirm the formation of circulating or spiraling patterns in the observed eye trajectories. We also relate consistently the average number of saccades per trial to the saccade amplitude distribution by modeling analytically the combined roles of the AC in attention and memory. The full Supplemental Appendix A for this article may be downloaded from http:// app.psychonomic-journals.org/content/supplemental.     

Eye movements and the span of the effective stimulus in visual search

The span of the effective stimulus during visual search through an unstructured alphanumeric array was investigated by using eye-contingent-display changes while the subjects searched for a target letter. In one condition, a window exposing the search array moved in synchrony with the subjects' eye movements, and the size of the window was varied. Performance reached asymptotic levels when the window was 5 degrees. In another condition, a foveal mask moved in synchrony with each eye movement, and the size of the mask was varied. The foveal mask conditions were much more detrimental to search behavior than the window conditions, indicating the importance of foveal vision during search. The size of the array also influenced performance, but performance reached asymptote for all array sizes tested at the same window size, and the effect of the foveal mask was the same for all array sizes. The results indicate that both acuity and difficulty of the search task influenced the span of the effective stimulus during visual search.     

Eye movements during search for coded and uncoded targets

Eye movements and search time of four subjects were studied as they searched for a target dial in a 4 х 4 array of dials which were differentiated by (1) color, (2) shape, (3) a combination of color and shape, or (4) were uncoded. Subjects did not exhibit a characteristic scanpath, and method of scanning did not relate to search time. Search time varied reliably among conditions; it was generally shortest in the color condition, followed by color shape, shape, and the uncoded condition. Subjects were capable of using both shape and color simultaneously. Search time was strongly associated with the average number of fixations required for target detection but not with other measures of eye movements. Fixation duration was a particularly inconsistent measure.     

Cultural differences in attention: Eye movement evidence from a comparative visual search task

Individual differences in visual attention have been linked to thinking style: analytic thinking (common in individualistic cultures) is thought to promote attention to detail and focus on the most important part of a scene, whereas holistic thinking (common in collectivist cultures) promotes attention to the global structure of a scene and the relationship between its parts. However, this theory is primarily based on relatively simple judgement tasks. We compared groups from Great Britain (an individualist culture) and Saudi Arabia (a collectivist culture) on a more complex comparative visual search task, using simple natural scenes. A higher overall number of fixations for Saudi participants, along with longer search times, indicated less efficient search behaviour than British participants. Furthermore, intra-group comparisons of scan-path for Saudi participants revealed less similarity than within the British group. Together, these findings suggest that there is a positive relationship between an analytic cognitive style and controlled attention.     

Eye movements and behavioral responses to threatening and nonthreatening stimuli during visual search in phobic and nonphobic subjects

Spider-phobic and nonphobic subjects searched for a feared/fear-relevant (spider) or neutral target (mushroom) presented in visual matrices of neutral objects (flowers). In half of the displays, the mushroom target was paired with a spider distractor, or a spider target was paired with a mushroom distractor. Although all subjects responded faster to the neutral target than to the feared/fear-relevant target, phobics were slower to respond than nonphobics when a mushroom target was presented with a spider distractor. Their eyes appeared to be drawn to the feared distractor before fixating neutral targets. A further experiment indicated no group differences when subjects merely judged the homogeneity of matrices. Thus, threat seems to capture the attention of phobics only when it is part of a background that subjects are explicitly instructed to ignore.     

Simultaneous processing of visual information and planning of hand movements in a visuo-manual search task

When searching for a target with eye movements, saccades are planned and initiated while the visual information is still being processed. If hand movements are needed to perform a search task, can they too be planned while visual information from the current position is still being processed? To find out we studied a visual search task in which participants had to move their hand to shift a window through which they could see the items. The task was to find an O in a circle of Cs. The size of the window and the sizes of the gaps in the Cs were varied. Participants made fast, smooth arm movements between items and adjusted their movements, when on the items, to the window size. On many trials the window passed the target and returned, indicating that the next movement had been planned before identifying the item that was in view.     

Dissociation of covert and overt spatial attention during prehension movements: Selective interference effects

In four experiments, the influence of distractor objects on the temporal evolution of the reach-tograsp movement toward a target object (an apple) was examined. In the first experiment, the distractor was another apple, which moved laterally behind the target and occasionally changed direction toward the target, thus becoming the to-be-grasped object. In the second and third experiments, the distractor was a stationary piece of fruit, which sometimes became the to-be-grasped object because of a change in illumination. The fourth experiment was a combination of the first two experiments. In all cases, selective interference effects on the transport and manipulation components were observed only when attention to the distractor was covert rather than overt. It is proposed that covert visuospatial attention selects information about distracting but potentially important stimuli, such that a registration of significance is accomplished without the need to process all available information.     

Age-related changes in selective attention and perceptual load during visual search

Three visual search experiments were conducted to test the hypothesis that age differences in selective attention vary as a function of perceptual load (E. A. Maylor & N. Lavie, 1998). Under resource-limited conditions (Experiments 1 and 2), the distraction from irrelevant display items generally decreased as display size (perceptual load) increased. This perceptual load effect was similar for younger and older adults, contrary to the findings of Maylor and Lavie. Distraction at low perceptual loads appeared to reflect both general and specific inhibitory mechanisms. Under more data-limited conditions (Experiment 3), an age-related decline in selective attention was evident, but the age difference was not attributable to capacity limitations as predicted by the perceptual load theory.