Eye movements during search and detection in comparative visual search

Motivated by the fact that previous visual memory paradigms have imposed encoding and retrieval constraints, the present article presents two experiments that address how observers allocate eye movements in memory and comparison processes in the absence of constraints. A comparative visual search design (Pomplun, Sichelschmidt, et al., 2001) was utilized in which observers searched for a difference between two images presented side by side. Robust time course effects were obtained, whereby search was characterized by brief fixations and a high proportion of comparative saccades. Then, upon target detection, fixations were extended, more comparative saccades were elicited, and the search focus was narrowed. The saliency and presence of differences did not guide attention, and detection was contingent upon direct fixation of the targets. The results indicate that, when full control is given, observers adopt a strategy that cuts down on memory usage in favor of restricted encoding and active scanning.     

Eye movements in search in visual neglect

We report data on eye movements in a patient (MP) with unilateral visual neglect, in a task of searching a real-world scene. We demonstrate that MP missed some contralesional targets after fixating on them. On such “miss”; trials, MP's eye movements were similar to those on objects in target-absent trials trials, where MP was cued to search for a target that was not actually present. In addition, MP showed little evidence of memory for the locations of objects that remained across a trial, though poor memory fails to explain performance on trials where targets were fixated. We suggest that, in this case, neglect reflected the poor uptake of information from the contralesional side of space, so that even fixated targets sometimes failed to match a “template” held in his memory.     

Distractor ratio influences patterns of eye movements during visual search

We examined the flexibility of guidance in a conjunctive search task by manipulating the ratios between different types of distractors. Participants were asked to decide whether a target was present or absent among distractors sharing either colour or shape. Results indicated a strong effect of distractor ratio on search performance. Shorter latency to move, faster manual response, and fewer fixations per trial were observed at extreme distractor ratios. The distribution of saccadic endpoints also varied flexibly as a function of distractor ratio. When there were very few same-colour distractors, the saccadic selectivity was biased towards the colour dimension. In contrast, when most of the distractors shared colour with the target, the saccadic selectivity was biased towards the shape dimension. Results are discussed within the framework of the guided search model.     

Eye movements and attention in reading,scene perception,and visual search

Eye movements are now widely used to investigate cognitive processes during reading, scene perception, and visual search. In this article, research on the following topics is reviewed with respect to reading: (a) the perceptual span (or span of effective vision), (b) preview benefit, (c) eye movement control, and (d) models of eye movements. Related issues with respect to eye movements during scene perception and visual search are also reviewed. It is argued that research on eye movements during reading has been somewhat advanced over research on eye movements in scene perception and visual search and that some of the paradigms developed to study reading should be more widely adopted in the study of scene perception and visual search. Research dealing with “real-world” tasks and research utilizing the visual-world paradigm are also briefly discussed.     

Eye movements during visual mental imagery

It has long been debated whether eye movements play a functional role in visual mental imagery. A recent paper by Laeng and Teodorescu presents new evidence that eye movements are stored as a spatial index that is used to arrange the component parts correctly when mental images are generated.     

Eye movements during search for coded and uncoded targets

Eye movements and search time of four subjects were studied as they searched for a target dial in a 4 х 4 array of dials which were differentiated by (1) color, (2) shape, (3) a combination of color and shape, or (4) were uncoded. Subjects did not exhibit a characteristic scanpath, and method of scanning did not relate to search time. Search time varied reliably among conditions; it was generally shortest in the color condition, followed by color shape, shape, and the uncoded condition. Subjects were capable of using both shape and color simultaneously. Search time was strongly associated with the average number of fixations required for target detection but not with other measures of eye movements. Fixation duration was a particularly inconsistent measure.     

Eye movements and the span of the effective stimulus in visual search

The span of the effective stimulus during visual search through an unstructured alphanumeric array was investigated by using eye-contingent-display changes while the subjects searched for a target letter. In one condition, a window exposing the search array moved in synchrony with the subjects' eye movements, and the size of the window was varied. Performance reached asymptotic levels when the window was 5 degrees. In another condition, a foveal mask moved in synchrony with each eye movement, and the size of the mask was varied. The foveal mask conditions were much more detrimental to search behavior than the window conditions, indicating the importance of foveal vision during search. The size of the array also influenced performance, but performance reached asymptote for all array sizes tested at the same window size, and the effect of the foveal mask was the same for all array sizes. The results indicate that both acuity and difficulty of the search task influenced the span of the effective stimulus during visual search.     

Eye movements in active visual search: A computable phenomenological model

We present a computational model and corresponding computer simulations that mimic phenomenologically the eye movement trajectories observed in a conjunctive visual search task. The element of randomness is captured in the model through a Monte Carlo selection of a particular eye movement based on its probability, which depends on three factors, adjusted to match to the observed saccade amplitude distribution, forward bias in consecutive saccades, and return rates. Memory is assumed to operate through tagging of objects already recognized as nontargets, which, in turn, requires their processing within the attentional area of conspicuity (AC). That AC is adjusted so that computer simulations optimally reproduce the distribution of the number of saccades, the failure rate for capturing the target, and the return rate to previously inspected locations. For their viability, computer simulations critically depend on memory’s being long-ranged. In turn, the simulations confirm the formation of circulating or spiraling patterns in the observed eye trajectories. We also relate consistently the average number of saccades per trial to the saccade amplitude distribution by modeling analytically the combined roles of the AC in attention and memory. The full Supplemental Appendix A for this article may be downloaded from http:// app.psychonomic-journals.org/content/supplemental.     

Eye movements during language-mediated visual search reveal a strong link between overt visual attention and lexical processing in 36-month-olds

The nature of children’s early lexical processing was investigated by asking what information 36-month-olds access and use when instructed to find a known but absent referent. Children readily retrieved stored knowledge about characteristic color, i.e., when asked to find an object with a typical color (e.g., strawberry), children tended to fixate more upon an object that had the same (e.g., red plane) as opposed to a different (e.g., yellow plane) color. They did so regardless of the fact that they had plenty of time to recognize the pictures for what they are, i.e., planes and not strawberries. These data represent the first demonstration that language-mediated shifts of overt attention in young children can be driven by individual stored visual attributes of known words that mismatch on most other dimensions. The finding suggests that lexical processing and overt attention are strongly linked from an early age.     

Eye movements and behavioral responses to threatening and nonthreatening stimuli during visual search in phobic and nonphobic subjects

Spider-phobic and nonphobic subjects searched for a feared/fear-relevant (spider) or neutral target (mushroom) presented in visual matrices of neutral objects (flowers). In half of the displays, the mushroom target was paired with a spider distractor, or a spider target was paired with a mushroom distractor. Although all subjects responded faster to the neutral target than to the feared/fear-relevant target, phobics were slower to respond than nonphobics when a mushroom target was presented with a spider distractor. Their eyes appeared to be drawn to the feared distractor before fixating neutral targets. A further experiment indicated no group differences when subjects merely judged the homogeneity of matrices. Thus, threat seems to capture the attention of phobics only when it is part of a background that subjects are explicitly instructed to ignore.     

Eye movements of children, adults, and elderly persons during inspection of dot patterns

The effectiveness of three fading and two nonfading procedures were compared in training kindergarten children on an oddity problem in which shape was the relevant dimension. The fading procedures employed supplementary cues which were gradually eliminated during training. The cues included either saturating the odd stimulus with a red color, saturating the nonodd stimuli with a red color, or varying the degree of illumination of the nonodd stimuli. One nonfading group received training on a structurally simpler oddity problem prior to transfer to a more complex oddity problem, and a second nonfading group received the standard oddity training procedure. While significant differences in acquisition were not obtained between training groups, the oddity task performance and the results from a test of dimensional observation revealed that the fading procedures were differentially effective in transferring Ss′ observation from the dimension of the fading cue to that relevant for solution of the oddity problem.     

On the visual span during object search in real-world scenes

The current study investigated from how large a region around their current point of gaze viewers can take in information when searching for objects in real-world scenes. Visual span size was estimated using the gaze-contingent moving window paradigm. Experiment 1 featured window radii measuring 1, 3, 4, 4.7, 5.4, and 6.1°. Experiment 2 featured six window radii measuring between 5 and 10°. Each scene occupied a 24.8 × 18.6° field of view. Inside the moving window, the scene was presented in high resolution. Outside the window, the scene image was low-pass filtered to impede the parsing of the scene into constituent objects. Visual span was defined as the window size at which object search times became indistinguishable from search times in the no-window control condition; this occurred with windows measuring 8° and larger. Notably, as long as central vision was fully available (window radii ≥ 5°), the distance traversed by the eyes through the scene to the search target was comparable to baseline performance. However, to move their eyes to the target, viewers made shorter saccades, requiring more fixations to cover the same image space, and thus more time. Moreover, a gaze-data based decomposition of search time revealed disruptions in specific subprocesses of search. In addition, nonlinear mixed models analyses demonstrated reliable individual differences in visual span size and parameters of the search time function.     

Eye movements and the integration of visual memory and visual perception

Because visual perception has temporal extent, temporally discontinuous input must be linked in memory. Recent research has suggested that this may be accomplished by integrating the active contents of visual short-term memory (VSTM) with subsequently perceived information. In the present experiments, we explored the relationship between VSTM consolidation and maintenance and eye movements, in order to discover how attention selects the information that is to be integrated. Specifically, we addressed whether stimuli needed to be overtly attended in order to be included in the memory representation or whether covert attention was sufficient. Results demonstrated that in static displays in which the to-be-integrated information was presented in the same spatial location, VSTM consolidation proceeded independently of the eyes, since subjects made few eye movements. In dynamic displays, however, in which the to-be-integrated information was presented in different spatial locations, eye movements were directly related to task performance. We conclude that these differences are related to different encoding strategies. In the static display case, VSTM was maintained in the same spatial location as that in which it was generated. This could apparently be accomplished with covert deployments of attention. In the dynamic case, however, VSTM was generated in a location that did not overlap with one of the to-be-integrated percepts. In order to "move" the memory trace, overt shifts of attention were required.     

Eye movements during change detection: implications for search constraints, memory limitations, and scanning strategies

Search, memory, and strategy constraints on change detection were analyzed in terms of oculomotor variables. Observers viewed a repeating sequence of three displays (Scene 1-->Mask-->Scene 2-->Mask...) and indicated the presence-absence of a changing object between Scenes 1 and 2. Scenes depicted real-world objects arranged on a surface. Manipulations included set size (one, three, or nine items) and the orientation of the changing objects (similar or different). Eye movements increased with the number of potentially changing objects in the scene, with this set size effect suggesting a relationship between change detection and search. A preferential fixation analysis determined that memory constraints are better described by the operation comparing the pre- and postchange objects than as a capacity limitation, and a scanpath analysis revealed a change detection strategy relying on the peripheral encoding and comparison of display items. These findings support a signal-in-noise interpretation of change detection in which the signal varies with the similarity of the changing objects and the noise is determined by the distractor objects and scene background.     

Eye movements and visual imagery in free recall

The relationship between eye movements and visual imagery has almost exclusively been studied by treating eye movements as the dependent variable while an imagery task is being performed. In the present experiment three eye-movement treatment conditions were manipulated, within Ss, as the independent variable in order to study their effects on the free recall of nouns which Ss had to store by means of imagery. The imagery-evoking capacity (I) of nouns was varied over three levels within lists of Dutch nouns (Low, Medium and High I). Ss were instructed to generate a visual image to each separate noun under the following treatment conditions: (a) while they looked over and scanned their image as if they were looking at the real object: (b) while they received concurrent visual stimulation from a checkerboard pattern; (c) while they fixated on a target. Reliable, but minor effects of treatment conditions on the recall scores were found. The results were discussed in terms of possible theories about the nature of the relationship between eye movements and visual imagery.     

Looking versus seeing: Strategies alter eye movements during visual search

Visual search can be made more efficient by adopting a passive cognitive strategy (i.e., letting the target “pop” into mind) rather than by trying to actively guide attention. In the present study, we examined how this strategic benefit is linked to eye movements. Results show that participants using a passive strategy wait longer before beginning to move their eyes and make fewer saccades than do active participants. Moreover, the passive advantage stems from more efficient use of the information in a fixation, rather than from a wider attentional window. Individual difference analyses indicate that strategies also change the way eye movements are related to search success, with a rapid saccade rate predicting success among active participants, and fewer and larger amplitude saccades predicting success among passive participants. A change in mindset, therefore, alters how oculomotor behaviors are harnessed in the service of visual search.