Eye movements during search and detection in comparative visual search

Motivated by the fact that previous visual memory paradigms have imposed encoding and retrieval constraints, the present article presents two experiments that address how observers allocate eye movements in memory and comparison processes in the absence of constraints. A comparative visual search design (Pomplun, Sichelschmidt, et al., 2001) was utilized in which observers searched for a difference between two images presented side by side. Robust time course effects were obtained, whereby search was characterized by brief fixations and a high proportion of comparative saccades. Then, upon target detection, fixations were extended, more comparative saccades were elicited, and the search focus was narrowed. The saliency and presence of differences did not guide attention, and detection was contingent upon direct fixation of the targets. The results indicate that, when full control is given, observers adopt a strategy that cuts down on memory usage in favor of restricted encoding and active scanning.     

Eye movements in search in visual neglect

We report data on eye movements in a patient (MP) with unilateral visual neglect, in a task of searching a real-world scene. We demonstrate that MP missed some contralesional targets after fixating on them. On such “miss”; trials, MP's eye movements were similar to those on objects in target-absent trials trials, where MP was cued to search for a target that was not actually present. In addition, MP showed little evidence of memory for the locations of objects that remained across a trial, though poor memory fails to explain performance on trials where targets were fixated. We suggest that, in this case, neglect reflected the poor uptake of information from the contralesional side of space, so that even fixated targets sometimes failed to match a “template” held in his memory.     

Eye movements in active visual search: A computable phenomenological model

We present a computational model and corresponding computer simulations that mimic phenomenologically the eye movement trajectories observed in a conjunctive visual search task. The element of randomness is captured in the model through a Monte Carlo selection of a particular eye movement based on its probability, which depends on three factors, adjusted to match to the observed saccade amplitude distribution, forward bias in consecutive saccades, and return rates. Memory is assumed to operate through tagging of objects already recognized as nontargets, which, in turn, requires their processing within the attentional area of conspicuity (AC). That AC is adjusted so that computer simulations optimally reproduce the distribution of the number of saccades, the failure rate for capturing the target, and the return rate to previously inspected locations. For their viability, computer simulations critically depend on memory’s being long-ranged. In turn, the simulations confirm the formation of circulating or spiraling patterns in the observed eye trajectories. We also relate consistently the average number of saccades per trial to the saccade amplitude distribution by modeling analytically the combined roles of the AC in attention and memory. The full Supplemental Appendix A for this article may be downloaded from http:// app.psychonomic-journals.org/content/supplemental.     

Eye movements and the span of the effective stimulus in visual search

The span of the effective stimulus during visual search through an unstructured alphanumeric array was investigated by using eye-contingent-display changes while the subjects searched for a target letter. In one condition, a window exposing the search array moved in synchrony with the subjects' eye movements, and the size of the window was varied. Performance reached asymptotic levels when the window was 5 degrees. In another condition, a foveal mask moved in synchrony with each eye movement, and the size of the mask was varied. The foveal mask conditions were much more detrimental to search behavior than the window conditions, indicating the importance of foveal vision during search. The size of the array also influenced performance, but performance reached asymptote for all array sizes tested at the same window size, and the effect of the foveal mask was the same for all array sizes. The results indicate that both acuity and difficulty of the search task influenced the span of the effective stimulus during visual search.     

Eye movements during search for coded and uncoded targets

Eye movements and search time of four subjects were studied as they searched for a target dial in a 4 х 4 array of dials which were differentiated by (1) color, (2) shape, (3) a combination of color and shape, or (4) were uncoded. Subjects did not exhibit a characteristic scanpath, and method of scanning did not relate to search time. Search time varied reliably among conditions; it was generally shortest in the color condition, followed by color shape, shape, and the uncoded condition. Subjects were capable of using both shape and color simultaneously. Search time was strongly associated with the average number of fixations required for target detection but not with other measures of eye movements. Fixation duration was a particularly inconsistent measure.     

Eye movements and attention in reading,scene perception,and visual search

Eye movements are now widely used to investigate cognitive processes during reading, scene perception, and visual search. In this article, research on the following topics is reviewed with respect to reading: (a) the perceptual span (or span of effective vision), (b) preview benefit, (c) eye movement control, and (d) models of eye movements. Related issues with respect to eye movements during scene perception and visual search are also reviewed. It is argued that research on eye movements during reading has been somewhat advanced over research on eye movements in scene perception and visual search and that some of the paradigms developed to study reading should be more widely adopted in the study of scene perception and visual search. Research dealing with “real-world” tasks and research utilizing the visual-world paradigm are also briefly discussed.     

Eye movements during language-mediated visual search reveal a strong link between overt visual attention and lexical processing in 36-month-olds

The nature of children’s early lexical processing was investigated by asking what information 36-month-olds access and use when instructed to find a known but absent referent. Children readily retrieved stored knowledge about characteristic color, i.e., when asked to find an object with a typical color (e.g., strawberry), children tended to fixate more upon an object that had the same (e.g., red plane) as opposed to a different (e.g., yellow plane) color. They did so regardless of the fact that they had plenty of time to recognize the pictures for what they are, i.e., planes and not strawberries. These data represent the first demonstration that language-mediated shifts of overt attention in young children can be driven by individual stored visual attributes of known words that mismatch on most other dimensions. The finding suggests that lexical processing and overt attention are strongly linked from an early age.     

Eye movements,evoked responses and visual perception: Some speculations

In a number of studies dealing with the activity of the visual system it has been found that the duration of 250–300 msec appears to be critical in some manner. It is suggested that these findings (from studies dealing with fixation durations during visual search, evoked cortical potential patterns, and the temporal limitations in the visual perception of sequential events) may be related to certain aspects of the processing and assimilation of visual information.     

Lateral eye-movement responses to visual stimuli

The association of left lateral eye-movement with emotionality or arousal of affect and of right lateral eye-movement with cognitive/interpretive operations and functions was investigated. Participants were junior and senior students enrolled in an undergraduate course in developmental psychology. There were 37 women and 13 men, ranging from 19 to 45 yr. of age. Using videotaped lateral eye-movements of 50 participants' responses to 15 visually presented stimuli (precategorized as neutral, emotional, or intellectual), content and statistical analyses supported the association between left lateral eye-movement and emotional arousal and between right lateral eye-movement and cognitive functions. Precategorized visual stimuli included items such as a ball (neutral), gun (emotional), and calculator (intellectual). The findings are congruent with existing lateral eye-movement literature and also are additive by using visual stimuli that do not require the explicit response or implicit processing of verbal questioning.     

Eye movements and visual imagery in free recall

The relationship between eye movements and visual imagery has almost exclusively been studied by treating eye movements as the dependent variable while an imagery task is being performed. In the present experiment three eye-movement treatment conditions were manipulated, within Ss, as the independent variable in order to study their effects on the free recall of nouns which Ss had to store by means of imagery. The imagery-evoking capacity (I) of nouns was varied over three levels within lists of Dutch nouns (Low, Medium and High I). Ss were instructed to generate a visual image to each separate noun under the following treatment conditions: (a) while they looked over and scanned their image as if they were looking at the real object: (b) while they received concurrent visual stimulation from a checkerboard pattern; (c) while they fixated on a target. Reliable, but minor effects of treatment conditions on the recall scores were found. The results were discussed in terms of possible theories about the nature of the relationship between eye movements and visual imagery.     

Distractor ratio influences patterns of eye movements during visual search

We examined the flexibility of guidance in a conjunctive search task by manipulating the ratios between different types of distractors. Participants were asked to decide whether a target was present or absent among distractors sharing either colour or shape. Results indicated a strong effect of distractor ratio on search performance. Shorter latency to move, faster manual response, and fewer fixations per trial were observed at extreme distractor ratios. The distribution of saccadic endpoints also varied flexibly as a function of distractor ratio. When there were very few same-colour distractors, the saccadic selectivity was biased towards the colour dimension. In contrast, when most of the distractors shared colour with the target, the saccadic selectivity was biased towards the shape dimension. Results are discussed within the framework of the guided search model.     

Emotional and autonomic responses to visual traumatic stimuli

A fine-grain analysis of autonomic responses are presented with the purpose of extending the conclusions from a previously published paper (Christianson & Nilsson, 1984) on emotional and memorial responses to traumatic visual stimuli. Control subjects were presented with a series of 18 slides of neutral faces, whereas the experimental subjects were presented with six slides of horrible facial injuries in positions 7–12, interspersed between six slides of neutral faces in the beginning, and six slides of neutral faces at the end of the series. The time course of heart rate (HR) and skin conductance (SC) during stimulus presentation was recorded. These data showed an initial pattern of increase in SC, but not in HR. This pattern was subsequently replaced by a combined increase in both SC and HR. The results are discrepant to previous work and are interpreted as effects of not informing the subjects about the gruesome slides to be presented.     

Eye movements and the integration of visual memory and visual perception

Because visual perception has temporal extent, temporally discontinuous input must be linked in memory. Recent research has suggested that this may be accomplished by integrating the active contents of visual short-term memory (VSTM) with subsequently perceived information. In the present experiments, we explored the relationship between VSTM consolidation and maintenance and eye movements, in order to discover how attention selects the information that is to be integrated. Specifically, we addressed whether stimuli needed to be overtly attended in order to be included in the memory representation or whether covert attention was sufficient. Results demonstrated that in static displays in which the to-be-integrated information was presented in the same spatial location, VSTM consolidation proceeded independently of the eyes, since subjects made few eye movements. In dynamic displays, however, in which the to-be-integrated information was presented in different spatial locations, eye movements were directly related to task performance. We conclude that these differences are related to different encoding strategies. In the static display case, VSTM was maintained in the same spatial location as that in which it was generated. This could apparently be accomplished with covert deployments of attention. In the dynamic case, however, VSTM was generated in a location that did not overlap with one of the to-be-integrated percepts. In order to "move" the memory trace, overt shifts of attention were required.     

Scene context influences without scene gist: Eye movements guided by spatial associations in visual search

Although the use of semantic information about the world seems ubiquitous in every task we perform, it is not clear whether we rely on a scene’s semantic information to guide attention when searching for something in a specific scene context (e.g., keys in one’s living room). To address this question, we compared contribution of a scene’s semantic information (i.e., scene gist) versus learned spatial associations between objects and context. Using the flash-preview–moving-window paradigm Castelhano and Henderson (Journal of Experimental Psychology: Human Perception and Performance 33:753–763, 2007), participants searched for target objects that were placed in either consistent or inconsistent locations and were semantically consistent or inconsistent with the scene gist. The results showed that learned spatial associations were used to guide search even in inconsistent contexts, providing evidence that scene context can affect search performance without consistent scene gist information. We discuss the results in terms of hierarchical organization of top-down influences of scene context.     

Saccadic eye movements and localization of visual stimuli

Visual localization phenomena were studied before, during, and after a saccade. Light flashes of 5 and 9 msec duration presented before and during the eye movement were mislocated in the saccade direction, the localization error being a time function. When the 9-msec duration stimulus and saccade did not overlap in time, a stripe was reported, when they did not, the stimulus was perceived as a point. If a long-duration stimulus moved perpendicularly to the saccade direction with the same “sigmoidal” velocity, a curvilinear trace was perceived, regardless of the linear trace of the image on the retina. A stimulus with stabilized retinal image was perceived as a stationary point during the saccade. A possible theory to deal with the data was suggested by modifying the algebra of outflow-inflow theories.