Initial scene representations facilitate eye movement guidance in visual search

What role does the initial glimpse of a scene play in subsequent eye movement guidance? In 4 experiments, a brief scene preview was followed by object search through the scene via a small moving window that was tied to fixation position. Experiment 1 demonstrated that the scene preview resulted in more efficient eye movements compared with a control preview. Experiments 2 and 3 showed that this scene preview benefit was not due to the conceptual category of the scene or identification of the target object in the preview. Experiment 4 demonstrated that the scene preview benefit was unaffected by changing the size of the scene from preview to search. Taken together, the results suggest that an abstract (size invariant) visual representation is generated in an initial scene glimpse and that this representation can be retained in memory and used to guide subsequent eye movements.     

Visual search in divided areas: Dividers initially interfere with and later facilitate visual search

A common search paradigm requires observers to search for a target among undivided spatial arrays of many items. Yet our visual environment is populated with items that are typically arranged within smaller (subdivided) spatial areas outlined by dividers (e.g., frames). It remains unclear how dividers impact visual search performance. In this study, we manipulated the presence and absence of frames and the number of frames subdividing search displays. Observers searched for a target O among Cs, a typically inefficient search task, and for a target C among Os, a typically efficient search. The results indicated that the presence of divider frames in a search display initially interferes with visual search tasks when targets are quickly detected (i.e., efficient search), leading to early interference; conversely, frames later facilitate visual search in tasks in which targets take longer to detect (i.e., inefficient search), leading to late facilitation. Such interference and facilitation appear only for conditions with a specific number of frames. Relative to previous studies of grouping (due to item proximity or similarity), these findings suggest that frame enclosures of multiple items may induce a grouping effect that influences search performance.     

Auditory, tactile, and multisensory cues facilitate search for dynamic visual stimuli

Presenting an auditory or tactile cue in temporal synchrony with a change in the color of a visual target can facilitate participants’ visual search performance. In the present study, we compared the magnitude of unimodal auditory, vibrotactile, and bimodal (i.e., multisensory) cuing benefits when the nonvisual cues were presented in temporal synchrony with the changing of the target’s color (Experiments 1 and 2). The target (a horizontal or vertical line segment) was presented among a number of distractors (tilted line segments) that also changed color at various times. In Experiments 3 and 4, the cues were also made spatially informative with regard to the location of the visual target. The unimodal and bimodal cues gave rise to an equivalent (significant) facilitation of participants’ visual search performance relative to a no-cue baseline condition. Making the unimodal auditory and vibrotactile cues spatially informative produced further performance improvements (on validly cued trials), as compared with cues that were spatially uninformative or otherwise spatially invalid. A final experiment was conducted in order to determine whether cue location (close to versus far from the visual display) would influence participants’ visual search performance. Auditory cues presented close to the visual search display were found to produce significantly better performance than cues presented over headphones. Taken together, these results have implications for the design of nonvisual and multisensory warning signals used in complex visual displays.     

Colour-cueing in visual search

Several studies have shown that people can selectively attend to stimulus colour, e.g., in visual search, and that preknowledge of a target colour can improve response speed/accuracy. The purpose was to use a form-identification task to determine whether valid colour precues can produce benefits and invalid cues costs. The subject had to identify the orientation of a "T"-shaped element in a ring of randomly-oriented "L"s when either two or four of the elements were differently coloured. Contrary to Moore and Egeth's (1998) recent findings, colour-based attention did affect performance under data-limited conditions: Colour cues produced benefits when processing load was high; when the load was reduced, they incurred only costs. Surprisingly, a valid colour cue succeeded in improving performance in the high-load condition even when its validity was reduced to the chance level. Overall, the results suggest that knowledge of a target colour does not facilitate the processing of the target, but makes it possible to prioritize it.     

Linguistically mediated visual search

During an individual's normal interaction with the environment and other humans, visual and linguistic signals often coincide and can be integrated very quickly. This has been clearly demonstrated in recent eyetracking studies showing that visual perception constrains on-line comprehension of spoken language. In a modified visual search task, we found the inverse, that real-time language comprehension can also constrain visual perception. In standard visual search tasks, the number of distractors in the display strongly affects search time for a target defined by a conjunction of features, but not for a target defined by a single feature. However, we found that when a conjunction target was identified by a spoken instruction presented concurrently with the visual display, the incremental processing of spoken language allowed the search process to proceed in a manner considerably less affected by the number of distractors. These results suggest that perceptual systems specialized for language and for vision interact more fluidly than previously thought.     

Collaboration during visual search

Two experiments examine how collaboration influences visual search performance. Working with a partner or on their own, participants reported whether a target was present or absent in briefly presented search displays. We compared the search performance of individuals working together (collaborative pairs) with the pooled responses of the individuals working alone (nominal pairs). Collaborative pairs were less likely than nominal pairs to correctly detect a target and they were less likely to make false alarms. Signal detection analyses revealed that collaborative pairs were more sensitive to the presence of the target and had a more conservative response bias than the nominal pairs. This pattern was observed even when the presence of another individual was matched across pairs. The results are discussed in the context of task-sharing, social loafing and current theories of visual search.     

Reading and visual search

Four experiments were conducted comparing the ways in which reading and search are affected by manipulations of word shape and word boundary. Word shape was manipulated by variations in type (normal, capitals, and alternating upper- and lowercase), while word boundary was manipulated by variations in spacing (normal, filled, and absent). The variations were combined factorially for nine space-type combinations. Experiments I and II were basic studies examining the effects of the manipulations on reading and on search, respectively. Search was found to be 2 to 2.5 times faster than reading. Reading and search both slowed to one-third of the normal speeds when spaces were removed and type altered. A significant interaction of Type by Space was found for reading but not for search. Experiments III and IV examined contextual and typographical effects on high-speed visual search through paragraphs. Form-class expectancy and target word predictability, respectively, were manipulated. In both experiments, subjects found the expected predictable words faster than the unexpected unpredictable words. The data were interpreted as providing support for the peripheral and cognitive search guidance processes hypothesized to be active in reading.     

Selection-for-action in visual search

Grasping an object rather than pointing to it enhances processing of its orientation but not its color. Apparently, visual discrimination is selectively enhanced for a behaviorally relevant feature. In two experiments we investigated the limitations and targets of this bias. Specifically, in Experiment 1 we were interested to find out whether the effect is capacity demanding, therefore we manipulated the set-size of the display. The results indicated a clear cognitive processing capacity requirement, i.e. the magnitude of the effect decreased for a larger set size. Consequently, in Experiment 2, we investigated if the enhancement effect occurs only at the level of behaviorally relevant feature or at a level common to different features. Therefore we manipulated the discriminability of the behaviorally neutral feature (color). Again, results showed that this manipulation influenced the action enhancement of the behaviorally relevant feature. Particularly, the effect of the color manipulation on the action enhancement suggests that the action effect is more likely to bias the competition between different visual features rather than to enhance the processing of the relevant feature. We offer a theoretical account that integrates the action-intention effect within the biased competition model of visual selective attention.     

Introspection during visual search

Recent advances in the field of metacognition have shown that human participants are introspectively aware of many different cognitive states, such as confidence in a decision. Here we set out to expand the range of experimental introspection by asking whether participants could access, through pure mental monitoring, the nature of the cognitive processes that underlie two visual search tasks: an effortless “pop-out” search, and a difficult, effortful, conjunction search. To this aim, in addition to traditional first order performance measures, we instructed participants to give, on a trial-by-trial basis, an estimate of the number of items scanned before a decision was reached. By controlling response times and eye movements, we assessed the contribution of self-observation of behavior in these subjective estimates. Results showed that introspection is a flexible mechanism and that pure mental monitoring of cognitive processes is possible in elementary tasks.     

Attention in visual search: Multiple search classes

Data from visual-search tasks are typically interpreted to mean that searching for targets defined by feature differences does not require attention and thus can be performed in parallel, whereas searching for other targets requires serial allocation of attention. The question addressed here was whether a parallel-serial dichotomy would be obtained if data were collected using a variety of targets representing each of several kinds of defining features. Data analyses included several computations in addition to search rate: (1) target-absent to target-present slope ratios; (2) two separate data transformations to control for errors; (3) minimum reaction time; and (4) slopes of standard deviation as a function of set size. Some targets showed strongly parallel or strongly serial search, but there was evidence for several intermediate search classes. Sometimes, for a given target-distractor pair, the results depended strongly on which character was the target and which was the distractor. Implications from theories of visual search are discussed.     

Prioritization in visual search: visual marking is not dependent on a mnemonic search

Visual marking (VM) refers to our ability to completely exclude old items from search when new stimuli are presented in our visual field. We examined whether this ability reflects an attentional scan of the old items, possibly allowing observers to apply inhibition of return or maintain a memory representation of already seen locations. In four experiments, we compared performance in two search conditions. In the double-search (DS) condition, we required participants to pay attention to a first set of items by having them search for a target within the set. Subsequently, they had to search a second set while the old items remained in the field. In the VM condition, the participants expected the target only to be in the second (new) set. Selection of new items in the DS condition was relatively poor and was always worse than would be expected if only the new stimuli had been searched. In contrast, selection of the new items in the VM condition was good and was equal to what would be expected if there had been an exclusive search of the new stimuli. These results were not altered when differences in Set 1 difficulty, task switching, and response generation were controlled for. We conclude that the mechanism of VM is distinct from mnemonic and/or serial inhibition-of-return processes as involved in search, although we also discuss possible links to more global and flexible inhibition-of-return processes not necessarily related to search.     

Attention demands of visual search

The relation between attention demand and the number of items in the array (array size) was investigated by engaging subjects in a primary search task and measuring spare capacity at different points in time, with a secondary tone task that occurred randomly on half of the trials. The major variables in both tasks were array size 14, 8, or 12 letters and stimulus onset asynchrony (SOA: ?400, ?200, 0, 200, 400, and 600 msec. Subjects were able to perform the tasks quite independently, and me, st of the interference that resulted from nonindependence appeared in tone-task performance. Theamount of interference (i.e., maximum tone reaction time) was independent of array size, but theduration of interference (li.e., the number of SOAs at which tone reaction time was elevated) increased with array size. The findings were interpreted as supporting unlimited-capacity models of visual search performance.     

Hemispheric patterns in visual search

A visual search paradigm was employed to examine hemispheric serial and parallel processing. Stimulus arrays containing 4, 9, or 16 elements were tachistoscopically presented to the right visual field-left hemisphere (RVF-LH) or left visual field-right hemisphere (LVF-RH). Subjects judged whether all of the elements within an array were physically the same (all X's) or whether one (O) was different from the rest. Left hemisphere presentations were processed more quickly and accurately than LVF-RH presentations for all stimulus conditions. As the number of array elements increased, more errors and longer response times were obtained for different stimulus items whereas fewer errors and somewhat shorter response times were obtained for same stimulus items. These and previous results suggest that the left hemisphere obtains an advantage for visual search because of that hemisphere's superiority for fine-grained feature analysis rather than because of a fundamental hemispheric serial/parallel processing dichotomy.     

Attentional misguidance in visual search

Previous research has shown that a task-irrelevant sudden onset of an object will capture an observer’s visual attention or draw it to that object (e.g., Yantis & Jonides, 1984). However, further research has demonstrated the apparent inability of an object with a task-irrelevant but unique color or luminance to capture attention (Jonides & Yantis, 1988). In the experiments reported here, we reexplore the question of whether task-irrelevant properties other than sudden onset may capture attention. Our results suggest that uniquely colored or luminous objects, as well as salient though irrelevant boundaries, do not appear to capture attention. However, these irrelevant features do appear to serve as landmarks for a top-down search strategy which becomes increasingly likely with larger display set sizes. These findings are described in terms of stimulus-driven and goal-directed aspects of attentional control.     

Acoustic factors in visual search

Previous work has shown that in searching for existing or absent “e.s” in printed prose, the presence or absence of silent “e.s” was less likely to be detected than that of pronounced “e.s.” It was suggested that the acoustic or kinaesthetic “image” was searched for evidence of an “e” in addition to the visual stimulus and that evidence from both sources was considered in making the appropriate response.

The present experiment employs mainly substitutive errors within words, which may or may not change their pronunciation. The results suggest that the form of the acoustic correlates has no bearing upon whether the words are detected as wrongly spelt, but that the presence or absence of an acoustic event corresponding in time to the spatial location of the error is important.     

Spatial selectivity in visual search

To what extent does successful search for a target letter in a visual display depend on the allocation of attention to the target’s spatial position? To investigate this question, we required subjects to discriminate the orientation of a briefly flashed U-shaped form while searching for a target letter. Performance operating characteristics (POCs) were derived by varying the relative amounts of attention subjects were to devote to each task. Extensive tradeoffs in performance were observed when the orientation form and target letter occurred in nonadjacent display positions. In contrast, the tradeoff was much more restricted when the two targets occurred in adjacent positions. These results suggest that the interference between simultaneous visual discriminations depends critically on their separation in visual space. Both visual search and form discrimination require a common limited-capacity visual resource.