Electrophysiological evidence for parallel and serial processing during visual search

Event-related potentials were recorded from young adults during a visual search task in order to evaluate parallel and serial models of visual processing in the context of Treisman's feature integration theory. Parallel and serial search strategies were produced by the use of feature-present and feature-absent targets, respectively. In the feature-absent condition, the slopes of the functions relating reaction time and latency of the P3 component to set size were essentially identical, indicating that the longer reaction times observed for larger set sizes can be accounted for solely by changes in stimulus identification and classification time, rather than changes in post-perceptual processing stages. In addition, the amplitude of the P3 wave on target-present trials in this condition increased with set size and was greater when the preceding trial contained a target, whereas P3 activity was minimal on target-absent trials. These effects are consistent with the serial self-terminating search model and appear to contradict parallel processing accounts of attention-demanding visual search performance, at least for a subset of search paradigms. Differences in ERP scalp distributions further suggested that different physiological processes are utilized for the detection of feature presence and absence.     

From parallel to serial processing: a computational study of visual search

A novel computational model of a preattentive system performing visual search is presented. The model processes displays of lines, reproduced from Wolfe, Friedman-Hill, Stewart, and O'Connell's (1992) and Treisman and Sato's (1990) visual-search experiments. The response times measured in these experiments suggest that some of the displays are searched serially, whereas others are scanned in parallel. Our neural network model operates in two phases. First, the visual displays are compressed via standard methods (principal component analysis), to overcome assumed biological capacity limitations. Second, the compressed representations are further processed to identify a target in the display. The model succeeds in fast detection of targets in experimentally labeled parallel displays, but fails with serial ones. Analysis of the compressed internal representations reveals that compressed parallel displays contain global information that enables instantaneous target detection. However, in representations of serial displays, this global information is obscure, and hence, a target detection system should resort to a serial, attentional scan of local features across the display. Our analysis provides a numerical criterion that is strongly correlated with the experimental response time slopes and enables us to reformulate Duncan and Humphreys's (1989) search surface, using precise quantitative measures. Our findings provide further insight into the important debate concerning the dichotomous versus continuous views of parallel/serial visual search.     

Top-down inhibition of search distractors in parallel visual search

In three experiments, we examined distractor inhibition in parallel ("pop-out") visual search. Distractor inhibition was measured in terms of reaction time (RT) to a simple luminance increment probe presented, after the search task response, at display locations that either contained a search distractor (on-probe) or were blank (off-probe). When the search stimuli remained in view, the on-probe (relative to off-probe) RT cost was larger than in a baseline condition in which observers had only to passively view, rather than search, the display. This differential on-probe RT cost, which discounts effects of masking, was interpreted as a measure of distractor inhibition associated with target selection in parallel visual search. Taken together, the results argue that the distractor inhibition is an object-based and local phenomenon that affects all distractors (of a particular type) in an equal manner.     

Parallel processing in visual search asymmetry

The difficulty of visual search may depend on assignment of the same visual elements as targets and distractors-search asymmetry. Easy C-in-O searches and difficult O-in-C searches are often associated with parallel and serial search, respectively. Here, the time course of visual search was measured for both tasks with speed-accuracy methods. The time courses of the 2 tasks were similar and independent of display size. New probabilistic parallel and serial search models and sophisticated-guessing variants made predictions about time course and accuracy of visual search. The probabilistic parallel model provided an excellent account of the data, but the serial model did not. Asymptotic search accuracies and display size effects were consistent with a signal-detection analysis, with lower variance encoding of Cs than Os. In the absence of eye movements, asymmetric visual search, long considered an example of serial deployment of covert attention, is qualitatively and quantitatively consistent with parallel search processes.     

The temporal dynamics of visual search: evidence for parallel processing in feature and conjunction searches

Feature and conjunction searches have been argued to delineate parallel and serial operations in visual processing. The authors evaluated this claim by examining the temporal dynamics of the detection of features and conjunctions. The 1st experiment used a reaction time (RT) task to replicate standard mean RT patterns and to examine the shapes of the RT distributions. The 2nd experiment used the response-signal speed-accuracy trade-off (SAT) procedure to measure discrimination (asymptotic detection accuracy) and detection speed (processing dynamics). Set size affected discrimination in both feature and conjunction searches but affected detection speed only in the latter. Fits of models to the SAT data that included a serial component overpredicted the magnitude of the observed dynamics differences. The authors concluded that both features and conjunctions are detected in parallel. Implications for the role of attention in visual processing are discussed.     

Factors affecting processing mode in visual search

Visual search was studied under a variety of conditions to clarify some differences among the results of previous investigations and to provide a testing ground for models of visual information processing. Display configuration, target and field composition, exposure duration, and display size (up to 16 elements) were among the parameters investigated. In some conditions, mean reaction time was essentially invariant with display size, while in other conditions it increased substantially and linearly with display size. Current models of visual information processing were evaluated in the light of these and previous findings; all were found wanting. The data seem to demand a system subject to flexible cognitive control processes.     

Cognitive control of fixation duration in visual search: The role of extrafoveal processing

Participants' eye movements were monitored in two visual search experiments that manipulated target-distractor similarity (high vs. low) as well as the availability of distractors for extrafoveal processing (Free-Viewing vs. No-Preview). The influence of the target-distractor similarity by preview manipulation on the distributions of first fixation and second fixation duration was examined by using a survival analysis technique which provided precise estimates of the timing of the first discernible influence of target-distractor similarity on fixation duration. We found a significant influence of target-distractor similarity on first fixation duration in normal visual search (Free Viewing) as early as 26–28 ms from the start of fixation. In contrast, the influence of target-distractor similarity occurred much later (199–233 ms) in the No-Preview condition. The present study also documented robust and fast acting extrafoveal and foveal preview effects. Implications for models of eye-movement control and visual search are discussed.     

Understanding the central processing limit in consistent-mapping visual search tasks

Effects of load (i.e., the number of stimuli in the display) have been observed in multiple-frame studies using a consistent mapping of stimuli to responses (e.g., Fisher, 1982, 1984). In a series of four experiments, it is shown that these effects are not the consequence of differences across the high- and low-load conditions in either decision noise or peripheral masking. Additionally, it is shown that of two modes of limited capacity (a limited-channel and divided-capacity model) considered as possible explanations of load effects in tasks where subjects are required to locate a target, only one--the limited-channel model--is consistent with the results from all three location tasks. Finally, it is argued that the limited-channel model predicts not only the behavior observed in the four consistent-mapping experiments reported in this article but also the behavior observed in several related consistent-mapping tasks (Kleiss & Lane, 1986; Shiffrin & Gardner, 1972).     

Parallel processing of park-whole information in visual search tasks

Combination of information from the parallel processing of different basic features (color, size, etc.) can be used to guide attention to targets defined by conjunctions of those features. Wolfe et al. (1990) argued that, although it was possible to guide attention to the conjunction of, for instance, color and orientation, it was not possible to guide attention to targets defined by conjunctions of two colors or two orientations. The present experiments demonstrate an exception to this rule. Although it is true that attention cannot be guided to a target that hasred and green parts, attention can be guided to an item that can be described as awhole red target with agreen part. In Experiments 1 and 2, we illustrate this point. In Experiments 3 and 4, we rule out some simple size-based accounts of this finding- In Experiments 5 and 6, we begin to explore the nature of these first steps toward dividing the visual scene into parts and wholes.     

Effects of increased processing load on parallel processing of visual displays

Display elements were sequentially painted upon a display scope in regular and irregular spatial-temporal orders. The primary result of Mayzner, Tresselt, and their associates is confirmed: within specified temporal-spatial limits, display elements may be perceptually blanked. Characteristics of perceptually blanked elements can, however, be revealed by forced-choice testing. The accuracy of tilt discrimination for perceptually blanked elements is equal to, or better than, that for nonblanked elements. Perceptually blanked elements can also be distinguished from absent and from partially absent elements, presumably on the basis of a crude brightness discrimination. Sequential blanking effects as revealed in the accuracy of slant detection, are not critically dependent upon the magnitude of uniform spacing between the display elements.     

The role of priming in conjunctive visual search

To assess the role of priming in conjunctive visual search tasks, we systematically varied the consistency of the target and distractor identity between different conditions. Search was fastest in the standard conjunctive search paradigm where identities remained constant. Search was slowest when potential target identity varied predictably for each successive trial (the 'switch' condition). The role of priming was also demonstrated on a trial-by-trial basis in a 'streak' condition where target and distractor identity was unpredictable yet was consistent within streaks. When the target to be found was the same for a few trials in a row, search performance became similar to that when the potential target was the same on all trials. A similar pattern was found for the target absent trials, suggesting that priming is based on the whole search array rather than just the target in each case. Further analysis indicated that the effects of priming are sufficiently strong to account for the advantage seen for the conjunctive search task. We conclude that the role of priming in visual search is underestimated in current theories of visual search and that differences in search times often attributed to top-down guidance may instead reflect the benefits of priming.     

Aging and guided visual search: the role of visual working memory

In the present study, we examined age-related differences in utilizing learned associations to guide visual search. Participants viewed an object cue that was associated with 1 or 2 target colors, followed by a search array. Older adults showed slower RTs, larger visual search slopes, and reduced cue–target association knowledge than did younger adults. We also found increased search RTs and higher error rates when the cue was associated with 2 colors instead of 1. However, visual search slopes did not vary with the number of associated colors. This indicates that participants could activate multiple templates simultaneously to guide the search or retrieve associative information directly from the long-term memory. Furthermore, regression analyses showed that VWMC can predict both visual search performances and cue–target association knowledge. More broadly, our results demonstrate that VWMC can modify the effects of age on cued visual search performance.     

The role of visual information in the processing of

Visual information provided by a talker’s mouth movements can influence the perception of certain speech features. Thus, the “McGurk effect” shows that when the syllable /bi/ is presented audibly, in synchrony with the syllable /gi/, as it is presented visually, a person perceives the talker as saying /di/. Moreover, studies have shown that interactions occur between place and voicing features in phonetic perception, when information is presented audibly. In our first experiment, we asked whether feature interactions occur when place information is specified by a combination of auditory and visual information. Members of an auditory continuum ranging from /ibi/ to /ipi/ were paired with a video display of a talker saying /igi/. The auditory tokens were heard as ranging from /ibi/ to /ipi/, but the auditory-visual tokens were perceived as ranging from /idi/ to /iti/. The results demonstrated that the voicing boundary for the auditory-visual tokens was located at a significantly longer VOT value than the voicing boundary for the auditory continuum presented without the visual information. These results demonstrate that place-voice interactions are not limited to situations in which place information is specified audibly. In three follow-up experiments, we show that (1) the voicing boundary is not shifted in the absence of a change in the global percept, even when discrepant auditory-visual information is presented; (2) the number of response alternatives provided for the subjects does not affect the categorization or the VOT boundary of the auditory-visual stimuli; and (3) the original effect of a VOT boundary shift is not replicated when subjects are forced by instruction to \ldrelabel\rd the /b-p/auditory stimuli as/d/or/t/. The subjects successfully relabeled the stimuli, but no shift in the VOT boundary was observed.     

Serial processing of visual spatial patterns in a search paradigm

Previous experiments in this laboratory employing a search paradigm have found highly significant differences in the detectability of a briefly exposed target pattern as a function of the spatial location of the target when it is presented simultaneously with a number of discriminably different nontarget patterns. These detectability differences, at loci equidistant from the fovea, could not be accounted for by any known variation in retinal spatial resolution or by differential lateral masking effects of the target by nearby nontarget patterns. These observations led to the hypothesis that the target in these experiments was detected by a serial mechanism which "scanned" a persisting but rapidly degrading neural representation of the visual scene with increasing detection failures the later in time the scan processed the location occupied by the target. If this hypothesis is correct, then target detectability should vary inversely with the number of stimuli which must be examined. The present experiment confirmed this expectation. A mathematical model of such a serial scanning process also predicts other, less obvious, effects on target detectability which were observed when the number of nontarget patterns was changed.     

The equivalence of target and nontarget processing in visual search

A comparison of a forced-choice visual search task with an item recognition task did not support Neisser’s (1967) hypothesis of a preattentive stage that processes targets and nontargets differentially. In the forced-choice condition, Ss indicated which of two items in a visual display was a target; in item recognition, Ss determined whether or not the single item in the visual display was a target. The size of the memorized set of possible targets was varied from one to six items for both tasks. Latencies increased linearly with memory set size in both conditions; the slopes for forced choice and item recognition were 41.8 and 27.9 msec per item, respectively. The ratio of 1.38 between the two slopes was well fit by Sternberg’s (1967) item recognition model, which predicts a ratio of 1.50.     

The role of crowding in parallel search: Peripheral pooling is not responsible for logarithmic efficiency in parallel search

Recent results from our laboratory showed that, in fixed-target parallel search tasks, reaction times increase in a logarithmic fashion with set size, and the slope of this logarithmic function is modulated by lure-target similarity. These results were interpreted as being consistent with a processing architecture where early vision (stage one) processes elements in the display in exhaustive fashion with unlimited capacity and with a limitation in resolution. Here, we evaluate the contribution of crowding to our recent logarithmic search slope findings, considering the possibility that peripheral pooling of features (as observed in crowding) may be responsible for logarithmic efficiency. Factors known to affect the strength of crowding were varied, specifically: item spacing and similarity. The results from three experiments converge on the same pattern of results: reaction times increased logarithmically with set size and were modulated by lure-target similarity even when crowding was minimized within displays through an inter-item spacing manipulation. Furthermore, we found logarithmic search efficiencies were overall improved in displays where crowding was minimized compared to displays where crowding was possible. The findings from these three experiments suggest logarithmic efficiency in efficient search is not the result peripheral pooling of features. That said, the presence of crowding does tend to reduce search efficiency, even in “pop-out” search situations.     

The role of within-dimension singleton priming in visual search

The authors report a newly identified intertrial priming phenomenon, within-dimension singleton priming, by which search for a target that happens to be a singleton on the current trial is faster when the target on the previous trial had also been a singleton on the same dimension rather than a nonsingleton. This effect was replicated in 6 experiments with different procedures, with singletons on various dimensions, when the featural contrast defining the singleton remained the same or changed within a dimension from one trial to the next, and when the target was a singleton on a target-defining dimension or on an irrelevant dimension. These findings cannot be explained by previously demonstrated intertrial repetition effects such as dimension-specific priming or priming of pop-out. Theoretical implications of the within-dimension singleton priming phenomenon are discussed relative to the dimension-weighting hypothesis, the role of stimulus-driven salience in feature-guided search, and the roles of intertrial priming and goal-directed factors in visual search.