“Transient structures”: The effects of practice and distractor grouping on within-dimension conjunction searches

It has been stated that whereas between-dimension (color × orientation) conjunctions can be searched in a “parallel” fashion, within-dimension (color × color) conjunctions are necessarily searched in a “serial self-terminating” fashion (Wolfe et al., 1990). We explored the effects of practice (within 1-h experimental session) and distractor grouping on within-dimension conjunction search tasks. In Experiments 1 and 3, the stimuli were rectangles formed by two adjacent squares; in Experiment 2, the stimuli were plus signs formed by two segments and an intersection. In Experiments 1 and 2, observers were assigned to one of two experimental conditions: In one, all the distractors shared a simple feature (the color blue); in the other, distractors did not share that simple feature. In the first condition, search became more efficient with practice and observers’ performance was characterized by a shallow reaction time (RT) × set size slope; in the second condition, observers’ performance did not improve as much with practice. We propose that the differential effects of practice between these two experimental conditions can be explained in terms of distractor grouping induced by the shared color of the distractors. Experiment 3 showed that, with practice, a shallow RT × set size slope characterized observers’ search for a color × color target among four different distractors that shared a common color. The present results contradict a main tenet of some current visual search models— namely, that within-dimension conjunctions cannot be searched in parallel, and question the validity of using RT × set size slope functions to distinguish between preattentive versus attentive search.     

Learning in combined-feature search: specificity to orientation

We investigated the dynamics and specificity of learning in the search for a target defined by combined features belonging to the same dimension (a rotated L) among homogeneous or heterogeneous distractors (differently rotated Ls). We found that learning makes searching faster although the search strategy does not change, remaining parallel with homogeneous distractors and serial with heterogeneous distractors. Learning was found to be specific for combined-feature orientation, although simple features did not change in the transfer stimulus: Transfer was partial when either the target or the distractors were rotated (so that their global orientation became the same) and totally absent when target and distractors were swapped. These results, which apply to searches among both homogeneous and heterogeneous distractors, rule out the possibility that learning is specific for orientation of just simple features. Instead, the results suggest that specificity of learning with combined features reflects the activation of junction detectors responding to a combined feature of a particular orientation.     

Parallel pattern processing and visual agnosia.

A series of visual search experiments are reported examining pattern processing in a visual agnosic patient. We examined search for targets defined by: (I) the combination of their features relative to homogeneous distractors; (2) the combination of their features relative to heterogeneous distractors; and (3) a single feature difference relative to the distractors (their orientation). Normal subjects demonstrate evidence of spatially parallel search when combined-feature targets are detected against homogeneous distractors, and when targets are defined by a salient feature difference. There are non-linear effects of the number of distractors present, and absent responses can be as fast as present. In contrast, search times for combined-feature targets amongst heterogeneous distractors increase linearly with display size, with the slope for absent responses about twice that for present. The contrast between search for combined-feature targets amongst homogeneous and heterogeneous distractors can be attributed to the effects of grouping between distractors and between distractors and targets (Duncan & Humphreys, 1989, 1992; Humphreys & Muller, in press). Grouping between homogeneous distractors facilitates search. An agnosic patient, HJA, showed normal search functions for single-feature targets and for combined-feature targets amongst heterogeneous distractors. However, he was impaired at search for combined-feature targets amongst homogeneous distractors. This suggests that HJA is selectively impaired at grouping conjunctions of form features. The relations between HJA's agnosia and his problem in the parallel grouping of form conjunctions are discussed, as are the implications of the work for understanding normal vision.     

Lesioning a connectionist model of visual search: selective effects on distractor grouping.

A connectionist model of visual search is presented, in which search is determined by patterns of grouping between distractors and between the target and the distractors. Grouping is based on conjunctive relations between simple form elements (corners, line-end terminators), and uses principles of similarity and spatial proximity. In its normal, 'unlesioned' state, the model simulates the search data generated by human subjects when they search for simple form conjunctions amongst either homogeneous or heterogeneous distractors (Humphreys & Muller, in press). In this paper, the performance of the model is examined after the model is subject to various types of 'lesion'. 'Lesioning' is produced either by increasing the internal noise on the activation functions governing the interactions between processing units, or by eliminating processing units from different loci in the model. Increasing the internal noise within the model, or lesioning units within 'high-level' processing stages, can generate the selective effects on search found in a detailed single case study of an agnosic patient (Humphreys, Riddoch, Quinlan, Price & Donnelly, this volume): Namely, there is selective disruption of search for a form conjunction amongst homogeneous distractors relative to search for the same target amongst heterogeneous distractors. This selective effect can be attributed to the 'lesion' disrupting grouping between distractors, which normally facilitates search with homogeneous distractors. The simulations demonstrate that (1) search processes can be disrupted by adding internal noise to search functions, (2) that there can be selective effects on grouping processes, and (3) that these selective effects can be associated with different types of lesion to different stages in the model. The implications of the simulations for understanding visual processing impairments in agnosia are discussed.     

Serial and parallel search in pattern vision?

The nature of the processing of combinations of stimulus dimensions in human vision has recently been investigated. A study is reported in which visual search for suprathreshold positional information--vernier offsets, stereoscopic disparity, lateral separation, and orientation--was examined. The initial results showed that reaction times for visual search for conjunctions of stereoscopic disparity and either vernier offsets or orientation were independent of the number of distracting stimuli displayed, suggesting that disparity was searched in parallel with vernier offsets or orientation. Conversely, reaction times for detection of conjunctions of vernier offsets and orientation, or lateral separation and each of the other positional judgements, were related linearly to the number of distractors, suggesting serial search. However, practice has a significant effect upon the results, indicative of a shift in the mode of search from serial to parallel for all conjunctions tested as well as for single features. This suggests a reinterpretation of these and perhaps other studies that use the Treisman visual search paradigm, in terms of perceptual segregation of the visual field by disparity, motion, color, and pattern features such as colinearity, orientation, lateral separation, or size.     

Spatially parallel processing of within-dimension conjunctions

Within-dimension conjunction search for red-green targets amongst red-blue, and blue-green, nontargets is extremely inefficient (Wolfe et al, 1990 Journal of Experimental Psychology: Human Perception and Performance 16 879-892). We tested whether pairs of red-green conjunction targets can nevertheless be processed spatially in parallel. Participants made speeded detection responses whenever a red-green target was present. Across trials where a second identical target was present, the distribution of detection times was compatible with the assumption that targets were processed in parallel (Miller, 1982 Cognitive Psychology 14 247-279). We show that this was not an artifact of response-competition or feature-based processing. We suggest that within-dimension conjunctions can be processed spatially in parallel. Visual search for such items may be inefficient owing to within-dimension grouping between items.     

Efficient visual search without top-down or bottom-up guidance

Two types of mechanisms have dominated theoretical accounts of efficient visual search. The first are bottom-up processes related to the characteristics of retinotopic feature maps. The second are top-down mechanisms related to feature selection. To expose the potential involvement of other mechanisms, we introduce a new search paradigm whereby a target is defined only in a context-dependent manner by multiple conjunctions of feature dimensions. Because targets in a multiconjunction task cannot be distinguished from distractors either by bottom-up guidance or top-down guidance, current theories of visual search predict inefficient search. While inefficient search does occur for the multiple conjunctions of orientation with color or luminance, we find efficient search for multiple conjunctions of luminance/size, luminance/shape, and luminance/topology. We also show that repeated presentations of either targets or a set of distractors result in much faster performance and that bottom-up feature extraction and top-down selection cannot account for efficient search on their own. In light of this, we discuss the possible role of perceptual organization in visual search. Furthermore, multiconjunction search could provide a new method for investigating perceptual grouping in visual search.     

Learning efficient visual search for stimuli containing diagnostic spatial configurations and color-shape conjunctions

Visual search is often slow and difficult for complex stimuli such as feature conjunctions. Search efficiency, however, can improve with training. Search for stimuli that can be identified by the spatial configuration of two elements (e.g., the relative position of two colored shapes) improves dramatically within a few hundred trials of practice. Several recent imaging studies have identified neural correlates of this learning, but it remains unclear what stimulus properties participants learn to use to search efficiently. Influential models, such as reverse hierarchy theory, propose two major possibilities: learning to use information contained in low-level image statistics (e.g., single features at particular retinotopic locations) or in high-level characteristics (e.g., feature conjunctions) of the task-relevant stimuli. In a series of experiments, we tested these two hypotheses, which make different predictions about the effect of various stimulus manipulations after training. We find relatively small effects of manipulating low-level properties of the stimuli (e.g., changing their retinotopic location) and some conjunctive properties (e.g., color-position), whereas the effects of manipulating other conjunctive properties (e.g., color-shape) are larger. Overall, the findings suggest conjunction learning involving such stimuli might be an emergent phenomenon that reflects multiple different learning processes, each of which capitalizes on different types of information contained in the stimuli. We also show that both targets and distractors are learned, and that reversing learned target and distractor identities impairs performance. This suggests that participants do not merely learn to discriminate target and distractor stimuli, they also learn stimulus identity mappings that contribute to performance improvements.     

Limitations on the parallel guidance of visual search: color x color and orientation x orientation conjunctions

In visual search for a conjunction it is much more difficult to search for the conjunction of 2 colors or 2 orientations than for Color x Orientation or Color x Shape conjunctions. The result is not limited to particular colors or shapes. Two colors cannot occupy the same spatial location in Color x Color searches. However, Experiments 6 and 7 show that Color x Shape searches remain efficient even if the color and shape are spatially separated. Our guided search model suggests that in searches for Color x Shape, a parallel color module can guide attention toward the correct color, whereas the shape module guides attention toward the correct shape. Together these 2 sources of guidance lead attention to the target. However, if a target is red and green among red-blue and green-blue distractors, it is not possible to guide search independently toward red items and green items or away from all blue items.     

Perceptual grouping and attention in visual search for features and for objects

This article explores the effects of perceptual grouping on search for targets defined by separate features or by conjunction of features. Treisman and Gelade proposed a feature-integration theory of attention, which claims that in the absence of prior knowledge, the separable features of objects are correctly combined only when focused attention is directed to each item in turn. If items are preattentively grouped, however, attention may be directed to groups rather than to single items whenever no recombination of features within a group could generate an illusory target. This prediction is confirmed: In search for conjunctions, subjects appear to scan serially between groups rather than items. The scanning rate shows little effect of the spatial density of distractors, suggesting that it reflects serial fixations of attention rather than eye movements. Search for features, on the other hand, appears to independent of perceptual grouping, suggesting that features are detected preattentively. A conjunction target can be camouflaged at the preattentive level by placing it at the boundary between two adjacent groups, each of which shares one of its features. This suggests that preattentive grouping creates separate feature maps within each separable dimension rather than one global configuration.     

Aging and the Development of Automaticity in Feature Search

A training experiment was conducted to investigate age differences in the learning that occurs when observers search for an orientation-defined target among a homogeneous set of distractors (i.e., feature search). Eighteen young (M age = 26 years) and seventeen old (M age = 62 years) participants completed seven practice sessions (3,024 trials), followed by a single session of full reversal. Training involved consistent mapping, varied mapping, or nonsearch, in which a precue predicted the target location with 100% validity. Younger and older observers demonstrated equivalent learning rates and equivalent disruption following reversal in all training conditions. Results are interpreted within models of visual attention and search.     

Do intersections serve as basic features in visual search?

The status of 'intersection' as a basic feature in visual search tasks has been controversial. Under some circumstances, a target possessing this attribute (eg a plus) 'pops out' of a display of distractors that lack the attribute (eg Ls). However, those cases may be artifacts of other features such as relative size or number of line terminators. We report two sets of experiments with stimuli intended to control for these factors. Search for the presence or absence of intersections is very inefficient with these stimuli. The results suggest that intersection should not be included among the list of salient features that support efficient search through visual displays.     

Object identification as a function of discriminability and learning presentations: the effect of stimulus similarity and canonical frame alignment on aircraft identification

Aircraft that were relatively similar (homogeneous) and relatively dissimilar (heterogeneous) in appearance were studied at orientations either consistent (canonical) or inconsistent (noncanonical) with the environmental frame of reference. At test, participants' identification performance was measured with stimuli rotated to novel orientations within the picture plane. During learning and testing, identification of heterogeneous aircraft was better than that of homogeneous aircraft. At test, only identification of homogeneous aircraft revealed a strong linear degradation of performance as angular disparity between the novel test orientations and the original learning orientations increased. During learning and testing, identification was better for aircraft studied at canonical orientations than for those studied at noncanonical orientations. The results are discussed in terms of object identification, aircraft recognition training, categorization, mental representations, and visual mental rotation.     

Does partial difficult search help difficult search?

Olds, Cowan, and Jolicoeur (2000a, 2000b) showed that exposure to a display that affords pop-out search a target among distractors of only one color) can assist processing of a related display that requires difficult search. They added distractors of an additional color to the initial simple display and analyzed response time distributions to show that exposure to the initial display aided subsequent search in the difficult portion (this finding was called search assistance). To test whether search assistance depends on perceptual grouping of the initial items, we presented initial items that were more difficult to group (two colors of distractors, instead of just one). The target appeared (on 50% of the trials) among distractors of two colors, and then after a delay, more distractors of those two colors were added to the display. Exposure to the initial easier portion of the display did not assist processing of the second portion of the display when the initial display contained a large number of items; we found tentative evidence for assistance with small numbers of initial items. In the Olds et al. (2000a, 2000b) studies, it was easy to group the initial distractor items, because they were all the same color. In contrast, in the present study, it was difficult to group the heterogeneous initial distractor items. Search assistance is found only when initial item grouping is relatively easy, and thus we conclude that search assistance depends on grouping.     

Developmental trends in utilizing perceptual closure for grouping of shape: effects of spatial proximity and collinearity

In two experiments, visual search was used to study the grouping of shape on the basis of perceptual closure among participants 5-23 years of age. We first showed that young children, like adults, demonstrate an efficient search for a concave target among convex distractors for closed connected stimuli but an inefficient search for open stimuli. Reliable developmental differences, however, were observed in search for fragmented stimuli as a function of spatial proximity and collinearity between the closure-inducing fragments. When only closure was available, search for all the age groups was equally efficient for spatially close fragments and equally inefficient for spatially distant fragments. When closure and collinearity were available, search for spatially close fragments was equally efficient for all the age groups, but search for spatially distant fragments was inefficient for younger children and improved significantly between ages 5 and 10. These findings suggest that young children can utilize closure as efficiently as can adults for the grouping of shape for closed or nearly closed stimuli. When the closure-inducing fragments are spatially distant, only older children and adults, but not 5-year-olds, can utilize collinearity to enhance closure for the perceptual grouping of shape.     

Further evidence for a time-independent shift of the focus of attention

The separation between stimuli was manipulated in a same-different matching task. In Experiment 1, stimuli were upright Ts and/or Ls, whereas in Experiment 2, they were rotated Ts and/or Ls. In both experiments, mean reaction time (RT) for the same-different judgment did not increase as a function of interletter separation, suggesting either that the time needed to relocate attention was independent of distance, or that the stimuli were processed in parallel. These alternatives were tested in a third experiment, with a diagnostic for parallel processing proposed by Egeth and Dagenbach (1991). The diagnostic indicated that the rotated Ts and Ls in Experiment 2 were processed serially. If serial processing implies the utilization of attention, then the results of Experiment 2 suggest that relocation of attention is time-invariant with respect to distance.     

Guidance of eye movements during conjunctive visual search: the distractor-ratio effect.

The distractor-ratio effect refers to the finding that search performance in a conjunctive visual search task depends on the relative frequency of two types or subsets of distractors when the total number of items in a display is fixed. Previously, Shen, Reingold, and Pomplun (2000) examined participants' patterns of eye movements in a distractor-ratio paradigm and demonstrated that on any given trial saccadic endpoints were biased towards the smaller subset of distractors and participants flexibly switched between different subsets across trials. The current study explored the boundary conditions of this tendency to flexibly search through a smaller subset of distractors by examining the influence of several manipulations known to modulate search efficiency, including stimulus discriminability (Experiment 1), within-dimension versus cross-dimension conjunction search and distractor heterogeneity (Experiment 2). The results indicated that the flexibility of visual guidance and saccadic bias exemplified by the distractor-ratio effect is a robust phenomenon that mediates search efficiency by adapting to changes in the relative informativeness of stimulus dimensions and features.     

Local and global factors of similarity in visual search

Effects of the similarity between target and distractors in a visual search task were investigated in several experiments. Both familiar (numerals and letters) and unfamiliar (connected figures in a 5 × 5 matrix) stimuli were used. The observer had to report on the presence or absence of a target among a variable number of homogeneous distractors as fast and as accurately as possible. It was found that physical difference had the same clear effect on processing time far familiar and for unfamiliar stimuli: processing time decreased monotonically with increasing physical difference. Distractors unrelated to the target and those related to the target by a simple transformation (180° rotation, horizontal or vertical reflection) were also compared, while the physical difference was kept constant. For familiar stimuli, transformational relatedness increased processing time in comparison with that fort unrelated stimulus pairs. It was further shown in a scaling experiment that this effect could be accounted for by the amount of perceived similarity of the target-distractor pairs. For unfamiliar stimuli, transformational relatedness did have a smaller and less pronounced effect. Various comparable unrelated distractors resulted in a full range of processing times. Results from a similarity scaling experiment correlated well with the outcome of the experiments with unfamiliar stimuli. These results are interpreted in terms of an underlying continuum of perceived similarity as the basis of the speed of visual search, rather than a dichotomy of parallel versus serial processing.     

Intra- and cross-dimensional visual search for single-feature targets

Cross-dimensional visual search for single-feature targets that differed from the distractors along two dimensions (color and orientation) was compared with intradimensional search for targets that differed from the distractors along a single dimension (either orientation or color). The design of the first three experiments differed from those of previous studies in that participants were required to respond differently to each of the targets. Experiments 1-3 were similar except that in Experiment 1, the distractors were homogeneous; in Experiment 2, two types of distractors were used in equal proportions; and in Experiment 3, two types of distractors were used but one of the distractors was a singleton. The findings, contrary to those of previous studies, revealed that cross-dimensional search is at least as efficient and for some targets even more efficient than intradimensional search. These results suggest that the details of stimulus-to-response mapping are essential in comparing intra- and cross-dimensional tasks. Experiment 4 used a priming design and did not support an explanation based on grouping processes. We outline an explanation for all the findings based on a recent cross-dimensional response selection model by Cohen and Shoup (1997).