Parallel pattern processing and visual agnosia.

A series of visual search experiments are reported examining pattern processing in a visual agnosic patient. We examined search for targets defined by: (I) the combination of their features relative to homogeneous distractors; (2) the combination of their features relative to heterogeneous distractors; and (3) a single feature difference relative to the distractors (their orientation). Normal subjects demonstrate evidence of spatially parallel search when combined-feature targets are detected against homogeneous distractors, and when targets are defined by a salient feature difference. There are non-linear effects of the number of distractors present, and absent responses can be as fast as present. In contrast, search times for combined-feature targets amongst heterogeneous distractors increase linearly with display size, with the slope for absent responses about twice that for present. The contrast between search for combined-feature targets amongst homogeneous and heterogeneous distractors can be attributed to the effects of grouping between distractors and between distractors and targets (Duncan & Humphreys, 1989, 1992; Humphreys & Muller, in press). Grouping between homogeneous distractors facilitates search. An agnosic patient, HJA, showed normal search functions for single-feature targets and for combined-feature targets amongst heterogeneous distractors. However, he was impaired at search for combined-feature targets amongst homogeneous distractors. This suggests that HJA is selectively impaired at grouping conjunctions of form features. The relations between HJA's agnosia and his problem in the parallel grouping of form conjunctions are discussed, as are the implications of the work for understanding normal vision.     

Stimulus-specific dynamics of learning in conjunction search tasks

We investigated the time course of learning in visual search for within-dimension conjunctions in homogeneous (inverted V in Vs) or heterogeneous distractors (L in 90° counterclockwise-rotated Ls and 180° rotated Ls), and for across-dimension conjunctions search (green\in green/s and red\s). Two learning sessions of 10 and 5 blocks each took place three months apart. In the first session, the reduction in mean search time was greater for within-dimension conjunctions with heterogeneous distractors. Learning endured from one session to the other for all stimuli, suggesting that learning can be long-term in search for feature conjunctions. However, when the positional regularity between elements was perturbed, the effect of prior learning was reduced for homogeneous within-dimension conjunctions. This suggests that, for these stimuli, learning facilitates grouping by positional regularity. Finally, the learning effect with homogeneous withindimension conjunctions disappeared when both target and distractors were rotated to modify the orientation of conjunction patterns. This suggests that learning improves a grouping mechanism selective for the relative orientations of combined form features.     

Target objects defined by a conjunction of colour and shape can be selected independently and in parallel

It is generally assumed that during search for targets defined by a feature conjunction, attention is allocated sequentially to individual objects. We tested this hypothesis by tracking the time course of attentional processing biases with the N2pc component in tasks where observers searched for two targets defined by a colour/shape conjunction. In Experiment 1, two displays presented in rapid succession (100 ms or 10 ms SOA) each contained a target and a colour-matching or shape-matching distractor on opposite sides. Target objects in both displays elicited N2pc components of similar size that overlapped in time when the SOA was 10 ms, suggesting that attention was allocated in parallel to both targets. Analogous results were found in Experiment 2, where targets and partially matching distractors were both accompanied by an object without target-matching features. Colour-matching and shape-matching distractors also elicited N2pc components, and the target N2pc was initially identical to the sum of the two distractor N2pcs, suggesting that the initial phase of attentional object selection was guided independently by feature templates for target colour and shape. Beyond 230 ms after display onset, the target N2pc became superadditive, indicating that attentional selection processes now started to be sensitive to the presence of feature conjunctions. Results show that independent attentional selection processes can be activated in parallel by two target objects in situations where these objects are defined by a feature conjunction.     

Integration of local features as a function of global goodness and spacing

In two experiments, the accuracy with which subjects detected a conjunction of features was examined as a function of the spacing between items and the goodness of the axis along which they were located. In each array, two items were arranged along a vertical, a horizontal, or a diagonal axis. Based on the well-established oblique effect, the vertical and horizontal axes were considered to be good global patterns and the diagonals were considered to be poor. In Experiment 1, the two items in an array could be two horizontal lines, two vertical lines, a vertical and a horizontal line, or a plus sign with one of the single lines. In Experiment 2, a positive- and a negative-diagonal line were used as the individual features, and an "X" was used as the conjunction. The results from Experiment 1 indicated that global goodness influenced only the rate of illusory conjunctions, and not of feature errors. Illusory conjunctions of vertical and horizontal line segments were more likely to occur in vertical and horizontal arrangements. The results from Experiment 2 revealed a reversal of the effect of global goodness on the rate of illusory conjunctions: Illusory conjunctions of negative- and positive-diagonal line segments were more likely to occur in diagonal arrangements. The results of both experiments taken together showed the existence of an important and new factor that influences the likelihood that features of shape will be conjoined: the ease with which line segments conjoin when they are translated along their extent toward each other. In both experiments, greater spacing between items produced more feature-identification errors and fewer feature-integration errors than did less spacing.     

Guided search: an alternative to the feature integration model for visual search

Subjects searched sets of items for targets defined by conjunctions of color and form, color and orientation, or color and size. Set size was varied and reaction times (RT) were measured. For many unpracticed subjects, the slopes of the resulting RT X Set Size functions are too shallow to be consistent with Treisman's feature integration model, which proposes serial, self-terminating search for conjunctions. Searches for triple conjunctions (Color X Size X Form) are easier than searches for standard conjunctions and can be independent of set size. A guided search model similar to Hoffman's (1979) two-stage model can account for these data. In the model, parallel processes use information about simple features to guide attention in the search for conjunctions. Triple conjunctions are found more efficiently than standard conjunctions because three parallel processes can guide attention more effectively than two.     

“Transient structures”: The effects of practice and distractor grouping on within-dimension conjunction searches

It has been stated that whereas between-dimension (color × orientation) conjunctions can be searched in a “parallel” fashion, within-dimension (color × color) conjunctions are necessarily searched in a “serial self-terminating” fashion (Wolfe et al., 1990). We explored the effects of practice (within 1-h experimental session) and distractor grouping on within-dimension conjunction search tasks. In Experiments 1 and 3, the stimuli were rectangles formed by two adjacent squares; in Experiment 2, the stimuli were plus signs formed by two segments and an intersection. In Experiments 1 and 2, observers were assigned to one of two experimental conditions: In one, all the distractors shared a simple feature (the color blue); in the other, distractors did not share that simple feature. In the first condition, search became more efficient with practice and observers’ performance was characterized by a shallow reaction time (RT) × set size slope; in the second condition, observers’ performance did not improve as much with practice. We propose that the differential effects of practice between these two experimental conditions can be explained in terms of distractor grouping induced by the shared color of the distractors. Experiment 3 showed that, with practice, a shallow RT × set size slope characterized observers’ search for a color × color target among four different distractors that shared a common color. The present results contradict a main tenet of some current visual search models— namely, that within-dimension conjunctions cannot be searched in parallel, and question the validity of using RT × set size slope functions to distinguish between preattentive versus attentive search.     

The return of object-based attention: selection of multiple-region objects

Objects can control the focus of attention, allowing features on the same object to be selected more easily than features on different objects. In the present experiments, we investigated the perceptual processes that contribute to such object-based attentional effects. Previous research has demonstrated that object-based effects occur for single-region objects but not for multiple-region objects under some conditions (Experiment 1, Watson & Kramer, 1999). Such results are surprising, because most objects in natural scenes are composed of multiple regions. Previous findings could therefore limit the usefulness of an object-based selection mechanism. We explored the generality of these single-region selection results by manipulating the extent to which different (i.e., multiple) regions of a single object perceptually grouped together. Object-based attentional effects were attenuated when multiple regions did not group into a single perceptual object (Experiment 1). However, when multiple regions grouped together based on (1) edge continuation (Experiments 2 and 3) or (2) part and occlusion cues (Experiment 4), we observed object-based effects. Our results suggest that object-based attention is a robust process that can select multiple-region objects, provided the regions of such objects cohere on the basis of perceptual grouping cues.     

Effect of feature similarity on illusory conjunctions

In four experiments, we examined whether the phenomenon of illusory conjunctions is constrained by feature similarity. Specifically, are illusory conjunctions more likely to occur between items with similar features than between items with dissimilar features? Feature similarity was manipulated in two dimensions: color and shape. Experiment 1 demonstrated that more illusory conjunctions occur between items with similar colors than between items with dissimilar colors. A similar effect was found for letter similarity in Experiment 2. Experiments 3 and 4 demonstrated that the similarity effect is still obtained for illusory conjunctions even when identification of the relevant features is near perfect. These findings introduce a new constraint in the process of feature integration. Additional implications of the similarity constraint for theories of feature integration are discussed.     

Emergent features, attention, and object perception

The perceptual processing of arrows and triangles and of their component angles and lines was explored in a number of different tasks. The results suggest that some analysis of shapes into simpler parts occurs preattentively, because these parts can recombine to form illusory conjunctions when attention is divided. The presence of "emergent features," such as closure or arrow junctions, was inferred from predicted correlations in the pattern of performance across tasks and across individual subjects. Thus triangles (for most subjects) and arrows (for some subjects) behave as if they had a perceptual feature that is absent from their parts and that mediates parallel detection in search and easy texture segregation. For some subjects, circles could apparently supply the additional feature (presumably closure) required to form illusory triangles from their component lines, whereas for other subjects circles had no effect. The fact that triangle lines can form illusory conjunctions with another shape makes it unlikely that triangles are perceived holistically and strengthens the interpretation that relies on emergent features.     

Search for a category target in clutter

An airport security worker searching a suitcase for a weapon is engaging in an especially difficult search task: the target is not well-specified, it is not salient, and it is not predicted by its context. Under these conditions, search may proceed item-by-item. In the experiment reported here we tested whether the items for this form of search are whole familiar objects. Our displays were composed of color photographs of ordinary objects, that were either uniform in color and texture (simple), or had two or more parts with different colors or textures (compound). The observer's task was to detect the presence of a target belonging to a broad category (food). We found that when the objects were presented in a sparse array, search times to find the target were similar for displays composed of simple and compound objects. But when the same objects were presented as dense clutter, search functions were steeper for displays composed of compound objects. We attribute this difference to the difficulty of segmenting compound objects in clutter: compared with simple objects, compound objects are less likely to be organized into a single object by bottom--up grouping processes. Our results indicate that while search rates in a sparse display may be determined by the number of objects, search rates in clutter are also affected by the number of object parts.     

Visual search: spatial frequency and orientation

Observers searched for a Gaussian-windowed patch of sinewave grating (Gabor pattern) through displays containing varying numbers of other such patterns (distractors). When the spatial frequencies of target and distractors differed by +/- 2 octaves and their orientations by +/- 60 degrees, the search proceeded spatially in parallel irrespective of whether the target could be discriminated in terms of spatial frequency differences alone, orientation differences alone, or their combination. However, when target and distractors differed by only +/- .5 octave in spatial frequency and by +/- 15 degrees in orientation, the search was serial and self-terminating, again irrespective of the nature of the target-distractor differences. These findings show that, contrary to some suggestions, the preattentive detection of targets defined by conjunctions of spatial frequency and orientation may occur, but only when the spectral distance between target and distractors allows their encoding by independent mechanisms.     

Incremental grouping of image elements in vision

One important task for the visual system is to group image elements that belong to an object and to segregate them from other objects and the background. We here present an incremental grouping theory (IGT) that addresses the role of object-based attention in perceptual grouping at a psychological level and, at the same time, outlines the mechanisms for grouping at the neurophysiological level. The IGT proposes that there are two processes for perceptual grouping. The first process is base grouping and relies on neurons that are tuned to feature conjunctions. Base grouping is fast and occurs in parallel across the visual scene, but not all possible feature conjunctions can be coded as base groupings. If there are no neurons tuned to the relevant feature conjunctions, a second process called incremental grouping comes into play. Incremental grouping is a time-consuming and capacity-limited process that requires the gradual spread of enhanced neuronal activity across the representation of an object in the visual cortex. The spread of enhanced neuronal activity corresponds to the labeling of image elements with object-based attention.     

Automatic guidance of visual attention from verbal working memory

Previous studies have shown that visual attention can be captured by stimuli matching the contents of working memory (WM). Here, the authors assessed the nature of the representation that mediates the guidance of visual attention from WM. Observers were presented with either verbal or visual primes (to hold in memory, Experiment 1; to verbalize, Experiment 2; or merely to attend, Experiment 3) and subsequently were required to search for a target among different distractors, each embedded within a colored shape. In half of the trials, an object in the search array matched the prime, but this object never contained the target. Despite this, search was impaired relative to a neutral baseline in which the prime and search displays did not match. An interesting finding is that verbal primes were effective in generating the effects, and verbalization of visual primes elicited similar effects to those elicited when primes were held in WM. However, the effects were absent when primes were only attended. The data suggest that there is automatic encoding into WM when items are verbalized and that verbal as well as visual WM can guide visual attention.     

Parallel and competitive processes in hierarchical analysis: perceptual grouping and encoding of closure.

The role of perceptual grouping and the encoding of closure of local elements in the processing of hierarchical patterns was studied. Experiments 1 and 2 showed a global advantage over the local level for 2 tasks involving the discrimination of orientation and closure, but there was a local advantage for the closure discrimination task relative to the orientation discrimination task. Experiment 3 showed a local precedence effect for the closure discrimination task when local element grouping was weakened by embedding the stimuli from Experiment 1 in a background made up of cross patterns. Experiments 4A and 4B found that dissimilarity of closure between the local elements of hierarchical stimuli and the background figures could facilitate the grouping of closed local elements and enhanced the perception of global structure. Experiment 5 showed that the advantage for detecting the closure of local elements in hierarchical analysis also held under divided- and selective-attention conditions. Results are consistent with the idea that grouping between local elements takes place in parallel and competes with the computation of closure of local elements in determining the selection between global and local levels of hierarchical patterns for response.     

Visual search for direction of shading is influenced by apparent depth.

Recent reports of rapid visual search for some feature conjunctions suggested that preattentive vision might be sensitive to scene-based as well as to image-based features (Enns & Rensink, 1990a, 1990b). This study examined visual search for targets defined by the direction of a luminance gradient, a conjunction of luminance and relative location that often corresponds to object curvature and direction of lighting in naturalistic scenes. Experiment 1 showed that such search is influenced by several factors, including the type of gradient, the shape of the contour enclosing the gradient, and the background luminance. These factors were varied systematically in Experiment 2 in a three-dimensionality rating task and in a visual-search task. The factors combined interactively in the rating task, supporting the presence of an emergent property of three-dimensionality. In contrast, each factor contributed only additively to the speed of the visual-search task. This is inconsistent with the view that search is guided by specialized detectors for surface curvature or direction of lighting. Rather, it is in keeping with the view that search is governed by a number of "quick and dirty" processes that are implemented rapidly and in parallel across the visual field.     

Visual search at different spatial scales

Treisman and Gelade's (1980) feature-integration model claims that the search for separate ("primitive") stimulus features is parallel, but that the conjunctions of those features require serial scan. Recently, evidence has accumulated that parallel processing is not limited to these "primitive" stimulus features, but that combinations of features can also produce parallel search. In the experiments reported here, the processing of feature conjunctions was studied when the stimulus features of a combination were at different spatial scales. The patterns in the search array were composed of three cross-shaped or T-shaped (local) elements, which formed an oblique bar (the global pattern) 45 deg or 135 deg in orientation. When the target and distractors differed from each other at one spatial scale only (either in the bar orientation or in the shape of the local elements), target detection was independent of the number of distractors, i.e., the search was parallel. In the conjunction task, in which the target and distractors were defined as the combinations of the bar orientation and the element shape, i.e., both spatial scales were relevant, the detection of the target required slow serial scrutiny of the search array. It is possible that the conjunction search could not be performed in parallel because switches between the two scales (or spatial frequency channels) are linked to attention and the task required the use of both scales in order to find the target.     

Color search and visual field segregation

Visual search for targets that combine color and shape features that are shared by distracting items can be conducted spatially in parallel. Experimental results show that parallel search for color/shape conjunctions is possible when the shapes chosen let observers segregate the spatially interspersed items into figure and ground and when, within the figure, the target differs from other items by a distinguishing color feature. Results of experiments that manipulate stimulus color suggest that adaptive mechanisms of color discrimination are used to detect targets within such a figure.     

The use of occlusion to resolve ambiguity in parallel projections

Previous research has shown that the three-dimensional structure of an object usually can be perceived when viewing a parallel projection of the object rotating in depth. Accurate judgments of direction of rotation, however, have been found only with polar projections. The present study demonstrated that accurate direction judgments can occur with parallel projections if occlusion is included in the displays. The stimuli were parallel projections of pentagonal texture elements on the surface of a rotating sphere. In one condition, the elements were occluded as they rounded the edge of an opaque sphere. In another condition, elements on the far surface of a transparent sphere were occluded by elements on the near surface. Accuracy of direction judgments was consistently high in the first condition and increased monotonically with element size in the second condition, from chance to over 80% correct. The relationship of these results to the general issue of perceptually combining structure in depth information from one source with relative distance information from another source is discussed.