Similarity grouping as feature-based selection

Our visual system groups objects with similar features, such as colour, orientation, or shape. We argue that similarity grouping is nothing more than global selection of a certain feature value, such as red, horizontal, or circular. This account makes the striking prediction that only one feature group can be created at a time. Here we provide the most direct evidence yet for this proposal, using a number estimation task that forces simultaneous processing of all objects. Multiple similarity cues failed to produce grouping in this task, in contrast to proximity, connectivity, and common region, which all showed strong grouping effects.     

Perceptual Grouping and Motion Coherence in Visual Search

Search for a conjunction of form and motion is greatly affected by manipulations of phase in the target and nontarget motion sets. To test whether this finding can be best explained by perceptual grouping, we moved a random set of dots in phase or counterphase with target or nontarget motion. Perceptual grouping was found to have a dramatic effect on search performance. We propose that this interaction between perceptual grouping and visual search is governed by three general rules. Our data also provide convincing evidence of the preattentive organization of a visual display into surfaces defined by common motion.     

Effects of similarity on apparent motion and perceptual grouping

Effects of similarity in colour, luminance, size, and shape on apparent motion and perceptual grouping were examined in part 1 in two parallel experiments on the same seven subjects. In both experiments, the effect of similarity was compared with that of proximity in competitive, bistable stimulus situations. A combination of a larger horizontal separation between the homogeneous stimulus elements and a smaller constant vertical separation between heterogeneous stimulus elements produced two kinds of apparent motion (or perceptual grouping) with equal probabilities. Such matched separations between homogeneous stimulus elements were obtained by the double staircase method in various stimulus conditions. In both experiments on apparent motion and perceptual grouping matched separation was found to increase as the difference between the heterogeneous stimulus elements increased. High correlations (0.71 to 0.94) of matched separations were found between apparent motion and perceptual grouping in four stimulus series: colour, luminance, size, and shape. Six of the seven subjects were also tested in part 2. Here, the effects of differences were found to work additively across different perceptual attributes in both phenomena, when multiple differences were combined in heterogeneous elements. The experimental results are discussed from the point of view that apparent motion is an example of perceptual constancy.     

The differentiation of rhythmic structure.

Listeners judged whether two five-tone nonmetric rhythms were the same or different. Each rhythm was presented one, two, or four times to study the process of perceptual differentiation. The results indicated that the listeners perceived these rhythms in terms of the grouping of the tones, and not in terms of the timing between the groups. Two rhythms that had the same perceptual grouping were judged as being identical, even if the timing between the groups was different. The perception of the groupings of tones developed gradually. If each rhythm was presented only once, then the listeners had only a global percept, focused on groups (runs) of three elements, and often judged two different rhythms as being identical. If the rhythms were presented two or four times, then the grouping of the tones became more differentiated and the listeners were less likely to judge different patterns as being identical. Thus, perception of auditory rhythmic structure appears to follow the same developmental process as the perception of visual spatial structure.     

The differentiation of rhythmic structure

Listeners judged whether two five-tone nonmetric rhythms were the same or different. Each rhythm was presented one, two, or four times to study the process of perceptual differentiation. The results indicated that the listeners perceived these rhythms in-terms.of the grouping of the tones, and not in terms of the timing between the groups. Two rhythms that had the same perceptual grouping were judged as being identical, even if the timing between the groups was different. The perception of the groupings of tones developed gradually. If each rhythm was presented only once, then the listeners had only a global percept, focused on groups (runs) of three elements, and often judged two different rhythms as being identical. If the rhythms were presented two or four times, then the grouping of the tones became more differentiated and the listeners were less likely to judge different patterns as being identical. Thus, perception of auditory rhythmic structure appears to follow the same developmental process as the perception of visual spatial structure.     

Effects of perceptual grouping on positive and negative priming

The effects of perceptual grouping/segregation of targets and distractors by means of colour on positive and negative priming were examined in two experiments. In Experiments 1 and 2 we examined whether grouping of target and distractors by means of common colour in the prime display affected positive and negative priming, or whether these effects depend on prime–probe contextual similarity in colour. In addition, we examined the effects of the predictability of target colour in the prime and the probe displays across the experiments using mixed (Experiment 1) or blocked procedures (Experiment 2). The pattern of results was similar in both experiments, indicating that the positive priming effect was determined by target repetition and enhanced by perceptual segregation of target from distractors in the prime display. The negative priming effect was determined by grouping the target and distractors by common colour in the prime display. The results of the present experiments are consistent with inhibition-based models of negative priming.     

Feature saliency affects delayed matching of an attended feature

We examined how top-down attentional modulation and bottom-up stimulus saliency interact with feature memory. Experiment 1 used a delayed-matching-to-sample (DMS) task to examine the relative saliency between features by observing the relative accuracy of recognition at different stimulus durations. Feature salience decreased according to the following order: colour, form, and texture. In a modified DMS task (Experiments 2 and 3), participants were required to attend to one of three features and ignore the others. After a delay, they were required to choose which of the two test stimuli matched the reference stimulus on the attended feature, disregarding other task-irrelevant features. The target was either identical to the reference stimulus or mismatched the reference stimulus on one of the irrelevant features. The results showed that colour matching was affected neither by a form change nor by a texture change. Form matching was affected by a colour change, and texture matching was affected by a colour or form change. These results are consistent with the relative saliency hypothesis. Even when all features of an attended object are maintained, a relatively more salient task-irrelevant feature can interfere with the delayed recognition of a less salient feature.     

Emergent features, attention, and perceptual glue in visual form perception

We examined the grouping of line segments into unitary shapes and attempted to identify procedures to diagnose when such grouping is taking place. Previous research has indicated that attentional measures may diagnose grouping: With grouped parts, selective attention to individual parts is difficult and divided attention across parts is easy, whereas with ungrouped parts selective attention is easy and divided attention is difficult. This result suggests that grouping operates via a perceptual glue binding parts into wholes that are difficult or impossible to divide. Other studies have suggested in addition that grouped parts produce emergent features, possibly including symmetry and closure, that make possible configural superiority effects, where whole shapes are more discriminable than are their distinguishing contours shown in isolation. The 13 experiments reported here indicate that perceptual glue is not needed to explain known findings about grouping, a claim that agrees with conclusions by other investigators using other criteria. Rather, emergent features alone may suffice to explain grouping, provided that reliable and accurate diagnostic criteria can be identified. It is shown that the diagnostics now available are not fully adequate for this purpose. Surprisingly, it appears that some prime candidates for emergent features--namely, closure and line terminators--may not be of central importance to form perception.     

Grouping and short-term memory: Different means and patterns of grouping

Two experiments, concerned with the improving effects of grouping on auditory short-term memory, are described. In the first, temporal grouping was found to improve recall considerably, but non-temporal grouping had a much smaller effect. Temporal grouping reduced the order errors more than other errors; it also changed the pattern of the order errors. Further, it altered the shape of the serial position curve of all errors. In the second experiment, irregular patterns of temporal grouping were found to be inferior to a regular pattern. The results are discussed in terms of the time available for processing previous items during the presentation of a sequence, and the form that this processing may take.     

Visual Marking of Locations and Feature Maps: Evidence from Within-dimension Defined Conjunctions

Recently, Watson and Humphreys (1997, 1998) proposed that the selection of new visual events can be aided by the top-down inhibition of old information-visual marking (VM) and that the mechanisms of marking differ for static and moving stimuli. Stationary stimuli are marked by location-based inhibition, whereas moving stimuli are marked by inhibition applied at the level of whole-feature maps. Here we provide a test of this 'two-mechanism' account. We show that static items can be marked even when old and new stimuli contain the same features and so cannot be distinguished by activation within a unique feature map. However, moving old items could not be marked unless they possessed a unique feature (colour). Manipulations of grouping strength, both within and between distractor sets, did not affect the basic findings. The results support the existence of two mechanisms for VM and counter an object-based inhibition explanation of performance.     

Grouping effects in flash-induced perceptual fading

We show that the flash-induced fading effect can be influenced by grouping based on colour and shape similarity. In flash-induced fading, peripherally presented elements perceptually disappear after a flash has been presented around or next to the element(s) (Kanai and Kamitani, 2003 Journal of Cognitive Neuroscience 15 664-672). In the present study, two elements (which could either be similar or different in both colour and shape) were presented at an eccentricity of 2.6 degrees from a fixation cross. After 2 s, a short flash (40 ms) was presented around one of the elements. The two elements remained on the screen for 2.5 s after the flash. We found a higher percentage of mutual perceptual disappearance when the two elements were similar in colour or in shape. These results converge with other findings showing that perceptual fading phenomena are influenced by effects of perceptual grouping. This indicates that, besides low-level adaptation, more global processes play a part in perceptual fading as well and should thus be taken into account in giving a full explanation of perceptual fading in general.     

Episodic representation of diagnostic and nondiagnostic object colour

In three experiments, we investigated transsaccadic object file representations. In each experiment, participants moved their eyes from a central fixation cross to a saccade target located between two peripheral objects. During the saccade, this preview display was replaced with a target display containing a single object to be named. On trials in which the target identity matched one of the preview objects, its colour either matched or did not match the previewed object colour. The results indicated that colour changes disrupt perceptual continuity, but only for the class of objects for which colour is diagnostic of object identity. When the colour is not integral to identifying an object (for example, when the object is a letter or an object without a characteristic colour), object continuity is preserved regardless of changes to the object's colour. These results suggest that object features that are important for defining the object are incorporated into its episodic representation. Furthermore, the results are consistent with previous work showing that the quality of a feature's representation determines its importance in preserving continuity.     

Developmental trends in the use of perceptual and conceptual attributes in grouping,clustering, and retrieval

In Experiment I, two tasks were administered to children aged 4, 5, and 9 in order to investigate preference for perceptual versus conceptual attributes in grouping of common objects, and in various aspects of memory. The grouping task revealed a clear chronological progression: color and form determined the youngest children's grouping about equally; form dominated in the 5-year-olds; and most of the oldest children grouped primarily by conceptual attributes. In the memory task, three lists—one organized by color, one by form, one by superordinate category—were presented for free, followed by cued recall. Clustering showed the developmental shift from color to form to concept, while cued recall showed conceptual superiority at all ages. Experiment II replicated the memory task, yielding the same results. The results were discussed in terms of the relative abstractness and predictability of conceptual versus perceptual attributes and the difficulty of abstraction in encoding and the function of predictability in retrieval.     

Limitations of perceptual segmentation on contextual cueing in visual search

In visual search, detection of a target in a repeated layout is faster than search within a novel arrangement, demonstrating that contextual invariances can implicitly guide attention to the target location (“contextual cueing”; Chun & Jiang, 1998). Here, we investigated how display segmentation processes influence contextual cueing. Seven experiments showed that grouping by colour and by size can considerably reduce contextual cueing. However, selectively attending to a relevant subgroup of items (that contains the target) preserved context-based learning effects. Finally, the reduction of contextual cueing by means of grouping affected both the latent learning and the recall of display layouts. In sum, all experiments show an influence of grouping on contextual cueing. This influence is larger for variations of spatial (as compared to surface) features and is consistent with the view that learning of contextual relations critically interferes with processes that segment a display into segregated groups of items.     

Object property encoding and change blindness in multiple object tracking

The paradigm of multiple object tracking (MOT) is an established tool for investigating human performance under conditions of divided attention to several objects. We studied change detection ability for colour and shape information in the setting of MOT. Subjects had to detect colour and shape changes during an MOT task. These changes occurred either openly (with nothing to hide them) or with a mud splash in the background to hide the change transient signal. Our experiment demonstrated that (1) when hidden by mud splashes, we fail to perceive a considerable number of colour changes even in the attended objects (i.e., targets) and (2) the visual system is significantly more likely to miss colour and shape changes in distractors than in target. We conclude that a colour change will be detected a lot more efficiently if attention is drawn to its transient. When a simultaneous mud splash hides the transient signal, subjects are significantly less efficient in detecting the change.     

Between-object binding and visual attention

Many previous studies have found that we can attend pairs of visual features (e.g., colour, orientation) more efficiently when they belong to the same “object” compared to when they belong to separate, neighbouring objects (e.g., Behrmann, Zemel, & Mozer, 1998; Egly, Rafal, & Driver, 1994). This advantage for attending features from the same object may reflect stronger binding between these features than arises for pairs of features belonging to separate objects. However, recent findings described by Davis, Welch, Holmes, and Shepherd (in press) suggest that under specific conditions this same-object advantage can be reversed, such that attention now spreads more readily between features belonging to separate neighbouring objects than between features of the same object. In such cases it would appear that features belonging to separate visual objects are more strongly bound than features of the same object. Here I review these findings and present the results of a new study. Together these data suggest that magnocellular processes in the human visual system bind together features from separate objects, whereas parvocellular processes bind together features from the same object.     

Importing perceived features into false memories

False memories sometimes contain specific details, such as location or colour, about events that never occurred. Based on the source-monitoring framework, we investigated one process by which false memories acquire details: the reactivation and misattribution of feature information from memories of similar perceived events. In Experiments 1A and 1B, when imagined objects were falsely remembered as seen, participants often reported that the objects had appeared in locations where visually or conceptually similar objects, respectively, had actually appeared. Experiment 2 indicated that colour and shape features of seen objects were misattributed to false memories of imagined objects. Experiment 3 showed that perceived details were misattributed to false memories of objects that had not been explicitly imagined. False memories that imported perceived features, compared to those that presumably did not, were subjectively more like memories for perceived events. Thus, perception may be even more pernicious than imagination in contributing to false memories.     

Importing perceived features into false memories

False memories sometimes contain specific details, such as location or colour, about events that never occurred. Based on the source-monitoring framework, we investigated one process by which false memories acquire details: the reactivation and misattribution of feature information from memories of similar perceived events. In Experiments 1A and 1B, when imagined objects were falsely remembered as seen, participants often reported that the objects had appeared in locations where visually or conceptually similar objects, respectively, had actually appeared. Experiment 2 indicated that colour and shape features of seen objects were misattributed to false memories of imagined objects. Experiment 3 showed that perceived details were misattributed to false memories of objects that had not been explicitly imagined. False memories that imported perceived features, compared to those that presumably did not, were subjectively more like memories for perceived events. Thus, perception may be even more pernicious than imagination in contributing to false memories.     

Colour correspondence effects between controlled objects and targets

It is increasingly popular to use movement trajectories as a measure of mental processes related to task performance. Often this is accomplished by moving a cursor to a target on a computer screen. However, the relation between features of the cursor and the targets is rarely, if at all, considered. In five experiments, we examined whether moving a cursor to a target was affected by the relation between their colours, even when this relation was task irrelevant. In Experiments 1–3, a mouse-controlled cursor was moved to one of two coloured targets. Results showed colour correspondence effects in latency to initiate a response, duration of movement times, and movement trajectories when the relationship between cursor and target colours was task relevant (Experiment 1) and when only the cursor colour was task relevant (Experiment 2), but not when only the target was task relevant (Experiment 3). Follow-up experiments using single targets showed that colour correspondence effects occurred as long as attention was dedicated to the colour of the cursor, even when neither the cursor nor the target colour was relevant to selecting the correct movement (Experiments 4 and 5). Furthermore, when the relation between cursor and target colours is task irrelevant, colour correspondence effects for response initiation times are uncorrelated with those for movement times and movement trajectories. We interpret the observed correspondence effect in terms of response coding, although attention cueing may also play a role, and suggest that greater consideration of cursor features is needed when examining movement trajectories in choice reaction tasks.     

Colour correspondence effects between controlled objects and targets

It is increasingly popular to use movement trajectories as a measure of mental processes related to task performance. Often this is accomplished by moving a cursor to a target on a computer screen. However, the relation between features of the cursor and the targets is rarely, if at all, considered. In five experiments, we examined whether moving a cursor to a target was affected by the relation between their colours, even when this relation was task irrelevant. In Experiments 1-3, a mouse-controlled cursor was moved to one of two coloured targets. Results showed colour correspondence effects in latency to initiate a response, duration of movement times, and movement trajectories when the relationship between cursor and target colours was task relevant (Experiment 1) and when only the cursor colour was task relevant (Experiment 2), but not when only the target was task relevant (Experiment 3). Follow-up experiments using single targets showed that colour correspondence effects occurred as long as attention was dedicated to the colour of the cursor, even when neither the cursor nor the target colour was relevant to selecting the correct movement (Experiments 4 and 5). Furthermore, when the relation between cursor and target colours is task irrelevant, colour correspondence effects for response initiation times are uncorrelated with those for movement times and movement trajectories. We interpret the observed correspondence effect in terms of response coding, although attention cueing may also play a role, and suggest that greater consideration of cursor features is needed when examining movement trajectories in choice reaction tasks.