Perceptual grouping in space and time: Evidence from the Ternus display

We report three experiments investigating the effect of perceptual grouping on the appearance of a bistable apparent-motion (Ternus) display. Subjects viewed a Ternus display embedded in an array of context elements that could potentially group with the Ternus elements. In contrast to several previous findings, we found that grouping influenced apparent motion perception. In Experiment 1, apparent motion perception was significantly affected via grouping by shape similarity, even when the visible persistence of the elements was controlled. In Experiment 2, elements perceived as moving without context were perceived as stationary when grouped with stationary context elements. In Experiment 3, elements perceived as stationary without context were perceived as moving when grouped with moving context elements. We argue that grouping in the spatial and temporal domains interact to yield perceptual experience of apparent-motion displays.     

Grouping effects in flash-induced perceptual fading

We show that the flash-induced fading effect can be influenced by grouping based on colour and shape similarity. In flash-induced fading, peripherally presented elements perceptually disappear after a flash has been presented around or next to the element(s) (Kanai and Kamitani, 2003 Journal of Cognitive Neuroscience 15 664-672). In the present study, two elements (which could either be similar or different in both colour and shape) were presented at an eccentricity of 2.6 degrees from a fixation cross. After 2 s, a short flash (40 ms) was presented around one of the elements. The two elements remained on the screen for 2.5 s after the flash. We found a higher percentage of mutual perceptual disappearance when the two elements were similar in colour or in shape. These results converge with other findings showing that perceptual fading phenomena are influenced by effects of perceptual grouping. This indicates that, besides low-level adaptation, more global processes play a part in perceptual fading as well and should thus be taken into account in giving a full explanation of perceptual fading in general.     

Visual training improves perceptual grouping based on basic stimulus features

Training on visual tasks improves performance on basic and higher order visual capacities. Such improvement has been linked to changes in connectivity among mediating neurons. We investigated whether training effects occur for perceptual grouping. It was hypothesized that repeated engagement of integration mechanisms would enhance grouping processes. Thirty-six participants underwent 15 sessions of training on a visual discrimination task that required perceptual grouping. Participants viewed 20?×?20 arrays of dots or Gabor patches and indicated whether the array appeared grouped as vertical or horizontal lines. Across trials stimuli became progressively disorganized, contingent upon successful discrimination. Four visual dimensions were examined, in which grouping was based on similarity in luminance, color, orientation, and motion. Psychophysical thresholds of grouping were assessed before and after training. Results indicate that performance in all four dimensions improved with training. Training on a control condition, which paralleled the discrimination task but without a grouping component, produced no improvement. In addition, training on only the luminance and orientation dimensions improved performance for those conditions as well as for grouping by color, on which training had not occurred. However, improvement from partial training did not generalize to motion. Results demonstrate that a training protocol emphasizing stimulus integration enhanced perceptual grouping. Results suggest that neural mechanisms mediating grouping by common luminance and/or orientation contribute to those mediating grouping by color but do not share resources for grouping by common motion. Results are consistent with theories of perceptual learning emphasizing plasticity in early visual processing regions.     

On the perception of shape from shading

The extraction of three-dimensional shape from shading is one of the most perceptually compelling, yet poorly understood, aspects of visual perception. In this paper, we report several new experiments on the manner in which the perception of shape from shading interacts with other visual processes such as perceptual grouping, preattentive search (“pop-out”), and motion perception. Our specific findings are as follows: (1) The extraction of shape from shading information incorporates at least two “assumptions” or constraints—first,that there is a single light source illuminating the whole scene, and second, that the light is shining from “above” in relation to retinal coordinates. (2) Tokens defined by shading can serve as a basis for perceptual grouping and segregation. (3) Reaction time for detecting a single convex shape does not increase with the number of items in the display. This “pop-out” effect must be based on shading rather than on differences in luminance polarity, since neither left-right differences nor step changes in luminance resulted in pop-out. (4) When the subjects were experienced, there were no search asymmetries for convex as opposed to concave tokens, but when the subjects were naive, cavities were much easier to detect than convex shapes. (5) The extraction of shape from shading can also provide an input to motion perception. And finally, (6) the assumption of “overhead illumination” that leads to perceptual grouping depends primarily on retinal rather than on “phenomenal” or gravitational coordinates. Taken collectively, these findings imply that the extraction of shape from shading is an “early” visual process that occurs prior to perceptual grouping, motion perception, and vestibular (as well as “cognitive”) correction for head tilt. Hence, there may be neural elements very early in visual processing that are specialized for the extraction of shape from shading.     

On the perception of shape from shading.

The extraction of three-dimensional shape from shading is one of the most perceptually compelling, yet poorly understood, aspects of visual perception. In this paper, we report several new experiments on the manner in which the perception of shape from shading interacts with other visual processes such as perceptual grouping, preattentive search ("pop-out"), and motion perception. Our specific findings are as follows: (1) The extraction of shape from shading information incorporates at least two "assumptions" or constraints--first, that there is a single light source illuminating the whole scene, and second, that the light is shining from "above" in relation to retinal coordinates. (2) Tokens defined by shading can serve as a basis for perceptual grouping and segregation. (3) Reaction time for detecting a single convex shape does not increase with the number of items in the display. This "pop-out" effect must be based on shading rather than on differences in luminance polarity, since neither left-right differences nor step changes in luminance resulted in pop-out. (4) When the subjects were experienced, there were no search asymmetries for convex as opposed to concave tokens, but when the subjects were naive, cavities were much easier to detect than convex shapes. (5) The extraction of shape from shading can also provide an input to motion perception. And finally, (6) the assumption of "overhead illumination" that leads to perceptual grouping depends primarily on retinal rather than on "phenomenal" or gravitational coordinates. Taken collectively, these findings imply that the extraction of shape from shading is an "early" visual process that occurs prior to perceptual grouping, motion perception, and vestibular (as well as "cognitive") correction for head tilt. Hence, there may be neural elements very early in visual processing that are specialized for the extraction of shape from shading.     

Grouping based on phenomenal similarity of achromatic color.

It is widely acknowledged that a precondition for the perception of the world of objects and events is an early process of organization, and it has generally been assumed that such organization is based on the Gestalt laws of grouping. However, the stage at which such grouping occurs, whether early or late, is an empirical question. It is demonstrated in two experiments that grouping by similarity of neutral color is based not on similarity of absolute luminance at the level of the proximal stimulus, but on phenomenal similarity of lightness resulting from the achievement of lightness constancy. An alternative explanation of such grouping based on the equivalence of luminance ratios between elements and background is ruled out by appropriate control conditions.     

Perceptual grouping and distance estimates in typical and atypical development: comparing performance across perception, drawing and construction tasks

Perceptual grouping is a pre-attentive process which serves to group local elements into global wholes, based on shared properties. One effect of perceptual grouping is to distort the ability to estimate the distance between two elements. In this study, biases in distance estimates, caused by four types of perceptual grouping, were measured across three tasks, a perception, a drawing and a construction task in both typical development (TD: Experiment 1) and in individuals with Williams syndrome (WS: Experiment 2). In Experiment 1, perceptual grouping distorted distance estimates across all three tasks. Interestingly, the effect of grouping by luminance was in the opposite direction to the effects of the remaining grouping types. We relate this to differences in the ability to inhibit perceptual grouping effects on distance estimates. Additive distorting influences were also observed in the drawing and the construction task, which are explained in terms of the points of reference employed in each task. Experiment 2 demonstrated that the above distortion effects are also observed in WS. Given the known deficit in the ability to use perceptual grouping in WS, this suggests a dissociation between the pre-attentive influence of and the attentive deployment of perceptual grouping in WS. The typical distortion in relation to drawing and construction points towards the presence of some typical location coding strategies in WS. The performance of the WS group differed from the TD participants on two counts. First, the pattern of overall distance estimates (averaged across interior and exterior distances) across the four perceptual grouping types, differed between groups. Second, the distorting influence of perceptual grouping was strongest for grouping by shape similarity in WS, which contrasts to a strength in grouping by proximity observed in the TD participants.     

Late influences on perceptual grouping: Amodal completion

Perceptual grouping is generally assumed to be an early visual process that operates on a previously unorganized image-based representation. The present experiment shows that elements perceived as occluded by a closer surface tend to be grouped with elements having the same shape as the amodally completed percept rather than with those having the same retinal shape as the incomplete stimulus. It is therefore concluded that perceptual grouping by shape similarity either occurs after amodal completion or is a temporally extended process that occurs both before and after it.     

Integration of perceptual information in word access

According to experiential theories of language comprehension, perceptual information plays an essential role when word meanings are accessed. We conducted four experiments to investigate how different types of perceptual information such as colour and shape are combined during word access. One possibility is that the colour and shape of a word's referent are activated independently from one another and are combined in an additive manner. Alternatively, words might activate perceptual representations via a multiplicative integration of colour and shape. Experiment 1 established that participants follow a multiplicative similarity rule when they judge the similarity of schematic pictures to actual fruits and vegetables. In Experiments 2 to 4, participants performed a classification task, a lexical decision task, or a word-naming task on names of fruits and vegetables that were superimposed on a background picture. Responses were facilitated only when both colour and shape of the picture matched the word's referents. Response times were associated negatively with mean similarity ratings and the consistency of these ratings obtained in the first experiment. These results suggest a multiplicative integration of different types of perceptual information during word access.     

Combined effects of perceptual grouping cues on object representation: Evidence from motion-induced blindness

We investigated the combined effects of perceptual grouping cues (proximity and contour closure/proximity and orientation similarity) on object representation, using motion-induced blindness, a phenomenon in which salient visual stimuli perceptually disappear when surrounded by moving patterns. We presented as visual targets two stimuli in which a solid square was embedded in an outlined square. Participants reported whether the targets disappeared independently or simultaneously. The results showed that a relatively high proximity cue (with a 0.2-deg separation between the targets) modulated the perceptions of the independent or simultaneous disappearances of targets, regardless of other grouping cues. The contour closure cue modulated these disappearances in the 0.4- to 0.8-deg separations. Finally, the orientation similarity cue began to modulate these disappearances in the 0.6- to 0.8-deg separations. We suggest that the separation between the visual stimuli modulates the combined effects of perceptual grouping cues on complete object representation.     

Dynamic grouping and interpolation induced by flickering stimuli

A novel grouping and interpolation effect induced by flickering stimuli is described: a matrix of flickering elements forms stick-like clusters, then the clusters gradually dissociate back into the discrete elements within a few seconds. On continuous viewing, this flicker-induced grouping and interpolation repeatedly disappeared and reappeared. The perceived strength of this phenomenon peaked when the luminance of the flickering elements was alternately darker and lighter than the background; thus, the reversal of the luminance contrast polarity was responsible for flicker-induced grouping. The temporal dynamics of flicker-induced grouping showed the stochastic nature of perceptual alternation, which depended on the global structure of the stimulus. From these results, it is concluded that flicker-induced grouping reflects multiple stages of visual processing.     

Visual grouping by motion precedes the relative localization between moving and flashed stimuli

A flashed stimulus is perceived as spatially lagging behind a moving stimulus when they are spatially aligned. When several elements are perceptually grouped into a unitary moving object, a flash presented at the leading edge of the moving stimulus suffers a larger spatial lag than a flash presented at the trailing edge (K. Watanabe. R. Nijhawan. B. Khurana, & S. Shimojo. 2001). By manipulation of the flash onset relative to the motion onset, the present study investigated the order of perceptual operations of visual motion grouping and relative visual localization. It was found that the asymmetric mislocalization was observed irrespective of physical and/or perceptual temporal order between the motion and flash onsets. Thus, grouping by motion must be completed to define the leading-trailing relation in a moving object before the visual system explicitly represents the relative positions of moving and flashed stimuli.     

Amodal completion is modulated by lightness similarity

The strength of amodal completion is known to be modulated by contour relationships and global shape. Some researchers have shown that amodal completion also depends on surface similarity, but they have not distinguished the relative importance of similarity in surface representations either pre or post lightness constancy. In the experiments reported here, we aimed to determine whether amodal completion depends on processes that occur either before or after the establishment of lightness constancy. We used computer rendering techniques to vary the consistency of a cast shadow with a decrement in luminance on one side of a partially occluded surface. We found that perceived completion depended on the consistency of the decrement in surface luminance with the orientation of a cast shadow (Exp.?1). In Experiment ?2, we generated occluded surface fragments that could be either luminance-matched or lightness-matched to surface fragments on the opposite side of the occluder, and we found that the strength of amodal completion depended primarily on similarity in the perceived surface reflectance. In Experiments 3 and 4, we performed apparent-motion tasks to obtain converging evidence for grouping on the basis of perceived similarity in lightness. We found that matching surfaces in lightness significantly improved the apparent motion of surfaces behind an occluder, as compared with surfaces that were matched in contrast alone. These results suggest that amodal completion depends on the perceived similarity in lightness of partially occluded surface fragments.     

Effects of perceptual grouping on positive and negative priming

The effects of perceptual grouping/segregation of targets and distractors by means of colour on positive and negative priming were examined in two experiments. In Experiments 1 and 2 we examined whether grouping of target and distractors by means of common colour in the prime display affected positive and negative priming, or whether these effects depend on prime–probe contextual similarity in colour. In addition, we examined the effects of the predictability of target colour in the prime and the probe displays across the experiments using mixed (Experiment 1) or blocked procedures (Experiment 2). The pattern of results was similar in both experiments, indicating that the positive priming effect was determined by target repetition and enhanced by perceptual segregation of target from distractors in the prime display. The negative priming effect was determined by grouping the target and distractors by common colour in the prime display. The results of the present experiments are consistent with inhibition-based models of negative priming.     

Perceptual grouping between successively presented stimuli and its relation to visual simultaneity and masking

Summary A 4×4 matrix of dots was presented by a tachistoscope. The first and the third columns of the stimulus pattern were presented first for 20 ms and then the second and the fourth columns were presented for 20 ms with SOAs of 0 to 170 ms. Luminous dots on a dark background, black dots on a white background, and black dots and small outline circles on a white background were used in Experiments I, II, and III, respectively. In each experiment, 5 Ss were asked to report whether the stimulus dots were seen as 4 horizontal rows or 4 vertical columns, and whether they were seen simultaneously or successively. The experimental results showed that the time range of successive grouping was nearly the same as that of perceptual simultaneity in Experiments I and II, but was much greater than the latter in Experiment III where the similarity factor favored successive grouping. Successive grouping generally occurred in the same time range with visual masking of dot patterns by random dots, temporal organization of patterns from successive stimulus elements. But the time range was generally wider than those of contrast reduction caused by temporal luminance summation, metacontrast, and apparent movement.A part of this study was conducted during the junior author's stay at Chiba University and presented by him at the 20th International Congress of Psychology at Tokyo, August 13–19, 1972 (Yamada and Oyama, 1972)     

How to produce an absent-advantage in visual search

In a series of four experiments, we investigated the conditions under which target-absent responses are faster than target-present responses in visual search. Previous experiments have shown that such an absent-advantage occurs mainly for homogeneous distractors arranged in a regular pattern. From these results, it has been concluded that the absent-advantage is due to perceptual processes, such as grouping by similarity. Our data show that such processes are not sufficient. Rather, the absent-advantage is the result of interactions between perceptual and decisional processes. Certain perceptual conditions, such as randomizing stimulus patterns, lead to specific criteria settings that produce an absent-advantage. That such an account can explain our main results is demonstrated by modeling our data with a modified version of the Guided Search 2 model.     

The perceptual fate of letters in two kinds of apparent movement displays

Two experiments investigated the importance of figurai relationships among stimulus elements in the determination of the kind of motion perceived in bistable apparentovement displays. Stimulus frames containing the words MITE and ITEM were constructed in such a way that the letters I, T, and E appeared in corresponding locations while the M was in disparate locations between frames. When the frames were alternated with a 20-msec ISI, observers maintained local figurai identity in their percepts of apparent movement. However, when the frames were alternated with an 80-msec ISI, observers reported apparent movement of the entire groups of letters and thereby ignored figurai relationships in their percepts of apparent movement. In a second experiment, it was found that figurai nonidentity between elements of successive frames always resulted in apparent movement of a perceptual group or “blob” regardless of ISI. It is suggested that short-range apparent-movement percepts rely strongly upon figurai identity among corresponding stimulus elements, whereas long-range apparent-movement percepts do not.     

When does visual perceptual grouping affect multisensory integration?

Several studies have shown that the direction in which a visual apparent motion stream moves can influence the perceived direction of an auditory apparent motion stream (an effect known as crossmodal dynamic capture). However, little is known about the role that intramodal perceptual grouping processes play in the multisensory integration of motion information. The present study was designed to investigate the time course of any modulation of the cross-modal dynamic capture effect by the nature of the perceptual grouping taking place within vision. Participants were required to judge the direction of an auditory apparent motion stream while trying to ignore visual apparent motion streams presented in a variety of different configurations. Our results demonstrate that the cross-modal dynamic capture effect was influenced more by visual perceptual grouping when the conditions for intramodal perceptual grouping were set up prior to the presentation of the audiovisual apparent motion stimuli. However, no such modulation occurred when the visual perceptual grouping manipulation was established at the same time as or after the presentation of the audiovisual stimuli. These results highlight the importance of the unimodal perceptual organization of sensory information to the manifestation of multisensory integration.     

Time course of perceptual grouping by color

Does perceptual grouping operate early or late in visual processing? One position is that the elements in perceptual layouts are grouped early in vision, by properties of the retinal image, before perceptual constancies have been determined. A second position is that perceptual grouping operates on a postconstancy representation, one that is available only after stereoscopic depth perception, lightness constancy, and amodal completion have occurred. The present experiments indicate that grouping can operate on both a preconstancy representation and a postconstancy representation. Perceptual grouping was based on retinal color similarity at short exposure durations and based on surface color similarity at long durations. These results permit an integration of the preconstancy and postconstancy positions with regard to grouping by color.     

Associative grouping: Perceptual grouping of shapes by association

Perceptual grouping is usually defined by principles that associate distinct elements by virtue of image properties, such as proximity, similarity, and occurrence within common regions. What role does learning play in forming a perceptual group? This study provides evidence that learning of shape associations leads to perceptual grouping. Subjects were repeatedly exposed to pairs of unique shapes that co-occurred within a common region. The common region cue was later removed in displays composed of these shapes, and the subjects searched the display for two adjacent shapes of the same color. The subjects were faster at locating the color repetition when the adjacent shapes with the same color came from the same trained groups than when they were composed of two shapes from different trained groups. The effects were perceptual in nature: Learned pairings produced spatial distortions similar to those observed for groups defined by perceptual similarity. A residual grouping effect was observed even when the shapes in the trained group switched their relative positions but was eliminated when each shape was inverted. These results indicate that statistical co-occurrence with explicit grouping cues may form an important component of perceptual organization, determining perceived scene structure solely on the basis of past experience.