The role of objects in perceptual grouping.

Perceptual organization can be viewed as the selection of the best or "most reasonable" parse of a given scene. However, the principles that determine which interpretation is most reasonable have resisted most attempts to define them formally. This paper summarizes a formal theory of human perceptual organization, called minimal model theory, in which the best interpretation of a given scene is expressed as the formally minimal interpretation in a well-defined space of possible interpretations. We then focus specifically on the role of types of grouping units, in particular the difficult notion of "object". Although grouping is often thought of as the process of dividing the image into objects, most research in perceptual grouping actually focuses on simpler types of units, such as contours and surfaces. Minimal model theory characterizes grouping units at a logical level, demonstrating how formal assumptions about units induce the observer to place a certain preference ranking on interpretations. The theory is then applied to the more subtle problem of objects, culminating in a definition for objects that is formally rigorous but at the same time captures some of the flexibility of human intuitions about objects.     

Structural salience and the nonaccidentality of a gestalt

We perceive structure through a process of perceptual organization. Here we report a new perceptual organization phenomenon-the facilitation of visual grouping by global curvature. Observers viewed patterns that they perceived as organized into collections of curves. The patterns were perceptually ambiguous such that the perceived orientation of the patterns varied from trial to trial. When patterns were sufficiently dense and proximity was equated for the predominant perceptual alternatives, observers tended to perceive the organization with the greatest curvature. This effect is tantamount to visual grouping by maximal curvature and thus demonstrates an unprecedented effect of global structure on perceptual organization. We account for this result with a model that predicts the perceived organization of a pattern as function of its nonaccidentality, which we define as the probability that it could have occurred by chance. Our findings demonstrate a novel relationship between the geometry of a pattern and the visual salience of global structure.     

When does grouping happen?

Recent research on perceptual grouping is described with particular emphasis on identifying the level(s) at which grouping factors operate. Contrary to the classical view of grouping as an early, two-dimensional, image-based process, recent experimental results show that it is strongly influenced by phenomena related to perceptual constancy, such as binocular depth perception, lightness constancy, amodal completion, and illusory contours. These findings imply that at least some grouping processes operate at the level of phenomenal perception rather than at the level of the retinal image. Preliminary evidence is reported showing that grouping can affect perceptual constancy, suggesting that grouping processes must also operate at an early, preconstancy level. If so, grouping may be a ubiquitous, ongoing aspect of visual organization that occurs for each level of representation rather than as a single stage that can be definitively localized relative to other perceptual processes.     

Associative grouping: Perceptual grouping of shapes by association

Perceptual grouping is usually defined by principles that associate distinct elements by virtue of image properties, such as proximity, similarity, and occurrence within common regions. What role does learning play in forming a perceptual group? This study provides evidence that learning of shape associations leads to perceptual grouping. Subjects were repeatedly exposed to pairs of unique shapes that co-occurred within a common region. The common region cue was later removed in displays composed of these shapes, and the subjects searched the display for two adjacent shapes of the same color. The subjects were faster at locating the color repetition when the adjacent shapes with the same color came from the same trained groups than when they were composed of two shapes from different trained groups. The effects were perceptual in nature: Learned pairings produced spatial distortions similar to those observed for groups defined by perceptual similarity. A residual grouping effect was observed even when the shapes in the trained group switched their relative positions but was eliminated when each shape was inverted. These results indicate that statistical co-occurrence with explicit grouping cues may form an important component of perceptual organization, determining perceived scene structure solely on the basis of past experience.     

A simplicity principle in unsupervised human categorization

We address the problem of predicting how people will spontaneously divide into groups a set of novel items. This is a process akin to perceptual organization. We therefore employ the simplicity principle from perceptual organization to propose a simplicity model of unconstrained spontaneous grouping. The simplicity model predicts that people would prefer the categories for a set of novel items that provide the simplest encoding of these items. Classification predictions are derived from the model without information either about the number of categories sought or information about the distributional properties of the objects to be classified. These features of the simplicity model distinguish it from other models in unsupervised categorization (where, for example, the number of categories sought is determined via a free parameter), and we discuss how these computational differences are related to differences in modeling objectives. The predictions of the simplicity model are validated in four experiments. We also discuss the significance of simplicity in cognitive modeling more generally.     

The role of timing in the attentional boost effect

Images that are presented with targets of an unrelated detection task are better remembered than images that are presented with distractors (the attentional boost effect). The likelihood that any of three mechanisms, attentional cuing, prediction-based reinforcement learning, and perceptual grouping, underlies this effect depends in part on how it is modulated by the relative timing of the target and image. Three experiments demonstrated that targets and images must overlap in time for the enhancement to occur; targets that appear 100 ms before or 100 ms after the image without temporally overlapping with it do not enhance memory of the image. However, targets and images need not be synchronized. A fourth experiment showed that temporal overlap of the image and target is not sufficient, as detecting targets did not enhance the processing of task-irrelevant images. These experiments challenge several simple accounts of the attentional boost effect based on attentional cuing, reinforcement learning, and perceptual grouping.     

Transfer and Scaffolding of Perceptual Grouping Occurs Across Organizing Principles in 3- to 7-Month-Old Infants

ABSTRACT— Previous research has demonstrated that organizational principles become functional over different time courses of development: Lightness similarity is available at 3 months of age, but form similarity is not readily in evidence until 6 months of age. We investigated whether organization would transfer across principles and whether perceptual scaffolding can occur from an already functional principle to a not-yet-operational principle. Six- to 7-month-old infants (Experiment 1) and 3- to 4-month-old infants (Experiment 2) who were familiarized with arrays of elements organized by lightness similarity displayed a subsequent visual preference for a novel organization defined by form similarity. Results with the older infants demonstrate transfer in perceptual grouping: The organization defined by one grouping principle can direct a visual preference for a novel organization defined by a different grouping principle. Findings with the younger infants suggest that learning based on an already functional organizational process enables an organizational process that is not yet functional through perceptual scaffolding.     

The relation between proximity and brightness similarity in dot patterns

The Gestalt studies demonstrated the tendency to visually organize dots on the basis of similarity, proximity, and global properties such as closure, good continuation, and symmetry. The particular organization imposed on a collection of dots is thus determined by many factors, some local, some global. We discuss computational reasons for expecting the initial stages of grouping to be achieved by processes with purely local support. In the case of dot patterns, the expectation is that neighboring dots are grouped as a function of proximity and similarity of contrast, by processes that are independent of the overall organization and the various global factors. We describe experiments that suggest a purely local relationship between proximity and brightness similarity in perceptual grouping.     

Attentional requirements in perceptual grouping depend on the processes involved in the organization

Previous studies on the role of attention in perceptual grouping have yielded contradicting findings, some suggesting that grouping requires attention and others indicating that it does not. Kimchi and Razpurker-Apfeld (Psychonomic Bulletin and Review, 11(4), 687–696, 2004) showed that attentional demands in grouping could vary according to the processes involved. The current study expanded on this, examining whether attentional demands vary for (a) different grouping principles and (b) as a function of contingent processing of element segregation and shape formation. We used the inattention paradigm with an online measure, in which participants engaged in an attentionally demanding change-detection task on a small matrix presented on a task-irrelevant backdrop of grouped elements. The backdrop grouping changed or stayed the same independently of any change in the target. Congruency effects produced by changes in backdrop grouping on target-change judgments indicate that the backdrop grouping was accomplished under inattention. The results showed congruency effects when grouping formed columns/rows by proximity but not by shape similarity, and when grouping into a distinct shape by collinearity did not involve element segregation. No congruency effects were found when grouping into a shape by collinearity or connectedness involved element segregation, except when connectedness was combined with color similarity. These results suggest that attentional demands depend on the combination of grouping principles and the complexity of the processes involved in the organization. These findings provide further support for the view that perceptual organization is a multiplicity of processes that vary in attentional demands.     

How to produce an absent-advantage in visual search

In a series of four experiments, we investigated the conditions under which target-absent responses are faster than target-present responses in visual search. Previous experiments have shown that such an absent-advantage occurs mainly for homogeneous distractors arranged in a regular pattern. From these results, it has been concluded that the absent-advantage is due to perceptual processes, such as grouping by similarity. Our data show that such processes are not sufficient. Rather, the absent-advantage is the result of interactions between perceptual and decisional processes. Certain perceptual conditions, such as randomizing stimulus patterns, lead to specific criteria settings that produce an absent-advantage. That such an account can explain our main results is demonstrated by modeling our data with a modified version of the Guided Search 2 model.     

Common region wins the competition between extrinsic grouping cues: Evidence from a task without explicit attention to grouping

The competition between perceptual grouping factors is a relatively ignored topic, especially in the case of extrinsic grouping cues (e.g., common region or connectedness). Recent studies have examined the integration of extrinsic cues using tasks that induce selective attention to groups based on different grouping cues. However, this procedure could generate alternative strategies for task performance, which are non-related to the perceptual grouping operations. In the current work, we used an indirect task, i.e. repetition discrimination task, without explicit attention to grouping cues to further examine the rules that govern dominance between competing extrinsic grouping factors. This procedure allowed us to obtain an unbiased measure of the competition between common region and connectedness cues acting within the same display. The results corroborate previous data showing that grouping by common region dominated the perceived organization of the display, even though the phenomenological strength of the grouping cues was equated for each participant by means of a preliminary scaling task. Our results highlight the relevance of using indirect tasks as an essential tool for the systematic study of the integration of extrinsic grouping cues.     

Visual attention and perceptual grouping.

Perceptual organization is thought to involve an analysis of both textural discontinuities and perceptual grouping. In earlier work, we found that textural discontinuities were detected normally even when visual attention was engaged elsewhere. Here we report how perceptual grouping is affected when visual attention is engaged by a concurrent visual task. To elicit perceptual grouping, we used the Gestalt demonstrations of grouping on the basis of proximity and of similarity. Four tasks were investigated, some requiring the observer to discriminate between horizontal and vertical grouping, and some requiring the observer to merely detect the presence or absence of grouping. Visual attention was engaged at the center of the display by a form identification task. The detection of a textural discontinuity served as a control task. Concurrent form identification conflicted with all four grouping tasks, resulting in a significant reduction of grouping performance in each case. No performance reduction was observed when either form identification or grouping discrimination was combined with the detection of a textural discontinuity. These results suggest that perceptual grouping and form identification compete for visual attention, whereas the detection of a textural discontinuity does not.     

Equivalent effects of grouping by time, voice, and location on response timing in verbal serial memory

The grouping of list items is known to improve serial memory accuracy and constrain the nature of temporal errors. A recent study (M. T. Maybery, F. B. R. Parmentier, & D. M. Jones, 2002) showed that grouping results in a temporal organization of the participants' responses that mimics the list structure but not the timing of its presentation. Here the authors tested the prediction that the temporal grouping of responses should yield the same pattern of response time (RT) irrespective of the method of grouping at presentation. Comparing temporal, location, and voice grouping, the results show that although these methods impact on recall accuracy to varying degrees, all 3 conditions produce significant and equivalent peaks in RT at the first position of each group. The RT data were accurately simulated through a model based on ACT-R's (J. R. Anderson & M. Matessa, 1997) basic principles. Altogether, the data suggest that the temporal organization of responses in verbal serial recall results from (a) declarative knowledge about the list's structure that is independent of the perceptual means by which grouping is induced at presentation and (b) the level of activation of the items per se.     

Rethinking perceptual organization: The role of uniform connectedness

A principle of perceptual organization, calleduniform connectedness (UC), is described, and a theoretical approach to perceptual organization is proposed in which this principle plays a fundamental role. The principle of UC states that closed regions of homogeneous properties—such as lightness, chromatic color, texture, and so forth—tend to be perceived initially as single units. We demonstrate its effects and show that they occur even when opposed by powerful grouping principles such as proximity and similarity. We argue that UC cannot be reduced to such grouping principles, because it is not a form of grouping at all. We then propose a theoretical framework within which UC accounts for the initial (orentry level) organization of the visual field into primitive units. Classical principles of grouping operate after UC, creating superordinate units consisting of two or more basic-level units. Parsing processes also operate after UC, dividing basic-level units into subordinate parts. UC in the retinal image is proposed to be a necessary, but not a sufficient, condition for unit formation, since connected elements on the retina that are perceived to lie in separate depth planes fail to be perceived as units. This fact, together with other evidence that the Gestalt principles of grouping are based onperceived (rather than retinal) relations, suggests that the organization of visual stimulation into UC objects is ultimately achieved within a relatively late, postconstancy representation of environmental surfaces. The implications of this possibility are discussed in light of present theories of visual perception.     

Visual attention and perceptual grouping

Perceptual organization is thought to involve an analysis of bothtextural discontinuities andperceptual grouping. In earlier work, we found that textural discontinuities were detected normally even when visual attention was engaged elsewhere. Here we report how perceptual grouping is affected when visual attention is engaged by a concurrent visual task. To elicit perceptual grouping, we used the Gestalt demonstrations of grouping on the basis of proximity and of similarity. Four tasks were investigated, some requiring the observer to discriminate between horizontal and vertical grouping, and some requiring the observer to merely detect the presence or absence of grouping. Visual attention was engaged at the center of the display by a form identification task. The detection of a textural discontinuity served as a control task. Concurrent form identification conflicted with all four grouping tasks, resulting in a significant reduction of grouping performance in each case. No performance reduction was observed when either form identification or grouping discrimination was combined with the detection of a textural discontinuity. These results suggest that perceptual grouping and form identification compete for visual attention, whereas the detection of a textural discontinuity does not.     

Perceptual organization of apparent motion in the Ternus display

A typical Ternus display has three sequentially presented frames, in which frame 1 consists of three motion tokens, frame 2 (blank) defines the interstimulus interval, and frame 3 has similar motion tokens with their relative positions shifted to the right. Interestingly, what appears to be a seemingly simple arrangement of stimuli can induce one of two distinct apparent-motion percepts in the observer. The first is an element-motion perception where the left-end token is seen to jump over its two neighboring tokens (inner tokens) to the right end of the display. The second is a group-motion perception where the entire display of the three tokens is seen to move to the right. How does the visual system choose between these two apparent-motion perceptions? It is hypothesized that the choice of motion perception is determined in part by the perceptual organization of the motion tokens. Specifically, a group-motion perception is experienced when a strong grouping tendency exists among the motion tokens belonging to the same frame. Conversely, an element-motion perception is experienced when a strong grouping tendency exists between the inner motion tokens in frames 1 and 3 (i.e. the two tokens that overlap in space between frames). We tested this hypothesis by varying the perceptual organization of the motion tokens. Both spatial (form similarity, 3-D proximity, common surface/common region, and occlusion) and temporal (motion priming) factors of perceptual organization were tested. We found that the apparent-motion perception of the Ternus display can be predictably affected, in a manner consistent with the perceptual organization hypothesis.     

Testing organization preferences in serial pattern learning

Subjects studied a series of colored dots for 6 s and then performed a memory reproduction task for which they chose alternative puzzle pieces from a set. Series were presented repeatedly until subjects made a completely correct reproduction. The puzzle pieces contained parts of the series that were expected to interact with the groups identified by spontaneous perceptual organization. By assuming that same grouping in series and puzzle pieces would be preferred, the preferences could be predicted on the basis of an economy principle. The preferences obtained were in accordance with the predictions.     

Multielement visual tracking: attention and perceptual organization.

Two types of theories have been advanced to account for how attention is allocated in performing goal-directed visual tasks. According to location-based theories, visual attention is allocated to spatial locations in the image; according to object-based theories, attention is allocated to perceptual objects. Evidence for the latter view comes from experiments demonstrating the importance of perceptual grouping in selective-attention tasks. This article provides further evidence concerning the importance of perceptual organization in attending to objects. In seven experiments, observers tracked multiple randomly moving visual elements under a variety of conditions. Ten elements moved continuously about the display for several seconds; one to five of them were designated as targets before movement initiation. At the end of movement, one element was highlighted, and subjects indicated whether or not it was a target. The ease with which the elements in the target set could be perceptually grouped was systematically manipulated. In Experiments 1-3, factors that influenced the initial formation of a perceptual group were manipulated; this affected performance, but only early in practice. In Experiments 4-7, factors that influenced the maintenance of a perceptual group during motion were manipulated; this affected performance throughout practice. The results suggest that observers spontaneously grouped the target elements and directed attention toward this coherent but nonrigid virtual object. This supports object-based theories of attention and demonstrates that perceptual grouping, which is usually conceived of as a purely stimulus-driven process, can also be governed by goal-directed mechanisms.     

Intact visual discrimination of complex and feature-ambiguous stimuli in the absence of perirhinal cortex

The perirhinal cortex is known to be important for memory, but there has recently been interest in the possibility that it might also be involved in visual perceptual functions. In four experiments, we assessed visual discrimination ability and visual discrimination learning in severely amnesic patients with large medial temporal lobe lesions that included complete lesions of perirhinal cortex. Experiment 1 tested complex visual object perception. Experiments 2a and 2b tested in two different ways the ability to discriminate between feature-ambiguous images, which was reported to be impaired in monkeys with perirhinal lesions. Experiment 3 involved images that were successfully discriminated in Experiment 2a and asked patients to learn across 20 trials which of the images had been designated as "correct." Patients performed as well as controls in Experiments 1, 2a, and 2b, but one of the patients had difficulty in Experiment 3 when the task required remembering from trial to trial which image was "correct." These findings indicate that perirhinal cortex is not needed for visual perception across a wide range of visual perceptual tasks.