Learning to perceive object unity: a connectionist account

To explore questions of how human infants begin to perceive partly occluded objects, we devised two connectionist models of perceptual development. The models were endowed with an existing ability to detect several kinds of visual information that have been found important in infants’ and adults’ perception of object unity (motion, co‐motion, common motion, relatability, parallelism, texture and T‐junctions). They were then presented with stimuli consisting of either one or two objects and an occluding screen. The models’ task was to determine whether the object or objects were joined when such a percept was ambiguous, after specified amounts of training with events in which a subset of possible visual information was provided. The model that was trained in an enriched environment achieved superior levels of performance and was able to generalize veridical percepts to a wide range of novel stimuli. Implications for perceptual development in humans, current theories of development and origins of knowledge are discussed.     

Synchronous change and perception of object unity: evidence from adults and infants.

Adults and infants display a robust ability to perceive the unity of a center-occluded object when the visible ends of the object undergo common motion (e.g. Kellman, P.J., Spelke, E.S., 1983. Perception of partly occluded objects in infancy. Cognitive Psychology 15, 483-524). Ecologically oriented accounts of this ability focus on the primary of motion in the perception of segregated objects, but Gestalt theory suggests a broader possibility: observers may perceive object unity by detecting patterns of synchronous change, of which common motion is a special case. We investigated this possibility with observations of adults and 4-month-old infants. Participants viewed a center-occluded object whose visible surfaces were either misaligned or aligned, stationary or moving, and unchanging or synchronously changing in color or brightness in various temporal patterns (e.g. flashing). Both alignment and common motion contributed to adults' perception of object unity, but synchronous color changes did not. For infants, motion was an important determinant of object unity, but other synchronous changes and edge alignment were not. When a stationary object with aligned edges underwent synchronous changes in color or brightness, infants showed high levels of attention to the object, but their perception of its unity appeared to be indeterminate. An inherent preference for fast over slow flash rates, and a novelty preference elicited by a change in rate, both indicated that infants detected the synchronous changes, although they failed to use them as information for object unity. These findings favor ecologically oriented accounts of object perception in which surface motion plays a privileged role.     

Motion and edge sensitivity in perception of object unity

Although much evidence indicates that young infants perceive unitary objects by analyzing patterns of motion, infants' abilities to perceive object unity by analyzing Gestalt properties and by integrating distinct views of an object over time are in dispute. To address these controversies, four experiments investigated adults' and infants' perception of the unity of a center-occluded, moving rod with misaligned visible edges. Both alignment information and depth information affected adults' and infants' perception of object unity in similar ways, and infants perceived object unity by integrating information about object features over time. However, infants perceived a moving, misaligned, three-dimensional object as indeterminate in its connectedness, whereas adults perceived it as connected behind the occluder. These findings indicate that the effectiveness of common motion in specifying unified surfaces across an occluder is reduced by misalignment of edges. Alignment information enhances perception of object unity either by serving directly as information for unity or by optimizing the detectability of motion-carried information for unity. In addition, young infants are able to retain information about edge orientation over short intervals in determining connectedness via a process of spatiotemporal integration.     

Infant object segregation implies information integration

Researchers, including Needham (2001, this issue), have found that infants as young as 4.5 months of age have the ability to use featural information to segregate objects. However, considerable research on infants' perception of color, shape, size, orientation, and so on has shown that infants younger than 4.5 months are capable of using these featural cues to discriminate between objects or other test items. Infants as young as 2 months of age also can perceive a moving object as unified. In this article, we argue for an information processing explanation of these results, which centers on the development of infants' ability to integrate both featural and object information. The proposed explanation is based upon L. B. Cohen's (1991, 1998) information processing propositions and is consistent with the evidence on object segregation as well as evidence from our laboratory and others' on infant perception and cognition.     

Object and observer motion in the perception of objects by infants

Sixteen-week-old human infants distinguish optical displacements given by their own motion from displacements given by moving objects, and they use only the latter to perceive the unity of partly occluded objects. Optical changes produced by moving the observer around a stationary object produced attentional levels characteristic of stationary observers viewing stationary displays and much lower than those shown by stationary observers viewing moving displays. Real displacements of an object with no subject-relative displacement, produced by moving an object so as to maintain a constant relation to the moving observer, evoked attentional levels that were higher than with stationary displays and more characteristic of attention to moving displays, a finding suggesting detection of the real motion. Previously reported abilities of infants to perceive the unity of partly occluded objects from motion information were found to depend on real object motion rather than on optical displacements in general. The results suggest that object perception depends on registration of the motions of surfaces in the three-dimensional layout.     

Infant development of configural object processing in visual and visual-haptic contexts

Infants’ visual processing of objects is characterised by a developmental trend from a predominantly analytical to a configural processing mode. In two studies with 6- and 8-month-old infants, we sought to replicate this finding in a purely visual condition (inspecting objects), and to examine how far redundant visual-haptic information present in a visual-haptic condition influences the processing mode. Infants were familiarized with two objects differing in three dimensions (texture, size and shape). At test, infants were presented with a familiar object, a switch object consisting of a recombination of familiar dimensions, and a novel object, and looking times were measured. Results indicate a transition from analytical processing at 6 months to configural processing at 8 months in the visual condition. In the visual-haptic condition, both age-groups displayed configural processing. Thus, redundant visual-haptic information seems to enhance object processing.     

Object individuation and object identity in infancy: the role of spatiotemporal information, object property information, and language.

Recent work on object individuation and object identity in infancy indicates that at least three sources of information may be used for object individuation and object identity: spatiotemporal information, object property information, and object kind information. Several experiments have shown that a major developmental change occurs between 10 and 12 months of age (Xu & Carey, 1996; Xu, Carey & Welch, in press; Van de Walle, Prevor & Carey, under review; Xu, Carey & Quint, in preparation): Infants at 10 months and younger readily use spatiotemporal information in object individuation and object identity tasks, but not until about 12 months of age are infants able to use object property or object kind information to do so. This paper proposes a two-part conjecture about the mechanism underlying this change. The first part borrows ideas from object-based attention and the distinction between "what" and "where" information in visual processing. The hypothesis is that (1) young infants encode object motion and location information separately from object property information; and (2) toward the end of the first year, infants integrate these two sources of information. The second part of the conjecture posits an important role for language. Infants may take distinct labels as referring to distinct kinds of objects from the onset of word learning, and infants use this information in solving the problem of object individuation and object identity. Evidence from human adults, infants, and non-human primates is reviewed to provide support for the conjecture.     

Linguistic and cognitive abilities in infancy: when does language become a tool for categorization?

Infants' ability to form new object categories based on either visual or naming information alone was evaluated at two different ages (16 and 20 months) using an object manipulation task. Estimates of productive vocabulary size were also collected. Infants at both ages showed evidence of using visual information to categorize the objects, while only the older ones used naming information. Moreover, there was a correlation between vocabulary size and name-based categorization among the 20-month-olds. The present results establish that infants as young as 20 months can use the non-obvious cue of naming to categorize objects. The possibility of a link between this ability and lexical development is discussed.     

Gaze detection and the cortical processing of faces: Evidence from infants and adults

Abstract

Faces, as a class of objects, have been studied extensively in order to understand how the human visual system recognizes and represents objects. In this paper we studied the ontogeny of the ability to perceive gaze direction. We bring together both developmental research and neurophysiological and neuropsychological research in order to address this issue. In two experiments we explored the developmental time course of the ability to discriminate between direct and averted gaze, a task thought to involve cortical information processing of faces. We found that (a) infants as young as four months could discriminate between direct and averted gaze, (b) this ability was not due to the development of low-level visual processes, and (c) younger infants did not show reliable evidence of gaze discrimination. In an additional experiment we tested adults to study the effect of face context on the ability to discriminate gaze direction. Adult subjects were more sensitive in this discrimination when the eyes were in the context of an upright face than when the eyes were in either an inverted face or in a scrambled face. Taken together, these results suggest that the mechanisms underlying gaze detection may be mediated by cortical circuits also involved in other aspects of face recognition.     

The role of good form in young Infants' perception of partly occluded objects

Young infants have been reported to perceive the unity of a center-occluded object when the visible ends of the object undergo common motion, but not on the basis of stationary information (e.g., P. J. Kellman & E. S. Spelke, 1983). We investigated the possibility that 4-month-old infants will attend to and utilize the global configuration (i.e., the "good form") of a partly occluded, moving object to perceive its unity and coherence behind the occluder. In the first experiment, infants viewed a partly occluded circle or cross that translated laterally. Infants who habituated in the minimum number of trials ("fast habituators") showed a reliable posthabituation preference for a broken object over a complete object, indicating perception of unity in the habituation display. Slow habituators exhibited no posthabituation preference. In the second experiment, infants were presented with small ring and cross displays, and the infants looked longer at the broken object. There were no reliable differences in performance between fast and slow habituators. A control group demonstrated no reliable posthabituation preference. In three additional conditions, infants viewed either a partly occluded half ring or a display in which two rod parts were either relatable and nonaligned or nonrelatable. The results indicated that curvature per se provided information in support of completion, in addition to global configuration and motion. Implications for theories of infants' visual development are discussed.     

Discrimination of possible and impossible objects in infancy

Adults can use pictorial depth cues to infer three-dimensional structure in two-dimensional depictions of objects. The age at which infants respond to the same kinds of visual information has not been determined, and theories about the underlying developmental mechanisms remain controversial. In this study, we used a visual habituation/novelty-preference procedure to assess the ability of 4-month-old infants to discriminate between two-dimensional depictions of structurally possible and impossible objects. Results indicate that young infants are sensitive to junction structures and interposition cues associated with pictorial depth and can detect inconsistent relationships among these cues that render an object impossible. Our results provide important insights into the development of mechanisms for processing pictorial depth cues that allow adults to extract three-dimensional structure from pictures of objects.     

Perception of partly occluded objects in infancy

Four-month-old infants sometimes can perceive the unity of a partly hidden object. In each of a series of experiments, infants were habituated to one object whose top and bottom were visible but whose center was occluded by a nearer object. They were then tested with a fully visible continuous object and with two fully visible object pieces with a gap where the occluder had been. Patterns of dishabituation suggested that infants perceive the boundaries of a partly hidden object by analyzing the movements of its surfaces: infants perceived a connected object when its ends moved in a common translation behind the occluder. Infants do not appear to perceive a connected object by analyzing the colors and forms of surfaces: they did not perceive a connected object when its visible parts were stationary, its color was homogeneous, its edges were aligned, and its shape was simple and regular. These findings do not support the thesis, from gestalt psychology, that object perception first arises as a consequence of a tendency to perceive the simplest, most regular configuration, or the Piagetian thesis that object perception depends on the prior coordination of action. Perception of objects may depend on an inherent conception of what an object is.     

Self‐generated variability in object images predicts vocabulary growth

Object names are a major component of early vocabularies and learning object names depends on being able to visually recognize objects in the world. However, the fundamental visual challenge of the moment‐to‐moment variations in object appearances that learners must resolve has received little attention in word learning research. Here we provide the first evidence that image‐level object variability matters and may be the link that connects infant object manipulation to vocabulary development. Using head‐mounted eye tracking, the present study objectively measured individual differences in the moment‐to‐moment variability of visual instances of the same object, from infants’ first‐person views. Infants who generated more variable visual object images through manual object manipulation at 15 months of age experienced greater vocabulary growth over the next six months. Elucidating infants’ everyday visual experiences with objects may constitute a crucial missing link in our understanding of the developmental trajectory of object name learning.     

Infants' perception of illusions in sound localization: reaching to sounds in the dark.

Sixteen infants each at 4, 6, and 8 months of age were tested for reaching to sounding toys in the dark under two auditory illusion conditions: the Haas-effect, which creates the illusion of a single lateralized sound based on an interaural intensity difference (the toy was visible and invisible under some test conditions); and the midline illusion, which creates the illusion of a single sound at midline due to an absence of any interaural time or intensity differences (invisible toy condition only). No-sound control trials indicated the level of spontaneous reaching in the dark. Results indicate that by 4 months infants perceive both the Haas-effect and midline illusions. The ability to reach both for invisible and visible sounding objects in the dark was well developed by 4 months of age, although developmental changes in aspects of reaching behavior were observed and, at all ages, object contact was most frequent when visual localization cues accompanied sound localization cues. The incidence of spontaneous reaching in the dark was low and did not vary with age. Theoretical and methodological implications of this research are discussed.     

Sound induces perceptual reorganization of an ambiguous motion display in human infants

Adults who watch an ambiguous visual event consisting of two identical objects moving toward, through, and away from each other and hear a brief sound when the objects overlap report seeing visual bouncing. We conducted three experiments in which we used the habituation/test method to determine whether these illusory effects might emerge early in development. In Experiments 1 and 3 we tested 4‐, 6‐ and 8‐month‐old infants’ discrimination between an ambiguous visual display presented together with a sound synchronized with the objects’ spatial coincidence and the identical visual display presented together with a sound no longer synchronized with coincidence. Consistent with illusory perception, the 6‐ and 8‐month‐old, but not the 4‐month‐old, infants responded to these events as different. In Experiment 2 infants were habituated to the ambiguous visual display together with a sound synchronized with the objects’ coincidence and tested with a physically bouncing object accompanied by the sound at the bounce. Consistent with illusory perception again, infants treated these two events as equivalent by not exhibiting response recovery. The developmental emergence of this intersensory illusion at 6 months of age is hypothesized to reflect developmental changes in object knowledge and attentional mechanisms.     

Infants’ sensitivity to familiar size: The effect of memory on spatial perception

Two experiments investigated infants’ sensitivity to familiar size as information for the distances of objects with which they had had only brief experience. Each experiment had two phases: a familiarization phase and a test phase. During the familiarization phase, the infant played with a pair of different-sized objects for 10 min. During the test phase, a pair of objects, identical to those seen in the familiarization phase but now equal in size, were presented to the infant at a fixed distance under monocular or binocular viewing conditions. In the test phase of Experiment 1, 7-month-old infants viewing the objects monocularly showed a significant preference to reach for the object that resembled the smaller object in the familiarization phase. Seven-month-old infants in the binocular viewing condition reached equally to the two test phase objects. These results indicate that, in the monocular condition, the 7-month-olds used knowledge about the objects’ sizes, acquired during the familiarization phase, to perceive distance from the test objects’ visual angles, and that they reached preferentially for the apparently nearer object. The lack of a reaching preference in the binocular condition rules out interpretations of the results not based on the objects’ perceived distances. The results, therefore, indicate that 7-month-old infants can use memory to mediate spatial perception. The implications of this finding for the debate between direct and indirect theories of visual perception are discussed. In the test phase of Experiment 2,5-month-old infants viewing the objects monocularly showed no reaching preference. These infants, therefore, showed no evidence of sensitivity to familiar size as distance information.     

Rapid development of feature binding in visual short-term memory

The binding of object identity (color) and location in visual short-term memory (VSTM) was examined in 6.5- to 12.5-month-old infants (N= 144). Although we previously found that by age 6.5 months, infants can represent both color and location in VSTM, in the present study we observed that 6.5-month-old infants could not remember trivially simple color-location combinations across a 300-ms delay. However, 7.5-month-old infants could bind color and location as effectively as 12.5-month-old infants. Control conditions confirmed that the failure of 6.5-month-old infants was not a result of perceptual or attentional limitations. This rapid development of VSTM binding between 6.5 and 7.5 months occurs during a period of rapid increase in VSTM storage capacity and just after a period of dramatic neuroanatomical changes in parietal cortex. Thus, the ability to bind features and the ability to store multiple objects may both depend on a process that is mediated by posterior parietal cortex and is perhaps related to focused attention.     

Infants’ identification of three-dimensional form from transformations of linear perspective

The ability of infants to perceive three-dimensional structure from transformations of linear perspective was investigated in two studies. Infants were habituated to the pattern of linear perspective transformations corresponding to a particular three-dimensional object, and their relative preference for that object as compared with a different three-dimensional object was assessed both before and after habituation. The habituation displays showed the distorting shadow cast by a rotating object and therefore provided only transformations of linear perspective as information specifying three-dimensional form. The pre- and posttest displays involved the actual three-dimensional objects and provided binocular, shading, and texture information specifying three-dimensional form, but did not provide informative transformations of linear perspective. In Study 1, 6-month-olds showed changes in preference from pre- to posttest that were related to the identity of the object whose shadow they had seen during habituation; 4-month-olds, however, did not show preference changes related to the habituation object. In Study 2, rhythm information that may have served as a basis for responding in Study 1 was eliminated from the test displays. Six-month-olds again showed changes in preference that were dependent on their habituation experience. It is concluded that, by 6 months of age, infants are able to perceive object structure from the isolated cue of transformations of linear perspective. The findings are discussed with reference to infants’ three-dimensional form perception based on other cues and also with reference to the emergence of certain spatially related moter activities.     

Principles of Object Perception

Research on human infants has begun to shed light on early-developing processes for segmenting perceptual arrays into objects. Infants appear to perceive objects by analyzing three-dimensional surface arrangements and motions. Their perception does not accord with a general tendency to maximize figural goodness or to attend to nonaccidental geometric relations in visual arrays. Object perception does accord with principles governing the motions of material bodies: Infants divide perceptual arrays into units that move as connected wholes, that move separately from one another, that tend to maintain their size and shape over motion, and that tend to act upon each other only on contact. These findings suggest that o general representation of object unity and boundaries is interposed between representations of surfaces and representations of objects of familiar kinds. The processes that construct this representation may be related to processes of physical reasoning.     

Increased visual interest and affective responses to impossible figures in early infancy

This research evaluated infants’ facial expressions as they viewed pictures of possible and impossible objects on a TV screen. Previous studies in our lab demonstrated that four-month-old infants looked longer at the impossible figures and fixated to a greater extent within the problematic region of the impossible shape, suggesting they were sensitive to novel or unusual object geometry. Our work takes studies of looking time data a step further, determining if increased looking co-occurs with facial expressions associated with increased visual interest and curiosity, or even puzzlement and surprise. We predicted that infants would display more facial expressions consistent with either “interest” or “surprise” when viewing the impossible objects relative to possible ones, which would provide further evidence of increased perceptual processing due to incompatible spatial information. Our results showed that the impossible cubes evoked both longer looking times and more reactive expressions in the majority of infants. Specifically, the data revealed significantly greater frequency of raised eyebrows, widened eyes and returns to looking when viewing impossible figures with the most robust effects occurring after a period of habituation. The pattern of facial expressions were consistent with the “interest” family of facial expressions and appears to reflect infants’ ability to perceive systematic differences between matched pairs of possible and impossible objects as well as recognize novel geometry found in impossible objects. Therefore, as young infants are beginning to register perceptual discrepancies in visual displays, their facial expressions may reflect heightened attention and increased information processing associated with identifying irreconcilable contours in line drawings of objects. This work further clarifies the ongoing formation and development of early mental representations of coherent 3D objects.