Infants' perception of information along object boundaries: concavities versus convexities

Object parts are signaled by concave discontinuities in shape contours. In seven experiments, we examined whether 5- and 6 1/2-month-olds are sensitive to concavities as special aspects of contours. Infants of both ages detected discrepant concave elements amid convex distractors but failed to discriminate convex elements among concave distractors. This discrimination asymmetry is analogous to the finding that concave targets among convex distractors pop out for adults, whereas convex targets among concave distractors do not. Thus, during infancy, as during adulthood, concavities appear to be salient regions of shape contours. The current study also found that infants' detection of concavity is impaired if the contours that define concavity and convexity are not part of closed shapes. Thus, for infants, as for adults, concavities and convexities are defined more readily in the contours of closed shapes. Taken together, the results suggest that some basic aspects of part perception from shape contours are available by at least 5 months of age.     

The visual and haptic perception of natural object shape

In this study, we evaluated observers' ability to compare naturally shaped three-dimensional (3-D) objects, using their senses of vision and touch. In one experiment, the observers haptically manipulated 1 object and then indicated which of 12 visible objects possessed the same shape. In the second experiment, pairs of objects were presented, and the observers indicated whether their 3-D shape was the same or different. The 2 objects were presented either unimodally (vision-vision or haptic-haptic) or cross-modally (vision-haptic or haptic-vision). In both experiments, the observers were able to compare 3-D shape across modalities with reasonably high levels of accuracy. In Experiment 1, for example, the observers' matching performance rose to 72% correct (chance performance was 8.3%) after five experimental sessions. In Experiment 2, small (but significant) differences in performance were obtained between the unimodal vision-vision condition and the two cross-modal conditions. Taken together, the results suggest that vision and touch have functionally overlapping, but not necessarily equivalent, representations of 3-D shape.     

A theory of visual interpolation in object perception

We describe a new theory explaining the perception of partly occluded objects and illusory figures, from both static and kinematic information, in a unified framework. Three ideas guide our approach. First, perception of partly occluded objects, perception of illusory figures, and some other object perception phenomena derive from a single boundary interpolation process. These phenomena differ only in respects that are not part of the unit formation process, such as the depth placement of units formed. Second, unit formation from static and kinematic information can be treated in the same general framework. Third, spatial and spatiotemporal discontinuities in the boundaries of optically projected areas are fundamental to the unit formation process. Consistent with these ideas, we develop a detailed theory of unit formation that accounts for most cases of boundary perception in the absence of local physical specification. According to this theory, discontinuities in the first derivative of projected edges are initiating conditions for unit formation. A formal notion of relatability is defined, specifying which physically given edges leading into discontinuities can be connected to others by interpolated edges. Intuitively, relatability requires that two edges be connectable by a smooth, monotonic curve. The roots of the discontinuity and relatability notions in ecological constraints on object perception are discussed. Finally, we elaborate our approach by discussing related issues, some new phenomena, connections to other approaches, and issues for future research.     

Aging and the visual, haptic, and cross-modal perception of natural object shape

One hundred observers participated in two experiments designed to investigate aging and the perception of natural object shape. In the experiments, younger and older observers performed either a same/different shape discrimination task (experiment 1) or a cross-modal matching task (experiment 2). Quantitative effects of age were found in both experiments. The effect of age in experiment 1 was limited to cross-modal shape discrimination: there was no effect of age upon unimodal (ie within a single perceptual modality) shape discrimination. The effect of age in experiment 2 was eliminated when the older observers were either given an unlimited amount of time to perform the task or when the number of response alternatives was decreased. Overall, the results of the experiments reveal that older observers can effectively perceive 3-D shape from both vision and haptics.     

Parts of visual objects: an experimental test of the minima rule

Three experiments were conducted to test Hoffman and Richards's (1984) hypothesis that, for purposes of visual recognition, the human visual system divides three-dimensional shapes into parts at negative minima of curvature. In the first two experiments, subjects observed a simulated object (surface of revolution) rotating about a vertical axis, followed by a display of four alternative parts. They were asked to select a part that was from the object. Two of the four parts were divided at negative minima of curvature and two at positive maxima. When both a minima part and a maxima part from the object were presented on each trial (experiment 1), most of the correct responses were minima parts (101 versus 55). When only one part from the object--either a minima part or a maxima part--was shown on each trial (experiment 2), accuracy on trials with correct minima parts and correct maxima parts did not differ significantly. However, some subjects indicated that they reversed figure and ground, thereby changing maxima parts into minima parts. In experiment 3, subjects marked apparent part boundaries. 81% of these marks indicated minima parts, 10% of the marks indicated maxima parts, and 9% of the marks were at other positions. These results provide converging evidence, from two different methods, which supports Hoffman and Richard's minima rule.     

Light source position in the perception of object shape

The apparent relief of monocularly viewed surfaces reversed when the order of light and shade was reversed relative to the position of a lamp observed the moment earlier. The pattern of shading was reversed either by illuminating from a direction opposite to that of the apparent direction of illumination or by inverting the illuminating image relative to the light source. The combination of both of these manipulations restores the original juxtaposition of light source and shading and reestablished accurate perception of relief. These results demonstrate that the perception of the relief of physical surfaces depends upon the remembered position of an apparent light source.     

An experiment on the theory of visual motion perception

Two classes of theories of motion perception were studied: correlation and gradient models (in the sense of D. Marr). Random-dot kinematograms with a shifted square were presented to subjects, and the 80% threshold for detection of correct direction of movement was determined. Correlation models predict scale invariance, that is, a constant shift measured in units of texture elements of the translated pattern in spite of a geometric magnification. This was refuted for all subjects. The increase of the recognizable translation with the area of the translated form was verified except for the patterns with the largest texture elements (8 minutes of arc). This prediction, however, is not very specific for competing theories. Gradient models are not yet fully specified, and they contain some free parameters. They cannot be tested strictly, but there exist reasonable numerical parameter values by which our data can be satisfactorily explained.     

Multidimensional shape similarity in the development of visual object classification

The current work examined age differences in the classification of novel object images that vary in continuous dimensions of structural shape. The structural dimensions employed are two that share a privileged status in the visual analysis and representation of objects: the shape of discrete prominent parts and the attachment positions of those parts. Experiment 1 involved a triad classification task in which participants at each of three different ages (5 years, 8 years, and adult) classified object images from two distinct stimulus sets. Across both sets, the youngest children demonstrated a systematic bias toward the shape of discrete parts during their judgments. With increasing age, participants increasingly came to select both the shape and the position of parts when classifying the images. The findings from Experiment 2 indicate that the local shape bias observed in young children's classifications is not merely a consequence of a discrimination advantage for that dimension. Results are discussed in relation to corresponding age-related changes in other functional contexts of visual processing.     

A theory of dynamic occluded and illusory object perception

Humans see whole objects from input fragmented in space and time, yet spatiotemporal object perception is poorly understood. The authors propose the theory of spatiotemporal relatability (STR), which describes the visual information and processes that allow visible fragments revealed at different times and places, due to motion and occlusion, to be assembled into unitary perceived objects. They present a formalization of STR that specifies spatial and temporal relations for object formation. Predictions from the theory regarding conditions that lead to unit formation were tested and confirmed in experiments with dynamic and static, occluded and illusory objects. Moreover, the results support the identity hypothesis of a common process for amodal and modal contour interpolation and provide new evidence regarding the relative efficiency of static and dynamic object formation. STR postulates a mental representation, the dynamic visual icon, that briefly maintains shapes and updates positions of occluded fragments to connect them with visible regions. The theory offers a unified account of interpolation processes for static, dynamic, occluded, and illusory objects.     

Learning by selection: visual search and object perception in young infants

The authors examined how visual selection mechanisms may relate to developing cognitive functions in infancy. Twenty-two 3-month-old infants were tested in 2 tasks on the same day: perceptual completion and visual search. In the perceptual completion task, infants were habituated to a partly occluded moving rod and subsequently presented with unoccluded broken and complete rod test stimuli. In the visual search task, infants viewed displays in which single targets of varying levels of salience were cast among homogeneous static vertical distractors. Infants whose posthabituation preference indicated unity perception in the completion task provided evidence of a functional visual selective attention mechanism in the search task. The authors discuss the implications of the efficiency of attentional mechanisms for information processing and learning.     

Perspectival appearing and Gilbson's theory of visual perception

Summary Although Gibson (1979) did not explicitly discuss the perspectival appearing of the ecological environment, his important ecological approach to visual perception can accommodate both (a) the stream of visual-perceptual experience that flows at the heart of the visual system's total activity of ordinary visual perceiving (ordinary seeing), and (b) the dimension of the visual experiential stream that is the ecological environment's perspectival appearing to the visual perceiver. In the present article, perspectival appearing is located at the level of brain centers of the visual system, where processes are determined by the spatiotemporally structured visual stimulus flux. And the stream of visual experience is interpreted as itself possessing a kind of perspective structure (as does the visual stimulus flux), including variant and invariant features that the visual system isolates and extracts from experience, producing the perceiver's cognitive visual awareness-of (Gibson, 1979) the environment and self in the environment.     

The size illusion: visual and kinaesthetic information in size perception

Earlier studies have shown the size of kinaesthetically presented two-dimensional movement patterns to be significantly overestimated. Whether this size overestimation is characteristic of the kinaesthetic system alone has not been established. Two experiments are reported which were designed to investigate size judgment made after kinaesthetic and visual pattern presentation and the effect of environmental cues on the perception of movement patterns. In experiment 1 patterns were presented kinaesthetically (experimenter guided hand movements around the outline of the pattern) or in combination with visual information given by a moving light (pinpoint light attached to the stylus which was moved around the pattern); visual and kinaesthetic cues were either congruent or conflicting with each other; and environmental cues were either present or absent. In experiment 2 static visual display was compared with visually traced pattern presentation, again with or without environmental cues. Overall the results showed that, regardless of experimental manipulation, in all cases where the information was given over time the subject perceived the pattern larger than reality. After static visual display, overestimation of size did not occur.     

Identifying the information for the visual perception of relative phase

The production and perception of coordinated rhythmic movement are very specifically structured. For production and perception, 0 degree mean relative phase is stable, 180 degrees is less stable, and no other state is stable without training. It has been hypothesized that perceptual stability characteristics underpin the movement stability characteristics, which has led to the development of a phase-driven oscillator model (e.g., Bingham, 2004a, 2004b). In the present study, a novel perturbation method was used to explore the identity of the perceptual information being used in rhythmic movement tasks. In the three conditions, relative position, relative speed, and frequency (variables motivated by the model) were selectively perturbed. Ten participants performed a judgment task to identify 0 degree or 180 degrees under these perturbation conditions, and 8 participants who had been trained to visually discriminate 90 degrees performed the task with perturbed 90 degrees displays. Discrimination of 0 degree and 180 degrees was unperturbed in 7 out of the 10 participants, but discrimination of 90 degrees was completely disrupted by the position perturbation and was made noisy by the frequency perturbation. We concluded that (1) the information used by most observers to perceive relative phase at 0 degree and 180 degrees was relative direction and (2) becoming an expert perceiver of 90 degrees entails learning a new variable composed of position and speed.     

The perception and recognition of natural object shape from deforming and static shadows

In this study of the informativeness of shadows for the perception of object shape, observers viewed shadows cast by a set of natural solid objects and were required to discriminate between them. In some conditions the objects underwent rotation in depth while in other conditions they remained stationary, thus producing both deforming and static shadows. The orientation of the light source casting the shadows was also varied, leading to further alterations in the shape of the shadows. When deformations in the shadow boundary were present, the observers were able to reliably recognize and discriminate between the objects, invariant over the shadow distortions produced by movements of the light source. The recognition performance for the static shadows depended critically upon the content of the specific views that were shown. These results support the idea that there are invariant features of shadow boundaries that permit the recognition of shape (cf Koenderink, 1984 Perception 13 321-330).     

Reading your own lips: Common-coding theory and visual speech perception

Common-coding theory posits that (1) perceiving an action activates the same representations of motor plans that are activated by actually performing that action, and (2) because of individual differences in the ways that actions are performed, observing recordings of one’s own previous behavior activates motor plans to an even greater degree than does observing someone else’s behavior. We hypothesized that if observing oneself activates motor plans to a greater degree than does observing others, and if these activated plans contribute to perception, then people should be able to lipread silent video clips of their own previous utterances more accurately than they can lipread video clips of other talkers. As predicted, two groups of participants were able to lipread video clips of themselves, recorded more than two weeks earlier, significantly more accurately than video clips of others. These results suggest that visual input activates speech motor activity that links to word representations in the mental lexicon.     

Body ownership affects visual perception of object size by rescaling the visual representation of external space

Size perception is most often explained by a combination of cues derived from the visual system. However, this traditional cue approach neglects the role of the observer’s body beyond mere visual comparison. In a previous study, we used a full-body illusion to show that objects appear larger and farther away when participants experience a small artificial body as their own and that objects appear smaller and closer when they assume ownership of a large artificial body (“Barbie-doll illusion”; van der Hoort, Guterstam, & Ehrsson, PLoS ONE, 6(5), e20195, 2011). The first aim of the present study was to test the hypothesis that this own-body-size effect is distinct from the role of the seen body as a direct familiar-size cue. To this end, we developed a novel setup that allowed for occlusion of the artificial body during the presentation of test objects. Our results demonstrate that the feeling of ownership of an artificial body can alter the perceived sizes of objects without the need for a visible body. Second, we demonstrate that fixation shifts do not contribute to the own-body-size effect. Third, we show that the effect exists in both peri-personal space and distant extra-personal space. Finally, through a meta-analysis, we demonstrate that the own-body-size effect is independent of and adds to the classical visual familiar-size cue effect. Our results suggest that, by changing body size, the entire spatial layout rescales and new objects are now perceived according to this rescaling, without the need to see the body.     

The effect of spatial and nonspatial contextual information on visual object memory

Recent research has found visual object memory can be stored as part of a larger scene representation rather than independently of scene context. The present study examined how spatial and nonspatial contextual information modulate visual object memory. Two experiments tested participants’ visual memory by using a change detection task in which a target object's orientation was either the same as it appeared during initial viewing or changed. In addition, we examined the effect of spatial and nonspatial contextual manipulations on change detection performance. The results revealed that visual object representations can be maintained reliably after viewing arrays of objects. Moreover, change detection performance was significantly higher when either spatial or nonspatial contextual information remained the same in the test image. We concluded that while processing complex visual stimuli such as object arrays, visual object memory can be stored as part of a comprehensive scene representation, and both spatial and nonspatial contextual changes modulate visual memory retrieval and comparison.