Discrimination of 3-D shape and 3-D curvature from motion in active vision

We examined the ability of human observers to discriminate between different 3-D quadratic surfaces defined by motion, and with head position fed back to the stimulus to provide an up-to-date dynamical perspective view. We tested whether 3-D shape or 3-D curvature would affect discrimination performance. It appeared that discrimination of 3-D quadratic shape clearly depended on shape but not on the amount of curvature. Even when the amount of curvature was randomized, subjects’ performance was not altered. On the other hand, the discrimination of 3-D curvature clearly depended linearly on curvature with Weber fractions of 20% on the average and, to a small degree, on 3-D shape. The experiment shows that observers can easily separate 3-D shape and 3-D curvature, and that Koenderink’s shape index and curvedness provide a convenient way to specify shape. These results warn us against using just any arbitrary 3-D shape in 3-D shape perception tasks and indicate, for example, that emphasizing 3-D shape in computer displays by exaggerating curvature does not have any effect.     

Aging and the perception of depth and 3-D shape from motion parallax

The ability of younger and older observers to perceive 3-D shape and depth from motion parallax was investigated. In Experiment 1, the observers discriminated among differently curved 3-dimensional (3-D) surfaces in the presence of noise. In Experiment 2, the surfaces' shape was held constant and the amount of front-to-back depth was varied; the observers estimated the amount of depth they perceived. The effects of age were strongly task dependent. The younger observers' performance in Experiment 1 was almost 60% higher than that of the older observers. In contrast, no age effect was obtained in Experiment 2. Older observers can effectively perceive variations in depth from patterns of motion parallax, but their ability to discriminate 3-D shape is significantly compromised.     

The visual and haptic perception of natural object shape

In this study, we evaluated observers' ability to compare naturally shaped three-dimensional (3-D) objects, using their senses of vision and touch. In one experiment, the observers haptically manipulated 1 object and then indicated which of 12 visible objects possessed the same shape. In the second experiment, pairs of objects were presented, and the observers indicated whether their 3-D shape was the same or different. The 2 objects were presented either unimodally (vision-vision or haptic-haptic) or cross-modally (vision-haptic or haptic-vision). In both experiments, the observers were able to compare 3-D shape across modalities with reasonably high levels of accuracy. In Experiment 1, for example, the observers' matching performance rose to 72% correct (chance performance was 8.3%) after five experimental sessions. In Experiment 2, small (but significant) differences in performance were obtained between the unimodal vision-vision condition and the two cross-modal conditions. Taken together, the results suggest that vision and touch have functionally overlapping, but not necessarily equivalent, representations of 3-D shape.     

Relative Distance Perception Through Expanding and Contracting Motion and the Role of Propiospecific Information in Walking

Two experiments using a new device that correlates simulated optic flow with forward and backward head motions are reported. The first experiment tested the effectiveness of the rate of optical expansion/contraction as a cue for relative distance perception; the second experiment examined the role of propriospecific information in determining whether or not a simulated wall was perceived to moving relative to the ground. In walking along the line of sight in a stationary environment, the image of a nearer object expands/contracts more than the image of objects farther away. In Experiment 1, observers' abilities to judge which of two walls was nearer, according to expanding/contracting patterns, were tested. The results show that both walking and stationary observers can detect the order of depth from expansion patterns but not from the contraction patterns. Experiment 2 assessed the role of propriospecific information for specifying the motion or nonmotion of simulated 'wall' relative to the ground. The results show the importance of synchrony between expansion/contraction patterns and head motion. Whether or not an observer is obtaining information actively does not seem to matter for perceiving relative distance but it does matter in perceiving object motion.     

Aging and visual 3-D shape recognition from motion

Two experiments were conducted to evaluate the ability of younger and older adults to recognize 3-D object shape from patterns of optical motion. In Experiment 1, participants were required to identify dotted surfaces that rotated in depth (i.e., surface structure portrayed using the kinetic depth effect). The task difficulty was manipulated by limiting the surface point lifetimes within the stimulus apparent motion sequences. In Experiment 2, the participants identified solid, naturally shaped objects (replicas of bell peppers, Capsicum annuum) that were defined by occlusion boundary contours, patterns of specular highlights, or combined optical patterns containing both boundary contours and specular highlights. Significant and adverse effects of increased age were found in both experiments. Despite the fact that previous research has found that increases in age do not reduce solid shape discrimination, our current results indicated that the same conclusion does not hold for shape identification. We demonstrated that aging results in a reduction in the ability to visually recognize 3-D shape independent of how the 3-D structure is defined (motions of isolated points, deformations of smooth optical fields containing specular highlights, etc.).     

Effective 3-D shape discrimination survives retinal blur

A single experiment evaluated observers’ ability to visually discriminate 3-D object shape, where the 3-D structure was defined by motion, texture, Lambertian shading, and occluding contours. The observers’ vision was degraded to varying degrees by blurring the experimental stimuli, using 2.0-, 2.5-, and 3.0-diopter convex lenses. The lenses reduced the observers’ acuity from ?0.091 LogMAR (in the no-blur conditions) to 0.924 LogMAR (in the conditions with the most blur; 3.0-diopter lenses). This visual degradation, although producing severe reductions in visual acuity, had only small (but significant) effects on the observers’ ability to discriminate 3-D shape. The observers’ shape discrimination performance was facilitated by the objects’ rotation in depth, regardless of the presence or absence of blur. Our results indicate that accurate global shape discrimination survives a considerable amount of retinal blur.     

Visual inertia of rotating 3-D objects

Five experiments were designed to determine whether a rotating, transparent 3-D cloud of dots (simulated sphere) could influence the perceived direction of rotation of a subsequent sphere. Experiment 1 established conditions under which the direction of rotation of a virtual sphere was perceived unambiguously. When a near-far luminance difference and perspective depth cues were present, observers consistently saw the sphere rotate in the intended direction. In Experiment 2, a near-far luminance difference was used to create an unambiguous rotation sequence that was followed by a directionally ambiguous rotation sequence that lacked both the near-far luminance cue and the perspective cue. Observers consistently saw the second sequence as rotating in the same direction as the first, indicating the presence of 3-D visual inertia. Experiment 3 showed that 3-D visual inertia was sufficiently powerful to bias the perceived direction of a rotation sequence made unambiguous by a near-far luminance cue. Experiment 5 showed that 3-D visual inertia could be obtained using an occlusion depth cue to create an unambiguous inertia-inducing sequence. Finally, Experiments 2, 4, and 5 all revealed a fast-decay phase of inertia that lasted for approximately 800 msec, followed by an asymptotic phase that lasted for periods as long as 1,600 msec. The implications of these findings are examined with respect to motion mechanisms of 3-D visual inertia.     

3-D structure perceived from dynamic information: a new theory

Image movement provides one of the most potent two-dimensional cues for depth. From motion cues alone, the brain is capable of deriving a three-dimensional representation of distant objects. For many decades, theoretical and empirical investigations into this ability have interpreted these percepts as faithful copies of the projected 3-D structures. Here we review empirical findings showing that perceived 3-D shape from motion is not veridical and cannot be accounted for by the current models. We present a probabilistic model based on a local analysis of optic flow. Although such a model does not guarantee a correct reconstruction of 3-D shape, it is shown to be consistent with human performance.     

Mom’s shadow: structure-from-motion in newly hatched chicks as revealed by an imprinting procedure

The ability to recognize three-dimensional objects from two-dimensional (2-D) displays was investigated in domestic chicks, focusing on the role of the object’s motion. In Experiment 1 newly hatched chicks, imprinted on a three-dimensional (3-D) object, were allowed to choose between the shadows of the familiar object and of an object never seen before. In Experiments 2 and 3 random-dot displays were used to produce the perception of a solid shape only when set in motion. Overall, the results showed that domestic chicks were able to recognize familiar shapes from 2-D motion stimuli. It is likely that similar general mechanisms underlying the perception of structure-from-motion and the extraction of 3-D information are shared by humans and animals. The present data shows that they occur similarly in birds as known for mammals, two separate vertebrate classes; this possibly indicates a common phylogenetic origin of these processes.     

Trajectory forms as information for visual event recognition: 3-D perspectives on path shape and speed profile

Trajectory forms in events consist of the path shape and the speed profile (Bingham, 1987, 1995). Wickelgren and Bingham (2004) showed that adults can use the speed profile as visual information to recognize events from different perspectives, despite perspective distortions and differences in optical components. We now investigate whether adults can use trajectory forms to recognize events when the forms are viewed from 3-D perspectives and the path shape and speed profile vary. In Experiment 1, we tested recognition of events that differ in path shape (with the speed profile held constant). In Experiment 2, we tested recognition of events in which speed profiles were mapped onto circular paths. In Experiment 3, as a strong test of sensitivity to trajectory forms, we tested simultaneous separate recognition of speed profile and path shape when both varied across events. In all three experiments, events were viewed from multiple 3-D perspectives. The results show that both the shape of the path and the speed profile provide information for visual event recognition. We found that adults exhibit constancy (or view invariance) in being able to use trajectory forms to identify the same events when viewed from different 3-D perspectives.     

Syntactic awareness in young monolingual and bilingual (Urdu–English) children

In two experiments, bilingual (Urdu and English) 5- and 6-year-old children outperformed their monolingual (English) peers when asked to detect grammatically incorrect sentences on a syntactic awareness test. This result occurred when children were tested in English (Experiment 1) and when they were tested in English or in Urdu (Experiment 2). Bilingual children aged 3 and 4 were better at detecting grammatically incorrect sentences than their monolingual peers, but only when tested in Urdu. However, no significant differences appeared in monolingual and bilingual children's ability to detect grammatically correct sentences, suggesting that both grammatically correct and incorrect sentences should be used to obtain an accurate measure of syntactic awareness. The issue of whether it is bilingualism or the properties of a language that affect syntactic awareness is considered.     

Inhibition of vection by red

We investigated the effects of colors on vection induction. Expanding optical flows during one’s forward self-motion were simulated by moving dots. The dots and the background were painted in equiluminant red and green. Experiments 1 and 2 showed that vection was weaker when the background was red than when the background was green. In addition, Experiment 3 showed that vection was weaker when the moving dots were red than when the dots were green. Experiment 4 demonstrated that red dots on a red background induced very weak vection, as compared with green dots on a green background. In Experiments 5 and 6, we showed that the present results could not be explained by a luminance artifact. Furthermore, Experiment 7 showed that a moving red grating induced weaker vection than did a green one. We concluded that a red visual stimulus inhibits vection.     

The representation of moving 3-D objects in apparent motion perception

In the present research, we investigated the depth information contained in the representations of apparently moving 3-D objects. By conducting three experiments, we measured the magnitude of representational momentum (RM) as an index of the consistency of an object’s representation. Experiment 1A revealed that RM magnitude was greater when shaded, convex, apparently moving objects shifted to a flat circle than when they shifted to a shaded, concave, hemisphere. The difference diminished when the apparently moving objects were concave hemispheres (Experiment 1B). Using luminance-polarized circles, Experiment 2 confirmed that these results were not due to the luminance information of shading. Experiment 3 demonstrated that RM magnitude was greater when convex apparently moving objects shifted to particular blurred convex hemispheres with low-pass filtering than when they shifted to concave hemispheres. These results suggest that the internal object’s representation in apparent motion contains incomplete depth information intermediate between that of 2-D and 3-D objects, particularly with regard to convexity information with low-spatial-frequency components.     

3-D shape perception

In this paper, we analyze and test three theories of 3-D shape perception: (1) Helmholtzian theory, which assumes that perception of the shape of an object involves reconstructing Euclidean structure of the object (up to size scaling) from the object’s retinal image after taking into account the object’s orientation relative to the observer, (2) Gibsonian theory, which assumes that shape perception involves invariants (projective or affine) computed directly from the object’s retinal image, and (3) perspective invariants theory, which assumes that shape perception involves a new kind of invariants of perspective transformation. Predictions of these three theories were tested in four experiments. In the first experiment, we showed that reliable discrimination between a perspective and nonperspective image of a random polygon is possible even when information only about the contour of the image is present. In the second experiment, we showed that discrimination performance did not benefit from the presence of a textured surface, providing information about the 3-D orientation of the polygon, and that the subjects could not reliably discriminate between the 3-D orientation of the textured surface and that of a shape. In the third experiment, we compared discrimination for solid shapes that either had flat contours (cuboids) or did not have visible flat contours (cylinders). The discrimination was very reliable in the case of cuboids but not in the case of cylinders. In the fourth experiment, we tested the effectiveness of planar motion in perception of distances and showed that the discrimination threshold was large and similar to thresholds when other cues to 3-D orientation were used. All these results support perspective invariants as a model of 3-D shape perception.     

The perception of surface curvature from optical motion

Observers viewed the optical flow field of a rotating quadric surface patch and were required to match its perceived structure by adjusting the shape of a stereoscopically presented surface. In Experiment 1, the flow fields included rigid object rotations and constant flow fields with patterns of image acceleration that had no possible rigid interpretation. In performing their matches, observers had independent control of two parameters that determined the surface shape. One of these, called the shape characteristic, is defined as the ratio of the two principle curvatures and is independent of object size. The other, called curvedness, is defined as the sum of the squared principle curvatures and depends on the size of the object. Adjustments of shape characteristic were almost perfectly accurate for both motion conditions. Adjustments of curvedness, on the other hand, were systematically overestimated and were not highly correlated with the simulated curvedness of the depicted surface patch. In Experiment 2, the same flow fields were masked with a global pattern of curl, divergence, or shear, which disrupted the first-order spatial derivatives of the image velocity field, while leaving the second-order spatial derivatives invariant. The addition of these masks had only negligible effects on observers’ performance. These findings suggest that observers’ judgments of three-dimensional surface shape from motion are primarily determined by the second-order spatial derivatives of the instantaneous field of image displacements.     

Recovery of 3-D shape from deforming contours

Three experiments were conducted to examine the accuracy of 3-D shape recovery from deforming-contour displays. The displays simulated silhouettes of ellipsoids rotating about a vertical axis. Subjects judged the horizontal cross-section of the ellipsoids. The shape of the ellipsoid, the position of the axis of rotation, and the type of projection were manipulated in Experiment 1. The results indicated relatively accurate shape recovery when the major axis of the ellipsoid was small. In Experiment 2, the shape of the ellipsoid and the velocity and curvature of the contour were manipulated. When the rate of deformation of curvature was decreased, more eccentric shapes were reported. In Experiment 3, the shape of the object and the amount of simulated rotation were manipulated. Subjects made both shape and extent of rotation judgments. The results showed that eccentricity of shape responses could be accurately predicted from rotation responses, suggesting that the recovery of 3-D shape from smooth, deforming contours is dependent on the perceived extent of rotation.     

Individual differences in the shape bias in preschool children with specific language impairment and typical language development: theoretical and clinical implications

We investigated whether preschool children with specific language impairment (SLI) exhibit the shape bias in word learning: the bias to generalize based on shape rather than size, color, or texture in an object naming context (‘This is a wek; find another wek’) but not in a non‐naming similarity classification context (‘See this? Which one goes with this one?’). Fifty‐four preschool children (16 with SLI, 16 children with typical language [TL] in an equated control group, and 22 additional children with TL included in individual differences analyses but not group comparisons) completed a battery of linguistic and cognitive assessments and two experiments. In Experiment 1, children made generalization choices in object naming and similarity classification contexts on separate days, from options similar to a target object in shape, color, or texture. On average, TL children exhibited the shape bias in an object naming context, but children with SLI did not. In Experiment 2, we tested whether the failure to exhibit the shape bias might be linked to ability to detect systematicities in the visual domain. Experiment 2 supported this hypothesis, in that children with SLI failed to learn simple paired visual associations that were readily learned by children with TL. Analyses of individual differences in the two studies revealed that visual paired‐associate learning predicted degree of shape bias in children with SLI and TL better than any other measure of nonverbal intelligence or standard assessments of language ability. We discuss theoretical and clinical implications.     

Recognizing faces defined by texture gradients

Texture gradients can reveal surface orientation in a manner similar to shape from shading, and therefore provide an important cue for object recognition. In this study, we tested whether a complex 3-D object, such as a face, can be identified from texture gradients alone. The stimuli were laser-scanned faces for which the texture element was a fractal-noise pattern mapped onto the 3-D surface. An eight-alternative forced choice task was used in which participants matched a face defined by texture gradients to one of eight faces defined by shape from shading (Experiment 1) or by texture gradients (Experiment 2). On average, participants scored 24% and 18%, respectively, above chance in these experiments. Although this performance was much poorer than the performance based entirely on shape-from-shading stimuli (Experiment 3), the results suggest that texture gradient information may be used to recover surface geometry of complex objects.     

Planar motion permits perception of metric structure in stereopsis

A fundamental problem in the study of spatial perception concerns whether and how vision might acquire information about the metric structure of surfaces in three-dimensional space from motion and from stereopsis. Theoretical analyses have indicated that stereoscopic perceptions of metric relations in depth require additional information about egocentric viewing distance; and recent experiments by James Todd and his colleagues have indicated that vision acquires only affine but not metric structure from motion—that is, spatial relations ambiguous with regard to scale in depth. The purpose of the present study was to determine whether the metric shape of planar stereoscopic forms might be perceived from congruence under planar rotation. In Experiment 1, observers discriminated between similar planar shapes (ellipses) rotating in a plane with varying slant from the frontal-parallel plane. Experimental conditions varied the presence versus absence of binocular disparities, magnification of the disparity scale, and moving versus stationary patterns. Shape discriminations were accurate in all conditions with moving patterns and were near chance in conditions with stationary patterns; neither the presence nor the magnification of binocular disparities had any reliable effect. In Experiment 2, accuracy decreased as the range of rotation decreased from 80° to 10°. In Experiment 3, small deviations from planarity of the motion produced large decrements in accuracy. In contrast with the critical role of motion in shape discrimination, motion hindered discriminations of the binocular disparity scale in Experiment 4. In general, planar motion provides an intrinsic metric scale that is independent of slant in depth and of the scale of binocular disparities. Vision is sensitive to this intrinsic optical metric.     

Planar motion permits perception of metric structure in stereopsis.

A fundamental problem in the study of spatial perception concerns whether and how vision might acquire information about the metric structure of surfaces in three-dimensional space from motion and from stereopsis. Theoretical analyses have indicated that stereoscopic perceptions of metric relations in depth require additional information about egocentric viewing distance; and recent experiments by James Todd and his colleagues have indicated that vision acquires only affine but not metric structure from motion--that is, spatial relations ambiguous with regard to scale in depth. The purpose of the present study was to determine whether the metric shape of planar stereoscopic forms might be perceived from congruence under planar rotation. In Experiment 1, observers discriminated between similar planar shapes (ellipses) rotating in a plane with varying slant from the frontal-parallel plane. Experimental conditions varied the presence versus absence of binocular disparities, magnification of the disparity scale, and moving versus stationary patterns. Shape discriminations were accurate in all conditions with moving patterns and were near chance in conditions with stationary patterns; neither the presence nor the magnification of binocular disparities had any reliable effect. In Experiment 2, accuracy decreased as the range of rotation decreased from 80 degrees to 10 degrees. In Experiment 3, small deviations from planarity of the motion produced large decrements in accuracy. In contrast with the critical role of motion in shape discrimination, motion hindered discriminations of the binocular disparity scale in Experiment 4. In general, planar motion provides an intrinsic metric scale that is independent of slant in depth and of the scale of binocular disparities. Vision is sensitive to this intrinsic optical metric.