Planar motion permits perception of metric structure in stereopsis

A fundamental problem in the study of spatial perception concerns whether and how vision might acquire information about the metric structure of surfaces in three-dimensional space from motion and from stereopsis. Theoretical analyses have indicated that stereoscopic perceptions of metric relations in depth require additional information about egocentric viewing distance; and recent experiments by James Todd and his colleagues have indicated that vision acquires only affine but not metric structure from motion—that is, spatial relations ambiguous with regard to scale in depth. The purpose of the present study was to determine whether the metric shape of planar stereoscopic forms might be perceived from congruence under planar rotation. In Experiment 1, observers discriminated between similar planar shapes (ellipses) rotating in a plane with varying slant from the frontal-parallel plane. Experimental conditions varied the presence versus absence of binocular disparities, magnification of the disparity scale, and moving versus stationary patterns. Shape discriminations were accurate in all conditions with moving patterns and were near chance in conditions with stationary patterns; neither the presence nor the magnification of binocular disparities had any reliable effect. In Experiment 2, accuracy decreased as the range of rotation decreased from 80° to 10°. In Experiment 3, small deviations from planarity of the motion produced large decrements in accuracy. In contrast with the critical role of motion in shape discrimination, motion hindered discriminations of the binocular disparity scale in Experiment 4. In general, planar motion provides an intrinsic metric scale that is independent of slant in depth and of the scale of binocular disparities. Vision is sensitive to this intrinsic optical metric.     

The perception of shape and curvedness from binocular stereopsis and structure from motion

The integration of binocular stereopsis and kinetic depth was measured for two distinct aspects of 3-Dstructure: (1)shape index, which is a measure of scale-independent structure, and (2)curvedness, which is a measure of scale-dependent structure. We found that motion contributes significantly more to judged shape index than it does to judged curvedness, and stereo contributes significantly more to judged curvedness than it does to judged shape index. This suggests that the differences in the relative contribution of motion and stereo reported here occurred because these two sources do not equally specify the scale-dependent and scale-independent aspects of surface structure. Furthermore, these results seem to be inconsistent with integration models in which the different visual cues all initially contribute to the same single representation of 3-Dstructure.     

Conditions under which stereopsis and motion perception are blind

We describe modified random-dot stereograms in which the corresponding elements differ from non-corresponding elements in colour, size, and luminance. Despite these visible differences between the elements, depth perception collapses when the spatially integrated luminous flux is similar for the corresponding and non-corresponding elements. Our results suggest that a low-pass spatial filter precedes the mechanism that recognises disparity. A similar phenomenon is observed for the perception of coherent motion in random-dot kinematograms. Our modified stereograms and kinematograms may find other uses when experimenters wish to study the contribution of colour to visual processes and require a method of eliminating edge artifacts.     

The interplay between stereopsis and structure from motion

In a series of psychophysical experiments, an adaptation paradigm was employed to study the influence of stereopsis on perception of rotation in an ambiguous kinetic depth (KD) display. Without prior adaptation or stereopsis, a rotating globe undergoes spontaneous reversals in perceived direction of rotation, with successive durations of perceived rotation being random variables. Following 90 sec of viewing a stereoscopic globe undergoing unambiguous rotation, the KD globe appeared to rotate in a direction opposite that experienced during the stereoscopic adaptation period. This adaptation aftereffect was short-lived, and it occurred only when the adaptation and test figures stimulated the same retinal areas, and only when the adaptation and test figures rotated about the same axis. The aftereffect was just as strong when the test and adaptation figures had different shapes, as long as the adaptation figure contained multiple directions of motion imaged at different retinal disparities. Nonstereoscopic adaptation figures had no effect on the perceived direction of rotation of the ambiguous KD figure. These results imply that stereopsis and motion strongly interact in the specification of structure from motion, a result that complements earlier work on this problem.     

Topological structure in the perception of apparent motion

Not only translations and rotations, but also intriguing 'plastic deformations' are observed in apparent motion. What kinds of invariants does the visual system depend on during these transformations to determine that two figures of different shapes nevertheless represent the same object? Experiments are reported in which seven pairs of stimuli with topological differences were used. The evidence suggests that topological invariants may be used in the perception of apparent motion. In spite of variations in other factors, such as brightness, spatial frequency, terminators, etc, subjects displayed a strong preference for motion from a central figure to a figure with the same topological invariants. The results emphasize the importance of topological structure in figure perception.     

Gender differences in apparent motion perception.

Distance disparity is a strong cue to element correspondence in apparent motion. Using a 2-AFC paradigm we have previously shown that shape similarity also plays a role. We now demonstrate a small gender difference in these effects: women are more sensitive to distance disparity, whereas men are more sensitive to differences in shape. Furthermore, in the competing presence of a shape cue, women's sensitivity to distance decreases while men's sensitivity is unaffected. These observations may be related to putative gender differences in the 'form' and 'motion-spatial relations' cortical pathways.     

The perception of shrinking in apparent motion.

Apparent motion was produced using two triangular patterns of different sizes, each exposed for 100 msec, with a 50-msec interstimulus interval and 200-msec recycle interval. The triangles were aligned either on center or on the midpoints of the bases. In Experiment 1, filled, outline, and three-dot triangles were viewed over four backgrounds: a blank illuminated field, and texture gradients constructed from horizontal lines, perspective lines, or a combination of these (full texture). In Experiment 2, outline and dot triangles were presented in one of three orientations: base down, base right, and base up over a blank background. Subjects made two forced-choice responses: apparent size was categorized as shrinking or not shrinking, and apparent motion was categorized as motion in depth or motion in a fixed frontal plane. The type of alignment was the major determiner of responses. When the midpoints of the base were aligned, the predominant response described a shrinking object in a fixed position in depth. When the centers were aligned, the predominant response described an object of constant size moving in depth.     

Postfusional latency in stereoscopic slant perception and the primitives of stereopsis

Random dot stereograms of slanted surfaces were constructed, each representing one or two slanted surfaces in different relative arrangements and with different axes. Latency to fusion and from fusion to stereoscopic resolution was measured for each stimulus. It was found that latency to fusion was always very brief but that latency to stereoscopic resolution varied markedly, depending upon the orientation and arrangement of the stereoscopic surfaces. A gradient of discontinuities at a surface boundary produced an instant slant response for that surface, whereas a gradient of absolute disparities across the surface did not, except under conditions where vertical declination (a form of orientation disparity) was present. We conclude that stereopsis is not based on the primitives used in matching the images for fusion and that it is, at least initially, a response to disparity discontinuities which play no role in the fusion process. We also conclude that vertical declination is responded to globally as a slant around a horizontal axis but that other forms of orientation disparity are ineffective. The evidence from our experiments does not support the existence of a stereoscopic ability to respond globally to differences in magnification (or spatial frequency). It is suggested that stereoscopic perception of slant around a vertical axis is slow because it results from the integration of local processes.     

Attentional modulation in perception of visual motion events.

Identical visual targets moving across each other with equal and constant speed can be perceived either to bounce off or to stream through each other. This bistable motion perception has been studied mostly in the context of motion integration. Since the perception of most ambiguous motion is affected by attention, there is the possibility of attentional modulation occurring in this case as well. We investigated whether distraction of attention from the moving targets would alter the relative frequency of each percept. During the observation of the streaming/bouncing motion event in the peripheral visual field, visual attention was disrupted by an abrupt presentation of a visual distractor at various timings and locations (experiment 1; exogenous distraction of attention) or by the demand of an additional discrimination task (experiments 2 and 3; endogenous distraction of attention). Both types of distractions of attention increased the frequency of the bouncing percept and decreased that of the streaming percept. These results suggest that attention may facilitate the perception of object motion as continuing in the same direction as in the past.     

Determinants of the perception of sagittal motion.

This study examines the change in the perceived distance of an object in three-dimensional space when the object and/or the observer's head is moved along the line of sight (sagittal motion) as a function of the perceived absolute (egocentric) distance of the object and the perceived motion of the head. To analyze the processes involved, two situations, labeled A and B, were used in four experiments. In Situation A, the observer was stationary and the perceived motion of the object was measured as the object was moved toward and away from the observer. In Situation B, the same visual information regarding the changing perceived egocentric distance between the observer and object was provided as in Situation A, but part or all of the change in visual egocentric distance was produced by the sagittal motion of the observer's head. A comparison of the perceived motion of the object in the two situations was used to measure the compensation in the perception of the motion of the object as a result of the head motion. Compensation was often clearly incomplete, and errors were often made in the perception of the motion of the stimulus object. A theory is proposed, which identifies the relation between the changes in the perceived egocentric distance of the object and the tandem motion of the object resulting from the perceived motion of the head to be the significant factor in the perception of the sagittal motion of the stimulus object in Situation B.     

Perception of Glass pattern structure with stereopsis

Stereograms are presented which demonstrate that the perceptual salience of structure in Glass patterns may be destroyed or created by the introduction of stereoscopic depth effects. Novel three-dimensional pattern structures can also be produced. Proposals concerning the nature of the primal sketch are evaluated in the light of these findings, and it is concluded that the findings are consistent with the view that depth derived from disparity information is explicitly represented in the primal sketch.     

Adaptation in motion perception: Alteration of induced motion

Prolonged exposure to a condition that causes induced motion was found to diminish this effect. The extent of a horizontal induced motion was measured by obtaining estimates of the direction of the apparent oblique path that resulted when a spot was visible on a horizontally moving pattern and was therefore in horizontal induced motion and, at the same time, moved vertically. Because the horizontal component of the perceived motion path represented the induced motion, the slope of the path measured the extent of the induced motion. After a 10-min exposure to induced motion, the apparent motion path was steeper; the mean change corresponded to a 15% smaller extent of the induced motion. Results were obtained that argue that this effect is not due to a diminished horizontal motion of the pattern but amounts to a smaller motion-inducing effect. The experiments were meant to support the view that the perceptual process that underlies induced motion is learned.     

The perception of 3-dimensional affine structure from minimal apparent motion sequences

The research described in the present article was designed to identify the minimal conditions for the visual perception of 3-dimensional structure from motion by comparing the theoretical limitations of ideal observers with the perceptual performance of actual human subjects on a variety of psychophysical tasks. The research began with a mathematical analysis, which showed that 2-frame apparent motion sequences are theoretically sufficient to distinguish between rigid and nonrigid motion and to identify structural properties of an object that remain invariant under affine transformations, but that 3 or more distinct frames are theoretically necessary to adequately specify properties of euclidean structure such as the relative 3-dimensional lengths or angles between nonparallel line segments. A series of four experiments was then performed to verify the psychological validity of this analysis. The results demonstrated that the determination of structure from motion in actual human observers may be restricted to the use of first order temporal relations, which are available within 2-frame apparent motion sequences. That is to say, the accuracy of observers' judgments did not improve in any of these experiments as the number of distinct frames in an apparent motion sequence was increased from 2 to 8, and performance on tasks involving affine structure was of an order of magnitude greater than performance on similar tasks involving euclidean structure.     

A counterexample to the rigidity assumption in the visual perception of structure from motion

It has been proposed that the human visual system prefers perceptions of objects that are rigid or undergo minimum form change. A counterexample is presented in which a rigid two-dimensional figure rotating in the frontal plane is perceived as a distorting three-dimensional shape. It is argued that this perception results from the stimulation of automatic processes for perceiving size change, and that these processes are not subject to a general rigidity assumption.     

Cortical dynamics of visual motion perception: short-range and long-range apparent motion.

This article describes further evidence for a new neural network theory of biological motion perception. The theory clarifies why parallel streams V1----V2, V1----MT, and V1----V2----MT exist for static form and motion form processing among the areas V1, V2, and MT of visual cortex. The theory suggests that the static form system (Static BCS) generates emergent boundary segmentations whose outputs are insensitive to direction-of-contrast and to direction-of-motion, whereas the motion form system (Motion BCS) generates emergent boundary segmentations whose outputs are insensitive to direction-of-contrast but sensitive to direction-of-motion. The theory is used to explain classical and recent data about short-range and long-range apparent motion percepts that have not yet been explained by alternative models. These data include beta motion, split motion, gamma motion and reverse-contrast gamma motion, delta motion, and visual inertia. Also included are the transition from group motion to element motion in response to a Ternus display as the interstimulus interval (ISI) decreases; group motion in response to a reverse-contrast Ternus display even at short ISIs; speed-up of motion velocity as interflash distance increases or flash duration decreases; dependence of the transition from element motion to group motion on stimulus duration and size, various classical dependencies between flash duration, spatial separation, ISI, and motion threshold known as Korte's laws; dependence of motion strength on stimulus orientation and spatial frequency; short-range and long-range form-color interactions; and binocular interactions of flashes to different eyes.     

Interpolation in structure from motion.

We investigated surface interpolation in displays of structure from motion (SFM). To do so, we introduced a new method for measuring surface perception in dynamic displays--the SFM probe. An SFM probe is a dot that moves rigidly with the dots on a simulated surface, and whose distance from that surface can be adjusted with a joystick or similar control. The displays we studied were random-dot cylinders containing a vertical strip devoid of feature points (the gap). Subjects adjusted an SFM probe, presented in the gap, until the probe dot appeared to be on the surface. Variability in probe-dot placement decreased with increasing texture density on the cylinder and increased with increasing gap width. Subjects showed a consistent bias to place the probe dot outside the cylinder. This bias increased with increasing texture density for the SFM displays. (The opposite bias was found in a static two-dimensional interpolation task with an arc whose curvature matched that of the cylinder: Subjects placed the probe dot inside the arc.) This outside bias is inconsistent with several theoretical approaches to surface interpolation.