Motion parallax driven by head movements: conditions for visual stability, perceived depth, and perceived concomitant motion

Yoking the movement of the stimulus on the screen to the movement of the head, we examined visual stability and depth perception as a function of head-movement velocity and parallax. In experiment 1, for different head velocities, observers adjusted the parallax to find (a) the depth threshold and (b) the concomitant-motion threshold. Between these thresholds, depth was seen with no perceived motion. In experiment 2, for different head velocities, observers adjusted the parallax to produce the same perceived depth. A slower head movement required a greater parallax to produce the same perceived depth as faster head movements. In experiment 3, observers reported the perceived depth for different parallax magnitudes. Perceived depth covaried with smaller parallax without motion perception, but began to decrease with larger parallax and concomitant motion was seen. Only motion was seen with the larger parallax.     

The appearance of surfaces specified by motion parallax and binocular disparity

The experiments reported in this paper were designed to investigate how depth information from binocular disparity and motion parallax cues is integrated in the human visual system. Observers viewed simulated 3-D corrugated surfaces that translated to and fro across their line of sight. The depth of the corrugations was specified by either motion parallax, or binocular disparities, or some combination of the two. The amount of perceived depth in the corrugations was measured using a matching technique.

A monocularly viewed surface specified by parallax alone was seen as a rigid, corrugated surface translating along a fronto-parallel path. The perceived depth of the corrugations increased monotonically with the amount of parallax motion, just as if observers were viewing an equivalent real surface that produced the same parallax transformation. With binocular viewing and zero disparities between the images seen by the two eyes, the perceived depth was only about half of that predicted by the monocular cue. In addition, this binocularly viewed surface appeared to rotate about a vertical axis as it translated to and fro. With other combinations of motion parallax and binocular disparity, parallax only affected the perceived depth when the disparity gradients of the corrugations were shallow. The discrepancy between the parallax and disparity signals was typically resolved by an apparent rotation of the surface as it translated to and fro. The results are consistent with the idea that the visual system attempts to minimize the discrepancies between (1) the depth signalled by disparity and that required by a particular interpretation of the parallax transformation and (2) the amount of rotation required by that interpretation and the amount of rotation signalled by other cues in the display.     

Relative distance cues contribute to scaling depth from motion parallax

The visual system scales motion parallax signals with information about absolute distance (M. E. Ono, Rivest, & H. Ono, 1986). The present study was designed to determine whether relative distance cues, which intrinsically provide information about relative distance, contribute to this scaling. In two experiments, two test stimuli, containing an equal extent of motion parallax, were presented simultaneously at a fixed viewing distance. The relative distance cues of dynamic occlusion and motion parallax in the areas surrounding the test stimuli (background motion parallax) and/or relative size were manipulated. The observers reported which of the two parallactic test stimuli appeared to have greater depth, and which appeared to be more distant. The results showed that the test stimulus specified, by the relative distance cues, as being more distant was perceived as having more depth and as being more distant. This indicates that relative distance cues contribute to scaling depth from motion parallax by modifying the information about the absolute distance of objects.     

Dynamic occlusion and motion parallax in depth perception

Random-dot techniques were used to examine the interactions between the depth cues of dynamic occlusion and motion parallax in the perception of three-dimensional (3-D) structures, in two different situations: (a) when an observer moved laterally with respect to a rigid 3-D structure, and (b) when surfaces at different distances moved with respect to a stationary observer. In condition (a), the extent of accretion/deletion (dynamic occlusion) and the amount of relative motion (motion parallax) were both linked to the motion of the observer. When the two cues specified opposite, and therefore contradictory, depth orders, the perceived order in depth of the simulated surfaces was dependent on the magnitude of the depth separation. For small depth separations, motion parallax determined the perceived order, whereas for large separations it was determined by dynamic occlusion. In condition (b), where the motion parallax cues for depth order were inherently ambiguous, depth order was determined principally by the unambiguous occlusion information.     

Disruption of eye movements by ethanol intoxication affects perception of depth from motion parallax

Motion parallax, the ability to recover depth from retinal motion generated by observer translation, is important for visual depth perception. Recent work indicates that the perception of depth from motion parallax relies on the slow eye movement system. It is well known that ethanol intoxication reduces the gain of this system, and this produces the horizontal gaze nystagmus that law enforcement's field sobriety test is intended to reveal. The current study demonstrates that because of its influence on the slow eye movement system, ethanol intoxication impairs the perception of depth from motion parallax. Thresholds in a motion parallax task were significantly increased by acute ethanol intoxication, whereas thresholds for an identical test relying on binocular disparity were unaffected. Perhaps a failure of motion parallax plays a role in alcohol-related driving accidents; because of the effects of alcohol on eye movements, intoxicated drivers may have inaccurate or inadequate information for judging the relative depth of obstacles from motion parallax.     

Depth perception as a function of motion parallax and absolute-distance information

The results of three experiments demonstrated that the visual system calibrates motion parallax according to absolute-distance information in processing depth. The parallax was created by yoking the relative movement of random dots displayed on a cathode-ray tube to the movements of the head. In Experiment 1, at viewing distances of 40 cm and 80 cm, observers reported the apparent depth produced by motion parallax equivalent to a binocular disparity of 0.47 degree. The mean apparent depth at 80 cm was 2.6 times larger than at 40 cm. In Experiment 2, again at viewing distances of 40 cm and 80 cm, observers adjusted the extent of parallax so that the apparent depth was 7.0 cm. The mean extent of parallax at 80 cm was 31% of that at 40 cm. In Experiment 3, distances ranged from 40 cm to 320 cm, and a wide range of parallax was used. As distance and parallax increased, the perception of a rigid three-dimensional surface was accompanied by rocking motion; perception of depth was replaced by perception of motion in some trials at 320 cm. Moreover, the mean apparent depths were proportional to the viewing distance at 40 cm and 80 cm but not at 160 cm and 320 cm.     

Integration of motion parallax with binocular disparity specifying different surface shapes

We investigated the interaction between motion parallax and binocular disparity cues in the perception of surface shape and depth magnitude by the use of the random dot stimuli in which these cues specified sinusoidal depth surfaces undulating with different spatial frequencies. When ambiguous motion parallax is inconsistent with unambiguous disparity cue, the reasonable solution for the visual system is to convert the motion signal to the flow on the surface specified by disparity. Two experiments, however, found that the visual system did not always use this reasonable solution; observers often perceived the surface specified by a composite of the two cues, or the surface specified by parallax alone. In the perception of this composite of the two cues, the apparent depth magnitude increased with the increase of the depth magnitude specified by both cues. This indicates that the visual system can combine the depth magnitude information from parallax and disparity in an additive fashion. The interference with parallax by disparity implies that the parallax processing is not independent of the disparity processing.     

The development of depth perception from motion parallax in infancy

North Dakota State University, Fargo, North Dakota Little is known about infants' perception of depth from motion parallax, even though it is known that infants are sensitive both to motion and to depth-from-motion cues at an early age. The present experiment assesses whether infants are sensitive to the unambiguous depth specified by motion parallax and, if so, when this sensitivity first develops. Eleven infants were followed longitudinally from 8 to 29 weeks. Infants monocularly viewed a translating Rogers and Graham (1979) random-dot stimulus, which appears as a corrugated surface to adult observers. Using the infant-control habituation paradigm, looking time was recorded for each 10-sec trial until habituation, followed by two test trials: one using a depth-reversed and one using a flat stimulus. Dishabituation results indicate that infants may be sensitive to unambiguous depth from motion parallax by 16 weeks of age. Implications for the developmental sequence of depth from motion, stereopsis, and eye movements are discussed.     

Performance and presence with head-movement produced motion parallax in simulated driving

Driving simulator studies can reveal relevant and valid aspects of driving behavior, but underestimation of distance and speed can negatively affect the driver’s performance, such as in performance of overtaking. One possible explanation for the underestimation of distance and speed is that two-dimensional projection of the visual scene disrupts the monocular-based illusory depth because of conflicting binocular and monocular information of depth. A possible solution might involve the strengthening of the monocular information so that the binocular information becomes less potent. In the present study, we used an advanced high-fidelity driving simulator to investigate whether adding the visual depth information of motion parallax from head movement affects sense of presence, judgment of distance and speed, and performance measures coupled with overtaking. The simulations included two types of driving scenario in which one was urban and the other was rural. The main results show no effect of this head-movement produced motion parallax on sense of presence, head movement, time to collision, distance judgment, or speed judgment. However, the results show an effect on lateral positioning. When initiating the overtaking maneuver there is a lateral positioning farther away from the road center as effect of the motion parallax in both types of scenario, which can be interpreted as indicating use of naturally occurring information that change behavior at overtaking. Nevertheless, only showing tendencies of effects, absent is any clear additional impact of this motion parallax in the simulated driving.     

Relationship between binocular disparity and motion parallax in surface detection

The ability to detect surfaces was studied in a multiple-cue condition in which binocular disparity and motion parallax could specify independent depth configurations. On trials on which binocular disparity and motion parallax were presented together, either binocular disparity or motion parallax could indicate a surface in one of two intervals; in the other interval, both sources indicated a volume of random points. Surface detection when the two sources of information were present and compatible was not better than detection in baseline conditions, in which only one source of information was present. When binocular disparity and motion specified incompatible depths, observers’ ability to detect a surface was severely impaired if motion indicated a surface but binocular disparity did not. Performance was not as severely degraded when binocular disparity indicated a surface and motion did not. This dominance of binocular disparity persisted in the presence of foreknowledge about which source of information would be relevant.     

Detectability of motion as a factor in depth perception by monocular movement parallax

A display of two objects at different distances was presented to 10 observers, who were requested in two experiments to match the width of the more distant (comparison) object to the width of the nearer (standard) one under conditions permitting monocular observation and lateral head motion. The matched width of the comparison object was considered a measure of the effectiveness of movement parallax. The effectiveness of movement parallax decreases with increasing angular separation of the objects and with increasing background distance. A background without visible texture leads to a better perception of depth between two objects than a textured background The results can be explained by postulating that, whenever the detectability of motion is enhanced, i.e., the threshold for the detection of motion is lowered, the effectiveness of movement parallax as a cue to depth is increased.     

The observer-relative velocity field as the basis for effective motion parallax

Earlier studies of motion parallax found unambiguous relative depth perception when random dot patterns were systematically translated in accordance with either motion of the observer's head or motion of the display scope. The need for such relative motion between an observer and a flow field was examined by placing a flow field in a limited area (window) in a large scope and translating the window relative to the observer. Accuracy in judging surface orientation and quantitative depth estimates were determined by the velocity field relative to the observer and were not measurably affected by whether this field was produced with a stationary or a moving window. Accuracy was consistently higher for smaller ratios of maximum to minimum projected velocities, reaching 100% in one experiment with a 1.12:1 ratio. We conclude that fully effective motion parallax does not require relative motion between the observer's head and the contours of a flow field.     

Reversals of visual depth caused by motion parallax

The role of the velocity and direction of retinal movement in the determination of apparent depth from motion parallax was examined. Motion parallax was produced either by linking the movement of random-dots to head movement or by making this motion independent of the head movement. The results show that apparent depth was largely estimated from the velocity difference between the stimuli. The direction of retinal movement in the absence of head movement did not determine whether the pattern appeared to protrude or recede. Information about direction linked to head movement was able to stabilize protrusion/recession by providing a cue for the location of the fixation point. Depth reversal occurred less frequently in the presence than in the absence of head movement. When the fixation point shifted from the apparently protruding pattern to the apparently receding pattern, in both the presence and absence of head movement, depth reversal was readily observed.     

Aging and the perception of depth and 3-D shape from motion parallax

The ability of younger and older observers to perceive 3-D shape and depth from motion parallax was investigated. In Experiment 1, the observers discriminated among differently curved 3-dimensional (3-D) surfaces in the presence of noise. In Experiment 2, the surfaces' shape was held constant and the amount of front-to-back depth was varied; the observers estimated the amount of depth they perceived. The effects of age were strongly task dependent. The younger observers' performance in Experiment 1 was almost 60% higher than that of the older observers. In contrast, no age effect was obtained in Experiment 2. Older observers can effectively perceive variations in depth from patterns of motion parallax, but their ability to discriminate 3-D shape is significantly compromised.     

The visual control of reaching and grasping: binocular disparity and motion parallax

The primary visual sources of depth and size information are binocular cues and motion parallax. Here, the authors determine the efficacy of these cues to control prehension by presenting them in isolation from other visual cues. When only binocular cues were available, reaches showed normal scaling of the transport and grasp components with object distance and size. However, when only motion parallax was available, only the transport component scaled reliably. No additional increase in scaling was found when both cues were available simultaneously. Therefore, although equivalent information is available from binocular and motion parallax information, the latter may be of relatively limited use for the control of the grasp. Binocular disparity appears selectively important for the control of the grasp.     

Apparent depth with retinal image motion of expansion and contraction yoked to head movement

The two main questions addressed in this study were (a) what effect does yoking the relative expansion and contraction (EC) of retinal images to forward and backward head movements have on the resultant magnitude and stability of perceived depth, and (b) how does this relative EC image motion interact with the depth cues of motion parallax? Relative EC image motion was produced by moving a small CCD camera toward and away from the stimulus, two random-dot surfaces separated in depth, in synchrony with the observers' forward and backward head movements. Observers viewed the stimuli monocularly, on a helmet-mounted display, while moving their heads at various velocities, including zero velocity. The results showed that (a) the magnitude of perceived depth was smaller with smaller head velocities (< 10 cm s-1), including the zero-head-velocity condition, than with a larger velocity (10 cm s-1), and (b) perceived depth, when motion parallax and the EC image motion cues were simultaneously presented, is equal to the greater of the two possible perceived depths produced from either of these two cues alone. The results suggested the role of nonvisual information of self-motion on perceiving depth.     

Implied motion produces real depth

Static images taken from an animation of continuous motion, such as a photograph of a figure in a running pose, contain no real motion (RM) information. Interestingly, while imaging studies have shown that passively viewing these implied motion (IM) stimuli activate the same brain regions as RM, the perceptual effects of adding IM to RM are not fully understood. Given that IM appears to recruit the same neural mechanisms as RM, it should be possible to capitalize on this functional overlap and use IM in addition to, or in place of, RM to influence the perception of depth from motion parallax (MP). In the current study, we found that IM influenced depth-sign judgments as expected based on the geometry of MP with RM. These results bolster our understanding of the neural mechanisms of both IM and MP by demonstrating that IM coupled with pursuit eye movements generates unambiguous depth from MP.     

Development of depth perception mediated by motion parallax in unidimensional projections of rotation in depth.

Motion parallax is a composite of five transformations demonstrated to be effective in adult judgments of rotation direction in polar motion projections of a horizontal row of dots rotating in depth. The effectiveness of these transformations as a function of age was tested by presenting six such motion projections to first graders (age = 6 years), seventh graders (age = 13 years), and college students (age = 19 years). Identical age functions were obtained for judged rotation direction from the four motion projections representing (1) Velocity, corresponding to the traditional definition of motion parallax as differential velocity, (2) Velocity plus differences between ratios of instantaneous displacement to instantaneous acceleration for dots on the near and far sides of the rotation axis ($\text{D}\text{A}$ Difference), (3) Velocity, $\text{D}\text{A}$ Difference, and a gradient across the row of $\text{D}\text{A}$ ratios, and (4) all transformations. First graders, unable to use horizontal transformations, performed at chance on these four projections, while older students made correct judgments. Order, separated from Velocity for the first time, resulted in chance performance at all ages, while Direction, also separated from Velocity for the first time, resulted in veridical judgments in only 4 of 24 college students.     

The roles of convergence and apparent distance in depth constancy with motion parallax

The question of whether motion parallax is calibrated by convergence or by apparent distance for depth perception was addressed in three experiments. In Experiment 1, a random dot parallactic display was viewed monocularly at a distance of 80 cm, and the convergence angles were set for distances of 40, 60, and 80 cm. Averaged apparent depth was not different across conditions. In Experiment 2, a display consisting of one surface showing dollar bills and one surface showing random dots was viewed monocularly at a distance of 80 cm. It was presented at two different apparent distances, which were manipulated by varying the size of the dollar bills. In one condition, normally sized dollar bills were presented, and in another condition, the size was reduced by 30%. The averaged apparent depth associated with the small-bill display was larger than the depth associated with the normally sized bill display. In Experiment 3, a random dot display was viewed monocularly at 120 cm. In the primary condition, the random dot display was viewed with an induction screen at 80 cm, and it was moved from side to side such that it appeared stationary and close to the plane of the induction screen. In a comparison condition, the display was viewed without the induction screen and was moving from side to side at 120 cm. In another comparison condition, the display was again viewed without the induction screen but was stationary at 120 cm. Observers adjusted the extent of motion parallax so that apparent depth was 1 cm. The mean extent of parallax was larger in the primary conditio.(ABSTRACT TRUNCATED AT 250 WORDS)     

Aging and the perception of slant from optical texture, motion parallax, and binocular disparity

The ability of younger and older observers to perceive surface slant was investigated in four experiments. The surfaces possessed slants of 20°, 35°, 50°, and 65°, relative to the frontoparallel plane. The observers judged the slants using either a palm board (Experiments 1, 3, and 4) or magnitude estimation (Experiment 2). In Experiments 1–3, physically slanted surfaces were used (the surfaces possessed marble, granite, pebble, and circle textures), whereas computer-generated 3-D surfaces (defined by motion parallax and binocular disparity) were utilized in Experiment 4. The results showed that the younger and older observers' performance was essentially identical with regard to accuracy. The younger and older age groups, however, differed in terms of precision in Experiments 1 and 2: The judgments of the older observers were more variable across repeated trials. When taken as a whole, the results demonstrate that older observers (at least through the age of 83 years) can effectively extract information about slant in depth from optical patterns containing texture, motion parallax, or binocular disparity.