How is motion disparity integrated with binocular disparity in depth perception?

Two experiments presented motion disparity conflicting with binocular disparity to examine how these cues determined apparent depth order (convex, concave) and depth magnitude. In each experiment, 8 subjects estimated the depth order and depth magnitude. The first experiment showed the following. (1) The visual system used one of these cues exclusively in selecting a depth order for each display. (2) The visual system integrated the depth magnitude information from these cues by a weighted additive fashion if it selected the binocular disparity in depth order perception and if the depth magnitude specified by motion disparity was small relative to that specified by binocular disparity. (3) The visual system ignored the depth magnitude information of binocular disparity if it selected the motion disparity in depth order perception. The second experiment showed that these three points were consistent whether the subject’s head movement or object movement generated motion disparity.     

The appearance of surfaces specified by motion parallax and binocular disparity

The experiments reported in this paper were designed to investigate how depth information from binocular disparity and motion parallax cues is integrated in the human visual system. Observers viewed simulated 3-D corrugated surfaces that translated to and fro across their line of sight. The depth of the corrugations was specified by either motion parallax, or binocular disparities, or some combination of the two. The amount of perceived depth in the corrugations was measured using a matching technique.

A monocularly viewed surface specified by parallax alone was seen as a rigid, corrugated surface translating along a fronto-parallel path. The perceived depth of the corrugations increased monotonically with the amount of parallax motion, just as if observers were viewing an equivalent real surface that produced the same parallax transformation. With binocular viewing and zero disparities between the images seen by the two eyes, the perceived depth was only about half of that predicted by the monocular cue. In addition, this binocularly viewed surface appeared to rotate about a vertical axis as it translated to and fro. With other combinations of motion parallax and binocular disparity, parallax only affected the perceived depth when the disparity gradients of the corrugations were shallow. The discrepancy between the parallax and disparity signals was typically resolved by an apparent rotation of the surface as it translated to and fro. The results are consistent with the idea that the visual system attempts to minimize the discrepancies between (1) the depth signalled by disparity and that required by a particular interpretation of the parallax transformation and (2) the amount of rotation required by that interpretation and the amount of rotation signalled by other cues in the display.     

Dynamic occlusion and motion parallax in depth perception

Random-dot techniques were used to examine the interactions between the depth cues of dynamic occlusion and motion parallax in the perception of three-dimensional (3-D) structures, in two different situations: (a) when an observer moved laterally with respect to a rigid 3-D structure, and (b) when surfaces at different distances moved with respect to a stationary observer. In condition (a), the extent of accretion/deletion (dynamic occlusion) and the amount of relative motion (motion parallax) were both linked to the motion of the observer. When the two cues specified opposite, and therefore contradictory, depth orders, the perceived order in depth of the simulated surfaces was dependent on the magnitude of the depth separation. For small depth separations, motion parallax determined the perceived order, whereas for large separations it was determined by dynamic occlusion. In condition (b), where the motion parallax cues for depth order were inherently ambiguous, depth order was determined principally by the unambiguous occlusion information.     

Depth perception as a function of motion parallax and absolute-distance information

The results of three experiments demonstrated that the visual system calibrates motion parallax according to absolute-distance information in processing depth. The parallax was created by yoking the relative movement of random dots displayed on a cathode-ray tube to the movements of the head. In Experiment 1, at viewing distances of 40 cm and 80 cm, observers reported the apparent depth produced by motion parallax equivalent to a binocular disparity of 0.47 degree. The mean apparent depth at 80 cm was 2.6 times larger than at 40 cm. In Experiment 2, again at viewing distances of 40 cm and 80 cm, observers adjusted the extent of parallax so that the apparent depth was 7.0 cm. The mean extent of parallax at 80 cm was 31% of that at 40 cm. In Experiment 3, distances ranged from 40 cm to 320 cm, and a wide range of parallax was used. As distance and parallax increased, the perception of a rigid three-dimensional surface was accompanied by rocking motion; perception of depth was replaced by perception of motion in some trials at 320 cm. Moreover, the mean apparent depths were proportional to the viewing distance at 40 cm and 80 cm but not at 160 cm and 320 cm.     

Disruption of eye movements by ethanol intoxication affects perception of depth from motion parallax

Motion parallax, the ability to recover depth from retinal motion generated by observer translation, is important for visual depth perception. Recent work indicates that the perception of depth from motion parallax relies on the slow eye movement system. It is well known that ethanol intoxication reduces the gain of this system, and this produces the horizontal gaze nystagmus that law enforcement's field sobriety test is intended to reveal. The current study demonstrates that because of its influence on the slow eye movement system, ethanol intoxication impairs the perception of depth from motion parallax. Thresholds in a motion parallax task were significantly increased by acute ethanol intoxication, whereas thresholds for an identical test relying on binocular disparity were unaffected. Perhaps a failure of motion parallax plays a role in alcohol-related driving accidents; because of the effects of alcohol on eye movements, intoxicated drivers may have inaccurate or inadequate information for judging the relative depth of obstacles from motion parallax.     

Relative distance cues contribute to scaling depth from motion parallax

The visual system scales motion parallax signals with information about absolute distance (M. E. Ono, Rivest, & H. Ono, 1986). The present study was designed to determine whether relative distance cues, which intrinsically provide information about relative distance, contribute to this scaling. In two experiments, two test stimuli, containing an equal extent of motion parallax, were presented simultaneously at a fixed viewing distance. The relative distance cues of dynamic occlusion and motion parallax in the areas surrounding the test stimuli (background motion parallax) and/or relative size were manipulated. The observers reported which of the two parallactic test stimuli appeared to have greater depth, and which appeared to be more distant. The results showed that the test stimulus specified, by the relative distance cues, as being more distant was perceived as having more depth and as being more distant. This indicates that relative distance cues contribute to scaling depth from motion parallax by modifying the information about the absolute distance of objects.     

The visual control of reaching and grasping: binocular disparity and motion parallax

The primary visual sources of depth and size information are binocular cues and motion parallax. Here, the authors determine the efficacy of these cues to control prehension by presenting them in isolation from other visual cues. When only binocular cues were available, reaches showed normal scaling of the transport and grasp components with object distance and size. However, when only motion parallax was available, only the transport component scaled reliably. No additional increase in scaling was found when both cues were available simultaneously. Therefore, although equivalent information is available from binocular and motion parallax information, the latter may be of relatively limited use for the control of the grasp. Binocular disparity appears selectively important for the control of the grasp.     

The development of depth perception from motion parallax in infancy

North Dakota State University, Fargo, North Dakota Little is known about infants' perception of depth from motion parallax, even though it is known that infants are sensitive both to motion and to depth-from-motion cues at an early age. The present experiment assesses whether infants are sensitive to the unambiguous depth specified by motion parallax and, if so, when this sensitivity first develops. Eleven infants were followed longitudinally from 8 to 29 weeks. Infants monocularly viewed a translating Rogers and Graham (1979) random-dot stimulus, which appears as a corrugated surface to adult observers. Using the infant-control habituation paradigm, looking time was recorded for each 10-sec trial until habituation, followed by two test trials: one using a depth-reversed and one using a flat stimulus. Dishabituation results indicate that infants may be sensitive to unambiguous depth from motion parallax by 16 weeks of age. Implications for the developmental sequence of depth from motion, stereopsis, and eye movements are discussed.     

Perceptual depth synthesis in the visual system as revealed by selective adaptation

Selective adaptations was used to determine the degree of interactions between channels processing relative depth from stereopsis, motion parallax, and texture. Monocular adaptations with motion parallax or binocular stationary adaptation caused test surfaces, viewed either stationary binocularly or monocularly with motion parallax, to appear to slant in the opposite direction compared with the slant initially adapted to. Monocular adaptations on frontoparallel surfaces covered with a pattern of texture gradients caused a subsequently viewed test surface, viewed either monocularly with motion parallax or stationary binocularly, to appear to slant in the opposite direction as the slant indicated by the texture in the adaptation condition. No aftereffect emerged in the monocular stationary test condition. A mechanism of independent channels for relative depth perception is dismissed in favor of a view of an asymmetrical interactive processing of different information sources. The results suggest asymmetrical inhibitory interactions among habituating slant detector units receiving inputs from static disparity, dynamic disparity, and texture gradients.     

Relationship between binocular disparity and motion parallax in surface detection

The ability to detect surfaces was studied in a multiple-cue condition in which binocular disparity and motion parallax could specify independent depth configurations. On trials on which binocular disparity and motion parallax were presented together, either binocular disparity or motion parallax could indicate a surface in one of two intervals; in the other interval, both sources indicated a volume of random points. Surface detection when the two sources of information were present and compatible was not better than detection in baseline conditions, in which only one source of information was present. When binocular disparity and motion specified incompatible depths, observers’ ability to detect a surface was severely impaired if motion indicated a surface but binocular disparity did not. Performance was not as severely degraded when binocular disparity indicated a surface and motion did not. This dominance of binocular disparity persisted in the presence of foreknowledge about which source of information would be relevant.     

Effect of disparity and viewing distance on perceived depth

It is shown that veridical depth perception presupposes the processing of both the magnitude of retinal disparity and observation distance according to a square-law function specified by the underlying geometrical stimulus relations. In the present study, after testing its existence, this constancy of depth perception was investigated by measuring perceived depth as a function of retinal disparity and observation distance. In addition, the relative effectiveness of convergence and accommodation as possible indicators of distance was examined through a conflicting-cues paradigm. It was shown that in the perception of depth the visual system computes distance by taking into account the convergence parameter only, rather than that of accommodation or of both.     

Independence of sampling of motion parallax and binocular disparity in discrimination of depth1

Abstract: The sampling strategy of the visual system in binocular disparity and motion parallax to discriminate depth was investigated. Human observers were asked to discriminate between the depths of two surfaces defined by both cues. Gaussian noise was added to the depths represented by each cue, and the correlation in noise was manipulated. Human performance was compared with two types of likelihood models. The first was based on independent sampling, in which data from the two cues were gathered from independent sets of points in the display. The second was based on paired sampling, in which data from these cues were gathered from the same set of points. The former model yielded a better fit with human performance. This suggests that the visual system is more likely to adopt independent sampling.     

Integrating multiple cues to depth order at object boundaries

We examined the interaction between motion and stereo cues to depth order along object boundaries. Relative depth was conveyed by a change in the speed of image motion across a boundary (motion parallax), the disappearance of features on a surface moving behind an occluding object (motion occlusion), or a difference in the stereo disparity of adjacent surfaces. We compared the perceived depth orders for different combinations of cues, incorporating conditions with conflicting depth orders and conditions with varying reliability of the individual cues. We observed large differences in performance between subjects, ranging from those whose depth order judgments were driven largely by the stereo disparity cues to those whose judgments were dominated by motion occlusion. The relative strength of these cues influenced individual subjects' behavior in conditions of cue conflict and reduced reliability.     

Stereo-motion cooperation and the use ofmotion disparity in the visual perception of 3-D structure

When an observer views a moving scene binocularly, both motion parallax and binocular disparity provide depth information. In Experiments lA-1C, we measured sensitivity to surface curvature when these depth cues were available either individually or simultaneously. When the depth cues yielded comparable sensitivity to surface curvature, we found that curvature detection was easier with the cues present simultaneously, rather than individually. For 2 of the 6 subjects, this effect was stronger when the component of frontal translation of the surface was vertical, rather than horizontal. No such anisotropy was found for the 4 other subjects. If a moving object is observed binocularly, the patterns of optic flow are different on the left and right retinae. We have suggested elsewhere (Cornilleau-Pérès & Droulez, in press) that this motion disparity might be used as avisual cue for the perception of a 3-D structure. Our model consisted in deriving binocular disparity from the left and right distributions of vertical velocities, rather than from luminous intensities, as has been done in classical studies on stereoscopic vision. The model led to some predictions concerning the detection of surface curvature from motion disparity in the presence or absence of intensity-based disparity (classically termedbinocular disparity). In a second set of experiments, we attempted to test these predictions, and we failed to validate our theoretical scheme from a physiological point of view.     

The interaction of binocular disparity and motion parallax in determining perceived depth and perceived size.

Although binocular disparity and motion parallax are powerful cues for depth, neither, in isolation, can specify information about both object size and depth. It has been shown that information from both cues can be combined to specify the size, depth, and distance of an object in a scene (Richards, 1985 Journal of the Optical Society of America A 2 343-349). Experiments are reported in which natural viewing and physical stimuli have been used to investigate the nature of size and depth perception on the basis of disparity and parallax presented separately and together at a range of viewing distances. Observers adjusted the relative position of three bright LEDs, which were constrained to form a triangle in plan view with the apex pointing toward the observer, so its dimensions matched that of a standard held by the subject. With static monocular viewing, depth settings were inaccurate and erratic. When both cues were present together accuracy increased and the perceptual outcome was consistent with an averaging of the information provided by both cues. When an apparent bias evident in the observers' responses (the tendency to under-estimate the size of the standard) was taken into account, accuracy was high and size and depth constancy were close to 100%. In addition, given this assumption, the same estimate of viewing distance was used to scale size and depth estimates.     

Demonstrations of spatiotemporal integration and what they tell us about the visual system

Five sets of displays are presented on the journal website to be viewed in conjunction with the text. We concentrate on the factors that give rise to the integration and disruption of the direction of apparent motion in two-dimensional and three-dimensional space. In the first set of displays we examine what factors contribute to the integration and disruption of apparent motion in the Ramachandran/Anstis clustered bistable quartets. In the second set we examine what factors give rise to the perception of the direction of motion in rotating two-dimensional wheels and dots. In the third and fourth sets we examine how the depth cues of shading and disparity contribute to the perception of apparent motion of opaque displays, and to the perception of rotating unoccluded displays, respectively. In the fifth set we examine how the depth cue of motion parallax influences the perception of apparent motion. Throughout, we make inferences about the roles which various parallel pathways and cortical areas play in the perceptions produced by the displays shown.     

Apparent depth with retinal image motion of expansion and contraction yoked to head movement

The two main questions addressed in this study were (a) what effect does yoking the relative expansion and contraction (EC) of retinal images to forward and backward head movements have on the resultant magnitude and stability of perceived depth, and (b) how does this relative EC image motion interact with the depth cues of motion parallax? Relative EC image motion was produced by moving a small CCD camera toward and away from the stimulus, two random-dot surfaces separated in depth, in synchrony with the observers' forward and backward head movements. Observers viewed the stimuli monocularly, on a helmet-mounted display, while moving their heads at various velocities, including zero velocity. The results showed that (a) the magnitude of perceived depth was smaller with smaller head velocities (< 10 cm s-1), including the zero-head-velocity condition, than with a larger velocity (10 cm s-1), and (b) perceived depth, when motion parallax and the EC image motion cues were simultaneously presented, is equal to the greater of the two possible perceived depths produced from either of these two cues alone. The results suggested the role of nonvisual information of self-motion on perceiving depth.     

Motion parallax judgements of depth as a function of the direction and type of head movement

We compared the relative effectiveness of rotating or translating the head, either horizontally or vertically, on the perception of depth resulting from motion parallax. Using Rogers and Graham's (1979) paradigm, we yoked the movement of random dots on a screen to movements of the head, simulating a corrugated surface. In two experiments, subjects nulled the apparent depth or motion seen in the display. Horizontal head movements yielded the most precise depth judgements, irrespective of whether the head translated or rotated. Motion thresholds were higher than those for depth and were independent of direction of head movement. In a third experiment, suprathreshold stimuli that simulated differing amounts of depth were used, and the subjects' perception of depth was virtually the same for all types and directions of head movement. In our stimulus situation, rotating or translating the head either vertically or horizontally produced motion parallax cues for depth that were equally effective. Our results also showed that, within a range, retinal image motion from head movement is converted into a depth signal and that above that range location constancy breaks down and motion is seen.     

Modification of depth and distance perception caused by long-term wearing of left-right reversing spectacles

For 35 to 39 days, four observers wore continuously left-right reversing spectacles which pseudoscopically reverse the order of binocular disparity and direction of convergence. In three tests, we investigated how the visual system copes with the transformation of depth and distance information due to the reversing spectacles. In stereogram observation, after a few days of wearing the spectacles. the observers sometimes perceived a depth order which was opposite to the depth order that they had perceived in the pre-spectacle-wearing period. Monocular depth cues contributed more to depth perception in the spectacle-wearing period than they did in the pre-spectacle-wearing period. While the perceived distance significantly decreased during the spectacle-wearing period, we found no evidence of adaptive change in distance perception. The results indicate that the visual system adapts itself to the transformed situation by not only changing the processing of disparity but also by changing the relative efficiency of each cue in determining apparent depth.