The appearance of surfaces specified by motion parallax and binocular disparity

The experiments reported in this paper were designed to investigate how depth information from binocular disparity and motion parallax cues is integrated in the human visual system. Observers viewed simulated 3-D corrugated surfaces that translated to and fro across their line of sight. The depth of the corrugations was specified by either motion parallax, or binocular disparities, or some combination of the two. The amount of perceived depth in the corrugations was measured using a matching technique.

A monocularly viewed surface specified by parallax alone was seen as a rigid, corrugated surface translating along a fronto-parallel path. The perceived depth of the corrugations increased monotonically with the amount of parallax motion, just as if observers were viewing an equivalent real surface that produced the same parallax transformation. With binocular viewing and zero disparities between the images seen by the two eyes, the perceived depth was only about half of that predicted by the monocular cue. In addition, this binocularly viewed surface appeared to rotate about a vertical axis as it translated to and fro. With other combinations of motion parallax and binocular disparity, parallax only affected the perceived depth when the disparity gradients of the corrugations were shallow. The discrepancy between the parallax and disparity signals was typically resolved by an apparent rotation of the surface as it translated to and fro. The results are consistent with the idea that the visual system attempts to minimize the discrepancies between (1) the depth signalled by disparity and that required by a particular interpretation of the parallax transformation and (2) the amount of rotation required by that interpretation and the amount of rotation signalled by other cues in the display.     

Shifts of spatial attention in perceived 3-D space.

Previous studies have shown that spatial attention can shift in three-dimensional (3-D) space determined by binocular disparity. Using Posner's precueing paradigm, the current work examined whether attentional selection occurs in perceived 3-D space defined by occlusion. Experiment 1 showed that shifts of spatial attention induced by central cues between two surfaces in the left and right visual fields did not differ between the conditions when the two surfaces were located at the same or different perceptual depth. In contrast, Experiment 2 found that peripheral cues generated a stronger cue validity effect when the two surfaces were perceived at a different rather than at the same perceptual depth. The results suggest that exogenous but not endogenous attention operates in perceived 3-D space.     

Combining cues while avoiding perceptual conflicts

A common assumption in cue combination models is that small discrepancies between cues are due to the limited resolution of the individual cues. Whenever this assumption holds, information from the separate cues can best be combined to give a single, more accurate estimate of the property of interest. We examined whether information about the discrepancy itself is lost when this is done. In our experiments, subjects were required to combine cues to match certain properties while avoiding perceptual conflicts. In part 1, they combined expansion and change in disparity to estimate motion in depth; and in part 2, they combined perspective and binocular disparities to estimate slant. We compared the pattern in the way that subjects set the two cues with the patterns predicted by models of cue combination with and without a loss of information about the discrepancy. From this comparison we conclude that little information about the discrepancies between cues is lost when the cues are combined.     

Modification of depth and distance perception caused by long-term wearing of left-right reversing spectacles

For 35 to 39 days, four observers wore continuously left-right reversing spectacles which pseudoscopically reverse the order of binocular disparity and direction of convergence. In three tests, we investigated how the visual system copes with the transformation of depth and distance information due to the reversing spectacles. In stereogram observation, after a few days of wearing the spectacles. the observers sometimes perceived a depth order which was opposite to the depth order that they had perceived in the pre-spectacle-wearing period. Monocular depth cues contributed more to depth perception in the spectacle-wearing period than they did in the pre-spectacle-wearing period. While the perceived distance significantly decreased during the spectacle-wearing period, we found no evidence of adaptive change in distance perception. The results indicate that the visual system adapts itself to the transformed situation by not only changing the processing of disparity but also by changing the relative efficiency of each cue in determining apparent depth.     

Integration of motion parallax with binocular disparity specifying different surface shapes

We investigated the interaction between motion parallax and binocular disparity cues in the perception of surface shape and depth magnitude by the use of the random dot stimuli in which these cues specified sinusoidal depth surfaces undulating with different spatial frequencies. When ambiguous motion parallax is inconsistent with unambiguous disparity cue, the reasonable solution for the visual system is to convert the motion signal to the flow on the surface specified by disparity. Two experiments, however, found that the visual system did not always use this reasonable solution; observers often perceived the surface specified by a composite of the two cues, or the surface specified by parallax alone. In the perception of this composite of the two cues, the apparent depth magnitude increased with the increase of the depth magnitude specified by both cues. This indicates that the visual system can combine the depth magnitude information from parallax and disparity in an additive fashion. The interference with parallax by disparity implies that the parallax processing is not independent of the disparity processing.     

Scale invariance in near space: pointing under influence of context

This paper describes the results of a pointing task close to the observer. Unlike most research reported in literature, the stimuli were composed of real solid objects in an unambiguous context, free of any cue conflict. Moreover, the stimuli were either within arm-reach or just beyond arm-reach, thus having strong binocular depth cues. Surprisingly, systematic errors up to four times the standard deviation were found. These errors depended mainly on the variations in context and hardly on egocentric distance. In good first approximation, the results were scale invariant. These results are in direct conflict with classic theories about visual space. The stimuli were unambiguous real 3-D equivalents of the computer-generated stimuli we used in a previous experiment. A comparison of the results did not reveal a clear effect of a depth cue conflict between accommodation and disparity.     

Stereo-motion cooperation and the use ofmotion disparity in the visual perception of 3-D structure

When an observer views a moving scene binocularly, both motion parallax and binocular disparity provide depth information. In Experiments lA-1C, we measured sensitivity to surface curvature when these depth cues were available either individually or simultaneously. When the depth cues yielded comparable sensitivity to surface curvature, we found that curvature detection was easier with the cues present simultaneously, rather than individually. For 2 of the 6 subjects, this effect was stronger when the component of frontal translation of the surface was vertical, rather than horizontal. No such anisotropy was found for the 4 other subjects. If a moving object is observed binocularly, the patterns of optic flow are different on the left and right retinae. We have suggested elsewhere (Cornilleau-Pérès & Droulez, in press) that this motion disparity might be used as avisual cue for the perception of a 3-D structure. Our model consisted in deriving binocular disparity from the left and right distributions of vertical velocities, rather than from luminous intensities, as has been done in classical studies on stereoscopic vision. The model led to some predictions concerning the detection of surface curvature from motion disparity in the presence or absence of intensity-based disparity (classically termedbinocular disparity). In a second set of experiments, we attempted to test these predictions, and we failed to validate our theoretical scheme from a physiological point of view.     

Depth adjacency in simultaneous contrast

The Gelb phenomenon, as an example of whiteness contrast, was investigated with three amounts of separation in depth between the test and induction disc. The cue of binocular disparity was used to vary the perceived depth between the discs. It was found that the magnitude of the contrast effect decreased with an increase in the perceived depth between the two discs. This change was regarded as an instance of the adjacency principle. The problem of whether the binocular disparity cue per se or perceived depth was the significant variable was discussed. The consequences of the results were considered with respect to the relation between whiteness constancy and whiteness contrast and the problem of neural localization of the contrast effect.     

Integrating multiple cues to depth order at object boundaries

We examined the interaction between motion and stereo cues to depth order along object boundaries. Relative depth was conveyed by a change in the speed of image motion across a boundary (motion parallax), the disappearance of features on a surface moving behind an occluding object (motion occlusion), or a difference in the stereo disparity of adjacent surfaces. We compared the perceived depth orders for different combinations of cues, incorporating conditions with conflicting depth orders and conditions with varying reliability of the individual cues. We observed large differences in performance between subjects, ranging from those whose depth order judgments were driven largely by the stereo disparity cues to those whose judgments were dominated by motion occlusion. The relative strength of these cues influenced individual subjects' behavior in conditions of cue conflict and reduced reliability.     

Effects of circular motion on judgment of rotation direction and depth order in visual motion

Abstract:  The rotation direction and depth order of a rotating sphere consisting of random dots often reverses while it is viewed under orthographic projection. However, if a short viewing distance is simulated under perspective projection, the correct rotation direction can be perceived. There are two motion cues for the rotation direction and depth order. One is the speed cue; points with higher velocities are closer to the observer. The other is the vertical motion cue; vertical motion is induced when the dots recede from or approach the observer. It was examined whether circular motion, which does not have any depth information but induces vertical velocities, masks the vertical motion cue. In Experiment 1, the effects of circular motion on the judgment of the rotation direction of a rotating sphere were examined. The magnitude of the two cues (the speed cue and the vertical velocity cue) as well as the angular speed of circular motion was varied. It was found that the performance improved as the vertical velocity increased and that the speed cue had slight effects on the judgment of the rotation direction. It was also found that the performance worsened as the angular speed of the circular motion was increased. In Experiment 2, the effects of circular motion on depth judgment of a rotating half sphere were investigated. The performance worsened as the angular speed of the circular motion increased, as in Experiment 1. These results suggest that the visual system cannot compensate perfectly for circular motion for the judgment of the rotation direction and depth order.     

Does binocular disparity or familiar size information override effects of relative size on judgements of time to contact?

Previous studies indicate that non-tau sources of depth information, such as pictorial depth cues, can influence judgements of time to contact (TTC). The effect of relative size on such judgements, the size-arrival effect, is particularly robust. However, earlier studies of the size-arrival effect did not include binocular disparity or familiar size information. The effects of these cues on relative TTC judgements were measured. Results suggested that disparity can eliminate the size-arrival effect but that the amount of disparity needed to do so is greater than typical stereoacuity thresholds. In contrast, familiar size eliminated the size-arrival effect even when disparity information was not available. Furthermore, disparity contributed more to performance when familiar size was present than when it was absent. Consistent with previous studies, TTC judgements were influenced by multiple sources of information. The present results suggested further that familiar size is one such source of information and that familiar size moderates the influence of binocular disparity information.     

Wheatstone-Panum limiting case: occlusion, camouflage, and vergence-induced disparity cues.

We examined effects of binocular occlusion, binocular camouflage, and vergence-induced disparity cues on the perceived depth between two objects when two stimuli are presented to one eye and a single stimulus to the other (Wheatstone-Panum limiting case). The perceived order and magnitude of the depth were examined in two experimental conditions: (1) The stimulus was presented on the temporal side (occlusion condition) and (2) the nasal side (camouflage condition) of the stimulus pair on one retina so as to fuse with the single stimulus on the other retina. In both conditions, the separation between the stimulus pair presented to one eye was systematically varied. Experiment 1, with 16 observers, showed that the fused object was seen in front of the nonfused object in the occlusion condition and was seen at the same distance as the nonfused object in the camouflage condition. The perceived depth between the two objects was constant and did not depend on the separation of the stimulus pair presented to one eye. Experiment 2, with 45 observers, showed that the disparity induced by vergence mainly determined the perceived depth, and the depth magnitude increased as the separation of the stimulus pair was made wider. The results suggest that (1) occlusion provides depth-order information but not depth-magnitude information, (2) camouflage provides neither depth-order nor depth-magnitude information, and (3) vergence-induced disparity provides both order and magnitude information.     

Shrinkage in the apparent size of cylindrical objects

A novel illusion in apparent size is reported. We asked observers to estimate the width and depth of vertically oriented elliptic cylinders depicted with texture or luminance gradients (experiment 1), or the height of horizontally oriented elliptic cylinders depicted with binocular disparity (experiment 2). The estimated width or height of cylinders showed systematic shrinkage in the direction of the gradual depth change. The dissimilarity of 2-D appearance amongst our stimuli implies a large variation in spatial-frequency components and brightness contrasts, eliminating the possibility that these parameters contributed to the illusion. Also, the mechanism inappropriately triggered by pictorial depth cues (eg size scaling) may be irrelevant, because the illusion was obtained even when binocular disparity alone specified the shape of the cylinders. The illusion demonstrated here suggests that our visual system may determine the size of 3-D objects by accounting for their depth structures.     

Suprathreshold stereo-depth matches as a function of contrast and spatial frequency

Thresholds for stereoscopic-depth perception increase with decreasing spatial frequency below 2.5 cycles deg-1. Despite this variation of stereo threshold, suprathreshold stereoscopic-depth perception is independent of spatial frequency down to 0.5 cycle deg-1. Below this frequency the perceived depth of crossed disparities is less than that stimulated by higher spatial frequencies which subtend the same disparities. We have investigated the effects of contrast fading upon this breakdown of stereo-depth invariance at low spatial frequencies. Suprathreshold stereopsis was investigated with spatially filtered vertical bars (difference of Gaussian luminance distribution, or DOG functions) tuned narrowly over a broad range of spatial frequencies (0.15-9.6 cycles deg-1). Disparity subtended by variable width DOGs whose physical contrast ranged from 10-100% was adjusted to match the perceived depth of a standard suprathreshold disparity (5 min visual angle) subtended by a thin black line. Greater amounts of crossed disparity were required to match broad than narrow DOGs to the apparent depth of the standard black line. The matched disparity was greater at low than at high contrast levels. When perceived contrast of all the DOGs was matched to standard contrasts ranging from 5-72%, disparity for depth matches became similar for narrow and broad DOGs. 200 ms pulsed presentations of DOGs with equal perceived contrast further reduced the disparity of low-contrast broad DOGs needed to match the standard depth. A perceived-depth bias in the uncrossed direction at low spatial frequencies was noted in these experiments. This was most pronounced for low-contrast low-spatial-frequency targets, which actually needed crossed disparities to make a depth match to an uncrossed standard. This bias was investigated further by making depth matches to a zero-disparity standard (ie the apparent fronto-parallel plane). Broad DOGs, which are composed of low spatial frequencies, were perceived behind the fixation plane when they actually subtended zero disparity. The magnitude of this low-frequency depth bias increased as contrast was reduced. The distal depth bias was also perceived monocularly, however, it was always greater when viewed binocularly. This investigation indicates that contrast fading of low-spatial-frequency stimuli changes their perceived depth and enhances a depth bias in the uncrossed direction. The depth bias has both a monocular and a binocular component.     

Binocular disparity magnitude affects perceived depth magnitude despite inversion of depth order

The hollow-face illusion involves a misperception of depth order: our perception follows our top-down knowledge that faces are convex, even though bottom-up depth information reflects the actual concave surface structure. While pictorial cues can be ambiguous, stereopsis should unambiguously indicate the actual depth order. We used computer-generated stereo images to investigate how, if at all, the sign and magnitude of binocular disparities affect the perceived depth of the illusory convex face. In experiment 1 participants adjusted the disparity of a convex comparison face until it matched a reference face. The reference face was either convex or hollow and had binocular disparities consistent with an average face or had disparities exaggerated, consistent with a face stretched in depth. We observed that apparent depth increased with disparity magnitude, even when the hollow faces were seen as convex (ie when perceived depth order was inconsistent with disparity sign). As expected, concave faces appeared flatter than convex faces, suggesting that disparity sign also affects perceived depth. In experiment 2, participants were presented with pairs of real and illusory convex faces. In each case, their task was to judge which of the two stimuli appeared to have the greater depth. Hollow faces with exaggerated disparities were again perceived as deeper.     

Wheatstone—Panum limiting case: Occlusion, camouflage, and vergence-induced disparity cues

We examined effects of binocular occlusion, binocular camouflage, and vergence-induced disparity cues on the perceived depth between two objects when two stimuli are presented to one eye and a single stimulus to the other (Wheatstone—Panum limiting case). The perceived order and magnitude of the depth were examined in two experimental conditions: (1) The stimulus was presented on the temporal side (occlusion condition) and (2) the nasal side (camouflage condition) of the stimulus pair on one retina so as to fuse with the single stimulus on the other retina. In both conditions, the separation between the stimulus pair presented to one eye was systematically varied. Experiment 1, with 16 observers, showed that the fused object was seen in front of the nonfused object in the occlusion condition and was seen at the same distance as the nonfused object in the camouflage condition. The perceived depth between the two objects was constant and did not depend on the separation of the stimulus pair presented to one eye. Experiment 2, with 45 observers, showed that the disparity induced by vergence mainly determined the perceived depth, and the depth magnitude increased as the separation of the stimulus pair was made wider. The results suggest that (1) occlusion provides depth-order information but not depth-magnitude information, (2) camouflage provides neither depth-order nor depth-magnitude information, and (3) vergence-induced disparity provides both order and magnitude information.     

Infants’ sensitivity to the depth cue of shading

Five- and 7-month-old infants were tested for sensitivity to the depth cue of shading. Infants were presented with two displays: a surface in which a convexity and a concavity were molded and a photograph in which shading specified a convexity and a concavity. Each display was presented under both monocular and binocular viewing conditions. Reaching was observed as the dependent measure. Infants in both age groups reached preferentially for the actual convexity in both the monocular and binocular viewing conditions. In the monocular photograph condition, the 7-month-olds reached preferentially for the apparent convexity specified by shading, indicating that they perceived it to be an actual convexity. These infants showed no significant reaching preference in the binocular photograph condition. This finding rules out interpretations of the infants’ reaching not based on perceived depth. The results therefore suggest that the 7-month-olds perceived depth from shading. The 5-month-olds showed no significant reaching preferences when viewing the photograph; thus, they showed no evidence of depth perception from shading. These findings are consistent with the results of a number of studies that have investigated infants’ sensitivity to pictorial depth cues. Together, these studies suggest that the ability to perceive depth from pictorial cues may first develop between 5 and 7 months of age.     

Adaptation to optically-increased interocular separation under naturalistic viewing conditions

Mirror spectacles which enhance binocular disparity by optically doubling the normal separation between the eyes were used to create conditions of combined perceptual and oculomotor conflict. Apparent depth and distance, as well as tonic accommodation, tonic vergence, and accommodative-vergence gain (response AC/A ratio), were assessed immediately before and after a 30 min exposure period of naturalistic viewing with the spectacles. Wearing the spectacles produced an increase in tonic vergence, and perceptual aftereffects consisting of increased apparent distance and depth. The results indicate that oculomotor conflict associated with enhanced interocular separation may be resolved through adaptation of tonic vergence, rather than through alteration of accommodative-vergence gain. The results also demonstrate that perceptual conflict between disparity and multiple veridical depth cues does not necessarily produce adaptive modification of the relationship between binocular disparity and apparent depth.     

Integration of disparity and velocity information for haptic and perceptual judgments of object depth

Do reach-to-grasp (prehension) movements require a metric representation of three-dimensional (3D) layouts and objects? We propose a model relying only on direct sensory information to account for the planning and execution of prehension movements in the absence of haptic feedback and when the hand is not visible. In the present investigation, we isolate relative motion and binocular disparity information from other depth cues and we study their efficacy for reach-to-grasp movements and visual judgments. We show that (i) the amplitude of the grasp increases when relative motion is added to binocular disparity information, even if depth from disparity information is already veridical, and (ii) similar distortions of derived depth are found for haptic tasks and perceptual judgments. With a quantitative test, we demonstrate that our results are consistent with the Intrinsic Constraint model and do not require 3D metric inferences (Domini, Caudek, & Tassinari, 2006). By contrast, the linear cue integration model (Landy, Maloney, Johnston, & Young, 1995) cannot explain the present results, even if the flatness cues are taken into account.