The appearance of surfaces specified by motion parallax and binocular disparity

The experiments reported in this paper were designed to investigate how depth information from binocular disparity and motion parallax cues is integrated in the human visual system. Observers viewed simulated 3-D corrugated surfaces that translated to and fro across their line of sight. The depth of the corrugations was specified by either motion parallax, or binocular disparities, or some combination of the two. The amount of perceived depth in the corrugations was measured using a matching technique.

A monocularly viewed surface specified by parallax alone was seen as a rigid, corrugated surface translating along a fronto-parallel path. The perceived depth of the corrugations increased monotonically with the amount of parallax motion, just as if observers were viewing an equivalent real surface that produced the same parallax transformation. With binocular viewing and zero disparities between the images seen by the two eyes, the perceived depth was only about half of that predicted by the monocular cue. In addition, this binocularly viewed surface appeared to rotate about a vertical axis as it translated to and fro. With other combinations of motion parallax and binocular disparity, parallax only affected the perceived depth when the disparity gradients of the corrugations were shallow. The discrepancy between the parallax and disparity signals was typically resolved by an apparent rotation of the surface as it translated to and fro. The results are consistent with the idea that the visual system attempts to minimize the discrepancies between (1) the depth signalled by disparity and that required by a particular interpretation of the parallax transformation and (2) the amount of rotation required by that interpretation and the amount of rotation signalled by other cues in the display.     

The stereoscopic sliver: a comparison of duration thresholds for fully stereoscopic and unmatched versions

Just as positional disparities of image features seen with both eyes provide depth information, the presence of an area visible to one eye but not the other within a binocularly viewed scene can indicate an occlusion at a depth discontinuity. The close geometrical association between these two kinds of cues suggests they may both be exploited by stereopsis. To investigate this, we developed a novel binocular stimulus entirely lacking in classical disparity that contains an unmatched vertical sliver which elicits a warping of the surrounding surface to accommodate a depth discontinuity. We measured depth-discrimination performance at a range of stimulus durations, correcting for variations in stimulus visibility, to characterise the decline of the efficacy of the depth signal with limited integration time. Results show a close correspondence of performance for similar stimuli with unmatched features and classical binocular disparity across a sixtyfold range of viewing durations, supporting the notion of a close association between the two types of cues in human stereopsis. Control experiments excluded simple eye-of-origin cues and long-range false matches as explanatory factors.     

Seeing stereoscopic depth from disparity between kinetic edges

Traditionally, it is assumed that stereovision operates only on the positional difference (disparity) between luminance-defined features in the images in the left and the right eye. Here, I show that stereoscopic depth can be seen from disparity between edges created by relative motion of texture elements, and between edges created by correlated flicker of stationary texture elements. Luminance-based stereopsis was impossible since the texture was binocularly uncorrelated. Positional disparity of the centre of revolving patterns was not an efficient depth cue. Stereopsis from the stimuli presented here was possible even without binocular overlap of textured areas. The results provide evidence that positional disparity of kinetic edges, defined by correlated flicker or motion contrast alone, can be used as matching features to recover stereoscopic depth.     

How is motion disparity integrated with binocular disparity in depth perception?

Two experiments presented motion disparity conflicting with binocular disparity to examine how these cues determined apparent depth order (convex, concave) and depth magnitude. In each experiment, 8 subjects estimated the depth order and depth magnitude. The first experiment showed the following. (1) The visual system used one of these cues exclusively in selecting a depth order for each display. (2) The visual system integrated the depth magnitude information from these cues by a weighted additive fashion if it selected the binocular disparity in depth order perception and if the depth magnitude specified by motion disparity was small relative to that specified by binocular disparity. (3) The visual system ignored the depth magnitude information of binocular disparity if it selected the motion disparity in depth order perception. The second experiment showed that these three points were consistent whether the subject’s head movement or object movement generated motion disparity.     

Integration of motion parallax with binocular disparity specifying different surface shapes

We investigated the interaction between motion parallax and binocular disparity cues in the perception of surface shape and depth magnitude by the use of the random dot stimuli in which these cues specified sinusoidal depth surfaces undulating with different spatial frequencies. When ambiguous motion parallax is inconsistent with unambiguous disparity cue, the reasonable solution for the visual system is to convert the motion signal to the flow on the surface specified by disparity. Two experiments, however, found that the visual system did not always use this reasonable solution; observers often perceived the surface specified by a composite of the two cues, or the surface specified by parallax alone. In the perception of this composite of the two cues, the apparent depth magnitude increased with the increase of the depth magnitude specified by both cues. This indicates that the visual system can combine the depth magnitude information from parallax and disparity in an additive fashion. The interference with parallax by disparity implies that the parallax processing is not independent of the disparity processing.     

Perceptual depth synthesis in the visual system as revealed by selective adaptation

Selective adaptations was used to determine the degree of interactions between channels processing relative depth from stereopsis, motion parallax, and texture. Monocular adaptations with motion parallax or binocular stationary adaptation caused test surfaces, viewed either stationary binocularly or monocularly with motion parallax, to appear to slant in the opposite direction compared with the slant initially adapted to. Monocular adaptations on frontoparallel surfaces covered with a pattern of texture gradients caused a subsequently viewed test surface, viewed either monocularly with motion parallax or stationary binocularly, to appear to slant in the opposite direction as the slant indicated by the texture in the adaptation condition. No aftereffect emerged in the monocular stationary test condition. A mechanism of independent channels for relative depth perception is dismissed in favor of a view of an asymmetrical interactive processing of different information sources. The results suggest asymmetrical inhibitory interactions among habituating slant detector units receiving inputs from static disparity, dynamic disparity, and texture gradients.     

Integrating multiple cues to depth order at object boundaries

We examined the interaction between motion and stereo cues to depth order along object boundaries. Relative depth was conveyed by a change in the speed of image motion across a boundary (motion parallax), the disappearance of features on a surface moving behind an occluding object (motion occlusion), or a difference in the stereo disparity of adjacent surfaces. We compared the perceived depth orders for different combinations of cues, incorporating conditions with conflicting depth orders and conditions with varying reliability of the individual cues. We observed large differences in performance between subjects, ranging from those whose depth order judgments were driven largely by the stereo disparity cues to those whose judgments were dominated by motion occlusion. The relative strength of these cues influenced individual subjects' behavior in conditions of cue conflict and reduced reliability.     

The visual control of reaching and grasping: binocular disparity and motion parallax

The primary visual sources of depth and size information are binocular cues and motion parallax. Here, the authors determine the efficacy of these cues to control prehension by presenting them in isolation from other visual cues. When only binocular cues were available, reaches showed normal scaling of the transport and grasp components with object distance and size. However, when only motion parallax was available, only the transport component scaled reliably. No additional increase in scaling was found when both cues were available simultaneously. Therefore, although equivalent information is available from binocular and motion parallax information, the latter may be of relatively limited use for the control of the grasp. Binocular disparity appears selectively important for the control of the grasp.     

Combining binocular and monocular curvature features.

A study is reported of the perception of visual surfaces in wire-frame stimuli generated by combinations of monocular surface contours and binocular disparity that provide differing information about 3-D relief. Observers vary considerably in the relative contribution made by the binocular and monocular cues to the perception of overall 3-D form. Without training, many observers may entirely fail to perceive surface curvature from the binocular disparity patterns, interpreting the form of the surface only according to the monocular information. For other observers, both cues contribute to the end percept, with the monocular interpretation dominating where the disparity information indicates planarity and with disparity dominating where disparity information suggests curvature and the monocular interpretation suggests planarity. Where stereo and monocular interpretations indicate inconsistent surface curvature features at a common location, more complex resolution strategies are suggested.     

Dynamics of attention in depth: evidence from multi-element tracking

We examined the allocation of attention in depth using a multi-element tracking paradigm. Observers were required to track a predefined subset of from two to eight elements in displays containing up to sixteen identical moving elements. We first show that depth cues, such as binocular disparity and occlusion through T-junctions, improve performance in a multi-element tracking task in the case where element boundaries are allowed to intersect in the depiction of motion in a single frontoparallel plane. We also show that the allocation of attention across two perceptually distinguishable planar surfaces, either frontoparallel or receding at a slanting angle and defined by coplanar elements, is easier than allocation of attention within a single surface. The same result was not found when attention was required to be deployed across items of two-color populations rather than across items of a single color. Our results suggest that, when surface information does not suffice to distinguish between targets and distractors that are embedded in these surfaces, division of attention across two surfaces aids in tracking moving targets. A final experiment with populations of elements moving within distinct volumes produced similar results, suggesting that spatial separation in three dimensions, rather than confinement to surfaces as such, may explain the improved performance for the two-surface case.     

Vertical disparity affects shape and size judgments across surfaces separated in depth

Vertical binocular disparity provides a useful source of information allowing three-dimensional (3-D) shape to be recovered from horizontal binocular disparity. In order to influence metric shape judgments, a large field of view is required, suggesting that vertical disparity may play a limited role in the perception of objects projecting small retinal images. This limitation could be overcome if vertical disparity information could be pooled over wide areas of 3-D space. This was investigated by assessing the effect of vertical disparity scaling of a large surround surface on the perceived size and 3-D shape of a small, central object. Observers adjusted the size and shape of a virtual, binocularly defined ellipsoid to match those of a real, hand-held tennis ball. The virtual ball was presented at three distances (200, 325, and 450 mm). Vertical disparities in a large surround surface were manipulated to be consistent with a distance of 160 mm or infinity. Both shape and size settings were influenced by this manipulation. This effect did not depend on presenting the surround and target objects at the same distance. These results suggest that the influence of vertical disparity on the perceived distance to a surface also affects the estimated distance of other visible surfaces. Vertical disparities are therefore important in the perception of metric depth, even for objects that in themselves subtend only small retinal images.     

Integration of disparity and velocity information for haptic and perceptual judgments of object depth

Do reach-to-grasp (prehension) movements require a metric representation of three-dimensional (3D) layouts and objects? We propose a model relying only on direct sensory information to account for the planning and execution of prehension movements in the absence of haptic feedback and when the hand is not visible. In the present investigation, we isolate relative motion and binocular disparity information from other depth cues and we study their efficacy for reach-to-grasp movements and visual judgments. We show that (i) the amplitude of the grasp increases when relative motion is added to binocular disparity information, even if depth from disparity information is already veridical, and (ii) similar distortions of derived depth are found for haptic tasks and perceptual judgments. With a quantitative test, we demonstrate that our results are consistent with the Intrinsic Constraint model and do not require 3D metric inferences (Domini, Caudek, & Tassinari, 2006). By contrast, the linear cue integration model (Landy, Maloney, Johnston, & Young, 1995) cannot explain the present results, even if the flatness cues are taken into account.     

Relationship between binocular disparity and motion parallax in surface detection

The ability to detect surfaces was studied in a multiple-cue condition in which binocular disparity and motion parallax could specify independent depth configurations. On trials on which binocular disparity and motion parallax were presented together, either binocular disparity or motion parallax could indicate a surface in one of two intervals; in the other interval, both sources indicated a volume of random points. Surface detection when the two sources of information were present and compatible was not better than detection in baseline conditions, in which only one source of information was present. When binocular disparity and motion specified incompatible depths, observers’ ability to detect a surface was severely impaired if motion indicated a surface but binocular disparity did not. Performance was not as severely degraded when binocular disparity indicated a surface and motion did not. This dominance of binocular disparity persisted in the presence of foreknowledge about which source of information would be relevant.     

Shifts of spatial attention in perceived 3-D space.

Previous studies have shown that spatial attention can shift in three-dimensional (3-D) space determined by binocular disparity. Using Posner's precueing paradigm, the current work examined whether attentional selection occurs in perceived 3-D space defined by occlusion. Experiment 1 showed that shifts of spatial attention induced by central cues between two surfaces in the left and right visual fields did not differ between the conditions when the two surfaces were located at the same or different perceptual depth. In contrast, Experiment 2 found that peripheral cues generated a stronger cue validity effect when the two surfaces were perceived at a different rather than at the same perceptual depth. The results suggest that exogenous but not endogenous attention operates in perceived 3-D space.     

Stereoillusory motion concomitant with lateral head movements

Stationary objects in a stereogram can appear to move when viewed with lateral head movements. This illusory motion can be explained by the motion-distance invariance hypothesis, which states that illusory motion covaries with perceived depth in accordance with the geometric relationship between the position of the stereo stimuli and the head. We examined two predictions based on the hypothesis. In Experiment 1, illusory motion was studied while varying the magnitude of binocular disparity and the magnitude of lateral head movement, holding viewing distance constant. In Experiment 2, illusory motion was studied while varying binocular disparity and viewing distance, holding magnitude of head movement constant. Ancillary measures of perceived depth, perceived viewing distance, and perceived magnitude of lateral head movement were also obtained. The results from the two experiments show that the extent of illusory motion varies as a function of perceived depth, supporting the motion-distance invariance hypothesis. The results also show that the extent of illusory motion is close to that predicted from the geometry in crossed disparity conditions, whereas it is greater than the predicted motion in uncrossed disparity conditions. Furthermore, predictions based on perceptual variables were no more accurate than predictions based on geometry.     

Binocular vision and spatial perception in 4- and 5-month-old infants

Four experiments investigated the relation between the development of binocular vision and infant spatial perception. Experiments 1 and 2 compared monocular and binocular depth perception in 4- and 5-month-old infants. Infants in both age groups reached more consistently for the nearer of two objects under binocular viewing conditions than under monocular viewing conditions. Experiments 3 and 4 investigated whether the superiority of binocular depth perception in 4-month-olds is related to the development of sensitivity to binocular disparity. Under binocular viewing conditions in Experiment 3, infants identified as disparity-sensitive reached more consistently for the nearer object than did infants identified as disparity-insensitive. The two groups' performances did not differ under monocular viewing conditions. These results suggest that, binocularly, the disparity-sensitive infants perceived the objects' distances more accurately than did the disparity-insensitive infants. In Experiment 4, infants were habituated to an object, then presented with the same object and a novel object that differed only in size. Disparity-sensitive infants showed size constancy by recovering from habituation when viewing the novel object. Disparity-insensitive infants did not show clear evidence of size constancy. These findings suggest that the development of sensitivity to binocular disparity is accompanied by a substantial increase in the accuracy of infant spatial perception.     

Binocular foveation in reading

We present a theory of foveation in normal binocular reading. We consider the pervasive, nontrivial binocular fixation disparities (FDs) observed in reading and relate them to the computational problem of resolving retinal disparities in depth perception. We infer that the right eye's fixation being to the right of the left eye's in reading promotes binocular fusion in challenging conditions. We then show a different (nonfusional) processing advantage for the right eye's fixation being to the left of the left eye's in reading conditions in which binocular fusion is assured, by modeling the combined influence of foveal splitting, contralateral preference, ocular prevalence, and fixation disparity. This synthesis of anatomically grounded research in different aspects of visual processing produces a theory of foveation in reading that matches current data and makes testable predictions.     

Interrelation of the effects of binocular disparity and perspective cues on judgments of depth and height

The effects of binocular disparity (aniseikonia) and perspective cues operating together on judgments of depth and height were studied, both when these stimulus variables operated in the same direction and when they were in conflict. Both depth cues were effective upon the perception of depth and height. The effects of binocular disparity and perspective cues upon perceived depth were found to be additive. The effects of these depth cues upon perceived height showed some interaction in the sense that, operating together, the effect of the perspective cue was stronger than the separate effect of the perspective cue, both when binocular disparity and perspective cues operated in the same direction and when they were in conflict. This interactive effect increased with increasing strength of the perspective cues. The size-distance invariance hypothesis was confirmed under the present experimental conditions. By a causal analysis of inference, this invariant relation could be explained in the following way: both the perceived depth and the perceived height of the sides of the patterns were directly determined by binocular disparity and perspective cues, but the perceived height was also indirectly determined through change of perceived depth. A direct causal relation between perceived depth and perceived height was found.     

Accuracy of stereomotion speed perception with persisting and dynamic textures

It has been established that the motion in depth of stimuli visible to both eyes may be signalled binocularly either by a change of disparity over time or by the difference in the velocity of the images projected on each retina, known as an interocular velocity difference. A two-interval forced-choice stereomotion speed discrimination experiment was performed on four participants to ascertain the relative speed of a persistent random dot stereogram (RDS) and a dynamic RDS undergoing directly approaching or receding motion in depth. While the persistent RDS pattern involved identical dot patterns translating in opposite directions in each eye, and hence included both changing disparity and interocular velocity difference cues, the dynamic RDS pattern (which contains no coherent monocular motion signals) specified motion in depth through changing disparity, but no motion through interocular velocity difference. Despite an interocular velocity difference speed signal of zero motion in depth, the dynamic RDS stimulus appeared to move more rapidly. These observations are consistent with a scheme in which cues that rely on coherent monocular motion signals (such as looming and the interocular velocity difference cue) are less influential in dynamic stimuli due to their lack of reliability (i.e., increased noise). While dynamic RDS stimuli may be relatively unaffected by the contributions of such cues when they signal that the stimulus did not move in depth, the persistent RDS stimulus may retain a significant and conflicting contribution from the looming cue, resulting in a lower perceived speed.     

Planar motion permits perception of metric structure in stereopsis

A fundamental problem in the study of spatial perception concerns whether and how vision might acquire information about the metric structure of surfaces in three-dimensional space from motion and from stereopsis. Theoretical analyses have indicated that stereoscopic perceptions of metric relations in depth require additional information about egocentric viewing distance; and recent experiments by James Todd and his colleagues have indicated that vision acquires only affine but not metric structure from motion—that is, spatial relations ambiguous with regard to scale in depth. The purpose of the present study was to determine whether the metric shape of planar stereoscopic forms might be perceived from congruence under planar rotation. In Experiment 1, observers discriminated between similar planar shapes (ellipses) rotating in a plane with varying slant from the frontal-parallel plane. Experimental conditions varied the presence versus absence of binocular disparities, magnification of the disparity scale, and moving versus stationary patterns. Shape discriminations were accurate in all conditions with moving patterns and were near chance in conditions with stationary patterns; neither the presence nor the magnification of binocular disparities had any reliable effect. In Experiment 2, accuracy decreased as the range of rotation decreased from 80° to 10°. In Experiment 3, small deviations from planarity of the motion produced large decrements in accuracy. In contrast with the critical role of motion in shape discrimination, motion hindered discriminations of the binocular disparity scale in Experiment 4. In general, planar motion provides an intrinsic metric scale that is independent of slant in depth and of the scale of binocular disparities. Vision is sensitive to this intrinsic optical metric.