Relationship between binocular disparity and motion parallax in surface detection

The ability to detect surfaces was studied in a multiple-cue condition in which binocular disparity and motion parallax could specify independent depth configurations. On trials on which binocular disparity and motion parallax were presented together, either binocular disparity or motion parallax could indicate a surface in one of two intervals; in the other interval, both sources indicated a volume of random points. Surface detection when the two sources of information were present and compatible was not better than detection in baseline conditions, in which only one source of information was present. When binocular disparity and motion specified incompatible depths, observers’ ability to detect a surface was severely impaired if motion indicated a surface but binocular disparity did not. Performance was not as severely degraded when binocular disparity indicated a surface and motion did not. This dominance of binocular disparity persisted in the presence of foreknowledge about which source of information would be relevant.     

Two forms of retinal disparity

The retinal disparities in stereograms where the vertical alignment of pairs of homologous points in one eye differs from that in the other eye were found to be more effective than disparities that do not involve that kind of binocular difference. The presence of such “transverse disparities” was found to shorten the time elapsed until perceived depth was reported in four instances, in two simple stereogram pairs and in two different pairs of random dot pattern stereograms. In an experiment where binocular parallax was in conflict with an effect of past experience, the presence of transverse disparities caused binocular parallax to prevail. The presumption that the amount of perceived depth depends only on the amount of disparity (provided distances from the eyes are unchanged) and not on the configuration in which it manifests itself was found not to hold in stereograms containing transverse disparities.     

The effects of age upon the perception of depth and 3-D shape from differential motion and binocular disparity

The ability of younger and older adults to perceive the 3-D shape, depth, and curvature of smooth surfaces defined by differential motion and binocular disparity was evaluated in six experiments. The number of points defining the surfaces and their spatial and temporal correspondences were manipulated. For stereoscopic sinusoidal surfaces, the spatial frequency of the corrugations was also varied. For surfaces defined by motion, the lifetimes of the individual points in the patterns were varied, and comparisons were made between the perception of surfaces defined by points and that of more ecologically valid textured surfaces. In all experiments, the older observers were less sensitive to the depths and curvatures of the surfaces, although the deficits were much larger for motion-defined surfaces. The results demonstrate that older adults can extract depth and shape from optical patterns containing only differential motion or binocular disparity, but these abilities are often manifested at reduced levels of performance.     

The appearance of surfaces specified by motion parallax and binocular disparity

The experiments reported in this paper were designed to investigate how depth information from binocular disparity and motion parallax cues is integrated in the human visual system. Observers viewed simulated 3-D corrugated surfaces that translated to and fro across their line of sight. The depth of the corrugations was specified by either motion parallax, or binocular disparities, or some combination of the two. The amount of perceived depth in the corrugations was measured using a matching technique.

A monocularly viewed surface specified by parallax alone was seen as a rigid, corrugated surface translating along a fronto-parallel path. The perceived depth of the corrugations increased monotonically with the amount of parallax motion, just as if observers were viewing an equivalent real surface that produced the same parallax transformation. With binocular viewing and zero disparities between the images seen by the two eyes, the perceived depth was only about half of that predicted by the monocular cue. In addition, this binocularly viewed surface appeared to rotate about a vertical axis as it translated to and fro. With other combinations of motion parallax and binocular disparity, parallax only affected the perceived depth when the disparity gradients of the corrugations were shallow. The discrepancy between the parallax and disparity signals was typically resolved by an apparent rotation of the surface as it translated to and fro. The results are consistent with the idea that the visual system attempts to minimize the discrepancies between (1) the depth signalled by disparity and that required by a particular interpretation of the parallax transformation and (2) the amount of rotation required by that interpretation and the amount of rotation signalled by other cues in the display.     

Correlation between stereoanomaly and perceived depth when disparity and motion interact in binocular matching

The aim of this study was to find out to what extent binocular matching is facilitated by motion when stereoanomalous and normal subjects estimate the perceived depth of a 3-D stimulus containing excessive matching candidates. Thirty subjects viewed stimuli that consisted of bars uniformly distributed inside a volume. They judged the perceived depth-to-width ratio of the volume by adjusting the aspect ratio of an outline rectangle (a metrical 3-D task). Although there were large inter-subject differences in the depth perceived, the experimental results yielded a good correlation with stereoanomaly (the inability to distinguish disparities of different magnitudes and/or signs in part of the disparity spectrum). The results cannot be explained solely by depth-cue combination. Since up to 30% of the population is stereoanomalous, stereoscopic experiments would yield more informative results if subjects were first characterized with regard to their stereo capacities. Intriguingly, it was found that motion does not help to define disparities in subjects who are able to perceive depth-from-disparity in half of the disparity spectrum. These stereoanomalous subjects were found to rely completely on the motion signals. This suggests that the perception of volumetric depth in subjects with normal stereoscopic vision requires the joint processing of crossed and uncrossed disparities.     

Independence of sampling of motion parallax and binocular disparity in discrimination of depth1

Abstract: The sampling strategy of the visual system in binocular disparity and motion parallax to discriminate depth was investigated. Human observers were asked to discriminate between the depths of two surfaces defined by both cues. Gaussian noise was added to the depths represented by each cue, and the correlation in noise was manipulated. Human performance was compared with two types of likelihood models. The first was based on independent sampling, in which data from the two cues were gathered from independent sets of points in the display. The second was based on paired sampling, in which data from these cues were gathered from the same set of points. The former model yielded a better fit with human performance. This suggests that the visual system is more likely to adopt independent sampling.     

Aging and the discrimination of 3-D shape from motion and binocular disparity

Two experiments evaluated the ability of younger and older adults to visually discriminate 3-D shape as a function of surface coherence. The coherence was manipulated by embedding the 3-D surfaces in volumetric noise (e.g., for a 55?% coherent surface, 55?% of the stimulus points fell on a 3-D surface, while 45?% of the points occupied random locations within the same volume of space). The 3-D surfaces were defined by static binocular disparity, dynamic binocular disparity, and motion. The results of both experiments demonstrated significant effects of age: Older adults required more coherence (tolerated volumetric noise less) for reliable shape discrimination than did younger adults. Motion-defined and static-binocular-disparity-defined surfaces resulted in similar coherence thresholds. However, performance for dynamic-binocular-disparity-defined surfaces was superior (i.e., the observers?? surface coherence thresholds were lowest for these stimuli). The results of both experiments showed that younger and older adults possess considerable tolerance to the disrupting effects of volumetric noise; the observers could reliably discriminate 3-D surface shape even when 45?% of the stimulus points (or more) constituted noise.     

Neural network-expert system models of relative-depth perception

Degree of binocular, horizontal disparity was used by two hybrid neural network/expert system computer models to make relative-depth judgments for pairs of stimulus points. These judgments were then correlated with the actual depth relationships of the points. Results from Simulation 1 showed that horizontal disparity could be computed by the shift in activated cortical hypercolumns evoked by a particular stimulus, and that, in general, multiple disparities could be compared to make accurate judgments about relative depth. However, these results also indicated that stimuli toward the periphery of the visual field were inaccurately perceived as being more distant. Simulation 2 corrected for this inaccuracy by appropriately weighting a stimulus point’s disparity value as a function of its horizontal position in the visual field.     

Contrast and depth perception: effects of texture contrast and area contrast

Many objects in natural scenes have textures on their surfaces. Contrast of the texture surfaces (the texture contrast) reduces when the viewing distance increases. Similarly, contrast between the surfaces of the objects and the background (the area contrast) reduces when the viewing distance increases. The texture contrast and the area contrast were defined by the contrast between random dots, and by the contrast between the average luminance of the dot pattern and the luminance of the background, respectively. To examine how these two types of contrast influence depth perception, we ran two experiments. In both experiments two areas of random-dot patterns were presented against a uniform background, and participants rated relative depth between the two areas. We found that the rated depth of the patterned areas increased with increases in texture contrast. Furthermore, the effect of the texture contrast on depth judgment increased when the area contrast became low.     

Planar motion permits perception of metric structure in stereopsis.

A fundamental problem in the study of spatial perception concerns whether and how vision might acquire information about the metric structure of surfaces in three-dimensional space from motion and from stereopsis. Theoretical analyses have indicated that stereoscopic perceptions of metric relations in depth require additional information about egocentric viewing distance; and recent experiments by James Todd and his colleagues have indicated that vision acquires only affine but not metric structure from motion--that is, spatial relations ambiguous with regard to scale in depth. The purpose of the present study was to determine whether the metric shape of planar stereoscopic forms might be perceived from congruence under planar rotation. In Experiment 1, observers discriminated between similar planar shapes (ellipses) rotating in a plane with varying slant from the frontal-parallel plane. Experimental conditions varied the presence versus absence of binocular disparities, magnification of the disparity scale, and moving versus stationary patterns. Shape discriminations were accurate in all conditions with moving patterns and were near chance in conditions with stationary patterns; neither the presence nor the magnification of binocular disparities had any reliable effect. In Experiment 2, accuracy decreased as the range of rotation decreased from 80 degrees to 10 degrees. In Experiment 3, small deviations from planarity of the motion produced large decrements in accuracy. In contrast with the critical role of motion in shape discrimination, motion hindered discriminations of the binocular disparity scale in Experiment 4. In general, planar motion provides an intrinsic metric scale that is independent of slant in depth and of the scale of binocular disparities. Vision is sensitive to this intrinsic optical metric.     

Planar motion permits perception of metric structure in stereopsis

A fundamental problem in the study of spatial perception concerns whether and how vision might acquire information about the metric structure of surfaces in three-dimensional space from motion and from stereopsis. Theoretical analyses have indicated that stereoscopic perceptions of metric relations in depth require additional information about egocentric viewing distance; and recent experiments by James Todd and his colleagues have indicated that vision acquires only affine but not metric structure from motion—that is, spatial relations ambiguous with regard to scale in depth. The purpose of the present study was to determine whether the metric shape of planar stereoscopic forms might be perceived from congruence under planar rotation. In Experiment 1, observers discriminated between similar planar shapes (ellipses) rotating in a plane with varying slant from the frontal-parallel plane. Experimental conditions varied the presence versus absence of binocular disparities, magnification of the disparity scale, and moving versus stationary patterns. Shape discriminations were accurate in all conditions with moving patterns and were near chance in conditions with stationary patterns; neither the presence nor the magnification of binocular disparities had any reliable effect. In Experiment 2, accuracy decreased as the range of rotation decreased from 80° to 10°. In Experiment 3, small deviations from planarity of the motion produced large decrements in accuracy. In contrast with the critical role of motion in shape discrimination, motion hindered discriminations of the binocular disparity scale in Experiment 4. In general, planar motion provides an intrinsic metric scale that is independent of slant in depth and of the scale of binocular disparities. Vision is sensitive to this intrinsic optical metric.     

Binocular disparity magnitude affects perceived depth magnitude despite inversion of depth order

The hollow-face illusion involves a misperception of depth order: our perception follows our top-down knowledge that faces are convex, even though bottom-up depth information reflects the actual concave surface structure. While pictorial cues can be ambiguous, stereopsis should unambiguously indicate the actual depth order. We used computer-generated stereo images to investigate how, if at all, the sign and magnitude of binocular disparities affect the perceived depth of the illusory convex face. In experiment 1 participants adjusted the disparity of a convex comparison face until it matched a reference face. The reference face was either convex or hollow and had binocular disparities consistent with an average face or had disparities exaggerated, consistent with a face stretched in depth. We observed that apparent depth increased with disparity magnitude, even when the hollow faces were seen as convex (ie when perceived depth order was inconsistent with disparity sign). As expected, concave faces appeared flatter than convex faces, suggesting that disparity sign also affects perceived depth. In experiment 2, participants were presented with pairs of real and illusory convex faces. In each case, their task was to judge which of the two stimuli appeared to have the greater depth. Hollow faces with exaggerated disparities were again perceived as deeper.     

Dynamics of attention in depth: evidence from multi-element tracking

We examined the allocation of attention in depth using a multi-element tracking paradigm. Observers were required to track a predefined subset of from two to eight elements in displays containing up to sixteen identical moving elements. We first show that depth cues, such as binocular disparity and occlusion through T-junctions, improve performance in a multi-element tracking task in the case where element boundaries are allowed to intersect in the depiction of motion in a single frontoparallel plane. We also show that the allocation of attention across two perceptually distinguishable planar surfaces, either frontoparallel or receding at a slanting angle and defined by coplanar elements, is easier than allocation of attention within a single surface. The same result was not found when attention was required to be deployed across items of two-color populations rather than across items of a single color. Our results suggest that, when surface information does not suffice to distinguish between targets and distractors that are embedded in these surfaces, division of attention across two surfaces aids in tracking moving targets. A final experiment with populations of elements moving within distinct volumes produced similar results, suggesting that spatial separation in three dimensions, rather than confinement to surfaces as such, may explain the improved performance for the two-surface case.     

Independent effects of local and global binocular disparity on the perceived convexity of stereoscopically presented faces in scenes

Evidence suggests that experiencing the hollow-face illusion involves perceptual reversal of the binocular disparities associated with the face even though the rest of the scene appears unchanged. This suggests stereoscopic processing of object shape may be independent of scene-based processing of the layout of objects in depth. We investigated the effects of global scene-based and local object-based disparity on the compellingness of the perceived convexity of the face. We took stereoscopic photographs of people in scenes, and independently reversed the binocular disparities associated with the head and scene. Participants rated perceived convexity of a natural disparity ("convex") or reversed disparity ("concave") face shown either in its original context with reversed or natural disparities or against a black background. Faces with natural disparity were rated as more convincingly convex independent of the background, showing that the local disparities can affect perceived convexity independent of disparities across the rest of the image. However, the apparent convexity of the faces was also greater in natural disparity scenes compared to either a reversed disparity scene or a zero disparity black background. This independent effect of natural scene disparity suggests that the 'solidity' associated with natural scene disparities spread to enhance the perceived convexity of the face itself. Together, these findings suggest that global and local disparity exert independent and additive effects upon the perceived convexity of the face.     

How configurations of binocular disparity determine whether stereoscopic slant or stereoscopic occlusion is seen

A partially occluded contour and a slanted contour may generate identical binocular horizontal disparities. We investigated conditions promoting an occlusion resolution indicated by an illusory contour in depth along the aligned ends of horizontally disparate line sets. For a set of identical oblique lines with a constant width added to one eye's view, strength, depth, and stability of the illusory contour were poor, whereas for oblique lines of alternating orientations the illusory contours were strong, indicating a reliance on vertical size disparities rather than vertical positional disparities in generating perceived occlusion. For horizontal lines, occlusion was seen when the lines were of different lengths and absolute width disparity was invariant across the set. In all line configurations, when the additional length was on the wrong eye to be attributed to differential occlusion, lines appeared slanted consistent with their individual horizontal disparities. This rules out monocular illusory contours as the determining factor.     

Binocular foveation in reading

We present a theory of foveation in normal binocular reading. We consider the pervasive, nontrivial binocular fixation disparities (FDs) observed in reading and relate them to the computational problem of resolving retinal disparities in depth perception. We infer that the right eye's fixation being to the right of the left eye's in reading promotes binocular fusion in challenging conditions. We then show a different (nonfusional) processing advantage for the right eye's fixation being to the left of the left eye's in reading conditions in which binocular fusion is assured, by modeling the combined influence of foveal splitting, contralateral preference, ocular prevalence, and fixation disparity. This synthesis of anatomically grounded research in different aspects of visual processing produces a theory of foveation in reading that matches current data and makes testable predictions.     

How is motion disparity integrated with binocular disparity in depth perception?

Two experiments presented motion disparity conflicting with binocular disparity to examine how these cues determined apparent depth order (convex, concave) and depth magnitude. In each experiment, 8 subjects estimated the depth order and depth magnitude. The first experiment showed the following. (1) The visual system used one of these cues exclusively in selecting a depth order for each display. (2) The visual system integrated the depth magnitude information from these cues by a weighted additive fashion if it selected the binocular disparity in depth order perception and if the depth magnitude specified by motion disparity was small relative to that specified by binocular disparity. (3) The visual system ignored the depth magnitude information of binocular disparity if it selected the motion disparity in depth order perception. The second experiment showed that these three points were consistent whether the subject’s head movement or object movement generated motion disparity.     

The magnitude of binocular disparity modulates search time for targets defined by a conjunction of depth and colour

Nakayama and Silverman (1986) proposed that, when searching for a target defined by a conjunction of color and stereoscopic depth, observers partition 3D space into separate depth planes and then rapidly search each such plane in turn, thereby turning a conjunctive search into a "feature" search. In their study, they found, consistent with their hypothesis, shallow search slopes when searching depth planes separated by large binocular disparities. Here, the authors investigated whether the search slope depends upon the extent of the stereoscopically induced separation between the planes to be searched (i.e., upon the magnitude of the binocular disparity. The obtained slope shows that (1) a rapid search only occurs with disparities greater than 6 min of arc, a value that vastly exceeds the stereo threshold, and that (2) the steepness of this slope increases in a major way at lower disparities. The ability to implement the search mode envisaged by Nakayama and Silverman is thus clearly limited to large disparities; less efficient search strategies are mandated by lower disparity values, as under such conditions items from one depth plane may be more likely to "intrude" upon the other. (PsycINFO Database Record (c) 2008 APA, all rights reserved).     

The effects of duration and luminance on binocular depth mixture

Two stimuli in the same binocular direction, one in front and the other an equal disparity behind a fixation point, are perceived at one depth. This depth is between that corresponding to the two stimulus disparities and varies continuously from one stimulus to the other as a function of the ratio of their luminances. When either duration or absolute luminance is increased, perceived depth changes toward the midpoint of the two disparities.