The appearance of surfaces specified by motion parallax and binocular disparity

The experiments reported in this paper were designed to investigate how depth information from binocular disparity and motion parallax cues is integrated in the human visual system. Observers viewed simulated 3-D corrugated surfaces that translated to and fro across their line of sight. The depth of the corrugations was specified by either motion parallax, or binocular disparities, or some combination of the two. The amount of perceived depth in the corrugations was measured using a matching technique.

A monocularly viewed surface specified by parallax alone was seen as a rigid, corrugated surface translating along a fronto-parallel path. The perceived depth of the corrugations increased monotonically with the amount of parallax motion, just as if observers were viewing an equivalent real surface that produced the same parallax transformation. With binocular viewing and zero disparities between the images seen by the two eyes, the perceived depth was only about half of that predicted by the monocular cue. In addition, this binocularly viewed surface appeared to rotate about a vertical axis as it translated to and fro. With other combinations of motion parallax and binocular disparity, parallax only affected the perceived depth when the disparity gradients of the corrugations were shallow. The discrepancy between the parallax and disparity signals was typically resolved by an apparent rotation of the surface as it translated to and fro. The results are consistent with the idea that the visual system attempts to minimize the discrepancies between (1) the depth signalled by disparity and that required by a particular interpretation of the parallax transformation and (2) the amount of rotation required by that interpretation and the amount of rotation signalled by other cues in the display.     

Temporal properties of disparity processing revealed by dynamic random-dot stereograms

In studies of the temporal flexibility of the stereoscopic system, it has been suggested that two different processes of binocular depth perception could be responsible for the flexibility: tolerance for interocular delays and temporal integration of correlation. None has investigated the relationship between tolerance for delays and temporal integration mechanisms and none has revealed which mechanism is responsible for depth perception in dynamic random-dot stereograms. We address these questions in the present study. Across five experiments, we investigated the temporal properties of stereopsis by varying interocular correlation as a function of time in controlled ways. We presented different types of dynamic random-dot stereograms, each consisting of two pairs of alternating random-dot patterns. Our experimental results demonstrate that (i) disparities from simultaneous monocular inputs dominate those from interocular delayed inputs; (ii) stereopsis is limited by temporal properties of monocular luminance mechanisms; and (iii) depth perception in dynamic random-dot stereograms results from cross-correlation-like operation on two simultaneous monocular inputs that represent the retinal images after having been subjected to a process of monocular temporal integration of luminance.     

Binocular disparity magnitude affects perceived depth magnitude despite inversion of depth order

The hollow-face illusion involves a misperception of depth order: our perception follows our top-down knowledge that faces are convex, even though bottom-up depth information reflects the actual concave surface structure. While pictorial cues can be ambiguous, stereopsis should unambiguously indicate the actual depth order. We used computer-generated stereo images to investigate how, if at all, the sign and magnitude of binocular disparities affect the perceived depth of the illusory convex face. In experiment 1 participants adjusted the disparity of a convex comparison face until it matched a reference face. The reference face was either convex or hollow and had binocular disparities consistent with an average face or had disparities exaggerated, consistent with a face stretched in depth. We observed that apparent depth increased with disparity magnitude, even when the hollow faces were seen as convex (ie when perceived depth order was inconsistent with disparity sign). As expected, concave faces appeared flatter than convex faces, suggesting that disparity sign also affects perceived depth. In experiment 2, participants were presented with pairs of real and illusory convex faces. In each case, their task was to judge which of the two stimuli appeared to have the greater depth. Hollow faces with exaggerated disparities were again perceived as deeper.     

Integration of motion parallax with binocular disparity specifying different surface shapes

We investigated the interaction between motion parallax and binocular disparity cues in the perception of surface shape and depth magnitude by the use of the random dot stimuli in which these cues specified sinusoidal depth surfaces undulating with different spatial frequencies. When ambiguous motion parallax is inconsistent with unambiguous disparity cue, the reasonable solution for the visual system is to convert the motion signal to the flow on the surface specified by disparity. Two experiments, however, found that the visual system did not always use this reasonable solution; observers often perceived the surface specified by a composite of the two cues, or the surface specified by parallax alone. In the perception of this composite of the two cues, the apparent depth magnitude increased with the increase of the depth magnitude specified by both cues. This indicates that the visual system can combine the depth magnitude information from parallax and disparity in an additive fashion. The interference with parallax by disparity implies that the parallax processing is not independent of the disparity processing.     

在亮度对比和颜色对比下立体视知觉的定量研究

研究了在亮度对比与等亮度颜色对比的条件下,受试者分辨随机点阵立体图对的立体视敏度（最小视差）．结果表明：（１）在亮度对比条件下,立体视敏度随对比度的增加而增加,１０％的对比度即可引起立体视知觉,对比度大于３０％时达到饱和;（２）在亮度对比与等亮度颜色对比两种不同的条件下,受试者的立体视敏度不存在有统计学意义的差异;（３）当双眼分别接受不同颜色的等亮度立体图刺激时,与亮度对比条件相比,受试者的立体视敏度无明显差异;（４）当受试者双眼分别接受由亮度对比和颜色对比形成的立体图刺激时,只有当颜色对比图中图形与背景间的对比度超过等亮度值３８％以上时,才能形成立体视知觉．以上结果提示,大、小细胞系统（包括斑点系统与斑点间系统）均参与立体视知觉信息的传递．     

Curvature biases in stereoscopic vision: a nasotemporal asymmetry

The reliability of curvature judgments for linear elements was studied, with stereograms that contained a binocular arc with curvature in depth, and either a binocular frontoparallel arc or a monocular one, on a background representing a hemiellipsoid. The subjects made about 15% errors on binocular arcs with curvature in depth, and 60%-80% of these occurred when both the hemiellipsoid and the arc were convex, the arc being perceived as concave, by transparency through the hemiellipsoid. There were also about 15%-30% errors on frontoparallel arcs, but spread among all situations, with a small prevalence of concave judgments. Curvature in depth was assigned to the monocular stimuli in more than 60% of the cases. There was a curvature bias when the monocular arcs were on the nasal side, and were viewed against a concave background. Assuming parallel viewing, nasal ingoing arcs were usually perceived as concave, and nasal outgoing arcs usually perceived as convex, in agreement with geometrical likelihood. Nasal-side elements captured by one eye are, in general, those with the highest likelihood of having matching elements in the other eye. Then the observed nasal bias effect suggests that the matching process in stereopsis could be driven from the nasal sides of the projections in the two cerebral hemispheres.     

Disruption of eye movements by ethanol intoxication affects perception of depth from motion parallax

Motion parallax, the ability to recover depth from retinal motion generated by observer translation, is important for visual depth perception. Recent work indicates that the perception of depth from motion parallax relies on the slow eye movement system. It is well known that ethanol intoxication reduces the gain of this system, and this produces the horizontal gaze nystagmus that law enforcement's field sobriety test is intended to reveal. The current study demonstrates that because of its influence on the slow eye movement system, ethanol intoxication impairs the perception of depth from motion parallax. Thresholds in a motion parallax task were significantly increased by acute ethanol intoxication, whereas thresholds for an identical test relying on binocular disparity were unaffected. Perhaps a failure of motion parallax plays a role in alcohol-related driving accidents; because of the effects of alcohol on eye movements, intoxicated drivers may have inaccurate or inadequate information for judging the relative depth of obstacles from motion parallax.     

Motion parallax as an independent cue for depth perception.

The perspective transformations of the retinal image, produced by either the movement of an observer or the movement of objects in the visual world, were found to produce a reliable, consistent, and unambiguous impression of relative depth in the absence of all other cues to depth and distance. The stimulus displays consisted of computer-generated random-dot patterns that could be transformed by each movement of the observer or the display oscilloscope to simulate the relative movement information produced by a three-dimensional surface. Using a stereoscopic matching task, the second experiment showed that the perceived depth from parallax transformations is in close agreement with the degree of relative image displacement, as well as producing a compelling impression of three-dimensionality not unlike that found with random-dot stereograms.     

Relationship between binocular disparity and motion parallax in surface detection

The ability to detect surfaces was studied in a multiple-cue condition in which binocular disparity and motion parallax could specify independent depth configurations. On trials on which binocular disparity and motion parallax were presented together, either binocular disparity or motion parallax could indicate a surface in one of two intervals; in the other interval, both sources indicated a volume of random points. Surface detection when the two sources of information were present and compatible was not better than detection in baseline conditions, in which only one source of information was present. When binocular disparity and motion specified incompatible depths, observers’ ability to detect a surface was severely impaired if motion indicated a surface but binocular disparity did not. Performance was not as severely degraded when binocular disparity indicated a surface and motion did not. This dominance of binocular disparity persisted in the presence of foreknowledge about which source of information would be relevant.     

Depth interval estimates from motion parallax and binocular disparity beyond interaction space

Static and dynamic observers provided binocular and monocular estimates of the depths between real objects lying well beyond interaction space. On each trial, pairs of LEDs were presented inside a dark railway tunnel. The nearest LED was always 40 m from the observer, with the depth separation between LED pairs ranging from 0 up to 248 m. Dynamic binocular viewing was found to produce the greatest (ie most veridical) estimates of depth magnitude, followed next by static binocular viewing, and then by dynamic monocular viewing. (No significant depth was seen with static monocular viewing.) We found evidence that both binocular and monocular dynamic estimates of depth were scaled for the observation distance when the ground plane and walls of the tunnel were visible up to the nearest LED. We conclude that both motion parallax and stereopsis provide useful long-distance depth information and that motion-parallax information can enhance the degree of stereoscopic depth seen.     

The effects of duration and luminance on binocular depth mixture

Two stimuli in the same binocular direction, one in front and the other an equal disparity behind a fixation point, are perceived at one depth. This depth is between that corresponding to the two stimulus disparities and varies continuously from one stimulus to the other as a function of the ratio of their luminances. When either duration or absolute luminance is increased, perceived depth changes toward the midpoint of the two disparities.     

Dynamic occlusion and motion parallax in depth perception

Random-dot techniques were used to examine the interactions between the depth cues of dynamic occlusion and motion parallax in the perception of three-dimensional (3-D) structures, in two different situations: (a) when an observer moved laterally with respect to a rigid 3-D structure, and (b) when surfaces at different distances moved with respect to a stationary observer. In condition (a), the extent of accretion/deletion (dynamic occlusion) and the amount of relative motion (motion parallax) were both linked to the motion of the observer. When the two cues specified opposite, and therefore contradictory, depth orders, the perceived order in depth of the simulated surfaces was dependent on the magnitude of the depth separation. For small depth separations, motion parallax determined the perceived order, whereas for large separations it was determined by dynamic occlusion. In condition (b), where the motion parallax cues for depth order were inherently ambiguous, depth order was determined principally by the unambiguous occlusion information.     

Planar motion permits perception of metric structure in stereopsis

A fundamental problem in the study of spatial perception concerns whether and how vision might acquire information about the metric structure of surfaces in three-dimensional space from motion and from stereopsis. Theoretical analyses have indicated that stereoscopic perceptions of metric relations in depth require additional information about egocentric viewing distance; and recent experiments by James Todd and his colleagues have indicated that vision acquires only affine but not metric structure from motion—that is, spatial relations ambiguous with regard to scale in depth. The purpose of the present study was to determine whether the metric shape of planar stereoscopic forms might be perceived from congruence under planar rotation. In Experiment 1, observers discriminated between similar planar shapes (ellipses) rotating in a plane with varying slant from the frontal-parallel plane. Experimental conditions varied the presence versus absence of binocular disparities, magnification of the disparity scale, and moving versus stationary patterns. Shape discriminations were accurate in all conditions with moving patterns and were near chance in conditions with stationary patterns; neither the presence nor the magnification of binocular disparities had any reliable effect. In Experiment 2, accuracy decreased as the range of rotation decreased from 80° to 10°. In Experiment 3, small deviations from planarity of the motion produced large decrements in accuracy. In contrast with the critical role of motion in shape discrimination, motion hindered discriminations of the binocular disparity scale in Experiment 4. In general, planar motion provides an intrinsic metric scale that is independent of slant in depth and of the scale of binocular disparities. Vision is sensitive to this intrinsic optical metric.     

Planar motion permits perception of metric structure in stereopsis.

A fundamental problem in the study of spatial perception concerns whether and how vision might acquire information about the metric structure of surfaces in three-dimensional space from motion and from stereopsis. Theoretical analyses have indicated that stereoscopic perceptions of metric relations in depth require additional information about egocentric viewing distance; and recent experiments by James Todd and his colleagues have indicated that vision acquires only affine but not metric structure from motion--that is, spatial relations ambiguous with regard to scale in depth. The purpose of the present study was to determine whether the metric shape of planar stereoscopic forms might be perceived from congruence under planar rotation. In Experiment 1, observers discriminated between similar planar shapes (ellipses) rotating in a plane with varying slant from the frontal-parallel plane. Experimental conditions varied the presence versus absence of binocular disparities, magnification of the disparity scale, and moving versus stationary patterns. Shape discriminations were accurate in all conditions with moving patterns and were near chance in conditions with stationary patterns; neither the presence nor the magnification of binocular disparities had any reliable effect. In Experiment 2, accuracy decreased as the range of rotation decreased from 80 degrees to 10 degrees. In Experiment 3, small deviations from planarity of the motion produced large decrements in accuracy. In contrast with the critical role of motion in shape discrimination, motion hindered discriminations of the binocular disparity scale in Experiment 4. In general, planar motion provides an intrinsic metric scale that is independent of slant in depth and of the scale of binocular disparities. Vision is sensitive to this intrinsic optical metric.     

Performance and presence with head-movement produced motion parallax in simulated driving

Driving simulator studies can reveal relevant and valid aspects of driving behavior, but underestimation of distance and speed can negatively affect the driver’s performance, such as in performance of overtaking. One possible explanation for the underestimation of distance and speed is that two-dimensional projection of the visual scene disrupts the monocular-based illusory depth because of conflicting binocular and monocular information of depth. A possible solution might involve the strengthening of the monocular information so that the binocular information becomes less potent. In the present study, we used an advanced high-fidelity driving simulator to investigate whether adding the visual depth information of motion parallax from head movement affects sense of presence, judgment of distance and speed, and performance measures coupled with overtaking. The simulations included two types of driving scenario in which one was urban and the other was rural. The main results show no effect of this head-movement produced motion parallax on sense of presence, head movement, time to collision, distance judgment, or speed judgment. However, the results show an effect on lateral positioning. When initiating the overtaking maneuver there is a lateral positioning farther away from the road center as effect of the motion parallax in both types of scenario, which can be interpreted as indicating use of naturally occurring information that change behavior at overtaking. Nevertheless, only showing tendencies of effects, absent is any clear additional impact of this motion parallax in the simulated driving.     

How configurations of binocular disparity determine whether stereoscopic slant or stereoscopic occlusion is seen

A partially occluded contour and a slanted contour may generate identical binocular horizontal disparities. We investigated conditions promoting an occlusion resolution indicated by an illusory contour in depth along the aligned ends of horizontally disparate line sets. For a set of identical oblique lines with a constant width added to one eye's view, strength, depth, and stability of the illusory contour were poor, whereas for oblique lines of alternating orientations the illusory contours were strong, indicating a reliance on vertical size disparities rather than vertical positional disparities in generating perceived occlusion. For horizontal lines, occlusion was seen when the lines were of different lengths and absolute width disparity was invariant across the set. In all line configurations, when the additional length was on the wrong eye to be attributed to differential occlusion, lines appeared slanted consistent with their individual horizontal disparities. This rules out monocular illusory contours as the determining factor.     

Perceiving surfaces in depth beyond the fusion limit of their elements

An isolated dot appears double outside a small disparity range called Panum's fusional area. In random-dot stereograms (RDSs), however, this doubling, or diplopia of dot elements is not evident at any disparity. Nevertheless, depth is perceived up to disparities that greatly exceed Panum's fusional limit. Either one is unaware of dot diplopia at disparities exceeding Panum's fusional limit or the fusion limit is extended. To examine these possibilities, we developed a novel RDS in which dichoptically color-coded dots have a distinctive color when fused, and return to their intrinsic colors when diplopic. We measured the fusion limit of dots in this RDS, and compared it to the patent stereopsis limit of the perceived surface in similar RDSs. We found that the fusional area of dots in the RDS was comparable to Panum's fusional area. Furthermore, there was clear dissociation between the fusion limit and the patent stereopsis limit in the RDS. We conclude that the elements composing a surface are not necessarily fused when a large disparity surface is perceived in depth.     

Disparity detection in anticorrelated stereograms.

Recent physiological observations in which stimuli with opposite contrast signs in the two eyes have been used (anticorrelated stereograms) show that these stimuli evoke responses in primary visual cortex which are the reverse of responses to correlated stimuli. Psychophysical investigations reveal no such reversals: reversed-contrast bars with crossed disparities are seen in front of those with uncrossed disparities. For anticorrelated random-dot stereograms human subjects perceive no depth at all, except at low dot densities. However, these human studies were carried out with stimuli that differed in several ways from those used in physiological studies. We therefore reexamined psychophysical responses using stimuli similar to those used for physiological recordings. Our results confirm the previous findings: there is no evidence of a reversed depth sensation for bar stereograms (crossed disparities are never seen behind uncrossed disparities), and subjects are unable to detect depth in anticorrelated random-dot stereograms at the densities used for the physiological recordings. The discrepancy between the psychophysical data and the responses of single neurons in primary visual cortex suggests that further processing outside area V1 is necessary to provide the signals that produce the sensation of stereoscopic depth.     

Aging and the perception of depth and 3-D shape from motion parallax

The ability of younger and older observers to perceive 3-D shape and depth from motion parallax was investigated. In Experiment 1, the observers discriminated among differently curved 3-dimensional (3-D) surfaces in the presence of noise. In Experiment 2, the surfaces' shape was held constant and the amount of front-to-back depth was varied; the observers estimated the amount of depth they perceived. The effects of age were strongly task dependent. The younger observers' performance in Experiment 1 was almost 60% higher than that of the older observers. In contrast, no age effect was obtained in Experiment 2. Older observers can effectively perceive variations in depth from patterns of motion parallax, but their ability to discriminate 3-D shape is significantly compromised.