Dynamic occlusion and motion parallax in depth perception

Random-dot techniques were used to examine the interactions between the depth cues of dynamic occlusion and motion parallax in the perception of three-dimensional (3-D) structures, in two different situations: (a) when an observer moved laterally with respect to a rigid 3-D structure, and (b) when surfaces at different distances moved with respect to a stationary observer. In condition (a), the extent of accretion/deletion (dynamic occlusion) and the amount of relative motion (motion parallax) were both linked to the motion of the observer. When the two cues specified opposite, and therefore contradictory, depth orders, the perceived order in depth of the simulated surfaces was dependent on the magnitude of the depth separation. For small depth separations, motion parallax determined the perceived order, whereas for large separations it was determined by dynamic occlusion. In condition (b), where the motion parallax cues for depth order were inherently ambiguous, depth order was determined principally by the unambiguous occlusion information.     

Influence of hand position on the near effect in 3-D attention

Voluntary reorienting of attention in real depth situations is characterized by an attentional bias to locations nearer the viewer once attention is deployed to a spatially cued object in depth. Previously, this effect (initially referred to as the near effect) was attributed to access of a 3-D viewer-centered spatial representation for guiding attention in 3-D space. The aim of this study was to investigate whether the near effect could have been associated with the position of the response hand, which was always near the viewer in previous studies that investigated endogenous attentional shifts in real depth. In Experiment 1, the response hand was placed at either the near or far target depth in a depth-cuing task. Placing the response hand at the far target depth abolished the near effect, but failed to bias spatial attention to the far location. Experiment 2 showed that the response hand effect was not modulated by the presence of an additional (passive) hand, whereas Experiment 3 confirmed that attentional prioritization of the passive hand was not masked by the influence of the responding hand on spatial attention in Experiment 2. The pattern of results is most consistent with the idea that response preparation can modulate spatial attention within a 3-D viewer-centered spatial representation.     

Exogenous orienting of crossmodal attention in 3-D space: Support for a depth-aware crossmodal attentional system

The aim of the present study was to investigate exogenous crossmodal orienting of attention in three-dimensional (3-D) space. Most studies in which the orienting of attention has been examined in 3-D space concerned either exogenous intramodal or endogenous crossmodal attention. Evidence for exogenous crossmodal orienting of attention in depth is lacking. Endogenous and exogenous attention are behaviorally different, suggesting that they are two different mechanisms. We used the orthogonal spatial-cueing paradigm and presented auditory exogenous cues at one of four possible locations in near or far space before the onset of a visual target. Cues could be presented at the same (valid) or at a different (invalid) depth from the target (radial validity), and on the same (valid) or on a different (invalid) side (horizontal validity), whereas we blocked the depth at which visual targets were presented. Next to an overall validity effect (valid RTs < invalid RTs) in horizontal space, we observed an interaction between the horizontal and radial validity of the cue: The horizontal validity effect was present only when the cue and the target were presented at the same depth. No horizontal validity effect was observed when the cue and the target were presented at different depths. These results suggest that exogenous crossmodal attention is “depth-aware,” and they are discussed in the context of the supramodal hypothesis of attention.     

The influence of depth segmentation on colour constancy

In real scenes, surfaces in different depth planes often differ in the luminance and chromatic content of their illumination. Scene segmentation is therefore an important issue when considering the compensation of illumination changes in our visual perception (lightness and colour constancy). Chromatic adaptation is an important sensory component of colour constancy and has been shown to be linked to the two-dimensional spatial structure of a scene (Werner, 2003 Vision Research 43 1611 - 1623). Here, the question is posed whether this cooperation also extends to the organisation of a scene in depth. The influence of depth on colour constancy was tested by introducing stereo disparity, whereby the test patch and background were perceived in either the same or one of five different depth planes (1.9-57 min of arc). There were no additional cues to depth such as shadows or specular highlights. For consistent illumination changes, colour constancy was reduced when the test patch and background were separated in depth, indicating a reduction of contextual influences. An interaction was found between the influences of stereo depth and spatial frequency on colour constancy. In the case of an inconsistent illumination change, colour constancy was reduced if the test patch and background were in the same depth plane (2-D condition), but not if they were separated in depth (3-D condition). Furthermore, colour constancy was slightly better in the 3-D inconsistent condition than in the 2-D inconsistent condition. It is concluded that depth segmentation supports colour constancy in scenes with inconsistent illumination changes. Processes of depth segmentation are implemented at an early sensory stage of colour constancy, and they define visual regions within which the effects of illuminant changes are discounted for separately. The results support recent models that posit such implementation of scene segmentation in colour constancy.     

Depth representation of moving 3-D objects in apparent-motion path

Apparent motion is perceived when two objects are presented alternately at different positions. The internal representations of apparently moving objects are formed in an apparent-motion path which lacks physical inputs. We investigated the depth information contained in the representation of 3-D moving objects in an apparent-motion path. We examined how probe objects-briefly placed in the motion path-affected the perceived smoothness of apparent motion. The probe objects comprised 3-D objects which were defined by being shaded or by disparity (convex/concave) or 2-D (flat) objects, while the moving objects were convex/concave objects. We found that flat probe objects induced a significantly smoother motion perception than concave probe objects only in the case of the convex moving objects. However, convex probe objects did not lead to smoother motion as the flat objects did, although the convex probe objects contained the same depth information for the moving objects. Moreover, the difference between probe objects was reduced when the moving objects were concave. These counterintuitive results were consistent in conditions when both depth cues were used. The results suggest that internal representations contain incomplete depth information that is intermediate between that of 2-D and 3-D objects.     

3-D processing in the Poggendorff illusion

In the Poggendorff illusion two collinear oblique lines, separated by two vertical lines, appear to be misaligned. 3-D processing of the oblique but not the vertical lines is considered to cause this apparent misalignment. We investigated whether more explicitly triggering 2-D versus 3-D interpretations of the different parts of Poggendorff-like displays would influence the apparent misalignment. In Experiment 1, we found that compared to 2-D controls, 3-D interpretations of the vertical parts did not influence apparent misalignment, while for the oblique parts 3-D processing resulted in more apparent misalignment than 2-D controls. In Experiment 2, the amount of contour convergence of the oblique parts was manipulated resulting in the 3-D blocks, but not the 2-D line patterns, to be perceived as receding in depth. Now, apparent misalignment increased the more the 3-D blocks were perceived as receding in depth. We conclude that apparent misalignment in Poggendorff-like displays can be influenced by different interpretations of its separate parts, while keeping the local junctions between the different elements the same.     

Tactile selective attention and body posture: assessing the multisensory contributions of vision and proprioception

This study addressed the role of proprioceptive and visual cues to body posture during the deployment of tactile spatial attention. Participants made speeded elevation judgments (up vs. down) to vibrotactile targets presented to the finger or thumb of either hand, while attempting to ignore vibrotactile distractors presented to the opposite hand. The first two experiments established the validity of this paradigm and showed that congruency effects were stronger when the target hand was uncertain (Experiment 1) than when it was certain (Experiment 2). Varying the orientation of the hands revealed that these congruency effects were determined by the position of the target and distractor in external space, and not by the particular skin sites stimulated (Experiment 3). Congruency effects increased as the hands were brought closer together in the dark (Experiment 4), demonstrating the role of proprioceptive input in modulating tactile selective attention. This spatial modulation was also demonstrated when a mirror was used to alter the visually perceived separation between the hands (Experiment 5). These results suggest that tactile, spatially selective attention can operate according to an abstract spatial frame of reference, which is significantly modulated by multisensory contributions from both proprioception and vision.     

Effects of Perceived Space on Spatial Attention

Abstract—This study demonstrates that a perceptual illusion that alters the perceived length of two lines also affects spatial attention. We used a cuing method that was introduced to study space- versus object-based attention. Two parallel lines of equal length were placed so that the distance between them was equal to the length of the lines. We then added a scene with depth cues to produce a strong illusion that one line was longer than the other. The results showed that spatial attention is distributed in space as it is perceived and altered by perceptual organization. These data have implications for assumptions concerning the spatial medium that guides attention and the role of depth and distance cues in spatial orienting, as well as for understanding attentional systems related to neuropsychological functions that respond to space and objects.     

The absence of depth constancy in contour stereograms

Stereoscopic surfaces constructed from Kanizsa-type illusory contours or explicit luminance contours were tested for three-dimensional (3-D) shape constancy. The curvature of the contours and the apparent viewing distance between the surface and the observer were manipulated. Observers judged which of two surfaces appeared more curved. Experiment 1 allowed eye movements and revealed a bias in 3-D shape judgment with changes in apparent viewing distance, such that surfaces presented far from the observer appeared less curved than surfaces presented close to the observer. The lack of depth constancy was approximately the same for illusory-contour surfaces and for explicit-contour surfaces. Experiment 2 showed that depth constancy for explicit-contour surfaces improved slightly when fixation was required and eye movements were restricted. These experiments suggest that curvature in depth is misperceived, and that illusory-contour surfaces are particularly sensitive to this distortion.     

The Perceptual Basis of Vast Space

“Vast” is a word often applied to environmental terrain that is perceived to have large spatial extent. This judgment is made even at viewing distances where traditional metric depth cues are not useful. This paper explores the perceptual basis of vast experience, including reliability and visual precursors. Experiment 1 demonstrated strong agreement in ratings of the spatial extent of two-dimensional (2D) scene images by participants in two countries under very different viewing conditions. Image categories labeled “vast” often exemplified scene attributes of ruggedness and openness (Oliva & Torralba, 2001). Experiment 2 quantitatively assessed whether these properties predict vastness. High vastness ratings were associated with highly open, or moderately open but rugged, scenes. Experiment 3 provided evidence, consistent with theory, that metric distance perception does not directly mediate the observed vastness ratings. The question remains as to how people perceive vast space when information about environmental scale is unavailable from metric depth cues or associated scene properties. We consider possible answers, including contribution from strong cues to relative depth.     

Splitting visual space with attention

If a right-left spatial compatibility effect is observed, it can be maintained that the space has been segmented into right- and left-side parts. The present study aimed at showing a spatial compatibility effect (and, by implication, a right-left subdivision of space) solely attributable to the orienting of attention. Five groups of 8 normal subjects were required to give right-left discriminative responses to stimuli presented within one of six empty boxes arranged in a horizontal row. Reaction times and errors were recorded. The first two experiments showed that a right-left grouping of the boxes occurred regardless of whether subjects' fixation was kept at the intermediate position (Experiment 1) or at one extremity (Experiment 2) of the row. In Experiments 3 and 4, subjects' attention was not aligned with a fixed position but was moved, through peripheral cues, from trial to trial and positioned between different pairs of adjacent boxes. The results showed that the display was again subdivided into two regions and that the reference point for the right-left subdivision was the focus of attention. In Experiment 5, eye position was instrumentally monitored, and subjects' attention was directed by central cues. The results confirmed that the focusing of attention leads to a right-left partitioning of space, with the boundary at the locus of focal attention. In conclusion, we demonstrated, by employing a right-left spatial compatibility paradigm, that directing attention to a position in space brings about a right-left perceptual organization that predominates over that provided by the other egocentric reference axes.     

Visual inertia of rotating 3-D objects

Five experiments were designed to determine whether a rotating, transparent 3-D cloud of dots (simulated sphere) could influence the perceived direction of rotation of a subsequent sphere. Experiment 1 established conditions under which the direction of rotation of a virtual sphere was perceived unambiguously. When a near-far luminance difference and perspective depth cues were present, observers consistently saw the sphere rotate in the intended direction. In Experiment 2, a near-far luminance difference was used to create an unambiguous rotation sequence that was followed by a directionally ambiguous rotation sequence that lacked both the near-far luminance cue and the perspective cue. Observers consistently saw the second sequence as rotating in the same direction as the first, indicating the presence of 3-D visual inertia. Experiment 3 showed that 3-D visual inertia was sufficiently powerful to bias the perceived direction of a rotation sequence made unambiguous by a near-far luminance cue. Experiment 5 showed that 3-D visual inertia could be obtained using an occlusion depth cue to create an unambiguous inertia-inducing sequence. Finally, Experiments 2, 4, and 5 all revealed a fast-decay phase of inertia that lasted for approximately 800 msec, followed by an asymptotic phase that lasted for periods as long as 1,600 msec. The implications of these findings are examined with respect to motion mechanisms of 3-D visual inertia.     

Surface formation and depth in monocular scene perception

The visual perception of monocular stimuli perceived as 3-D objects has received considerable attention from researchers in human and machine vision. However, most previous research has focused on how individual 3-D objects are perceived. Here this is extended to a study of how the structure of 3-D scenes containing multiple, possibly disconnected objects and features is perceived. Da Vinci stereopsis, stereo capture, and other surface formation and interpolation phenomena in stereopsis and structure-from-motion suggest that small features having ambiguous depth may be assigned depth by interpolation with features having unambiguous depth. I investigated whether vision may use similar mechanisms to assign relative depth to multiple objects and features in sparse monocular images, such as line drawings, especially when other depth cues are absent. I propose that vision tends to organize disconnected objects and features into common surfaces to construct 3-D-scene interpretations. Interpolations that are too weak to generate a visible surface percept may still be strong enough to assign relative depth to objects within a scene. When there exists more than one possible surface interpolation in a scene, the visual system's preference for one interpolation over another seems to be influenced by a number of factors, including: (i) proximity, (ii) smoothness, (iii) a preference for roughly frontoparallel surfaces and 'ground' surfaces, (iv) attention and fixation, and (v) higher-level factors. I present a variety of demonstrations and an experiment to support this surface-formation hypothesis.     

Segregation by color and stereoscopic depth in three-dimensional visual space

Two experiments were conducted to investigate how color and stereoscopic depth information are used to segregate objects for visual search in three-dimensional (3-D) visual space. Eight observers were asked to indicate the alphanumeric category (letter or digit) of the target which had its unique color and unique depth plane. In Experiment 1, distractors sharing a common depth plane or a common color appeared in spatial contiguity in thexy plane. The results suggest that visual search for the target involves examination of kernels formed by homogeneous items sharing the same color and depth. In Experiment 2, thexy contiguity of distractors sharing a common color or a common depth plane was varied. The results showed that when target-distractor distinction becomes more difficult on one dimension, the other dimension becomes more important in performing visual search, as indicated by a larger effect on search time. This suggests that observers can make optimal use of the information available. Finally, color had a larger effect on search time than did stereoscopic depth. Overall, the results support models of visual processing which maintain that perceptual segregation and selective attention are determined by similarity among objects in 3-D visual space on both spatial and nonspatial stimulus dimensions.     

Temporal integration of motion and stereo cues to depth

In three experiments we investigated the integration of three-dimensional information provided over time by different depth cues. In the first experiment, we found that the perceptual derivation of surface orientation from the optic flow was affected by the prior presentation of static stereo information in the same spatial location. This bias weakened as the length of the motion sequence increased, but it was still present after 800 msec. In the second experiment, conversely, we found that the perceived orientation of a stereo-specified surface was not influenced by the prior presentation of a static stereo surface. In a third experiment, we found that two surfaces defined by identical disparity fields did not elicit the same perceived depth if, previously, one of them had been specified by a conjunction of stereo and motion information. This effect was found to last for at least 400 msec. Taken together, these findings indicate that interactions exist among different sources of depth information, even when they are provided at different moments of time.     

Dynamics of attention in depth: evidence from multi-element tracking

We examined the allocation of attention in depth using a multi-element tracking paradigm. Observers were required to track a predefined subset of from two to eight elements in displays containing up to sixteen identical moving elements. We first show that depth cues, such as binocular disparity and occlusion through T-junctions, improve performance in a multi-element tracking task in the case where element boundaries are allowed to intersect in the depiction of motion in a single frontoparallel plane. We also show that the allocation of attention across two perceptually distinguishable planar surfaces, either frontoparallel or receding at a slanting angle and defined by coplanar elements, is easier than allocation of attention within a single surface. The same result was not found when attention was required to be deployed across items of two-color populations rather than across items of a single color. Our results suggest that, when surface information does not suffice to distinguish between targets and distractors that are embedded in these surfaces, division of attention across two surfaces aids in tracking moving targets. A final experiment with populations of elements moving within distinct volumes produced similar results, suggesting that spatial separation in three dimensions, rather than confinement to surfaces as such, may explain the improved performance for the two-surface case.     

The appearance of surfaces specified by motion parallax and binocular disparity

The experiments reported in this paper were designed to investigate how depth information from binocular disparity and motion parallax cues is integrated in the human visual system. Observers viewed simulated 3-D corrugated surfaces that translated to and fro across their line of sight. The depth of the corrugations was specified by either motion parallax, or binocular disparities, or some combination of the two. The amount of perceived depth in the corrugations was measured using a matching technique.

A monocularly viewed surface specified by parallax alone was seen as a rigid, corrugated surface translating along a fronto-parallel path. The perceived depth of the corrugations increased monotonically with the amount of parallax motion, just as if observers were viewing an equivalent real surface that produced the same parallax transformation. With binocular viewing and zero disparities between the images seen by the two eyes, the perceived depth was only about half of that predicted by the monocular cue. In addition, this binocularly viewed surface appeared to rotate about a vertical axis as it translated to and fro. With other combinations of motion parallax and binocular disparity, parallax only affected the perceived depth when the disparity gradients of the corrugations were shallow. The discrepancy between the parallax and disparity signals was typically resolved by an apparent rotation of the surface as it translated to and fro. The results are consistent with the idea that the visual system attempts to minimize the discrepancies between (1) the depth signalled by disparity and that required by a particular interpretation of the parallax transformation and (2) the amount of rotation required by that interpretation and the amount of rotation signalled by other cues in the display.     

Three-month-olds' sensitivity to orientation cues in the three-dimensional depth plane

Three-month-olds are sensitive to orientation changes of line drawings when they have a three-dimensional (3-D) interpretation and when the changes are defined by both 3-D depth and two-dimensional (2-D) picture plane cues [Bhatt, R. S., & Bertin, E. (2001). Pictorial cues and three-dimensional information processing in early infancy. Journal of Experimental Child Psychology, 80, 315-332]. In the current study, we examined whether 3-month-olds are sensitive to pictorial line junction cues that signal orientation changes solely in the 3-D depth plane. The results revealed that infants discriminated a misoriented elongated cube in an array when the stimuli contained both shading and lines (Experiment 2) but not when only lines depicted the elongated cubes (Experiment 1). Testing with comparable 2-D images revealed that, even in the presence of shading information, detection of orientation changes is specific to images that have a 3-D interpretation. Together, the results suggest that 3-month-olds are sensitive to pictorial line junction cues that signal orientation changes in the 3-D depth plane to adults provided that shading information is available and the images have a 3-D interpretation.     

The interaction of oculomotor cues and stimulus size in stereoscopic death constancy.

In the natural world, observers perceive an object to have a relatively fixed size and depth over a wide range of distances. Retinal image size and binocular disparity are to some extent scaled with distance to give observers a measure of size constancy. The angle of convergence of the two eyes and their accommodative states are one source of scaling information, but even at close range this must be supplemented by other cues. We have investigated how angular size and oculomotor state interact in the perception of size and depth at different distances. Computer-generated images of planar and stereoscopically simulated 3-D surfaces covered with an irregular blobby texture were viewed on a computer monitor. The monitor rested on a movable sled running on rails within a darkened tunnel. An observer looking into the tunnel could see nothing but the simulated surface so that oculomotor signals provided the major potential cues to the distance of the image. Observers estimated the height of the surface, their distance from it, or the stereoscopically simulated depth within it over viewing distances which ranged from 45 cm to 130 cm. The angular width of the images lay between 2 deg and 10 deg. Estimates of the magnitude of a constant simulated depth dropped with increasing viewing distance when surfaces were of constant angular size. But with surfaces of constant physical size, estimates were more nearly independent of viewing distance. At any one distance, depths appeared to be greater, the smaller the angular size of the image. With most observers, the influence of angular size on perceived depth grew with increasing viewing distance. These findings suggest that there are two components to scaling. One is independent of angular size and related to viewing distance. The second component is related to angular size, and the weighting accorded to it grows with viewing distance. Control experiments indicate that in the tunnel, oculomotor state provides the principal cue to viewing distance. Thus, the contribution of oculomotor signals to depth scaling is gradually supplanted by other cues as viewing distance grows. Binocular estimates of the heights and distances of planar surfaces of different sizes revealed that angular size and viewing distance interact in a similar way to determine perceived size and perceived distance.     

Wheatstone—Panum limiting case: Occlusion, camouflage, and vergence-induced disparity cues

We examined effects of binocular occlusion, binocular camouflage, and vergence-induced disparity cues on the perceived depth between two objects when two stimuli are presented to one eye and a single stimulus to the other (Wheatstone—Panum limiting case). The perceived order and magnitude of the depth were examined in two experimental conditions: (1) The stimulus was presented on the temporal side (occlusion condition) and (2) the nasal side (camouflage condition) of the stimulus pair on one retina so as to fuse with the single stimulus on the other retina. In both conditions, the separation between the stimulus pair presented to one eye was systematically varied. Experiment 1, with 16 observers, showed that the fused object was seen in front of the nonfused object in the occlusion condition and was seen at the same distance as the nonfused object in the camouflage condition. The perceived depth between the two objects was constant and did not depend on the separation of the stimulus pair presented to one eye. Experiment 2, with 45 observers, showed that the disparity induced by vergence mainly determined the perceived depth, and the depth magnitude increased as the separation of the stimulus pair was made wider. The results suggest that (1) occlusion provides depth-order information but not depth-magnitude information, (2) camouflage provides neither depth-order nor depth-magnitude information, and (3) vergence-induced disparity provides both order and magnitude information.