Occlusion as a depth cue in the Wheatstone-Panum limiting case

We examined the hypothesis (Ono & Wade, 1985) that occlusion of far stimuli by a near one on the same visual line can operate as a depth cue in stereograms containing different numbers of targets in the two eyes. By controlling eye positions, we created conditions in which the visual system could interpret the retinal images as originating from stimuli on the visual axis of one eye and also created other conditions in which the origin of the retinal images was ambiguous. In Experiment 1, we presented two lines to one eye and a single line to the other eye. When the image of the line on the temporal side of the line pair on one retina fused with the image of the single line on the other retina, the nonfused line appeared farther away more often than it did when the image on the nasal side fused. In Experiment 2, we used two differently shaped stimuli. In the condition in which the nonfused stimulus represented an object being occluded, it appeared farther away more often than in the four conditions in which it did not. In Experiment 3, we extended the idea to three different objects. When the middle of the three images fused with the single image, the nonfused stimulus appeared farther when it could be interpreted as being occluded than when it could not. In the condition in which the most temporal image fused with the single image, the nonfused stimuli appeared farther than in the condition in which the most nasal one fused. The results supported the hypothesis that occlusion plays a role in depth perception in the Wheatstone-Panum limiting case.     

Shape from shadows

The colors, textures, and shapes of shadows are physically constrained in several ways in natural scenes. The visual system appears to ignore these constraints, however, and to accept many patterns as shadows even though they could not occur naturally. In the stimuli that we have studied, the only requirements for the perception of depth due to shadows were that shadow regions be darker than the surrounding, nonshadow regions and that there be consistent contrast polarity along the shadow border. Three-dimensional shape due to shadows was perceived when shadow areas were filled with colors or textures that could not occur in natural scenes, when shadow and nonshadow regions had textures that moved in different directions, or when they were presented on different depth planes. The results suggest that the interpretation of shadows begins with the identification of acceptable shadow borders by a cooperative process that requires consistent contrast polarity across a range of scales at each point along the border. Finally, we discuss how the identification of a shadow region can help the visual system to patch together areas that are separated by shadow boundaries, to identify directions of surface curvature, and to select a preferred three-dimensional interpretation while rejecting others.     

Occlusion as a depth cue in the Wheatstone-Panum limiting case.

We examined the hypothesis (Ono & Wade, 1985) that occlusion of far stimuli by a near one on the same visual line can operate as a depth cue in stereograms containing different numbers of targets in the two eyes. By controlling eye positions, we created conditions in which the visual system could interpret the retinal images as originating from stimuli on the visual axis of one eye and also created other conditions in which the origin of the retinal images was ambiguous. In Experiment 1, we presented two lines to one eye and a single line to the other eye. When the image of the line on the temporal side of the line pair on one retina fused with the image of the single line on the other retina, the nonfused line appeared farther away more often than it did when the image on the nasal side fused. In Experiment 2, we used two differently shaped stimuli. In the condition in which the nonfused stimulus represented an object being occluded, it appeared farther away more often than in the four conditions in which it did not. In Experiment 3, we extended the idea to three different objects. When the middle of the three images fused with the single image, the nonfused stimulus appeared farther when it could be interpreted as being occluded than when it could not. In the condition in which the most temporal image fused with the single image, the nonfused stimuli appeared farther than in the condition in which the most nasal one fused. The results supported the hypothesis that occlusion plays a role in depth perception in the Wheatstone-Panum limiting case.     

Rapid processing of cast and attached shadows

We used a visual-search method to investigate the role of shadows in the rapid discrimination of scene properties. Targets and distractors were light or dark 2-D crescents of identical shape and size, on a mid-grey background. From the dark stimuli, illusory 3-D shapes can be created by blurring one arc of the crescent. If the inner arc is blurred, the stimulus is perceived as a curved surface with attached shadow. If the outer arc is blurred, the stimulus is perceived as a flat surface casting a shadow. In a series of five experiments, we used this simple stimulus to map out the shadow properties that the human visual system can rapidly detect and discriminate. To subtract out 2-D image factors, we compared search performance for dark-shadow stimuli with performance for light-shadow stimuli which generally do not elicit strong 3-D percepts. We found that the human visual system is capable of rapid discrimination based upon a number of different shadow properties, including the type of the shadow (cast or attached), the direction of the shadow, and the displacement of the shadow. While it is clear that shadows are not simply discounted in rapid search, it is unclear at this stage whether rapid discrimination is acting upon shadows per se or upon representations of 3-D object shape and position elicited by perceived shadows.     

Perception of scene layout from optical contact, shadows, and motion

Kersten et al (1997 Perception 26 171-192) found that the perceived motion of an object in a 3-D scene was determined by the motion of a shadow. In the present study, we compared the effect of a shadow to that of a second object on the ground in determining the perceived position in depth of a floating object in both dynamic and stationary scenes. Changing the second (lower) object from textured to dark increased the influence of the second object on the judged position of the first object. Giving the second object zero thickness had this effect only if it was also dark. Variations in the height of the floating object were important with a second object but not with a shadow, in motion scenes. With alternative shadows present, the position of the floating object was determined primarily by matching speeds, with matching sizes as a secondary factor. These results show some similarities but important differences between the effect of a second object and that of a shadow.     

Use of interreflection and shadow for surface contact

The interaction of light with surfaces results in a number of lighting effects that may serve as valuable visual cues. Previous research on shadows has shown them to be effective in determining the three-dimensional (3-D) layout of a scene, but interreflections have been ignored as cues for spatial layout. Interreflections as well as shadows may help to disambiguate the 3-D layout of objects by providing information about an object's contact with a surface. We generated computer images of a box on an extended textured ground plane that was either in contact with the ground or was slightly above the ground. Images were rendered for four conditions: (1) no shadow + no interreflection, (2) shadow only, (3) interreflection only, and (4) shadow + interreflection. A photometrically incorrect condition was also included. The participants rated the degree of contact for each image on a scale, which was used to generate receiver operating characteristic (ROC) curves and a measure of sensitivity. In the images with no shadows or interreflections, the participants performed at chance levels. Interreflections, shadows, and a combination of interreflections and shadows all resulted in high sensitivity for judging object contact. More important, information from shadows and interreflections can be combined, resulting in near-perfect judgment of surface contact. Interreflections and shadows can be effective cues for object contact.     

How owls structure visual information

Recent studies on perceptual organization in humans claim that the ability to represent a visual scene as a set of coherent surfaces is of central importance for visual cognition. We examined whether this surface representation hypothesis generalizes to a non-mammalian species, the barn owl (Tyto alba). Discrimination transfer combined with random-dot stimuli provided the appropriate means for a series of two behavioural experiments with the specific aims of (1) obtaining psychophysical measurements of figure–ground segmentation in the owl, and (2) determining the nature of the information involved. In experiment 1, two owls were trained to indicate the presence or absence of a central planar surface (figure) among a larger region of random dots (ground) based on differences in texture. Without additional training, the owls could make the same discrimination when figure and ground had reversed luminance, or were camouflaged by the use of uniformly textured random-dot stereograms. In the latter case, the figure stands out in depth from the ground when positional differences of the figure in two retinal images are combined (binocular disparity). In experiment 2, two new owls were trained to distinguish three-dimensional objects from holes using random-dot kinematograms. These birds could make the same discrimination when information on surface segmentation was unexpectedly switched from relative motion to half-occlusion. In the latter case, stereograms were used that provide the impression of stratified surfaces to humans by giving unpairable image features to the eyes. The ability to use image features such as texture, binocular disparity, relative motion, and half-occlusion interchangeably to determine figure–ground relationships suggests that in owls, as in humans, the structuring of the visual scene critically depends on how indirect image information (depth order, occlusion contours) is allocated between different surfaces. Electronic Publication     

Effects of flicker-induced depth on chromatic subjective contours

Two experiments examined the dependence of illusory colors on boundary salience and depth stratification by using flicker-induced depth. The first used a subjective-contour stimulus that appeared as a translucent colored rectangle covering a set of inducing circles and a dark background. The circles were then flickered so as to be perceived as background, and the previously dark background moved forward and appeared as foreground. Simultaneously, the chromatic subjective contour was eliminated. In the second experiment, a subjective-contour (faces/vase-concentric squares) figure was tinted with the McCollough effect, which produced a strong subjective color edge. This edge was visible only with the faces/vase percept and not in the squares percept. Flickering the target locked it into the square configuration because in this case the flicker held the entire pattern in the same depth plane. This eliminated the subjective color edge. Depth stratification and subjective color blockage were maximal at a flicker rate of 6 Hz.     

Perceived relative distance on the ground affected by the selection of depth information

Our visual space does not appear to change when we scan or shift attention between locations. This appearance of stability implies that the depth information selection process is not crucial for constructing visual space. But we present evidence to the contrary. We focused on space perception in the intermediate distance, which depends on the integration of depth information on the ground. We propose a selection hypothesis that states that the integration process is influenced by where the depth information is selected. Specifically, the integration process inaccurately represents the ground when one samples depth information only from the far ground surface, instead of sequentially from the near to the far ground. To test this, observers matched the depth/length of a sagittal bar (test) to the width of a laterally oriented bar (reference) in three conditions in a full-cue environment that compelled the visual system to sample from different parts of the ground. These conditions had the lateral reference bar placed (1) adjacent to the test bar, (2) at the far ground, and (3) at the near ground. We found that the sagittal bar was perceived as shorter in conditions (1) and (2) than in Condition 3. This finding supports the selection hypothesis, since only Condition 3 led to more accurate ground surface integration/representation and less error in relative distance/depth perception. Also, we found that performances in all three conditions were similar in the dark, which has no depth information on the ground, indicating that the results cannot be attributed to asymmetric visual scanning but, rather, to differential information selection.     

The perception of briefly exposed point-sources of light

Point-sources of light (dots) were exposed for 10 to 50 msec, before five dark-adapted subjects in a dimly illuminated room. During voluntary fixation with one eye, the target was exposed some 10° on the nasal side of the optic axis. The intensity X duration of all targets was 2 X threshold and they consisted of either a single dot, or a pair of dots separated by a distance that was less than that required for two-point discrimination. In two-thirds of trials both the single-dot and the two-dot targets were perceived as short thin lines of various orientation. Although individual percepts were unpredictable, there was a preferred or most likely orientation for responses to the single-dot target; this was near to the horizontal for all five subjects. There was no significant difference between the preferred orientations for single-dot targets tested at sites more than 1° apart in the visual field. When two single-dot targets, separated by about 1°, were exposed simultaneously, the orientations of the perceived lines sometimes differed by as much as 80°; occasionally, one target was reported as a dot while the other was seen as a thin line. If the single-dot was briefly exposed between two continuously visible and parallel straight lines, the target usually appeared as a thin line, parallel to the framing lines. Some of these results appear to be consistent with the hypothesis that the human visual cortex, like that of the cat and monkey, contains neurones that are orientation specific.     

Disparity minimisation, cyclovergence, and the validity of nonius lines as a technique for measuring torsional alignment

Frisby et al (1993 Perception 22 Supplement, 115) proposed that the visual system might make cyclovergent eye movements in order to minimise the overall pattern of both vertical and horizontal disparities when an observer views an inclined stereoscopic surface. Their measurements of cyclovergence, which used vertically oriented nonius lines, were found to be consistent with that proposal. In our experiment 1, we measured torsional eye movements objectively, using scleral coils, and found no evidence of a cyclovergent response to either a real inclined surface or to a simulated inclined surface in which the two stereoscopic images were related by a horizontal shear transformation. These results are inconsistent with the disparity minimisation hypothesis. In order to account for the discrepant findings of the two studies, we propose that vertically oriented nonius lines may not be a valid method for assessing cyclovergence because the lines can be seen as lying 'within' the inclined surface. In experiment 2, we tested the predictions of the cyclovergence hypothesis of Frisby et al against our own 'within surface' explanation, using both horizontally and vertically oriented nonius lines and dichoptic images related by either a horizontal or a vertical shear. If cyclovergence were the cause of the misalignment, both horizontal and vertical nonius lines should appear misaligned to the same extent. This was not found to be the case. We conclude that vertical nonius lines may not be a valid technique for measuring cyclovergence when the lines are seen against a background of an inclined surface.     

Organizational factors and the perception of motion in depth

When two stationary, stereoscopically separated targets are viewed in a completely dark surround, and no cues concerning their egocentric distances from the observer are salient, the farther target tends to be seen at the same distance it would have assumed if it were by itself. The nearer target is seen as being closer than it would have been if seen alone. The present studies extend this previous finding (now termed thefar-anchor effect) into the domain of targets that move in stereoscopic space. Observers viewed two small illuminated targets, which began at either the same or different stereoscopic distances. One of the targets was moved in depth and the observers identified the target that appeared to move. Conditions varied according to the initial depth location of the moving target. Significantly more correct responses were reported when the nearer target moved than when the farther one moved, consistent with the hypothesis that the perception of motion in depth is affected by the aforementioned perceptual anchoring effect of the farther target.     

A variant of the anomalous motion illusion based upon contrast and visual latency

We examined a variant of the anomalous motion illusion. In a series of experiments, we ascertained luminance contrast to be the critical factor. Low-contrast random dots showed longer latency than high-contrast ones, irrespective of whether they were dark or light (experiments 1 -3). We conjecture that this illusion may share the same mechanism with the Hess effect, which is characterised by visual delay of a low-contrast, dark stimulus in a moving situation. Since the Hess effect is known as the monocular version of the Pulfrich effect, we examined whether illusory motion in depth could be observed if a high-contrast pattern was projected to one eye and the same pattern of low-contrast was presented to the other eye, and they were binocularly fused and swayed horizontally. Observers then reported illusory motion in depth when the low-contrast pattern was dark, but they did not when it was bright (experiment 4). Possible explanations of this inconsistency are discussed.     

Distortions of depth-order relations and parallelism in structure from motion

Four experiments related human perception of depth-order relations in structure-from-motion dis-plays to current Euclidean and affine theories of depth recovery from motion. Discrimination between parallel and nonparallel lines and relative-depth judgments was observed for orthographic projections of rigidly oscillating random-dot surfaces. We found that (1) depth-order relations were perceived veridically for surfaces with the same slant magnitudes, but were systematically biased for surfaces with different slant magnitudes. (2) Parallel (virtual) lines defined by probe dots on surfaces with different slant magnitudes were judged to be nonparallel. (3) Relative-depth judgments were internally inconsistent for probe dots on surfaces with different slant magnitudes. It is argued that both veridical performance and systematic misperceptions may be accounted for by a heuristic analysis of the first-order optic flow.     

The contribution of colour to three-dimensional ambiguities in paintings and drawings.

This paper is about kinds of visual ambiguity that concern the author as a painter. Some effects of incompatible depth cues on the experience of looking at paintings and drawings are discussed. Particular attention is given to the role of colour as a depth cue. It is suggested that areas of identical pigmentation on different parts of a picture surface tend to be interpreted as being on the same plane. Where this interpretation is incompatible with other depth cues 'visual tension' results, the degree of tension being dependent on the relative strength of the cues involved. This hypothesis is illustrated and elaborated with the help of a number of line drawings.     

The minimum contrast requirements for stereopsis.

A number of researchers have compared the contrast requirements for stereopsis with those for detection of the stereoscopic stimulus, but they have generally failed to allow for the fact that stereopsis requires a detectable stimulus in both eyes at the same time. It is argued that the most appropriate detection threshold for this comparison is that for simultaneous monocular detection (SMD) of the stereoscopic half images. Experiments in which this comparison threshold has been used are summarised and the hypothesis generated that, on using stimuli that are localised in both space and spatial frequency (e.g. Gabor patches or differences of Gaussians), a range of disparities can always be found over which contrast thresholds for depth identification are less than or equal to this SMD threshold (the SMD hypothesis). It is argued that the success of this hypothesis in describing data obtained with these stimuli is consistent with the notions of labelled lines for disparity sign and the size--disparity correlation. Last, experiments are reported in which contrast thresholds for stereoscopic depth identification (front/back) were measured with interocular differences in contrast. The data obtained are consistent with the presence of both inhibitory and excitatory interactions between the eyes when unequal monocular contrasts are presented. The implications of these results and the SMD hypothesis for theories of stereopsis and binocular function are discussed.     

Rigid and non-rigid kinetic depth effect with rotating discrete helices

Summary To examine the conditions in which human observers fail to recover the rigid structure of a three-dimensional object in motion we used simulations of discrete helices with various pitches undergoing either pure rotation in depth (rigid stimuli) or rotation plus stretching (non-rigid stimuli). Subjects had either to rate stimuli on a rigidity scale (Experiments 1 and 2) or to judge the amount of rotation of the helices (Experiments 3 and 4). We found that perceived rigidity depended on the pitch of the helix rather than on objective non-rigidity. Furthermore, we found that helices with a large pitch/radius ratio were perceived as highly non-rigid and that their rotation was underestimated. Experiment 5 showed that the detection of a pair of dots rigidly related (located on. the helix) against a background of randomly moving dots is easier at small phases in which the change of orientation across frames is also small. We suggest that this is because at small phases the grouping of dots in virtual lines does occur and that this may be an important factor in the perceived nonrigidity of the helices.This research was supported by MPI 60% (1987, 1988) and CNR (1986), 1987, 1988) grants to Clara Casco and Sergio Roncato and Grant CNR 90.01603.PS93 to Giorgio Ganis.     

Depth separation and the Ponzo illusion

The Ponzo illusion refers to an apparent change in length of objectively equal parallel lines induced by enclosure within an acute angle. The present study investigated this illusory change in stimulus extent as a function of the relative depth positions of the parallel lines and the inducing angle. To permit facile and unconfounded manipulation of apparent depth, the stimuli comprising the Ponzo configuration were stereoscopic contours formed from dynamic random-element stereograms. The main results were: (1) apparent depth separation exerted a strong influence on illusion magnitude; (2) this influence was asymmetrical in that illusion magnitude decreased when the inducing angle appeared in depth behind the parallel lines and increased when the inducing angle appeared in depth in front of the lines. These data are consistent with a general theory of space perception that assumes that information about depth position is processed prior to information about stimulus characteristics.     

Some observations on the perception of Marroquin patterns.

Demonstrations are presented to show that the perception of structure in Marroquin patterns is disrupted if the dots comprising the pattern have opposite contrast polarity, and also if the dots comprising the pattern are separated in stereoscopic depth. It is also demonstrated that the perception of structure in a Marroquin pattern is made possible if the pattern is separated in stereoscopic depth from 'noise' dots, where the pattern structure cannot be perceived in either half of the unfused stereogram. In these respects the perception of Marroquin patterns is similar to the perception of Glass patterns. These findings are thus consistent with the proposal that the perception both of Marroquin and of Glass patterns is based on the construction of virtual lines.     

The aperture problems in the Pulfrich effect

The Pulfrich effect yields a perceived depth for horizontally moving objects but not for vertically moving ones. In this study the Pulfrich effect was measured by translating oblique lines seen through a circular window, which made motion direction ambiguous. Overlaying random dots that moved horizontally, vertically, or diagonally controlled the perceptual motion direction of the lines. In experiment 1, when the lines were seen to move horizontally, the effect was strongest in spite of the same physical motion of the lines. Experiment 2 was performed to test the above conditions again, excluding the Pulfrich effect of the dots on the depth of the lines. The overlaid dots were presented to one eye only. The result showed that the Pulfrich effect of the lines was persistently strong in spite of the perceptual changes in motion direction. Experiment 3 also showed that the Pulfrich depth was independent of the perceived horizontal speed in a plaid display. The Pulfrich effect was determined by measuring the horizontal disparity component, independently of the perceived motion direction. These results demonstrate that the aperture problems in motion and stereopsis in the Pulfrich effect are solved independently.