Perceiving self-motion in depth: The role of stereoscopic motion and changing-size cues

During self-motions, different patterns of optic flow are presented to the left and right eyes. Previous research has, however, focused mainly on the self-motion information contained in a single pattern of optic flow. The present experiments investigated the role that binocular disparity plays in the visual perception of self-motion, showing that the addition of stereoscopic cues to optic flow significantly improves forward linear vection in central vision. Improvements were also achieved by adding changingsize cues to sparse (but not dense) flow patterns. These findings showed that assumptions in the heading literature that stereoscopic cues facilitate self-motion only when the optic flow has ambiguous depth ordering do not apply to vection. Rather, it was concluded that both stereoscopic and changingsize cues provide additional motion-in-depth information that is used in perceiving self-motion.     

How owls structure visual information

Recent studies on perceptual organization in humans claim that the ability to represent a visual scene as a set of coherent surfaces is of central importance for visual cognition. We examined whether this surface representation hypothesis generalizes to a non-mammalian species, the barn owl (Tyto alba). Discrimination transfer combined with random-dot stimuli provided the appropriate means for a series of two behavioural experiments with the specific aims of (1) obtaining psychophysical measurements of figure–ground segmentation in the owl, and (2) determining the nature of the information involved. In experiment 1, two owls were trained to indicate the presence or absence of a central planar surface (figure) among a larger region of random dots (ground) based on differences in texture. Without additional training, the owls could make the same discrimination when figure and ground had reversed luminance, or were camouflaged by the use of uniformly textured random-dot stereograms. In the latter case, the figure stands out in depth from the ground when positional differences of the figure in two retinal images are combined (binocular disparity). In experiment 2, two new owls were trained to distinguish three-dimensional objects from holes using random-dot kinematograms. These birds could make the same discrimination when information on surface segmentation was unexpectedly switched from relative motion to half-occlusion. In the latter case, stereograms were used that provide the impression of stratified surfaces to humans by giving unpairable image features to the eyes. The ability to use image features such as texture, binocular disparity, relative motion, and half-occlusion interchangeably to determine figure–ground relationships suggests that in owls, as in humans, the structuring of the visual scene critically depends on how indirect image information (depth order, occlusion contours) is allocated between different surfaces. Electronic Publication     

Integration of motion parallax with binocular disparity specifying different surface shapes

We investigated the interaction between motion parallax and binocular disparity cues in the perception of surface shape and depth magnitude by the use of the random dot stimuli in which these cues specified sinusoidal depth surfaces undulating with different spatial frequencies. When ambiguous motion parallax is inconsistent with unambiguous disparity cue, the reasonable solution for the visual system is to convert the motion signal to the flow on the surface specified by disparity. Two experiments, however, found that the visual system did not always use this reasonable solution; observers often perceived the surface specified by a composite of the two cues, or the surface specified by parallax alone. In the perception of this composite of the two cues, the apparent depth magnitude increased with the increase of the depth magnitude specified by both cues. This indicates that the visual system can combine the depth magnitude information from parallax and disparity in an additive fashion. The interference with parallax by disparity implies that the parallax processing is not independent of the disparity processing.     

How is motion disparity integrated with binocular disparity in depth perception?

Two experiments presented motion disparity conflicting with binocular disparity to examine how these cues determined apparent depth order (convex, concave) and depth magnitude. In each experiment, 8 subjects estimated the depth order and depth magnitude. The first experiment showed the following. (1) The visual system used one of these cues exclusively in selecting a depth order for each display. (2) The visual system integrated the depth magnitude information from these cues by a weighted additive fashion if it selected the binocular disparity in depth order perception and if the depth magnitude specified by motion disparity was small relative to that specified by binocular disparity. (3) The visual system ignored the depth magnitude information of binocular disparity if it selected the motion disparity in depth order perception. The second experiment showed that these three points were consistent whether the subject’s head movement or object movement generated motion disparity.     

Integration of stereo and texture cues in the formation of discontinuities during three-dimensional surface interpolation

A series of stereograms are presented which demonstrate that texture boundaries can strongly influence the perception of discontinuities between neighbouring three-dimensional (3-D) surfaces portrayed by means of stereo cues. In these demonstration figures, no stereo information is available in the immediate vicinity of the boundary between the two 3-D stereo surfaces because all texture in that region is removed in one eye's view. On the other hand, various forms of texture boundary information are provided in the resulting monocular region. This stimulus paradigm is used to explore the question: what influence does texture boundary information have on the nature of the perceived 3-D surface that is interpolated between two stimulus regions which carry stereo cues? It is shown that if a clear-cut texture boundary is present in the monocular region then this is used by the human visual system to fix the perceived location of 3-D crease and step surface discontinuities between the stereo regions. Collett (1985) explored this issue with a similar methodology and reported weak and unreliable assistance from monocular texture boundaries in helping shape 3-D stereo surface discontinuities. The strong and robust phenomena demonstrated here seem to rely on two main differences between the present stimuli and those of Collett. In the present stimuli, figurally continuous textures containing strong texture boundaries are used, together with a technique for minimising the complications, including binocular rivalry, that arise from the borders of the stimulus regions present in only one half of each stereogram.     

Combining binocular and monocular curvature features.

A study is reported of the perception of visual surfaces in wire-frame stimuli generated by combinations of monocular surface contours and binocular disparity that provide differing information about 3-D relief. Observers vary considerably in the relative contribution made by the binocular and monocular cues to the perception of overall 3-D form. Without training, many observers may entirely fail to perceive surface curvature from the binocular disparity patterns, interpreting the form of the surface only according to the monocular information. For other observers, both cues contribute to the end percept, with the monocular interpretation dominating where the disparity information indicates planarity and with disparity dominating where disparity information suggests curvature and the monocular interpretation suggests planarity. Where stereo and monocular interpretations indicate inconsistent surface curvature features at a common location, more complex resolution strategies are suggested.     

Seeing in three dimensions: the neurophysiology of stereopsis

From the pair of 2-D images formed on the retinas, the brain is capable of synthesizing a rich 3-D representation of our visual surroundings. The horizontal separation of the two eyes gives rise to small positional differences, called binocular disparities, between corresponding features in the two retinal images. These disparities provide a powerful source of information about 3-D scene structure, and alone are sufficient for depth perception. How do visual cortical areas of the brain extract and process these small retinal disparities, and how is this information transformed into non-retinal coordinates useful for guiding action? Although neurons selective for binocular disparity have been found in several visual areas, the brain circuits that give rise to stereoscopic vision are not very well understood. I review recent electrophysiological studies that address four issues: the encoding of disparity at the first stages of binocular processing, the organization of disparity-selective neurons into topographic maps, the contributions of specific visual areas to different stereoscopic tasks, and the integration of binocular disparity and viewing-distance information to yield egocentric distance. Some of these studies combine traditional electrophysiology with psychophysical and computational approaches, and this convergence promises substantial future gains in our understanding of stereoscopic vision.     

Recovery of 3-D shape from binocular disparity and structure from motion

Four experiments were conducted to examine the integration of depth information from binocular stereopsis and structure from motion (SFM), using stereograms simulating transparent cylindrical objects. We found that the judged depth increased when either rotational or translational motion was added to a display, but the increase was greater for rotating (SFM) displays. Judged depth decreased as texture element density increased for static and translating stereo displays, but it stayed relatively constant for rotating displays. This result indicates that SFM may facilitate stereo processing by helping to resolve the stereo correspondence problem. Overall, the results from these experiments provide evidence for a cooperative relationship between. SFM and binocular disparity in the recovery of 3-D relationships from 2-D images. These findings indicate that the processing of depth information from SFM and binocular disparity is not strictly modular, and thus theories of combining visual information that assume strong modularity-or-independence cannot accurately characterize all instances of depth perception from multiple sources.     

The visual control of reaching and grasping: binocular disparity and motion parallax

The primary visual sources of depth and size information are binocular cues and motion parallax. Here, the authors determine the efficacy of these cues to control prehension by presenting them in isolation from other visual cues. When only binocular cues were available, reaches showed normal scaling of the transport and grasp components with object distance and size. However, when only motion parallax was available, only the transport component scaled reliably. No additional increase in scaling was found when both cues were available simultaneously. Therefore, although equivalent information is available from binocular and motion parallax information, the latter may be of relatively limited use for the control of the grasp. Binocular disparity appears selectively important for the control of the grasp.     

The dynamics of the visual system in combining conflicting KDE and binocular stereopsis cues

The dynamics of the visual system in combining multiple depth cues were investigated by measuring the temporal change in the perceived 3-D shape of a random-dot stimulus with conflicting kinetic depth effect (KDE) and binocular stereopsis cues. The KDE shape perception dominated for the first few seconds, and then was gradually supplanted by the stereo shape perception. The effects of various pre-adaptation stimuli suggested that the temporal change in the perceived shape resulted from a self-adaptation of the KDE mechanism that occurs mainly at the levels of motion and relative motion detection.     

Depth perception: cuttlefish (Sepia officinalis) respond to visual texture density gradients

Studies concerning the perceptual processes of animals are not only interesting, but are fundamental to the understanding of other developments in information processing among non-humans. Carefully used visual illusions have been proven to be an informative tool for understanding visual perception. In this behavioral study, we demonstrate that cuttlefish are responsive to visual cues involving texture gradients. Specifically, 12 out of 14 animals avoided swimming over a solid surface with a gradient picture that to humans resembles an illusionary crevasse, while only 5 out of 14 avoided a non-illusionary texture. Since texture gradients are well-known cues for depth perception in vertebrates, we suggest that these cephalopods were responding to the depth illusion created by the texture density gradient. Density gradients and relative densities are key features in distance perception in vertebrates. Our results suggest that they are fundamental features of vision in general, appearing also in cephalopods.     

Is there a pop-out of exclusively binocular (cyclopean) contours and regions?

In this work, contours and texture regions were designed so that they could not be observed by either eye alone, but only after images from both eyes were fused into a single stereoscopic picture. Two planes of random dots were positioned one in front of the other so that their random-dot patterns were transparently overlaid. In this way the dot pattern in the front plane was completely masked by the dots in the back plane for either eye on its own. Such exclusively binocular or 'cyclopean' stimuli are therefore defined by a conjunction of depth information with other basic visual features. It is shown that, unlike their monocular counterparts, cyclopean contours do not pop-out. It is also shown that cyclopean regions pop-out only when they have either much higher or much lower luminance contrast than their surroundings, or (for some observers) when the cyclopean region is defined by motion contrast. Colour, luminance-contrast sign, and orientation-defined regions are not easily detected even when viewed attentively.     

Does binocular disparity or familiar size information override effects of relative size on judgements of time to contact?

Previous studies indicate that non-tau sources of depth information, such as pictorial depth cues, can influence judgements of time to contact (TTC). The effect of relative size on such judgements, the size-arrival effect, is particularly robust. However, earlier studies of the size-arrival effect did not include binocular disparity or familiar size information. The effects of these cues on relative TTC judgements were measured. Results suggested that disparity can eliminate the size-arrival effect but that the amount of disparity needed to do so is greater than typical stereoacuity thresholds. In contrast, familiar size eliminated the size-arrival effect even when disparity information was not available. Furthermore, disparity contributed more to performance when familiar size was present than when it was absent. Consistent with previous studies, TTC judgements were influenced by multiple sources of information. The present results suggested further that familiar size is one such source of information and that familiar size moderates the influence of binocular disparity information.     

Stereoscopic surface interpolation supports lightness constancy

The human visual system has a remarkable ability to construct surface representations from sparse stereoscopic, as well as texture and motion, information. In impoverished displays where few points are used to define regions in depth, the brain often interpolates depth estimates across intervening blank regions to create a compelling sense of a solid surface. The set of experiments described here examined stereoscopic interpolation using a novel technique based on lightness constancy. The effectiveness of this method is notable because it stands as the only technique to date that unequivocally examines the perception of interpolated surfaces, and not surfaces inferred subjectively from depth information in the stimulus. Further, these data support the growing evidence that a primary function of the stereoscopic system is to define three-dimensional surface structure.     

Consistent stereoscopic information increases the perceived speed of vection in depth

Previous research found that adding stereoscopic information to radially expanding optic flow decreased vection onsets and increased vection durations (Palmisano, 1996 Perception & Psychophysics 58 1168-1176). In the current experiments, stereoscopic cues were also found to increase perceptions of vection speed and self-displacement during vection in depth--but only when these cues were consistent with monocularly available information about self-motion. Stereoscopic information did not appear to be improving vection by increasing the perceived maximum extent of displays or by making displays appear more three-dimensional. Rather, it appeared that consistent patterns of stereoscopic optic flow provided extra, purely binocular information about vection speed, which resulted in faster/more compelling illusions of self-motion in depth.     

Absence of binocular interaction between spatial and color attributes of visual stimuli

The hypothesis that induction of the McCollough effect (spatially selective color aftereffects) entails adaptation of monocularly driven detectors tuned to both spatial and color attributes of the visual stimulus was examined in four experiments. The McCollough effect could not be generated by displaying contour information to one eye and color information to the other eye during inspection, even in the absence of binocular rivalry. Nor was it possible to induce depth-specific color aftereffects following an inspection period during which random-dot stereograms were viewed, with crossed and uncrossed disparity seen in different colored light. Masking and aftereffect in the perception of stereoscopic depth were also nonselective to color; in both cases, perceptual distortion was controlled by stereospatial variables but not by the color relationship between the inspection and test stimuli. The results suggest that binocularly driven spatial detectors in human vision are insensitive to wavelength.     

Shrinkage in the apparent size of cylindrical objects

A novel illusion in apparent size is reported. We asked observers to estimate the width and depth of vertically oriented elliptic cylinders depicted with texture or luminance gradients (experiment 1), or the height of horizontally oriented elliptic cylinders depicted with binocular disparity (experiment 2). The estimated width or height of cylinders showed systematic shrinkage in the direction of the gradual depth change. The dissimilarity of 2-D appearance amongst our stimuli implies a large variation in spatial-frequency components and brightness contrasts, eliminating the possibility that these parameters contributed to the illusion. Also, the mechanism inappropriately triggered by pictorial depth cues (eg size scaling) may be irrelevant, because the illusion was obtained even when binocular disparity alone specified the shape of the cylinders. The illusion demonstrated here suggests that our visual system may determine the size of 3-D objects by accounting for their depth structures.     

Stereo-motion cooperation and the use ofmotion disparity in the visual perception of 3-D structure

When an observer views a moving scene binocularly, both motion parallax and binocular disparity provide depth information. In Experiments lA-1C, we measured sensitivity to surface curvature when these depth cues were available either individually or simultaneously. When the depth cues yielded comparable sensitivity to surface curvature, we found that curvature detection was easier with the cues present simultaneously, rather than individually. For 2 of the 6 subjects, this effect was stronger when the component of frontal translation of the surface was vertical, rather than horizontal. No such anisotropy was found for the 4 other subjects. If a moving object is observed binocularly, the patterns of optic flow are different on the left and right retinae. We have suggested elsewhere (Cornilleau-Pérès & Droulez, in press) that this motion disparity might be used as avisual cue for the perception of a 3-D structure. Our model consisted in deriving binocular disparity from the left and right distributions of vertical velocities, rather than from luminous intensities, as has been done in classical studies on stereoscopic vision. The model led to some predictions concerning the detection of surface curvature from motion disparity in the presence or absence of intensity-based disparity (classically termedbinocular disparity). In a second set of experiments, we attempted to test these predictions, and we failed to validate our theoretical scheme from a physiological point of view.     

Visual and tactual texture perception: Intersensory cooperation

In three experiments, subjects were required to make texture judgments about abrasive surfaces. Touch and vision provided comparable levels of performance when observers attempted to select the smoothest of three surfaces, but bimodal visual and tactual input led to greater accuracy. The superiority of bimodal perception was ascribed to visual guidance of tactual exploration. The elimination of visual texture cues did not impair bimodal performance if vision of hand movements were permitted. It is suggested that touch may preempt vision when both sources of texture information are simultaneously available. The results support the notion that perception is normally multimodal, since restriction of the observer to either sense in isolation produces lower levels of performance.