Spatial and temporal properties of stereoscopic surface interpolation

It is well established that under a wide range of conditions when a sparse collection of texture elements varies smoothly in depth, the spaces between the elements are assigned depth values. This disparity interpolation process has been studied in an effort to define some of its fundamental spatial and temporal constraints. To assess disparity interpolation we employed two tasks: a novel task that relies on the bisection of illusory boundaries created when subjective stereoscopic surfaces intersect, and one that relies on a 3-D shape discrimination. The results of both experiments show that there is no improvement in performance when texture density is increased from near 0.20 to 0.85 or when exposure duration is increased from 50-100 to 1000 ms. This lack of dependence on the addition of features that define the interpolated surface, along with the abrupt decline in performance below a critical value, is consistent with the view that surface interpolation is an important function of human stereoscopic vision.     

Serial and parallel search in pattern vision?

The nature of the processing of combinations of stimulus dimensions in human vision has recently been investigated. A study is reported in which visual search for suprathreshold positional information--vernier offsets, stereoscopic disparity, lateral separation, and orientation--was examined. The initial results showed that reaction times for visual search for conjunctions of stereoscopic disparity and either vernier offsets or orientation were independent of the number of distracting stimuli displayed, suggesting that disparity was searched in parallel with vernier offsets or orientation. Conversely, reaction times for detection of conjunctions of vernier offsets and orientation, or lateral separation and each of the other positional judgements, were related linearly to the number of distractors, suggesting serial search. However, practice has a significant effect upon the results, indicative of a shift in the mode of search from serial to parallel for all conjunctions tested as well as for single features. This suggests a reinterpretation of these and perhaps other studies that use the Treisman visual search paradigm, in terms of perceptual segregation of the visual field by disparity, motion, color, and pattern features such as colinearity, orientation, lateral separation, or size.     

Perception of depth: Different processing times for simple and relative positional disparity

Summary When judging in stereoscopic vision whether an object is lying in front of or behind the point of momentary fixation, the visual system extracts depth information by using retinal disparity; in this case it computes one angular difference between retinal images (simple positional disparity). But if the task is to discriminate two or more objects in their depth (relative to the point of fixation) and the relative distances between them, two or more such angular differences have to be determined (relative positional disparity). An investigation was carried out to determine whether depth extraction is more complex for relative distances than for object positions and therefore demands a longer processing time. For this purpose stimuli with simple and relative positional disparity were foveally and parafoveally presented (each followed by a masking stimulus). It was shown that the duration threshold for the detection of stimuli with relative disparity was about 2.5 times larger than that for stimuli with simple disparity (Exp. 1). This difference could not be attributed to differences in stimulus configuration between simple and relative disparity (Exp. 2). The results are discussed in terms of a serial, hierarchically structured, disparity processing.     

Perception of Glass pattern structure with stereopsis

Stereograms are presented which demonstrate that the perceptual salience of structure in Glass patterns may be destroyed or created by the introduction of stereoscopic depth effects. Novel three-dimensional pattern structures can also be produced. Proposals concerning the nature of the primal sketch are evaluated in the light of these findings, and it is concluded that the findings are consistent with the view that depth derived from disparity information is explicitly represented in the primal sketch.     

The Poggendorf illusion in stereoscopic space.

The stereoscopic depth separation between the bisecting rectangle and the oblique line of a Poggendorf configuration was manipulated by varying the direction and magnitude of disparity carried by the rectangle. Based upon data of 6 subjects, the magnitude of the illusion decreased with increasing depth separation regardless of the direction of disparity. Depth separation varied directly with disparity. These findings make plain that depth adjacency can operate symmetrically in stereoscopic space.     

Depth interpolation with sparse disparity cues

The interpolation of stereoscopic depth given only sparse disparity information was investigated. The basic stimulus was a rectangle with zero disparity at one edge, and 20 or 30 min visual angle disparity at the other. The depth assigned to the ambiguous intervening locations was measured by means of a small briefly-flashed binocular comparison spot. For a stimulus consisting of a uniform rectangle presented on a background of random dots with zero disparity, interpolated depth was greater for a high mean contrast between rectangle and background than for a low mean contrast. Relative to a linear interpolation between the edges, a larger difference in edge disparity resulted in poorer depth interpolation. Depth interpolation based on rivalrous information was examined by filling the stimulus rectangle with narrow-band filtered noise which was uncorrelated between the two eyes. Four different passbands which were matched in apparent contrast were investigated. The results demonstrate that the rivalrous low-spatial-frequency content was resistant to interpolation; rivalrous high spatial frequencies did not interfere with depth interpolation. High-spatial-frequency stimuli yielded a percept similar to the uniform-field condition, whereas low-spatial-frequency stimuli lay in a depth plane near or even behind the background. In the latter case a transparent plane was perceived which was linearly interpolated between the two edges, and which floated above the rivalrous noise.     

Binocular rivalry and stereoscopic depth perception

An investigation was made of stimulus factors causing retinal rivalry or allowing stereoscopic depth perception, given a requisite positional disparity. It is shown that similar colour information can be “filtered” out from both eyes; that stereopsis is not incompatible with rivalry and suppression of one aspect of the stimulus, and that the strongest cue for perception of stereoscopic depth is intensity difference at the boundaries of the figures in the same direction at each eye. Identity of colour can also act as a cue for stereopsis. The brightness of different monocular figures seen in the stereoscope in different combinations was estimated by a matching technique, and it is suggested that the perceived brightness is a compromise between the monocular brightness difference between figure and ground seen in relation to the binocular fused background, and the mean brightness of the figures. The results are discussed in terms of neurophysiological “on,” “off” and continuous response fibres.     

Seeing in three dimensions: the neurophysiology of stereopsis

From the pair of 2-D images formed on the retinas, the brain is capable of synthesizing a rich 3-D representation of our visual surroundings. The horizontal separation of the two eyes gives rise to small positional differences, called binocular disparities, between corresponding features in the two retinal images. These disparities provide a powerful source of information about 3-D scene structure, and alone are sufficient for depth perception. How do visual cortical areas of the brain extract and process these small retinal disparities, and how is this information transformed into non-retinal coordinates useful for guiding action? Although neurons selective for binocular disparity have been found in several visual areas, the brain circuits that give rise to stereoscopic vision are not very well understood. I review recent electrophysiological studies that address four issues: the encoding of disparity at the first stages of binocular processing, the organization of disparity-selective neurons into topographic maps, the contributions of specific visual areas to different stereoscopic tasks, and the integration of binocular disparity and viewing-distance information to yield egocentric distance. Some of these studies combine traditional electrophysiology with psychophysical and computational approaches, and this convergence promises substantial future gains in our understanding of stereoscopic vision.     

Stereoscopic depth cues can segment motion information

Can the motion system selectively process elements at a particular depth? We attempted to answer this question using global coherence tasks in which signal and noise elements could be given different disparities. In experiment 1 we found that, if all the signal elements had a disparity different from that of the noise elements, performance was far better than when they had the same disparity (at least for stereo-normal observers). In a second experiment we found that adding additional noise elements to the motion task had no effect if they had a different disparity (however, they had a marked effect for stereo-blind observers). We conclude that stereo disparity can be used as a segmentation cue by the motion system.     

The effects of age upon the perception of depth and 3-D shape from differential motion and binocular disparity

The ability of younger and older adults to perceive the 3-D shape, depth, and curvature of smooth surfaces defined by differential motion and binocular disparity was evaluated in six experiments. The number of points defining the surfaces and their spatial and temporal correspondences were manipulated. For stereoscopic sinusoidal surfaces, the spatial frequency of the corrugations was also varied. For surfaces defined by motion, the lifetimes of the individual points in the patterns were varied, and comparisons were made between the perception of surfaces defined by points and that of more ecologically valid textured surfaces. In all experiments, the older observers were less sensitive to the depths and curvatures of the surfaces, although the deficits were much larger for motion-defined surfaces. The results demonstrate that older adults can extract depth and shape from optical patterns containing only differential motion or binocular disparity, but these abilities are often manifested at reduced levels of performance.     

Planar motion permits perception of metric structure in stereopsis

A fundamental problem in the study of spatial perception concerns whether and how vision might acquire information about the metric structure of surfaces in three-dimensional space from motion and from stereopsis. Theoretical analyses have indicated that stereoscopic perceptions of metric relations in depth require additional information about egocentric viewing distance; and recent experiments by James Todd and his colleagues have indicated that vision acquires only affine but not metric structure from motion—that is, spatial relations ambiguous with regard to scale in depth. The purpose of the present study was to determine whether the metric shape of planar stereoscopic forms might be perceived from congruence under planar rotation. In Experiment 1, observers discriminated between similar planar shapes (ellipses) rotating in a plane with varying slant from the frontal-parallel plane. Experimental conditions varied the presence versus absence of binocular disparities, magnification of the disparity scale, and moving versus stationary patterns. Shape discriminations were accurate in all conditions with moving patterns and were near chance in conditions with stationary patterns; neither the presence nor the magnification of binocular disparities had any reliable effect. In Experiment 2, accuracy decreased as the range of rotation decreased from 80° to 10°. In Experiment 3, small deviations from planarity of the motion produced large decrements in accuracy. In contrast with the critical role of motion in shape discrimination, motion hindered discriminations of the binocular disparity scale in Experiment 4. In general, planar motion provides an intrinsic metric scale that is independent of slant in depth and of the scale of binocular disparities. Vision is sensitive to this intrinsic optical metric.     

Planar motion permits perception of metric structure in stereopsis.

A fundamental problem in the study of spatial perception concerns whether and how vision might acquire information about the metric structure of surfaces in three-dimensional space from motion and from stereopsis. Theoretical analyses have indicated that stereoscopic perceptions of metric relations in depth require additional information about egocentric viewing distance; and recent experiments by James Todd and his colleagues have indicated that vision acquires only affine but not metric structure from motion--that is, spatial relations ambiguous with regard to scale in depth. The purpose of the present study was to determine whether the metric shape of planar stereoscopic forms might be perceived from congruence under planar rotation. In Experiment 1, observers discriminated between similar planar shapes (ellipses) rotating in a plane with varying slant from the frontal-parallel plane. Experimental conditions varied the presence versus absence of binocular disparities, magnification of the disparity scale, and moving versus stationary patterns. Shape discriminations were accurate in all conditions with moving patterns and were near chance in conditions with stationary patterns; neither the presence nor the magnification of binocular disparities had any reliable effect. In Experiment 2, accuracy decreased as the range of rotation decreased from 80 degrees to 10 degrees. In Experiment 3, small deviations from planarity of the motion produced large decrements in accuracy. In contrast with the critical role of motion in shape discrimination, motion hindered discriminations of the binocular disparity scale in Experiment 4. In general, planar motion provides an intrinsic metric scale that is independent of slant in depth and of the scale of binocular disparities. Vision is sensitive to this intrinsic optical metric.     

Perceptual depth synthesis in the visual system as revealed by selective adaptation

Selective adaptations was used to determine the degree of interactions between channels processing relative depth from stereopsis, motion parallax, and texture. Monocular adaptations with motion parallax or binocular stationary adaptation caused test surfaces, viewed either stationary binocularly or monocularly with motion parallax, to appear to slant in the opposite direction compared with the slant initially adapted to. Monocular adaptations on frontoparallel surfaces covered with a pattern of texture gradients caused a subsequently viewed test surface, viewed either monocularly with motion parallax or stationary binocularly, to appear to slant in the opposite direction as the slant indicated by the texture in the adaptation condition. No aftereffect emerged in the monocular stationary test condition. A mechanism of independent channels for relative depth perception is dismissed in favor of a view of an asymmetrical interactive processing of different information sources. The results suggest asymmetrical inhibitory interactions among habituating slant detector units receiving inputs from static disparity, dynamic disparity, and texture gradients.     

How owls structure visual information

Recent studies on perceptual organization in humans claim that the ability to represent a visual scene as a set of coherent surfaces is of central importance for visual cognition. We examined whether this surface representation hypothesis generalizes to a non-mammalian species, the barn owl (Tyto alba). Discrimination transfer combined with random-dot stimuli provided the appropriate means for a series of two behavioural experiments with the specific aims of (1) obtaining psychophysical measurements of figure–ground segmentation in the owl, and (2) determining the nature of the information involved. In experiment 1, two owls were trained to indicate the presence or absence of a central planar surface (figure) among a larger region of random dots (ground) based on differences in texture. Without additional training, the owls could make the same discrimination when figure and ground had reversed luminance, or were camouflaged by the use of uniformly textured random-dot stereograms. In the latter case, the figure stands out in depth from the ground when positional differences of the figure in two retinal images are combined (binocular disparity). In experiment 2, two new owls were trained to distinguish three-dimensional objects from holes using random-dot kinematograms. These birds could make the same discrimination when information on surface segmentation was unexpectedly switched from relative motion to half-occlusion. In the latter case, stereograms were used that provide the impression of stratified surfaces to humans by giving unpairable image features to the eyes. The ability to use image features such as texture, binocular disparity, relative motion, and half-occlusion interchangeably to determine figure–ground relationships suggests that in owls, as in humans, the structuring of the visual scene critically depends on how indirect image information (depth order, occlusion contours) is allocated between different surfaces. Electronic Publication     

Amodal representation of occluded surfaces: role of invisible stimuli in apparent motion correspondence

A series of demonstrations were created where the perceived depth of targets was controlled by stereoscopic disparity. A closer object (a cloud) was made to jump back and forth horizontally, partially occluding a farther object (a full moon). The more distant moon appeared stationary even though the unoccluded portion of it, a crescent, changed position. Reversal of the relative depth of the moon and cloud gave a totally different percept: the crescent appeared to flip back and forth in the front depth plane. Thus, the otherwise-robust apparent motion of the moon crescents was completely abolished in the cloud-closer case alone. This motion-blocking effect is attributed to the 'amodal presence' of the occluded surface continuing behind the occluding surface. To measure the effect of this occluded 'invisible' surface quantitatively, a bistable apparent motion display was used (Ramachandran and Anstis 1983a): two small rectangular-shaped targets changed their positions back and forth between two frames, and the disparity of a large centrally positioned rectangle was varied. When the perceived depths supported the possibility of amodal completion behind the large rectangle, increased vertical motion of the targets was found, suggesting that the amodal presence of the targets behind the occluder had effectively changed the center position of the moving targets for purposes of motion correspondence. Amodal contours are literally 'invisible', yet it is hypothesized that they have a neural representation at sufficiently early stages of visual processing to alter the correspondence solving process for apparent motion.     

Correlation between stereoanomaly and perceived depth when disparity and motion interact in binocular matching

The aim of this study was to find out to what extent binocular matching is facilitated by motion when stereoanomalous and normal subjects estimate the perceived depth of a 3-D stimulus containing excessive matching candidates. Thirty subjects viewed stimuli that consisted of bars uniformly distributed inside a volume. They judged the perceived depth-to-width ratio of the volume by adjusting the aspect ratio of an outline rectangle (a metrical 3-D task). Although there were large inter-subject differences in the depth perceived, the experimental results yielded a good correlation with stereoanomaly (the inability to distinguish disparities of different magnitudes and/or signs in part of the disparity spectrum). The results cannot be explained solely by depth-cue combination. Since up to 30% of the population is stereoanomalous, stereoscopic experiments would yield more informative results if subjects were first characterized with regard to their stereo capacities. Intriguingly, it was found that motion does not help to define disparities in subjects who are able to perceive depth-from-disparity in half of the disparity spectrum. These stereoanomalous subjects were found to rely completely on the motion signals. This suggests that the perception of volumetric depth in subjects with normal stereoscopic vision requires the joint processing of crossed and uncrossed disparities.     

Perceptual latencies to discriminate surface orientation in stereopsis

The difference in sensitivity to stereoscopic surfaces oriented horizontally or vertically (the stereoscopic orientation anisotropy) can be redescribed as a difference in sensitivity to shear or compression transformations that relate the binocular images. The present experiment was designed to test this by dissociating the image transformation from the orientation of the surface. Surfaces were presented in isolation or in the presence of a surrounding frame that formed step and gradient discontinuities in the disparity field. Without discontinuities, observers required considerably more time to discriminate between surfaces differing in compression than between those differing in shear, irrespective of surface orientation. Disparity discontinuities facilitated the perception of the disparity gradients; minimum stimulus durations were reduced by over an order of magnitude when the reference frame was present. These results support the hypothesis that the disparity field is decomposed into different primitives during the recovery of depth and surface structure.     

Stereopsis from reversible and irreversible patterns

Eight subjects reported stereoscopic depth as a function of the magnitude and direction of disparity carried by a reversible grid or an irreversible solid surface. The former alternated between a diamond seen against a grating or a uniform rectangular grid pattern with stereoscopic depth reported only when the diamond was perceived. Depth was attenuated for the grid compared to the solid surface patterns. Disparity can be defined by perceptually extracted forms with depth present only when those forms are bounded by visible contours.     

Dynamic stereo displays for research on the recovery of three-dimensional structure

Research issues that can be addressed by combining stereoscopic and kinetic depth displays include cue conflict and recalibration, mutual constraints, specialization of cues, and differential effects of disparity and kinetic depth on other perceptions, such as size constancy. Methods of producing dynamic stereoscopic displays are reviewed, especially displays combining stereoscopic with orthographic projections of rotation in depth. A sample personal computer program in Pas-cal is provided.     

Pre-attentive detection of a target defined by stereoscopic slant.

Does the visual system represent stereoscopic depth purely as a map of local disparities, or does it explicitly represent local relationships of disparity, such as disparity gradients? Experiments are reported in which visual search for a target containing the same disparity range as other elements in the display, but differing in the relationship of the disparities (stereo slant), was used to determine whether the target showed 'pop-out' like a unitary feature, or the serial search characteristic of feature conjunctions. Each stereo pair of elements was selected randomly from a range of outline parallelograms leaning to the right or to the left, so that the target could not be identified using any monocular shape cue. Response times for detection of the target (present on 50% of the trials) were independent of the number of elements in the display. This result was confirmed by varying element size and spacing, and by using oblique crosses rather than parallelograms as stimuli. It is concluded that stereoscopically defined slant, or disparity gradient, can be processed and compared in parallel across the display, and acts in this respect as an explicit unitary visual property. This contrasts with findings in analogous experiments on movement, which show that targets defined by divergence or deformation of optic flow can only be identified by serial search.