Integration of motion parallax with binocular disparity specifying different surface shapes

We investigated the interaction between motion parallax and binocular disparity cues in the perception of surface shape and depth magnitude by the use of the random dot stimuli in which these cues specified sinusoidal depth surfaces undulating with different spatial frequencies. When ambiguous motion parallax is inconsistent with unambiguous disparity cue, the reasonable solution for the visual system is to convert the motion signal to the flow on the surface specified by disparity. Two experiments, however, found that the visual system did not always use this reasonable solution; observers often perceived the surface specified by a composite of the two cues, or the surface specified by parallax alone. In the perception of this composite of the two cues, the apparent depth magnitude increased with the increase of the depth magnitude specified by both cues. This indicates that the visual system can combine the depth magnitude information from parallax and disparity in an additive fashion. The interference with parallax by disparity implies that the parallax processing is not independent of the disparity processing.     

How is motion disparity integrated with binocular disparity in depth perception?

Two experiments presented motion disparity conflicting with binocular disparity to examine how these cues determined apparent depth order (convex, concave) and depth magnitude. In each experiment, 8 subjects estimated the depth order and depth magnitude. The first experiment showed the following. (1) The visual system used one of these cues exclusively in selecting a depth order for each display. (2) The visual system integrated the depth magnitude information from these cues by a weighted additive fashion if it selected the binocular disparity in depth order perception and if the depth magnitude specified by motion disparity was small relative to that specified by binocular disparity. (3) The visual system ignored the depth magnitude information of binocular disparity if it selected the motion disparity in depth order perception. The second experiment showed that these three points were consistent whether the subject’s head movement or object movement generated motion disparity.     

Depth from binocular half-occlusions in stereoscopic images of natural scenes

Over the past two decades psychophysical experiments have firmly established that binocular half-occlusions are useful sources of information for the human visual system. The existing literature has focused on simplified stimuli that have no additional cues to depth, apart from stereopsis. From this large body of work we can be confident that the visual system is able to exploit binocular half-occlusions to aid depth perception; however, we do not know if this signal has any influence on perception when observers view complex stereoscopic stimuli with multiple sources of depth information. This issue is addressed here with the use of stereoscopic images of natural scenes, some of which have been digitally altered to manipulate a major half-occlusion signal. Our results show that depth-ordering judgments for these relatively complex stimuli are significantly affected by the nature of the half-occlusion signal, but only when highly textured surfaces are viewed. Under such conditions, the replacement of a binocular half-occlusion with background texture slows reaction time relative to performance when the occluded region is consistent with the foreground object. This result is specific to conditions when the depth ordering is correct (ie not reversed) and depends upon the size of the half-occlusion. The influence of the half-occlusion information in the presence of potent depth cues such as perspective, texture gradient, shading, and interposition is convincing evidence that this information plays a significant role in human depth perception.     

The role of local and distal landmarks in the development of object location memory

To locate objects in the environment, animals and humans use visual and nonvisual information. We were interested in children's ability to relocate an object on the basis of self-motion and local and distal color cues for orientation. Five- to 9-year-old children were tested on an object location memory task in which, between presentation and test, the availability of local and distal cues was manipulated. Additionally, participants' viewpoint could be changed. We used a Bayesian model selection approach to compare our hypotheses. We found that, to remain oriented in space, 5-year-olds benefit from visual information in general, 7-year-olds benefit from visual cues when a viewpoint change takes place, and 9-year-olds do not benefit from the availability of visual cues for orientation but rely on self-movement cues instead. Results are discussed in terms of the adaptive combination model (Newcombe & Huttenlocher, 2006).     

Colour vision brings clarity to shadows

We have revealed a new role for colour vision in visual scene analysis: colour vision facilitates shadow identification. Shadows are important features of the visual scene, providing information about the shape, depth, and movement of objects. To be useful for perception, however, shadows must be distinguished from other types of luminance variation, principally the variation in object reflectance. A potential cue for distinguishing shadows from reflectance variations is colour, since chromatic changes typically occur at object but not shadow boundaries. We tested whether colour cues were exploited by the visual system for shadow identification, by comparing the ability of human test subjects to identify simulated shadows on chromatically variegated versus achromatically variegated backgrounds with identical luminance compositions. Performance was superior with the chromatically variegated backgrounds. Furthermore, introducing random colour contrast across the shadow boundaries degraded their identification. These findings demonstrate that the visual system exploits inbuilt assumptions about the relationships between colour and luminance in the natural visual world.     

Some recent studies on the extraretinal contribution to distance perception

Some recent studies on the extraretinal contribution to distance perception are reviewed. These experiments demonstrate that vergence can provide reliable information for judgments on the distance of proximal targets in the absence of all other cues. We argue that, although vergence is an unreliable cue at large fixation distances and is subject to a strong contraction bias when studied in isolation, these facts do not imply a minor role for vergence in near-space perception. When additional depth and distance cues are added, the contribution of vergence information becomes more complicated. We present results which indicate that the different cues to depth and distance are combined in a manner that can result in unexpected distortions of visual space. A simple heuristic model which can produce the observed distortions is outlined.     

Independence of sampling of motion parallax and binocular disparity in discrimination of depth1

Abstract: The sampling strategy of the visual system in binocular disparity and motion parallax to discriminate depth was investigated. Human observers were asked to discriminate between the depths of two surfaces defined by both cues. Gaussian noise was added to the depths represented by each cue, and the correlation in noise was manipulated. Human performance was compared with two types of likelihood models. The first was based on independent sampling, in which data from the two cues were gathered from independent sets of points in the display. The second was based on paired sampling, in which data from these cues were gathered from the same set of points. The former model yielded a better fit with human performance. This suggests that the visual system is more likely to adopt independent sampling.     

Integration of disparity and velocity information for haptic and perceptual judgments of object depth

Do reach-to-grasp (prehension) movements require a metric representation of three-dimensional (3D) layouts and objects? We propose a model relying only on direct sensory information to account for the planning and execution of prehension movements in the absence of haptic feedback and when the hand is not visible. In the present investigation, we isolate relative motion and binocular disparity information from other depth cues and we study their efficacy for reach-to-grasp movements and visual judgments. We show that (i) the amplitude of the grasp increases when relative motion is added to binocular disparity information, even if depth from disparity information is already veridical, and (ii) similar distortions of derived depth are found for haptic tasks and perceptual judgments. With a quantitative test, we demonstrate that our results are consistent with the Intrinsic Constraint model and do not require 3D metric inferences (Domini, Caudek, & Tassinari, 2006). By contrast, the linear cue integration model (Landy, Maloney, Johnston, & Young, 1995) cannot explain the present results, even if the flatness cues are taken into account.     

Spatial attention based on 2D location and relative depth order modulates visual working memory in a 3D environment

The attentional effect on visual working memory (VWM) has been a heated research topic in the past two decades. Studies show that VWM performance for an attended memory item can be improved by cueing its two-dimensional (2D) spatial location during retention. However, few studies have investigated the effect of attentional selection on VWM in a three-dimensional setting, and it remains unknown whether depth information can produce beneficial attentional effects on 2D visual representations similar to 2D spatial information. Here we conducted four experiments, displaying memory items at various stereoscopic depth planes, and examined the retro-cue effects of four types of cues – a cue would either indicate the 2D or depth location of a memory item, and either in the form of physical (directly pointing to a location) or symbolic (numerically mapping onto a location) cues. We found that retro-cue benefits were only observed for cues directly pointing to a 2D location, whereas a null effect was observed for cues directly pointing to a depth location. However, there was a retro-cue effect when cueing the relative depth order, though the effect was weaker than that for cueing the 2D location. The selective effect on VWM based on 2D spatial attention is different from depth-based attention, and the divergence suggests that an object representation is primarily bound with its 2D spatial location, weakly bound with its depth order but not with its metric depth location. This indicates that attentional selection based on memory for depth, particularly metric depth, is ineffective.     

Stereo and motion cues in preattentive vision processing--some experiments with random-dot stereographic image sequences

Low-level preattentive vision processing is of special interest since it seems the logical starting point of all vision processing. Exploration of the human visual processing system at this level is, however, extremely difficult, but can be facilitated by the use of stroboscopic presentation of sequences of random-dot stereograms, which contain only local spatial and temporal information and therefore limit the processing of these images to the low level. Four experiments are described in which such sequences were used to explore the relationships between various cues (optical flow, stereo disparity, and accretion and deletion of image points) at the low level. To study these relationships in more depth, especially the resolution of conflicting information among the cues, some of the image sequences presented information not usually encountered in 'natural' scenes. The results indicate that the processing of these cues is undertaken as a set of cooperative processes.     

Discrimination of spectrally blended natural images: optimisation of the human visual system for encoding natural images

We have developed a protocol for testing experimentally the hypothesis that the human visual system is optimised for making visual discriminations amongst natural scenes. Visual stimuli were made by gradual blending of the Fourier spectra of digitised photographs of natural scenes. The statistics of the stimuli were made unnatural to varying degrees by changing the overall slopes of the amplitude spectra of the stimuli. Thresholds were measured for discriminating small amounts of spectral blending at different spectral slopes. We found that thresholds were lowest when the spectral slope was natural; thresholds were increased when the slopes were either shallower or steeper than natural. A number of spurious cues were considered, such as differences in mean luminance or overall spectral power or contrast between test and reference stimuli. Control experiments were performed to remove such spurious cues, and the discrimination thresholds were still lowest for stimuli that were most natural. Thus, these experiments do provide experimental support for the idea that human vision and the human visual system are optimised for processing natural visual information [corrected].     

Discrimination of familiar human faces in dogs (Canis familiaris)

Faces are an important visual category for many taxa, and the human face is no exception to this. Because faces differ in subtle ways and possess many idiosyncratic features, they provide a rich source of perceptual cues. A fair amount of those cues are learned through social interactions and are used for future identification of individual humans. These effects of individual experience can be studied particularly well in hetero-specific face perception. Domestic dogs represent a perfect model in this respect, due to their proved ability to extract important information from the human face in socio-communicative interactions. There is also suggestive evidence that dogs can identify their owner or other familiar human individuals by using visual information from the face. However, most studies have used only dogs’ looking behavior to examine their visual processing of human faces and it has been demonstrated only that dogs can differentiate between familiar and unknown human faces. Here, we examined the dog's ability to discriminate the faces of two familiar persons by active choice (approach and touch). Furthermore, in successive stages of the experiment we investigated how well dogs discriminate humans in different representations by systematically reducing the informational richness and the quality of the stimuli. We found a huge inter-individual and inter-stage variance in performance, indicating differences across dogs in their learning ability as well as their selection of discriminative cues. On a group level, the performance of dogs significantly decreased when they were presented with pictures of human heads after having learned to discriminate the real heads, and when – after relearning – confronted with the same pictures showing only the inner parts of the heads. However, as two dogs quickly mastered all stages, we conclude that dogs are in principle able to discriminate people on the basis of visual information from their faces and by making active choices.     

Visual contribution to human standing balance during support surface tilts

Visual position and velocity cues improve human standing balance, reducing sway responses to external disturbances and sway variability. Previous work suggested that human balancing is based on sensory estimates of external disturbances and their compensation using feedback mechanisms (Disturbance Estimation and Compensation, DEC model). This study investigates the visual effects on sway responses to pseudo-random support surface tilts, assuming that improvements result from lowering the velocity threshold in a tilt estimate and the position threshold in an estimate of the gravity disturbance. Center of mass (COM) sway was measured with four different tilt amplitudes, separating the effect of visual cues across the conditions ‘Eyes closed’ (no visual cues), ‘4 Hz stroboscopic illumination’ (visual position cues), and ‘continuous illumination’ (visual position and velocity cues). In a model based approach, parameters of disturbance estimators were identified. The model reproduced experimental results and showed a specific reduction of the position and velocity threshold when adding visual position and velocity cues, respectively. Sway variability was analyzed to explore a hypothesized relation between estimator thresholds and internal noise. Results suggest that adding the visual cues reduces the contribution of vestibular noise, thereby reducing sway variability and allowing for lower thresholds, which improves the disturbance compensation.     

The visual control of reaching and grasping: binocular disparity and motion parallax

The primary visual sources of depth and size information are binocular cues and motion parallax. Here, the authors determine the efficacy of these cues to control prehension by presenting them in isolation from other visual cues. When only binocular cues were available, reaches showed normal scaling of the transport and grasp components with object distance and size. However, when only motion parallax was available, only the transport component scaled reliably. No additional increase in scaling was found when both cues were available simultaneously. Therefore, although equivalent information is available from binocular and motion parallax information, the latter may be of relatively limited use for the control of the grasp. Binocular disparity appears selectively important for the control of the grasp.     

Relative distance cues contribute to scaling depth from motion parallax

The visual system scales motion parallax signals with information about absolute distance (M. E. Ono, Rivest, & H. Ono, 1986). The present study was designed to determine whether relative distance cues, which intrinsically provide information about relative distance, contribute to this scaling. In two experiments, two test stimuli, containing an equal extent of motion parallax, were presented simultaneously at a fixed viewing distance. The relative distance cues of dynamic occlusion and motion parallax in the areas surrounding the test stimuli (background motion parallax) and/or relative size were manipulated. The observers reported which of the two parallactic test stimuli appeared to have greater depth, and which appeared to be more distant. The results showed that the test stimulus specified, by the relative distance cues, as being more distant was perceived as having more depth and as being more distant. This indicates that relative distance cues contribute to scaling depth from motion parallax by modifying the information about the absolute distance of objects.     

Discrimination of possible and impossible objects in infancy

Adults can use pictorial depth cues to infer three-dimensional structure in two-dimensional depictions of objects. The age at which infants respond to the same kinds of visual information has not been determined, and theories about the underlying developmental mechanisms remain controversial. In this study, we used a visual habituation/novelty-preference procedure to assess the ability of 4-month-old infants to discriminate between two-dimensional depictions of structurally possible and impossible objects. Results indicate that young infants are sensitive to junction structures and interposition cues associated with pictorial depth and can detect inconsistent relationships among these cues that render an object impossible. Our results provide important insights into the development of mechanisms for processing pictorial depth cues that allow adults to extract three-dimensional structure from pictures of objects.     

The appearance of surfaces specified by motion parallax and binocular disparity

The experiments reported in this paper were designed to investigate how depth information from binocular disparity and motion parallax cues is integrated in the human visual system. Observers viewed simulated 3-D corrugated surfaces that translated to and fro across their line of sight. The depth of the corrugations was specified by either motion parallax, or binocular disparities, or some combination of the two. The amount of perceived depth in the corrugations was measured using a matching technique.

A monocularly viewed surface specified by parallax alone was seen as a rigid, corrugated surface translating along a fronto-parallel path. The perceived depth of the corrugations increased monotonically with the amount of parallax motion, just as if observers were viewing an equivalent real surface that produced the same parallax transformation. With binocular viewing and zero disparities between the images seen by the two eyes, the perceived depth was only about half of that predicted by the monocular cue. In addition, this binocularly viewed surface appeared to rotate about a vertical axis as it translated to and fro. With other combinations of motion parallax and binocular disparity, parallax only affected the perceived depth when the disparity gradients of the corrugations were shallow. The discrepancy between the parallax and disparity signals was typically resolved by an apparent rotation of the surface as it translated to and fro. The results are consistent with the idea that the visual system attempts to minimize the discrepancies between (1) the depth signalled by disparity and that required by a particular interpretation of the parallax transformation and (2) the amount of rotation required by that interpretation and the amount of rotation signalled by other cues in the display.     

Effects of visual-field inversions on the reverse-perspective illusion

The 'reverse-perspective' illusion entails the apparent motion of a stationary scene painted in relief and containing misleading depth cues. We have found that, using prism goggles to induce horizontal or vertical visual-field reversals, the illusory motion is greatly reduced or eliminated in the direction for which the goggles reverse the visual field. We argue that the illusion is a consequence of the observer's inability to reconcile changes in visual information due to body movement with implicit knowledge concerning anticipated changes. As such, the reverse-perspective illusion may prove to be useful in the study of the integration of linear perspective and motion parallax information.     

The linear perspective information in ground surface representation and distance judgment

Most ground surfaces contain various types of texture gradient information that serve as depth cues for space perception. We investigated how linear perspective, a type of texture gradient information on the ground, affects judged absolute distance and eye level. Phosphorescent elements were used to display linear perspective information on the floor in an otherwise dark room. We found that observers were remarkably receptive to such information. Changing the configuration of the linear perspective information from parallel to converging resulted in relatively larger judged distances and lower judged eye levels. These findings support the proposals that (1) the visual system has a bias for representing an image of converging lines as one of parallel lines on a downward-slanting surface and (2) the convergence point of a converging-lines image represents the eye level. Finally, we found that the visual system may be less sensitive to the manipulation of compression gradient information than of linear perspective information.     

Information integration in judgements of time to contact

Time to contact (TTC) is specified optically by tau, and studies suggest that observers are sensitive to this information. However, TTC judgements also are influenced by other sources of information, including pictorial depth cues. Therefore, it is useful to identify these sources of information and to determine whether and how their effects combine when multiple sources are available. We evaluated the effect of five depth cues on TTC judgements. Results indicate that relative size, height in field, occlusion, and motion parallax influence TTC judgements. When multiple cues are available, an integration (rather than selection) strategy is used. Finally, the combined effects of multiple cues are not always consistent with a strict additive model and may be task dependent.