Inaccurate representation of the ground surface beyond a texture boundary

The sequential-surface-integration-process (SSIP) hypothesis was proposed to elucidate how the visual system constructs the ground-surface representation in the intermediate distance range (He et al, 2004 Perception 33 789-806). According to the hypothesis, the SSIP constructs an accurate representation of the near ground surface by using reliable near depth cues. The near ground representation then serves as a template for integrating the adjacent surface patch by using the texture gradient information as the predominant depth cue. By sequentially integrating the surface patches from near to far, the visual system obtains the global ground representation. A critical prediction of the SSIP hypothesis is that, when an abrupt texture-gradient change exists between the near and far ground surfaces, the SSIP can no longer accurately represent the far surface. Consequently, the representation of the far surface will be slanted upward toward the frontoparallel plane (owing to the intrinsic bias of the visual system), and the egocentric distance of a target on the far surface will be underestimated. Our previous findings in the real 3-D environment have shown that observers underestimated the target distance across a texture boundary. Here, we used the virtual-reality system to first test distance judgments with a distance-matching task. We created the texture boundary by having virtual grass- and cobblestone-textured patterns abutting on a flat (horizontal) ground surface in experiment 1, and by placing a brick wall to interrupt the continuous texture gradient of a flat grass surface in experiment 2. In both instances, observers underestimated the target distance across the texture boundary, compared to the homogeneous-texture ground surface (control). Second, we tested the proposal that the far surface beyond the texture boundary is perceived as slanted upward. For this, we used a virtual checkerboard-textured ground surface that was interrupted by a texture boundary. We found that not only was the target distance beyond the texture boundary underestimated relative to the homogeneous-texture condition, but the far surface beyond the texture boundary was also perceived as relatively slanted upward (experiment 3). Altogether, our results confirm the predictions of the SSIP hypothesis.     

Depth perception: cuttlefish (Sepia officinalis) respond to visual texture density gradients

Studies concerning the perceptual processes of animals are not only interesting, but are fundamental to the understanding of other developments in information processing among non-humans. Carefully used visual illusions have been proven to be an informative tool for understanding visual perception. In this behavioral study, we demonstrate that cuttlefish are responsive to visual cues involving texture gradients. Specifically, 12 out of 14 animals avoided swimming over a solid surface with a gradient picture that to humans resembles an illusionary crevasse, while only 5 out of 14 avoided a non-illusionary texture. Since texture gradients are well-known cues for depth perception in vertebrates, we suggest that these cephalopods were responding to the depth illusion created by the texture density gradient. Density gradients and relative densities are key features in distance perception in vertebrates. Our results suggest that they are fundamental features of vision in general, appearing also in cephalopods.     

Maternal odor shapes rapid face categorization in the infant brain

To successfully interact with a rich and ambiguous visual environment, the human brain learns to differentiate visual stimuli and to produce the same response to subsets of these stimuli despite their physical difference. Although this visual categorization function is traditionally investigated from a unisensory perspective, its early development is inherently constrained by multisensory inputs. In particular, an early‐maturing sensory system such as olfaction is ideally suited to support the immature visual system in infancy by providing stability and familiarity to a rapidly changing visual environment. Here, we test the hypothesis that rapid visual categorization of salient visual signals for the young infant brain, human faces, is shaped by another highly relevant human‐related input from the olfactory system, the mother's body odor. We observe that a right‐hemispheric neural signature of single‐glance face categorization from natural images is significantly enhanced in the maternal versus a control odor context in individual 4‐month‐old infant brains. A lack of difference between odor conditions for the common brain response elicited by both face and non‐face images rules out a mere enhancement of arousal or visual attention in the maternal odor context. These observations show that face‐selective neural activity in infancy is mediated by the presence of a (maternal) body odor, providing strong support for multisensory inputs driving category acquisition in the developing human brain and having important implications for our understanding of human perceptual development.     

The perception of doubly curved surfaces from anisotropic textures

Abstract— Most existing computational models of the visual perception of three-dimensional shape from texture are based on assumed constraints about how texture is distributed on visible surfaces. The research described in the present article was designed to investigate how violations of these assumptions influence human perception. Observers were presented with images of smoothly curved surfaces depicted with different types of texture, whose distribution of surface markings could be both anisotropic and inhomogeneous. Observers judged the pattern of ordinal depth on each object by marking local maxima and minima along designated scan lines. They also judged the apparent magnitudes of relative depth between designated probe points on the surface. The results revealed a high degree of accuracy and reliability in all conditions, except for a systematic underestimation of the overall magnitude of surface relief. These findings suggest that human perception of three-dimensional shape from texture is much more robust than would be reasonable to expect based on current computational models of this phenomenon.     

Cue gradient and cue density interact in the detection and recognition of objects defined by motion,contrast, or texture

The human visual system is able to extract an object from its surrounding using a number of cues. These include foreground/background gradients in disparity, motion, texture, colour, and luminance. We have investigated normal subjects' ability to detect objects defined by either motion, texture, or luminance gradients. The effects of manipulating cue density and cue foreground/background gradient on both detection and recognition accuracy were also investigated. The results demonstrate a simple additive relationship between cue density and cue gradient across forms defined by motion, luminance, and texture. The results are interpreted as evidence for the notion that form parsing is achieved via a similar algorithm across anatomically distinct processing streams.     

Texture discrimination does not occur at the cyclopean retina

The ability to segregate texture patterns at the cyclopean retina was tested with random-dot stereograms. When fused, patterns displayed arrays of texture elements which varied either in their form or in apparent depth. If elements of different form appeared at similar disparity in the random-dot stereograms, they did not provide the visual impression of distinct texture areas, although individually they could be easily discriminated. When texture elements differed in apparent depth rather than in form, segregation of different areas was readily achieved. These results restrict the possible site in the visual system for texture discrimination.     

A new visual illusion: flickering fields are localized in a depth plane behind nonflickering fields

Flickering regions of the visual field are perceived to lie well behind regions which are not flickered. The depth segregation is not due to luminance differences since the average temporal luminance across all the regions was equal. This depth effect produced by flicker is not dependent on the texture of the visual field; nor does it depend on a specific configuration of the flickering and nonflickering areas. It is optimal at a temporal frequency around 6 Hz, which suggests that visual channels responding maximally to high temporal frequencies are involved in the segregation of perceptual regions in depth.     

Depth from binocular half-occlusions in stereoscopic images of natural scenes

Over the past two decades psychophysical experiments have firmly established that binocular half-occlusions are useful sources of information for the human visual system. The existing literature has focused on simplified stimuli that have no additional cues to depth, apart from stereopsis. From this large body of work we can be confident that the visual system is able to exploit binocular half-occlusions to aid depth perception; however, we do not know if this signal has any influence on perception when observers view complex stereoscopic stimuli with multiple sources of depth information. This issue is addressed here with the use of stereoscopic images of natural scenes, some of which have been digitally altered to manipulate a major half-occlusion signal. Our results show that depth-ordering judgments for these relatively complex stimuli are significantly affected by the nature of the half-occlusion signal, but only when highly textured surfaces are viewed. Under such conditions, the replacement of a binocular half-occlusion with background texture slows reaction time relative to performance when the occluded region is consistent with the foreground object. This result is specific to conditions when the depth ordering is correct (ie not reversed) and depends upon the size of the half-occlusion. The influence of the half-occlusion information in the presence of potent depth cues such as perspective, texture gradient, shading, and interposition is convincing evidence that this information plays a significant role in human depth perception.     

Efficient search for size targets on a background texture gradient: is detection guided by discontinuities in the retinal-size gradient of items?

Six visual search experiments were carried out to investigate the processing of size information in early vision. The apparent size of display items was manipulated independently of their retinal size by placing items on a textured surface which altered the perceived distance in depth of the items. Overall, these experiments demonstrate that a target item differing from non-target items in terms of apparent size can be detected efficiently. However, the pattern of results indicates that, rather than deriving apparent-size information, target detection is guided by discontinuities in the 'retinal-size gradient' of items, in particular between items at the same 'depth'. Although the arrangement of items on the texture surface strongly influenced search, this was largely due to the retinal size of items and the retinal separation between items. The implications of these experiments for the nature of the pre-attentive representation of size are discussed.     

Image statistics and the perception of apparent motion

The short- and long-range apparent motion processes are discussed in terms of the statistical properties of images. It is argued that the short-range process, exemplified by the random-dot kinematogram, is primarily sensitive to the dipole statistics, whereas the long-range process, exemplified by illusory occlusion, is treated by the visual system primarily in terms of the tripole and higher statistical correlation functions. The studies incorporate the balanced dot, which is a unique stimulus element that permits high pass filtering while preserving detailed positional information. Low spatial frequencies are shown to be critical for texture segregation in random-dot kinematograms, independent of the grain size or number density of texture elements. Illusory path perception in the long-range process is shown not to require low spatial frequencies, but is sensitive rather to global temporal phase coherency. These results are interpreted in terms of the respective roles of the power and phase spectra in perceptual organization. The construction of balanced dots is discussed in detail.     

Spatial and temporal properties of stereoscopic surface interpolation

It is well established that under a wide range of conditions when a sparse collection of texture elements varies smoothly in depth, the spaces between the elements are assigned depth values. This disparity interpolation process has been studied in an effort to define some of its fundamental spatial and temporal constraints. To assess disparity interpolation we employed two tasks: a novel task that relies on the bisection of illusory boundaries created when subjective stereoscopic surfaces intersect, and one that relies on a 3-D shape discrimination. The results of both experiments show that there is no improvement in performance when texture density is increased from near 0.20 to 0.85 or when exposure duration is increased from 50-100 to 1000 ms. This lack of dependence on the addition of features that define the interpolated surface, along with the abrupt decline in performance below a critical value, is consistent with the view that surface interpolation is an important function of human stereoscopic vision.     

Perceived structure from optic flow: consistent versus variable mapping of 3-D Euclidean structure

In an earlier study (Börjesson & Lind, 1996), the perception of Euclidean structure from polar projected two‐frame apparent motion sequences was studied. The results showed that Euclidean structure is not perceived. However, at larger visual angles a certain consistency in the mapping between distal and perceived structure exists. The aim of the present study was to more precisely examine how this degree of consistency varies as a function of visual angle. In Experiments 1 and 2, slant judgments of simulated and real planes indicated that the degree of consistency is a positive function of visual angle. No definite sign of a Euclidean mapping could, however, be found even in the full view condition. Experiment 3 examined texture gradients and the response method used. The results showed that texture gradients did not influence the degree of consistency of the mapping between distal and judged depth and that the response method was both reliable and valid. However, texture gradients did influence the absolute values of the slant judgments. The role of Euclidean and affine mappings of distal structure is discussed and it is proposed that the perceptually important distinction is not between affine and Euclidean mapping, but rather between two types of affine mappings—consistent and variable.     

Projective invariance and the kinetic depth effect.

Seven experiments test the assumption that, in the kinetic depth effect, observers have reliable and direct access to the equivalence of shapes in projective geometry. The assumption is implicit in 'inverse optics' approaches to visual form perception. Observers adjusted a comparison shape to match a standard shape; both standard and comparison were portrayed as in continuous rotation in space, using a graphics computer. The shapes were either plane quadrilaterals or solid prisms. The angular difference of the planes of the shapes was varied, as was the dot density of a texture in those planes. Departure from projective equivalence was measured in six studies by measuring the planar analogue of cross ratio, and in a seventh by measuring the cross ratio for points in space. Projective equivalence was not found to be perceived uniformly, except in one experiment that did not involve rotation in depth. Otherwise changes in orientation of up to 180 degrees about a single coordinate axis had no significant effect on matches in shape, while changes in orientation about more than one coordinate axis produced significant effects. The addition of texture and a change in rotation speed did not correct departures from projective equivalence.     

Tracing trajectories of audio‐visual learning in the infant brain

Although infants begin learning about their environment before they are born, little is known about how the infant brain changes during learning. Here, we take the initial steps in documenting how the neural responses in the brain change as infants learn to associate audio and visual stimuli. Using functional near‐infrared spectroscopy (fNRIS) to record hemodynamic responses in the infant cortex (temporal, occipital, and frontal cortex), we find that across the infant brain, learning is characterized by an increase in activation followed by a decrease. We take this U‐shaped response as evidence of repetition enhancement during early stages of learning and repetition suppression during later stages, a result that mirrors the Hunter and Ames model of infant visual preference. Furthermore, we find that the neural response to violations of the learned associations can be predicted by the shape of the learning curve in temporal and occipital cortex. These data provide the first look at the shape of the neural response during audio‐visual associative learning in infancy establishing that diverse regions of the infant brain exhibit systematic changes across the time‐course of learning.     

Stereoscopic surface interpolation supports lightness constancy

The human visual system has a remarkable ability to construct surface representations from sparse stereoscopic, as well as texture and motion, information. In impoverished displays where few points are used to define regions in depth, the brain often interpolates depth estimates across intervening blank regions to create a compelling sense of a solid surface. The set of experiments described here examined stereoscopic interpolation using a novel technique based on lightness constancy. The effectiveness of this method is notable because it stands as the only technique to date that unequivocally examines the perception of interpolated surfaces, and not surfaces inferred subjectively from depth information in the stimulus. Further, these data support the growing evidence that a primary function of the stereoscopic system is to define three-dimensional surface structure.     

Visual placing by human infants

Prior research has not agreed that extension of the arms by the human infant on approach to a surface is a visual response. In this research, human infants 8 to 11-months-old extended their arms on approach to a patterned surface covered with glass. The arms did not extend to a patterned surface 14 in. below the glass. Thus, the response is a visual, not a vestibular, proprioceptive one. Ambiguity of the visual stimulus that elicits the response is shown by the finding that the infants also extended their arms almost as much to a gray surface just beneath the glass as they did to the patterned one.     

Ordinal structure in the visual perception and cognition of smoothly curved surfaces

In theoretical analyses of visual form perception, it is often assumed that the 3-dimensional structures of smoothly curved surfaces are perceptually represented as point-by-point mappings of metric depth and/or orientation relative to the observer. This article describes an alternative theory in which it is argued that our visual knowledge of smoothly curved surfaces can also be defined in terms of local, nonmetric order relations. A fundamental prediction of this analysis is that relative depth judgments between any two surface regions should be dramatically influenced by monotonicity of depth change (or lack of it) along the intervening portions of the surface through which they are separated. This prediction is confirmed in a series of experiments using surfaces depicted with either shading or texture. Additional experiments are reported, moreover, that demonstrate that smooth occlusion contours are a primary source of information about the ordinal structure of a surface and that the depth extrema in between contours can be optically specified by differences in luminance at the points of occlusion.     

Induced self-motion in central vision

Previous research on visually induced self-motion found that stimulation of the central visual field (up to 30 degrees in diameter) results in perceived object motion while self-motion requires peripheral stimulation. In the present study, perceived self-motion was induced with a radially expanding pattern simulating observer motion through a space filled with dots, with visual angles of 7.5 degrees, 10.6 degrees, 15 degrees, and 21.2 degrees. Speed and texture density were also varied. The duration of reported self-motion (a) decreased with increased speed, (b) failed to increase with increased visual angle, and (c) decreased with visual angle at the highest speed level. In a second experiment, subjects rated the perceived depth of the displays. The speed and speed/area interaction effects on judged depth matched those found for induced self-motion. These results suggest an extension of the focal/ambient theory: In addition to a more primitive ambient processing mode that requires peripheral vision, there is a higher level system concerned with ambient processing that functions in the central visual field and uses more complex stimulus information, such as internal depth represented in a radially expanding pattern.     

Kinetic occlusion: further studies of the boundary-flow cue

Previous work has demonstrated that human beings employ a processing assumption, the boundary-flow constraint, in perceiving the order of depth at an edge. Subjects perceive depth order of surfaces on the basis of the relative motions of an image boundary and a projected surface texture on either side of the boundary. In the present study, adult subjects viewed computer-generated kinematograms in which boundary-flow information provided the only cue for depth order. The results of Experiments 1 and 2 indicate that common motion between boundary and texture and differential motion between boundary and texture can independently generate the perception of ordered depths of surfaces. In Experiment 3, we examined the interaction of two processes involved in the extraction of depth order from boundary-flow displays: (1) the propagation of foreground and background surfaces from texture to boundary; and (2) the computation of depth order of surfaces on either side of the boundary. The results indicate that while the mechanism that computes depth from boundary-flow information functions reliably when the mean distance between texture and boundary is 8.1(0), surface propagation may be disrupted for distances of this magnitude.     

INFANT MACAQUE MONKEYS RESPOND TO PICTORIAL DEPTH

Abstract— The studies described here are the first to demonstrate that a nonhuman primate species is capable of responding to pictorial depth information during infancy. In two experiments, pigtailed macaque (Macaca nemestrina) infants were tested for responsivity to the pictorial depth cites of texture gradient/linear perspective and relative size. The procedures were adapted from human studies and are based on the proclivity of infants to reach more frequently to closer objects than to objects that are farther away. The stimulus displays included two equidistant objects that, when viewed monocularly, appear separated in space because of an illusion created by pictorial depth cues. When presented with these displays, animals reached significantly more often to the apparently closer objects under monocular conditions than under binocular conditions. These findings suggest that infant macaques are sensitive to pictorial depth information, the implication being that this ability has ancient phytogenetic origins and ix not learned from exposure to the conventions of Western art.