The perception of depth and slant from texture in three-dimensional scenes.

The perception of depth and slant in three-dimensional scenes specified by texture was investigated in five experiments. Subjects were presented with computer-generated scenes of a ground and ceiling plane receding in depth. Compression, convergence, and grid textures were examined. The effect of the presence or absence of a gap in the center of the display was also assessed. Under some conditions perceived slant and depth from compression were greater than those found with convergence. The relative effectiveness of compression in specifying surface slant was greater for surfaces closer to ground planes (80 degrees slant) than for surfaces closer to frontal parallel planes (40 degrees slant). The usefulness of compression was also observed with single-plane displays and with displays with surfaces oriented to reduce information regarding the horizon.     

The effect of pattern and texture gradient on slant and shape judgments

The experiment reported was designed to explore the relationship between gradient of texture and monocular slantshape perception. The effects of instructional set and order of slant and shape judgments were studied in interaction with four patterns differing in regularity of texture. Judgments of slant and shape were made by the same Ss for all patterns at 20°, 45°, 60°slant for slant judgments and 0°, 20°, 45°, 60° for width judgments. There were three instructional groups. Within each group one half of the Ss made slant judgments first, the other half shape judgments first. For all patterns, accurate perception of the slant of patterned material resulted in increased compensation in width judgments. Apparent width was found to be a function of pattern and also subject to instructional manipulation.     

When texture takes precedence over motion in depth perception

Both texture and motion can be strong cues to depth, and estimating slant from texture cues can be considered analogous to calculating slant from motion parallax (Malik and Rosenholtz 1994, report UCB/CSD 93/775, University of California, Berkeley, CA). A series of experiments was conducted to determine the relative weight of texture and motion cues in the perception of planar-surface slant when both texture and motion convey similar information. Stimuli were monocularly viewed images of planar surfaces slanted in depth, defined by texture and motion information that could be varied independently. Slant discrimination biases and thresholds were measured by a method of single-stimuli binary-choice procedure. When the motion and texture cues depicted surfaces of identical slants, it was found that the depth-from-motion information neither reduced slant discrimination thresholds, nor altered slant discrimination bias, compared to texture cues presented alone. When there was a difference in the slant depicted by motion and by texture, perceived slant was determined almost entirely by the texture cue. The regularity of the texture pattern did not affect this weighting. Results are discussed in terms of models of cue combination and previous results with different types of texture and motion information.     

The influence of texture on judgments of slant and relative distance in a picture with suggested depth

Six surfaces from natural environments with different visual textures were photographed at angles of 60, 65, and 70 deg from perpendicular. Measurements were taken of 24 Ss’ judgments of the inferred angles of slant and inferred midpoints of the six textured surfaces represented in the photographs which were viewed in the frontoparallel plane. Judgments of both slant and relative distance within the photographs were influenced by represented angle of slant and by variations in surface texture.     

Haptic perception of texture gradients

To pick up 3-D aspects of pictures is arguably the most difficult problem concerning tactile pictorial perception by the blind. The aim of the experiments reported was to examine the potential utility of texture gradients in this context. Since there is no theoretical basis for predicting absolute values of 3-D properties from 2-D patterns read by the finger pads, the abilities of participants to perceive gradients lying between known maxima and minima were assessed. Experiment 1 involved blindfolded sighted participants making verbal magnitude estimations of texture-gradient magnitudes corresponding to plane surfaces at different slants. In experiment 2 the participants' task was to orient a surface at a slant corresponding to the texture gradients depicted tactually, and experiment 3 required early-blind participants to attempt the same task. The results revealed that participants can scale the magnitudes of texture gradients with high precision and that they can also accurately produce surface slants from depictions, providing the extreme conditions are clearly defined and there are opportunities for learning. Texture gradients appear as informative to the blind as they do to the sighted. To what extent these data can be generalised to other gradients and textures or to other projections of 3-D scenes remains to be investigated.     

Three gradients and the perception of flat and curved surfaces

Researchers of visual perception have long been interested in the perceived slant of a surface and in the gradients that purportedly specify it. Slant is the angle between the line of sight and the tangent to the planar surface at any point, also called the surface normal. Gradients are the sources of information that grade, or change, with visual angle as one looks from one's feet upward to the horizon. The present article explores three gradients--perspective, compression, and density--and the phenomenal impression of flat and curved surfaces. The perspective gradient is measured at right angles to the axis of tilt at any point in the optic array; that is, when looking down a hallway at the tiles of a floor receding in the distance, perspective is measured by the x-axis width of each tile projected on the image plane orthogonal to the line of sight. The compression gradient is the ratio of y/x axis measures on the projected plane. The density gradient is measured by the number of tiles per unit solid visual angle. For flat surfaces and many others, perspective and compression gradients decrease with distance, and the density gradient increases. We discuss the manner in which these gradients change for various types of surfaces. Each gradient is founded on a different assumption about textures on the surfaces around us. In Experiment 1, viewers assessed the three-dimensional character of projections of flat and curved surfaces receding in the distance. They made pairwise judgments of preference and of dissimilarity among eight stimuli in each of four sets. The presence of each gradient was manipulated orthogonally such that each stimulus had zero, one, two, or three gradients appropriate for either a flat surface or a curved surface. Judgments were made were made for surfaces with both regularly shaped and irregularly shaped textures scattered on them. All viewer assessment were then scaled in one dimension. Multiple correlation and regression on the scale values revealed that greater than 98% of the variance in scale values was accounted for by the gradients. For the flat surfaces a mean of 65% of the variance was accounted for by the perspective gradient, 28% by the density gradient, and 6% by the compression gradient. For curved surfaces, on the other hand, a mean of 96% of the variance was accounted for by the compression gradient, and less than 2% by either the perspective gradient or the density gradient.(ABSTRACT TRUNCATED AT 400 WORDS)     

Evidence for the duplex theory of tactile texture perception

Three experiments are reported bearing on Katz's hypothesis that tactile texture perception is mediated by vibrational cues in the case of fine textures and by spatial cues in the case of coarse textures. Psychophysical responses when abrasive surfaces moved across the skin were compared with those obtained during static touch, which does not provide vibrational cues. Experiment 1 used two-interval forced-choice procedures to measure discrimination of surfaces. Fine surfaces that were readily discriminated when moved across the skin became indistinguishable in the absence of movement; coarse surfaces, however, were equally discriminable in moving and stationary conditions. This was shown not to result from any inherently greater difficulty of fine-texture discrimination. Experiments 2 and 3 used free magnitude estimation to obtain a more comprehensive picture of the effect of movement on texture (roughness) perception. Without movement, perception was seriously degraded (the psychophysical magnitude function was flattened) for textures with element sizes below 100 microns; above this point, however, the elimination of movement produced an overall decrease in roughness, but not in the slope of the magnitude function. Thus, two components of stimulation (presumably vibrational and spatial) contribute to texture perception, as Katz maintained; mechanisms for responding to the latter appear to be engaged at texture element sizes down to 100 microns, a surprisingly small value.     

Perception of three-dimensional form from patterns of optical texture

The research described in the present article was designed to investigate how patterns of optical texture provide information about the three-dimensional structure of objects in space. Four experiments were performed in which observers were asked to judge the perceived depth of simulated ellipsoid surfaces under a variety of experimental conditions. The results revealed that judged depth increases linearly with simulated depth although the slope of this relation varies significantly among different types of texture patterns. Random variations in the sizes and shapes of individual surface elements have no detectable effect on observers' judgments. The perception of three-dimensional form is quite strong for surfaces displayed under parallel projection, but the amount of apparent depth is slightly less than for identical surfaces displayed under polar projection. Finally, the perceived depth of a surface is eliminated if the optical elements in a display are not sufficiently elongated or if they are not approximately aligned with one another. A theoretical explanation of these findings is proposed based on the neural network analysis of Grossberg and Mingolla.     

Texture discrimination with and without abrupt texture gradients.

A common assumption is that effortless, visual texture discrimination relies on the detection of gradients between two textures. This assumption was assessed in two experiments with manipulations that smoothed (Experiment 1) or interrupted (Experiment 2) the gradient between textures comprising L- and X-type micropatterns. Compared to discrimination performance when there was an abrupt discontinuity between juxtaposed textures, performance declined moderately (about 10 percent) when the texture boundary was smoothed. In this case the two textures were asymmetrically discriminated but there was no interaction of this asymmetry with the abruptness of the texture gradient. Abrupt texture gradients, therefore, are not a necessary condition for the asymmetrical discrimination of two textures. A comparison of discrimination performance with juxtaposed textures--having an abrupt gradient--and discrimination performance when the textures were separated into distinct regions--by non-textured areas--yielded very similar results across several texture pairs. Taken together these results indicate that, in certain instances, texture discrimination may involve pattern classification-like processes that are operative in the absence of texture gradients.     

Factors involved in visual capture.

Visual capture was explored using three types of vision-"touch" conflicts. The results indicated that the amount of visual capture differed for the three tasks. In one task (slant judgments) strong, but incomplete, visual capture occurred, in another (a length judgment task) an approximate compromise between the two modalities was found, and in the third task (texture judgments) a trend toward touch capture occurred. In two additional experiments using the slant task, the effects of brief training with one of the competing modalities and the effects of manipulating certain aspects of the stimulus display were explored. The bried training did not alter the resolution of the conflict but varying visual clarity and felt texture of the rod whose slant was being judged did affect visual capture.     

Aging and the perception of slant from optical texture, motion parallax, and binocular disparity

The ability of younger and older observers to perceive surface slant was investigated in four experiments. The surfaces possessed slants of 20°, 35°, 50°, and 65°, relative to the frontoparallel plane. The observers judged the slants using either a palm board (Experiments 1, 3, and 4) or magnitude estimation (Experiment 2). In Experiments 1–3, physically slanted surfaces were used (the surfaces possessed marble, granite, pebble, and circle textures), whereas computer-generated 3-D surfaces (defined by motion parallax and binocular disparity) were utilized in Experiment 4. The results showed that the younger and older observers' performance was essentially identical with regard to accuracy. The younger and older age groups, however, differed in terms of precision in Experiments 1 and 2: The judgments of the older observers were more variable across repeated trials. When taken as a whole, the results demonstrate that older observers (at least through the age of 83 years) can effectively extract information about slant in depth from optical patterns containing texture, motion parallax, or binocular disparity.     

The perception of texture on folded surfaces

Do judgments of texture similarity reflect surface texture or image texture? To find out, we had observers view a rectangular surface that was folded into three panels, much like a brochure. Each panel was textured with an oriented noise pattern and the observers' task was to determine which side panel matched the center panel in surface texture. Information about surface geometry was conveyed by binocular disparity and by the boundaries of the rectangular surface. We found that observers were often consistently wrong, selecting the texture that differed in the image and not on the surface. In sharp contrast, when observers judged the texture orientation on each panel individually, their judgments were accurate reflections of the surface texture. So even when observers can recover surface texture, their judgments of texture similarity may still be based on image texture.     

Reliability and dimensionality of judgments of visually textured materials

We extended perceptual studies of the Brodatz set of textured materials. In the experiments, texture perception for different texture sets, viewing distances, or lighting intensities was examined. Subjects compared one pair of textures at a time. The main task was to rapidly rate all of the texture pairs on a number scale for their overall dissimilarities first and then for their dissimilarities according to six specified attributes (e.g., texture contrast). The implied dimensionality of perceptual texture space was usually at least four, rather than three. All six attributes proved to be useful predictors of overall dissimilarity, especially coarseness and regularity. The novel attribute texture lightness, an assessment of mean surface reflectance, was important when viewing conditions were wide-ranging. We were impressed by the general validity of texture judgments across subject, texture set, and comfortable viewing distances or lighting intensities. The attributes are nonorthogonal directions in four-dimensional perceptual space and are probably not narrow linear axes. In a supplementary experiment, we studied a completely different task: identifying textures from a distance. The dimensionality for this more refined task is similar to that for rating judgments, so our findings may have general application.     

Visual aftereffect of texture density contingent on color of frame

An aftereffect of perceived texture density contingent on the color of a surrounding region is reported. In a series of experiments, participants were adapted, with fixation, to stimuli in which the relative density of two achromatic texture regions was perfectly correlated with the color presented in a surrounding region. Following adaptation, the perceived relative density of the two regions was contingent on the color of the surrounding region or of the texture elements themselves. For example, if high density on the left was correlated with a blue surround during adaptation (and high density on the right with a yellow surround), then in order for the left and right textures to appear equal in the assessment phase, denser texture was required on the left in the presence of a blue surround (and denser texture on the right in the context of a yellow surround). Contingent aftereffects were found (1) with black-and-white scatter-dot textures, (2) with luminance-balanced textures, and (3) when the texture elements, rather than the surrounds, were colored during assessment. Effect size was decreased when the elements themselves were colored, but also when spatial subportions of the surround were used for the presentation of color. The effect may be mediated by retinal color spreading (Pöppel, 1986) and appears consistent with a local associative account of contingent aftereffects, such as Barlow’s (1990) model of modifiable inhibition.     

Contrast and depth perception: effects of texture contrast and area contrast

Many objects in natural scenes have textures on their surfaces. Contrast of the texture surfaces (the texture contrast) reduces when the viewing distance increases. Similarly, contrast between the surfaces of the objects and the background (the area contrast) reduces when the viewing distance increases. The texture contrast and the area contrast were defined by the contrast between random dots, and by the contrast between the average luminance of the dot pattern and the luminance of the background, respectively. To examine how these two types of contrast influence depth perception, we ran two experiments. In both experiments two areas of random-dot patterns were presented against a uniform background, and participants rated relative depth between the two areas. We found that the rated depth of the patterned areas increased with increases in texture contrast. Furthermore, the effect of the texture contrast on depth judgment increased when the area contrast became low.     

Conjoint measurement of gloss and surface texture

The image of a material's surface varies not only with viewing and illumination conditions, but also with the material's surface properties, including its 3-D texture and specularity. Previous studies on the visual perception of surface material have typically focused on single material properties, ignoring possible interactions. In this study, we used a conjoint-measurement design to determine how observers represent perceived 3-D texture ("bumpiness") and specularity ("glossiness") and modeled how each of these two surface-material properties affects perception of the other. Observers made judgments of bumpiness and glossiness of surfaces that varied in both surface texture and specularity. We quantified how changes in each surface-material property affected judgments of the other and found that a simple additive model captured visual perception of texture and specularity and their interaction. Conjoint measurement is potentially a powerful tool for analyzing perception of surface material in realistic environments.     

Visual and tactual texture perception: Intersensory cooperation

In three experiments, subjects were required to make texture judgments about abrasive surfaces. Touch and vision provided comparable levels of performance when observers attempted to select the smoothest of three surfaces, but bimodal visual and tactual input led to greater accuracy. The superiority of bimodal perception was ascribed to visual guidance of tactual exploration. The elimination of visual texture cues did not impair bimodal performance if vision of hand movements were permitted. It is suggested that touch may preempt vision when both sources of texture information are simultaneously available. The results support the notion that perception is normally multimodal, since restriction of the observer to either sense in isolation produces lower levels of performance.     

Distortions of depth-order relations and parallelism in structure from motion

Four experiments related human perception of depth-order relations in structure-from-motion dis-plays to current Euclidean and affine theories of depth recovery from motion. Discrimination between parallel and nonparallel lines and relative-depth judgments was observed for orthographic projections of rigidly oscillating random-dot surfaces. We found that (1) depth-order relations were perceived veridically for surfaces with the same slant magnitudes, but were systematically biased for surfaces with different slant magnitudes. (2) Parallel (virtual) lines defined by probe dots on surfaces with different slant magnitudes were judged to be nonparallel. (3) Relative-depth judgments were internally inconsistent for probe dots on surfaces with different slant magnitudes. It is argued that both veridical performance and systematic misperceptions may be accounted for by a heuristic analysis of the first-order optic flow.     

Visual discrimination of texture

Julesz (1975) proposed a theory of texture discrimination, based on an order statistics principle, which states that no two textures can be perceptually discriminated if they have identical second-order statistics. The experiments reported here demonstrate that this principle is not adequate to predict visual texture discriminability. Both letter and dot micropatterns were used to create texture pairs that either differed or were identical with respect to secondorder statistics. The subject’s task was to decide which quadrant of an array contained a disparate texture. In Experiments 1, 2, and 3, when controlling for spatial overlap, texture pairs having identical second-order statistics were discriminated more quickly than similar texture pairs having different second-order statistics, in contradiction to the principle. Although a significant effect in the direction predicted by the order statistics principle was found in Experiment 4 for texture pairs created from the dot micropatterns, other factors, such as spatial overlap, border differences, and goodness of pattern, must also be considered in predicting texture discriminability.     

Texture gradient registration and the development of slant perception.

The processes underlying the development of slant perception were investigated by manipulating the degree of texture element variability. Subjects at four grade levels were required to make judgments of physical slant of surfaces with three levels of variability. Absolute error of judgment decreased with age, but texture variability had no effect at any grade level. The results suggest that there is no improvement in the ability to extract gradient information. Rather, improvement in the consistency of judgment reflects a developmental change in the relationship between stimulus information and judgment.