The coding of roughness.

This review examines the way information about textures is captured, encoded, and processed by the somatosensory system to produce sensations of roughness/smoothness. Textures with spatial periods exceeding about 200 microm are encoded spatially, so roughness is nearly independent of the speed and direction of their movement across the skin. The information consists of spatial variations in activity among slowly adapting (SA1) mechanoreceptors, and appears to be extracted by specialized cortical neurons. Perception of the roughness of finer surfaces is mediated by detection, primarily by Pacinian afferents, of cutaneous vibrations generated when textures move across the skin. Movement is necessary to the perception of these textures, and vibrotactile adaptation interferes with it. The code is an intensitive one (i.e., the amount of activity in Pacinian afferents).     

质地密度逐渐变化对触觉识别的作用

研究关于输入、本体感受和输出对表面触觉认知的影响,旨在探索运用触觉识别质地密度逐渐变化的表面时,理论关于表面粗糙度恒定的情况下,主动手指运动产生的信息不影响触觉认知的解释是否仍然成立。实验采用表面质地密度呈正态曲线式逐渐变化,组成正负两组变化方向。正方向变化为表面质点密度向中逐渐增大,与手指触摸运动的加减速方式一致;负方向变化为表面质点密度向中逐渐减小,与手指触摸运动的加减速方式相反;另外包括一个表面密度不变的平面。让被试辨别表面质地密度变化的方向,结果发现被试能够很好地判别表面质地密度变化的方向,但在判别正向变化的表面时显得更准确;当表面密度没有变化时,被试倾向于判别为正向变化。这一发现没有支持表面密度恒定的触觉认知解释模型。与常规直觉相反,研究还发现即时反馈并没有改进触觉识别,反而降低了辨别的正确率。质地密度逐渐变化的触觉识别在变化的大小、准确和自信心方面都显示了不同,但没有发现认知学习作用该触觉任务辨别的过程。基于这些发现,文章讨论了触觉质地感知和有关存在的理论解释模式。     

Perception of texture by vision and touch: multidimensionality and intersensory integration

A series of six experiments offers converging evidence that there is no fixed dominance hierarchy for the perception of textured patterns, and in doing so, highlights the importance of recognizing the multidimensionality of texture perception. The relative bias between vision and touch was reversed or considerably altered using both discrepancy and nondiscrepancy paradigms. This shift was achieved merely by directing observers to judge different dimensions of the same textured surface. Experiments 1, 4, and 5 showed relatively strong emphasis on visual as opposed to tactual cues regarding the spatial density of raised dot patterns. In contrast, Experiments 2, 3, and 6 demonstrated considerably greater emphasis on the tactual as opposed to visual cues when observers were instructed to judge the roughness of the same surfaces. The results of the experiments were discussed in terms of a modality appropriateness interpretation of intersensory bias. A weighted averaging model appeared to describe the nature of the intersensory integration process for both spatial density and roughness perception.     

Texture perception in sighted and blind observers

The purpose of the present study was to evaluate the utility of visual imagery for texture perception. In Experiment 1, sighted, early-blind, and late-blind observers made relative smoothness judgments of abrasive surfaces using active or passive tough. In Experiment 2, subjects compared vision and touch in the accuracy of smoothness detection, using a broad range of textures, including very fine surfaces. No differences appeared between the sighted and the blind, and it did not matter if touch were active or passive. Vision and touch showed similar performance with relatively coarse textures, but touch was superior to vision for much finer surface textures. The results were consistent with the notion that visual coding of tactual stimuli is not advantageous (or necessary) for texture perception, since touch may hold advantages for the detection of the smoothness of surfaces.     

When texture takes precedence over motion in depth perception

Both texture and motion can be strong cues to depth, and estimating slant from texture cues can be considered analogous to calculating slant from motion parallax (Malik and Rosenholtz 1994, report UCB/CSD 93/775, University of California, Berkeley, CA). A series of experiments was conducted to determine the relative weight of texture and motion cues in the perception of planar-surface slant when both texture and motion convey similar information. Stimuli were monocularly viewed images of planar surfaces slanted in depth, defined by texture and motion information that could be varied independently. Slant discrimination biases and thresholds were measured by a method of single-stimuli binary-choice procedure. When the motion and texture cues depicted surfaces of identical slants, it was found that the depth-from-motion information neither reduced slant discrimination thresholds, nor altered slant discrimination bias, compared to texture cues presented alone. When there was a difference in the slant depicted by motion and by texture, perceived slant was determined almost entirely by the texture cue. The regularity of the texture pattern did not affect this weighting. Results are discussed in terms of models of cue combination and previous results with different types of texture and motion information.     

Direction repulsion in unfiltered and ring-filtered Julesz textures

Perceived directions of motion were measured for each of two superposed two-dimensional dynamic random patterns consisting of unfiltered or ring-filtered dense random-check (Julesz) textures. One pattern always moved in a cardinal direction (up, down, left, or right), and the other texture always moved in an oblique direction separated from the cardinal component by 20 degrees-80 degrees. Several cardinal/oblique speed ratios were tested. In Experiment 1, the textures were unfiltered. In Experiment 2, the textures were ring filtered and had the same center frequency (1, 2, or 4 cpd). In Experiment 3, a 1-cpd ring-filtered texture was paired with a 2-, 4-, or 8-cpd texture. Subjects consistently misperceived the directions of component motion in these experiments; the angular separation of movement of the two textures was perceptually exaggerated, a phenomenon referred to as direction repulsion (Marshak & Sekuler, 1979). The results show that (1) direction repulsion occurs across at least a fourfold range of spatial frequencies and a sixfold range of speed ratios, (2) direction repulsion varies systematically with speed ratio, and (3) across most conditions, direction repulsion is anisotropic--direction repulsion is more evident in the oblique directions than in the cardinal directions. These findings suggest that the spatiotemporal range of inhibitory interactions involved in motion transparency is much greater than previously appreciated.     

The effect of texture relief on perception of slant from texture

Texture can be an effective source of information for perception of slant and curvature. A computational assumption required for some texture cues is that texture must be flat along a surface. There are many textures which violate this assumption, and have some sort of texture relief: variations perpendicular to the surface. Some examples include grass, which has vertical elements, or scattered rocks, which are volumetric elements with 3-D shapes. Previous studies of perception of slant from texture have not addressed the case of textures with relief. The experiments reported here test judgments of slant for textures with various types of relief, including textures composed of bumps, columns, and oriented elements. The presence of texture relief was found to affect judgments, indicating that perception of slant from texture is not robust to violations of the flat-texture assumption. For bumps and oriented elements, slant was underestimated relative to matching flat textures, while for columns textures, which had visible flat top faces, perceived slant was equal or greater than for flat textures. The differences can be explained by the way different types of texture relief affect the amount of optical compression in the projected image, which would be consistent with results from previous experiments using cue conflicts in flat textures. These results provide further evidence that compression contributes to perception of slant from texture.     

Integration of motion parallax with binocular disparity specifying different surface shapes

We investigated the interaction between motion parallax and binocular disparity cues in the perception of surface shape and depth magnitude by the use of the random dot stimuli in which these cues specified sinusoidal depth surfaces undulating with different spatial frequencies. When ambiguous motion parallax is inconsistent with unambiguous disparity cue, the reasonable solution for the visual system is to convert the motion signal to the flow on the surface specified by disparity. Two experiments, however, found that the visual system did not always use this reasonable solution; observers often perceived the surface specified by a composite of the two cues, or the surface specified by parallax alone. In the perception of this composite of the two cues, the apparent depth magnitude increased with the increase of the depth magnitude specified by both cues. This indicates that the visual system can combine the depth magnitude information from parallax and disparity in an additive fashion. The interference with parallax by disparity implies that the parallax processing is not independent of the disparity processing.     

Texture discrimination with and without abrupt texture gradients.

A common assumption is that effortless, visual texture discrimination relies on the detection of gradients between two textures. This assumption was assessed in two experiments with manipulations that smoothed (Experiment 1) or interrupted (Experiment 2) the gradient between textures comprising L- and X-type micropatterns. Compared to discrimination performance when there was an abrupt discontinuity between juxtaposed textures, performance declined moderately (about 10 percent) when the texture boundary was smoothed. In this case the two textures were asymmetrically discriminated but there was no interaction of this asymmetry with the abruptness of the texture gradient. Abrupt texture gradients, therefore, are not a necessary condition for the asymmetrical discrimination of two textures. A comparison of discrimination performance with juxtaposed textures--having an abrupt gradient--and discrimination performance when the textures were separated into distinct regions--by non-textured areas--yielded very similar results across several texture pairs. Taken together these results indicate that, in certain instances, texture discrimination may involve pattern classification-like processes that are operative in the absence of texture gradients.     

Opponent motion interactions

Interactions in the perception of motion transparency were investigated using a signal-detection paradigm. The stimuli were the linear sum of two independent, moving, random-check \ldsignal\rd textures and a third texture consisting of dynamic random \ldnoise.\rd Performance was measured as the ratio of squared signal and noise contrasts was varied (S²/W²). Motion detectability was poorest when the two signal textures moved in opposite directions (180\dg), intermediate when they moved in the same direction (0\dg), and best when the textures moved in directions separated by 90\dg in the stimulus plane. This pattern of results held across substantial variations in velocity, field size, duration, and texture-element size. Motion identification was also impaired, relative to 0\dg, in the 180\dg but not in the 90\dg condition. These results are consistent with the idea that performance in the opponent-motion condition is limited by inhibitory (or suppressive) interactions. These interactions, however, appear to be direction specific: little, if any, inhibition was observed for perpendicular motion.     

Tactile perception of nonpainful unpleasantness in relation to perceived roughness: effects of inter-element spacing and speed of relative motion of rigid 2-D raised-dot patterns at two body loci

Rigid surfaces consisting of spatially jittered 2-D raised-dot patterns with different inter-element spacings were moved back and forth across the skin at three different speeds (10-fold range). Within each psychophysical experiment, participants numerically estimated the perceived magnitude of either unpleasantness (nonpainful) or roughness of 2-D raised-dot surfaces applied to two stationary body sites (experiment 1: fingers; experiment 2: forearm). The psychophysical functions for the two types of perceptual judgment were highly similar at both body loci; more specifically, the perceived magnitude of unpleasantness and roughness both increased monotonically as a power function of increasing inter-element spacing, with the rate of growth declining at the upper end of the continuum. These results suggest that inter-element spacing is a critical determinant of the perceived magnitude of unpleasantness (nonpainful), as well as of roughness. Each perceptual judgment also increased as a function of increasing relative speed at both body loci. However, the magnitude of this effect was significantly greater for perceived unpleasantness than for perceived roughness; conversely, the speed effect was significantly greater on the forearm than on the fingers. Several possible explanations for these findings are considered.     

“有声有色”的触觉体验：来自多感觉通道整合的线索

虚拟现实技术通过提供视觉、听觉和触觉等信息为用户创造身临其境的感知体验, 其中触觉反馈面临诸多技术瓶颈使得虚拟现实中的自然交互受限。基于多感官错觉的伪触觉技术可以借助其他通道的信息强化和丰富触觉感受, 是目前虚拟现实环境中优化触觉体验的有效途径。本文聚焦于触觉中最重要的维度之一——粗糙度, 试图为解决虚拟现实中触觉反馈的受限问题提供新思路。探讨了粗糙度感知中, 视、听、触多感觉通道整合的关系, 分析了视觉线索(表面纹理密度、表面光影、控制显示比)和听觉线索(音调/频率、响度)如何影响触觉粗糙度感知, 总结了当下调控这些因素来改变粗糙度感知的方法。最后, 探讨了使用伪触觉反馈技术时, 虚拟现实环境中视、听、触觉信息在呈现效果、感知整合等方面与真实世界相比可能存在的差异, 提出可借鉴的改善触觉体验的适用方法和未来待研究的方向。     

Dynamic occlusion and motion parallax in depth perception

Random-dot techniques were used to examine the interactions between the depth cues of dynamic occlusion and motion parallax in the perception of three-dimensional (3-D) structures, in two different situations: (a) when an observer moved laterally with respect to a rigid 3-D structure, and (b) when surfaces at different distances moved with respect to a stationary observer. In condition (a), the extent of accretion/deletion (dynamic occlusion) and the amount of relative motion (motion parallax) were both linked to the motion of the observer. When the two cues specified opposite, and therefore contradictory, depth orders, the perceived order in depth of the simulated surfaces was dependent on the magnitude of the depth separation. For small depth separations, motion parallax determined the perceived order, whereas for large separations it was determined by dynamic occlusion. In condition (b), where the motion parallax cues for depth order were inherently ambiguous, depth order was determined principally by the unambiguous occlusion information.     

Roughness perception of unfamiliar dot pattern textures

Both vision and touch yield comparable results in terms of roughness estimation of familiar textures as was shown in earlier studies. To our knowledge, no research has been conducted on the effect of sensory familiarity with the stimulus material on roughness estimation of unfamiliar textures.The influence of sensory modality and familiarity on roughness perception of dot pattern textures was investigated in a series of five experiments. Participants estimated the roughness of textures varying in mean center-to-center dot spacing in experimental conditions providing visual, haptic and visual–haptic combined information.The findings indicate that roughness perception of unfamiliar dot pattern textures is well described by a bi-exponential function of inter-dot spacing, regardless of the sensory modality used. However, sensory modality appears to affect the maximum of the psychophysical roughness function, with visually perceived roughness peaking for a smaller inter-dot spacing than haptic roughness. We propose that this might be due to the better spatial acuity of the visual modality. Individuals appeared to use different visual roughness estimation strategies depending on their first sensory experience (visual vs. haptic) with the stimulus material, primarily in an experimental context which required the combination of visual and haptic information in a single bimodal roughness estimate. Furthermore, the similarity of findings in experimental settings using real and virtual visual textures indicates the suitability of the experimental setup for neuroimaging studies, creating a more direct link between behavioral and neuroimaging results.     

Integration of stereo and texture cues in the formation of discontinuities during three-dimensional surface interpolation

A series of stereograms are presented which demonstrate that texture boundaries can strongly influence the perception of discontinuities between neighbouring three-dimensional (3-D) surfaces portrayed by means of stereo cues. In these demonstration figures, no stereo information is available in the immediate vicinity of the boundary between the two 3-D stereo surfaces because all texture in that region is removed in one eye's view. On the other hand, various forms of texture boundary information are provided in the resulting monocular region. This stimulus paradigm is used to explore the question: what influence does texture boundary information have on the nature of the perceived 3-D surface that is interpolated between two stimulus regions which carry stereo cues? It is shown that if a clear-cut texture boundary is present in the monocular region then this is used by the human visual system to fix the perceived location of 3-D crease and step surface discontinuities between the stereo regions. Collett (1985) explored this issue with a similar methodology and reported weak and unreliable assistance from monocular texture boundaries in helping shape 3-D stereo surface discontinuities. The strong and robust phenomena demonstrated here seem to rely on two main differences between the present stimuli and those of Collett. In the present stimuli, figurally continuous textures containing strong texture boundaries are used, together with a technique for minimising the complications, including binocular rivalry, that arise from the borders of the stimulus regions present in only one half of each stereogram.     

Imposed vibration influences perceived tactile smoothness

According to the duplex theory of tactile texture perception, detection of cutaneous vibrations produced when the exploring finger moves across a surface contributes importantly to the perception of fine textures. If this is true, a vibrating surface should feel different from a stationary one. To test this prediction, experiments were conducted in which subjects examined two identical surfaces, one of which was surreptitiously made to vibrate, and judged which of the two was smoother. In experiment 1, the vibrating surface was less and less often judged smoother as the amplitude of (150 Hz) vibration increased. The effect was comparable in subjects who realized the surface was vibrating and those who did not. Experiment 2 showed that different frequencies (150-400 Hz) were equally effective in eliciting the effect when equated in sensation level (dB SL). The results suggest that vibrotaction contributes to texture perception, and that, at least within the Pacinian channel, it does so by means of an intensity code.     

Pacinian representations of fine surface texture

Subjects were presented with pairs of finely textured stimuli and were instructed to rate their dissimilarity, using free magnitude estimation. The subjects also rated the stimuli along each of four textural continua: roughness, hardness, stickiness, and warmth. In subsequent experimental sessions, we used a Hall effect transducer to measure the vibrations produced in the subjects' fingertip skin as the stimuli were scanned across it. We wished to assess the extent to which the perceptual dissimilarity of the textures could be explained in terms of the perceptual dissimilarity of the vibrations they elicited in the skin. To that end, we invoked a model characterizing the Pacinian representation of a vibratory stimulus. From the model, we computed the difference in the vibratory representations of the two stimuli in each pair. We found that the bulk of the variance in perceived dissimilarity of the textures was accounted for by differences in the Pacinian representations of the vibrations they produced. Our results further suggested that the textural information conveyed by the Pacinian system concerns surface roughness and, possibly, stickiness.     

On discriminating visual textures and images

Recent developments in modeling image discrimination by feature analytic and frequency selective methods are discussed. Some issues relating to the design of two-dimensional spatial frequency filters are developed within the context of two experiments on texture discrimination using artificial and naturally occurring textures. Results of these experiments indicate that, given an adequately formulated relationship between spatial frequency and orientation tuning parameters of the filter, one can predict a variety of texture discriminations using only amplitude-specific models. Finally, guidelines are established for ascertaining when phase transmission characteristics do become critical in two-dimensional image processing by the human observer.     

How is motion disparity integrated with binocular disparity in depth perception?

Two experiments presented motion disparity conflicting with binocular disparity to examine how these cues determined apparent depth order (convex, concave) and depth magnitude. In each experiment, 8 subjects estimated the depth order and depth magnitude. The first experiment showed the following. (1) The visual system used one of these cues exclusively in selecting a depth order for each display. (2) The visual system integrated the depth magnitude information from these cues by a weighted additive fashion if it selected the binocular disparity in depth order perception and if the depth magnitude specified by motion disparity was small relative to that specified by binocular disparity. (3) The visual system ignored the depth magnitude information of binocular disparity if it selected the motion disparity in depth order perception. The second experiment showed that these three points were consistent whether the subject’s head movement or object movement generated motion disparity.     

Aging and the perception of slant from optical texture, motion parallax, and binocular disparity

The ability of younger and older observers to perceive surface slant was investigated in four experiments. The surfaces possessed slants of 20°, 35°, 50°, and 65°, relative to the frontoparallel plane. The observers judged the slants using either a palm board (Experiments 1, 3, and 4) or magnitude estimation (Experiment 2). In Experiments 1–3, physically slanted surfaces were used (the surfaces possessed marble, granite, pebble, and circle textures), whereas computer-generated 3-D surfaces (defined by motion parallax and binocular disparity) were utilized in Experiment 4. The results showed that the younger and older observers' performance was essentially identical with regard to accuracy. The younger and older age groups, however, differed in terms of precision in Experiments 1 and 2: The judgments of the older observers were more variable across repeated trials. When taken as a whole, the results demonstrate that older observers (at least through the age of 83 years) can effectively extract information about slant in depth from optical patterns containing texture, motion parallax, or binocular disparity.