Texture perception in sighted and blind observers

The purpose of the present study was to evaluate the utility of visual imagery for texture perception. In Experiment 1, sighted, early-blind, and late-blind observers made relative smoothness judgments of abrasive surfaces using active or passive tough. In Experiment 2, subjects compared vision and touch in the accuracy of smoothness detection, using a broad range of textures, including very fine surfaces. No differences appeared between the sighted and the blind, and it did not matter if touch were active or passive. Vision and touch showed similar performance with relatively coarse textures, but touch was superior to vision for much finer surface textures. The results were consistent with the notion that visual coding of tactual stimuli is not advantageous (or necessary) for texture perception, since touch may hold advantages for the detection of the smoothness of surfaces.     

Perception of texture by vision and touch: multidimensionality and intersensory integration

A series of six experiments offers converging evidence that there is no fixed dominance hierarchy for the perception of textured patterns, and in doing so, highlights the importance of recognizing the multidimensionality of texture perception. The relative bias between vision and touch was reversed or considerably altered using both discrepancy and nondiscrepancy paradigms. This shift was achieved merely by directing observers to judge different dimensions of the same textured surface. Experiments 1, 4, and 5 showed relatively strong emphasis on visual as opposed to tactual cues regarding the spatial density of raised dot patterns. In contrast, Experiments 2, 3, and 6 demonstrated considerably greater emphasis on the tactual as opposed to visual cues when observers were instructed to judge the roughness of the same surfaces. The results of the experiments were discussed in terms of a modality appropriateness interpretation of intersensory bias. A weighted averaging model appeared to describe the nature of the intersensory integration process for both spatial density and roughness perception.     

Tactual, visual, and cross-modal transfer of texture in 5- and 8-year-old children

Children's tactual, visual, and cross-modal transfer abilities for texture were investigated in a delayed matching-to-sample paradigm. Transfer performance from vision to touch was found to increase between 5 and 8 years of age, whereas transfer performance from touch to vision did not vary with age and matched touch-to-touch performance. Asymmetrical cross-modal abilities were observed at the age of 8 years, vision-to-touch transfer performance being higher than touch-to-vision transfer performance (experiment 2). This developmental pattern could not be attributed to limitations in the tactual or visual discriminability of the textures or to differences in tactual or visual memory between the two age groups (experiment 1). It is suggested that the increase with age in vision-to-touch performance may be related to the intervention of more efficient top-down perceptual processes in the older children.     

Similarity of tactual and visual picture recognition with limited field of view.

Subjects attempted to recognize simple line drawings of common objects using either touch or vision. In the touch condition, subjects explored raised line drawings using the distal pad of the index finger or the distal pads both of the index and of the middle fingers. In the visual condition, a computer-driven display was used to simulate tactual exploration. By moving an electronic pen over a digitizing tablet, the subject could explore a line drawing stored in memory; on the display screen a portion of the drawing appeared to move behind a stationary aperture, in concert with the movement of the pen. This aperture was varied in width, thus simulating the use of one or two fingers. In terms of average recognition accuracy and average response latency, recognition performance was virtually the same in the one-finger touch condition and the simulated one-finger vision condition. Visual recognition performance improved considerably when the visual field size was doubled (simulating two fingers), but tactual performance showed little improvement, suggesting that the effective tactual field of view for this task is approximately equal to one finger pad. This latter result agrees with other reports in the literature indicating that integration of two-dimensional pattern information extending over multiple fingers on the same hand is quite poor. The near equivalence of tactual picture perception and narrow-field vision suggests that the difficulties of tactual picture recognition must be largely due to the narrowness of the effective field of view.     

The limits of newborn's grasping to detect texture in a cross-modal transfer task

Three experiments were conducted to investigate human newborns’ ability to perceive texture property tactually, either in a cross-modal transfer task or in an intra-modal tactual discrimination task. In Experiment 1, newborns failed to tactually recognize the texture (smooth vs. granular) of flat objects that they had previously seen, when they held flat objects. This failure was mainly due to a lack of intra-modal tactual discrimination between the two objects (Experiment 2). In contrast, Experiment 3 showed that newborns were able to tactually recognize the texture of previously seen surfaces when they held volumetric objects. Taken together, the results suggest that cross-modal transfer of texture from vision to touch stem from a peripheral mechanism, not a central mechanism. Grasping only allows newborns to perceive the texture of volumetric but not flat objects. As a consequence, this study reveals the limits of newborns’ grasping to detect and process information about texture. The results also suggest that more mature exploratory procedures, such as the “lateral motion” procedure exhibited by adults [Lederman, S. J., & Klatzky, R. (1987). Hand movements: A window into haptic object recognition. Cognitive Psychology, 19, 342–368], might be necessary for detecting the texture of flat objects in newborn infants.     

What aspects of vision facilitate haptic processing?

We investigate how vision affects haptic performance when task-relevant visual cues are reduced or excluded. The task was to remember the spatial location of six landmarks that were explored by touch in a tactile map. Here, we use specially designed spectacles that simulate residual peripheral vision, tunnel vision, diffuse light perception, and total blindness. Results for target locations differed, suggesting additional effects from adjacent touch cues. These are discussed. Touch with full vision was most accurate, as expected. Peripheral and tunnel vision, which reduce visuo-spatial cues, differed in error pattern. Both were less accurate than full vision, and significantly more accurate than touch with diffuse light perception, and touch alone. The important finding was that touch with diffuse light perception, which excludes spatial cues, did not differ from touch without vision in performance accuracy, nor in location error pattern. The contrast between spatially relevant versus spatially irrelevant vision provides new, rather decisive, evidence against the hypothesis that vision affects haptic processing even if it does not add task-relevant information. The results support optimal integration theories, and suggest that spatial and non-spatial aspects of vision need explicit distinction in bimodal studies and theories of spatial integration.     

Picture and pattern perception in the sighted and the blind: the advantage of the late blind

Two experiments are reported on the contribution of visual experience to tactile perception. In the first experiment, sighted, congenitally blind, and late blind individuals made tactual matches to tangible embossed shapes. In the second experiment, the same subjects attempted tactile identification of raised-line drawings. The three groups did not differ in the accuracy of shape matching, but both groups of blind subjects were much faster than the sighted. Late blind observers were far better than the sighted or congenitally blind at tactile picture identification. Four of the twelve pictures were correctly identified by most of the late blind subjects. The sighted and congenitally blind performed at comparable levels in picture naming. There was no evidence that visual experience alone aided the sighted in the tactile task under investigation, since they performed no better than did the early blind. The superiority of the late blind suggests that visual exposure to drawings and the rules of pictorial representation may help tactile picture identification when combined with a history of tactual experience.     

Impaired tactual perception in children with Down's syndrome

Using standardized neuropsychological tests, tactual finger discrimination, graphaesthesia and stereognosis were studied in a group of 11 children aged 7–11 years with Down's syndrome (DS). All tasks were solved without visual control. The performance was subnormal in each test and the results of the stereognosis test were particularly poor. It was ascertained that the DS children could understand test instructions. Moreover, under visual control all objects used in the stereognosis test were handled correctly. The results suggest that tactual perception is subnormal in children with DS. The pathogenesis of the somatosensory abnormalities should be explored.     

Audition dominates vision in duration perception irrespective of salience,attention, and temporal discriminability

Whereas the visual modality tends to dominate over the auditory modality in bimodal spatial perception, the auditory modality tends to dominate over the visual modality in bimodal temporal perception. Recent results suggest that the visual modality dominates bimodal spatial perception because spatial discriminability is typically greater for the visual than for the auditory modality; accordingly, visual dominance is eliminated or reversed when visual-spatial discriminability is reduced by degrading visual stimuli to be equivalent or inferior to auditory spatial discriminability. Thus, for spatial perception, the modality that provides greater discriminability dominates. Here, we ask whether auditory dominance in duration perception is similarly explained by factors that influence the relative quality of auditory and visual signals. In contrast to the spatial results, the auditory modality dominated over the visual modality in bimodal duration perception even when the auditory signal was clearly weaker, when the auditory signal was ignored (i.e., the visual signal was selectively attended), and when the temporal discriminability was equivalent for the auditory and visual signals. Thus, unlike spatial perception, where the modality carrying more discriminable signals dominates, duration perception seems to be mandatorily linked to auditory processing under most circumstances.     

Tactual learning and cross-modal transfer of an oddity problem in young children

The ability to solve tactual oddity problems, and transfer of oddity learning across the visual and the tactual modalities, was studied in 3- to 8-year-old children (N = 294). Oddity tasks consisting of one odd and two equal objects were made from stimuli that were easily discriminated visually and tactually. The results showed that tactual oddity learning increased gradually with age. The growth in tactual performance begins later than visual, suggesting that children are more adept at encoding visual stimulus invariances or relational properties than tactual ones. Bidirectional cross-modal transfer of oddity learning was found, supporting the suggestion that such transfer occurs when training and transfer oddity tasks share a common vehicle dimension. The cross-modal effect also shows that oddity learning is independent of a specific modality-labeled perceptual context. Our results are consistent with the view that development of oddity learning depends on a single rather than a dual process, and that the oddity relation may be treated as an amodal stimulus feature.     

Perceptual equivalence between visual and tactual pattern perception: An anchoring study

An anchoring design was used to investigate correspondence between visual and tactual scaling of complexity when two samples of random polygons served as stimulus forms. The results support the conclusion that within an adjustment for differential acuity between vision and active touch input is referred to a common perceptual mechanism.     

Tactual perception: a review of experimental variables and procedures

This paper reviews the literature on tactual perception. Throughout this review, we will highlight some of the most relevant aspects in the touch literature: type of stimuli; type of participants; type of tactile exploration; and finally, the interaction between touch and other senses. Regarding type of stimuli, we will analyse studies with abstract stimuli such as vibrations, with two- and three-dimensional stimuli, and also concrete stimuli, considering the relation between familiar and unfamiliar stimuli and the haptic perception of faces. Under the "type of participants" topic, we separated studies with blind participants, studies with children and adults, and also performed an overview of sex differences in performance. The type of tactile exploration is explored considering conditions of active and passive touch, the relevance of movement in touch and the relation between haptic exploration and time. Finally, interactions between touch and vision, touch and smell and touch and taste are explored in the last topic. The review ends with an overall conclusion on the state of the art for the tactual perception literature. With this work, we intend to present an organised overview of the main variables in touch experiments, compiling aspects reported in the tactual literature, and attempting to provide both a summary of previous findings, and a guide to the design of future works on tactual perception and memory, through a presentation of implications from previous studies.     

Textural properties corresponding to visual perception based on the correlation mechanism in the visual system

We present a set of texture parameters that correspond to perceptual properties of visual texture. For machine vision or a computer interface, it is important that the computational measurements of texture correspond well to the perceptual properties. To understand the mechanism of our visual system, it is important to know how we extract or characterize information for texture perception. In this study, we show that the autocorrelation function (ACF) analysis provides useful measures for representing three salient perceptual properties of texture: contrast, coarseness, and regularity. The validity of the ACF analysis was examined by comparing the calculated factors to the subjective scores collected for various kinds of natural textures. The effectiveness of the analysis depends on the structure of the estimated ACF. When a texture has a harmonic structure, the estimated ACF has periodical peaks corresponding to the periods of the texture. Both perceived coarseness and regularity are strongly related to these peaks in the ACF. However, the estimated ACF does not have a periodical structure when the texture is random. In this case, the texture coarseness and regularity are represented by the decay rate of the ACF.     

Tactual perception of embossed Morse code and braille: the alliance of vision and touch

In three experiments observers made visual matches to tangible embossed patterns. Stained glass was used to blur vision and thus allow the effect of visual guidance of tactual exploration on the accuracy of symbol recognition to be evaluated. Stained glass rendered the embossed code invisible, but allowed sight of the hand. In the first experiment subjects identified patterns made up of dots and dashes drawn from Morse code; in the second and third experiments they studied braille. The results show that subjects are more accurate in 'reading' tangible codes when provided with visual guidance. Performance was higher for braille than for Morse code. Vision aided touch through the provision of a frame of reference and through sight of scanning movements. Naive sighted observers were able to identify invisible braille dots by watching other individuals touch the symbols, suggesting the importance of vision of kinesthetic patterns.     

A comparison of auditory and visual apparent motion presented individually and with crossmodal moving distractors

Unimodal auditory and visual apparent motion (AM) and bimodal audiovisual AM were investigated to determine the effects of crossmodal integration on motion perception and direction-of-motion discrimination in each modality. To determine the optimal stimulus onset asynchrony (SOA) ranges for motion perception and direction discrimination, we initially measured unimodal visual and auditory AMs using one of four durations (50, 100, 200, or 400 ms) and ten SOAs (40-450 ms). In the bimodal conditions, auditory and visual AM were measured in the presence of temporally synchronous, spatially displaced distractors that were either congruent (moving in the same direction) or conflicting (moving in the opposite direction) with respect to target motion. Participants reported whether continuous motion was perceived and its direction. With unimodal auditory and visual AM, motion perception was affected differently by stimulus duration and SOA in the two modalities, while the opposite was observed for direction of motion. In the bimodal audiovisual AM condition, discriminating the direction of motion was affected only in the case of an auditory target. The perceived direction of auditory but not visual AM was reduced to chance levels when the crossmodal distractor direction was conflicting. Conversely, motion perception was unaffected by the distractor direction and, in some cases, the mere presence of a distractor facilitated movement perception.     

Perception of surface curvature and direction of illumination from patterns of shading

Three experiments examine the perceptual salience of shading information for the visual specification of three-dimensional form. The observers in these experiments were required to estimate the surface curvature and direction of illumination depicted in computer-synthesized images of cylindrical surfaces, both with and without texture. The results indicate that the shininess of a surface enhances the perception of curvature, but has no effect on perceived direction of illumination; and that shading is generally less effective than texture for depicting surfaces in three dimensions. These and other findings are used to evaluate the psychological validity of several mathematical analyses of shading information that have recently been proposed in the literature.     

人类颜色视觉的计算理论

该文有机地结合了计算视觉理论和生态学视觉理论,指出颜色信息处理的根本任务是检测环境中的光不变量。在此基础上,作者提出了颜色视觉的计算理论以及计算理论本身的生物学标准。初级视觉计算是典型的不适定问题,动物的视觉系统则利用视环境中存在的条件将该不适定问题转化为定解问题。本文引入颜色视觉计算的免要条件,客观性约束,以及颜色认知的神经表象,证明了上述约束下颜色算法的存在性。本文给出了构造颜色知觉的基本假设。同时,该文还讨论了与上述问题密切相关的几个基本问题:神经表象的完备性,主观色觉的客观性,明度知觉和颜色知觉的统一,人类主观色觉的实现方式。     

Depth perception: cuttlefish (Sepia officinalis) respond to visual texture density gradients

Studies concerning the perceptual processes of animals are not only interesting, but are fundamental to the understanding of other developments in information processing among non-humans. Carefully used visual illusions have been proven to be an informative tool for understanding visual perception. In this behavioral study, we demonstrate that cuttlefish are responsive to visual cues involving texture gradients. Specifically, 12 out of 14 animals avoided swimming over a solid surface with a gradient picture that to humans resembles an illusionary crevasse, while only 5 out of 14 avoided a non-illusionary texture. Since texture gradients are well-known cues for depth perception in vertebrates, we suggest that these cephalopods were responding to the depth illusion created by the texture density gradient. Density gradients and relative densities are key features in distance perception in vertebrates. Our results suggest that they are fundamental features of vision in general, appearing also in cephalopods.     

Depth from binocular half-occlusions in stereoscopic images of natural scenes

Over the past two decades psychophysical experiments have firmly established that binocular half-occlusions are useful sources of information for the human visual system. The existing literature has focused on simplified stimuli that have no additional cues to depth, apart from stereopsis. From this large body of work we can be confident that the visual system is able to exploit binocular half-occlusions to aid depth perception; however, we do not know if this signal has any influence on perception when observers view complex stereoscopic stimuli with multiple sources of depth information. This issue is addressed here with the use of stereoscopic images of natural scenes, some of which have been digitally altered to manipulate a major half-occlusion signal. Our results show that depth-ordering judgments for these relatively complex stimuli are significantly affected by the nature of the half-occlusion signal, but only when highly textured surfaces are viewed. Under such conditions, the replacement of a binocular half-occlusion with background texture slows reaction time relative to performance when the occluded region is consistent with the foreground object. This result is specific to conditions when the depth ordering is correct (ie not reversed) and depends upon the size of the half-occlusion. The influence of the half-occlusion information in the presence of potent depth cues such as perspective, texture gradient, shading, and interposition is convincing evidence that this information plays a significant role in human depth perception.     

Effects of surface texture and grip force on the discrimination of hand-held loads

In this paper, we report the results from two experiments in which subjects were required to discriminate horizontal load forces applied to a manipulandum held with a precision grip. The roughness (and hence friction) of the grip surfaces and required grip force were manipulated. In the first experiment, subjects were instructed to judge the load while maintaining hand position and not letting the manipulandum slip. It was found that performance was influenced by surface texture; a given load was judged to be greater when the surface texture was smooth than when it was rough. This result is consistent with a previous study based on lifting objects and indicates that the effect of surface texture applies to loads in general and not just to gravitational loads (i.e., weight). To test whether the load acting on a smooth object is judged to be greater because the grip force required to prevent it from slipping is larger, a second experiment was carried out. Subjects used a visual feedback display to maintain the same grip force for smooth and rough manipulandum surfaces. In this case, there was no effect of surface texture on load perception. These results provide evidence that perceived load depends on the grip force used to resist the load. The implications of these results in terms of central and peripheral factors underlying load discrimination are considered.