Memory processing of spatial order as transmitted by auditory information in the absence of visual cues

Two experiments were conducted concerning spatial order recall when spatial information is transmitted by auditory stimuli. Temporal order either was congruent with spatial order or was independent of spatial order. In Experiment 1, the comparisons were among normally or partially sighted subjects allowed to look, normally sighted subjects who were blindfolded, and blind children. The main findings were a superiority of the sighted subjects allowed to look (that is, to support auditory information with visual cues) and a smaller advantage for the sighted-but-blindfolded subjects, relative to the blind group. In Experiment 2, normally sighted adults (either seeing or blindfolded) and blind adults were tested. Surprisingly, the blind were not worse than the sighted in this study. Subsequent interviews and detailed analysis of errors suggested that the blind coded spatial information kinesthetically. These indirect analyses also suggested that whereas spatial order was coded temporally in the sighted, it was controlled by both temporal and spatial factors in the blind and blindfolded subjects.     

Imagery in the congenitally blind: how visual are visual images?

Three experiments compared congenitally blind and sighted adults and children on tasks presumed to involve visual imagery in memory. In all three, the blind subjects' performances were remarkably similar to the sighted. The first two experiments examined Paivio's (1971) modality-specific imagery hypothesis. Experiment 1 used a paired-associate task with words whose referents were high in either visual or auditory imagery. The blind, like the sighted, recalled more high-visual-imagery pairs than any others. Experiment 2 used a free-recall task for words grouped according to modality-specific attributes, such as color and sound. The blind performed as well as the sighted on words grouped by color. In fact, the only consistent deficit in both experiments occurred for the sighted in recall of words whose referents are primarily auditory. These results challenge Paivio's theory and suggest either (a) that the visual imagery used by the sighted is no more facilitating than the abstract semantic representations used by the blind or (b) that the sighted are not using visual imagery. Experiment 3 used Neisser and Kerr's (1973) imaging task. Subjects formed images of scenes in which target objects were described as either visible in the picture plane or concealed by another object and thus not visible. On an incidental recall test for the target objects, the blind, like the sighted, recalled more pictorial than concealed targets. This finding suggests that the haptic images of the blind maintain occlusion just as the visual images of the sighted do.     

Visual mediation and the haptic recognition of two-dimensional pictures of common objects

A set of three experiments was performed to investigate the role of visual imaging in the haptic recognition of raised-line depictions of common objects. Blindfolded, sighted (Experiment 1) observers performed the task very poorly, while several findings converged to indicate that a visual translation process was adopted. These included (1) strong correlation between image-ability ratings (obtained in Experiment 1 and, independently, in Experiment 2) and both recognition speed and accuracy, (2) superior performance with, and greater ease of imaging, two-dimensional as opposed to three-dimensional depictions, despite equivalence in rated line complexity, and (3) a significant correlation between the general ability of the observer to image and obtained imageability ratings of the stimulus depictions. That congenitally blind observers performed the same task even more poorly, while their performance did not differ for two- versus three-dimensional depictions (Experiment 3), provides further evidence that visual translation was used by the sighted. Such limited performance is contrasted with the considerable skill with which real common objects are processed and recognized haptically. The reasons for the general difference in the haptic performance of two- versus three-dimensional tasks are considered. Implications for the presentation of spatial information in the form of tangible graphics displays for the blind are also discussed.     

Tactile memory in sighted and blind observers: the influence of orientation and rate of presentation

Sighted, early blind, and late blind subjects attempted to identify numerals or number sequences printed on their palms. The numerals were either upright, or inverted, or rotated perpendicular to the arm axis. Stimulus rotation degraded recognition in the early blind subjects, suggesting the influence of experience with visual frames of reference. Slower rates of presentation with upright number sequences improved recall in both sighted and blind observers. An experiment on tactual-visual braille recognition in the sighted observers showed that tilt degraded pattern identification, but visual guidance of the fingertip and ballpoint minimized this loss. A further experiment was performed to distinguish between visual imagery and visual frame of reference explanations of the visual guidance effect on recognition of rotated braille. Subjects explored upright or tilted braille characters while viewing only a light emitting diode on the exploratory fingertip. Sight of scanning movements did not aid pattern recognition with tilt. The results indicate that the benefits of visual guidance on recognition of tilted patterns were probably due to frame of reference information. It is concluded that spatial reference information may aid tactile memory in the sighted and late blind, since the early blind performed at a lower level in the retention task. It is proposed that visual imagery may only explain the superiority of the sighted and late blind when familiar stimuli are studied.     

Early- and late-onset blindness both curb audiotactile integration on the parchment-skin illusion

It has been shown that congenital blindness can lead to anomalies in the integration of auditory and tactile information, at least under certain conditions. In the present study, we used the parchment-skin illusion, a robust illustration of sound-biased perception of touch based on changes in frequency, to investigate the specificities of audiotactile interactions in early- and late-onset blind individuals. Blind individuals in both groups did not experience any illusory change in tactile perception when the frequency of the auditory signal was modified, whereas sighted individuals consistently experienced the illusion. This demonstration that blind individuals had reduced susceptibility to an auditory-tactile illusion suggests either that vision is necessary for the establishment of audiotactile interactions or that auditory and tactile information can be processed more independently in blind individuals than in sighted individuals. In addition, the results obtained in late-onset blind participants suggest that visual input may play a role in the maintenance of audiotactile integration.     

盲人的时间水平方向隐喻的通道特异性

通过2个实验, 考察了感觉通道对盲人的时间水平方向隐喻的影响。实验1发现, 盲人只在动作水平上存在同阅读方向一致的时间水平方向隐喻, 对表征过去的词或句子按左键反应和对表征将来的词或句子按右键反应时更快, 表明盲人用于隐喻时间的空间信息是知觉性的。实验2比较了明眼人可视组被试和明眼人遮眼组被试的时间空间隐喻, 发现明眼人可视组被试只在动作水平上存在时间水平方向隐喻, 明眼人遮眼组被试只在刺激在右侧时呈现才出现动作水平的时间水平方向隐喻。综合分析表明, 盲人和明眼人可视组被试的反应更为接近, 表明盲人的时间空间隐喻未受听觉信息的影响。盲人通过运动通道获得的空间认知代偿了视觉通道信息的缺失。     

Does visual experience influence the spatial distribution of auditory attention?

Sighted individuals are less accurate and slower to localize sounds coming from the peripheral space than sounds coming from the frontal space. This specific bias in favour of the frontal auditory space seems reduced in early blind individuals, who are particularly better than sighted individuals at localizing sounds coming from the peripheral space. Currently, it is not clear to what extent this bias in the auditory space is a general phenomenon or if it applies only to spatial processing (i.e. sound localization). In our approach we compared the performance of early blind participants with that of sighted subjects during a frequency discrimination task with sounds originating either from frontal or peripheral locations. Results showed that early blind participants discriminated faster than sighted subjects both peripheral and frontal sounds. In addition, sighted subjects were faster at discriminating frontal sounds than peripheral ones, whereas early blind participants showed equal discrimination speed for frontal and peripheral sounds. We conclude that the spatial bias observed in sighted subjects reflects an unbalance in the spatial distribution of auditory attention resources that is induced by visual experience.     

Texture perception in sighted and blind observers

The purpose of the present study was to evaluate the utility of visual imagery for texture perception. In Experiment 1, sighted, early-blind, and late-blind observers made relative smoothness judgments of abrasive surfaces using active or passive tough. In Experiment 2, subjects compared vision and touch in the accuracy of smoothness detection, using a broad range of textures, including very fine surfaces. No differences appeared between the sighted and the blind, and it did not matter if touch were active or passive. Vision and touch showed similar performance with relatively coarse textures, but touch was superior to vision for much finer surface textures. The results were consistent with the notion that visual coding of tactual stimuli is not advantageous (or necessary) for texture perception, since touch may hold advantages for the detection of the smoothness of surfaces.     

Accuracy of judging time to arrival: effects of modality, trajectory, and gender

Observers' accuracy in using time-to-arrival (Ta) information was examined in 4 experiments. The issues included use of visual vs. acoustic Ta information, use of acoustic Ta information by blind Ss, use of Ta information controlling for velocity, and effects of angle of approach and arrival time on judgment accuracy. Visual information was used more efficiently than audiovisual and auditory information. Blind Ss used acoustical approach information as accurately as sighted Ss used visual information. Radial, oblique, and transverse orientations were used to examine effects of approach trajectory. Radial events were underestimated, whereas the more accurate transverse approach was likely to be overestimated. Oblique angle events yielded intermediate accuracies implying a spatiotemporal anisotropy. Women underestimated Ta more than did men. Possible reasons for Ss' judgment accuracy, including linear vs. nonlinear optical changes and relation to spatial skills and experience, were discussed.     

Semantic numerical representation in blind subjects: The role of vision in the spatial format of the mental number line

Does vision play a role in the elaboration of the semantic representation of small and large numerosities, notably in its spatial format? To investigate this issue, we decided to compare in the auditory modality the performance of congenitally and early blind people with that of a sighted control group, in two number comparison tasks (to 5 and to 55) and in one parity judgement task. Blind and sighted participants presented exactly the same distance and SNARC (Spatial Numerical Association of Response Codes) effects, indicating that they share the same semantic numerical representation. In consequence, our results suggest that the spatial dimension of the numerical representation is not necessarily attributable to the visual modality and that the absence of vision does not preclude the elaboration of this representation for 1-digit (Experiment 1) and 2-digit numerosities (Experiment 2). Moreover, as classical semantic numerical effects were observed in the auditory modality, the postulate of the amodal nature of the mental number line for both small and large magnitudes was reinforced.     

Semantic numerical representation in blind subjects: the role of vision in the spatial format of the mental number line

Does vision play a role in the elaboration of the semantic representation of small and large numerosities, notably in its spatial format? To investigate this issue, we decided to compare in the auditory modality the performance of congenitally and early blind people with that of a sighted control group, in two number comparison tasks (to 5 and to 55) and in one parity judgement task. Blind and sighted participants presented exactly the same distance and SNARC (Spatial Numerical Association of Response Codes) effects, indicating that they share the same semantic numerical representation. In consequence, our results suggest that the spatial dimension of the numerical representation is not necessarily attributable to the visual modality and that the absence of vision does not preclude the elaboration of this representation for 1-digit (Experiment 1) and 2-digit numerosities (Experiment 2). Moreover, as classical semantic numerical effects were observed in the auditory modality, the postulate of the amodal nature of the mental number line for both small and large magnitudes was reinforced.     

The role of haptic versus visual volume cues in the size-weight illusion

Three experiments establish the size-weight illusion as a primarily haptic phenomenon, despite its having been more traditionally considered an example of vision influencing haptic processing. Experiment 1 documents, across a broad range of stimulus weights and volumes, the existence of a purely haptic size-weight illusion, equal in strength to the traditional illusion. Experiment 2 demonstrates that haptic volume cues are both sufficient and necessary-for a full-strength illusion. In contrast, visual volume cues are merely sufficient, and produce a relatively weaker effect. Experiment 3 establishes that congenitally blind subjects experience an effect as powerful as that Of blindfolded sighted observers, thus demonstrating that visual imagery is also unnecessary for a robust size-weight illusion. The results are discussed in terms of their implications for both sensory and cognitive theories of the size-weight illusion. Applications of this work to a human factors design and to sensor-based systems for robotic manipulation are also briefly considered.     

Spatial perception in the blind.

It is often that the spatial senses (vision, hearing and the tactual senses) operate as distinct and independent modalities and, moreover, that vision is crucial to the development of spatial abilities. However, well controlled studies of blind persons with adequate experience show that they can function usefully in space. In other words, vision is not a necessary condition for spatial awareness. On the other hand, thought the blind may be equal or even superior to the sighted when performing spatial tasks within the body space, they may be deficient, either developmentally or absolutely, in tasks which involve events at a distance from the body, principally in auditory localization. One possible explanation of the differences between blind and sighted (McKinney, 1964; Attneave & Benson, 1969, Warren, 1970) is that vision is the primary spatial reference, and inputs from other modalities are fitted to a visual map. Several criticisms of this theory are adduced and an alternative theory derived from Sherrington (1947), in which all sensory inputs map on to efferent patterns, is sketched.     

Structural properties of spatial representations in blind people: Scanning images constructed from haptic exploration or from locomotion in a 3-D audio virtual environment

When people scan mental images, their response times increase linearly with increases in the distance to be scanned, which is generally taken as reflecting the fact that their internal representations incorporate the metric properties of the corresponding objects. In view of this finding, we investigated the structural properties of spatial mental images created from nonvisual sources in three groups (blindfolded sighted, late blind, and congenitally blind). In Experiment 1, blindfolded sighted and late blind participants created metrically accurate spatial representations of a small-scale spatial configuration under both verbal and haptic learning conditions. In Experiment 2, late and congenitally blind participants generated accurate spatial mental images after both verbal and locomotor learning of a full-scale navigable space (created by an immersive audio virtual reality system), whereas blindfolded sighted participants were selectively impaired in their ability to generate precise spatial representations from locomotor experience. These results attest that in the context of a permanent lack of sight, encoding spatial information on the basis of the most reliable currently functional system (the sensorimotor system) is crucial for building a metrically accurate representation of a spatial environment. The results also highlight the potential of spatialized audio-rendering technology for exploring the spatial representations of visually impaired participants.     

Spatial representation by blind and sighted children

Spatial representation by 72 blind and blindfolded sighted children between the ages of 6 and 11 was tested in two experiments by mental rotation of a raised line under conditions of clockwise varied directions.Experiment 1 showed that the two groups were well matched on tactual recognition and scored equally badly on matching displays to their own mentally rotated position.Experiment 2 found the sighted superior in recall tests. There was a highly significant interaction between sighted status and degree of rotation. Degree of rotation affected only the blind. Their scores were significantly lower for rotating to oblique and to the far orthogonal directions than to near orthogonal test positions. On near orthogonals the blind did not differ from the sighted.Age was a main effect, but it did not interact with any other variable. Older blind children whose visual experience dated from before the age of 6 were superior to congenitally blind subjects, but not differentially more so on oblique directions.The results were discussed in relation to hypotheses about the nature of spatial representation and strategies by children whose prior experience derived from vision or from touch and movement.     

Some Structural Variables in Auditory Projective Testing

This study explored perceived pleasantness of auditory projective stimuli as related to three aspects of the projective response; emotional tone, RT and length of stories. Thirty blind and 30 sighted males, comparable in age and intelligence, told stories in response to eight selected auditory stimuli and rated them for pleasantness. Emotional tone varied significantly with pleasantness for 5 out of 8 sounds. Pleasantness was not significantly related to story length nor to RT, except for the sound of weeping. Blind Ss told longer stories than the sighted. Apparent consistent individual differences in response to the auditory projective method were observed. This technique seems useful in the study of personality, perception and cognition of sighted and blind persons.     

Spatial knowledge in a young blind child

A set of eight experiments demonstrate spatial knowledge in a 2-year-old congenitally blind child and sighted blindfolded controls. Once the blind child had traveled along specific paths between objects in a novel array, she was able to make spatial inferences, finding new routes between those objects (Experiment 1). She could also do so when the routes were between places in space, not occupied by objects (Experiment II). Deviations from precisely straight routes in Experiments I and II were not due to faulty inferences, but probably came from imprecise motor control, since the same deviations occured when inferences were not required—when the child moved to a place designated by a sound source (Experiment III). This child's performances could not be accounted for by artifactual explanations: sound cues, experimenter bias, and echolocation were ruled out (Experiments IV, V, VI). Further, sighted blindfolded controls performed at roughly the same level (Experiment VII). Finally, Experiment VIII shows that the blind child could access her spatial knowledge for use in a simple map-reading task. We conclude that the young blind child has a system of spatial knowledge, including abstract, amodal rules     

Mechanisms in the haptic horizontal-vertical illusion: Evidence from sighted and blind subjects

The haptic horizontal-vertical illusion was studied in two experiments. In Experiment 1, the illusion was relatively weak in sighted subjects and depended on stimulus size and the nature of the figure, that is, whether the pattern was an inverted-T or L shape. Experiment 2 compared early blind and late blind subjects. The illusion was present for an inverted-T figure but absent for an L figure in late blind subjects. However, the early blind subjects treated both the L and T figures as similar and showed the illusion to both. These results support the idea that visual experience may alter haptic judgments in sighted and late blind subjects.     

Picture and pattern perception in the sighted and the blind: the advantage of the late blind

Two experiments are reported on the contribution of visual experience to tactile perception. In the first experiment, sighted, congenitally blind, and late blind individuals made tactual matches to tangible embossed shapes. In the second experiment, the same subjects attempted tactile identification of raised-line drawings. The three groups did not differ in the accuracy of shape matching, but both groups of blind subjects were much faster than the sighted. Late blind observers were far better than the sighted or congenitally blind at tactile picture identification. Four of the twelve pictures were correctly identified by most of the late blind subjects. The sighted and congenitally blind performed at comparable levels in picture naming. There was no evidence that visual experience alone aided the sighted in the tactile task under investigation, since they performed no better than did the early blind. The superiority of the late blind suggests that visual exposure to drawings and the rules of pictorial representation may help tactile picture identification when combined with a history of tactual experience.     

Individual differences in the capacity limitations of visuospatial short-term memory: Research on sighted and totally congenitally blind people

The study of visuospatial imagery processes in totally congenitally blind people makes it possible to understand the specific contribution of visual experience for imagery processes. We argue that blind people may have visuospatial imagery processes, but they suffer from some capacity limitations. Similar, although smaller, limitations and individual differences may be found in sighted people. Visuospatial imagery capacity was explored by asking people to follow an imaginary pathway through either two- or three-dimensional matrices of different complexity. The blind appear to use specific visuospatial processes in this task (Experiments 2 and 3), but they have difficulty with three-dimensional matrices; sighted people have no such difficulty with three-dimensional matrices (Experiment 1). On the other hand, when a three-dimensional pattern exceeded sighted capacity, the blind and sighted showed similar patterns of errors. Subsequent analyses suggested that both visuospatial processes and verbal mediation were used.