触觉、听觉、视觉发展与学习

对盲人的研究表明,在失去视觉以后,只要我们把感觉学习训练的重点放在个别化的基础上,就能使盲人比较容易适应于使用其它感觉。在我们理解视觉缺陷儿童在认知学习方面的特殊问题之前,我们必须首先理解有关感觉学习的两个基本概念。不论接受信息通道的类型,分辨(dis-crimination)这一术语是指对味觉、嗅觉、听觉、触觉、视觉刺激的异同进行辨别的能力。而识别(recognition)是指感觉到的信息在以前就早已认识过的,这就意味着某个人能对某一刺激的物体加     

视听跨通道信息的整合与冲突控制

多通道信息交互是指来自某个感觉通道的信息与另一感觉通道的信息相互作用、相互影响的一系列加工过程。主要包括两个方面：一是不同感觉通道的输入如何整合;二是跨通道信息的冲突控制。本文综述了视听跨通道信息整合与冲突控制的行为心理机制和神经机制,探讨了注意对视听信息整合与冲突控制的影响。未来需探究视听跨通道信息加工的脑网络机制,考察特殊群体的跨通道整合和冲突控制以帮助揭示其认知和社会功能障碍的机制。     

盲人的时间水平方向隐喻的通道特异性

通过2个实验, 考察了感觉通道对盲人的时间水平方向隐喻的影响。实验1发现, 盲人只在动作水平上存在同阅读方向一致的时间水平方向隐喻, 对表征过去的词或句子按左键反应和对表征将来的词或句子按右键反应时更快, 表明盲人用于隐喻时间的空间信息是知觉性的。实验2比较了明眼人可视组被试和明眼人遮眼组被试的时间空间隐喻, 发现明眼人可视组被试只在动作水平上存在时间水平方向隐喻, 明眼人遮眼组被试只在刺激在右侧时呈现才出现动作水平的时间水平方向隐喻。综合分析表明, 盲人和明眼人可视组被试的反应更为接近, 表明盲人的时间空间隐喻未受听觉信息的影响。盲人通过运动通道获得的空间认知代偿了视觉通道信息的缺失。     

保留的跨通道启动与老化：对于近期观点的总结

通道内重复启动的研究提示老年人内隐记忆未受损, 这不只体现在视觉通道上还包括其他感觉通道(例如触觉、听觉和嗅觉)。然而很少有研究考察启动任务是否具有通道特异性。在以年轻人为被试的研究中发现跨通道迁移(视觉到触觉和触觉到视觉)和通道内迁移(视觉到视觉, 触觉到触觉)具有相似性。一项最近的研究进一步探索老年人在跨通道启动任务上是否受损。结果显示视觉和触觉间的跨通道启动在年轻被试和老年被试上都是保留的且具有对称性。并且, 对于自然声响、图片的通道内和跨通道启动任务随着年老化发展仍旧保留。这些行为结果和其它最近神经科学结果显示跨通道启动发生于枕叶后纹状皮层区, 而这一区域在老年人中未损坏。这一领域未来的研究方向包括利用不同知觉通道间、利用熟悉的和新异的刺激并结合行为的和脑成像的方法, 通过设计完善的跨通道启动来研究正常老人与阿尔兹海默病人, 还包括将设计得完善的启动任务包括在用于改善老年人记忆功能的项目中。     

视觉经验缺失对盲人听觉词汇识别的影响

听觉词汇识别包含复杂的认知加工过程。视觉通道受阻的盲人在听觉词汇加工中具有一定听觉补偿优势; 但由于视觉经验的缺失, 盲人对一些视觉相关词(比如颜色词)的语义加工和理解比明眼人弱。未来的研究应对词汇的视觉相关性进行分类讨论; 对音、形、义等多层面及其神经生理机制进行深入探究, 发展符合盲人感知特点的听觉词汇加工模型; 并拓展不同年龄段的发展性研究。最终, 揭示视觉经验缺失对盲人听觉词汇识别影响机制的全貌。     

人类嗓音加工的神经机制——来自正常视力者和盲人的脑神经证据

人类嗓音作为听觉环境的重要组成部分, 包含了大量副语言信息以帮助识别个体身份, 尤其对于盲人而言, 视觉面孔经验的缺乏使得嗓音信息成为其感知对方个体特征的主要来源。通过结合正常视力者和盲人在嗓音选择性加工和嗓音身份加工方面的研究, 尝试揭示普遍的人类嗓音加工模式以及盲人特异的嗓音加工机制。此外, 与视觉面孔加工相关的梭状回脑区也参与并卷入了两类人群的嗓音加工任务, 以此为基础梳理的视听整合模型和基于去掩蔽效应的跨模态重组假说, 为这两类人群嗓音加工神经基础的差异性提供了相应的解释机制, 未来研究希望可以进一步探究盲人的嗓音加工策略, 以及考察左侧颞上沟/回脑区在嗓音加工中的作用。     

早期视听整合加工——来自MMN的证据

视听整合是指当呈现的视觉和听觉信号在时间、空间上大致接近时,视觉和听觉系统倾向于整合的加工过程。失匹配负波(Mismatch Negativity,MMN)作为反映大脑早期加工的成分,表征偏差的信息输入与感觉记忆痕迹之间的神经失匹配。以MMN作为探测指标的视听整合加工研究,主要包括MMN在阅读理解中字母和语音、韵律信息、麦格克效应等方面的视听整合加工,以及分析跨通道视听整合相互竞争、相互补充的关系。未来研究需聚焦于其他通道的跨通道整合加工,同时应拓展MMN的诱发范式。     

先天视觉经验缺失对颜色认知的影响：一项ERP研究

感觉与认知是否是相互独立的？本研究通过对比先天盲被试与明眼被试在进行物体颜色判断时的行为反应和神经电生理信号变化,探讨视觉经验缺失对颜色认知的影响。结果发现,先天盲被试具有一定的颜色知识,但其水平低于明眼被试;两组被试都出现了由颜色不匹配所诱发的N400效应,且都表现出左半球优势;但是盲人组的N400效应大于明眼组,盲人组的N400反应潜伏期小于明眼组。该结果说明,直接的视觉经验是颜色认知的充分条件而非必要条件。     

不同感觉功能对抑郁的影响及其神经机制

大脑通过视觉、听觉、嗅觉、味觉和触觉等感官通道接收来自外界的信息。不同感觉功能受损涉及抑郁发生的中枢机制,而基于不同感官通道进行适当刺激以及多感官联合干预也可能发挥显著的抑郁治疗作用。笔者以症状-脑区-机制-治疗为逻辑主线,首次系统梳理了五种主要感觉障碍人群的抑郁临床症状、抑郁神经机制以及基于感觉刺激的抗抑郁治疗。结果表明,不同感觉功能障碍对抑郁相关神经机制的影响可能表征了不同的抑郁病理,涉及神经元电活动(某些神经元放电和神经环路激活等)和神经生化改变(神经可塑性和神经发生、炎症免疫和HPA轴、神经激素和神经递质等),且主要发生在边缘系统及其附近脑区,涉及岛叶、颞叶、额叶等。因此,未来研究可聚焦于机体对不同感觉信息的提取,这将为人类抑郁的病因和治疗提供新的研究视角。     

不同感觉通道在应激传染中的作用及其神经机制

应激传染是指个体在观察或接触到另一个处于急性应激状态下的个体时,不自觉地受到对方负面情绪的影响,在生理与心理上将自己的状态与对方匹配。应激传染的实验范式分为替代应激与交叉应激两种类型。在替代应激范式中,观察者通过隔板观察,接受来自示范者单一或多个感觉通道传递的应激信息。在交叉应激中,观察者在示范者受到应激之后直接与示范者接触,通过多种感觉通道接受示范者传递的应激信息。不同感觉信息引发应激传染的行为反应具有相似性,都伴随自主活动减少、焦虑行为增加以及皮质醇水平升高,其背后的神经环路与关键脑区并不完全一致。相比单一感觉通道(视觉、听觉与嗅觉),多感觉通道引发的应激传染效应更强。杏仁核是应激传染的热点脑区,在不同的应激传染实验范式中均观察到显著激活。未来的研究需要在重视应激传染实验范式的基础上,根据不同感觉通道影响应激传染的神经机制确定研究需要关注的脑区。     

Comparisons of memory for nonverbal auditory and visual sequential stimuli

Properties of auditory and visual sensory memory were compared by examining subjects' recognition performance of randomly generated binary auditory sequential frequency patterns and binary visual sequential color patterns within a forced-choice paradigm. Experiment 1 demonstrated serial-position effects in auditory and visual modalities consisting of both primacy and recency effects. Experiment 2 found that retention of auditory and visual information was remarkably similar when assessed across a 10 s interval. Experiments 3 and 4, taken together, showed that the recency effect in sensory memory is affected more by the type of response required (recognition vs. reproduction) than by the sensory modality employed. These studies suggest that auditory and visual sensory memory stores for nonverbal stimuli share similar properties with respect to serial-position effects and persistence over time.     

Out of sight,out of mind? Relations between visual acuity and cognition

Prior research has established significant relations between measures of sensory ability and cognitive function in adults of different ages, and several explanations for this relation have been proposed. One explanation is that sensory abilities restrict cognitive processing, a second is that cognitive abilities influence assessments of sensory ability, and a third is that both sensory function and cognition are affected by a common, potentially age-based, third factor. These explanations were investigated using mediation and moderation analyses, with near visual acuity as the sensory measure and scores on visual speed tests and auditory memory tests as the cognitive measures. Measures of visual acuity, speed, and memory were obtained from three moderately large samples, two cross-sectional (N?=?380, N?=?4,779) and one longitudinal (N?=?2,258), with participants ranging from 18 to 90 years of age. The visual acuity and cognitive measures had different age trajectories, and the visual acuity–cognition relations were similar in each 5-year age band. The results suggest that the age-related differences and changes in near visual acuity are unlikely to contribute to the age-related differences and changes in speed and memory measures.     

Roughness perception of unfamiliar dot pattern textures

Both vision and touch yield comparable results in terms of roughness estimation of familiar textures as was shown in earlier studies. To our knowledge, no research has been conducted on the effect of sensory familiarity with the stimulus material on roughness estimation of unfamiliar textures.The influence of sensory modality and familiarity on roughness perception of dot pattern textures was investigated in a series of five experiments. Participants estimated the roughness of textures varying in mean center-to-center dot spacing in experimental conditions providing visual, haptic and visual–haptic combined information.The findings indicate that roughness perception of unfamiliar dot pattern textures is well described by a bi-exponential function of inter-dot spacing, regardless of the sensory modality used. However, sensory modality appears to affect the maximum of the psychophysical roughness function, with visually perceived roughness peaking for a smaller inter-dot spacing than haptic roughness. We propose that this might be due to the better spatial acuity of the visual modality. Individuals appeared to use different visual roughness estimation strategies depending on their first sensory experience (visual vs. haptic) with the stimulus material, primarily in an experimental context which required the combination of visual and haptic information in a single bimodal roughness estimate. Furthermore, the similarity of findings in experimental settings using real and virtual visual textures indicates the suitability of the experimental setup for neuroimaging studies, creating a more direct link between behavioral and neuroimaging results.     

Visual dominance and attention: the Colavita effect revisited

Under many conditions, humans display a robust tendency to rely more on visual information than on other forms of sensory information. Colavita (1974) illustrated this visual dominance effect by showing that naive observers typically fail to respond to clearly suprathreshold tones if these are presented simultaneously with a visual target flash. In the present study, we demonstrate that visual dominance influences performance under more complex stimulation conditions and address the role played by attention in mediating this effect. In Experiment 1, we show the Colavita effect in the simple speeded detection of line drawings and naturalistic sounds, whereas in Experiment 2 we demonstrate visual dominance when the task targets (auditory, visual, or bimodal combinations) are embedded among continuous streams of irrelevant distractors. In Experiments 3-5, we address the consequences of varying the probability of occurrence of targets in each sensory modality. In Experiment 6, we further investigate the role played by attention on visual dominance by manipulating perceptual load in either the visual or the auditory modality. Our results demonstrate that selective attention to a particular sensory modality can modulate--although not completely reverse--visual dominance as illustrated by the Colavita effect.     

感觉记忆中含语义对象的视觉表征

感觉记忆能够以特征形式构建对视觉对象表面信息的表征, 然而对于具有重要意义的潜在抽象信息, 尚未有研究考察其是否影响感觉记忆的视觉表征。结合掩蔽技术与部分报告法范式考察了感觉记忆的视觉表征中是否包含语义信息。以阿拉伯数字作为目标, 实验1与实验2分别采用正立与倒置的汉字大写数字作为掩蔽刺激, 比较其与白噪音刺激的掩蔽效应。结果显示, 汉字大写数字的掩蔽效应均强于白噪音刺激, 且正立汉字大写数字的掩蔽效果较倒置汉字大写数字更强。实验3采用汉字大写数字与汉字常用字分别作为掩蔽刺激, 结果显示汉字大写数字的掩蔽效果强于汉字常用字。上述结果显示, 刺激间的语义相似性带来了视觉表征冲突, 表明感觉记忆的视觉表征中包含了刺激的语义信息。     

Enhanced prenatal auditory experience facilitates species-specific visual responsiveness in bobwhite quail chicks (Colinus virginianus)

Premature stimulation of a later developing sensory system is known to impact the functioning of earlier developing sensory systems. For example, exposure to premature (prenatal) visual experience results in a decline in species-typical auditory responsiveness in several precocial bird species. The present study examined the influence of experiential enhancement of an earlier developing sensory system on a later developing modality. Specifically, the influence of enhanced prenatal auditory stimulation on subsequent postnatal auditory and visual functioning of bobwhite quail (Colinus virginianus) chicks was assessed. Results indicate that birds receiving exposure to increased amounts of unaltered, species-typical embryonic vocalizations before hatching show species-typical auditory responsiveness at both 12 hr and 24 hr after hatching, but exhibit an accelerated pattern of species-typical visual responsiveness by 24 hr of age. These findings suggest that enhancement of an earlier developing sensory system can facilitate the development of a later developing sensory system and serve to demonstrate the dynamic nature of early perceptual organization.     

Perceptual load influences auditory space perception in the ventriloquist aftereffect

A period of exposure to trains of simultaneous but spatially offset auditory and visual stimuli can induce a temporary shift in the perception of sound location. This phenomenon, known as the ‘ventriloquist aftereffect’, reflects a realignment of auditory and visual spatial representations such that they approach perceptual alignment despite their physical spatial discordance. Such dynamic changes to sensory representations are likely to underlie the brain’s ability to accommodate inter-sensory discordance produced by sensory errors (particularly in sound localization) and variability in sensory transduction. It is currently unknown, however, whether these plastic changes induced by adaptation to spatially disparate inputs occurs automatically or whether they are dependent on selectively attending to the visual or auditory stimuli. Here, we demonstrate that robust auditory spatial aftereffects can be induced even in the presence of a competing visual stimulus. Importantly, we found that when attention is directed to the competing stimuli, the pattern of aftereffects is altered. These results indicate that attention can modulate the ventriloquist aftereffect.     

Vertical-horizontal illusion present for sighted but not early blind humans using auditory substitution of vision

This experiment was undertaken to investigate the effect of sensory modality (vision vs. audition) and of visual status (early blind vs. sighted) on susceptibility to the vertical-horizontal illusion. Early blind volunteers and blindfolded sighted subjects explored variants of the vertical-horizontal illusion using a device that substituted audition for vision, whereas sighted subjects from an independent group inspected the same stimuli visually. Sensitivity to the vertical-horizontal illusion, including an illusion of moderate strength when using the sensory substitution device, was observed only in the two sighted groups. The existence of an illusion effect when using such a device supports the idea of a visual perception provided by sensory substitution, whereas the attenuation of the vertical-horizontal illusion strength is consistent with the visual field shape theory (Künnapas, 1955a). The absence of the illusion effect in early blind subjects suggests that the sensory experience influences the nature of perception and that the visual experience plays a crucial role in the vertical-horizontal illusion, in accordance with the size-constancy scaling theory (Gregory, 1963).     

Use of visual, acoustic, and olfactory information during embedded invertebrate foraging in brown capuchins (Cebus apella)

Experiments were conducted to investigate which sensory cues are used by brown capuchins (Cebus apella) in embedded invertebrate foraging. The importance of visual, olfactory, and acoustic cues in such foraging was determined by presenting subjects with a stimulus log modified to block out given sensory cues. Experiment 1 was designed to investigate whether subjects could locate an invertebrate embedded in wood when only visual, acoustic, or olfactory information was available. Experiments 2 and 3 were designed to investigate extractive foraging behavior when two sensory cues were provided. It was hypothesized that the combination of visual and acoustic information would be necessary for subjects to successfully locate embedded invertebrates. Results indicated that subjects' performance was most successful when both visual and acoustic information was available.     

Sensory substitution: an approach to the experimental study of perception / Sustitución sensorial: un abordaje para el estudio experimental de la percepción

Abstract

Sensory substitution refers to the phenomenon where object and environment information normally acquired through one sense can be obtained by another sense. For example, visual input being provided by hearing or touching. Sensory substitution devices are technological designs that transform the characteristics of one sensory modality into stimuli of another sensory modality. These devices were developed with two purposes: (1) to assist people with sensory disabilities in daily tasks; and (2) to study the involved mechanisms of brain plasticity. This article reviews studies in which sensory substitution phenomenon is employed as a methodological strategy to study visual perception. Furthermore, its use is discussed as an experimental platform to contrast new perceptual theories and underlying neurophysiological mechanisms that are currently under review.