没听到？“听”到！——来自听觉表象神经机制研究的证据

近年来听觉表象开始得到关注,相关研究包括言语声音、音乐声音、环境声音的听觉表象三类。本文梳理了认知神经科学领域对上述三种听觉表象所激活的脑区研究,比较了听觉表象和听觉对应脑区的异同,并展望了听觉表象未来的研究方向。     

视觉经验缺失对盲人听觉词汇识别的影响

听觉词汇识别包含复杂的认知加工过程。视觉通道受阻的盲人在听觉词汇加工中具有一定听觉补偿优势; 但由于视觉经验的缺失, 盲人对一些视觉相关词(比如颜色词)的语义加工和理解比明眼人弱。未来的研究应对词汇的视觉相关性进行分类讨论; 对音、形、义等多层面及其神经生理机制进行深入探究, 发展符合盲人感知特点的听觉词汇加工模型; 并拓展不同年龄段的发展性研究。最终, 揭示视觉经验缺失对盲人听觉词汇识别影响机制的全貌。     

The use of averaged electroencephalic response techniques in the study of auditory processing related to speech and language

This paper reviews a number of studies done by the authors and others, who have utilized various averaged electroencephalic response (AER) techniques to study speech and language processing. Pertinent studies are described in detail. A relatively new AER technique, auditory brainstem responses (ABR), is described and its usefulness in studying auditory processing activity related to speech and language is outlined. In addition, a series of ABR studies, that have demonstrated significant male—female differences in ABR auditory processing abilities, is presented and the relevance of these data to already established differences in male—female language, hearing, and cognitive abilities is discussed.     

The language environment of the young infant: implications for early perceptual development

The purpose of this article is to review recent research on the young infant's use of voice-specific as well as voice-nonspecific auditory information during early language processing, to suggest a possible mechanism that biases the young infant towards this information, and to discuss potential implications of the early saliency of this information for later language development. Auditory preferences expressed by young infants are of interest because they demonstrate which properties of complex auditory events are effective in capturing the infant's attention. Moreover, the presence of such auditory preferences has led to speculations about their possible origins in both pre- and postnatal auditory experience. Research examining the role of early auditory experience in the formation of preferences is presented, along with a discussion of how the constrained nature of early auditory experience (particularly prenatal) may bias the young infant towards specific features of maternal as well as nonmaternal speech.     

Developmental trends in auditory processing can provide early predictions of language acquisition in young infants

Auditory processing capabilities at the subcortical level have been hypothesized to impact an individual's development of both language and reading abilities. The present study examined whether auditory processing capabilities relate to language development in healthy 9‐month‐old infants. Participants were 71 infants (31 boys and 40 girls) with both Auditory Brainstem Response (ABR) and language assessments. At 6 weeks and/or 9 months of age, the infants underwent ABR testing using both a standard hearing screening protocol with 30 dB clicks and a second protocol using click pairs separated by 8, 16, and 64‐ms intervals presented at 80 dB. We evaluated the effects of interval duration on ABR latency and amplitude elicited by the second click. At 9 months, language development was assessed via parent report on the Chinese Communicative Development Inventory ‐ Putonghua version (CCDI‐P). Wave V latency z‐scores of the 64‐ms condition at 6 weeks showed strong direct relationships with Wave V latency in the same condition at 9 months. More importantly, shorter Wave V latencies at 9 months showed strong relationships with the CCDI‐P composite consisting of phrases understood, gestures, and words produced. Likewise, infants who had greater decreases in Wave V latencies from 6 weeks to 9 months had higher CCDI‐P composite scores. Females had higher language development scores and shorter Wave V latencies at both ages than males. Interestingly, when the ABR Wave V latencies at both ages were taken into account, the direct effects of gender on language disappeared. In conclusion, these results support the importance of low‐level auditory processing capabilities for early language acquisition in a population of typically developing young infants. Moreover, the auditory brainstem response in this paradigm shows promise as an electrophysiological marker to predict individual differences in language development in young children.     

Grammatical language impairment and the specificity of cognitive domains: relations between auditory and language abilities

Grammatical-specific language impairment (G-SLI) in children, arguably, provides evidence for the existence of a specialised grammatical sub-system in the brain, necessary for normal language development. Some researchers challenge this, claiming that domain-general, low-level auditory deficits, particular to rapid processing, cause phonological deficits and thereby SLI. We investigate this possibility by testing the auditory discrimination abilities of G-SLI children for speech and non-speech sounds, at varying presentation rates, and controlling for the effects of age and language on performance. For non-speech formant transitions, 69% of the G-SLI children showed normal auditory processing, whereas for the same acoustic information in speech, only 31% did so. For rapidly presented tones, 46% of the G-SLI children performed normally. Auditory performance with speech and non-speech sounds differentiated the G-SLI children from their age-matched controls, whereas speed of processing did not. The G-SLI children evinced no relationship between their auditory and phonological/grammatical abilities. We found no consistent evidence that a deficit in processing rapid acoustic information causes or maintains G-SLI. The findings, from at least those G-SLI children who do not exhibit any auditory deficits, provide further evidence supporting the existence of a primary domain-specific deficit underlying G-SLI.     

脑干诱发电位在言语感知研究中的应用

脑干诱发电位是一种考察听觉脑干加工声音信号时神经活动的非侵入性技术, 近年来被广泛用于探索言语感知的神经基础。相关研究主要集中在考察成年人和正常发展儿童语音编码时脑干的活动特征及发展模式, 探讨发展性阅读障碍及其他语言损伤的语音编码缺陷及其神经表现等方面。在已有研究的基础上进一步探索初级语音编码和高级言语加工之间的相互作用机制, 考察阅读障碍的底层神经基础将成为未来该技术在言语感知研究中应用的重点。     

Shedding light on words and sentences: near-infrared spectroscopy in language research

Investigating the neuronal network underlying language processing may contribute to a better understanding of how the brain masters this complex cognitive function with surprising ease and how language is acquired at a fast pace in infancy. Modern neuroimaging methods permit to visualize the evolvement and the function of the language network. The present paper focuses on a specific methodology, functional near-infrared spectroscopy (fNIRS), providing an overview over studies on auditory language processing and acquisition. The methodology detects oxygenation changes elicited by functional activation of the cerebral cortex. The main advantages for research on auditory language processing and its development during infancy are an undemanding application, the lack of instrumental noise, and its potential to simultaneously register electrophysiological responses. Also it constitutes an innovative approach for studying developmental issues in infants and children. The review will focus on studies on word and sentence processing including research in infants and adults.     

早期听觉剥夺后的大脑可塑性：来自先天性听力障碍群体的证据

皮层功能的正常发展依赖于充分的外部感觉信息的输入。先天性听力障碍群体由于经历早期听觉剥夺, 皮层功能往往出现异常。具体表现为初级听皮层功能退化, 初级、次级听皮层的功能连接变弱, 次级听皮层出现跨通道功能重组; 在后天听力重建后听皮层功能重组仍然存在, 言语加工需要更多高级认知资源的补偿。已有研究在探讨听力重建后皮层的长期可塑性机制、复杂声学环境下言语加工机制、汉语言加工独特性等方面尚不深入, 值得进一步研究。     

Auditory speed tasks as potential candidates for the study of cognitive ageing

Speed of information processing is an important cognitive ability. It facilitates the efficient operation of higher order cognitive functions, such as reasoning, and is implicated in various models of cognitive decline. The present study considers the potential benefits of expanding the measurement of processing speed to include the auditory modality. It examines the reliability and factorial structure of a variety of auditory and visual speed tasks in a sample of N = 138 older adults aged between 51 and 82 years. Our findings demonstrate that auditory measures can be used to assess processing speed as indexed by existing widely used tests of this ability. Moreover, the inclusion of auditory tasks significantly increases the relationship between processing speed and general cognitive ability. This novel research provides strong evidence of the suitability of auditory speed tasks for the study of cognitive function in older people, and demonstrates the importance of expanding cognitive measurement to include alternate modalities.     

Estimating group size from human speech: Three's a conversation,but four's a crowd

Much previous research has examined various aspects of auditory processing, including the localization of sounds, and the influence of lexical and indexical information on language processing. In the present set of experiments we explored the ability of listeners to estimate the number of speakers in a group solely from the information in an auditory signal. The bound on accurately estimating the number of simultaneous speakers is 3. We suggest that subitization—the ability to estimate numerosity of visual and auditory elements without explicitly counting these elements—rather than the capacity of short-term memory, may underlie this limitation. The cognitive constraint on estimating the number of simultaneous speakers may have implications for a wide variety of seemingly unrelated psychological phenomena.     

汉语听觉阈下启动效应：来自听觉掩蔽启动范式的证据

使用汉语双字词为实验材料,采用听觉掩蔽启动范式,通过3个实验考察汉语听觉阈下启动效应。结果发现,真词的听觉阈下重复启动效应显著,并且听觉阈下重复启动效应不受启动、目标发音者性别一致性的影响。但真词的阈下语音、语素和语义启动效应及假词的阈下重复和首字启动效应都不显著。这些结果说明,听觉通道阈下呈现的汉语双字词的词汇水平信息可以得到无意识加工。汉语双字词的听觉阈下启动效应可能是基于启动词整词表征的无意识激活。     

大脑电刺激在听觉语言加工研究中的应用

大脑电刺激是历史悠久但近年来才广泛应用在人类被试上的实验技术。通过对颅内刺激位点进行电刺激, 并分析引发的暂时性行为功能变化和记录位点的电位活动, 大脑电刺激技术可以揭示认知加工过程中脑区内的功能作用与脑区间的有效连接。通过对听觉语言加工过程相关的丘脑、听觉皮层、高级语言皮层进行电刺激, 现有研究发现了各个脑区的不同功能特点以及不同脑区间的信息传递机制, 为进一步探索听觉语言加工的神经机制提供了新的视角。     

Oral language deficits in dyslexic children: weaknesses in working memory and verbal planning

This paper focuses on the relationships among language processing (word- and sentence-level), working memory, and verbal/nonverbal linguistic output. The study examined oral language abilities in a group of 26 French-speaking dyslexic children, compared to two control groups (26 normally developing age-matched children and 26 normally developing younger children). The experimental procedure consisted of tasks involving auditory memory skills (digit span, unfamiliar word repetition, sentence repetition), word retrieval (with semantic, phonological and grammatical criteria), and sentence processing (with verbal and act-out production). The major findings reveal that (a) compared with their age-mates, the dyslexic children exhibited a significant deficit affecting all tasks; and (b) the dyslexic children and the younger controls performed similarly on several tasks. The results are consistent with the processing limitation hypothesis and suggest that the core deficit is the formulation of cognitive plans from auditory input to verbal output.     

Working memory, deafness and sign language

Working memory (WM) for sign language has an architecture similar to that for speech-based languages at both functional and neural levels. However, there are some processing differences between language modalities that are not yet fully explained, although a number of hypotheses have been mooted. This article reviews some of the literature on differences in sensory, perceptual and cognitive processing systems induced by auditory deprivation and sign language use and discusses how these differences may contribute to differences in WM architecture for signed and speech-based languages. In conclusion, it is suggested that left-hemisphere reorganization of the motion-processing system as a result of native sign-language use may interfere with the development of the order processing system in WM.     

Working memory interference during processing texts and pictures: Implications for the explanation of the modality effect

Auditory text presentation improves learning with pictures and texts. With sequential text–picture presentation, cognitive models of multimedia learning explain this modality effect in terms of greater visuo‐spatial working memory load with visual as compared to auditory texts. Visual texts are assumed to demand the same working memory subsystem as pictures, while auditory texts make use of an additional cognitive resource. We provide two alternative assumptions that relate to more basic processes: First, acoustic‐sensory information causes a retention advantage for auditory over visual texts which occurs no matter if a picture is presented or not. Second, eye movements during reading hamper visuo‐spatial rehearsal. Two experiments applying elementary procedures provide first evidence for these assumptions. Experiment 1 demonstrates that, regarding text recall, the auditory advantage is independent of visuo‐spatial working memory load. Experiment 2 reveals worse matrix recognition performance after reading text requiring eye movements than after listening or reading without eye movements. Copyright © 2008 John Wiley & Sons, Ltd.     

Auditory access,language access,and implicit sequence learning in deaf children

Developmental psychology plays a central role in shaping evidence‐based best practices for prelingually deaf children. The Auditory Scaffolding Hypothesis (Conway et al., 2009) asserts that a lack of auditory stimulation in deaf children leads to impoverished implicit sequence learning abilities, measured via an artificial grammar learning (AGL) task. However, prior research is confounded by a lack of both auditory and language input. The current study examines implicit learning in deaf children who were (Deaf native signers) or were not (oral cochlear implant users) exposed to language from birth, and in hearing children, using both AGL and Serial Reaction Time (SRT) tasks. Neither deaf nor hearing children across the three groups show evidence of implicit learning on the AGL task, but all three groups show robust implicit learning on the SRT task. These findings argue against the Auditory Scaffolding Hypothesis, and suggest that implicit sequence learning may be resilient to both auditory and language deprivation, within the tested limits. A video abstract of this article can be viewed at: https://youtu.be/EeqfQqlVHLI [Correction added on 07 August 2017, after first online publication: The video abstract link was added.]     

Bilingual enhancements have no socioeconomic boundaries

To understand how socioeconomic status (SES) and bilingualism simultaneously operate on cognitive and sensory function, we examined executive control, language skills, and neural processing of sound in adolescents who differed in language experience (i.e. English monolingual or Spanish‐English bilingual) and level of maternal education (a proxy for SES). We hypothesized that experience communicating in two languages provides an enriched linguistic environment that can bolster neural precision in subcortical auditory processing which, in turn, enhances cognitive and linguistic function, regardless of the adolescent's socioeconomic standing. Consistent with this, we report that adolescent bilinguals of both low and high SES demonstrate more stable neural responses, stronger phonemic decoding skills, and heightened executive control, relative to their monolingual peers. These results support the argument that bilingualism can bolster cognitive and neural function in low‐SES children and suggest that strengthened neural response consistency provides a biological mechanism through which these enhancements occur.     

Children's auditory and visual processing of narrated and nonnarrated television programming

Two experiments with 5- and 7-year-old children tested the hypotheses that auditory attention is used to (a) monitor a TV program for important visual content, and (b) semantically process program information through language to enhance comprehension and visual attention. A direct measure of auditory attention was the latency of the child's restoration of gradually degraded sound quality. Restoration of auditory clarity did not vary as a function of looking. Restoration of visual clarity was faster when looking than when not looking. Restoration was faster for visual than auditory degrades, but audiovisual degrades were restored most rapidly of all, suggesting that dual modality presentation maximizes children's attention. Narration enhanced visual attention and comprehension including comprehension of visually presented material. Auditory comprehension did not depend on looking, suggesting that children can semantically process verbal content without looking at the TV. Auditory attention did not differ with the presence or absence of narration, but did predict auditory comprehension best while visual attention predicted visual comprehension best. In the absence of narration, auditory attention predicted visual comprehension, suggesting its monitoring function. Visual attention indexed overall interest and appeared to be most critical for comprehension in the absence of narration.     

Auditory distractor processing in sequential selection tasks

In this review, we analyze the cognitive processes contributing to selection in audition. In particular, we focus on the processing of auditory distractors in sequential selection paradigms in which target stimuli are accompanied by distractors. We review the evidence from two established tasks, namely the auditory negative priming and the auditory distractor–response binding task, and discuss the cognitive mechanisms contributing to the results typically observed in these tasks. In fact, several processes have been suggested as to explain how distractors are processed and handled in audition; that is, auditory distractors can be inhibited, encoded with a do-not-respond-tag, integrated into a stimulus–response episode containing the response to the target, or upheld in working memory and matched/mismatched with the following distractor. In addition, variables possibly modulating these cognitive processes are discussed. Finally, auditory distractor processing is compared with distractor processing in vision.