Beneficial effects of a music listening intervention on neural speech processing in 0–28-month-old children at risk for dyslexia

Familial risk for developmental dyslexia can compromise auditory and speech processing and subsequent language and literacy development. According to the phonological deficit theory, supporting phonological development during the sensitive infancy period could prevent or ameliorate future dyslexic symptoms. Music is an established method for supporting auditory and speech processing and even language and literacy, but no previous studies have investigated its benefits for infants at risk for developmental language and reading disorders. We pseudo-randomized N∼150 infants at risk for dyslexia to vocal or instrumental music listening interventions at 0–6 months, or to a no-intervention control group. Music listening was used as an easy-to-administer, cost-effective intervention in early infancy. Mismatch responses (MMRs) elicited by speech-sound changes were recorded with electroencephalogram (EEG) before (at birth) and after (at 6 months) the intervention and at a 28 months follow-up. We expected particularly the vocal intervention to promote phonological development, evidenced by enhanced speech-sound MMRs and their fast maturation. We found enhanced positive MMR amplitudes in the vocal music listening intervention group after but not prior to the intervention. Other music activities reported by parents did not differ between the three groups, indicating that the group effects were attributable to the intervention. The results speak for the use of vocal music in early infancy to support speech processing and subsequent language development in infants at developmental risk.

Research Highlights

• Dyslexia-risk infants were pseudo-randomly assigned to a vocal or instrumental music listening intervention at home from birth to 6 months of age.
• Neural mismatch responses (MMRs) to speech-sound changes were enhanced in the vocal music intervention group after but not prior to the intervention.
• Even passive vocal music listening in early infancy can support phonological development known to be deficient in dyslexia-risk.

     

婴儿对语音和非语音的感知:认知和神经机制

婴儿听觉感知能力的发展对于他们未来的语言学习和社会化都具有重要意义。过去大量的研究主要关注语音感知方面,只有较少的研究将非语音感知纳入考虑之中,但了解非语音感知的特征和机制将有助于增加研究者对听觉加工以及儿童发育的认识。该文分别介绍了婴儿语音感知中的三种偏好——对语音、“婴儿语”和母语的偏好,并尝试着将非语音分为音乐、人类的非言语发声、环境声音三类进行阐述。通过对比这两大类声音的感知得到婴儿可能存在语音感知的左脑偏侧化和音乐感知的右脑偏侧化现象,但这也尚存争议,目前有特定领域模型、特定线索模型和脑网络模型三种理论对偏侧化现象的认知机制进行解释。     

Rhythmic structure facilitates learning from auditory input in newborn infants

Rhythm and metrical regularities are fundamental properties of music and poetry - and all of those are used in the interaction between infants and their parents. Music and rhythm perception have been shown to support auditory and language skills. Here we compare newborn infants’ learning from a song, a nursery rhyme, and normal speech for the first time in the same study. Infants’ electrophysiological brain responses revealed that the nursery rhyme condition facilitated learning from auditory input, and thus led to successful detection of deviations. These findings suggest that coincidence of prosodic cue patterns and to-be-learned items is more important than the format of the input. Overall, the present results support the view that rhythm is likely to create a template for future events, which allows auditory system to predict prospective input and thus facilitates language development.     

Behavioral assessment of auditory processing deficits in schizophrenia: Literature review and suggestions for future research

During the last decades, a considerable number of studies about auditory processing deficits in schizophrenia have been published, some of them using the term of Auditory Processing Disorder (APD). Due to heterogeneous methodology and inconsistent results concrete conclusions may not be straightforward. We focused on studies that used at least one behavioral test for the assessment of auditory processing in schizophrenia, in order to identify new evidence on auditory processing deficits in schizophrenia, and to consider fields for future research. 28 studies met inclusion criteria and are presented in this review. The articles were divided into three groups, those that implemented a test battery approach, those that used only Dichotic Listening (DL), those that used DL along with imaging or electrophysiology techniques. Most of the studies that implemented a test battery showed significant performance differences between patients and controls. This indicates APD presence. Due to the limited number of studies implementing a test battery, this is not conclusive. The majority of all studies that used a DL task showed that patients' performance or laterality was significantly lower than that of controls. Age, duration of illness, total and specific positive symptoms seem to affect significantly DL performance and auditory laterality. The results support the existence of various schizophrenia subgroups that differ in their auditory processing performance, and also have structural and functional specificities. Further research in the field is needed, especially studies that implement a test battery, and studies that examine possible correlations between clinical variables and auditory processing deficits.     

Dual language use in sign-speech bimodal bilinguals: fNIRS brain-imaging evidence

The brain basis of bilinguals’ ability to use two languages at the same time has been a hotly debated topic. On the one hand, behavioral research has suggested that bilingual dual language use involves complex and highly principled linguistic processes. On the other hand, brain-imaging research has revealed that bilingual language switching involves neural activations in brain areas dedicated to general executive functions not specific to language processing, such as general task maintenance. Here we address the involvement of language-specific versus cognitive-general brain mechanisms for bilingual language processing. We study a unique population, bimodal bilinguals proficient in signed and spoken languages, and we use an innovative brain-imaging technology, functional Near-Infrared Spectroscopy (fNIRS; Hitachi ETG-4000). Like fMRI, the fNIRS technology measures hemodynamic change, but it is also advanced in permitting movement for unconstrained speech and sign production. Participant groups included (i) hearing ASL–English bilinguals, (ii) ASL monolinguals, and (iii) English monolinguals. Imaging tasks included picture naming in “Monolingual mode” (using one language at a time) and in “Bilingual mode” (using both languages either simultaneously or in rapid alternation). Behavioral results revealed that accuracy was similar among groups and conditions. By contrast, neuroimaging results revealed that bilinguals in Bilingual mode showed greater signal intensity within posterior temporal regions (“Wernicke’s area”) than in Monolingual mode. Significance: Bilinguals’ ability to use two languages effortlessly and without confusion involves the use of language-specific posterior temporal brain regions. This research with both fNIRS and bimodal bilinguals sheds new light on the extent and variability of brain tissue that underlies language processing, and addresses the tantalizing questions of how language modality, sign and speech, impact language representation in the 7brain.     

Eighteen-month-olds integrate verbal cues into their action processing: Evidence from ERPs and mu power

Behavioral research has shown that infants use both behavioral cues and verbal cues when processing the goals of others’ actions. For instance, 18-month-olds selectively imitate an observed goal-directed action depending on its (in)congruence with a model’s previous verbal announcement of a desired action goal. This EEG-study analyzed the electrophysiological underpinnings of these behavioral findings on the two functional levels of conceptual action processing and motor activation. Mid-latency mean negative ERP amplitude and mu-frequency band power were analyzed while 18-month-olds (N = 38) watched videos of an adult who performed one out of two potential actions on a novel object. In a within-subjects design, the action demonstration was preceded by either a congruent or an incongruent verbally announced action goal (e.g., “up” or “down” and upward movement). Overall, ERP negativity did not differ between conditions, but a closer inspection revealed that in two subgroups, about half of the infants showed a broadly distributed increased mid-latency ERP negativity (indicating enhanced conceptual action processing) for either the congruent or the incongruent stimuli, respectively. As expected, mu power at sensorimotor sites was reduced (indicating enhanced motor activation) for congruent relative to incongruent stimuli in the entire sample. Both EEG correlates were related to infants’ language skills. Hence, 18-month-olds integrate action-goal-related verbal cues into their processing of others’ actions, at the functional levels of both conceptual processing and motor activation. Further, cue integration when inferring others’ action goals is related to infants’ language proficiency.     

视觉词汇加工的动态神经网络及其形成

揭示大脑加工的神经网络机制成为认知神经科学研究的最新取向.本研究以视觉词汇加工脑区(VWFA)的神经功能作为切入点,探讨视觉词汇加工神经网络的动态机制及其形成.研究一考察VWFA在刺激驱动和任务调节下的动态激活,及其与语音、语义脑区所组成神经网络的动态机制.研究二通过跨文化对比以及儿童阅读发展研究,阐明语言经验对视觉词汇加工网络的塑造作用.研究三对比功能网络、静息网络以及白质纤维束联结,探讨视觉词汇加工网络的动态联结及其形成.研究结果有助于建构视觉词汇加工的神经生理模型,为基于脑科学的阅读教学和阅读障碍矫治奠定理论基础,为认知神经科学研究提供了新的思路.     

The impact of the home musical environment on infants’ language development

There is strong evidence that musical engagement influences children’s language development but little research has been carried out on the relationship between the home musical environment and language development in infancy. The current study assessed musical exposure at home (including parental singing) and language development in 64 infants (8.5–18 months). Results showed that the home musical environment significantly predicted gesture development. For a subgroup of infants’ below 12 months, both parental singing and overall home musical environment score significantly predicted word comprehension. These findings represent the first demonstration that an enriched musical environment in infancy can promote development of communication skills.     

Sensorimotor foundations of speech perception in infancy

The perceptual system for speech is highly organized from early infancy. This organization bootstraps young human learners’ ability to acquire their native speech and language from speech input. Here, we review behavioral and neuroimaging evidence that perceptual systems beyond the auditory modality are also specialized for speech in infancy, and that motor and sensorimotor systems can influence speech perception even in infants too young to produce speech-like vocalizations. These investigations complement existing literature on infant vocal development and on the interplay between speech perception and production systems in adults. We conclude that a multimodal speech and language network is present before speech-like vocalizations emerge.     

Does functional neuroimaging solve the questions of neurolinguistics?

Neurolinguistic research has been engaged in evaluating models of language using measures from brain structure and function, and/or in investigating brain structure and function with respect to language representation using proposed models of language. While the aphasiological strategy, which classifies aphasias based on performance modality and a few linguistic variables, has been the most stable, cognitive neurolinguistics has had less success in reliably associating more elaborately proposed levels and units of language models with brain structure. Functional imaging emerged at this stage of neurolinguistic research. In this review article, it is proposed that the often-inconsistent superfluity of outcomes arising from functional imaging studies of language awaits adjustment at both "ends" of the process: model and data. Assumptions that our current language models consistently and reliably represent implicit knowledge within human cerebral processing are in line for major revision; and the promise of functional brain imaging to reveal any such knowledge structures must incorporate stable correlates of the imaging signal as dependent variable.     

Speed of word recognition and vocabulary knowledge in infancy predict cognitive and language outcomes in later childhood

The nature of predictive relations between early language and later cognitive function is a fundamental question in research on human cognition. In a longitudinal study assessing speed of language processing in infancy, Fernald, Perfors and Marchman (2006) found that reaction time at 25 months was strongly related to lexical and grammatical development over the second year. In this follow-up study, children originally tested as infants were assessed at 8 years on standardized tests of language, cognition, and working memory. Speed of spoken word recognition and vocabulary size at 25 months each accounted for unique variance in linguistic and cognitive skills at 8 years, effects that were attributable to strong relations between both infancy measures and working memory. These findings suggest that processing speed and early language skills are fundamental to intellectual functioning, and that language development is guided by learning and representational principles shared across cognitive and linguistic domains.     

The role of the auditory brainstem in processing linguistically-relevant pitch patterns

Historically, the brainstem has been neglected as a part of the brain involved in language processing. We review recent evidence of language-dependent effects in pitch processing based on comparisons of native vs. nonnative speakers of a tonal language from electrophysiological recordings in the auditory brainstem. We argue that there is enhancing of linguistically-relevant pitch dimensions or features well before the auditory signal reaches the cerebral cortex. We propose that long-term experience with a tone language sharpens the tuning characteristics of neurons along the pitch axis with enhanced sensitivity to linguistically-relevant, rapidly changing sections of pitch contours. Though not specific to a speech context, experience-dependent brainstem mechanisms for pitch representation are clearly sensitive to particular aspects of pitch contours that native speakers of a tone language have been exposed to. Such experience-dependent effects on lower-level sensory processing are compatible with more integrated, hierarchically organized pathways to language and the brain.     

Perception of auditory motion affects language processing

Previous reports have demonstrated that the comprehension of sentences describing motion in a particular direction (toward, away, up, or down) is affected by concurrently viewing a stimulus that depicts motion in the same or opposite direction. We report 3 experiments that extend our understanding of the relation between perception and language processing in 2 ways. First, whereas most previous studies of the relation between perception and language processing have focused on visual perception, our data show that sentence processing can be affected by the concurrent processing of auditory stimuli. Second, it is shown that the relation between the processing of auditory stimuli and the processing of sentences depends on whether the sentences are presented in the auditory or visual modality.     

大脑电刺激在听觉语言加工研究中的应用

大脑电刺激是历史悠久但近年来才广泛应用在人类被试上的实验技术。通过对颅内刺激位点进行电刺激, 并分析引发的暂时性行为功能变化和记录位点的电位活动, 大脑电刺激技术可以揭示认知加工过程中脑区内的功能作用与脑区间的有效连接。通过对听觉语言加工过程相关的丘脑、听觉皮层、高级语言皮层进行电刺激, 现有研究发现了各个脑区的不同功能特点以及不同脑区间的信息传递机制, 为进一步探索听觉语言加工的神经机制提供了新的视角。     

The language environment of the young infant: implications for early perceptual development

The purpose of this article is to review recent research on the young infant's use of voice-specific as well as voice-nonspecific auditory information during early language processing, to suggest a possible mechanism that biases the young infant towards this information, and to discuss potential implications of the early saliency of this information for later language development. Auditory preferences expressed by young infants are of interest because they demonstrate which properties of complex auditory events are effective in capturing the infant's attention. Moreover, the presence of such auditory preferences has led to speculations about their possible origins in both pre- and postnatal auditory experience. Research examining the role of early auditory experience in the formation of preferences is presented, along with a discussion of how the constrained nature of early auditory experience (particularly prenatal) may bias the young infant towards specific features of maternal as well as nonmaternal speech.     

早期听觉剥夺后的大脑可塑性：来自先天性听力障碍群体的证据

皮层功能的正常发展依赖于充分的外部感觉信息的输入。先天性听力障碍群体由于经历早期听觉剥夺, 皮层功能往往出现异常。具体表现为初级听皮层功能退化, 初级、次级听皮层的功能连接变弱, 次级听皮层出现跨通道功能重组; 在后天听力重建后听皮层功能重组仍然存在, 言语加工需要更多高级认知资源的补偿。已有研究在探讨听力重建后皮层的长期可塑性机制、复杂声学环境下言语加工机制、汉语言加工独特性等方面尚不深入, 值得进一步研究。     

The role of words and sounds in infants' visual processing: from overshadowing to attentional tuning

Although it is well documented that language plays an important role in cognitive development, there are different views concerning the mechanisms underlying these effects. Some argue that even early in development, effects of words stem from top-down knowledge, whereas others argue that these effects stem from auditory input affecting attention allocated to visual input. Previous research (e.g., Robinson & Sloutsky, 2004a ) demonstrated that non-speech sounds attenuate processing of corresponding visual input at 8, 12, and 16 months of age, whereas the current study demonstrates that words attenuate visual processing at 10 months but not at 16 months (Experiment 1). Furthermore, prefamiliarization with non-speech sounds (Experiment 2) resulted in able processing of visual input by 16-month-olds. These findings suggest that some effects of labels found early in development may stem from familiarity with human speech. The possibility of general-auditory factors underlying the effects of words on cognitive development is discussed.     

Use of the dichotic listening technique with learning disabilities

Dichotic listening (DL) techniques have been used extensively as a non-invasive procedure to assess language lateralization among children with and without learning disabilities (LD), and with individuals who have other auditory system related brain disorders. Results of studies using DL have indicated that language is lateralized in children with LD and that the lateralized language asymmetries do not develop after age 6 nor are they affected by gender. Observed differences in lateralized language processes between control children and those with LD were found not due to delayed cerebral dominance, but rather to deficits in selective attention. In addition, attention factors have a greater influence on auditory processing of verbal than nonverbal stimuli for children with LD, and children with LD exhibit a general processing bias to the same hemisphere unlike control children. Furthermore, employing directed attention conditions in DL experiments has played an important role in explaining learning disabled children's performance on DL tasks. We conclude that auditory perceptual asymmetries as assessed by DL with children who experience LD are the result of the interaction of hemispheric capability and attention factors.     

Infants learn phonotactic regularities from brief auditory experience

Two experiments investigated whether novel phonotactic regularities, not present in English, could be acquired by 16.5-month-old infants from brief auditory experience. Subjects listened to consonant-vowel-consonant syllables in which particular consonants were artificially restricted to either initial or final position (e.g. /baep/ not /paeb/). In a later head-turn preference test, infants listened longer to new syllables that violated the experimental phonotactic constraints than to new syllables that honored them. Thus, infants rapidly learned phonotactic regularities from brief auditory experience and extended them to unstudied syllables, documenting the sensitivity of the infant's language processing system to abstractions over linguistic experience.     

Linking patterns of infant eye movements to a neural network model of the ventral stream using representational similarity analysis

Little is known about the development of higher-level areas of visual cortex during infancy, and even less is known about how the development of visually guided behavior is related to the different levels of the cortical processing hierarchy. As a first step toward filling these gaps, we used representational similarity analysis (RSA) to assess links between gaze patterns and a neural network model that captures key properties of the ventral visual processing stream. We recorded the eye movements of 4- to 12-month-old infants (N = 54) as they viewed photographs of scenes. For each infant, we calculated the similarity of the gaze patterns for each pair of photographs. We also analyzed the images using a convolutional neural network model in which the successive layers correspond approximately to the sequence of areas along the ventral stream. For each layer of the network, we calculated the similarity of the activation patterns for each pair of photographs, which was then compared with the infant gaze data. We found that the network layers corresponding to lower-level areas of visual cortex accounted for gaze patterns better in younger infants than in older infants, whereas the network layers corresponding to higher-level areas of visual cortex accounted for gaze patterns better in older infants than in younger infants. Thus, between 4 and 12 months, gaze becomes increasingly controlled by more abstract, higher-level representations. These results also demonstrate the feasibility of using RSA to link infant gaze behavior to neural network models. A video abstract of this article can be viewed at https://youtu.be/K5mF2Rw98Is