Musicians and tone-language speakers share enhanced brainstem encoding but not perceptual benefits for musical pitch

Behavioral and neurophysiological transfer effects from music experience to language processing are well-established but it is currently unclear whether or not linguistic expertise (e.g., speaking a tone language) benefits music-related processing and its perception. Here, we compare brainstem responses of English-speaking musicians/non-musicians and native speakers of Mandarin Chinese elicited by tuned and detuned musical chords, to determine if enhancements in subcortical processing translate to improvements in the perceptual discrimination of musical pitch. Relative to non-musicians, both musicians and Chinese had stronger brainstem representation of the defining pitches of musical sequences. In contrast, two behavioral pitch discrimination tasks revealed that neither Chinese nor non-musicians were able to discriminate subtle changes in musical pitch with the same accuracy as musicians. Pooled across all listeners, brainstem magnitudes predicted behavioral pitch discrimination performance but considering each group individually, only musicians showed connections between neural and behavioral measures. No brain-behavior correlations were found for tone language speakers or non-musicians. These findings point to a dissociation between subcortical neurophysiological processing and behavioral measures of pitch perception in Chinese listeners. We infer that sensory-level enhancement of musical pitch information yields cognitive-level perceptual benefits only when that information is behaviorally relevant to the listener.     

汉语口语韵律的作用及其神经机制

汉语是一种声调语言, 在口语韵律表达中存在独特的特点。本项目利用汉语不同于非声调语言的特点, 探讨已有研究中尚未澄清的问题, 即汉语声调在早期自动加工中对语义激活的作用, 以及在不同认知阶段中, 汉语声调和语调加工的神经机制。这些问题是当前的研究热点, 但仍存在着各种分歧和激烈的争论。本项目拟采用ERP方法, 结合LORETA源定位技术, 通过不同的实验范式考察以下内容：(1)在早期自动加工过程中, 汉语声调对词汇语义激活的作用; (2)在早期阶段, 汉语声调和语调加工的大脑激活模式; (3)在晚期阶段, 汉语声调和语调加工的大脑激活模式。对这些问题的考察将有助于澄清当前的激烈争论, 拓展以往基于非声调语言研究建立的口语加工理论的适用范围, 为完善言语认知加工的理论模型提供新的实验证据。     

幼儿汉语口语感知特点及神经机制

口语感知是当前心理语言学的研究热点, 然而以往研究大多以婴儿和成人为被试, 缺乏对幼儿口语感知的研究。此外, 现有口语感知模型主要是基于非声调语言研究建立起来的, 对汉语并不完全适用。汉语是一种声调语言, 在语音构成上不同于非声调语言。本项目将立足于汉语口语特点, 以3~5岁幼儿为研究对象, 考察幼儿汉语口语感知特点及神经机制。综合使用眼动方法、ERP方法和LORETA源定位技术探讨以下问题：(1)幼儿在前注意阶段和注意阶段的听觉语音辨别特点; (2)幼儿汉语口语词汇识别过程中音段信息和超音段信息的作用; (3)幼儿汉语口语感知的神经机制。本项目研究结果将揭示幼儿汉语口语感知特点, 为完善现有的口语感知模型提供新的实验证据。     

Cross‐linguistic interactions influence reading development in bilinguals: a comparison between early balanced French‐Basque and Spanish‐Basque bilingual children

This study investigates whether orthographic consistency and transparency of languages have an impact on the development of reading strategies and reading sub‐skills (i.e. phonemic awareness and visual attention span) in bilingual children. We evaluated 21 French (opaque)‐Basque (transparent) bilingual children and 21 Spanish (transparent)‐Basque (transparent) bilingual children at Grade 2, and 16 additional children of each group at Grade 5. All of them were assessed in their common language (i.e. Basque) on tasks measuring word and pseudoword reading, phonemic awareness and visual attention span skills. The Spanish speaking groups showed better Basque pseudoword reading and better phonemic awareness abilities than their French speaking peers, but only in the most difficult conditions of the tasks. However, on the visual attention span task, the French‐Basque bilinguals showed the most efficient visual processing strategies to perform the task. Therefore, learning to read in an additional language affected differently Basque literacy skills, depending on whether this additional orthography was opaque (e.g. French) or transparent (e.g. Spanish). Moreover, we showed that the most noteworthy effects of Spanish and French orthographic transparency on Basque performance were related to the size of the phonological and visual grain used to perform the tasks.     

Brains that are out of tune but in time

It is estimated that about 4% of the general population may have amusia (or tone deafness). Congenital amusia is a lifelong disability for processing music despite normal intellectual, memory, and language skills. Here we present evidence that the disorder stems from a deficit in fine-grained pitch perception. Amusic and control adults were presented with monotonic and isochronous sequences of five tones (i.e., constant pitch and intertone interval). They were required to detect when the fourth tone was displaced in pitch or time. All amusic participants were impaired in detecting the pitch changes, and showed no sign of improvement with practice. In contrast, they detected time changes as well as control adults and exhibited similar improvements with practice. Thus, the degraded pitch perception seen in the amusic individuals cannot be ascribed to nonspecific problems with the task or to poor hearing in general. Rather, the data point to the presence of a congenital neural anomaly that selectively impairs pitch processing.     

汉语普通话声调感知的老年化效应：来自ERP的证据

研究考察汉语普通话老年人前注意阶段声调感知状况, 探究是否存在领域特殊的老年化。运用事件相关电位技术, 采用被动oddball范式诱发MMN回应, 控制领域一般性因素的影响。结果显示涉及范畴变化的声调和非语音音调诱发MMN强度衰减, 不涉及范畴变化的声调诱发MMN强度未衰退。研究结果表明在前注意阶段, 在特定汉语普通话声调范畴知识加工能力上存在领域特殊的衰退, 而不涉及母语音位知识的声调的感知存在领域特殊的一定程度的保留, 这一保留与时间维度上补偿机制的调用有关。受补偿机制调节, 语言加工呈现出衰退或保留等不同的老年化进程。     

Enhanced music sensitivity in 9-month-old bilingual infants

This study explores the influence of bilingualism on the cognitive processing of language and music. Specifically, we investigate how infants learning a non-tone language perceive linguistic and musical pitch and how bilingualism affects cross-domain pitch perception. Dutch monolingual and bilingual infants of 8–9 months participated in the study. All infants had Dutch as one of the first languages. The other first languages, varying among bilingual families, were not tone or pitch accent languages. In two experiments, infants were tested on the discrimination of a lexical (N = 42) or a violin (N = 48) pitch contrast via a visual habituation paradigm. The two contrasts shared identical pitch contours but differed in timbre. Non-tone language learning infants did not discriminate the lexical contrast regardless of their ambient language environment. When perceiving the violin contrast, bilingual but not monolingual infants demonstrated robust discrimination. We attribute bilingual infants’ heightened sensitivity in the musical domain to the enhanced acoustic sensitivity stemming from a bilingual environment. The distinct perceptual patterns between language and music and the influence of acoustic salience on perception suggest processing diversion and association in the first year of life. Results indicate that the perception of music may entail both shared neural network with language processing, and unique neural network that is distinct from other cognitive functions.     

Spatial metaphor in language can promote the development of cross‐modal mappings in children

Pitch is often described metaphorically: for example, Farsi and Turkish speakers use a ‘thickness’ metaphor (low sounds are ‘thick’ and high sounds are ‘thin’), while German and English speakers use a height metaphor (‘low’, ‘high’). This study examines how child and adult speakers of Farsi, Turkish, and German map pitch and thickness using a cross‐modal association task. All groups, except for German children, performed significantly better than chance. German‐speaking adults’ success suggests the pitch‐to‐thickness association can be learned by experience. But the fact that German children were at chance indicates that this learning takes time. Intriguingly, Farsi and Turkish children's performance suggests that learning cross‐modal associations can be boosted through experience with consistent metaphorical mappings in the input language.     

Absolute pitch in infancy and adulthood: the role of tonal structure

Despite many similarities in infant and adult auditory processing, the literature suggests that two aspects of music perception, pitch processing and knowledge of tonal structure, change over development. The current experiments assess the use of absolute and relative pitch cues in a tone sequence statistical learning task containing tonal structure. The results suggest that infants preferentially process absolute pitch patterns in continuous tone sequences, supporting the hypothesis that absolute pitch is present in infancy, whereas adults tracked both absolute and relative pitch patterns. Infants and adults detected the tonal structure in the input, suggesting that humans are attuned to basic aspects of tonality early in life.     

汉语普通话母语者的节奏组块感知偏好

个体对声音节奏的感知具有明显的偏好,强度上表现为扬抑组块偏好,时长上表现为抑扬组块偏好,这被称作抑扬-扬抑规律,但这一感知规律是否具有跨语言的普遍性却存在争议。本研究以汉语普通话母语者为被试,考察他们对非语音音调序列的节奏组块感知情况,结果发现强度和时长参数下被试对扬抑形式的判断比例均显著高于随机水平,说明汉语普通话母语者在两个参数上的节奏感知中均表现出明显的扬抑偏好,在强度上支持节奏感知偏好具有跨语言普遍性的观点,在时长上不支持节奏感知偏好受到母语短语韵律特征影响的观点。     

Japanese Sound‐Symbolism Facilitates Word Learning in English‐Speaking Children

Sound‐symbolism is the nonarbitrary link between the sound and meaning of a word. Japanese‐speaking children performed better in a verb generalization task when they were taught novel sound‐symbolic verbs, created based on existing Japanese sound‐symbolic words, than novel nonsound‐symbolic verbs ( Imai, Kita, Nagumo, & Okada, 2008 ). A question remained as to whether the Japanese children had picked up regularities in the Japanese sound‐symbolic lexicon or were sensitive to universal sound‐symbolism. The present study aimed to provide support for the latter. In a verb generalization task, English‐speaking 3‐year‐olds were taught novel sound‐symbolic verbs, created based on Japanese sound‐symbolism, or novel nonsound‐symbolic verbs. English‐speaking children performed better with the sound‐symbolic verbs, just like Japanese‐speaking children. We concluded that children are sensitive to universal sound‐symbolism and can utilize it in word learning and generalization, regardless of their native language.     

Developmental changes in automatic rule‐learning mechanisms across early childhood

Infants’ ability to learn complex linguistic regularities from early on has been revealed by electrophysiological studies indicating that 3‐month‐olds, but not adults, can automatically detect non‐adjacent dependencies between syllables. While different ERP responses in adults and infants suggest that both linguistic rule learning and its link to basic auditory processing undergo developmental changes, systematic investigations of the developmental trajectories are scarce. In the present study, we assessed 2‐ and 4‐year‐olds’ ERP indicators of pitch discrimination and linguistic rule learning in a syllable‐based oddball design. To test for the relation between auditory discrimination and rule learning, ERP responses to pitch changes were used as predictor for potential linguistic rule‐learning effects. Results revealed that 2‐year‐olds, but not 4‐year‐olds, showed ERP markers of rule learning. Although, 2‐year‐olds’ rule learning was not dependent on differences in pitch perception, 4‐year‐old children demonstrated a dependency, such that those children who showed more pronounced responses to pitch changes still showed an effect of rule learning. These results narrow down the developmental decline of the ability for automatic linguistic rule learning to the age between 2 and 4 years, and, moreover, point towards a strong modification of this change by auditory processes. At an age when the ability of automatic linguistic rule learning phases out, rule learning can still be observed in children with enhanced auditory responses. The observed interrelations are plausible causes for age‐of‐acquisition effects and inter‐individual differences in language learning.     

汉语普通话声调T2-T4范畴化感知的老化效应

本研究考察了50~80岁说普通话的中老年人对普通话声调T2—T4的范畴化感知表现,探究影响声调范畴化感知老化的因素。采用经典范畴感知范式。结果显示,(1)中老年组所有年龄段(50~60岁、60~70岁、70~80岁)的范畴边界宽度都显著大于年轻组,但中老年组间差异不显著。(2)中老年人范畴边界宽度与记忆广度测试得分呈显著负相关,而与年龄的相关性不显著。(3)和年轻组相比,中老年组范畴内识别函数的斜率差异显著,而范畴间差异不显著。结果表明,中老年人声调感知范畴化程度下降,音系层面的加工能力发生衰退,记忆广度的衰退与声调范畴化感知老年化之间存在关联。此外,50到80岁间,年龄不会直接影响声调感知范畴化程度。     

The development of comprehension and reading‐related skills in children learning English as an additional language and their monolingual,English‐speaking peers

Background. A significant number of pupils in UK schools learn English as an additional language (EAL). Relative differences between the educational attainment of this group and monolingual, English‐speaking pupils call for an exploration of the literacy needs of EAL learners. Aims. This study explores the developmental progression of reading and listening comprehension skills and a range of reading‐related skills in EAL learners, whose first language is of South Asian origin, and their monolingual peers. Sample. Participants were 39 children learning EAL and 39 monolingual, English‐speaking children who were all in school Year 3 at the start of the study. Method. Children completed standardized measures of comprehension, vocabulary, reading accuracy, and reading fluency in school Year 3 and again in Year 4. Results. The results suggest that, although children learning EAL often demonstrate fast and accurate reading accuracy skills, lower levels of vocabulary knowledge place significant constraints on EAL learners' comprehension of spoken and written texts. Conclusions. Reciprocal relationships between vocabulary and comprehension may lead to increasing gaps in reading comprehension between monolingual and EAL pupils over time. It is proposed that support for the development of vocabulary skills in children learning EAL is needed in early years' classrooms.     

Implicit Association Test (IAT) Studies Investigating Pitch-Shape Audiovisual Cross-modal Associations Across Language Groups

Previous studies have shown that Chinese speakers and non-Chinese speakers exhibit different patterns of cross-modal congruence for the lexical tones of Mandarin Chinese, depending on which features of the pitch they attend to. But is this pattern of language-specific listening a conscious cultural strategy or an automatic processing effect? If automatic, does it also apply when the same pitch contours no longer sound like speech? Implicit Association Tests (IATs) provide an indirect measure of cross-modal association. In a series of IAT studies, conducted with participants with three kinds of language backgrounds (Chinese-dominant bilinguals, Chinese balanced bilinguals, and English speakers with no Chinese experience) we find language-specific congruence effects for Mandarin lexical tones but not for matched sine-wave stimuli. That is, for linguistic stimuli, non-Chinese speakers show advantages for pitch-height congruence (high-pointy, low-curvy); no congruence effects were found for Chinese speakers. For non-linguistic stimuli, all participant groups showed advantages for pitch-height congruence. The present findings suggest that non-lexical tone congruence (high-pointy, low-curvy) is a basic congruence pattern, and the acquisition of a language with lexical tone can alter this perception.     

2~4岁普通话儿童前注意阶段的声调感知机制

以MMN、p-MMR作为汉语词汇声调感知的神经关联物,探究2~4岁汉语普通话儿童前注意阶段对声调刺激的失匹配响应,关注范畴信息和偏差大小两个因素对儿童感知水平的影响。结果显示:在范畴间大偏差条件下(T1/T3),诱发明显的MMN;在范畴内或小偏差条件下(T3a/T3、T3b/T3、T2/T3),都未诱发显著的MMR。表明:2~4岁普通话儿童正处于声调感知能力的发展过程中,音位信息和声学信息共同影响其声调感知。     

Both Earlier Times and the Future Are “Front”: The Distinction Between Time‐ and Ego‐Reference‐Points in Mandarin Speakers’ Temporal Representation

Mandarin speakers, like most other language speakers around the world, use spatial terms to talk about time. However, the direction of their mental temporal representation along the front‐back axis remains controversial because they use the spatial term “front” to refer to both earlier times (e.g., front‐year means “the year before last”) and the future (e.g., front‐road means “prospect”). Although the linguistic distinction between time‐ and ego‐reference‐point spatiotemporal metaphors in Mandarin suggests a promising clarification of the above controversy, there is little empirical evidence verifying this distinction. In this study, Mandarin speakers’ time‐ and ego‐reference‐point temporal representations on three axes (i.e., sagittal, lateral, and vertical) were separately examined through two tasks. In a time‐reference‐point task, Mandarin speakers judged whether the time point of the second picture was earlier or later than the time point of the first picture, while in an ego‐reference‐point task, they judged whether an event or phase had happened in the past or would happen in the future. The results indicate that Mandarin speakers construe an earlier‐times‐in‐front‐of‐later‐times temporal sequence and adopt the front‐to‐the‐future orientation.     

ERP correlates of language-specific processing of auditory pitch feedback during self-vocalization

The present study investigated whether the neural correlates for auditory feedback control of vocal pitch can be shaped by tone language experience. Event-related potentials (P2/N1) were recorded from adult native speakers of Mandarin and Cantonese who heard their voice auditory feedback shifted in pitch by −50, −100, −200, or −500 cents when they sustained the vowel sound /u/. Cantonese speakers produced larger P2 amplitudes to −200 or −500 cents stimuli than Mandarin speakers, but this language effect failed to reach significance in the case of −50 or −100 cents. Moreover, Mandarin speakers produced shorter N1 latencies over the left hemisphere than the right hemisphere, whereas Cantonese speakers did not. These findings demonstrate that neural processing of auditory pitch feedback in vocal motor control is subject to language-dependent neural plasticity, suggesting that cortical mechanisms of auditory-vocal integration can be shaped by tone language experience.     

Individuals with congenital amusia imitate pitches more accurately in singing than in speaking: Implications for music and language processing

In this study, we investigated the impact of congenital amusia, a disorder of musical processing, on speech and song imitation in speakers of a tone language, Mandarin. A group of 13 Mandarin-speaking individuals with congenital amusia and 13 matched controls were recorded while imitating a set of speech and two sets of song stimuli with varying pitch and rhythm patterns. The results indicated that individuals with congenital amusia were worse than controls in both speech and song imitation, in terms of both pitch matching (absolute and relative) and rhythm matching (relative time and number of time errors). Like the controls, individuals with congenital amusia achieved better absolute and relative pitch matching and made fewer pitch interval and contour errors in song than in speech imitation. These findings point toward domain-general pitch (and time) production deficits in congenital amusia, suggesting the presence of shared pitch production mechanisms but distinct requirements for pitch-matching accuracy in language and music processing.     

Impaired categorical perception of lexical tones in Mandarin-speaking congenital amusics

The degree to which cognitive resources are shared in the processing of musical pitch and lexical tones remains uncertain. Testing Mandarin amusics on their categorical perception of Mandarin lexical tones may provide insight into this issue. In the present study, a group of 15 amusic Mandarin speakers identified and discriminated Mandarin tones presented as continua in separate blocks. The tonal continua employed were from a high-level tone to a mid-rising tone and from a high-level tone to a high-falling tone. The two tonal continua were made in the contexts of natural speech and of nonlinguistic analogues. In contrast to the controls, the participants with amusia showed no improvement for discrimination pairs that crossed the classification boundary for either speech or nonlinguistic analogues, indicating a lack of categorical perception. The lack of categorical perception of Mandarin tones in the amusic group shows that the pitch deficits in amusics may be domain-general, and this suggests that the processing of musical pitch and lexical tones may share certain cognitive resources and/or processes (Patel 2003, 2008, 2012).