Differential recognition of pitch patterns in discrete and gliding stimuli in congenital amusia: evidence from Mandarin speakers

This study examined whether "melodic contour deafness" (insensitivity to the direction of pitch movement) in congenital amusia is associated with specific types of pitch patterns (discrete versus gliding pitches) or stimulus types (speech syllables versus complex tones). Thresholds for identification of pitch direction were obtained using discrete or gliding pitches in the syllable /ma/ or its complex tone analog, from nineteen amusics and nineteen controls, all healthy university students with Mandarin Chinese as their native language. Amusics, unlike controls, had more difficulty recognizing pitch direction in discrete than in gliding pitches, for both speech and non-speech stimuli. Also, amusic thresholds were not significantly affected by stimulus types (speech versus non-speech), whereas controls showed lower thresholds for tones than for speech. These findings help explain why amusics have greater difficulty with discrete musical pitch perception than with speech perception, in which continuously changing pitch movements are prevalent.     

汉语普通话声调T2-T4范畴化感知的老化效应

本研究考察了50~80岁说普通话的中老年人对普通话声调T2—T4的范畴化感知表现,探究影响声调范畴化感知老化的因素。采用经典范畴感知范式。结果显示,(1)中老年组所有年龄段(50~60岁、60~70岁、70~80岁)的范畴边界宽度都显著大于年轻组,但中老年组间差异不显著。(2)中老年人范畴边界宽度与记忆广度测试得分呈显著负相关,而与年龄的相关性不显著。(3)和年轻组相比,中老年组范畴内识别函数的斜率差异显著,而范畴间差异不显著。结果表明,中老年人声调感知范畴化程度下降,音系层面的加工能力发生衰退,记忆广度的衰退与声调范畴化感知老年化之间存在关联。此外,50到80岁间,年龄不会直接影响声调感知范畴化程度。     

失歌症者对音乐和言语音高的加工

音高是音乐和言语领域中一个重要维度。失歌症是一种对音乐音高加工的障碍。探讨失歌症者对音乐和言语音高的加工有助于揭示音乐和言语音高加工是否共享特定的认知和神经机制。已有研究结果表明, 失歌症者对音乐音高加工存在障碍, 这种音高障碍在一定程度上影响到言语音高加工。同时, 声调语言背景无法弥补失歌症者的音高障碍。这些研究结果支持了资源－共享框架(resource-sharing framework), 即音乐和语言共享特定的认知和神经机制(Patel, 2003, 2008, in press), 并可能在一定程度上为失语症临床治疗提供借鉴。     

汉语语音范畴性知觉及其发展

范畴性是言语知觉的一个显著特征,长期以来一直受到研究者的普遍关注。但汉语不同语音特征的范畴性知觉特点及其发展模式迄今为止还很少有研究涉及。本研究利用语音合成的方法分别改变辅音的送气/不送气特征和声调的基频曲线,生成语音刺激连续体,采用范畴性知觉的经典研究范式探讨了汉语正常成人被试嗓音启动时间（Voice onset time,VOT）和声调范畴性知觉的特点及不同年龄儿童的发展模式。研究结果表明：（1）成人被试对VOT和声调的知觉是范畴性的;（2）对于汉语声调特征,6岁儿童已经具有类似成人的范畴性知觉能力;而在VOT这一维度上,范畴知觉能力随着年龄发展不断精细化,但7岁儿童也尚未达到成年人的敏感程度,说明汉语VOT和声调这两个不同的语音特征经历了不同的发展模式。     

On the (non)categorical perception of lexical tones

Identification and discrimination of lexical tones in Cantonese were compared in the context of a traditional categorical perception paradigm. Three lexical tone continua were used: one ranging from low level to high level, one from high rising to high level, and one from low falling to high rising. Identification data showed steep slopes at category boundaries, suggesting that lexical tones are perceived categorically. In contrast, discrimination curves generally showed much weaker evidence for categorical perception. Subsequent investigation showed that the presence of a tonal context played a strong role in the identification of target tones and less of a role in discrimination. The results are consistent with the hypothesis that tonal category boundaries are determined by a combination of regions of natural auditory sensitivity and the influence of linguistic experience.     

2~4岁普通话儿童前注意阶段的声调感知机制

以MMN、p-MMR作为汉语词汇声调感知的神经关联物,探究2~4岁汉语普通话儿童前注意阶段对声调刺激的失匹配响应,关注范畴信息和偏差大小两个因素对儿童感知水平的影响。结果显示:在范畴间大偏差条件下(T1/T3),诱发明显的MMN;在范畴内或小偏差条件下(T3a/T3、T3b/T3、T2/T3),都未诱发显著的MMR。表明:2~4岁普通话儿童正处于声调感知能力的发展过程中,音位信息和声学信息共同影响其声调感知。     

汉语口语韵律的作用及其神经机制

汉语是一种声调语言, 在口语韵律表达中存在独特的特点。本项目利用汉语不同于非声调语言的特点, 探讨已有研究中尚未澄清的问题, 即汉语声调在早期自动加工中对语义激活的作用, 以及在不同认知阶段中, 汉语声调和语调加工的神经机制。这些问题是当前的研究热点, 但仍存在着各种分歧和激烈的争论。本项目拟采用ERP方法, 结合LORETA源定位技术, 通过不同的实验范式考察以下内容：(1)在早期自动加工过程中, 汉语声调对词汇语义激活的作用; (2)在早期阶段, 汉语声调和语调加工的大脑激活模式; (3)在晚期阶段, 汉语声调和语调加工的大脑激活模式。对这些问题的考察将有助于澄清当前的激烈争论, 拓展以往基于非声调语言研究建立的口语加工理论的适用范围, 为完善言语认知加工的理论模型提供新的实验证据。     

汉语元音对声调感知边界的影响

本项研究基于现代汉语普通话声调感知具有范畴性这一结论(Wang, 1976), 以普通话中6个单元音(/a//?//F//i//u//y/, 即拼音a、o、e、i、u、ü)阴平(T1)到阳平(T2)调的连续统(continuum)为实验语料, 用专业语音学软件Praat合成连续统语音样本, 对20名平均年龄为22.90岁的普通话母语者进行声调感知实验, 即让被试对所听刺激进行T1或T2的二选一鉴别测试(identification test), 从而探究单元音的内在音高(intrinsic pitch)与声调感知边界(boundary)的关系。本文借鉴Wang (1976)和Peng等(2010)对元音/i/声调连续统的合成方法, 使声调感知研究拓展到普通话中除/i/之外的其他5个单元音, 对以上两项研究起到一定的对照作用。研究发现, 元音会对T1到T2的声调范畴感知边界位置产生影响, 低元音/a/的内在音高较低, 其边界位置亦始终低于其他元音, 且具有显著性差异, 实验结果证明, 内在音高会对感知边界产生影响, 从而支持了Ohala和Eukel (1976)的“舌位拉伸”假说。     

汉语普通话声调感知的老年化效应：来自ERP的证据

研究考察汉语普通话老年人前注意阶段声调感知状况, 探究是否存在领域特殊的老年化。运用事件相关电位技术, 采用被动oddball范式诱发MMN回应, 控制领域一般性因素的影响。结果显示涉及范畴变化的声调和非语音音调诱发MMN强度衰减, 不涉及范畴变化的声调诱发MMN强度未衰退。研究结果表明在前注意阶段, 在特定汉语普通话声调范畴知识加工能力上存在领域特殊的衰退, 而不涉及母语音位知识的声调的感知存在领域特殊的一定程度的保留, 这一保留与时间维度上补偿机制的调用有关。受补偿机制调节, 语言加工呈现出衰退或保留等不同的老年化进程。     

Speaking a tone language enhances musical pitch perception in 3–5‐year‐olds

Young children learn multiple cognitive skills concurrently (e.g., language and music). Evidence is limited as to whether and how learning in one domain affects that in another during early development. Here we assessed whether exposure to a tone language benefits musical pitch processing among 3–5‐year‐old children. More specifically, we compared the pitch perception of Chinese children who spoke a tone language (i.e., Mandarin) with English‐speaking American children. We found that Mandarin‐speaking children were more advanced at pitch processing than English‐speaking children but both groups performed similarly on a control music task (timbre discrimination). The findings support the Pitch Generalization Hypothesis that tone languages drive attention to pitch in nonlinguistic contexts, and suggest that language learning benefits aspects of music perception in early development. A video abstract of this article can be viewed at: https://youtu.be/UY0kpGpPNA0     

Pitch discrimination without awareness in congenital amusia: Evidence from event-related potentials

Congenital amusia is a lifelong disorder characterized by a difficulty in perceiving and producing music despite normal intelligence and hearing. Behavioral data have indicated that it originates from a deficit in fine-grained pitch discrimination, and is expressed by the absence of a P3b event-related brain response for pitch differences smaller than a semitone and a bigger N2b–P3b brain response for large pitch differences as compared to controls. However, it is still unclear why the amusic brain overreacts to large pitch changes. Furthermore, another electrophysiological study indicates that the amusic brain can respond to changes in melodies as small as a quarter-tone, without awareness, by exhibiting a normal mismatch negativity (MMN) brain response. Here, we re-examine the event-related N2b–P3b components with the aim to clarify the cause of the larger amplitude observed by Peretz, Brattico, and Tervaniemi (2005), by experimentally matching the number of deviants presented to the controls according to the number of deviants detected by amusics. We also re-examine the MMN component as well as the N1 in an acoustical context to investigate further the pitch discrimination deficit underlying congenital amusia. In two separate conditions, namely ignore and attend, we measured the MMN, the N1, the N2b and the P3b to tones that deviated by an eight of a tone (25 cents) or whole tone (200 cents) from a repeated standard tone. The results show a normal MMN, a seemingly normal N1, a normal P3b for the 200 cents pitch deviance, and no P3b for the small 25 cents pitch differences in amusics. These results indicate that the amusic brain responds to small pitch differences at a pre-attentive level of perception, but is unable to detect consciously those same pitch deviances at a later attentive level. The results are consistent with previous MRI and fMRI studies indicating that the auditory cortex of amusic individuals is functioning normally.     

音乐训练对4~5岁幼儿普通话声调范畴感知能力的影响

已有研究表明, 音乐训练能提高成人对普通话声调范畴感知的能力, 此种训练能否增强幼儿对声调范畴感知的能力?训练效果是否受到训练时间长短的影响?本研究对幼儿园4~5岁幼儿进行音乐训练, 共40人, 分成音乐组和控制组, 每组各20人, 追踪考察音乐训练和训练时间长短对幼儿声调范畴感知能力提升的影响。实验采用前测-中测-后测设计, 对音乐组开展每周3次, 每次30分钟, 以小钟琴演奏为主的音乐训练; 控制组不进行任何有组织的训练活动。结果发现, 12个月音乐训练提升了幼儿对声调范畴感知的程度, 表现为音乐组幼儿范畴边界宽度显著小于控制组, 而训练6个月时, 该优势并不显著。此外, 12个月音乐训练还加强了幼儿区分范畴内刺激声学差异的敏感性, 而对范畴间刺激的区分能力无显著提高。本研究结果支持了音乐学习的歌剧理论(OPERA), 音乐训练具有跨域迁移作用, 可提升4~5岁幼儿对普通话声调范畴感知的能力, 但只有长期持续的训练才可能真正提高幼儿的音高精细化加工水平。     

Implicit Association Test (IAT) Studies Investigating Pitch-Shape Audiovisual Cross-modal Associations Across Language Groups

Previous studies have shown that Chinese speakers and non-Chinese speakers exhibit different patterns of cross-modal congruence for the lexical tones of Mandarin Chinese, depending on which features of the pitch they attend to. But is this pattern of language-specific listening a conscious cultural strategy or an automatic processing effect? If automatic, does it also apply when the same pitch contours no longer sound like speech? Implicit Association Tests (IATs) provide an indirect measure of cross-modal association. In a series of IAT studies, conducted with participants with three kinds of language backgrounds (Chinese-dominant bilinguals, Chinese balanced bilinguals, and English speakers with no Chinese experience) we find language-specific congruence effects for Mandarin lexical tones but not for matched sine-wave stimuli. That is, for linguistic stimuli, non-Chinese speakers show advantages for pitch-height congruence (high-pointy, low-curvy); no congruence effects were found for Chinese speakers. For non-linguistic stimuli, all participant groups showed advantages for pitch-height congruence. The present findings suggest that non-lexical tone congruence (high-pointy, low-curvy) is a basic congruence pattern, and the acquisition of a language with lexical tone can alter this perception.     

音乐经验对言语加工能力的促进作用

以初中二年级的学生为考察对象,探讨了音乐经验对不同层次的言语加工能力的促进作用,发现：在声音信号的加工层面,音乐经验对音高和时长信息感知能力的发展都有积极的促进作用;在语音意识层面,音乐经验的促进作用只局限于声调意识;在言语记忆方面,音乐经验可以促进言语材料在长时记忆中的保持。     

Musical ability and non‐native speech‐sound processing are linked through sensitivity to pitch and spectral information

Is the observed link between musical ability and non‐native speech‐sound processing due to enhanced sensitivity to acoustic features underlying both musical and linguistic processing? To address this question, native English speakers (N = 118) discriminated Norwegian tonal contrasts and Norwegian vowels. Short tones differing in temporal, pitch, and spectral characteristics were used to measure sensitivity to the various acoustic features implicated in musical and speech processing. Musical ability was measured using Gordon's Advanced Measures of Musical Audiation. Results showed that sensitivity to specific acoustic features played a role in non‐native speech‐sound processing: Controlling for non‐verbal intelligence, prior foreign language‐learning experience, and sex, sensitivity to pitch and spectral information partially mediated the link between musical ability and discrimination of non‐native vowels and lexical tones. The findings suggest that while sensitivity to certain acoustic features partially mediates the relationship between musical ability and non‐native speech‐sound processing, complex tests of musical ability also tap into other shared mechanisms.     

Quantification of the hierarchy of tonal functions within a diatonic context

Listeners rated test tones falling in the octave range from middle to high C according to how well each completed a diatonic C major scale played in an adjacent octave just before the final test tone. Ratings were well explained in terms of three factors. The factors were distance in pitch height from the context tones, octave equivalence, and the following hierarchy of tonal functions: tonic tone, other tones of the major triad chord, other tones of a diatonic scale, and the nondiatonic tones. In these ratings, pitch height was more prominent for less musical listeners or with less musical (sinusoidal) tones, whereas octave equivalence and the tonal hierarchy prevailed for musical listeners, especially with harmonically richer tones. Ratings for quarter tones interpolated halfway between the halftone steps of the standard chromatic scale were approximately the averages of ratings for adjacent chromatic tones, suggesting failure to discriminate tones at this fine level of division.     

幼儿汉语口语感知特点及神经机制

口语感知是当前心理语言学的研究热点, 然而以往研究大多以婴儿和成人为被试, 缺乏对幼儿口语感知的研究。此外, 现有口语感知模型主要是基于非声调语言研究建立起来的, 对汉语并不完全适用。汉语是一种声调语言, 在语音构成上不同于非声调语言。本项目将立足于汉语口语特点, 以3~5岁幼儿为研究对象, 考察幼儿汉语口语感知特点及神经机制。综合使用眼动方法、ERP方法和LORETA源定位技术探讨以下问题：(1)幼儿在前注意阶段和注意阶段的听觉语音辨别特点; (2)幼儿汉语口语词汇识别过程中音段信息和超音段信息的作用; (3)幼儿汉语口语感知的神经机制。本项目研究结果将揭示幼儿汉语口语感知特点, 为完善现有的口语感知模型提供新的实验证据。     

Brains that are out of tune but in time

It is estimated that about 4% of the general population may have amusia (or tone deafness). Congenital amusia is a lifelong disability for processing music despite normal intellectual, memory, and language skills. Here we present evidence that the disorder stems from a deficit in fine-grained pitch perception. Amusic and control adults were presented with monotonic and isochronous sequences of five tones (i.e., constant pitch and intertone interval). They were required to detect when the fourth tone was displaced in pitch or time. All amusic participants were impaired in detecting the pitch changes, and showed no sign of improvement with practice. In contrast, they detected time changes as well as control adults and exhibited similar improvements with practice. Thus, the degraded pitch perception seen in the amusic individuals cannot be ascribed to nonspecific problems with the task or to poor hearing in general. Rather, the data point to the presence of a congenital neural anomaly that selectively impairs pitch processing.     

Music-to-language transfer effect: may melodic ability improve learning of tonal languages by native nontonal speakers?

In tonal languages, as Mandarin Chinese and Thai, word meaning is partially determined by lexical tones. Previous studies suggest that lexical tones are processed by native listeners as linguistic information and not as pure tonal information. This study aims at verifying if, in nontonal languages speakers, the discrimination of lexical Mandarin tones varies in function of the melodic ability. Forty-six students with no previous experience of Mandarin or any other tonal language were presented with two short lists of spoken monosyllabic Mandarin words and invited to perform a same–different task trying to identify whether the variation were phonological or tonal. Main results show that subjects perform significantly better in identifying phonological variations rather than tonal ones and interestingly, the group with a high melodic ability (assessed by Wing subtest 3) shows a better performance exclusively in detecting tonal variations.     

Effects of Phonetic Similarity in the Identification of Mandarin Tones

Tonal languages differ in how they use phonetic correlates e.g. average pitch height and pitch direction, for tonal contrasts. Thus, native speakers of a tonal language may need to adjust their attention to familiar or unfamiliar phonetic cues when perceiving non-native tones. On the other hand, speakers of a non-tonal language may need to develop sensitivity to tonal correlates absent from their native system. The current study examines and compares five language groups’ perception of two synthesized Mandarin tones: the high level tone and the high falling tone. It aims to examine how listeners from tonal and non-tonal backgrounds identify and categorize acoustically equidistant pitches varying along two phonetic dimensions: pitch onset and slope. Results reveal “universal” perceptual patterns across groups and also tendencies caused by native tonal systems. Our findings confirm that L1 tonal and prosodic systems affect speakers’ sensitivity to novel perceptual cues and their abilities to discern relevant phonetic differences.