不同语境中声调早期加工的作用及时间进程

作为一种声调语言,汉语词汇在语音构成上存在独特的特点。本研究利用汉语不同于非声调语言的特点,探讨已有研究中尚未澄清的问题,即汉语声调在早期自动加工和早期控制加工中对语义激活的作用,以及在不同认知阶段中汉语声调加工的神经机制。本研究拟采用ERP方法,结合LORETA源定位技术,通过Oddball范式考察以下内容在早期阶段,汉语声调加工的大脑激活模式,拓展以往基于非声调语言研究建立的口语加工理论的适用范围,为完善言语认知加工的理论模型提供新的实验证据。     

幼儿汉语口语感知特点及神经机制

口语感知是当前心理语言学的研究热点, 然而以往研究大多以婴儿和成人为被试, 缺乏对幼儿口语感知的研究。此外, 现有口语感知模型主要是基于非声调语言研究建立起来的, 对汉语并不完全适用。汉语是一种声调语言, 在语音构成上不同于非声调语言。本项目将立足于汉语口语特点, 以3~5岁幼儿为研究对象, 考察幼儿汉语口语感知特点及神经机制。综合使用眼动方法、ERP方法和LORETA源定位技术探讨以下问题：(1)幼儿在前注意阶段和注意阶段的听觉语音辨别特点; (2)幼儿汉语口语词汇识别过程中音段信息和超音段信息的作用; (3)幼儿汉语口语感知的神经机制。本项目研究结果将揭示幼儿汉语口语感知特点, 为完善现有的口语感知模型提供新的实验证据。     

中-英双语者语言理解中非加工语言的自动激活

采用长时重复启动范式探讨母语为汉语的中-英双语者语言理解中非加工语言的激活状况。实验1和实验2使用词汇判断任务, 实验3和实验4使用概念判断任务。在每个实验的第一个小实验中, 非加工语言是英文, 在每个实验的第二个小实验中, 非加工语言是中文。实验1和实验3探讨学习阶段的非加工词在测验阶段呈现时能否出现长时重复启动效应, 从而检验双语者语言理解中非加工语言有没有自动激活; 实验2和实验4探讨学习阶段的非加工词在测验阶段以翻译对等词呈现时能否出现长时重复启动效应, 从而检验双语者语言理解中非加工语言的语义有没有自动激活。总的实验结果表明, 母语为汉语的中-英双语者在语言理解过程中, 加工一种语言(目标语言)时, 非加工语言(要求被试忽略的另一种语言)会自动激活, 但在词汇任务情境中, 非加工语言只在词汇层面上激活, 其语义不会自动激活, 而在概念任务情境中, 非加工语言的词汇层面和语义层面都会自动激活。     

汉语声调加工过程的脑神经机制述评

汉语是一种声调语言。文章从三方面总结了汉语声调加工的脑神经机制研究:1)声调加工是语言性质,还是语音性质;2)声调加工和音段音位加工的异同;3)声调加工与语调加工的异同。首先,汉语声调加工是语言性质,虽然有右脑的参与,但主要表现为左脑偏侧化。其次,汉语声调是一个独立的语音单位,声调加工与音段音位加工的脑神经机制存在一定程度的分离。最后,声调加工与语调加工在脑神经机制上有一定相似性也有很大不同,虽然汉语语调加工主要是语言性质,但存在明显的语音性质。     

声调在汉语音节感知中的作用

探讨超音段(如声调)与音段信息的共同作用机制, 对口语词汇识别研究具有重要的理论意义。有研究探讨了声调在口语词汇语义通达阶段的作用, 但在相对早期的音节感知阶段, 声调与声母、韵母的共同作用机制还缺乏系统的认识。本研究采用oddball实验范式, 通过两个行为实验考察了声调在汉语音节感知中的作用。实验1发现检测声调和声母变化的时间没有差异, 均比检测韵母变化的时间长, 表明在汉语音节感知中对声调的敏感性不及韵母。实验2发现声母和韵母的组合并没有明显优于对韵母的觉察, 但声调与声母或韵母的同时变化都促进了被试对偏差刺激的觉察, 表明声调通过与声母、韵母的结合来共同影响汉语音节的感知加工。研究结果在认知行为层面为声调在音节感知中的作用机制提供了直接的实验证据, 为进一步探讨超音段与音段信息共同作用的认知神经机制提供了基础。     

汉语口语词汇产生中的多重音韵激活：单词翻译任务的ERP研究

口语词汇产生过程中, 非目标词是否会产生音韵激活是独立两阶段模型和交互激活模型的争论焦点之一。研究运用事件相关电位技术, 考察了被试在翻译命名任务中是否受到背景图片音韵或语义干扰词的影响。行为反应时中未发现显著的音韵效应, 而语义效应显著, 表明非目标词不会产生音韵激活。事件相关电位的结果显示在目标单词呈现后的400~600 ms时间窗口中出现了显著的语义效应, 在600~700 ms时间窗口内出现了边缘显著的语义效应和音韵效应, 均表现为相关条件比无关条件波幅更正。上述结果表明在将英语翻译成汉语的过程中, 尽管在脑电上呈现出可能存在微弱的多重音韵激活, 但行为结果并不会显示出非目标项的音韵激活。研究结果支持了汉语口语词汇产生遵循独立两阶段模式的观点。     

汉语双字词超音段信息在语义激活中的作用

采用眼动方法,通过两个实验考察了汉语双字词超音段信息在语义激活中的作用。结果显示：（1）汉语双字词语义激活过程中,分别改变首字声调和尾字声调对语义激活起到抑制作用,首字声调改变时的抑制作用更大。结果支持了Cohort模型。（2）语义相关词的注视点和注视时间远远多于其控制词,但没有发现词频效应。（3）汉语声调的加工过程与声韵母一样,独立作用于语义激活过程。     

汉语口语音段和超音段信息对词汇语义激活的作用

本研究通过两个实验来探讨汉语口语的音段信息和超音段信息对词汇语义激活的作用。实验结果表明,韵母的改变在语义激活过程中没有起到显著的抑制作用;声调改变词作为不一致启动词时,被试需要更多的时间来完成语义激活,说明了声调的改变对词汇语义激活具有制约作用。     

词汇熟悉度对非熟练中英双语者语言理解转换中非目标语言激活的影响

采用改造后的长时重复启动范式,探讨母语为汉语的非熟练中英双语者语言理解转换中非目标语言的激活层面,以及词汇熟悉度的影响。实验1考察学习阶段不同熟悉度的非目标词在测验阶段呈现时能否出现长时重复启动效应,从而检测双语者语言理解转换中非目标语言是否自动激活,实验2探究学习阶段不同熟悉度的非目标词在测验阶段以翻译对等词呈现时能否出现长时重复启动效应,从而检测双语者语言理解转换中非目标语言的语义层面能否激活。结果发现:非熟练中英双语者语言理解转换中非目标语言不管为中文还是英文,都能自动激活,但激活层面会受到词汇熟悉度的影响;当非目标语言为二语时,熟悉度高的二语词能激活到语义层面,熟悉度低的二语词只能激活到词汇层面;当非目标语言为一语时,不管词汇熟悉度高还是低,都能够激活到语义层面。     

汉语语调早期加工的脑机制

采用ERP方法, 结合LORETA源定位分析技术, 考察了汉语语调早期自动加工的脑机制。结果发现： (1)对于附着在二声调汉字后的语调, 无论以单字词的形式, 还是以句子的形式呈现, 都没有诱发MMN; (2)当过滤掉实验刺激的言语信息后, 词音高和句子音高条件均诱发了MMN, 且这两个条件下的MMN波幅差异不显著; (3)LORETA分析发现, 句子音高条件在右半球顶叶的多个区域存在显著激活。该结果拓展了以往的研究结论, 为声学假设提供了证据。     

2~4岁普通话儿童前注意阶段的声调感知机制

以MMN、p-MMR作为汉语词汇声调感知的神经关联物,探究2~4岁汉语普通话儿童前注意阶段对声调刺激的失匹配响应,关注范畴信息和偏差大小两个因素对儿童感知水平的影响。结果显示:在范畴间大偏差条件下(T1/T3),诱发明显的MMN;在范畴内或小偏差条件下(T3a/T3、T3b/T3、T2/T3),都未诱发显著的MMR。表明:2~4岁普通话儿童正处于声调感知能力的发展过程中,音位信息和声学信息共同影响其声调感知。     

汉语普通话声调感知的老年化效应：来自ERP的证据

研究考察汉语普通话老年人前注意阶段声调感知状况, 探究是否存在领域特殊的老年化。运用事件相关电位技术, 采用被动oddball范式诱发MMN回应, 控制领域一般性因素的影响。结果显示涉及范畴变化的声调和非语音音调诱发MMN强度衰减, 不涉及范畴变化的声调诱发MMN强度未衰退。研究结果表明在前注意阶段, 在特定汉语普通话声调范畴知识加工能力上存在领域特殊的衰退, 而不涉及母语音位知识的声调的感知存在领域特殊的一定程度的保留, 这一保留与时间维度上补偿机制的调用有关。受补偿机制调节, 语言加工呈现出衰退或保留等不同的老年化进程。     

Impaired categorical perception of lexical tones in Mandarin-speaking congenital amusics

The degree to which cognitive resources are shared in the processing of musical pitch and lexical tones remains uncertain. Testing Mandarin amusics on their categorical perception of Mandarin lexical tones may provide insight into this issue. In the present study, a group of 15 amusic Mandarin speakers identified and discriminated Mandarin tones presented as continua in separate blocks. The tonal continua employed were from a high-level tone to a mid-rising tone and from a high-level tone to a high-falling tone. The two tonal continua were made in the contexts of natural speech and of nonlinguistic analogues. In contrast to the controls, the participants with amusia showed no improvement for discrimination pairs that crossed the classification boundary for either speech or nonlinguistic analogues, indicating a lack of categorical perception. The lack of categorical perception of Mandarin tones in the amusic group shows that the pitch deficits in amusics may be domain-general, and this suggests that the processing of musical pitch and lexical tones may share certain cognitive resources and/or processes (Patel 2003, 2008, 2012).     

Implicit Association Test (IAT) Studies Investigating Pitch-Shape Audiovisual Cross-modal Associations Across Language Groups

Previous studies have shown that Chinese speakers and non-Chinese speakers exhibit different patterns of cross-modal congruence for the lexical tones of Mandarin Chinese, depending on which features of the pitch they attend to. But is this pattern of language-specific listening a conscious cultural strategy or an automatic processing effect? If automatic, does it also apply when the same pitch contours no longer sound like speech? Implicit Association Tests (IATs) provide an indirect measure of cross-modal association. In a series of IAT studies, conducted with participants with three kinds of language backgrounds (Chinese-dominant bilinguals, Chinese balanced bilinguals, and English speakers with no Chinese experience) we find language-specific congruence effects for Mandarin lexical tones but not for matched sine-wave stimuli. That is, for linguistic stimuli, non-Chinese speakers show advantages for pitch-height congruence (high-pointy, low-curvy); no congruence effects were found for Chinese speakers. For non-linguistic stimuli, all participant groups showed advantages for pitch-height congruence. The present findings suggest that non-lexical tone congruence (high-pointy, low-curvy) is a basic congruence pattern, and the acquisition of a language with lexical tone can alter this perception.     

汉语普通话声调T2-T4范畴化感知的老化效应

本研究考察了50~80岁说普通话的中老年人对普通话声调T2—T4的范畴化感知表现,探究影响声调范畴化感知老化的因素。采用经典范畴感知范式。结果显示,(1)中老年组所有年龄段(50~60岁、60~70岁、70~80岁)的范畴边界宽度都显著大于年轻组,但中老年组间差异不显著。(2)中老年人范畴边界宽度与记忆广度测试得分呈显著负相关,而与年龄的相关性不显著。(3)和年轻组相比,中老年组范畴内识别函数的斜率差异显著,而范畴间差异不显著。结果表明,中老年人声调感知范畴化程度下降,音系层面的加工能力发生衰退,记忆广度的衰退与声调范畴化感知老年化之间存在关联。此外,50到80岁间,年龄不会直接影响声调感知范畴化程度。     

Brain activity varies with modulation of dynamic pitch variance in sentence melody

Fourteen native speakers of German heard normal sentences, sentences which were either lacking dynamic pitch variation (flattened speech), or comprised of intonation contour exclusively (degraded speech). Participants were to listen carefully to the sentences and to perform a rehearsal task. Passive listening to flattened speech compared to normal speech produced strong brain responses in right cortical areas, particularly in the posterior superior temporal gyrus (pSTG). Passive listening to degraded speech compared to either normal or flattened speech particularly involved fronto-opercular and subcortical (Putamen, Caudate Nucleus) regions bilaterally. Additionally the Rolandic operculum (premotor cortex) in the right hemisphere subserved processing of neat sentence intonation. As a function of explicit rehearsing sentence intonation we found several activation foci in the left inferior frontal gyrus (Broca's area), the left inferior precentral sulcus, and the left Rolandic fissure. The data allow several suggestions: First, both flattened and degraded speech evoked differential brain responses in the pSTG, particularly in the planum temporale (PT) bilaterally indicating that this region mediates integration of slowly and rapidly changing acoustic cues during comprehension of spoken language. Second, the bilateral circuit active whilst participants receive degraded speech reflects general effort allocation. Third, the differential finding for passive perception and explicit rehearsal of intonation contour suggests a right fronto-lateral network for processing and a left fronto-lateral network for producing prosodic information. Finally, it appears that brain areas which subserve speech (frontal operculum) and premotor functions (Rolandic operculum) coincidently support the processing of intonation contour in spoken sentence comprehension.     

Acoustic analysis of lexical tone in Mandarin infant-directed speech

Using Mandarin Chinese, a "tone language" in which the pitch contours of syllables differentiate words, the authors examined the acoustic modifications of infant-directed speech (IDS) at the syllable level to test 2 hypotheses: (a) the overall increase in pitch and intonation contour that occurs in IDS at the phrase level would not distort lexical pitch at the syllable level and (b) IDS provides exaggerates cues to lexical tones. Sixteen Mandarin-speaking mothers were recorded while addressing their infants and addressing an adult. The results indicate that IDS does not distort the acoustic cues that are essential to word meaning at the syllable level; evidence of exaggeration of the acoustic differences in IDS was observed, extending previous findings of phonetic exaggeration to the lexical level.     

Dichotic Perception of Mandarin Tones by Chinese and American Listeners

The dichotic perception of Mandarin tones by native and nonnative listeners was examined in order to investigate the lateralization of lexical tone. Twenty American listeners with no tone language background and 20 Chinese listeners were asked to identify dichotically presented tone pairs by identifying which tone they heard in each ear. For the Chinese listeners, 57% of the total errors occurred via the left ear, indicating a significant right ear advantage. However, the American listeners revealed no significant ear preference, with 48% of the errors attributable to the left ear. These results indicated that Mandarin tones are predominantly processed in the left hemisphere by native Mandarin speakers, whereas they are bilaterally processed by American English speakers with no prior tone experience. The results also suggest that the left hemisphere superiority for native Mandarin tone processing is similar to native processing of other tone languages.