普通话韵律词重音知觉

实验一研究了韵律词重音的多个声学相关物,及其对韵律词重音知觉贡献的大小,结果表明,按照贡献大小的次序,影响普通话韵律词重音感知的声学参数是：时长、音高、频谱倾斜和平均能量。实验二研究非声学参数因素对普通话韵律词重音知觉的影响,实验结果表明,听者关于普通话韵律词重音方面的语言学知识对韵律词重音的知觉有显著影响。     

口语句子的韵律边界：窥探言语理解的秘窗

韵律边界加工与言语理解紧密相关, 最近十几年来逐渐成为心理学和语言学的研究焦点。韵律系统包含若干由小到大的韵律单位, 不同单位的韵律成分其边界强度不同, 表现在音高、延宕和停顿三个声学线索上的参数也不同。句子的听力理解过程中, 听话人运用声学线索感知权重策略对韵律边界的声学线索进行加工。从神经层面上来看, 对于韵律边界的加工, 大脑显示出独立且特异性的神经机制。韵律边界的加工能力在婴儿出生后随年龄的增长而发展, 到了老年阶段则逐渐退化, 而且似乎能够对二语迁移。未来, 需要扩大对韵律边界声学表现的考查范围, 进一步明确韵律边界的加工过程, 进一步厘清韵律边界加工和句法加工之间的关系, 进一步关注二语者韵律边界加工能力的发展。     

语句重音分布模式知觉

在排除语义和句法结构信息的情况下,用统计方法研究听者使用局部的韵律学线索知觉语句重音分布模式的能力;并根据知觉模式,讨论汉语中重音分类、词重音在语流中的变化以及重音在语句组织和语义表达中的作用等问题。     

绝句韵律边界的认知加工及其脑电效应

语言理解过程中, 句子内部的韵律短语边界会诱发反映韵律短语终止的特异性脑电成分终止正漂移 (CPS, closure positive shift), 而句末语调短语边界则会诱发反映句法终止和完整语言单元结束的脑电效应P3。研究采用汉语特有的语篇绝句, 考察了听者加工绝句中各句末语调短语边界的认知过程及其诱发的脑电效应。结果发现五言绝句内部各语调短语边界分别诱发了时间进程、头皮分布和波幅均相同的CPS, 表明语篇内部韵律边界加工不受其所处语篇位置的影响; 五言和七言绝句末的韵律边界则分别诱发了一个P3, 并且前者诱发的P3波幅小于后者, 而二者在时间进程和头皮分布上不存在差异。本研究表明, 句末语调短语边界诱发何种脑电效应与其承担的功能有关, 既表示前面信息终止又预期后面信息出现的句末边界会诱发CPS, 而只表示信息终止的句末边界则会诱发P3。     

汉语语句重音的分类和分布

通过两个独立进行的重音标注实验对汉语语句重音的分类和分布进行了初步探讨。实验l是由60位普通被试参加的音节重音突显度的知觉实验。实验2是由本文三位作者参加的重音类别标注实验,在此实验中语句重音被划分为节奏重音和语义重音。实验2中对于语句重音的分类性标注结果得到了实验l中普通被试对音节重音突显度知觉结果的支持,这说明人们确实能够感知到两种不同类型的重音。实验结果还表明,节奏重音倾向于出现在较大韵律单元内的最末韵律词的末音节上,并且与适当的停延相伴生,语义重音的分布则与语句的韵律结构的关系不大。     

国外关于韵律特征和重音的一些研究

该文对韵律特征（包括其中的重音）这一研究领域近年的一些主要研究成果进行了一个小结。小结分两部分：（１）韵律特征及其作用;（２）关于重音的研究。文章对后者进行较详细的讨论,这个讨论分为重音的声学参数、重音的作用以及重音和其它韵律特征变量相互作用三个部分。     

强调范围对句子重音知觉的影响及其声学表现的研究

通过韵律匹配度知觉实验和声学参数分析,探讨了句子层面上不同强调范围对句子重音知觉的影响。实验材料为精心设计的语料,两名发音人在问答匹配的实验范式下朗读,以自然的方式强调相应内容。20名被试对不同强调范围的问答句进行韵律匹配度知觉判断。结果发现,一些答句和问句之间的匹配可以替换,另一些答句只与对应的问句匹配。句子重音的实现符合节律栅规则。通过对不同语境下音节的时长和音高进行声学参数分析。结果表明,时长延长和音高升高都是重音的声学表现。时长增加涉及的范围没有因句子重音的强调范围不同而不同。     

汉语普通话句子重音在时长方面的声学表现

研究包括2部分。在第一部分,通过对由10个发音人发音的148条句子中的4个词时长方面的声学特征的分析发现：（1）当句子重音强调词时,时长的增加主要集中在这个词的重读音节上;（2）当句子重音强调词的某个音节时,时长的延长主要集中在这个音节上。在第二部分,通过使用上述语句的知觉实验发现,句子重音强调词的语句和句子重音强调这个词的重读音节的语句相对于它们的语境是可以相互替换的, 这种相互可替换性起因于这两种语句声学表现方面的相似性     

3～5岁儿童基于声音线索的情绪知觉

研究从言语的韵律和语义两条线索出发,试图探讨学前儿童基于声音线索情绪知觉的发展特点.实验一中,124名3～5岁儿童对男、女性用5种不同情绪(高兴、生气、害怕、难过和中性)的声音表达的中性语义句子进行了情绪类型上的判断.3～5岁儿童基于声音韵律线索情绪知觉能力随着年龄的增长不断提高,主要表现在生气、害怕和中性情绪上.不同情绪类型识别的发展轨迹不完全相同,总体来说,高兴的声音韵律最容易识别,而害怕是最难识别的.当韵律和语义线索冲突时,学前儿童更多地依赖韵律线索来判断说话者的情绪状态.被试对女性用声音表达的情绪更敏感.     

老年人群的韵律感知

老龄化导致听觉系统、认知功能有所衰退。老年人群的言语理解能力减弱, 韵律信息解析存在困难。老年人对重音、语调、语速等语言韵律感知能力退化, 对情感韵律的加工也出现问题, 特别是消极情绪韵律加工减退较快。老年疾病进一步加深韵律加工难度, 韵律感知呈现出与特定疾病的相关性。未来研究需考察不同语言背景老年人群的韵律感知表现与机制、复杂交流环境的影响、韵律感知障碍对老年疾病的预测、韵律感知的早期干预与复健等问题。     

On the lateralization of emotional prosody: an event-related functional MR investigation

In order to investigate the lateralization of emotional speech we recorded the brain responses to three emotional intonations in two conditions, i.e., "normal" speech and "prosodic" speech (i.e., speech with no linguistic meaning, but retaining the 'slow prosodic modulations' of speech). Participants listened to semantically neutral sentences spoken with a positive, neutral, or negative intonation in both conditions and judged how positive, negative, or neutral the intonation was on a five-point scale. Core peri-sylvian language areas, as well as some frontal and subcortical areas were activated bilaterally in the normal speech condition. In contrast, a bilateral fronto-opercular region was active when participants listened to prosodic speech. Positive and negative intonations elicited a bilateral fronto-temporal and subcortical pattern in the normal speech condition, and more frontal activation in the prosodic speech condition. The current results call into question an exclusive right hemisphere lateralization of emotional prosody and expand patient data on the functional role of the basal ganglia during the perception of emotional prosody.     

Unattended emotional intonations modulate linguistic prosody processing

Prosody or speech melody subserves linguistic (e.g., question intonation) and emotional functions in speech communication. Findings from lesion studies and imaging experiments suggest that, depending on function or acoustic stimulus structure, prosodic speech components are differentially processed in the right and left hemispheres. This direct current (DC) potential study investigated the linguistic processing of digitally manipulated pitch contours of sentences that carried an emotional or neutral intonation. Discrimination of linguistic prosody was better for neutral stimuli as compared to happily as well as fearfully spoken sentences. Brain activation was increased during the processing of happy sentences as compared to neutral utterances. Neither neutral nor emotional stimuli evoked lateralized processing in the left or right hemisphere, indicating bilateral mechanisms of linguistic processing for pitch direction. Acoustic stimulus analysis suggested that prosodic components related to emotional intonation, such as pitch variability, interfered with linguistic processing of pitch course direction.     

The influence of prosodic structure on the resolution of temporary syntactic closure ambiguities

This paper investigates the influence of prosodic structure on the process of sentence comprehension, with a specific focus on the relative contributions of syntactic and prosodic information to the resolution of temporary syntactic closure ambiguities. We argue that prosodic structure provides an initial memory representation for spoken sentences, and that information from this prosodic representation is available to inform syntactic parsing decisions. This view makes three predictions for the processing of temporary syntactic ambiguity: 1. When prosodic and syntactic boundaries coincide, syntactic processing should be facilitated. 2. When prosodic boundaries are placed at misleading points in syntactic structure, syntactic processing should show interference effects. 3. The processing difficulties that have been reliably demonstrated in reading experiments for syntactically complex sentences should disappear when those sentences are presented with a felicitous prosodic structure in listening experiments. These predictions were confirmed by series of experiments measuring end-of-sentence comprehension time and cross-modal naming time for sentences with temporary syntactic closure ambiguities. Sentences with coinciding or conflicting prosodic and syntactic boundaries were compared to a prosodic baseline condition.This research was supported in part by NIMH grant R29 MH51768 to the first author and NIMH grant T32 MH19729 to the Northeastern University Psychology Department.     

Gender and the integration of acoustic dimensions of prosody: implications for clinical studies.

This study was conducted to detect the existence of a relationship between spectral and temporal prosodic cues and to examine gender differences in any such relationship. The rationale for the investigation was to gain a greater understanding of normal prosody and the requirements for control groups in clinical studies of prosody. Ten male and 10 female speakers with no known speech or neurological deficits participated in the study. They performed a reading task which involved delivering 10 sentences first with a declarative and then repeated with an interrogative intonation (20 sentences per speaker). Intrasubject and intersubject analyses of the speech data revealed a dependence of pitch on duration that differed between male and female speakers. Significant differences between the genders were also found in speech rate, pitch range, and pitch slope. The findings suggest that an integrated treatment of acoustic cues may provide a more invariant feature of normal prosody against which clinical groups may be compared. The data also imply that in clinical studies of the production of prosody gender should be carefully controlled.     

Brain activity varies with modulation of dynamic pitch variance in sentence melody

Fourteen native speakers of German heard normal sentences, sentences which were either lacking dynamic pitch variation (flattened speech), or comprised of intonation contour exclusively (degraded speech). Participants were to listen carefully to the sentences and to perform a rehearsal task. Passive listening to flattened speech compared to normal speech produced strong brain responses in right cortical areas, particularly in the posterior superior temporal gyrus (pSTG). Passive listening to degraded speech compared to either normal or flattened speech particularly involved fronto-opercular and subcortical (Putamen, Caudate Nucleus) regions bilaterally. Additionally the Rolandic operculum (premotor cortex) in the right hemisphere subserved processing of neat sentence intonation. As a function of explicit rehearsing sentence intonation we found several activation foci in the left inferior frontal gyrus (Broca's area), the left inferior precentral sulcus, and the left Rolandic fissure. The data allow several suggestions: First, both flattened and degraded speech evoked differential brain responses in the pSTG, particularly in the planum temporale (PT) bilaterally indicating that this region mediates integration of slowly and rapidly changing acoustic cues during comprehension of spoken language. Second, the bilateral circuit active whilst participants receive degraded speech reflects general effort allocation. Third, the differential finding for passive perception and explicit rehearsal of intonation contour suggests a right fronto-lateral network for processing and a left fronto-lateral network for producing prosodic information. Finally, it appears that brain areas which subserve speech (frontal operculum) and premotor functions (Rolandic operculum) coincidently support the processing of intonation contour in spoken sentence comprehension.     

Recognizing prosody across modalities, face areas and speakers: examining perceivers' sensitivity to variable realizations of visual prosody

Prosody can be expressed not only by modification to the timing, stress and intonation of auditory speech but also by modifying visual speech. Studies have shown that the production of visual cues to prosody is highly variable (both within and across speakers), however behavioural studies have shown that perceivers can effectively use such visual cues. The latter result suggests that people are sensitive to the type of prosody expressed despite cue variability. The current study investigated the extent to which perceivers can match visual cues to prosody from different speakers and from different face regions. Participants were presented two pairs of sentences (consisting of the same segmental content) and were required to decide which pair had the same prosody. Experiment 1 tested visual and auditory cues from the same speaker and Experiment 2 from different speakers. Experiment 3 used visual cues from the upper and the lower face of the same talker and Experiment 4 from different speakers. The results showed that perceivers could accurately match prosody even when signals were produced by different speakers. Furthermore, perceivers were able to match the prosodic cues both within and across modalities regardless of the face area presented. This ability to match prosody from very different visual cues suggests that perceivers cope with variation in the production of visual prosody by flexibly mapping specific tokens to abstract prosodic types.     

Immediate use of prosody and context in predicting a syntactic structure

Numerous studies have reported an effect of prosodic information on parsing but whether prosody can impact even the initial parsing decision is still not evident. In a visual world eye-tracking experiment, we investigated the influence of contrastive intonation and visual context on processing temporarily ambiguous relative clause sentences in Japanese. Our results showed that listeners used the prosodic cue to make a structural prediction before hearing disambiguating information. Importantly, the effect was limited to cases where the visual scene provided an appropriate context for the prosodic cue, thus eliminating the explanation that listeners have simply associated marked prosodic information with a less frequent structure. Furthermore, the influence of the prosodic information was also evident following disambiguating information, in a way that reflected the initial analysis. The current study demonstrates that prosody, when provided with an appropriate context, influences the initial syntactic analysis and also the subsequent cost at disambiguating information. The results also provide first evidence for pre-head structural prediction driven by prosodic and contextual information with a head-final construction.     

Pupillometry reveals processing load during spoken language comprehension

This study investigated processing effort by measuring peoples’ pupil diameter as they listened to sentences containing a temporary syntactic ambiguity. In the first experiment, we manipulated prosody. The results showed that when prosodic structure conflicted with syntactic structure, pupil diameter reliably increased. In the second experiment, we manipulated both prosody and visual context. The results showed that when visual context was consistent with the correct interpretation, prosody had very little effect on processing effort. However, when visual context was inconsistent with the correct interpretation, prosody had a large effect on processing effort. The interaction between visual context and prosody shows that visual context has an effect on online processing and that it can modulate the influence of linguistic sources of information, such as prosody. Pupillometry is a sensitive measure of processing effort during spoken language comprehension.     

Phonological phrase boundaries constrain the online syntactic analysis of spoken sentences

Two experiments tested whether phonological phrase boundaries constrain online syntactic analysis in French. Pairs of homophones belonging to different syntactic categories (verb and adjective) were used to create sentences with a local syntactic ambiguity (e.g., [le petit chien mort], in English, the dead little dog, vs. [le petit chien] [mord], in English, the little dog bites, where brackets indicate phonological phrase boundaries). An expert speaker recorded the sentences with either a maximally informative prosody or a minimally informative one. Participants correctly assigned the appropriate syntactic category to the target word, even without any access to the lexical disambiguating information, in both a completion task (Experiment 1) and an abstract word detection task (Experiment 2). The size of the experimental effect was modulated by the prosodic manipulation (maximally vs. minimally informative), guaranteeing that prosody played a crucial role in disambiguation. The authors discuss the implications of these results for models of online speech perception and language acquisition.     

Preschoolers use phrasal prosody online to constrain syntactic analysis

Two experiments were conducted to investigate whether young children are able to take into account phrasal prosody when computing the syntactic structure of a sentence. Pairs of French noun/verb homophones were selected to create locally ambiguous sentences ([la petite ferme ] [est très jolie] ‘the small farm is very nice’ vs. [la petite] [ ferme la fenêtre] ‘the little girl closes the window’ – brackets indicate prosodic boundaries). Although these sentences start with the same three words, ferme is a noun (farm) in the former but a verb (to close) in the latter case. The only difference between these sentence beginnings is the prosodic structure, that reflects the syntactic structure (with a prosodic boundary just before the critical word when it is a verb, and just after it when it is a noun). Crucially, all words following the homophone were masked, such that prosodic cues were the only disambiguating information. Children successfully exploited prosodic information to assign the appropriate syntactic category to the target word, in both an oral completion task (4.5‐year‐olds, Experiment 1) and in a preferential looking paradigm with an eye‐tracker (3.5‐year‐olds and 4.5‐year‐olds, Experiment 2). These results show that both groups of children exploit the position of a word within the prosodic structure when computing its syntactic category. In other words, even younger children of 3.5 years old exploit phrasal prosody online to constrain their syntactic analysis. This ability to exploit phrasal prosody to compute syntactic structure may help children parse sentences containing unknown words, and facilitate the acquisition of word meanings.