韵律在语言加工中的作用及其神经机制

综述了近年来使用即时加工方法进行的韵律理解和作用机制方面的一些研究。首先, 介绍了韵律特征在句法加工中的作用, 从重音、韵律边界和韵律单元三个研究角度分析了韵律在句子理解中所起的作用及作用的时间点; 然后, 探讨了韵律加工的脑机制问题。论文最后提出未来的研究应在更广阔的视野中对韵律的加工阶段以及韵律与其他心理过程之间的关系进行探讨。     

言语韵律加工的ERP研究

韵律是言语各部分声音特性的综合,包括言语韵律和情绪韵律.有关言语韵律加工的ERP研究,涉及韵律成分加工、其与句法、语义、信息结构等的交互作用,以及韵律加工的个体差异.这些研究提供了丰富的信息.但由于韵律的复杂性,目前的研究仍然缺乏统一的范式,所得发现也难以有效整合.今后的言语韵律研究,应对已有研究成果从不同方面和角度进行验证和拓展,并充分重视汉语这一声调语言的加工独特性.     

句子产生中的句法启动

句子产生中的句法启动是指个体产生一个句子时,倾向于重复使用刚刚加工过的句法结构。研究发现：（1）句法启动不能简单用词汇、题元或韵律等因素来解释;（2）启动句和目标句动词、题元角色数目以及顺序是否一致,影响句法启动;（3）层级结构和线性结构具有心理现实性;（4）存在说和写之间以及从理解到产生的跨通道句法启动。这些发现促使研究者提出了新的句子产生理论,如句法启动模型和动词句法表征模型。论文最后指出了进一步研究的方向     

句法和语义在汉语简单句理解中的作用

两个实验探讨句法和语义在汉语简单句加工中的作用及其相互关系。实验一采用施事判断任务,发现句法作用与语义可逆性的作用都很显著;实验二采用快速句子判断任务,发现句法作用是主要的,语义可逆性无显著作用;两个实验都发现句法与语义可逆性之间的交互作用不显著。这些结果表明：（１）在汉语简单句理解的过程中句法因素的作用是主要的,语义因素的作用是次要的,只要当实验任务更多地强调语义分析时,语义因素才有显著的作用。     

韵律特征研究

介绍从知觉、认知和语料库分析角度对汉语韵律特征进行的一系列研究。（1）韵律特征知觉：用实验心理学和知觉标注的语料库分析方法,研究汉语语调和音高下倾与降阶问题,语句和语篇中知觉可以区分的韵律层级及相关的声学线索。研究结果支持汉语语调的双线模型理论和语句音高下倾的存在;证明语篇中知觉可以区分的韵律边界是小句、句子和段落,及其知觉相关的声学线索。（2）韵律特征与其他语言学结构的关系：在标注的语料库的基础上,用常规统计方法研究语句常规重音分布规律、语篇信息结构与重音的关系、并用决策树方法研究根据文本信息确定韵律短语边界和焦点的规则。（3）韵律特征在语篇理解中的作用：用实验心理学方法和脑电指标研究韵律对语篇信息整合和指代理解的影响,揭示其作用的认知和神经机制。讨论了这些研究结果对语音工程、语音学理论和心理语言学研究的实践和理论意义     

从使动句加工的功能性磁共振成像看中文句法加工的独立性

大脑中的句法加工模式是神经认知科学研究的重要课题, 而句法加工是否存在独立性一直是研究者争论较多的问题。有形态标记的英语等印欧语语言的句法可以通过形态变化表现, 而汉语不具备与印欧语有明确对应关系的形态变化, 因此汉语的句法变化几乎不能通过外在形态标记。通过3T场强功能性磁共振成像, 以汉语语义等值使动句为研究材料, 对不依赖形态变化来标记句法变化的汉语句法加工的独立性进行了初步研究。结果显示, 大脑左侧额叶对于汉语句法加工具有重要的作用, 尤其是大脑左侧额叶中回的BA44区和额叶下回的BA47区都对汉语句法加工较为敏感, 这表明即使不通过形态改变来标记句法变化, 汉语句子加工中的句法加工仍然可以被分离, 句法独立性的加工主要由大脑左侧额叶中回及大脑左侧额叶下回等脑区承担, 大脑左侧颞叶并未参与汉语句法的独立性加工。     

双语跨语言的句法启动

本文介绍了跨语言句法启动的图片描述法、补句法和句子回忆法三种研究方法;总结了跨语言句法启动研究关注的主要问题,包括：词序的一致性对跨语言句法启动的影响、词汇因素在跨语言句法启动中的作用、语言内和语言间句法启动的比较以及跨语言句法启动产生的机制等。同时也指出,在双语词序一致性,第二语言的熟练程度,双语语言学特性的差异性是否或者如何影响跨语言的句法启动等方面仍需进一步的研究     

印尼留学生汉语句子产生中的跨语言句法启动

采用图片描述范式探讨了不同年级印尼留学生汉语句子产生中的跨语言句法启动效应。结果发现,印尼语主动句启动条件下中年级印尼留学生没有产生跨语言句法启动,而高年级印尼留学生产生了跨语言句法启动;印尼语被动句启动条件下中、高年级印尼留学生均产生明显的跨语言句法启动。本研究结果初步表明,印尼留学生印尼语－汉语间跨语言句法启动与词序无关而与汉语水平有关。即使启动句为词序不同的印尼语被动句时,也能产生印尼语－汉语间跨语言句法启动。中年级印尼留学生句法表征中母语句法特征占优势,高年级印尼留学生句法表征中母语和汉语两种句法     

国外关于韵律特征和重音的一些研究

该文对韵律特征（包括其中的重音）这一研究领域近年的一些主要研究成果进行了一个小结。小结分两部分：（１）韵律特征及其作用;（２）关于重音的研究。文章对后者进行较详细的讨论,这个讨论分为重音的声学参数、重音的作用以及重音和其它韵律特征变量相互作用三个部分。     

情绪韵律调节情绪词识别的ERP研究

采用韵律/词汇干扰范式和延迟匹配任务, 通过两个ERP实验, 考察了汉语口语中情绪韵律能否、以及如何调节情绪词的识别。实验一中, 不同类型的情绪韵律分组呈现, ERP结果显示, 同与情绪韵律效价一致的情绪词相比, 与情绪韵律效价不一致的情绪词诱发了走向更负的P200、N300和N400成分; 实验二中, 不同类型的情绪韵律随机呈现, 上述效价一致性效应依然存在。实验结果表明, 情绪韵律能够调节情绪词识别, 主要表现在对情绪词的音韵编码和语义加工的双重易化上。     

Young children's use of prosody in sentence parsing

Korean children's ability to use prosodic phrasing in sentence comprehension was studied using two types of ambiguity. First, we examined a word-segmentation ambiguity in which placement of the phrasal boundary leads to different interpretations of a sentence. Next, we examined a syntactic ambiguity in which the same words were differently grouped into syntactic phrases by prosodic demarcation. Children aged 3 or 4 years showed that they could use prosodic information to segment utterances and to derive the meaning of ambiguous sentences when the sentences only contained a word-segmentation ambiguity. However, even 5- to 6-year-old children were not able to reliably resolve the second type of ambiguity, an ambiguity of phrasal grouping, by using prosodic information. The results demonstrate that children's difficulties in dealing with structural ambiguity are not due to their inability to use prosodic information.     

The influence of prosodic structure on the resolution of temporary syntactic closure ambiguities

This paper investigates the influence of prosodic structure on the process of sentence comprehension, with a specific focus on the relative contributions of syntactic and prosodic information to the resolution of temporary syntactic closure ambiguities. We argue that prosodic structure provides an initial memory representation for spoken sentences, and that information from this prosodic representation is available to inform syntactic parsing decisions. This view makes three predictions for the processing of temporary syntactic ambiguity: 1. When prosodic and syntactic boundaries coincide, syntactic processing should be facilitated. 2. When prosodic boundaries are placed at misleading points in syntactic structure, syntactic processing should show interference effects. 3. The processing difficulties that have been reliably demonstrated in reading experiments for syntactically complex sentences should disappear when those sentences are presented with a felicitous prosodic structure in listening experiments. These predictions were confirmed by series of experiments measuring end-of-sentence comprehension time and cross-modal naming time for sentences with temporary syntactic closure ambiguities. Sentences with coinciding or conflicting prosodic and syntactic boundaries were compared to a prosodic baseline condition.This research was supported in part by NIMH grant R29 MH51768 to the first author and NIMH grant T32 MH19729 to the Northeastern University Psychology Department.     

What can prosody tell a parser?

In this paper, I consider how a sentence processor might use specific prosodic cues at various points in the processing of particular sentences containing (at least temporary) syntactic ambiguity. In principle, the usefulness of prosodic information depends on what a given cluster of prosodic cues typically signifies, and on which syntactic options exist for a given string: in only some instances can prosodic information provide useful disambiguating information.This work was supported by Grant #DC-01409, a Research and Training Grant funded by the National Institute on Deafness and Other Communicative Disorders to the National Center for Neurogenic Communication Disorders, University of Arizona. I wish to thank Andrew Barss for very helpful comments on an earlier draft of this paper.     

Preschoolers use phrasal prosody online to constrain syntactic analysis

Two experiments were conducted to investigate whether young children are able to take into account phrasal prosody when computing the syntactic structure of a sentence. Pairs of French noun/verb homophones were selected to create locally ambiguous sentences ([la petite ferme ] [est très jolie] ‘the small farm is very nice’ vs. [la petite] [ ferme la fenêtre] ‘the little girl closes the window’ – brackets indicate prosodic boundaries). Although these sentences start with the same three words, ferme is a noun (farm) in the former but a verb (to close) in the latter case. The only difference between these sentence beginnings is the prosodic structure, that reflects the syntactic structure (with a prosodic boundary just before the critical word when it is a verb, and just after it when it is a noun). Crucially, all words following the homophone were masked, such that prosodic cues were the only disambiguating information. Children successfully exploited prosodic information to assign the appropriate syntactic category to the target word, in both an oral completion task (4.5‐year‐olds, Experiment 1) and in a preferential looking paradigm with an eye‐tracker (3.5‐year‐olds and 4.5‐year‐olds, Experiment 2). These results show that both groups of children exploit the position of a word within the prosodic structure when computing its syntactic category. In other words, even younger children of 3.5 years old exploit phrasal prosody online to constrain their syntactic analysis. This ability to exploit phrasal prosody to compute syntactic structure may help children parse sentences containing unknown words, and facilitate the acquisition of word meanings.     

句法歧义消解影响因素、认知机制及其神经基础

句法歧义消解主要是指人们在面临多种句法分析可能性的情况下,句法分析器抑制不正确的句法分析而选择正确句法分析的认知过程。研究表明,该过程受到工作记忆、认知控制能力、语言分布频率、语境、韵律等因素的影响。为有效说明人们是如何完成句法歧义消解的,研究者们建构了诸如花园路径模型、约束满意理论、弱交互作用句法分析理论等相关模型。另外,基于脑成像技术研究表明,左侧额下回、左侧颞叶后部、中部和前部在句法消歧任务中都有显著激活。未来研究当围绕着句法消歧中的语义效应、句法和词汇歧义消解机制的异同、句法消歧中抑制能力的效应等方面展开。     

Prosodic disambiguation of syntactic structure: for the speaker or for the addressee?

Evidence has been mixed on whether speakers spontaneously and reliably produce prosodic cues that resolve syntactic ambiguities. And when speakers do produce such cues, it is unclear whether they do so "for" their addressees (the audience design hypothesis) or "for" themselves, as a by-product of planning and articulating utterances. Three experiments addressed these issues. In Experiments 1 and 3, speakers followed pictorial guides to spontaneously instruct addressees to move objects. Critical instructions (e.g., "Put the dog in the basket on the star") were syntactically ambiguous, and the referential situation supported either one or both interpretations. Speakers reliably produced disambiguating cues to syntactic ambiguity whether the situation was ambiguous or not. However, Experiment 2 suggested that most speakers were not yet aware of whether the situation was ambiguous by the time they began to speak, and so adapting to addressees' particular needs may not have been feasible in Experiment 1. Experiment 3 examined individual speakers' awareness of situational ambiguity and the extent to which they signaled structure, with or without addressees present. Speakers tended to produce prosodic cues to syntactic boundaries regardless of their addressees' needs in particular situations. Such cues did prove helpful to addressees, who correctly interpreted speakers' instructions virtually all the time. In fact, even when speakers produced syntactically ambiguous utterances in situations that supported both interpretations, eye-tracking data showed that 40% of the time addressees did not even consider the non-intended objects. We discuss the standards needed for a convincing test of the audience design hypothesis.     

Prosody and parsing in coordination structures

The effect of prosodic boundary cues on the off-line disambiguation and on-line parsing of coordination structures was examined. It was found that relative clauses were attached to coordinated object noun phrases in preference to second conjuncts in sentences like: The lawyer greeted the powerful barrister and the wise judge who was/were walking to the courtroom. Naive speakers signalled the syntactic contrast between the two structures by a prosodic break between the conjuncts when the relative clause was attached to the second conjunct. Listeners were able to use this prosodic information in both off-line syntactic disambiguation and on-line syntactic parsing. The findings are compatible with a model in which prosody has a strong immediate effect on parsing. It is argued that the current experimental design has avoided confounds present in earlier studies on the on-line integration of prosodic and syntactic information.     

Phonological phrase boundaries constrain the online syntactic analysis of spoken sentences

Two experiments tested whether phonological phrase boundaries constrain online syntactic analysis in French. Pairs of homophones belonging to different syntactic categories (verb and adjective) were used to create sentences with a local syntactic ambiguity (e.g., [le petit chien mort], in English, the dead little dog, vs. [le petit chien] [mord], in English, the little dog bites, where brackets indicate phonological phrase boundaries). An expert speaker recorded the sentences with either a maximally informative prosody or a minimally informative one. Participants correctly assigned the appropriate syntactic category to the target word, even without any access to the lexical disambiguating information, in both a completion task (Experiment 1) and an abstract word detection task (Experiment 2). The size of the experimental effect was modulated by the prosodic manipulation (maximally vs. minimally informative), guaranteeing that prosody played a crucial role in disambiguation. The authors discuss the implications of these results for models of online speech perception and language acquisition.     

Utilization of Prosodic Information in Syntactic Ambiguity Resolution

Two self paced listening experiments examined the role of prosodic phrasing in syntactic ambiguity resolution. In Experiment 1, the stimuli consisted of early closure sentences (e.g., “While the parents watched, the child sang a song.”) containing transitive-biased subordinate verbs paired with plausible direct objects or intransitive-biased subordinate verbs paired with implausible direct objects. Experiment 2 also contained early closure sentences with transitively and intransitive-biased subordinate verbs, but the subordinate verbs were always followed by plausible direct objects. In both experiments, there were two prosodic conditions. In the subject-biased prosodic condition, an intonational phrase boundary marked the clausal boundary following the subordinate verb. In the object-biased prosodic condition, the clause boundary was unmarked. The results indicate that lexical and prosodic cues interact at the subordinate verb and plausibility further affects processing at the ambiguous noun. Results are discussed with respect to models of the role of prosody in sentence comprehension.     

Linguistic rhythm guides parsing decisions in written sentence comprehension

Various recent studies attest that reading involves creating an implicit prosodic representation of the written text which may systematically affect the resolution of syntactic ambiguities in sentence comprehension. Research up to now suggests that implicit prosody itself depends on a partial syntactic analysis of the text, raising the question of whether implicit prosody contributes to the parsing process, or whether it merely interprets the syntactic analysis. The present reading experiments examine the influence of stress-based linguistic rhythm on the resolution of local lexical-syntactic ambiguities in German. Both speech production data from unprepared oral reading and eye-tracking results from silent reading demonstrate that readers favor syntactic analyses that allow for a prosodic representation in which stressed and unstressed syllables alternate rhythmically. The findings contribute evidence confirming immediate and guiding effects of linguistic rhythm on the earliest stages of syntactic parsing in reading.