Sensitivity to prosodic structure in left- and right-hemisphere-damaged individuals

An experiment was conducted in order to determine whether left- (LHD) and right-hemisphere-damaged (RHD) patients exhibit sensitivity to prosodic information that is used in syntactic disambiguation. Following the work of, a cross-modal lexical decision task was performed by LHD and RHD subjects, as well as by adults without brain pathology (NC). Subjects listened to sentences with attachment ambiguities with either congruent or incongruent prosody, while performing a visual lexical decision task. Results showed that each of the unilaterally damaged populations differed from each other, as well as from the NCs in terms of sensitivity regarding prosodic cues. Specifically, the RHD group was insensitive to sentence prosody as a whole. This was in contrast to the LHD patients, who responded to the prosodic manipulation, but in the unexpected direction. Results are discussed in terms of current hypotheses regarding the hemispheric lateralization of prosodic cues.     

从讲话者和听话者两个角度看韵律的句法解歧

综述了近年来韵律句法解歧方面的一些研究。首先介绍了韵律特征及其作用;其次,简单介绍了句法歧义及其加工模型;然后从讲话者和听话者两个角度,分析了讲话者在自然的情境中是否自发稳定的生成韵律线索,以及听话者是否能够即时的使用韵律信息引导最初的句法分析两个问题,并简要地阐述了汉语韵律和句法的独特特点以及国内的相关研究;最后,初步探讨了进行汉语相应研究应该注意的问题     

The role of prosody in the interpretation of structural ambiguities: a study of anticipatory eye movements

An eye-tracking experiment examined whether prosodic cues can affect the interpretation of grammatical functions in the absence of clear morphological information. German listeners were presented with scenes depicting three potential referents while hearing temporarily ambiguous SVO and OVS sentences. While case marking on the first noun phrase (NP) was ambiguous, clear case marking on the second NP disambiguated sentences towards SVO or OVS. Listeners interpreted case-ambiguous NP1s more often as Subject, and thus expected an Object as upcoming argument, only when sentence beginnings carried an SVO-type intonation. This was revealed by more anticipatory eye movements to suitable Patients (Objects) than Agents (Subjects) in the visual scenes. No such preference was found when sentence beginnings had an OVS-type intonation. Prosodic cues were integrated rapidly enough to affect listeners' interpretation of grammatical function before disambiguating case information was available. We conclude that in addition to manipulating attachment ambiguities, prosody can influence the interpretation of constituent order ambiguities.     

Prosodic cues for morphological complexity: The case of Dutch plural nouns

It has recently been shown that listeners use systematic differences in vowel length and intonation to resolve ambiguities between onset-matched simple words (Davis, Marslen-Wilson, & Gaskell, 2002; Salverda, Dahan, & McQueen, 2003). The present study shows that listeners also use prosodic information in the speech signal to optimize morphological processing. The precise acoustic realization of the stem provides crucial information to the listener about the morphological context in which the stem appears and attenuates the competition between stored inflectional variants. We argue that listeners are able to make use of prosodic information, even though the speech signal is highly variable within and between speakers, by virtue of the relative invariance of the duration of the onset. This provides listeners with a baseline against which the durational cues in a vowel and a coda can be evaluated. Furthermore, our experiments provide evidence for item-specific prosodic effects.     

The influence of prosodic structure on the resolution of temporary syntactic closure ambiguities

This paper investigates the influence of prosodic structure on the process of sentence comprehension, with a specific focus on the relative contributions of syntactic and prosodic information to the resolution of temporary syntactic closure ambiguities. We argue that prosodic structure provides an initial memory representation for spoken sentences, and that information from this prosodic representation is available to inform syntactic parsing decisions. This view makes three predictions for the processing of temporary syntactic ambiguity: 1. When prosodic and syntactic boundaries coincide, syntactic processing should be facilitated. 2. When prosodic boundaries are placed at misleading points in syntactic structure, syntactic processing should show interference effects. 3. The processing difficulties that have been reliably demonstrated in reading experiments for syntactically complex sentences should disappear when those sentences are presented with a felicitous prosodic structure in listening experiments. These predictions were confirmed by series of experiments measuring end-of-sentence comprehension time and cross-modal naming time for sentences with temporary syntactic closure ambiguities. Sentences with coinciding or conflicting prosodic and syntactic boundaries were compared to a prosodic baseline condition.This research was supported in part by NIMH grant R29 MH51768 to the first author and NIMH grant T32 MH19729 to the Northeastern University Psychology Department.     

Prosodic disambiguation of syntactic structure: for the speaker or for the addressee?

Evidence has been mixed on whether speakers spontaneously and reliably produce prosodic cues that resolve syntactic ambiguities. And when speakers do produce such cues, it is unclear whether they do so "for" their addressees (the audience design hypothesis) or "for" themselves, as a by-product of planning and articulating utterances. Three experiments addressed these issues. In Experiments 1 and 3, speakers followed pictorial guides to spontaneously instruct addressees to move objects. Critical instructions (e.g., "Put the dog in the basket on the star") were syntactically ambiguous, and the referential situation supported either one or both interpretations. Speakers reliably produced disambiguating cues to syntactic ambiguity whether the situation was ambiguous or not. However, Experiment 2 suggested that most speakers were not yet aware of whether the situation was ambiguous by the time they began to speak, and so adapting to addressees' particular needs may not have been feasible in Experiment 1. Experiment 3 examined individual speakers' awareness of situational ambiguity and the extent to which they signaled structure, with or without addressees present. Speakers tended to produce prosodic cues to syntactic boundaries regardless of their addressees' needs in particular situations. Such cues did prove helpful to addressees, who correctly interpreted speakers' instructions virtually all the time. In fact, even when speakers produced syntactically ambiguous utterances in situations that supported both interpretations, eye-tracking data showed that 40% of the time addressees did not even consider the non-intended objects. We discuss the standards needed for a convincing test of the audience design hypothesis.     

Lexical and Prosodic Effects on Syntactic Ambiguity Resolution in Aphasia

The purpose of this study was to determine whether and when individuals with aphasia and healthy controls use lexical and prosodic information during on-line sentence comprehension. Individuals with aphasia and controls (n = 12 per group) participated in a self-paced listening experiment. The stimuli were early closure sentences, such as "While the parents watched(,) the child sang a song." Both lexical and prosodic cues were manipulated. The cues were biased toward the subject- or object- of the ambiguous noun phrase (the child). Thus, there were two congruous conditions (in which both lexical cues and prosodic cues were consistent) and two incongruous conditions (in which lexical and prosodic cues conflicted). The results showed that the people with aphasia had longer listening times for the ambiguous noun phrase (the child) when the cues were conflicting, rather than consistent. The controls showed effects earlier in the sentence, at the subordinate verb (watched or danced). Both groups showed evidence of reanalysis at the main verb (sang). These effects demonstrate that the aphasic group was sensitive to the lexical and prosodic cues, but used them on a delayed time course relative to the control group.     

An interaction between prosody and statistics in the segmentation of fluent speech

Sensitivity to prosodic cues might be used to constrain lexical search. Indeed, the prosodic organization of speech is such that words are invariably aligned with phrasal prosodic edges, providing a cue to segmentation. In this paper we devise an experimental paradigm that allows us to investigate the interaction between statistical and prosodic cues to extract words from a speech stream. We provide evidence that statistics over the syllables are computed independently of prosody. However, we also show that trisyllabic sequences with high transition probabilities that straddle two prosodic constituents appear not to be recognized. Taken together, our findings suggest that prosody acts as a filter, suppressing possible word-like sequences that span prosodic constituents.     

Word segmentation with universal prosodic cues

When listening to speech from one’s native language, words seem to be well separated from one another, like beads on a string. When listening to a foreign language, in contrast, words seem almost impossible to extract, as if there was only one bead on the same string. This contrast reveals that there are language-specific cues to segmentation. The puzzle, however, is that infants must be endowed with a language-independent mechanism for segmentation, as they ultimately solve the segmentation problem for any native language. Here, we approach the acquisition problem by asking whether there are language-independent cues to segmentation that might be available to even adult learners who have already acquired a native language. We show that adult learners recognize words in connected speech when only prosodic cues to word-boundaries are given from languages unfamiliar to the participants. In both artificial and natural speech, adult English speakers, with no prior exposure to the test languages, readily recognized words in natural languages with critically different prosodic patterns, including French, Turkish and Hungarian. We suggest that, even though languages differ in their sound structures, they carry universal prosodic characteristics. Further, these language-invariant prosodic cues provide a universally accessible mechanism for finding words in connected speech. These cues may enable infants to start acquiring words in any language even before they are fine-tuned to the sound structure of their native language.     

Infants infer intentions from prosody

Two studies were conducted to examine infants’ ability to discern intentions from lexical and prosodic cues. Two groups of 14-18-month-olds participated in these studies. In both studies, infants watched an adult perform a sequence of two-step actions on novel toys that produced an end-result. In the first study actions were marked intentionally with both lexical and prosodic cues. In the second study, the lexical markers of intention were presented in Greek, thus providing infants with prosodic but not lexical cues. In both studies, infants reproduced more intentional than accidental actions, suggesting that infants can infer intentions from prosodic cues.     

The brain generates its own sentence melody: a Gestalt phenomenon in speech perception

Brain processes underlying spoken language comprehension comprise auditory encoding, prosodic analysis and linguistic evaluation. Auditory encoding usually activates both hemispheres while language-specific stages are lateralized: analysis of prosodic cues are right-lateralized while linguistic evaluation is left-lateralized. Here, we investigated to what extent the absence of prosodic information influences lateralization. MEG brain-responses indicated that syntactic violations lead to early bi-lateral brain responses for syntax violations. When the pitch of sentences was flattened to diminish prosodic cues, the brain's syntax response was lateralized to the right hemisphere, indicating that the missing pitch was generated automatically by the brain when it was absent. This represents a Gestalt phenomenon, since we perceive more than is actually presented.     

The specificity of age-related decline in interpretation of emotion cues from prosody

Older adults are not as good as younger adults at decoding prosodic emotions. We sought to determine the specificity of this finding. Performance of older and younger adults was compared on a prosodic emotion task, a "pure" prosodic emotion task, a linguistic prosody task, and a "pure" linguistic prosody task. Older adults were less accurate at interpreting prosodic emotion cues and nonemotional contours, concurrent semantic processing worsened interpretation, and performance was further degraded when identifying negative emotions and questions. Older adults display a pervasive problem interpreting prosodic cues, but further study is required to clarify the stage at which performance declines.     

普通话韵律词重音知觉

实验一研究了韵律词重音的多个声学相关物,及其对韵律词重音知觉贡献的大小,结果表明,按照贡献大小的次序,影响普通话韵律词重音感知的声学参数是：时长、音高、频谱倾斜和平均能量。实验二研究非声学参数因素对普通话韵律词重音知觉的影响,实验结果表明,听者关于普通话韵律词重音方面的语言学知识对韵律词重音的知觉有显著影响。     

口语加工中的词语切分线索

词是语言的基本结构单位, 对词语进行切分是语言加工的重要步骤。口语语流中的切分线索来自于语音、语义和语法三个方面。语音线索包括概率信息、音位配列规则和韵律信息, 韵律信息中还包括词重音、时长和音高等内容, 这些线索的使用在接触语言的早期阶段就逐渐被个体所掌握, 而且在不同的语言背景下有一定的特异性。语法和语义线索属于较高级的线索机制, 主要作用于词语切分过程的后期。后续研究应从语言的毕生发展和语言的特异性两个方面考察口语语言加工中的词语切分线索。     

The developing role of prosody in novel word interpretation

This study examined whether children use prosodic correlates to word meaning when interpreting novel words. For example, do children infer that a word spoken in a deep, slow, loud voice refers to something larger than a word spoken in a high, fast, quiet voice? Participants were 4- and 5-year-olds who viewed picture pairs that varied along a single dimension (e.g., big vs. small flower) and heard a recorded voice asking them, for example, “Can you get the blicket one?” spoken with either meaningful or neutral prosody. The 4-year-olds failed to map prosodic cues to their corresponding meaning, whereas the 5-year-olds succeeded (Experiment 1). However, 4-year-olds successfully mapped prosodic cues to word meaning following a training phase that reinforced children’s attention to prosodic information (Experiment 2). These studies constitute the first empirical demonstration that young children are able to use prosody-to-meaning correlates as a cue to novel word interpretation.     

Effects and Limitations of Prosodic and Semantic Biases on Syntactic Disambiguation

This paper examined the effects of prosody on the syntactic ambiguity resolution of Japanese sentences, especially with reference to the interaction with semantic bias. Syntactically ambiguous sentences with different types of semantic bias were constructed. The degree of bias in each sentence was evaluated through visual presentation experiments. Three types of sentences were selected based on the results of visual presentation experiments, were recorded with prosody maximally favoring each possible interpretation of the sentences, and were used as the stimuli for the auditory presentation experiments. The results showed that prosodic cues can influence the interpretation of a sentence even when the sentence is strongly semantically biased. The results also showed a limitation to prosodic cues. The prosodic biases alone were not sufficient to fully determine the interpretation of the sentences even when the sentences were neutrally biased semantically.     

口语句子的韵律边界：窥探言语理解的秘窗

韵律边界加工与言语理解紧密相关, 最近十几年来逐渐成为心理学和语言学的研究焦点。韵律系统包含若干由小到大的韵律单位, 不同单位的韵律成分其边界强度不同, 表现在音高、延宕和停顿三个声学线索上的参数也不同。句子的听力理解过程中, 听话人运用声学线索感知权重策略对韵律边界的声学线索进行加工。从神经层面上来看, 对于韵律边界的加工, 大脑显示出独立且特异性的神经机制。韵律边界的加工能力在婴儿出生后随年龄的增长而发展, 到了老年阶段则逐渐退化, 而且似乎能够对二语迁移。未来, 需要扩大对韵律边界声学表现的考查范围, 进一步明确韵律边界的加工过程, 进一步厘清韵律边界加工和句法加工之间的关系, 进一步关注二语者韵律边界加工能力的发展。     

Understanding speaker attitudes from prosody by adults with Parkinson's disease

The ability to interpret vocal (prosodic) cues during social interactions can be disrupted by Parkinson's disease, with notable effects on how emotions are understood from speech. This study investigated whether PD patients who have emotional prosody deficits exhibit further difficulties decoding the attitude of a speaker from prosody. Vocally inflected but semantically nonsensical ‘pseudo‐utterances’ were presented to listener groups with and without PD in two separate rating tasks. Task 1 required participants to rate how confident a speaker sounded from their voice and Task 2 required listeners to rate how polite the speaker sounded for a comparable set of pseudo‐utterances. The results showed that PD patients were significantly less able than HC participants to use prosodic cues to differentiate intended levels of speaker confidence in speech, although the patients could accurately detect the polite/impolite attitude of the speaker from prosody in most cases. Our data suggest that many PD patients fail to use vocal cues to effectively infer a speaker's emotions as well as certain attitudes in speech such as confidence, consistent with the idea that the basal ganglia play a role in the meaningful processing of prosodic sequences in spoken language ( Pell & Leonard, 2003 ).     

What can prosody tell a parser?

In this paper, I consider how a sentence processor might use specific prosodic cues at various points in the processing of particular sentences containing (at least temporary) syntactic ambiguity. In principle, the usefulness of prosodic information depends on what a given cluster of prosodic cues typically signifies, and on which syntactic options exist for a given string: in only some instances can prosodic information provide useful disambiguating information.This work was supported by Grant #DC-01409, a Research and Training Grant funded by the National Institute on Deafness and Other Communicative Disorders to the National Center for Neurogenic Communication Disorders, University of Arizona. I wish to thank Andrew Barss for very helpful comments on an earlier draft of this paper.