语言和音乐中短语边界的认知加工

综述了近年来语言和音乐中有关短语边界加工的一些研究成果。首先,语言中使用事件相关电位技术（ERP）进行的众多研究表明,口语中的语调短语边界和阅读中的逗号都能诱发中止正漂移（CPS）这种反映语调短语中止的ERP成分。然后介绍了近期关于音乐短语结构的一系列ERP和事件相关磁场（ERF）研究,结果发现在各种实验条件下音乐CPS都能够稳定产生。最后,对今后汉语韵律层级结构边界的认知加工研究做出展望     

绝句韵律边界的认知加工及其脑电效应

语言理解过程中, 句子内部的韵律短语边界会诱发反映韵律短语终止的特异性脑电成分终止正漂移 (CPS, closure positive shift), 而句末语调短语边界则会诱发反映句法终止和完整语言单元结束的脑电效应P3。研究采用汉语特有的语篇绝句, 考察了听者加工绝句中各句末语调短语边界的认知过程及其诱发的脑电效应。结果发现五言绝句内部各语调短语边界分别诱发了时间进程、头皮分布和波幅均相同的CPS, 表明语篇内部韵律边界加工不受其所处语篇位置的影响; 五言和七言绝句末的韵律边界则分别诱发了一个P3, 并且前者诱发的P3波幅小于后者, 而二者在时间进程和头皮分布上不存在差异。本研究表明, 句末语调短语边界诱发何种脑电效应与其承担的功能有关, 既表示前面信息终止又预期后面信息出现的句末边界会诱发CPS, 而只表示信息终止的句末边界则会诱发P3。     

Electrophysiological correlates of prosody and punctuation

Psycholinguistic models of sentence parsing are primarily based on reading rather than auditory processing data. Moreover, both prosodic information and its potential orthographic equivalent, i.e., punctuation, have been largely ignored until recently. The unavailability of experimental online methods is one likely reason for this neglect. Here I give an overview of six event-related brain potential (ERP) studies demonstrating that the processing of both prosodic boundaries in natural speech and commas during silent reading can determine syntax parsing immediately. In ERPs, speech boundaries and commas reliably elicit a similar online brain response, termed the Closure Positive Shift (CPS). This finding points to a common mechanism, suggesting that commas serve as visual triggers for covert phonological phrasing. Alternative CPS accounts are tested and the relationship between the CPS and other ERP components, including the P600/SPS, is addressed.     

Time-driven effects on parsing during reading

The phonological trace of perceived words starts fading away in short-term memory after a few seconds. Spoken utterances are usually 2-3 s long, possibly to allow the listener to parse the words into coherent prosodic phrases while they still have a clear representation. Results from this brain potential study suggest that even during silent reading, words are organized into 2-3 s long ‘implicit’ prosodic phrases. Participants read the same sentences word by word at different presentation rates. Clause-final words occurring at multiples of 2-3 s from sentence onset yielded increased positivity, irrespective of presentation rate. The effect was interpreted as a closure positive shift (CPS), reflecting insertion of implicit prosodic phrase boundaries every 2-3 s. Additionally, in participants with low working memory span, clauses over 3 s long produced a negativity, possibly indicating increased working memory load.     

口语句子的韵律边界：窥探言语理解的秘窗

韵律边界加工与言语理解紧密相关, 最近十几年来逐渐成为心理学和语言学的研究焦点。韵律系统包含若干由小到大的韵律单位, 不同单位的韵律成分其边界强度不同, 表现在音高、延宕和停顿三个声学线索上的参数也不同。句子的听力理解过程中, 听话人运用声学线索感知权重策略对韵律边界的声学线索进行加工。从神经层面上来看, 对于韵律边界的加工, 大脑显示出独立且特异性的神经机制。韵律边界的加工能力在婴儿出生后随年龄的增长而发展, 到了老年阶段则逐渐退化, 而且似乎能够对二语迁移。未来, 需要扩大对韵律边界声学表现的考查范围, 进一步明确韵律边界的加工过程, 进一步厘清韵律边界加工和句法加工之间的关系, 进一步关注二语者韵律边界加工能力的发展。     

Utilization of Prosodic Information in Syntactic Ambiguity Resolution

Two self paced listening experiments examined the role of prosodic phrasing in syntactic ambiguity resolution. In Experiment 1, the stimuli consisted of early closure sentences (e.g., “While the parents watched, the child sang a song.”) containing transitive-biased subordinate verbs paired with plausible direct objects or intransitive-biased subordinate verbs paired with implausible direct objects. Experiment 2 also contained early closure sentences with transitively and intransitive-biased subordinate verbs, but the subordinate verbs were always followed by plausible direct objects. In both experiments, there were two prosodic conditions. In the subject-biased prosodic condition, an intonational phrase boundary marked the clausal boundary following the subordinate verb. In the object-biased prosodic condition, the clause boundary was unmarked. The results indicate that lexical and prosodic cues interact at the subordinate verb and plausibility further affects processing at the ambiguous noun. Results are discussed with respect to models of the role of prosody in sentence comprehension.     

Prosodic boundaries, comma rules, and brain responses: the closure positive shift in ERPs as a universal marker for prosodic phrasing in listeners and readers

Just as the false comma in this sentence, shows punctuation can influence sentence processing considerably. Pauses and other prosodic cues in spoken language serve the same function of structuring the sentence in smaller phrases. However, surprisingly little effort has been spent on the question as to whether both phenomena rest on the same mechanism and whether they are equally efficient in guiding parsing decisions. In a recent study, we showed that auditory speech boundaries evoke a specific positive shift in the listeners' event-related brain potentials (ERPs) that indicates the sentence segmentation and resulting changes in the understanding of the utterance (Steinhauer et al., 1999a). Here, we present three ERP reading experiments demonstrating that the human brain processes commas in a similar manner and that comma perception depends crucially on the reader's individual punctuation habits. Main results of the study are: (1) Commas can determine initial parsing as efficiently as speech boundaries because they trigger the same prosodic phrasing covertly, although phonological representations seem to be activated to a lesser extent. (2) Independent of the input modality, this phrasing is reflected online by the same ERP component, namely the Closure Positive Shift (CPS). (3) Both behavioral and ERP data suggest that comma processing varies with the readers' idiosyncratic punctuation habits. (4) A combined auditory and visual ERP experiment shows that the CPS is also elicited both by delexicalized prosody and while subjects replicate prosodic boundaries during silent reading. (5) A comma-induced reversed garden path turned out to be much more difficult than the classical garden path. Implications for psycholinguistic models and future ERP research are discussed.     

Structural packaging in the input to language learning: Contributions of prosodic and morphological marking of phrases to the acquisition of language

The linguistic input to language learning is usually thought to consist of simple strings of words. We argue that input must also include information about how words group into syntactic phrases. Natural languages regularly incorporate correlated cues to phrase structure, such as prosody, function words, and concord morphology. The claim that such cues are necessary for successful acquisition of syntax was tested in a series of miniature language learning experiments with adult subjects. In each experiment, when input included some cue marking the phrase structure of sentences, subjects were entirely successful in learning syntax; in contrast, when input lacked such a cue (but was otherwise identical), subjects failed to learn significant portions of syntax. Cues to phrase structure appear to facilitate learning by indicating to the learner those domains within which distributional analyses may be most efficiently pursued, thereby reducing the amount and complexity of required input data. More complex target systems place greater premiums on efficient analysis; hence, such cues may be even more crucial for acquisition of natural language syntax. We suggest that the finding that phrase structure cues are a necessary aspect of language input reflects the limited capacities of human language learners; languages may incorporate structural cues in part to circumvent such limitations and ensure successful acquisition.     

The role of syntactic obligatoriness in the production of intonational boundaries

Researchers have hypothesized that words that are highly related semantically are more likely to occur within the same intonational phrase (F. zzaq;, 1988; E. O. Selkirk, 1984). D. Watson and E. Gibson (2004) proposed that semantic closeness can be captured by using the argument/adjunct distinction, such that intonational boundaries are more likely to occur before adjuncts than before arguments. In the current experiment, the authors compared two aspects of argumenthood: semantic relatedness and obligatoriness. In a production study, speakers were more likely to place an intonational phrase boundary between a word and a dependent if the dependent was optional (e.g., after "investigation" in "The reporter's investigation [of the crash] unnerved the officials") than if the dependent was obligatory (e.g., after "investigated" in "The reporter investigated [the crash], and this unnerved the officials"). These data suggest that obligatoriness is a better predictor of intonational boundary placement than semantic closeness.     

绝对音高感对音乐句法加工能力的影响

绝对音高感是一种敏锐的音高知觉能力。拥有这种能力的人可以在没有标准音(A4)参照下, 对所听到的音高进行命名。本文通过对比绝对音高感被试与不具有绝对音高感被试对音乐句法基本规则的知觉以及对音乐句法结构划分能力的差异, 探讨绝对音高感与音乐句法加工能力之间的关系。结果表明, 绝对音高感被试对音乐句法基本规则的知觉水平高于控制组; 同时, 这种知觉上的优势也延伸到他们对音乐句法结构的划分。这一结果说明, 绝对音高感被试不仅可以对音高进行孤立命名, 而且表现出对调性音乐音高关系加工的优势。     

言语产生中的韵律生成

首先描述了韵律生成的相关模型。然后以研究的问题为着眼点,回顾了言语产生中韵律生成的相关研究。发现大多数研究结果都证明,在单词产生过程中,存在一个独立于音段内容的抽象韵律结构,其中包含了词的重音模式和音节数量等信息;在短语和句子产生过程中,韵律结构和停顿模式都不是完全决定于句法结构,而具有相对的独立性;句子韵律产生的最佳单位是韵律词。语言学韵律产生的脑区激活呈左侧化趋势。     

The brain generates its own sentence melody: a Gestalt phenomenon in speech perception

Brain processes underlying spoken language comprehension comprise auditory encoding, prosodic analysis and linguistic evaluation. Auditory encoding usually activates both hemispheres while language-specific stages are lateralized: analysis of prosodic cues are right-lateralized while linguistic evaluation is left-lateralized. Here, we investigated to what extent the absence of prosodic information influences lateralization. MEG brain-responses indicated that syntactic violations lead to early bi-lateral brain responses for syntax violations. When the pitch of sentences was flattened to diminish prosodic cues, the brain's syntax response was lateralized to the right hemisphere, indicating that the missing pitch was generated automatically by the brain when it was absent. This represents a Gestalt phenomenon, since we perceive more than is actually presented.     

Neurophysiological preconditions of syntax acquisition

Although the neural network for language processing in the adult brain is well specified, the neural underpinning of language acquisition is still underdetermined. Here, we define the milestones of syntax acquisition and discuss the possible neurophysiological preconditions thereof. Early language learning seems to be based on the bilateral temporal cortices. Subsequent syntax acquisition apparently primarily recruits a neural network involving the left frontal cortex and the temporal cortex connected by a ventrally located fiber system. The late developing ability to comprehend syntactically complex sentences appears to require a neural network that connects Broca’s area to the left posterior temporal cortex via a dorsally located fiber pathway. Thus, acquisition of syntax requires the maturation of fiber bundles connecting the classical language-relevant brain regions.     

Hemispheric asymmetries in children's perception of nonlinguistic human affective sounds

In the present work, we developed a database of nonlinguistic sounds that mirror prosodic characteristics typical of language and thus carry affective information, but do not convey linguistic information. In a dichotic-listening task, we used these novel stimuli as a means of disambiguating the relative contributions of linguistic and affective processing across the hemispheres. This method was applied to both children and adults with the goal of investigating the role of developing cognitive resource capacity on affective processing. Results suggest that children's limited computational resources influence how they process affective information and rule out attentional biases as a factor in children's perceptual asymmetries for nonlinguistic affective sounds. These data further suggest that investigation of perception of nonlinguistic affective sounds is a valuable tool in assessing interhemispheric asymmetries in affective processing, especially in parceling out linguistic contributions to hemispheric differences.     

Modeling the Developmental Patterning of Finiteness Marking in English, Dutch, German, and Spanish Using MOSAIC

In this study, we apply MOSAIC (model of syntax acquisition in children) to the simulation of the developmental patterning of children's optional infinitive (OI) errors in 4 languages: English, Dutch, German, and Spanish. MOSAIC, which has already simulated this phenomenon in Dutch and English, now implements a learning mechanism that better reflects the theoretical assumptions underlying it, as well as a chunking mechanism that results in frequent phrases being treated as 1 unit. Using 1, identical model that learns from child-directed speech, we obtain a close quantitative fit to the data from all 4 languages despite there being considerable cross-linguistic and developmental variation in the OI phenomenon. MOSAIC successfully simulates the difference between Spanish (a pro-drop language in which OI errors are virtually absent) and obligatory subject languages that do display the OI phenomenon. It also highlights differences in the OI phenomenon across German and Dutch, 2 closely related languages whose grammar is virtually identical with respect to the relation between finiteness and verb placement. Taken together, these results suggest that (a) cross-linguistic differences in the rates at which children produce OIs are graded, quantitative differences that closely reflect the statistical properties of the input they are exposed to and (b) theories of syntax acquisition need to consider more closely the role of input characteristics as determinants of quantitative differences in the cross-linguistic patterning of phenomena in language acquisition.     

Learn locally, act globally: Learning language from variation set cues

Variation set structure - partial overlap of successive utterances in child-directed speech - has been shown to correlate with progress in children’s acquisition of syntax. We demonstrate the benefits of variation set structure directly: in miniature artificial languages, arranging a certain proportion of utterances in a training corpus in variation sets facilitated word and phrase constituent learning in adults. Our findings have implications for understanding the mechanisms of L1 acquisition by children, and for the development of more efficient algorithms for automatic language acquisition, as well as better methods for L2 instruction.     

English derivational suffix frequency and children's stress judgments

Considering the importance of word and stem frequency in the adult lexical processing literature, and the effect of input frequency on children's acquisition of words (Tardif, Shatz, and Naigles, 1997), it was hypothesized that children's acquisition of English morphologically conditioned stress alternations would be affected by the frequency with which children were exposed to different stress-changing suffixes (e.g., -tion, -ity, and -ic). Study 1 determined the proportional representation of suffixes in a children's literature corpus, thereby allowing the suffix variable to be established. Study 2 empirically examined the effect of suffix frequency on school-aged children's judgments of primary stress placement. Findings suggest that age and suffix frequency both play a role in children's awareness of stress placement.