失歌症者对音乐和言语音高的加工

音高是音乐和言语领域中一个重要维度。失歌症是一种对音乐音高加工的障碍。探讨失歌症者对音乐和言语音高的加工有助于揭示音乐和言语音高加工是否共享特定的认知和神经机制。已有研究结果表明, 失歌症者对音乐音高加工存在障碍, 这种音高障碍在一定程度上影响到言语音高加工。同时, 声调语言背景无法弥补失歌症者的音高障碍。这些研究结果支持了资源－共享框架(resource-sharing framework), 即音乐和语言共享特定的认知和神经机制(Patel, 2003, 2008, in press), 并可能在一定程度上为失语症临床治疗提供借鉴。     

音乐句法加工的影响因素

音乐句法是指将离散的音符元素组合成序列的规则。音乐句法加工受到音乐结构特征和听众自身特征两个方面的影响。针对每个方面,本文聚焦于近年来进展迅速的几个因素进行评述,分别是依存距离和音乐时间结构,听者的年龄和音乐训练程度。未来研究应进一步比较不同距离的句法加工,澄清音乐时间结构何时并且如何影响句法加工,考察音乐句法加工中遗传和环境的作用以及发展的敏感期,并对这些因素之间的共同影响展开研究。     

绝对音高者对音乐的加工及其神经机制

绝对音高感是一种特殊的音高命名能力。通过论述绝对音高能力与音乐加工的关系,发现绝对音高者具有对音高、音程和旋律的加工优势,但他们对相对音高的加工存在劣势。同时,与非绝对音高者相比,绝对音高者大脑结构和功能都表现出特殊性。未来研究应进一步厘清音乐训练对绝对音高者音乐加工的影响。     

绝对音高感对音乐句法加工能力的影响

绝对音高感是一种敏锐的音高知觉能力。拥有这种能力的人可以在没有标准音(A4)参照下, 对所听到的音高进行命名。本文通过对比绝对音高感被试与不具有绝对音高感被试对音乐句法基本规则的知觉以及对音乐句法结构划分能力的差异, 探讨绝对音高感与音乐句法加工能力之间的关系。结果表明, 绝对音高感被试对音乐句法基本规则的知觉水平高于控制组; 同时, 这种知觉上的优势也延伸到他们对音乐句法结构的划分。这一结果说明, 绝对音高感被试不仅可以对音高进行孤立命名, 而且表现出对调性音乐音高关系加工的优势。     

绝对音高加工的认知神经机制

绝对音高(absolute pitch,AP)是一种比较罕见的音高加工能力,具有特殊的认知和神经机制。事件相关电位研究表明AP音乐家进行音高命名时,工作记忆参与较少但涉及多个认知策略。功能神经成像研究发现左侧额叶背侧后部和左侧颞叶平面对AP音乐家非常重要,而准AP音乐家(quasi-AP)的某些右侧脑区的参与则反映其增加的音高加工负荷和难度。结构神经成像研究发现AP音乐家具有特殊的灰质结构形态及白质连接。未来研究有待将AP能力进一步分为"具有相对音高能力"与"没有相对音高能力"两类并观察相应的认知神经机制,并通过影像基因组学来探索基因多态性对AP能力的影响,以及有必要观察以声调语言为母语的音乐家进行音高加工的神经机制。     

音乐绝对音高信息加工的脑机制

音乐绝对音高(absolute pitch, AP)一直是音乐心理学者感兴趣的问题。AP能力是一种特殊的音乐能力。ERP研究表明具有AP能力的群体只需较少的认知资源进行音高加工, 同时不同AP能力的加工机制也不同; 功能神经成像研究表明大脑左侧额叶背侧后部和左侧颞叶平面对AP加工发挥重要作用; 脑结构研究发现AP群体的某些脑区皮层厚度低于没有绝对音高能力(Non-AP)群体, 这可能与AP特殊的加工机制有关。AP能力形成需要先天遗传和后天环境的共同作用, 其相互作用的脑机制需结合行为遗传学的研究方法及成果。     

声调范畴感知和声调复杂度对音乐音高感知的跨领域影响

采用音高识别与区分任务, 以汉语母语者、越南语母语者和俄语母语者为研究对象, 考察了两个语言加工层面的因素, 即声调范畴感知模式以及不同语言声调系统的复杂度差异对跨领域音乐音高感知的影响。结果发现: (1)汉语和越南语两组声调语言母语者听辨结果符合范畴感知模式, 而俄语母语者是连续感知。在语言和音乐两种刺激条件下, 声调语言母语者在范畴边界宽度、范畴内区分率、范畴间区分率以及区分峰度等指标上不存在显著差异。(2)汉语和越南语两组声调语言母语者的音乐音高区分任务结果差异不显著。实验结果表明: 在行为层面, 母语声调范畴感知模式可以迁移到音乐音高感知中, 但复杂声调系统并不能促进跨领域的音乐音高精细感知。实验结果从语言对音乐音高加工影响的角度支持了“共享论”。     

音乐对语言加工的影响——来自ERP的证据

向音乐人和非音乐人分别同时呈现句末词有无词类范畴违反的句子，和结尾和弦有无和弦句法违反的和弦序列，并采用ERP(event-related potential，事件相关电位)技术观察被试音乐加工对句子加工的影响。结论是，汉语句子和和弦序列的句法整合加工之间似乎共享神经资源。这两种句法整合加工机制性质相同，能相互促进。音乐训练对语言和音乐句法整合加工的神经资源共享性有调节作用。     

音乐与语言的关系：来自句法、语义与音调节奏感知的神经活动证据

音乐和语言加工神经基础的关系研究,近年来发展迅速,获得了越来越多的关注。“共享结构整合资源假说”主张音乐的句法加工和语言的句法加工具有较大程度的神经资源的共享。在听觉语言实验中反映句法违例的ERP ELAN与音乐句法违例引发的ERAN极为相似,唯一的区别仅在于它们的分布有所不同——ERAN就像是一个两半球对称的ELAN。而且ERAN的引发不受是否接受过音乐训练这一因素的影响,虽然音乐人被试引发的ERAN波幅更大。一些研究发现音乐语义加工的神经基础为N400和N500。前者可以由音乐和语言两种刺激引发,后者只能由音乐意义的加工引发。然而,音乐的音调感知和语言的音调感知是否共享了神经资源,却还没有确定的结论。     

语言和音乐层级结构的加工

语言和音乐在呈现过程中, 小单元相互结合组成更大的单元, 最终形成层级结构。已有研究表明, 听者能够将连续的语流和音乐切分成层级结构, 并在大脑中形成层级表征。在感知基础之上, 听者还能将新出现的语言和音乐事件整合到层级结构之中, 形成连贯理解, 最终顺利地完成交流过程。未来研究应剖析边界线索在层级结构感知中的作用, 考察不同层级整合过程的影响因素, 进一步探索语言和音乐层级结构加工的关系。     

The nature of music from a biological perspective

Music, as language, is a universal human trait. Throughout human history and across all cultures, people have produced and enjoyed music. Despite its ubiquity, the musical capacity is rarely studied as a biological function. Music is typically viewed as a cultural invention. In this paper, the evidence bearing on the biological perspective of the musical capacity is reviewed. Related issues, such as domain-specificity, innateness, and brain localization, are addressed in an attempt to offer a unified conceptual basis for the study of music processing. This scheme should facilitate the study of the biological foundations of music by bringing together the fields of genetics, developmental and comparative research, neurosciences, and musicology.     

Making psycholinguistics musical: Self-paced reading time evidence for shared processing of linguistic and musical syntax

Linguistic processing, especially syntactic processing, is often considered a hallmark of human cognition; thus, the domain specificity or domain generality of syntactic processing has attracted considerable debate. The present experiments address this issue by simultaneously manipulating syntactic processing demands in language and music. Participants performed self-paced reading of garden path sentences, in which structurally unexpected words cause temporary syntactic processing difficulty. A musical chord accompanied each sentence segment, with the resulting sequence forming a coherent chord progression. When structurally unexpected words were paired with harmonically unexpected chords, participants showed substantially enhanced garden path effects. No such interaction was observed when the critical words violated semantic expectancy or when the critical chords violated timbral expectancy. These results support a prediction of the shared syntactic integration resource hypothesis (Patel, 2003), which suggests that music and language draw on a common pool of limited processing resources for integrating incoming elements into syntactic structures. Notations of the stimuli from this study may be downloaded from pbr.psychonomic-journals.org/content/supplemental.     

Shared structural and temporal integration resources for music and arithmetic processing

While previous research has investigated the relationship either between language and music processing or between language and arithmetic processing, the present study investigated the relationship between music and arithmetic processing. Rule-governed number series, with the final number being a correct or incorrect series ending, were visually presented in synchrony with musical sequences, with the final chord functioning as the expected tonic or the less-expected subdominant chord (i.e., tonal function manipulation). Participants were asked to judge the correctness of the final number as quickly and accurately as possible. The results revealed an interaction between the processing of series ending and the processing of the task-irrelevant chords' tonal function, thus suggesting that music and arithmetic processing share cognitive resources. These findings are discussed in terms of general temporal and structural integration resources for linguistic and non-linguistic rule-governed sequences.     

Challenging prior evidence for a shared syntactic processor for language and music

A theoretical landmark in the growing literature comparing language and music is the shared syntactic integration resource hypothesis (SSIRH; e.g., Patel, 2008), which posits that the successful processing of linguistic and musical materials relies, at least partially, on the mastery of a common syntactic processor. Supporting the SSIRH, Slevc, Rosenberg, and Patel (Psychonomic Bulletin & Review 16(2):374–381, 2009) recently reported data showing enhanced syntactic garden path effects when the sentences were paired with syntactically unexpected chords, whereas the musical manipulation had no reliable effect on the processing of semantic violations. The present experiment replicated Slevc et al.’s (2009) procedure, except that syntactic garden paths were replaced with semantic garden paths. We observed the very same interactive pattern of results. These findings suggest that the element underpinning interactions is the garden path configuration, rather than the implication of an alleged syntactic module. We suggest that a different amount of attentional resources is recruited to process each type of linguistic manipulations, hence modulating the resources left available for the processing of music and, consequently, the effects of musical violations.     

The tonal function of a task-irrelevant chord modulates speed of visual processing

Harmonic priming studies have provided evidence that musical expectations influence sung phoneme monitoring, with facilitated processing for phonemes sung on tonally related (expected) chords in comparison to less-related (less-expected) chords [Bigand, Tillmann, Poulin, D’Adamo, and Madurell (2001). The effect of harmonic context on phoneme monitoring in vocal music. Cognition, 81, B11–B20]. This tonal relatedness effect has suggested two interpretations: (a) processing of music and language interact at some level of processing; and (b) tonal functions of chords influence task performance via listeners’ attention. Our study investigated these hypotheses by exploring whether the effect of tonal relatedness extends to the processing of visually presented syllables (Experiments 1 and 2) and geometric forms (Experiments 3 and 4). For Experiments 1–4, visual target identification was faster when the musical background fulfilled listeners’ expectations (i.e., a related chord was played simultaneously). In Experiment 4, the addition of a baseline condition (i.e., without an established tonal center) further showed that the observed difference was due to a facilitation linked to the related chord and not to an inhibition or disruption caused by the less-related chord. This outcome suggests the influence of musical structures on attentional mechanisms and that these mechanisms are shared between auditory and visual modalities. The implications for research investigating neural correlates shared by music and language processing are discussed.     

音乐传达哲理性概念的认知神经机制

哲理性概念是音乐表现的对象之一。由于音乐不具有类似语言的语义性, 对哲理性概念的理解常常成为音乐欣赏者的困扰。基于此, 本项目聚焦于听者对哲理性概念的理解。通过选取音乐训练经历不同的人群为被试, 系统考察哲理性概念加工的认知神经机制。本项目成果将揭示音乐诱发哲理性概念加工的神经机制, 厘清音乐训练对音乐外在意义加工的作用, 从而在一定程度上回答人类对音乐意义理解的普遍性问题。     

Structural integration in language and music: Evidence for a shared system

In this study, we investigate whether language and music share cognitive resources for structural processing. We report an experiment that used sung materials and manipulated linguistic complexity (subject-extracted relative clauses, object-extracted relative clauses) and musical complexity (in-key critical note, out-of-key critical note, auditory anomaly on the critical note involving a loudness increase). The auditory-anomaly manipulation was included in order to test whether the difference between in-key and out-of-key conditions might be due to any salient, unexpected acoustic event. The critical dependent measure involved comprehension accuracies to questions about the propositional content of the sentences asked at the end of each trial. The results revealed an interaction between linguistic and musical complexity such that the difference between the subject- and object-extracted relative clause conditions was larger in the out-of-key condition than in the in-key and auditory-anomaly conditions. These results provide evidence for an overlap in structural processing between language and music.     

The processing of rhythmic structures in music and prosody by children with developmental dyslexia and developmental language disorder

Rhythm perception seems to be crucial to language development. Many studies have shown that children with developmental dyslexia and developmental language disorder have difficulties in processing rhythmic structures. In this study, we investigated the relationships between prosody and musical processing in Italian children with typical and atypical development. The tasks aimed to reproduce linguistic prosodic structures through musical sequences, offering a direct comparison between the two domains without violating the specificities of each one. About 16 Typically Developing children, 16 children with a diagnosis of Developmental Dyslexia, and 16 with a diagnosis of developmental language disorder (age 10–13 years) participated in the experimental study. Three tasks were administered: an association task between a sentence and its humming version, a stress discrimination task (between couples of sounds reproducing the intonation of Italian trisyllabic words), and an association task between trisyllabic nonwords with different stress position and three‐notes musical sequences with different musical stress. Children with developmental language disorder perform significantly lower than Typically Developing children on the humming test. By contrast, children with developmental dyslexia are significantly slower than TD in associating nonwords with musical sequences. Accuracy and speed in the experimental tests correlate with metaphonological, language, and word reading scores. Theoretical and clinical implications are discussed within a multidimensional model of neurodevelopmental disorders including prosodic and rhythmic skills at word and sentence level.     

Computer graphics in music performance research

Theories of skilled music performance must account for variations on what is written in traditional musical notation. Some variations are intentional and reflect structural features of the music that are chosen for emphasis by the performer. Current music notations are inadequate to reflect these variations. Computer applications are described that allow graphical and statistical examination of performance variations on traditional musical notation. An integrated set of visual and sound tools is provided that allows music to be recorded, edited, analyzed, and played back on electronic and acoustic musical instruments. The graphical format allows flexibility through the use of windows, compression, expansion, and scrolling of multiple sources of information, mapping of acoustic to visual dimensions, and scaling of different performance parameters without normalization. Experimental evidence from piano performances is used to demonstrate how graphical formats can aid research on human performance.