Structural integration in language and music: Evidence for a shared system

In this study, we investigate whether language and music share cognitive resources for structural processing. We report an experiment that used sung materials and manipulated linguistic complexity (subject-extracted relative clauses, object-extracted relative clauses) and musical complexity (in-key critical note, out-of-key critical note, auditory anomaly on the critical note involving a loudness increase). The auditory-anomaly manipulation was included in order to test whether the difference between in-key and out-of-key conditions might be due to any salient, unexpected acoustic event. The critical dependent measure involved comprehension accuracies to questions about the propositional content of the sentences asked at the end of each trial. The results revealed an interaction between linguistic and musical complexity such that the difference between the subject- and object-extracted relative clause conditions was larger in the out-of-key condition than in the in-key and auditory-anomaly conditions. These results provide evidence for an overlap in structural processing between language and music.     

Idiomatic syntactic constructions and language learning

This article explores the influence of idiomatic syntactic constructions (i.e., constructions whose phrase structure rules violate the rules that underlie the construction of other kinds of sentences in the language) on the acquisition of phrase structure. In Experiment 1, participants were trained on an artificial language generated from hierarchical phrase structure rules. Some participants were given exposure to an idiomatic construction (IC) during training, whereas others were not. Under some circumstances, the presence of an idiomatic construction in the input aided learners in acquiring the phrase structure of the language. Experiment 2 provides a replication of the first experiment and extends the findings by showing that idiomatic constructions that strongly violate the predictive dependencies that define the phrase structure of the language do not aid learners in acquiring the structure of the language. Together, our data suggest that (a) idiomatic constructions aid learners in acquiring the phrase structure of a language by highlighting relevant structural elements in the language, and (b) such constructions are useful cues to learning to the extent that learners can keep their knowledge of the idiomatic construction separate from their knowledge of the rest of the language.     

The influence of language exposure on lexical and syntactic language processing

Previous literature has argued that proficient bilingual speakers often demonstrate monolingual-equivalent structural processing of language (e.g., the processing of structural ambiguities; Frenck-Mestre, 2002). In this paper, we explore this thesis further via on-line examination of the processing of syntactically complex structures with three populations: those who classify as monolingual native English speaker (MNES), those who classify as non-native English speakers (NNES), and those who calssify as bilingual native English speakers (BNES). On-line measures of processing of object-relative constructions demonstrated that both NNES and BNES have different patterns of performance as compared to MNES. Further, NNES and BNES speakers perform differently from one another in such processing. The study also examines the activation of lexical information in biasing contexts, and suggests that different processes are at work in the different type of bilinguals examined here. The nature of these differences and the implications for developing sensitive models of on-line language comprehension are developed and discussed.     

Spiritual care illustrated: creating a shared language

In an attempt to schematically illustrate the pastoral care intervention to scientifically minded professionals and colleagues the author developed a model that can be used as an interdisciplinary teaching tool. Within the setting of hospital ministry, the tool also provides insights into the stages of "crisis experience" and illustrates the transformational process involved in The Healing Journey. These change-processes are explained against the background of a multi-level anthropology. This approach births a Healing Journey diagram, a spiritual pain assessment tool, and a seven-phase intervention model that may be helpful in Clinical Pastoral Education.     

Word recognition and syntactic attachment in reading: evidence for a staged architecture

In 3 experiments, the author examined how readers' eye movements are influenced by joint manipulations of a word's frequency and the syntactic fit of the word in its context. In the critical conditions of the first 2 experiments, a high- or low-frequency verb was used to disambiguate a garden-path sentence, while in the last experiment, a high- or low-frequency verb constituted a phrase structure violation. The frequency manipulation always influenced the early eye movement measures of first-fixation duration and gaze duration. The context manipulation had a delayed effect in Experiment 1, influencing only the probability of a regressive eye movement from later in the sentence. However, the context manipulation influenced the same early eye movement measures as the frequency effect in Experiments 2 and 3, though there was no statistical interaction between the effects of these variables. The context manipulation also influenced the probability of a regressive eye movement from the verb, though the frequency manipulation did not. These results are shown to confirm predictions emerging from the serial, staged architecture for lexical and integrative processing of the E-Z Reader 10 model of eye movement control in reading (Reichle, Warren, & McConnell, 2009). It is argued, more generally, that the results provide an important constraint on how the relationship between visual word recognition and syntactic attachment is treated in processing models.     

The syntactic priming effect: Evoked response evidence for a prelexical locus

Twenty subjects made lexical decisions in a syntactic priming paradigm. Target stimuli (nouns, verbs, abiguous noun--verb words, and nonsense words) were immediately preceded on each trial by a function word syntactic prime, creating appropriate or inappropriate syntactic contexts for the real word targets. Evoked responses to the targets were recorded from left and right frontal, temporal, and temporoparietal sites. Principal components analysis revealed a component peaking at 140 msec which discriminated words in appropriate contexts from words in inappropriate contexts, independent of lexical syntactic class, with maximal discrimination at temporoparietal sites. Evidence for the identification of the syntactic class of target items was not observed in the evoked response until 80 msec after this syntactic priming effect occurred. These results suggest a prelexical locus for the syntactic priming effect. The implications of these results for current conceptions of the modularity of the mental lexicon are discussed.     

音乐句法加工的认知机制与音乐结构的影响模式

音乐和语言是人类最重要的两种交流系统。与语言一样, 音符的排列和组织也是建立在一定的句法规则之上。尽管现有研究发现听众具有感知音乐句法的能力, 音乐句法加工的认知机制以及影响因素仍不清楚。基于此, 拟深入探究预期和整合在音乐音高句法加工中的作用, 以及音乐层级结构和时间结构对音高句法加工的影响。以期进一步揭示音乐句法加工的本质, 为音乐和语言的比较以及探索人类更一般的交流机制提供实证依据。     

Between- and within-language priming is the same: Evidence for shared bilingual syntactic representations

Two structural-priming experiments investigated how bilinguals represent syntactic structures. According to the shared-syntax account (Hartsuiker, Pickering, & Veltkamp, 2004), bilinguals have a single syntactic representation for structures that exist in both languages, whereas separate-syntax accounts claim that the representations for these structures are language specific. Our experiments tested native speakers of Swedish who were highly proficient in English. The results showed that structural priming within language and between languages was equally strong. This indicates that representations of syntactic structures from different languages are shared and, therefore, supports the shared-syntax account.     

Hemispheric specialization for semantic and syntactic components of language in simultaneous interpreters

Hemispheric specializations for semantic and syntactic components in Italian (L1) and English (L2) were studied with a dichotic listening test, simulating simultaneous interpretation tasks in 24 right-handed female interpretation students at the Scuola Superiore di Lingue Moderne per Interpreti e Traduttori (SSLM) of the University of Trieste and in 12 right-handed female professional interpreters at the European Communities (EEC). The test involved the recognition of correct translations, translations with semantic errors, and translations with syntactic errors from L1 to L2 and vice versa. As an overall result, both students and interpreters gave significantly more correct answers when sentences in L2 as the target language were sent to the left ear. Students recognized significantly more sentences containing syntactic errors than did professional interpreters, while professional interpreters recognized significantly more sentences with semantic errors than did interpreting students. In regard to hemispheric specialization in interpreting students, no significant asymmetries were revealed in the recognition of semantic and syntactic errors. Professional interpreters showed a significant right-ear superiority in recognizing semantic errors in L1 and a significant left-ear superiority in recognizing semantic errors in L2. In the recognition of syntactic errors, professional interpreters showed significant left-ear superiority for L1 and significant right-ear superiority for L2. The prolonged practice in simultaneous interpreting strategies in EEC professional interpreters may account for some of their peculiar hemispheric specializations for languages revealed by this study.     

Electrophysiological evidence for a shared representational medium for visual images and visual percepts

Does mental imagery involve the activation of representations in the visual system? Systematic effects of imagery on visual signal detection performance have been used to argue that imagery and the perceptual processing of stimuli interact at some common locus of activity (Farah, 1985). However, such a result is neutral with respect to the question of whether the interaction occurs during modality-specific visual processing of the stimulus. If imagery affects stimulus processing at early, modality-specific stages of stimulus representation, this implies that the shared stimulus representations are visual, whereas if imagery affects stimulus processing only at later, amodal stages of stimulus representation, this implies that imagery involves more abstract, postvisual stimulus representations. To distinguish between these two possibilities, we repeated the earlier imagery-perception interaction experiment while recording event-related potentials (ERPs) to stimuli from 16 scalp electrodes. By observing the time course and scalp distribution of the effect of imagery on the ERP to stimuli, we can put constraints on the locus of the shared representations for imagery and perception. An effect of imagery was seen within 200 ms following stimulus presentation, at the latency of the first negative component of the visual ERP, localized at the occipital and posterior temporal regions of the scalp, that is, directly over visual cortex. This finding provides support for the claim that mental images interact with percepts in the visual system proper and hence that mental images are themselves visual representations.     

Generative theories in language and music descriptions

The style of a set of Swedish nursery tunes is described in terms of a generative rule system. A generative rule system producing melodically similar versions of an old Swedish folk song is also presented. Examples of melodies generated by these two rule systems are given.Both these rule systems are similar in several respects. Thus, the marking of the hierarchical constituent structure seems to be one of the important principles in composing simple melodies.The rule systems also show a number of similarities with the Chomsky & Halle (1968) generative phonology of English. For instance, the procedures used for deriving a stress contour from a tree diagram are almost identical. Moreover, in sentences as in melodies this stress, or prominence contour is of decisive importance to the generation of the surface structure, such as meter, harmony, and sequences of pitches. It is believed that such parallels between language and music reflect characteristics of man's perceptual and cognitive capacities.     

句法加工中的预测现象及实验证据

句法加工是读者通过整合输入的言语信息来理解句子的过程。句法加工的存在,使得读者能够提前预测文本的信息,提高阅读效率。由于阅读离不开信息整合,研究者提出两类不同的句法理论:句法预测的模块局域性理论和句法预测的互动分析性观点。这两类理论的争论点在于句法加工是单独模块化的自上而下加工,还是自下而上-自上而下的互动分析加工过程。其区别表现为句法预测的作用——前者认为句法预测对句子加工有抑制作用,后者认为句法预测对句子加工起促进作用。来自眼动、ERP等研究的数据佐证了句法预测的存在。未来研究应围绕其差异进行深入探讨,以揭示句法加工的实质。     

Activation of lexical and syntactic target language properties in translation

Is reading for translation equal to reading in monolingual contexts? Horizontal/parallel theories of translation propose that normal reading and reading for translation differ because the translator engages in partial reformulation while reading for translating the source text. In contrast, vertical/serial theories assume that the translators first extract the meaning of the message, and only then they proceed to reformulate it. In two experiments, we manipulated lexical and syntactic properties of the target language (TL) while translators read for repetition or for translation. On-line sentence comprehension was affected by the lexical frequency of words in the TL (Experiment 1) and the syntactic congruency between the source language (SL) and TL sentences (Experiment 2). However, the influence of lexical and syntactic TL properties was restricted to the reading for translation task. According to our results, the horizontal view of translation includes code-to-code links between the SL and TL involving at least the lexical and syntactic level of processing.     

Give and take: syntactic priming during spoken language comprehension

Syntactic priming during language production is pervasive and well-studied. Hearing, reading, speaking or writing a sentence with a given structure increases the probability of subsequently producing the same structure, regardless of whether the prime and target share lexical content. In contrast, syntactic priming during comprehension has proven more elusive, fueling claims that comprehension is less dependent on general syntactic representations and more dependent on lexical knowledge. In three experiments we explored syntactic priming during spoken language comprehension. Participants acted out double-object (DO) or prepositional-object (PO) dative sentences while their eye movements were recorded. Prime sentences used different verbs and nouns than the target sentences. In target sentences, the onset of the direct-object noun was consistent with both an animate recipient and an inanimate theme, creating a temporary ambiguity in the argument structure of the verb (DO e.g., Show the horse the book; PO e.g., Show the horn to the dog). We measured the difference in looks to the potential recipient and the potential theme during the ambiguous interval. In all experiments, participants who heard DO primes showed a greater preference for the recipient over the theme than those who heard PO primes, demonstrating across-verb priming during online language comprehension. These results accord with priming found in production studies, indicating a role for abstract structural information during comprehension as well as production.     

语言和音乐层级结构的加工

语言和音乐在呈现过程中, 小单元相互结合组成更大的单元, 最终形成层级结构。已有研究表明, 听者能够将连续的语流和音乐切分成层级结构, 并在大脑中形成层级表征。在感知基础之上, 听者还能将新出现的语言和音乐事件整合到层级结构之中, 形成连贯理解, 最终顺利地完成交流过程。未来研究应剖析边界线索在层级结构感知中的作用, 考察不同层级整合过程的影响因素, 进一步探索语言和音乐层级结构加工的关系。     

Change deafness across voices in music and language

ABSTRACT

Listeners made same/different evaluations of a pair of musical presentations separated by a broadband noise. In the first experiment, the pair had either the same or a different: singers voice, language (Spanish or English), and reverberation (dry or very high reverb). A second experiment was conducted using the same vocal melodies played on guitars to emphasize non-linguistic content. In both Experiments 1 and 2, large-scale changes to Reverb were either completely undetected or ignored. A change of language in Experiment 1 supported only minimal sensitivity to change detection. Changes to multiple variables tended to increase listener sensitivity to a stimulus change. The results seem to indicate that the semantic coherence created by a musical background may limit attention to linguistic changes and voicing. Rather, those changes that more directly influence musical quality may be of greater salience in a musical context.     

ERP evidence for telicity effects on syntactic processing in garden-path sentences

Verbs contain multifaceted information about both the semantics of an action, and potential argument structures. Linguistic theory classifies verbs according to whether the denoted action has an inherent (telic) end-point (fall, awaken), or whether it is considered homogenous, or atelic (read, worship). The aim of our study was to examine how this distinction influences on-line sentence processing, investigating the effects of verbal telicity on the ease of syntactic re-analysis of Object reduced relative clauses. Event-related brain potentials (ERPs) were recorded from 22 English speakers as they read sentences in which the main verb was either telic or atelic, e.g., “The actress awakened/worshipped by the writer left in a hurry”. ERPs elicited by telic and atelic verbs, the preposition “by” introducing the second argument (Agent), and the second argument itself, e.g., “writer”, were compared. Additionally, participants were grouped according to receptive syntactic proficiency: normal (NP) or high (HP). ERPs from the NP group first diverged at the second argument, with the atelic condition eliciting larger amplitude negativity at the N100, and continuing to the P200 interval. In contrast, ERPs from the HP group first diverged earlier in the sentence, on the word “by”. ERPs elicited by “by” in the atelic condition were also characterized by increased negativity, in this case significant at P200 and Anterior Negativity between 320 and 500 ms post stimulus onset. Our results support the postulated conceptual/semantic distinction underlying the two verb categories, and demonstrate that world-knowledge about actions designated by verbs and syntactic proficiency are reflected in on-line processing of sentence structure.     

An empirical comparison of rhythm in language and music

Musicologists and linguists have often suggested that the prosody of a culture's spoken language can influence the structure of its instrumental music. However, empirical data supporting this idea have been lacking. This has been partly due to the difficulty of developing and applying comparable quantitative measures to melody and rhythm in speech and music. This study uses a recently-developed measure for the study of speech rhythm to compare rhythmic patterns in English and French language and classical music. We find that English and French musical themes are significantly different in this measure of rhythm, which also differentiates the rhythm of spoken English and French. Thus, there is an empirical basis for the claim that spoken prosody leaves an imprint on the music of a culture.     

Aesthetic preference and syntactic prototypicality in music: 'tis the gift to be simple

In the dominant aesthetic theory, composers are said to use unpredictable events to tease the listener, and make music optimally challenging and therefore aesthetically pleasing. We tested this claim that events optimally discrepant from a schema will be most pleasing. Experts and novices evaluated harmonic progressions at seven levels of syntactic prototypicality. Four results emerged: (1) even novices were extremely sensitive to syntactic atypicality; (2) all subjects found atypical progressions more interesting and complex; (3) novices and undergraduate music students preferred harmonic prototypes, contrary to most aesthetic theories; (4) only music graduate students preferred atypical progressions. We discuss the striking sensitivity of novices to harmonic syntax. We describe differences between an aesthetic theory based on information and uncertainty, and one based on schemas and schema divergence. We also consider the tonal conservatism of most subjects. This conservatism constrains aesthetic theories, and may have implications for music's stylistic evolution.