Sensitivity to syntax in visual cortex

One of the most intriguing findings on language comprehension is that violations of syntactic predictions can affect event-related potentials as early as 120 ms, in the same time-window as early sensory processing. This effect, the so-called early left-anterior negativity (ELAN), has been argued to reflect word category access and initial syntactic structure building (Friederici, 2002). In two experiments, we used magnetoencephalography to investigate whether (a) rapid word category identification relies on overt category-marking closed-class morphemes and (b) whether violations of word category predictions affect modality-specific sensory responses. Participants read sentences containing violations of word category predictions. Unexpected items varied in whether or not their word category was marked by an overt function morpheme. In Experiment 1, the amplitude of the visual evoked M100 component was increased for unexpected items, but only when word category was overtly marked by a function morpheme. Dipole modeling localized the generator of this effect to the occipital cortex. Experiment 2 replicated the main results of Experiment 1 and eliminated two non-morphology-related explanations of the M100 contrast we observed between targets containing overt category-marking and targets that lacked such morphology. Our results show that during reading, syntactically relevant cues in the input can affect activity in occipital regions at around 125 ms, a finding that may shed new light on the remarkable rapidity of language processing.     

Semantic predictability eliminates the transposed-letter effect

Semantic predictability facilitates word recognition during language processing. One possible explanation for this facilitation is that highly specific predictions generated online during language processing preactivate some features of upcoming words. To explore whether, how, and when these predictions affect visual word recognition, in the two experiments reported here we investigated the influence of semantic predictability on transposed-letter priming. In order to do so, a paradigm that combines self-paced word-by-word reading with masked priming was developed. Transposed-letter priming occurred in nonconstraining contexts but not in constraining contexts, indicating that readers use context to make predictions about both letter identity and position in upcoming words, and that these predictions have an early influence on visual word recognition.     

Neurophysiological markers of early language acquisition: from syllables to sentences

Recently, there have been several reports of the neurophysiological correlates of language acquisition. These indicate that the infant's brain is able to discriminate different phonemes within the first 2 months of life, that knowledge about stress patterns and phonotactic rules is established between 5-12 months, and that phonotactic knowledge begins to interact with lexical-semantic processes between 12-14 months. Electrophysiological markers for lexical-semantic processes indicate that semantic processing of words in picture contexts is present at 14 months and for words in sentential contexts around 30 months. At 32 months, children demonstrate an adult-like electrophysiological response pattern to syntactic violations. The similarities between the brain response patterns observed in children and adults support the view that language develops in a continuous manner.     

The Time Course of Syntactic Activation During Language Processing: A Model Based on Neuropsychological and Neurophysiological Data

This paper presents a model describing the temporal and neurotopological structure of syntactic processes during comprehension. It postulates three distinct phases of language comprehension, two of which are primarily syntactic in nature. During the first phase the parser assigns the initial syntactic structure on the basis of word category information. These early structural processes are assumed to be subserved by the anterior parts of the left hemisphere, as event-related brain potentials show this area to be maximally activated when phrase structure violations are processed and as circumscribed lesions in this area lead to an impairment of the on-line structural assignment. During the second phase lexical-semantic and verb-argument structure information is processed. This phase is neurophysiologically manifest in a negative component in the event-related brain potential around 400 ms after stimulus onset which is distributed over the left and right temporo-parietal areas when lexical-semantic information is processed and over left anterior areas when verb-argument structure information is processed. During the third phase the parser tries to map the initial syntactic structure onto the available lexical-semantic and verb-argument structure information. In case of an unsuccessful match between the two types of information reanalyses may become necessary. These processes of structural reanalysis are correlated with a centroparietally distributed late positive component in the event-related brain potential. The different temporal and topographical patterns of the event-related brain potential. as well as some aspects of aphasics′ comprehension behavior are taken to support the view that these different processing phases are distinct and that the left anterior cortex, in particular, is responsible for the on-line assignment of syntactic structure.     

Violations of information structure: an electrophysiological study of answers to wh-questions

This study investigates brain responses to violations of information structure in wh-question-answer pairs, with particular emphasis on violations of focus assignment in it-clefts (It was the queen that silenced the banker). Two types of ERP responses in answers to wh-questions were found. First, all words in the focus-marking (cleft) position elicited a large positivity (P3b) characteristic of sentence-final constituents, as did the final words of these sentences, which suggests that focused elements may trigger integration effects like those seen at sentence end. Second, the focusing of an inappropriate referent elicited a smaller, N400-like effect. The results show that comprehenders actively use structural focus cues and discourse-level restrictions during online sentence processing. These results, based on visual stimuli, were different from the brain response to auditory focus violations indicated by pitch-accent [Hruska, C., Steinhauer, K., Alter, K., & Steube, A. (2000). ERP effects of sentence accents and violations of the information structure. In Poster presented at the 13th annual CUNY conference on human sentence processing, San Diego, CA.], but similar to brain responses to newly introduced discourse referents [Bornkessel, I., Schlesewsky, M., & Friederici, A. (2003). Contextual information modulated initial processes of syntactic integration: the role of inter- versus intrasentential predictions. Journal of Experimental Psychology: Learning, Memory and Cognition, 29, 871-882.].     

Syntactic, prosodic, and semantic processes in the brain: evidence from event-related neuroimaging

The neural network supporting aspects of syntactic, prosodic, and semantic information processing is specified on the basis of two experiments using functional magnetic resonance imaging (fMRI). In these two studies, the presence/absence of lexical-semantic and syntactic information is systematically varied in spoken language stimuli. Inferior frontal and temporal brain areas in the left and the right hemisphere are identified to support different aspects of auditory language processing. Two additional experiments using event-related brain potentials investigate the possible interaction of syntactic and prosodic information, on the one hand, and syntactic and semantic information, on the other. While the first two information types were shown to interact early during processing, the latter two information types do not. Implications for models of auditory language comprehension are discussed.     

语义和句法信息在副中央凹加工中的作用

读者能够从副中央凹中提取到什么类型的信息, 是当前阅读眼动研究领域关注的焦点问题.当前普遍认为低水平信息(如正字法信息)可以在副中央凹中得以加工, 但是高水平的信息(如语义和句法信息)能否从副中央凹中进行提取存在争议.本文总结了近年来高水平信息在副中央凹加工的研究进展, 包括拼音文字和非拼音文字(如中文)阅读过程中语义和句法预视效益的研究现状及影响因素, 当前眼动控制模型(如E-Z读者和SWIFT)对预视效益的解释和不足之处, 最后提出未来关于语义和句法预视加工的研究方向.     

Two-year-olds compute syntactic structure on-line

Syntax allows human beings to build an infinite number of new sentences from a finite stock of words. Because toddlers typically utter only one or two words at a time, they have been thought to have no syntax. Using event-related potentials (ERPs), we demonstrated that 2-year-olds do compute syntactic structure when listening to spoken sentences. We observed an early left-lateralized brain response when an expected verb was incorrectly replaced by a noun (or vice versa). Thus, toddlers build on-line expectations as to the syntactic category of the next word in a sentence. In addition, the response topography was different for nouns and verbs, suggesting that different neural networks already underlie noun and verb processing in toddlers, as they do in adults.     

Syntax as a reflex: neurophysiological evidence for early automaticity of grammatical processing

It has been a matter of debate whether the specifically human capacity to process syntactic information draws on attentional resources or is automatic. To address this issue, we recorded neurophysiological indicators of syntactic processing to spoken sentences while subjects were distracted to different degrees from language processing. Subjects were either passively distracted, by watching a silent video film, or their attention was actively streamed away from the language input by performing a demanding acoustic signal detection task. An early index of syntactic violations, the syntactic Mismatch Negativity (sMMN), distinguished between grammatical and ungrammatical speech even under strongest distraction. The magnitude of the early sMMN (at <150ms) was unaffected by attention load of the distraction task. The independence of the early syntactic brain response of attentional distraction provides neurophysiological evidence for the automaticity of syntax and for its autonomy from other attention-demanding processes, including acoustic stimulus discrimination. The first attentional modulation of syntactic brain responses became manifest at a later stage, at approximately 200ms, thus demonstrating the narrowness of the early time window of syntactic autonomy. We discuss these results in the light of modular and interactive theories of cognitive processing and draw inferences on the automaticity of both the cognitive MMN response and certain grammar processes in general.     

Phonological typicality influences sentence processing in predictive contexts: reply to Staub, Grant, Clifton, and Rayner (2009)

In 2 separate self-paced reading experiments, Farmer, Christiansen, and Monaghan (2006) found that the degree to which a word's phonology is typical of other words in its lexical category influences online processing of nouns and verbs in predictive contexts. Staub, Grant, Clifton, and Rayner (2009) failed to find an effect of phonological typicality when they combined stimuli from the separate experiments into a single experiment. We replicated Staub et al.'s experiment and found that the combination of stimulus sets affects the predictiveness of the syntactic context; this reduces the phonological typicality effect as the experiment proceeds, although the phonological typicality effect was still evident early in the experiment. Although an ambiguous context may diminish sensitivity to the probabilistic relationship between the sound of a word and its lexical category, phonological typicality does influence online sentence processing during normal reading when the syntactic context is predictive of the lexical category of upcoming words.     

The organization of words and environmental sounds in the second year: Behavioral and electrophysiological evidence

The majority of research examining early auditory‐semantic processing and organization is based on studies of meaningful relations between words and referents. However, a thorough investigation into the fundamental relation between acoustic signals and meaning requires an understanding of how meaning is associated with both lexical and non‐lexical sounds. Indeed, it is unknown how meaningful auditory information that is not lexical (e.g., environmental sounds) is processed and organized in the young brain. To capture the structure of semantic organization for words and environmental sounds, we record event‐related potentials as 20‐month‐olds view images of common nouns (e.g., dog) while hearing words or environmental sounds that match the picture (e.g., “dog” or barking), that are within‐category violations (e.g., “cat” or meowing), or that are between‐category violations (e.g., “pen” or scribbling). Results show both words and environmental sounds exhibit larger negative amplitudes to between‐category violations relative to matches. Unlike words, which show a greater negative response early and consistently to within‐category violations, such an effect for environmental sounds occurs late in semantic processing. Thus, as in adults, the young brain represents semantic relations between words and between environmental sounds, though it more readily differentiates semantically similar words compared to environmental sounds.     

On the early left-anterior negativity (ELAN) in syntax studies

Within the framework of Friederici’s (2002) neurocognitive model of sentence processing, the early left anterior negativity (ELAN) in event-related potentials (ERPs) has been claimed to be a brain marker of syntactic first-pass parsing. As ELAN components seem to be exclusively elicited by word category violations (phrase structure violations), they have been taken as strong empirical support for syntax-first models of sentence processing and have gained considerable impact on psycholinguistic theory in a variety of domains. The present article reviews relevant ELAN studies and raises a number of serious issues concerning the reliability and validity of the findings. We also discuss how baseline problems and contextual factors can contribute to early ERP effects in studies examining word category violations. We conclude that - despite the apparent wealth of ELAN data - the functional significance of these findings remains largely unclear. The present paper does not claim to have falsified the existence of ELANs or syntax-related early frontal negativities. However, by separating facts from myths, the paper attempts to make a constructive contribution to how future ERP research in the area of syntax processing may better advance our understanding of online sentence comprehension.     

Lexical integration: Sequential effects of syntactic and semantic information

Both semantic and syntactic context constraints can influence word processing at the level of lexical integration. In event-related brain potentials (ERPs), semantic integration is reflected by a negativity around 400 msec (N400), whereas phrase structure assignment and syntactic integration are assumed to be reflected by an early left anterior negativity and a late positivity (P600), respectively. An ERP study is presented in which participants read different types of sentences whose terminal verb was either congruent with the preceding context or incongruent due to a phrase structure violation, a semantic violation, or both. The main finding was that only the pure semantic violation condition, but not the combined semantic and syntactic violation condition, elicited a large N400. The two conditions containing phrase structure violations were predominantly characterized by a P600. Both semantic violation conditions, moreover, displayed a late negativity around 700 msec that overlapped with the P600 in the double violation condition. The absence of an N400 effect for elements that are syntactically as well as semantically incongruent with prior context suggests an early influence of phrase structure information on processes of lexical-semantic integration. The present data are discussed in comparison to previous ERP findings, and a new view of lexical integration processes is proposed.     

Effect of ambiguity and lexical availability on syntactic and lexical production

Speakers only sometimes include the that in sentence complement structures like The coach knew (that) you missed practice. Six experiments tested the predictions concerning optional word mention of two general approaches to language production. One approach claims that language production processes choose syntactic structures that ease the task of creating sentences, so that words are spoken opportunistically, as they are selected for production. The second approach claims that a syntactic structure is chosen that is easiest to comprehend, so that optional words like that are used to avoid temporarily ambiguous, difficult-to-comprehend sentences. In all experiments, speakers did not consistently include optional words to circumvent a temporary ambiguity, but they did omit optional words (the complementizer that) when subsequent material was either repeated (within a sentence) or prompted with a recall cue. The results suggest that speakers choose syntactic structures to permit early mention of available material and not to circumvent disruptive temporary ambiguities.     

First-Pass versus Second-Pass Parsing Processes in a Wernicke''s and a Broca''s Aphasic: Electrophysiological Evidence for a Double Dissociation

The present paper is a first attempt to integrate the classical brain lesion behavioral impairment approach of functional neuroanatomy and the electrophysiological brain mapping approach in the domain of syntactic processing. In a group of normal age-matched controls we identified three electrophysiological components previously observed in correlation with language comprehension processes: an early left anterior negativity normally seen in correlation with syntactic first-pass parsing processes (ELAN), a centroparietal negativity seen in correlation with processes of lexical-semantic integration (N400), and a late centroparietal positivity observed in correlation with secondary syntactic processes of reanalysis and repair (P600). The early left anterior negativity was absent in a patient with an extended lesion in the anterior part of the left hemisphere sparing the temporal lobe, although the late centroparietal positivity and the centroparietal N400 were present. In a patient with a left temporal-parietal lesion the early left anterior negativity was found to be present, whereas the N400 component was absent. These findings suggest that first-pass parsing and secondary processes are subserved by distinct brain systems.     

Implicit meaning in 18‐month‐old toddlers

A substantial body of evidence demonstrates that infants understand the meaning of spoken words from as early as 6 months. Yet little is known about their ability to do so in the absence of any visual referent, which would offer diagnostic evidence for an adult‐like, symbolic interpretation of words and their use in language mediated thought. We used the head‐turn preference procedure to examine whether infants can generate implicit meanings from word forms alone as early as 18 months of age, and whether they are sensitive to meaningful relationships between words. In one condition, toddlers were presented with lists of words taken from the same taxonomic category (e.g. animals or body parts). In a second condition, words taken from two other categories (e.g. clothes and food items) were interleaved within the same list. Listening times were found to be longer in the related‐category condition than in the mixed‐category condition, suggesting that infants extract the meaning of spoken words and are sensitive to the semantic relatedness between these words. Our results show that infants have begun to construct the rudiments of a semantic system based on taxonomic relations even before they enter a period of accelerated vocabulary growth.     

Brain potentials for derivational morphology: an ERP study of deadjectival nominalizations in Spanish

This study investigates brain potentials to derived word forms in Spanish. Two experiments were performed on derived nominals that differ in terms of their productivity and semantic properties but are otherwise similar, an acceptability judgment task and a reading experiment using event-related brain potentials (ERPs) in which correctly and incorrectly formed derived words were presented in sentence contexts. The first experiment indicated productivity differences between the different nominalization processes in Spanish. The second experiment yielded a pattern of ERP responses that differed from both the familiar lexical-semantic and grammatical ERP effects. Violations of derivational morphology elicited an increased N400 component plus a late positivity (P600), unlike gender-agreement violations, which produced the biphasic LAN/P600 ERP pattern known from previous studies of morpho-syntactic violations. We conclude that the recognition of derived word forms engages both word-level (lexical-semantic) and decompositional (morpheme-based) processes.     

Brain responses to lexical-semantic priming in children at-risk for dyslexia

Deviances in early event-related potential (ERP) components reflecting auditory and phonological processing are well-documented in children at familial risk for dyslexia. However, little is known about brain responses which index processing in other linguistic domains such as lexicon, semantics and syntax in this group. The present study investigated effects of lexical-semantic priming in 20- and 24-month-olds at-risk for dyslexia and typically developing controls in two ERP experiments. In both experiments an early component assumed to reflect facilitated lexical processing for primed words was enhanced in the at-risk group compared to the control group. Moreover, an N400-like response which was prominent in the control group was attenuated or absent in at-risk children. Results suggest that deficiencies in young children at-risk for dyslexia are not restricted to perceptual and lower-level phonological abilities, but also affect higher order linguistic skills such as lexical and semantic processing.     

Word category conversion causes processing costs: Evidence from adjectival passives

Constructing syntactic representations in language comprehension begins with the identification of word categories. Whether the category information is stored in the mental lexicon is a matter of debate in current linguistic theorizing. The standard view assumes that the syntactic category of a word is lexically specified (lexicalist approach). More recently, it has been proposed within the paradigm of distributed morphology that lexical elements (roots) are stored without any syntactic category information: The syntactic category of a lexical element is determined only by the syntactic context in which it appears (syntactic approach). For processing categoryambiguous words, different hypotheses can be derived from these two accounts. The lexicalist approach predicts that there are productive grammatical processes, such as nominalization and adjectivization, that convert a word of Category A into one of Category B. Such a conversion might be assumed to create additional processing costs. Within the syntactic approach, on the other hand, no additional processing step is expected, because there is no need for any category shift. In a self-paced reading study on so-called adjectival passives, we found evidence of costs predicted under the lexicalist approach (i.e., for a grammatical process that changes the category of a word). More specifically, the present study provides evidence for category conversion from a verbal participle into an adjectival one. We also discuss an alternative explanation for this finding in terms of frequency.     

汉、英句法结构相似性与第二语言的熟练度对第二语言句法加工的影响

采用事件相关电位（ERP）技术,考察了汉、英句法结构相似性与第二语言（英语）熟练度对第二语言句法加工的影响。实验材料包含与汉语句法结构相似和不同的两种英语句法结构违反的句子。结果发现：与正确句子相比,相似句法违反句在高熟练组被试中,引发正向的ERP波形偏转（150-800ms）,而在低熟练组被试中,只引发了降低的N400（300-550ms）效应;对于不同句法违反句,无论高低熟悉程度的被试,均未出现显著的ERP效应。研究结果表明,第二语言句法与母语的相似性越高,加工起来更容易;第二语言熟练度水平对第二语言句法加工具有一定的促进作用,但受到两种语言句法结构相似性的影响,相似性越高,熟练度的促进作用越大。