Large-scale neural network for sentence processing

Our model of sentence comprehension includes at least grammatical processes important for structure-building, and executive resources such as working memory that support these grammatical processes. We hypothesized that a core network of brain regions supports grammatical processes, and that additional brain regions are activated depending on the working memory demands associated with processing a particular grammatical feature. We used functional magnetic resonance imaging (fMRI) to test this hypothesis by comparing cortical activation patterns during coherence judgments of sentences with three different syntactic features. We found activation of the ventral portion of left inferior frontal cortex during judgments of violations of each grammatical feature. Increased recruitment of the dorsal portion of left inferior frontal cortex was seen during judgments of violations of specific grammatical features that appear to involve a more prominent working memory component. Left posterolateral temporal cortex and anterior cingulate were also implicated in judging some of the grammatical features. Our observations are consistent with a large-scale neural network for sentence processing that includes a core set of regions for detecting and repairing several different kinds of grammatical features, and additional regions that appear to participate depending on the working memory demands associated with processing a particular grammatical feature.     

Towards a neural basis of auditory sentence processing

Functional dissociations within the neural basis of auditory sentence processing are difficult to specify because phonological, syntactic and semantic information are all involved when sentences are perceived. In this review I argue that sentence processing is supported by a temporo-frontal network. Within this network, temporal regions subserve aspects of identification and frontal regions the building of syntactic and semantic relations. Temporal analyses of brain activation within this network support syntax-first models because they reveal that building of syntactic structure precedes semantic processes and that these interact only during a later stage.     

Neural correlates of metonymy resolution

Metonymies are exemplary models for complex semantic association processes at the sentence level. We investigated processing of metonymies using event-related functional magnetic resonance imaging (fMRI).During an 1.5 Tesla fMRI scan, 14 healthy subjects (12 female) read 124 short German sentences with either literal (like “Africa is arid”), metonymic (“Africa is hungry”), or nonsense (“Africa is woollen”) content. Sentences were constructed so that they obey certain grammatical, semantic, and plausibility conditions and were matched for word frequency, semantic association, length and syntactic structure. We concentrated on metonymies that were not yet fossilised; we also examined a wide variety of metonymic readings.Reading metonymies relative to literal sentences revealed signal changes in a predominantly left-lateralised fronto-temporal network with maxima in the left and right inferior frontal as well as left middle temporal gyri. Left inferior frontal activation may reflect both inference processes and access to world knowledge during metonymy resolution.     

The question shapes the answer: the neural correlates of task differences reveal dynamic semantic processing

Task effects in semantic processing were investigated by contrasting the neural activation associated with two semantic categorization tasks (SCT) using event-related fMRI. The two SCTs involved different decision categories: is it an animal? vs. is it a concrete thing? Participants completed both tasks and, across participants, the same core set of items were presented in both tasks. Results showed task differences in the neural activation associated with these items: in the animal SCT there was greater activation in a number of frontal and temporal regions, including left superior and middle temporal gyri, while in the concrete SCT there was greater activation in left medial frontal gyrus and bilaterally in the precentral gyri. These results are interpreted as evidence of top-down modulation of semantic processing; participants make adjustments to optimize performance in a given task and these adjustments have consequences for the activation observed.     

Repetition in the transcortical aphasias

Transcortical aphasic patients were assessed on a repetition task comprised of both well-formed and deviant sentences. The patients faithfully repeated those sentences that were factually incorrect but grammatically well formed, and those sentences that were ungrammatical because of selection restriction violations. In contrast, presented with sentences featuring only minor syntactic violations (e.g., lack of number agreement), the patients spontaneously, and without awareness, resisted exact repetition; moreover, the resultant changes most often served to correct the syntactic deviations. Repetitions of sentences of this latter type also revealed a difference between the patients as a function of level of comprehension. The transcortical motor aphasic patient was influenced by semantic factors in his alterations of the minor syntactic violations, while the transcortical sensory aphasic was not. These findings are discussed in relation to the notion of autonomous syntactic processing. They are taken to suggest that syntactic facts such as number agreement are represented at a level in the processing chain that is distinct from that of semantic representation.     

Syntactic processing in bilinguals: an fNIRS study

The study of the neural basis of syntactic processing has greatly benefited from neuroimaging techniques. Research on syntactic processing in bilinguals has used a variety of techniques, including mainly functional magnetic resonance imaging (fMRI) and event-related potentials (ERP). This paper reports on a functional near-infrared spectroscopy (fNIRS) study on syntactic processing in highly proficient young adult speakers of Portuguese (mother tongue) (L1) and French (second language) (L2). They made a syntactic judgment of visually presented sentences, which either did or did not contain noun-verb agreement violations. The results showed that syntactic processing in both languages resulted in significant activation in anterior frontal regions of the left hemisphere and in the temporal superior posterior areas of the right hemisphere, with a more prominent activation for L2 in some areas. These findings corroborate previously reported neuroimaging evidence, showing the suitability of fNIRS for the study of syntactic processing in the bilingual brain.     

Auditory language comprehension: an event-related fMRI study on the processing of syntactic and lexical information

The functional specificity of different brain regions recruited in auditory language processing was investigated by means of event-related functional magnetic resonance imaging (fMRI) while subjects listened to speech input varying in the presence or absence of semantic and syntactic information. There were two sentence conditions containing syntactic structure, i.e., normal speech (consisting of function and content words), syntactic speech (consisting of function words and pseudowords), and two word-list conditions, i.e., real words and pseudowords. The processing of auditory language, in general, correlates with significant activation in the primary auditory cortices and in adjacent compartments of the superior temporal gyrus bilaterally. Processing of normal speech appeared to have a special status, as no frontal activation was observed in this case but was seen in the other three conditions. This difference may point toward a certain automaticity of the linguistic processes used during normal speech comprehension. When considering the three other conditions, we found that these were correlated with activation in both left and right frontal cortices. An increase of activation in the planum polare bilaterally and in the deep portion of the left frontal operculum was found exclusively when syntactic processes were in focus. Thus, the present data may be taken to suggest an involvement of the left frontal and bilateral temporal cortex when processing syntactic information during comprehension.     

动词论元结构复杂性加工的认知神经机制

动词论元结构复杂性表现在论元数量、论元范畴选择模式、题元角色指派模式和映射方式四个方面。大部分实证研究表明, 更多的论元数量、选择性论元范畴、选择性题元角色指派以及非典型映射, 使动词论元结构加工的认知神经机制更复杂。多论元加工功能脑区主要涉及左侧额下回和外侧裂周后部; 选择性论元范畴加工功能脑区主要涉及左侧额下回、额叶中后部、颞上回和颞叶中后部; 选择性题元角色指派加工功能脑区主要涉及外侧裂周后部、左侧额叶中后部和额下回; 非典型映射加工功能脑区主要涉及左侧额下回、颞上回、颞中回和颞叶后部。左侧额下回可能涉及初始句法加工、动词次范畴确定、句法移位和非宾格动词语义加工, 左侧额叶中后部可能涉及初始句法加工和动词次范畴确定, 左侧颞上回和颞叶中后部可能涉及表层句法加工和表层论元句法-语义整合, 外侧裂周后部可能涉及论元语义表征。动词论元结构加工过程和动词词汇特征表明, 复杂性某些方面存在交互作用。动词论元结构复杂性与加工难易的对应关系、复杂性加工难度层级和交互作用的认知神经机制以及汉语动词论元结构复杂性加工认知神经机制等议题, 有待进一步探讨。     

Individual differences in skilled adult readers reveal dissociable patterns of neural activity associated with component processes of reading

We used fMRI to examine patterns of brain activity associated with component processes of visual word recognition and their relationships to individual differences in reading skill. We manipulated both the judgments adults made on written stimuli and the characteristics of the stimuli. Phonological processing led to activation in left inferior frontal and temporal regions whereas semantic processing was associated with bilateral middle frontal activation. Individual differences in reading subskills were reflected in differences in the degree to which cortical regions were engaged during reading. Variation in sight word reading efficiency was associated with degree of activation in visual cortex. Increased phonological decoding skill was associated with greater activation in left temporo-parietal cortex. Greater reading comprehension ability was associated with decreased activation in anterior cingulate and temporal regions. Notably, associations between reading ability and neural activation indicate that brain/behavior relationships among skilled readers differ from patterns associated with dyslexia and reading development.     

The comprehension of anomalous sentences: evidence from structural priming

We report three experiments investigating how people process anomalous sentences, in particular those in which the anomaly is associated with the verb. We contrast two accounts for the processing of such anomalous sentences: a syntactic account, in which the representations constructed for anomalous sentences are similar in nature to the ones constructed for well-formed sentences; and a semantic account, in which the representations constructed for anomalous sentences are erroneous, or altogether missing, and interpretation is achieved on the basis of semantic representations instead. To distinguish between these accounts, we used structural priming. First, we ruled out the possibility that anomaly per se influences the magnitude of the priming effect: Prime sentences with morphologically incorrect verbs produced similarly enhanced priming (lexical boost) to sentences with the same correct verbs (Exp. 1). Second, we found that prime sentences with a novel verb (Exp. 2) or a semantically and syntactically incongruent verb (Exp. 3) produced a priming effect, which was the same as that produced by well-formed sentences. In accord with the syntactic account, we conclude that the syntactic representations of anomalous sentences are similar to those constructed for well-formed sentences. Our results furthermore suggest that lexically-independent syntactic information is robust enough to produce well-formed syntactic representations during processing without requiring aid from lexically-based syntactic information.     

The neural consequences of semantic richness: when more comes to mind, less activation is observed

Some concepts have richer semantic representations than others. That is, when considering the meaning of concepts, subjects generate more information (more features, more associates) for some concepts than for others. This variability in semantic richness influences responses in speeded tasks that involve semantic processing, such as lexical decision and semantic categorization tasks. It has been suggested that concepts with richer semantic representations build stronger attractors in semantic space, allowing faster settling of activation patterns and thus faster responding. Using event-related functional magnetic resonance imaging, we examined the neural activation associated with semantic richness by contrasting activation for words with high and low numbers of associates in a semantic categorization task. Results were consistent with faster semantic settling for words with richer representations: Words with a low number of semantic associates produced more activation than words with a high number of semantic associates in a number of regions, including left inferior frontal and inferior temporal gyri.     

句法歧义消解影响因素、认知机制及其神经基础

句法歧义消解主要是指人们在面临多种句法分析可能性的情况下,句法分析器抑制不正确的句法分析而选择正确句法分析的认知过程。研究表明,该过程受到工作记忆、认知控制能力、语言分布频率、语境、韵律等因素的影响。为有效说明人们是如何完成句法歧义消解的,研究者们建构了诸如花园路径模型、约束满意理论、弱交互作用句法分析理论等相关模型。另外,基于脑成像技术研究表明,左侧额下回、左侧颞叶后部、中部和前部在句法消歧任务中都有显著激活。未来研究当围绕着句法消歧中的语义效应、句法和词汇歧义消解机制的异同、句法消歧中抑制能力的效应等方面展开。     

Auditory language comprehension: an event-related fMRI study on the processing of syntactic and lexical information

The functional specificity of different brain areas recruited in auditory language processing was investigated by means of event-related functional magnetic resonance imaging (fMRI) while subjects listened to speech input varying in the presence or absence of semantic and syntactic information. There were two sentence conditions containing syntactic structure, i.e., normal speech (consisting of function and content words), syntactic speech (consisting of function words and pseudowords), and two word-list conditions, i.e., real words and pseudowords. The processing of auditory language, in general, correlates with significant activation in the primary auditory cortices and in adjacent compartments of the superior temporal gyrus bilaterally. Processing of normal speech appeared to have a special status, as no frontal activation was observed in this case but was seen in the three other conditions. This difference may point toward a certain automaticity of the linguistic processes used during normal speech comprehension. When considering the three other conditions, we found that these were correlated with activation in both left and right frontal cortices. An increase of activation in the planum polare bilaterally and in the deep portion of the left frontal operculum was found exclusively when syntactic processes were in focus. Thus, the present data may be taken to suggest an involvement of the left frontal and bilateral temporal cortex when processing syntactic information during comprehension.     

语义信息复杂度对二语者英语被动句加工的影响

采用英语所独有且非常重要的句法结构——被动语态作为语言材料,选取某些可以在句子中的词汇顺序基本没有变化的情况下转换为汉语句式（汉语“被”字句）的“直译型”被动句以及必须根据其意义进行句式转换方能形成相应的汉语句式（汉语主动句）的“意译型”被动句作为实验材料,探讨了在动词语义复杂条件下二语熟练度（包括晚期中等熟练者和高熟练者）对被动句加工过程的影响。结果表明：高熟练者正确率均高于中等熟练者,说明在动词语义复杂的情况下熟练度依然可以预测英语被动句实时加工的程度和水平。此时,语义违例的正确率最高、反应时最短,句法违例句则与之相反。双违例引发的N400效应显著,正确句和句法违例均未引发负向的N400;高熟练者P600的波幅明显高于中等熟练者,句法违例和双违例引发的P600效应最显著。行为指标支持语言间句法加工相似性效应——直译句反应快、正确率高。ERP数据则得出了与之相反的结果：直译句比意译句诱发出更大的N400效应,意译句则引发了较大的P600。上述结果进一步说明二语熟练度对语言间句法加工相似性效应具有很强的调节作用。     

Neural responses to morphological, syntactic, and semantic properties of single words: an fMRI study

Dissociations in the recognition of specific classes of words have been documented in brain-injured populations. These include deficits in the recognition and production of morphologically complex words as well as impairments specific to particular syntactic classes such as verbs. However, functional imaging evidence for distinctions among the neural systems underlying these dissociations has been inconclusive. We explored the neural systems involved in processing different word classes in a functional Magnetic Resonance Imaging study, contrasting four groups of words co-varying morphological complexity (simple, monomorphemic words vs complex derived or inflected words) and syntactic class (verbs vs nouns/adjectives). Subtraction of word from letter string processing showed activation in left frontal and temporal lobe regions consistent with prior studies of visual word processing. No differences were observed for morphologically complex and simple words, despite adequate power to detect stimulus specific effects. A region of posterior left middle temporal gyrus showed significantly increased activation for verbs. Post hoc analyses showed that this elevated activation could also be related to semantic properties of the stimulus items (verbs have stronger action associations than nouns, and action association is correlated with activation). Results suggest that semantic as well as syntactic factors should be considered when assessing the neural systems involved in single word comprehension.     

Functional connectivity in an fMRI study of semantic and phonological processes and the effect of L-Dopa

We describe an fMRI experiment examining the functional connectivity (FC) between regions of the brain associated with semantic and phonological processing. We wished to explore whether L-Dopa administration affects the interaction between language network components in semantic and phonological categorization tasks, as revealed by FC. We hypothesized that L-Dopa would decrease FC due to restriction of the semantic network. During two test sessions (placebo and L-Dopa) each participant performed two fMRI runs, involving phonological and semantic processing. A number of brain regions commonly activated by the two tasks were chosen as regions if interest: left inferior frontal, left posterior temporal and left fusiform gyri, and left parietal cortex. FC was calculated and further analyzed for effects of either the drug or task. No main effect for drug was found. A significant main effect for task was found, with a greater average correlation for the phonological task than for the semantic task. These findings suggest that language areas are activated in a more synchronous manner for phonological than for semantic tasks. This may relate to the fact that phonological processes are mediated to a greater extent within language areas, whereas semantic tasks likely require greater interaction outside of the language areas. Alternatively, this may be due to differences in the attentional requirements of the two tasks.     

The neural reality of syntactic transformations: evidence from functional magnetic resonance imaging

The functional anatomy of syntactic transformations, a major computational operation invoked in sentence processing, was identified through a functional magnetic resonance imaging investigation. A grammaticality judgment task was used, presented through a novel hidden-blocks design. Subjects listened to transformational and nontransformational sentences in which a host of other complexity generators (number of words, prepositions, embeddings, etc.) were kept constant. A series of analyses revealed that the neural processing of transformations is localizable, evoking a highly lateralized and localized activation in the left inferior frontal gyrus (Broca's region) and bilateral activation in the posterior superior temporal sulcus. The pattern of activation associated with transformational analysis was distinct from the one observed in neighboring regions, and anatomically separable from the effects of verb complexity, which yielded significant activation in the left posterior superior temporal sulcus. Taken together with neuropsychological evidence, these results uncover the neural reality of syntactic transformations.     

What artificial grammar learning reveals about the neurobiology of syntax

In this paper we examine the neurobiological correlates of syntax, the processing of structured sequences, by comparing FMRI results on artificial and natural language syntax. We discuss these and similar findings in the context of formal language and computability theory. We used a simple right-linear unification grammar in an implicit artificial grammar learning paradigm in 32 healthy Dutch university students (natural language FMRI data were already acquired for these participants). We predicted that artificial syntax processing would engage the left inferior frontal region (BA 44/45) and that this activation would overlap with syntax-related variability observed in the natural language experiment. The main findings of this study show that the left inferior frontal region centered on BA 44/45 is active during artificial syntax processing of well-formed (grammatical) sequence independent of local subsequence familiarity. The same region is engaged to a greater extent when a syntactic violation is present and structural unification becomes difficult or impossible. The effects related to artificial syntax in the left inferior frontal region (BA 44/45) were essentially identical when we masked these with activity related to natural syntax in the same subjects. Finally, the medial temporal lobe was deactivated during this operation, consistent with the view that implicit processing does not rely on declarative memory mechanisms that engage the medial temporal lobe. In the context of recent FMRI findings, we raise the question whether Broca’s region (or subregions) is specifically related to syntactic movement operations or the processing of hierarchically nested non-adjacent dependencies in the discussion section. We conclude that this is not the case. Instead, we argue that the left inferior frontal region is a generic on-line sequence processor that unifies information from various sources in an incremental and recursive manner, independent of whether there are any processing requirements related to syntactic movement or hierarchically nested structures. In addition, we argue that the Chomsky hierarchy is not directly relevant for neurobiological systems.     

EEG theta and gamma responses to semantic violations in online sentence processing

We explore the nature of the oscillatory dynamics in the EEG of subjects reading sentences that contain a semantic violation. More specifically, we examine whether increases in theta ( approximately 3-7 Hz) and gamma (around 40 Hz) band power occur in response to sentences that were either semantically correct or contained a semantically incongruent word (semantic violation). ERP results indicated a classical N400 effect. A wavelet-based time-frequency analysis revealed a theta band power increase during an interval of 300-800 ms after critical word onset, at temporal electrodes bilaterally for both sentence conditions, and over midfrontal areas for the semantic violations only. In the gamma frequency band, a predominantly frontal power increase was observed during the processing of correct sentences. This effect was absent following semantic violations. These results provide a characterization of the oscillatory brain dynamics, and notably of both theta and gamma oscillations, that occur during language comprehension.     

Differential prefrontal-temporal neural correlates of semantic processing in children

This study used functional magnetic resonance imaging (fMRI) to examine brain-behavior correlations in a group of 16 children (9- to 12-year-olds). Activation was measured during a semantic judgment task presented in either the visual or auditory modality that required the individual to determine whether a final word was related in meaning to one of two previous words (e.g., found-tank-lost). The main finding was that higher performers (i.e., accuracy) were associated with more activation in posterior representational systems including the inferior and middle temporal gyri, whereas lower performers were associated with more activation in anterior regions including the inferior and middle frontal gyri. This pattern of results was interpreted as reflecting an elaborated semantic representational system in temporal areas for the high accuracy performers that allowed them to efficiently and accurately make meaning based judgments. The low accuracy performers may have an inaccurate or weakly interconnected semantic system that results in greater use of frontal areas in a feature selection process.