动词论元结构复杂性加工的认知神经机制

动词论元结构复杂性表现在论元数量、论元范畴选择模式、题元角色指派模式和映射方式四个方面。大部分实证研究表明, 更多的论元数量、选择性论元范畴、选择性题元角色指派以及非典型映射, 使动词论元结构加工的认知神经机制更复杂。多论元加工功能脑区主要涉及左侧额下回和外侧裂周后部; 选择性论元范畴加工功能脑区主要涉及左侧额下回、额叶中后部、颞上回和颞叶中后部; 选择性题元角色指派加工功能脑区主要涉及外侧裂周后部、左侧额叶中后部和额下回; 非典型映射加工功能脑区主要涉及左侧额下回、颞上回、颞中回和颞叶后部。左侧额下回可能涉及初始句法加工、动词次范畴确定、句法移位和非宾格动词语义加工, 左侧额叶中后部可能涉及初始句法加工和动词次范畴确定, 左侧颞上回和颞叶中后部可能涉及表层句法加工和表层论元句法-语义整合, 外侧裂周后部可能涉及论元语义表征。动词论元结构加工过程和动词词汇特征表明, 复杂性某些方面存在交互作用。动词论元结构复杂性与加工难易的对应关系、复杂性加工难度层级和交互作用的认知神经机制以及汉语动词论元结构复杂性加工认知神经机制等议题, 有待进一步探讨。     

Neural responses to morphological, syntactic, and semantic properties of single words: an fMRI study

Dissociations in the recognition of specific classes of words have been documented in brain-injured populations. These include deficits in the recognition and production of morphologically complex words as well as impairments specific to particular syntactic classes such as verbs. However, functional imaging evidence for distinctions among the neural systems underlying these dissociations has been inconclusive. We explored the neural systems involved in processing different word classes in a functional Magnetic Resonance Imaging study, contrasting four groups of words co-varying morphological complexity (simple, monomorphemic words vs complex derived or inflected words) and syntactic class (verbs vs nouns/adjectives). Subtraction of word from letter string processing showed activation in left frontal and temporal lobe regions consistent with prior studies of visual word processing. No differences were observed for morphologically complex and simple words, despite adequate power to detect stimulus specific effects. A region of posterior left middle temporal gyrus showed significantly increased activation for verbs. Post hoc analyses showed that this elevated activation could also be related to semantic properties of the stimulus items (verbs have stronger action associations than nouns, and action association is correlated with activation). Results suggest that semantic as well as syntactic factors should be considered when assessing the neural systems involved in single word comprehension.     

An event-related fMRI study of syntactic and semantic violations

We used event-related functional magnetic resonance imaging to identify brain regions involved in syntactic and semantic processing. Healthy adult males read well-formed sentences randomly intermixed with sentences which either contained violations of syntactic structure or were semantically implausible. Reading anomalous sentences, as compared to well-formed sentences, yielded distinct patterns of activation for the two violation types. Syntactic violations elicited significantly greater activation than semantic violations primarily in superior frontal cortex. Semantically incongruent sentences elicited greater activation than syntactic violations in the left hippocampal and parahippocampal gyri, the angular gyri bilaterally, the right middle temporal gyrus, and the left inferior frontal sulcus. These results demonstrate that syntactic and semantic processing result in nonidentical patterns of activation, including greater frontal engagement during syntactic processing and larger increases in temporal and temporo-parietal regions during semantic analyses.     

Syntactic processing in bilinguals: an fNIRS study

The study of the neural basis of syntactic processing has greatly benefited from neuroimaging techniques. Research on syntactic processing in bilinguals has used a variety of techniques, including mainly functional magnetic resonance imaging (fMRI) and event-related potentials (ERP). This paper reports on a functional near-infrared spectroscopy (fNIRS) study on syntactic processing in highly proficient young adult speakers of Portuguese (mother tongue) (L1) and French (second language) (L2). They made a syntactic judgment of visually presented sentences, which either did or did not contain noun-verb agreement violations. The results showed that syntactic processing in both languages resulted in significant activation in anterior frontal regions of the left hemisphere and in the temporal superior posterior areas of the right hemisphere, with a more prominent activation for L2 in some areas. These findings corroborate previously reported neuroimaging evidence, showing the suitability of fNIRS for the study of syntactic processing in the bilingual brain.     

The neural basis of syntactic deficits in primary progressive aphasia

Patients with primary progressive aphasia (PPA) vary considerably in terms of which brain regions are impacted, as well as in the extent to which syntactic processing is impaired. Here we review the literature on the neural basis of syntactic deficits in PPA. Structural and functional imaging studies have most consistently associated syntactic deficits with damage to left inferior frontal cortex. Posterior perisylvian regions have been implicated in some studies. Damage to the superior longitudinal fasciculus, including its arcuate component, has been linked with syntactic deficits, even after gray matter atrophy is taken into account. These findings suggest that syntactic processing depends on left frontal and posterior perisylvian regions, as well as intact connectivity between them. In contrast, anterior temporal regions, and the ventral tracts that link frontal and temporal language regions, appear to be less important for syntax, since they are damaged in many PPA patients with spared syntactic processing.     

Prominence vs. aboutness in sequencing: A functional distinction within the left inferior frontal gyrus

Prior research on the neural bases of syntactic comprehension suggests that activation in the left inferior frontal gyrus (lIFG) correlates with the processing of word order variations. However, there are inconsistencies with respect to the specific subregion within the IFG that is implicated by these findings: the pars opercularis or the pars triangularis. Here, we examined the hypothesis that the dissociation between pars opercularis and pars triangularis activation may reflect functional differences between clause-medial and clause-initial word order permutations, respectively. To this end, we directly compared clause-medial and clause-initial object-before-subject orders in German in a within-participants, event-related fMRI design. Our results showed increased activation for object-initial sentences in a bilateral network of frontal, temporal and subcortical regions. Within the lIFG, posterior and inferior subregions showed only a main effect of word order, whereas more anterior and superior subregions showed effects of word order and sentence type, with higher activation for sentences with an argument in the clause-initial position. These findings are interpreted as evidence for a functional gradation of sequence processing within the left IFG: posterior subportions correlate with argument prominence-based (local) aspects of sequencing, while anterior subportions correlate with aboutness-based aspects of sequencing, which are crucial in linking the current sentence to the wider discourse. This proposal appears compatible with more general hypotheses about information processing gradients in prefrontal cortex (Koechlin & Summerfield, 2007).     

Cortical localisation of the visual and auditory word form areas: a reconsideration of the evidence

In this paper we examine the evidence for human brain areas dedicated to visual or auditory word form processing by comparing cortical activation for auditory word repetition, reading, picture naming, and environmental sound naming. Both reading and auditory word repetition activated left lateralised regions in the frontal operculum (Broca's area), posterior superior temporal gyrus (Wernicke's area), posterior inferior temporal cortex, and a region in the mid superior temporal sulcus relative to baseline conditions that controlled for sensory input and motor output processing. In addition, auditory word repetition increased activation in a lateral region of the left mid superior temporal gyrus but critically, this area is not specific to auditory word processing, it is also activated in response to environmental sounds. There were no reading specific activations, even in the areas previously claimed as visual word form areas: activations were either common to reading and auditory word repetition or common to reading and picture naming. We conclude that there is no current evidence for cortical sites dedicated to visual or auditory word form processing.     

Auditory language comprehension: an event-related fMRI study on the processing of syntactic and lexical information

The functional specificity of different brain regions recruited in auditory language processing was investigated by means of event-related functional magnetic resonance imaging (fMRI) while subjects listened to speech input varying in the presence or absence of semantic and syntactic information. There were two sentence conditions containing syntactic structure, i.e., normal speech (consisting of function and content words), syntactic speech (consisting of function words and pseudowords), and two word-list conditions, i.e., real words and pseudowords. The processing of auditory language, in general, correlates with significant activation in the primary auditory cortices and in adjacent compartments of the superior temporal gyrus bilaterally. Processing of normal speech appeared to have a special status, as no frontal activation was observed in this case but was seen in the other three conditions. This difference may point toward a certain automaticity of the linguistic processes used during normal speech comprehension. When considering the three other conditions, we found that these were correlated with activation in both left and right frontal cortices. An increase of activation in the planum polare bilaterally and in the deep portion of the left frontal operculum was found exclusively when syntactic processes were in focus. Thus, the present data may be taken to suggest an involvement of the left frontal and bilateral temporal cortex when processing syntactic information during comprehension.     

Auditory language comprehension: an event-related fMRI study on the processing of syntactic and lexical information

The functional specificity of different brain areas recruited in auditory language processing was investigated by means of event-related functional magnetic resonance imaging (fMRI) while subjects listened to speech input varying in the presence or absence of semantic and syntactic information. There were two sentence conditions containing syntactic structure, i.e., normal speech (consisting of function and content words), syntactic speech (consisting of function words and pseudowords), and two word-list conditions, i.e., real words and pseudowords. The processing of auditory language, in general, correlates with significant activation in the primary auditory cortices and in adjacent compartments of the superior temporal gyrus bilaterally. Processing of normal speech appeared to have a special status, as no frontal activation was observed in this case but was seen in the three other conditions. This difference may point toward a certain automaticity of the linguistic processes used during normal speech comprehension. When considering the three other conditions, we found that these were correlated with activation in both left and right frontal cortices. An increase of activation in the planum polare bilaterally and in the deep portion of the left frontal operculum was found exclusively when syntactic processes were in focus. Thus, the present data may be taken to suggest an involvement of the left frontal and bilateral temporal cortex when processing syntactic information during comprehension.     

Neural responses to meaningless pseudosigns: evidence for sign-based phonetic processing in superior temporal cortex

To identify neural regions that automatically respond to linguistically structured, but meaningless manual gestures, 14 deaf native users of American Sign Language (ASL) and 14 hearing non-signers passively viewed pseudosigns (possible but non-existent ASL signs) and non-iconic ASL signs, in addition to a fixation baseline. For the contrast between pseudosigns and baseline, greater activation was observed in left posterior superior temporal sulcus (STS), but not in left inferior frontal gyrus (BA 44/45), for deaf signers compared to hearing non-signers, based on VOI analyses. We hypothesize that left STS is more engaged for signers because this region becomes tuned to human body movements that conform the phonological constraints of sign language. For deaf signers, the contrast between pseudosigns and known ASL signs revealed increased activation for pseudosigns in left posterior superior temporal gyrus (STG) and in left inferior frontal cortex, but no regions were found to be more engaged for known signs than for pseudosigns. This contrast revealed no significant differences in activation for hearing non-signers. We hypothesize that left STG is involved in recognizing linguistic phonetic units within a dynamic visual or auditory signal, such that less familiar structural combinations produce increased neural activation in this region for both pseudosigns and pseudowords.     

The anatomy of auditory word processing: individual variability

This study used functional magnetic resonance imaging (fMRI) to investigate the neural substrate underlying the processing of single words, comparing activation patterns across subjects and within individuals. In a word repetition task, subjects repeated single words aloud with instructions not to move their jaws. In a control condition involving reverse speech, subjects heard a digitally reversed speech token and said aloud the word "crime." The averaged fMRI results showed activation in the left posterior temporal and inferior frontal regions and in the supplementary motor area, similar to previous PET studies. However, the individual subject data revealed variability in the location of the temporal and frontal activation. Although these results support previous imaging studies, demonstrating an averaged localization of auditory word processing in the posterior superior temporal gyrus (STG), they are more consistent with traditional neuropsychological data, which suggest both a typical posterior STG localization and substantial individual variability. By using careful head restraint and movement analysis and correction methods, the present study further demonstrates the feasibility of using overt articulation in fMRI experiments.     

Gesture in the developing brain

Speakers convey meaning not only through words, but also through gestures. Although children are exposed to co-speech gestures from birth, we do not know how the developing brain comes to connect meaning conveyed in gesture with speech. We used functional magnetic resonance imaging (fMRI) to address this question and scanned 8- to 11-year-old children and adults listening to stories accompanied by hand movements, either meaningful co-speech gestures or meaningless self-adaptors. When listening to stories accompanied by both types of hand movement, both children and adults recruited inferior frontal, inferior parietal, and posterior temporal brain regions known to be involved in processing language not accompanied by hand movements. There were, however, age-related differences in activity in posterior superior temporal sulcus (STSp), inferior frontal gyrus, pars triangularis (IFGTr), and posterior middle temporal gyrus (MTGp) regions previously implicated in processing gesture. Both children and adults showed sensitivity to the meaning of hand movements in IFGTr and MTGp, but in different ways. Finally, we found that hand movement meaning modulates interactions between STSp and other posterior temporal and inferior parietal regions for adults, but not for children. These results shed light on the developing neural substrate for understanding meaning contributed by co-speech gesture.     

社会互动加工的认知特性及脑机制——第三人称的视角

在日常生活中, 从“第三人称”的视角识别并理解他人的社会互动至关重要。这种社会互动加工具有两种认知特性：构形整体性和动作关联性; 体现为一个由众多脑区共同参与的层级加工过程, 主要包括个体知觉网络、动作观察网络和心智化网络。其中, 后颞上沟等脑区在表征社会互动关系中起着关键作用。未来的研究需要结合多种技术手段进一步揭示社会互动加工的遗传特性和神经机制, 并关注它在实际生活中的应用。     

Minds, persons, and space: an fMRI investigation into the relational complexity of higher-order intentionality

Mental state reasoning or theory-of-mind has been the subject of a rich body of imaging research. Although such investigations routinely tap a common set of regions, the precise function of each area remains a contentious matter. With the help of functional magnetic resonance imaging (fMRI), we sought to determine which areas are involved when processing mental state or intentional metarepresentations by focusing on the relational aspect of such representations. Using non-intentional relational representations such as spatial relations between persons and between objects as a contrast, the results ascertained the involvement of the precuneus, the temporal poles, and the medial prefrontal cortex in the processing of intentional representations. In contrast, the anterior superior temporal sulcus and the left temporo-parietal junction were implicated when processing representations that refer to the presence of persons in relational contexts in general. The right temporo-parietal junction, however, was specifically activated for persons entering spatial relations. The level of representational complexity, a previously unexplored factor, was also found to modulate the neural response in some brain regions, such as the medial prefrontal cortex and the right temporo-parietal junction. These findings highlight the need to take into account the critical roles played by an extensive network of neural regions during mental state reasoning.     

Cortical integration of audio–visual speech and non-speech stimuli

Using fMRI we investigated the neural basis of audio–visual processing of speech and non-speech stimuli using physically similar auditory stimuli (speech and sinusoidal tones) and visual stimuli (animated circles and ellipses). Relative to uni-modal stimuli, the different multi-modal stimuli showed increased activation in largely non-overlapping areas. Ellipse-Speech, which most resembles naturalistic audio–visual speech, showed higher activation in the right inferior frontal gyrus, fusiform gyri, left posterior superior temporal sulcus, and lateral occipital cortex. Circle-Tone, an arbitrary audio–visual pairing with no speech association, activated middle temporal gyri and lateral occipital cortex. Circle-Speech showed activation in lateral occipital cortex, and Ellipse-Tone did not show increased activation relative to uni-modal stimuli. Further analysis revealed that middle temporal regions, although identified as multi-modal only in the Circle-Tone condition, were more strongly active to Ellipse-Speech or Circle-Speech, but regions that were identified as multi-modal for Ellipse-Speech were always strongest for Ellipse-Speech. Our results suggest that combinations of auditory and visual stimuli may together be processed by different cortical networks, depending on the extent to which multi-modal speech or non-speech percepts are evoked.     

Syntactic structure building in the anterior temporal lobe during natural story listening

The neural basis of syntax is a matter of substantial debate. In particular, the inferior frontal gyrus (IFG), or Broca’s area, has been prominently linked to syntactic processing, but the anterior temporal lobe has been reported to be activated instead of IFG when manipulating the presence of syntactic structure. These findings are difficult to reconcile because they rely on different laboratory tasks which tap into distinct computations, and may only indirectly relate to natural sentence processing. Here we assessed neural correlates of syntactic structure building in natural language comprehension, free from artificial task demands. Subjects passively listened to Alice in Wonderland during functional magnetic resonance imaging and we correlated brain activity with a word-by-word measure of the amount syntactic structure analyzed. Syntactic structure building correlated with activity in the left anterior temporal lobe, but there was no evidence for a correlation between syntactic structure building and activity in inferior frontal areas. Our results suggest that the anterior temporal lobe computes syntactic structure under natural conditions.     

句法歧义消解影响因素、认知机制及其神经基础

句法歧义消解主要是指人们在面临多种句法分析可能性的情况下,句法分析器抑制不正确的句法分析而选择正确句法分析的认知过程。研究表明,该过程受到工作记忆、认知控制能力、语言分布频率、语境、韵律等因素的影响。为有效说明人们是如何完成句法歧义消解的,研究者们建构了诸如花园路径模型、约束满意理论、弱交互作用句法分析理论等相关模型。另外,基于脑成像技术研究表明,左侧额下回、左侧颞叶后部、中部和前部在句法消歧任务中都有显著激活。未来研究当围绕着句法消歧中的语义效应、句法和词汇歧义消解机制的异同、句法消歧中抑制能力的效应等方面展开。     

Role of left posterior superior temporal gyrus in phonological processing for speech perception and production

Models of both speech perception and speech production typically postulate a processing level that involves some form of phonological processing. There is disagreement, however, on the question of whether there are separate phonological systems for speech input versus speech output. We review a range of neuroscientific data that indicate that input and output phonological systems partially overlap. An important anatomical site of overlap appears to be the left posterior superior temporal gyrus. We then present the results of a new event-related functional magnetic resonance imaging (fMRI) experiment in which participants were asked to listen to and then (covertly) produce speech. In each participant, we found two regions in the left posterior superior temporal gyrus that responded both to the perception and production components of the task, suggesting that there is overlap in the neural systems that participate in phonological aspects of speech perception and speech production. The implications for neural models of verbal working memory are also discussed in connection with our findings.     

How reading acquisition changes children’s spoken language network

To examine the influence of age and reading proficiency on the development of the spoken language network, we tested 6- and 9-years-old children listening to native and foreign sentences in a slow event-related fMRI paradigm. We observed a stable organization of the peri-sylvian areas during this time period with a left dominance in the superior temporal sulcus and inferior frontal region. A year of reading instruction was nevertheless sufficient to increase activation in regions involved in phonological representations (posterior superior temporal region) and sentence integration (temporal pole and pars orbitalis). A top-down activation of the left inferior temporal cortex surrounding the visual word form area, was also observed but only in 9 year-olds (3 years of reading practice) listening to their native language. These results emphasize how a successful cultural practice, reading, slots in the biological constraints of the innate spoken language network.     

Dissociable patterns of brain activity during comprehension of rapid and syntactically complex speech: evidence from fMRI

Sentence comprehension is a complex task that involves both language-specific processing components and general cognitive resources. Comprehension can be made more difficult by increasing the syntactic complexity or the presentation rate of a sentence, but it is unclear whether the same neural mechanism underlies both of these effects. In the current study, we used event-related functional magnetic resonance imaging (fMRI) to monitor neural activity while participants heard sentences containing a subject-relative or object-relative center-embedded clause presented at three different speech rates. Syntactically complex object-relative sentences activated left inferior frontal cortex across presentation rates, whereas sentences presented at a rapid rate recruited frontal brain regions such as anterior cingulate and premotor cortex, regardless of syntactic complexity. These results suggest that dissociable components of a large-scale neural network support the processing of syntactic complexity and speech presented at a rapid rate during auditory sentence processing.