The Two-Level Theory of verb meaning: An approach to integrating the semantics of action with the mirror neuron system

Verbs have two separate levels of meaning. One level reflects the uniqueness of every verb and is called the "root". The other level consists of a more austere representation that is shared by all the verbs in a given class and is called the "event structure template". We explore the following hypotheses about how, with specific reference to the motor features of action verbs, these two distinct levels of semantic representation might correspond to two distinct levels of the mirror neuron system. Hypothesis 1: Root-level motor features of verb meaning are partially subserved by somatotopically mapped mirror neurons in the left primary motor and/or premotor cortices. Hypothesis 2: Template-level motor features of verb meaning are partially subserved by representationally more schematic mirror neurons in Brodmann area 44 of the left inferior frontal gyrus. Evidence has been accumulating in support of the general neuroanatomical claims made by these two hypotheses-namely, that each level of verb meaning is associated with the designated cortical areas. However, as yet no studies have satisfied all the criteria necessary to support the more specific neurobiological claims made by the two hypotheses-namely, that each level of verb meaning is associated with mirror neurons in the pertinent brain regions. This would require demonstrating that within those regions the same neuronal populations are engaged during (a) the linguistic processing of particular motor features of verb meaning, (b) the execution of actions with the corresponding motor features, and (c) the observation of actions with the corresponding motor features.     

Neuroanatomically separable effects of imageability and grammatical class during single-word comprehension

The present study characterizes the neural correlates of noun and verb imageability and addresses the question of whether components of the neural network supporting word recognition can be separately modified by variations in grammatical class and imageability. We examined the effect of imageability on BOLD signal during single-word comprehension of nouns and verbs. Subjects made semantic similarity judgments while undergoing functional magnetic resonance imaging (fMRI). Nouns and verbs were matched on imageability, and imageability varied continuously within a grammatical category. We observed three anatomically separable effects: a main effect of grammatical class, a main effect of imageability, and an imageability by grammatical class cross-over interaction. The left superior parietal lobule and a region in the left fusiform responded similarly to increases in noun and verb imageability; the left superior temporal gyrus showed greater activity for verbs than nouns after imageability was matched across grammatical class; and, in both the left middle temporal gyrus and the left inferior frontal lobe, a decrease in noun but not verb imageability resulted in higher BOLD signal. The presence of reliable and anatomically separable main effects of both imageability and grammatical class renders unlikely the hypothesis that previously reported dissociations between nouns and verbs can be dismissed as imageability effects. However, some regions previously thought to respond to grammatical class or imageability instead respond to the interaction of these variables.     

动词论元结构复杂性加工的认知神经机制

动词论元结构复杂性表现在论元数量、论元范畴选择模式、题元角色指派模式和映射方式四个方面。大部分实证研究表明, 更多的论元数量、选择性论元范畴、选择性题元角色指派以及非典型映射, 使动词论元结构加工的认知神经机制更复杂。多论元加工功能脑区主要涉及左侧额下回和外侧裂周后部; 选择性论元范畴加工功能脑区主要涉及左侧额下回、额叶中后部、颞上回和颞叶中后部; 选择性题元角色指派加工功能脑区主要涉及外侧裂周后部、左侧额叶中后部和额下回; 非典型映射加工功能脑区主要涉及左侧额下回、颞上回、颞中回和颞叶后部。左侧额下回可能涉及初始句法加工、动词次范畴确定、句法移位和非宾格动词语义加工, 左侧额叶中后部可能涉及初始句法加工和动词次范畴确定, 左侧颞上回和颞叶中后部可能涉及表层句法加工和表层论元句法-语义整合, 外侧裂周后部可能涉及论元语义表征。动词论元结构加工过程和动词词汇特征表明, 复杂性某些方面存在交互作用。动词论元结构复杂性与加工难易的对应关系、复杂性加工难度层级和交互作用的认知神经机制以及汉语动词论元结构复杂性加工认知神经机制等议题, 有待进一步探讨。     

Imageability and semantic association in the representation and processing of event verbs

This study examined the relative salience of imageability (the degree to which a word evokes mental imagery) versus semantic association (the density of semantic network in which a word is embedded) in the representation and processing of four types of event verbs: sensory, cognitive, speech, and motor verbs. ERP responses were recorded, while 34 university students performed on a lexical decision task. Analysis focused primarily on amplitude differences across verb conditions within the N400 time window where activities are considered representing meaning activation. Variation in N400 amplitude across four types of verbs was found significantly associated with the level of imageability, but not the level of semantic association. The findings suggest imageability as a more salient factor relative to semantic association in the processing of these verbs. The role of semantic association and the representation of speech verbs are also discussed.     

文盲与非文盲汉字字形和语音加工的脑机制

利用功能性磁共振成像(fMRI)技术探讨文盲和非文盲汉字字形和语音加工脑机制的差异。实验1使用汉字字形和图形比较了中国人文盲和非文盲字形加工过程脑机制的左侧差异。实验2使用汉字语音和纯音比较了文盲和非文盲语音加工过程脑机制的双侧差异。结果表明文盲与非文盲汉字字形和语音加工脑机制不同,且非文盲的脑活动强。     

The role of the ventral and dorsal pathways in reading Chinese characters and English words

Previous literature in alphabetic languages suggests that the occipital-temporal region (the ventral pathway) is specialized for automatic parallel word recognition, whereas the parietal region (the dorsal pathway) is specialized for serial letter-by-letter reading ( [Cohen et al., 2008] and [Ho et al., 2002] ). However, few studies have directly examined the role of the ventral and dorsal pathways in Chinese reading compared to English reading. To investigate this issue, we adopted the degraded word processing paradigm used by Cohen et al. (2008) and compared brain regions involved in the processing of degraded Chinese characters and English words during lexical decision, using functional magnetic resonance imaging (fMRI). The degraded characters/words were created by inserting blank spaces between radicals of Chinese characters or syllables of English polysyllabic words. Generally, the current study replicated the effects of Cohen et al. (2008), showing that in Chinese – like in alphabetic languages – character spacing modulates both ventral (bilateral cuneus, left middle occipital gyrus) and dorsal (left superior parietal lobule and middle frontal gyrus) pathways. In addition, the current study showed greater activation in bilateral cuneus and right lingual gyrus for Chinese versus English when comparing spaced to normal stimuli, suggesting that Chinese character recognition relies more on ventral visual-spatial processing than English word recognition. Interestingly, bilateral cuneus showed monotonic patterns in response to increasing spacing, while the rest of the regions of interest showed non-monotonic patterns, indicating different profiles for these regions in visual-spatial processing.     

押韵加工的认知神经机制

押韵是指一对词语中从最后一个发音的元音到词尾的语音结构均相同的现象。现有押韵加工主要分为押韵识别与押韵产生两个研究领域,两者的认知加工过程相似,包括字形编码、形音转换、语音表征与语音分段等阶段。从语音加工与字形加工两方面对押韵过程的神经基础进行探讨,发现左半球颞上回与额下回分别负责语音表征与语音分段,左半球梭状回参与着字形编码,而有效的形音转换依赖于左半球顶下小叶与额下回组成的神经网络。今后应进一步整合不同研究方法与任务下的研究结果,并对押韵产生加工进行更深入的探讨。     

认知判断中手部动作模拟的fMRI研究

该研究采用功能磁共振成像技术,考察不同条件下进行工具认知判断时手部姿势对认知判断的影响及动作模拟的神经机制。实验发现：手部姿势存在显著的主效应,冲突手部姿势条件下反应时最慢,且冲突手部姿势条件下与不冲突手部姿势条件下、自然状态条件下反应时存在显著差异,自然状态条件与不冲突手部姿势条件下反应时不存在显著差异。另外,f MRI成像结果发现,额中回、额下回、顶下小叶以及辅助运动区在自然状态下有显著激活,表明个体在进行认知判断过程中有动作模拟过程;海马结构、扣带回及楔前叶等与记忆有关的脑区有显著激活,表明身体经验在认知过程的作用。总的研究表明,不同的手部姿势状态对认知判断有不同影响,冲突手部姿势会对动作模拟产生干扰作用,手部动作模拟的神经机制主要涉及镜像神经元区,且在认知判断时存在具身效应。     

Effects of relative embodiment in lexical and semantic processing of verbs

Research examining semantic richness effects in visual word recognition has shown that multiple dimensions of meaning are activated in the process of word recognition (e.g., Yap et al., 2012). This research has, however, been limited to nouns. In the present research we extended the semantic richness approach to verb stimuli in order to investigate how verb meanings are represented. We characterized a dimension of relative embodiment for verbs, based on the bodily sense described by Borghi and Cimatti (2010), and collected ratings on that dimension for 687 English verbs. The relative embodiment ratings revealed that bodily experience was judged to be more important to the meanings of some verbs (e.g., dance, breathe) than to others (e.g., evaporate, expect). We then tested the effects of relative embodiment and imageability on verb processing in lexical decision (Experiment 1), action picture naming (Experiment 2), and syntactic classification (Experiment 3). In all three experiments results showed facilitatory effects of relative embodiment, but not imageability: latencies were faster for relatively more embodied verbs, even after several other lexical variables were controlled. The results suggest that relative embodiment is an important aspect of verb meaning, and that the semantic richness approach holds promise as a strategy for investigating other aspects of verb meaning.     

Body parts and early-learned verbs

This article reports the structure of associations among 101 common verbs and body parts. The verbs are those typically learned by children learning English prior to 3 years of age. In a free association task, 50 adults were asked to provide the single body part that came to mind when they thought of each verb. Analyses reveal highly systematic and structured patterns of associations that are also related to the normative age of acquisition of the verbs showing a progression from verbs associated with actions by the mouth, to verbs strongly associated with actions by hand and arm, to verbs not so strongly associated with any one body part. The results have implications for proposals about embodied verb meaning and also for processes of early verb learning.     

汉语双字词在心理词典中的表征方式:来自fNIRS的证据

以汉语双字构成的真词与假词为实验材料,22名大学生为被试,采用功能性近红外脑成像技术(f NIRS)和事件相关设计,考察被试在完成词汇判断任务时的大脑激活模式,探索汉语双字词在心理词典中的表征方式。结果发现:(1)在完成真假词判断任务时,被试大脑左侧额叶和左侧颞叶均被激活;(2)与判断假词相比,被试在判断真词时显著地激活左额上回和左额中回。这一结果说明汉语双字词在心理词典中是混合表征的。     

Effective brain connectivity in children with reading difficulties during phonological processing

Using Dynamic Causal Modeling (DCM) and functional magnetic resonance imaging (fMRI), we examined effective connectivity between three left hemisphere brain regions (inferior frontal gyrus, inferior parietal lobule, fusiform gyrus) and bilateral medial frontal gyrus in 12 children with reading difficulties (M age=12.4, range: 8.11-14.10) and 12 control children (M age=12.3, range: 8.9-14.11) during rhyming judgments to visually presented words. More difficult conflicting trials either had similar orthography but different phonology (e.g. pint-mint) or similar phonology but different orthography (e.g. jazz-has). Easier non-conflicting trials had similar orthography and phonology (e.g. dime-lime) or different orthography and phonology (e.g. staff-gain). The modulatory effect from left fusiform gyrus to left inferior parietal lobule was stronger in controls than in children with reading difficulties only for conflicting trials. Modulatory effects from left fusiform gyrus and left inferior parietal lobule to left inferior frontal gyrus were stronger for conflicting trials than for non-conflicting trials only in control children but not in children with reading difficulties. Modulatory effects from left inferior frontal gyrus to inferior parietal lobule, from medial frontal gyrus to left inferior parietal lobule, and from left inferior parietal lobule to medial frontal gyrus were positively correlated with reading skill only in control children. These findings suggest that children with reading difficulties have deficits in integrating orthography and phonology utilizing left inferior parietal lobule, and in engaging phonological rehearsal/segmentation utilizing left inferior frontal gyrus possibly through the indirect pathway connecting posterior to anterior language processing regions, especially when the orthographic and phonological information is conflicting.     

Walking or talking? Behavioral and neurophysiological correlates of action verb processing

Brain activity elicited by visually presented words was investigated using behavioral measures and current source densities calculated from high-resolution EEG recordings. Verbs referring to actions usually performed with different body parts were compared. Behavioral data indicated faster processing of verbs referring to actions performed with the face muscles and articulators (face-related words) compared to verbs referring to movements involving the lower half of the body (leg-related words). Significant topographical differences in brain activity elicited by verb types were found starting approximately 250 ms after word onset. Differences were seen at recording sites located over the motor strip and adjacent frontal cortex. At the vertex, close to the cortical representation of the leg, leg-related verbs (for example, to walk) produced strongest in-going currents, whereas for face-related verbs (for example, to talk) the most in-going activity was seen at more lateral electrodes placed over the left Sylvian fissure, close to the representation of the articulators. Thus, action words caused differential activation along the motor strip, with strongest in-going activity occurring close to the cortical representation of the body parts primarily used for carrying out the actions the verbs refer to. Topographically specific physiological signs of word processing started earlier for face-related words and lasted longer for verbs referring to leg movements. We conclude that verb types can differ in their processing speed and can elicit neurophysiological activity with different cortical topographies. These behavioral and physiological differences can be related to cognitive processes, in particular to lexical semantic access. Our results are consistent with associative theories postulating that words are organized in the brain as distributed cell assemblies whose cortical distributions reflect the words' meanings.     

Neuroanatomical distribution of five semantic components of verbs: evidence from fMRI

The Simulation Framework, also known as the Embodied Cognition Framework, maintains that conceptual knowledge is grounded in sensorimotor systems. To test several predictions that this theory makes about the neural substrates of verb meanings, we used functional magnetic resonance imaging (fMRI) to scan subjects' brains while they made semantic judgments involving five classes of verbs-specifically, Running verbs (e.g., run, jog, walk), Speaking verbs (e.g., shout, mumble, whisper), Hitting verbs (e.g., hit, poke, jab), Cutting verbs (e.g., cut, slice, hack), and Change of State verbs (e.g., shatter, smash, crack). These classes were selected because they vary with respect to the presence or absence of five distinct semantic components-specifically, ACTION, MOTION, CONTACT, CHANGE OF STATE, and TOOL USE. Based on the Simulation Framework, we hypothesized that the ACTION component depends on the primary motor and premotor cortices, that the MOTION component depends on the posterolateral temporal cortex, that the CONTACT component depends on the intraparietal sulcus and inferior parietal lobule, that the CHANGE OF STATE component depends on the ventral temporal cortex, and that the TOOL USE component depends on a distributed network of temporal, parietal, and frontal regions. Virtually all of the predictions were confirmed. Taken together, these findings support the Simulation Framework and extend our understanding of the neuroanatomical distribution of different aspects of verb meaning.     

Motor-iconicity of sign language does not alter the neural systems underlying tool and action naming

Positron emission tomography was used to investigate whether the motor-iconic basis of certain forms in American Sign Language (ASL) partially alters the neural systems engaged during lexical retrieval. Most ASL nouns denoting tools and ASL verbs referring to tool-based actions are produced with a handshape representing the human hand holding a tool and with an iconic movement depicting canonical tool use, whereas the visual iconicity of animal signs is more idiosyncratic and inconsistent across signs. We investigated whether the motor-iconic relation between a sign and its referent alters the neural substrate for lexical retrieval in ASL. Ten deaf native ASL signers viewed photographs of tools/utensils or of actions performed with or without an implement and were asked to overtly produce the ASL sign for each object or action. The control task required subjects to judge the orientation of unknown faces. Compared to the control task, naming tools engaged left inferior and middle frontal gyri, bilateral parietal lobe, and posterior inferotemporal cortex. Naming actions performed with or without a tool engaged left inferior frontal gyrus, bilateral parietal lobe, and posterior middle temporal gyrus at the temporo-occipital junction (area MT). When motor-iconic verbs were compared with non-iconic verbs, no differences in neural activation were found. Overall, the results indicate that even when the form of a sign is indistinguishable from a pantomimic gesture, the neural systems underlying its production mirror those engaged when hearing speakers name tools or tool-based actions with speech.     

Brain activations associated with sign production using word and picture inputs in deaf signers

Effective literacy education in deaf students calls for psycholinguistic research revealing the cognitive and neural mechanisms underlying their written language processing. When learning a written language, deaf students are often instructed to sign out printed text. The present fMRI study was intended to reveal the neural substrates associated with word signing by comparing it with picture signing. Native deaf signers were asked to overtly sign in Chinese Sign Language (CSL) common objects indicated with written words or presented as pictures. Except in left inferior frontal gyrus and inferior parietal lobule where word signing elicited greater activation than picture signing, the two tasks engaged a highly overlapping set of brain regions previously implicated in sign production. The results suggest that word signing in the deaf signers relies on meaning activation from printed visual forms, followed by similar production processes from meaning to signs as in picture signing. The present study also documents the basic brain activation pattern for sign production in CSL and supports the notion of a universal core neural network for sign production across different sign languages.     

Psycholinguistic measures for German verb pairs: Semantic transparency,semantic relatedness,verb family size,and age of reading acquisition

A central issue in visual and spoken word recognition is the lexical representation of complex words—in particular, whether the lexical representation of complex words depends on semantic transparency: Is a complex verb like understand lexically represented as a whole word or via its base stand, given that its meaning is not transparent from the meanings of its parts? To study this issue, a number of stimulus characteristics are of interest that are not yet available in public databases of German. This article provides semantic association ratings, lexical paraphrases, and vector-based similarity measures for German verbs, measuring (a) the semantic transparency between 1,259 complex verbs and their bases, (b) the semantic relatedness between 1,109 verb pairs with 432 different bases, and (c) the vector-based similarity measures of 846 verb pairs. Additionally, we include the verb regularity of all verbs and two counts of verb family size for 184 base verbs, as well as estimates of age of acquisition and age of reading for 200 verbs. Together with lemma and type frequencies from public lexical databases, all measures can be downloaded along with this article. Statistical analyses indicate that verb family size, morphological complexity, frequency, and verb regularity affect the semantic transparency and relatedness ratings as well as the age of acquisition estimates, indicating that these are relevant variables in psycholinguistic experiments. Although lexical paraphrases, vector-based similarity measures, and semantic association ratings may deliver complementary information, the interrater reliability of the semantic association ratings for each verb pair provides valuable information when selecting stimuli for psycholinguistic experiments.     

What matters is the underlying experience: Similar motor responses during processing observed hand actions and hand-related verbs

It is well-accepted that processing observed actions involves at some extent the same neural mechanisms responsible for action execution. More recently, it has been forwarded that also the processing of verbs expressing a specific motor content is subserved by the neural mechanisms allowing individuals to perform the content expressed by that linguistic material. This view is also known as embodiment and contrasts with a more classical approach to language processing that considers it as amodal. In the present study, we used a go/no-go paradigm, in which participants were requested to respond to real words and pictures and refrain from responding when presented stimuli were pseudowords and scrambled images. Real stimuli included pictures depicting hand- and foot-related actions and verbs expressing hand- and foot-related actions. We, therefore, directly compared the modulation of hand motor responses during the observation of actions and the presentation of verbs, expressing actions in the same category. The results have shown that participants gave slower hand motor responses during the observation of hand actions and the processing of hand-related verbs as than observed foot actions and related verbs. These findings support embodiment showing that whatever the modality of presentation (observed action or verb), the modulation of hand motor responses was similar, thus suggesting that processing seen actions and related verbs shares common mechanisms most likely involving the motor system and the underlying motor experience.     

The brain adapts to orthography with experience: evidence from English and Chinese

Using functional magnetic resonance imaging (fMRI), we examined the process of language specialization in the brain by comparing developmental changes in two contrastive orthographies: Chinese and English. In a visual word rhyming judgment task, we found a significant interaction between age and language in left inferior parietal lobule and left superior temporal gyrus, which was due to greater developmental increases in English than in Chinese. Moreover, we found that higher skill only in English children was correlated with greater activation in left inferior parietal lobule. These findings suggest that the regions associated with phonological processing are essential in English reading development. We also found greater developmental increases in English than in Chinese in left inferior temporal gyrus, suggesting refinement of this region for fine‐grained word form recognition. In contrast, greater developmental increases in Chinese than in English were found in right middle occipital gyrus, suggesting the importance of holistic visual‐orthographic analysis in Chinese reading acquisition. Our results suggest that the brain adapts to the special features of the orthography by engaging relevant brain regions to a greater degree over development.