Reading action word affects the visual perception of biological motion

In the present study, we investigate whether reading an action-word can influence subsequent visual perception of biological motion. The participant's task was to perceptually judge whether a human action identifiable in the biological motion of a point-light display embedded in a high density mask was present or not in the visual sequence, which lasted for 633 ms on average. Prior to the judgement task, participants were exposed to an abstract verb or an action verb for 500 ms, which was related to the human action according to a congruent or incongruent semantic relation. Data analysis showed that correct judgements were not affected by action verbs, whereas a facilitation effect on response time (49 ms on average) was observed when a congruent action verb primed the judgement of biological movements. In relation with the existing literature, this finding suggests that the perception, the planning and the linguistic coding of motor action are subtended by common motor representations.     

Task related modulation of the motor system during language processing

Recent neurophysiological and brain imaging studies have shown that the motor system is involved in language processing. However, it is an open question whether this involvement is a necessary requisite to understand language or rather a side effect of distinct cognitive processes underlying it. In order to clarify this issue we carried out three behavioral experiments, using a go-no go paradigm. Italian verbs expressing hand actions, foot actions or an abstract content served as stimuli. Participants used their right hands to respond. In Experiment 1, in which a semantics decision task with an early delivery of the go signal (during processing language material) was used, slower responses were found for hand action-related verbs than for foot action-related verbs. In Experiment 2, using the same task with either an early or a delayed delivery of the go signal (when language material had been already processed), no difference was found between responses to the two verb categories in the delayed delivery condition. In Experiment 3, in which a lexical decision task with an early delivery of the go signal was used, again no difference between the two verb categories was found. The present findings demonstrate that during language processing the modulation of the motor system crucially occurs while performing a semantics decision task, thus supporting the notion that this involvement is a necessary step to understand language rather than a side effect of upstream cognitive processes.     

Walking or talking? Behavioral and neurophysiological correlates of action verb processing

Brain activity elicited by visually presented words was investigated using behavioral measures and current source densities calculated from high-resolution EEG recordings. Verbs referring to actions usually performed with different body parts were compared. Behavioral data indicated faster processing of verbs referring to actions performed with the face muscles and articulators (face-related words) compared to verbs referring to movements involving the lower half of the body (leg-related words). Significant topographical differences in brain activity elicited by verb types were found starting approximately 250 ms after word onset. Differences were seen at recording sites located over the motor strip and adjacent frontal cortex. At the vertex, close to the cortical representation of the leg, leg-related verbs (for example, to walk) produced strongest in-going currents, whereas for face-related verbs (for example, to talk) the most in-going activity was seen at more lateral electrodes placed over the left Sylvian fissure, close to the representation of the articulators. Thus, action words caused differential activation along the motor strip, with strongest in-going activity occurring close to the cortical representation of the body parts primarily used for carrying out the actions the verbs refer to. Topographically specific physiological signs of word processing started earlier for face-related words and lasted longer for verbs referring to leg movements. We conclude that verb types can differ in their processing speed and can elicit neurophysiological activity with different cortical topographies. These behavioral and physiological differences can be related to cognitive processes, in particular to lexical semantic access. Our results are consistent with associative theories postulating that words are organized in the brain as distributed cell assemblies whose cortical distributions reflect the words' meanings.     

习得年龄对客体和动作图画口语命名的不同影响：ERP研究

词汇习得年龄指人们最早理解单词意义时的年龄, 已有研究发现早习得词汇的阅读反应时间短于晚习得词汇, 研究者对于词汇习得年龄效应的认知机制存在争论。本研究运用事件相关电位技术, 考察了词汇习得年龄(早与晚)对客体图画和动作图画命名的影响。研究中采用图画命名任务, 要求被试在看到图画后迅速且准确地说出图画名称。结果发现早习得名词的命名快于晚习得名词, 而早习得动词的命名却慢于晚习得动词; 习得年龄对于名词产生的影响发生在图画呈现后的250~300 ms之间, 表现为早习得名词波幅小于晚习得名词, 而习得年龄对于动词产生的影响发生在图画呈现后的200~600 ms之间, 表现为早习得动词波幅大于晚习得动词。这表明名词产生中的习得年龄效应发生在词汇选择阶段, 支持了语义假设的观点; 动词产生过程中的习得年龄效应出现在多个加工阶段, 包括了词汇选择、音韵编码和语音编码阶段, 这与动词语义的多重性及其与动作相关的脑区激活有关, 支持了网络可塑性假说的观点。     

汉语及物动词词典中宾语信息的表征

该研究利用认知行为反应时方法,操作汉语及物动词与宾语之间的搭配关系,对汉语及物动词词典中宾语信息的表征情况进行了考察。结果发现,随着动词与宾语搭配的语义违反程度的增大,反应时增加。这表明,汉语及物动词词典中存在比较精确的宾语信息,其宾语信息是以语义特征来表征的。     

Parkinson’s disease disrupts both automatic and controlled processing of action verbs

The problem of how word meaning is processed in the brain has been a topic of intense investigation in cognitive neuroscience. While considerable correlational evidence exists for the involvement of sensory-motor systems in conceptual processing, it is still unclear whether they play a causal role. We investigated this issue by comparing the performance of patients with Parkinson’s disease (PD) with that of age-matched controls when processing action and abstract verbs. To examine the effects of task demands, we used tasks in which semantic demands were either implicit (lexical decision and priming) or explicit (semantic similarity judgment). In both tasks, PD patients’ performance was selectively impaired for action verbs (relative to controls), indicating that the motor system plays a more central role in the processing of action verbs than in the processing of abstract verbs. These results argue for a causal role of sensory-motor systems in semantic processing.     

身体活动与心理活动动词加工的ERP比较

在19名右利手被试完成词汇判断任务的同时,通过119个头皮电极记录其事件相关电位（ERP）,以此来探讨表示身体活动的动词与表示心理活动的动词之间的加工差异。研究结果表明,在200~300ms时窗,在左半球枕区附近,身体活动动词所诱发的ERP比心理活动动词所诱发的ERP在正走向上更小。在300~400ms（即类似的N400）时窗,动词类型效应出现在中线和左半球的更大的区域上,特别是中央区附近,身体活动动词所诱发的ERP比心理活动动词所诱发的ERP在负走向上更大。语言表征的神经生物学理论可以解释本研究的部分结果。     

Dissociation and association of the embodied representation of tool-use verbs and hand verbs: An fMRI study

Embodied semantic theories suppose that representation of word meaning and actual sensory-motor processing are implemented in overlapping systems. According to this view, association and dissociation of different word meaning should correspond to dissociation and association of the described sensory-motor processing. Previous studies demonstrate that although tool-use actions and hand actions have overlapping neural substrates, tool-use actions show greater activations in frontal–parietal–temporal regions that are responsible for motor control and tool knowledge processing. In the present study, we examined the association and the dissociation of the semantic representation of tool-use verbs and hand action verbs. Chinese verbs describing tool-use or hand actions without tools were included, and a passive reading task was employed. All verb conditions showed common activations in areas of left middle frontal gyrus, left inferior frontal gyrus (BA 44/45) and left inferior parietal lobule relative to rest, and all conditions showed significant effects in premotor areas within the mask of hand motion effects. Contrasts between tool-use verbs and hand verbs demonstrated that tool verbs elicited stronger activity in left superior parietal lobule, left middle frontal gyrus and left posterior middle temporal gyrus. Additionally, psychophysiological interaction analyses demonstrated that tool verbs indicated greater connectivity among these regions. These results suggest that the brain regions involved in tool-use action processing also play more important roles in tool-use verb processing and that similar systems may be responsible for word meaning representation and actual sensory-motor processing.     

动词理解中空间表征的激活过程

探讨动词理解中空间表征的激活过程。被试听以不同空间轴向动词作谓语的句子后辨认视觉刺激的形状。实验1以肯定句为材料探讨语义理解对视知觉任务的影响。实验2以客观原因否定句为材料排除句子表征的影响。实验3以主观原因否定句为材料探讨动词空间元素的激活机制。总的结果表明,动词理解过程中激活其表征中的空间元素,这种激活是自动的、非策略性的,不受情境中客观原因或主观意愿否定的影响。动词理解空间效应反映了语言表征中的知觉运动特征     

What matters is the underlying experience: Similar motor responses during processing observed hand actions and hand-related verbs

It is well-accepted that processing observed actions involves at some extent the same neural mechanisms responsible for action execution. More recently, it has been forwarded that also the processing of verbs expressing a specific motor content is subserved by the neural mechanisms allowing individuals to perform the content expressed by that linguistic material. This view is also known as embodiment and contrasts with a more classical approach to language processing that considers it as amodal. In the present study, we used a go/no-go paradigm, in which participants were requested to respond to real words and pictures and refrain from responding when presented stimuli were pseudowords and scrambled images. Real stimuli included pictures depicting hand- and foot-related actions and verbs expressing hand- and foot-related actions. We, therefore, directly compared the modulation of hand motor responses during the observation of actions and the presentation of verbs, expressing actions in the same category. The results have shown that participants gave slower hand motor responses during the observation of hand actions and the processing of hand-related verbs as than observed foot actions and related verbs. These findings support embodiment showing that whatever the modality of presentation (observed action or verb), the modulation of hand motor responses was similar, thus suggesting that processing seen actions and related verbs shares common mechanisms most likely involving the motor system and the underlying motor experience.     

Auditory verb perception recruits motor systems in the developing brain: an fMRI investigation

This study investigated neural activation patterns during verb processing in children, using fMRI (functional Magnetic Resonance Imaging). Preschool children (aged 4–6) passively listened to lists of verbs and adjectives while neural activation was measured. Findings indicated that verbs were processed differently than adjectives, as the verbs recruited motor systems in the frontal cortex during auditory perception, but the adjectives did not. Further evidence suggested that different types of verbs activated different regions in the motor cortex. The results demonstrate that the motor system is recruited during verb perception in the developing brain, reflecting the embodied nature of language learning and processing.     

名词与动词加工的ERP差异

采用词汇判断任务和记录ERP的方法,探讨了名词与动词之间的差异以及词汇的具体性对这种词性效应的影响。研究结果表明,在200~300ms、300~400ms（即N400）时窗,词性与具体性的交互作用在两侧电极上达到显著水平,在两半球上具体名词所诱发的ERP比具体动词更负。并且,在N400上词性与电极位置有显著的交互作用,名词与动词的差异主要存在于左、右半球的额叶和颞叶。本研究结果部分支持了语言表征的神经生物学理论     

Interplay of emotional valence and concreteness in word processing: An event-related potential study with verbs

The functional locus of emotional valence in word processing remains an open question. In event-related potentials, emotion has been found to elicit an early posterior negativity (EPN), which is assumed to reflect attention catching by the words’ meaning. Previously, the EPN was modulated by word category with verbs exhibiting longer EPN latencies compared with other word categories. Here we examined whether concreteness, a semantic variable, influences emotion processing. Within a lexical decision task for verbs, emotional valence (positive, negative, and neutral) was orthogonally combined with concreteness (concrete and abstract). EPN onset was found already at 250 ms post-stimulus for concrete verbs, whereas it started 50 ms later for abstract verbs. Concreteness effects occurred after the start of main effects of emotion. Thus, the elicitation of the EPN seems to be based on semantic processes, with emotional valence being accessed before other semantic aspects such as concreteness of verbs.     

A functional role for the motor system in language understanding: evidence from theta-burst transcranial magnetic stimulation

Does language comprehension depend, in part, on neural systems for action? In previous studies, motor areas of the brain were activated when people read or listened to action verbs, but it remains unclear whether such activation is functionally relevant for comprehension. In the experiments reported here, we used off-line theta-burst transcranial magnetic stimulation to investigate whether a causal relationship exists between activity in premotor cortex and action-language understanding. Right-handed participants completed a lexical decision task, in which they read verbs describing manual actions typically performed with the dominant hand (e.g., "to throw," "to write") and verbs describing nonmanual actions (e.g., "to earn," "to wander"). Responses to manual-action verbs (but not to nonmanual-action verbs) were faster after stimulation of the hand area in left premotor cortex than after stimulation of the hand area in right premotor cortex. These results suggest that premotor cortex has a functional role in action-language understanding.     

Neuroanatomical distribution of five semantic components of verbs: evidence from fMRI

The Simulation Framework, also known as the Embodied Cognition Framework, maintains that conceptual knowledge is grounded in sensorimotor systems. To test several predictions that this theory makes about the neural substrates of verb meanings, we used functional magnetic resonance imaging (fMRI) to scan subjects' brains while they made semantic judgments involving five classes of verbs-specifically, Running verbs (e.g., run, jog, walk), Speaking verbs (e.g., shout, mumble, whisper), Hitting verbs (e.g., hit, poke, jab), Cutting verbs (e.g., cut, slice, hack), and Change of State verbs (e.g., shatter, smash, crack). These classes were selected because they vary with respect to the presence or absence of five distinct semantic components-specifically, ACTION, MOTION, CONTACT, CHANGE OF STATE, and TOOL USE. Based on the Simulation Framework, we hypothesized that the ACTION component depends on the primary motor and premotor cortices, that the MOTION component depends on the posterolateral temporal cortex, that the CONTACT component depends on the intraparietal sulcus and inferior parietal lobule, that the CHANGE OF STATE component depends on the ventral temporal cortex, and that the TOOL USE component depends on a distributed network of temporal, parietal, and frontal regions. Virtually all of the predictions were confirmed. Taken together, these findings support the Simulation Framework and extend our understanding of the neuroanatomical distribution of different aspects of verb meaning.     

Imageability and semantic association in the representation and processing of event verbs

This study examined the relative salience of imageability (the degree to which a word evokes mental imagery) versus semantic association (the density of semantic network in which a word is embedded) in the representation and processing of four types of event verbs: sensory, cognitive, speech, and motor verbs. ERP responses were recorded, while 34 university students performed on a lexical decision task. Analysis focused primarily on amplitude differences across verb conditions within the N400 time window where activities are considered representing meaning activation. Variation in N400 amplitude across four types of verbs was found significantly associated with the level of imageability, but not the level of semantic association. The findings suggest imageability as a more salient factor relative to semantic association in the processing of these verbs. The role of semantic association and the representation of speech verbs are also discussed.     

The role of meaning in past-tense inflection: evidence from polysemy and denominal derivation

Although English verbs can be either regular (walk-walked) or irregular (sing-sang), "denominal verbs" that are derived from nouns, such as the use of the verb ring derived from the noun a ring, take the regular form even if they are homophonous with an existing irregular verb: The soldiers ringed the city rather than *The soldiers rang the city. Is this regularization due to a semantic difference from the usual verb, or is it due to the application of the default rule, namely VERB+ -ed suffix? In Experiment 1, participants rated the semantic similarity of the extended senses of polysemous verbs and denominal verbs to their central senses. Experiment 2 examined the acceptability of the regular and irregular past tenses of the different verbs. The results showed that all the denominal verbs were rated as more acceptable for the regular inflection than the same verbs used polysemously, even though the two were semantically equally similar to the central meaning. Thus, the derivation of the verb (nominal or verbal) determined the past-tense preference more than semantic variables, consistent with dual-route models of verb inflection.     

Effects of relative embodiment in lexical and semantic processing of verbs

Research examining semantic richness effects in visual word recognition has shown that multiple dimensions of meaning are activated in the process of word recognition (e.g., Yap et al., 2012). This research has, however, been limited to nouns. In the present research we extended the semantic richness approach to verb stimuli in order to investigate how verb meanings are represented. We characterized a dimension of relative embodiment for verbs, based on the bodily sense described by Borghi and Cimatti (2010), and collected ratings on that dimension for 687 English verbs. The relative embodiment ratings revealed that bodily experience was judged to be more important to the meanings of some verbs (e.g., dance, breathe) than to others (e.g., evaporate, expect). We then tested the effects of relative embodiment and imageability on verb processing in lexical decision (Experiment 1), action picture naming (Experiment 2), and syntactic classification (Experiment 3). In all three experiments results showed facilitatory effects of relative embodiment, but not imageability: latencies were faster for relatively more embodied verbs, even after several other lexical variables were controlled. The results suggest that relative embodiment is an important aspect of verb meaning, and that the semantic richness approach holds promise as a strategy for investigating other aspects of verb meaning.     

The Role of Semantic Features in Verb Processing

The present study examined the general hypothesis that, as for nouns, stable representations of semantic knowledge relative to situations expressed by verbs are available and accessible in long term memory in normal people. Regular associations between verbs and past tenses in French adults allowed to abstract two superordinate semantic features in the representation of verb meaning: durativity and resultativity. A pilot study was designed to select appropriate items according to these features: durative, non-resultative verbs and non-durative, resultative verbs. An experimental study was then conducted to assess semantic priming in French adults with two visual semantic-decision tasks at a 200- and 100-ms SOA. In the durativity decision task, participants had to decide if the target referred to a durable or non-durable situation. In the resultativity decision task, they had to decide if it referred to a situation with a directly observable outcome or without any clear external outcome. Targets were preceded by similar, opposite, and neutral primes. Results showed that semantic priming can tap verb meaning at a 200- and 100-ms SOA, with the restriction that only the positive value of each feature benefited from priming, that is the durative and resultative values. Moreover, processing of durativity and resultativity is far from comparable since facilitation was shown on the former with similar and opposite priming, whereas it was shown on the latter only with similar priming. Overall, these findings support Le Ny’s (in: Saint-Dizier, Viegas (eds) Computational lexical semantics, 1995; Cahier de Recherche Linguistique LanDisCo 12:85–100, 1998; Comment l’esprit produit du sens, 2005) general hypothesis that classificatory properties of verbs could be interpreted as semantic features and the view that semantic priming can tap verb meaning, as noun meaning.