Understanding of action-related and abstract verbs in comparison: a behavioral and TMS study

Does the comprehension of both action-related and abstract verbs rely on motor simulation? In a behavioral experiment, in which a semantic task was used, response times to hand-action-related verbs were briefer than those to abstract verbs and both decreased with repetition of presentation. In a transcranial magnetic stimulation (TMS) experiment, single-pulse stimulation was randomly delivered over hand motor area of the left primary motor cortex to measure cortical-spinal excitability at 300 or 500 ms after verb presentation. Two blocks of trials were run. In each block, the same verbs were randomly presented. In the first block, stimulation induced an increase in motor evoked potentials only when TMS was applied 300 ms after action-related verb presentation. In the second block, no modulation of motor cortex was found according to type of verb and stimulation-delay. These results confirm that motor simulation can be used to understand action rather than abstract verbs. Moreover, they suggest that with repetition, the semantic processing for action verbs does not require activation of primary motor cortex anymore.     

Visual experiences during letter production contribute to the development of the neural systems supporting letter perception

Letter production through handwriting creates visual experiences that may be important for the development of visual letter perception. We sought to better understand the neural responses to different visual percepts created during handwriting at different levels of experience. Three groups of participants, younger children, older children, and adults, ranging in age from 4.5 to 22 years old, were presented with dynamic and static presentations of their own handwritten letters, static presentations of an age‐matched control's handwritten letters, and typeface letters during fMRI. First, data from each group were analyzed through a series of contrasts designed to highlight neural systems that were most sensitive to each visual experience in each age group. We found that younger children recruited ventral‐temporal cortex during perception and this response was associated with the variability present in handwritten forms. Older children and adults also recruited ventral‐temporal cortex; this response, however, was significant for typed letter forms but not variability. The adult response to typed letters was more distributed than in the children, including ventral‐temporal, parietal, and frontal motor cortices. The adult response was also significant for one's own handwritten letters in left parietal cortex. Second, we compared responses among age groups. Compared to older children, younger children demonstrated a greater fusiform response associated with handwritten form variability. When compared to adults, younger children demonstrated a greater response to this variability in left parietal cortex. Our results suggest that the visual perception of the variability present in handwritten forms that occurs during handwriting may contribute to developmental changes in the neural systems that support letter perception.     

What matters is the underlying experience: Similar motor responses during processing observed hand actions and hand-related verbs

It is well-accepted that processing observed actions involves at some extent the same neural mechanisms responsible for action execution. More recently, it has been forwarded that also the processing of verbs expressing a specific motor content is subserved by the neural mechanisms allowing individuals to perform the content expressed by that linguistic material. This view is also known as embodiment and contrasts with a more classical approach to language processing that considers it as amodal. In the present study, we used a go/no-go paradigm, in which participants were requested to respond to real words and pictures and refrain from responding when presented stimuli were pseudowords and scrambled images. Real stimuli included pictures depicting hand- and foot-related actions and verbs expressing hand- and foot-related actions. We, therefore, directly compared the modulation of hand motor responses during the observation of actions and the presentation of verbs, expressing actions in the same category. The results have shown that participants gave slower hand motor responses during the observation of hand actions and the processing of hand-related verbs as than observed foot actions and related verbs. These findings support embodiment showing that whatever the modality of presentation (observed action or verb), the modulation of hand motor responses was similar, thus suggesting that processing seen actions and related verbs shares common mechanisms most likely involving the motor system and the underlying motor experience.     

Sensori‐motor experience leads to changes in visual processing in the developing brain

Since Broca’s studies on language processing, cortical functional specialization has been considered to be integral to efficient neural processing. A fundamental question in cognitive neuroscience concerns the type of learning that is required for functional specialization to develop. To address this issue with respect to the development of neural specialization for letters, we used functional magnetic resonance imaging (fMRI) to compare brain activation patterns in pre‐school children before and after different letter‐learning conditions: a sensori‐motor group practised printing letters during the learning phase, while the control group practised visual recognition. Results demonstrated an overall left‐hemisphere bias for processing letters in these pre‐literate participants, but, more interestingly, showed enhanced blood oxygen‐level‐dependent activation in the visual association cortex during letter perception only after sensori‐motor (printing) learning. It is concluded that sensori‐motor experience augments processing in the visual system of pre‐school children. The change of activation in these neural circuits provides important evidence that ‘learning‐by‐doing’ can lay the foundation for, and potentially strengthen, the neural systems used for visual letter recognition.     

Walking or talking? Behavioral and neurophysiological correlates of action verb processing

Brain activity elicited by visually presented words was investigated using behavioral measures and current source densities calculated from high-resolution EEG recordings. Verbs referring to actions usually performed with different body parts were compared. Behavioral data indicated faster processing of verbs referring to actions performed with the face muscles and articulators (face-related words) compared to verbs referring to movements involving the lower half of the body (leg-related words). Significant topographical differences in brain activity elicited by verb types were found starting approximately 250 ms after word onset. Differences were seen at recording sites located over the motor strip and adjacent frontal cortex. At the vertex, close to the cortical representation of the leg, leg-related verbs (for example, to walk) produced strongest in-going currents, whereas for face-related verbs (for example, to talk) the most in-going activity was seen at more lateral electrodes placed over the left Sylvian fissure, close to the representation of the articulators. Thus, action words caused differential activation along the motor strip, with strongest in-going activity occurring close to the cortical representation of the body parts primarily used for carrying out the actions the verbs refer to. Topographically specific physiological signs of word processing started earlier for face-related words and lasted longer for verbs referring to leg movements. We conclude that verb types can differ in their processing speed and can elicit neurophysiological activity with different cortical topographies. These behavioral and physiological differences can be related to cognitive processes, in particular to lexical semantic access. Our results are consistent with associative theories postulating that words are organized in the brain as distributed cell assemblies whose cortical distributions reflect the words' meanings.     

When nominal features are marked on verbs: a transcranial magnetic stimulation study

It has been claimed that verb processing (as opposed to noun processing) is subserved by specific neural circuits in the left prefrontal cortex. In this study, we took advantage of the unusual grammatical characteristics of clitic pronouns in Italian (e.g., lo and la in portalo and portala 'bring it [masculine]/[feminine]', respectively)-the fact that clitics have both nominal and verbal characteristics, to explore the neural correlates of verb and clitic processing. We used repetitive transcranial magnetic stimulation (rTMS) to suppress the excitability of the left prefrontal cortex and to assess its role in producing verb+det+noun and verb+clitic phrases. Results showed an interference effect for both kinds of phrases when stimulation was applied to the left but not to the right prefrontal cortex. However, the interference effect was significantly greater for the verb+clitic than for the verb+det+noun phrases. These findings support the view that clitics increase the morphosyntactic complexity of verbs.     

Neural responses to morphological, syntactic, and semantic properties of single words: an fMRI study

Dissociations in the recognition of specific classes of words have been documented in brain-injured populations. These include deficits in the recognition and production of morphologically complex words as well as impairments specific to particular syntactic classes such as verbs. However, functional imaging evidence for distinctions among the neural systems underlying these dissociations has been inconclusive. We explored the neural systems involved in processing different word classes in a functional Magnetic Resonance Imaging study, contrasting four groups of words co-varying morphological complexity (simple, monomorphemic words vs complex derived or inflected words) and syntactic class (verbs vs nouns/adjectives). Subtraction of word from letter string processing showed activation in left frontal and temporal lobe regions consistent with prior studies of visual word processing. No differences were observed for morphologically complex and simple words, despite adequate power to detect stimulus specific effects. A region of posterior left middle temporal gyrus showed significantly increased activation for verbs. Post hoc analyses showed that this elevated activation could also be related to semantic properties of the stimulus items (verbs have stronger action associations than nouns, and action association is correlated with activation). Results suggest that semantic as well as syntactic factors should be considered when assessing the neural systems involved in single word comprehension.     

汉语句子可继续性对句子理解加工的即时影响

通过操纵动词与后接词的关系,来产生搭配异常并控制句子的可继续性,研究汉语词汇信息在句子加工中的即时作用。实验一利用跨通道技术,发现动一名词搭配异常对目标名词的加工有即时影响,形容词条件下可继续性对目标形容词的加工有即时影响;实验二采用眼动技术,发现名词条件和形容词条件下可继续性均有显著的即时影响。结果显示,语义等多种词汇信息被通达后立即共同参与了汉语句子加工。     

Dissociation and association of the embodied representation of tool-use verbs and hand verbs: An fMRI study

Embodied semantic theories suppose that representation of word meaning and actual sensory-motor processing are implemented in overlapping systems. According to this view, association and dissociation of different word meaning should correspond to dissociation and association of the described sensory-motor processing. Previous studies demonstrate that although tool-use actions and hand actions have overlapping neural substrates, tool-use actions show greater activations in frontal–parietal–temporal regions that are responsible for motor control and tool knowledge processing. In the present study, we examined the association and the dissociation of the semantic representation of tool-use verbs and hand action verbs. Chinese verbs describing tool-use or hand actions without tools were included, and a passive reading task was employed. All verb conditions showed common activations in areas of left middle frontal gyrus, left inferior frontal gyrus (BA 44/45) and left inferior parietal lobule relative to rest, and all conditions showed significant effects in premotor areas within the mask of hand motion effects. Contrasts between tool-use verbs and hand verbs demonstrated that tool verbs elicited stronger activity in left superior parietal lobule, left middle frontal gyrus and left posterior middle temporal gyrus. Additionally, psychophysiological interaction analyses demonstrated that tool verbs indicated greater connectivity among these regions. These results suggest that the brain regions involved in tool-use action processing also play more important roles in tool-use verb processing and that similar systems may be responsible for word meaning representation and actual sensory-motor processing.     

Where the brain appreciates the final state of an event: The neural correlates of telicity

In this study we investigated whether the human brain distinguishes between telic events that necessarily entail a specified endpoint (e.g., reaching), and atelic events with no delimitation or final state (e.g., chasing). We used functional magnetic resonance imaging to explore the patterns of neural response associated with verbs denoting telic and atelic events, and found that the left posterior middle temporal gyrus (pMTG), an area consistently engaged by verb processing tasks, showed a significantly higher activation for telic compared with atelic verbs. These results provide the first evidence that the human brain appreciates whether events lead to an end or a change of state. Moreover, they provide an explanation for the long-debated question of which verb properties modulate neural activity in the left pMTG, as they indicate that, independently of any other semantic property, verb processing and event knowledge in this area are specifically related to the representation of telicity.     

Verbs as linguistic markers of agency: The social side of grammar

Basic grammatical categories may carry social meanings irrespective of their semantic content. In a set of four studies, we demonstrate that verbs—a basic linguistic category present and distinguishable in most languages—are related to the perception of agency, a fundamental dimension of social perception. In an archival analysis of actual language use in Polish and German, we found that targets stereotypically associated with high agency (men and young people) are presented in the immediate neighborhood of a verb more often than non‐agentic social targets (women and older people). Moreover, in three experiments using a pseudo‐word paradigm, verbs (but not adjectives and nouns) were consistently associated with agency (but not with communion). These results provide consistent evidence that verbs, as grammatical vehicles of action, are linguistic markers of agency. In demonstrating meta‐semantic effects of language, these studies corroborate the view of language as a social tool and an integral part of social perception.     

Frequency of verb use in young children who stutter

Several recent studies have suggested that young children who stutter (CWS) tend to show depressed lexical performance relative to peers. Given the developmental literature as well as several studies of verb processing in individuals who stutter, verbs may pose a particular challenge for this group. The purpose of the present study was to examine verb use in CWS. In theory, if young CWS differ in their production of verbs, this finding would partially explain the findings of studies that probed conversational vocabulary skills more generally. Fifteen CWS and 15 children who do not stutter (CWNS) participated in a play-based conversational sample with a parent. Samples were analyzed for the total number of verbs, the number of different verbs, and the proportion of general all-purpose (GAP) verbs within the samples. CWS produced significantly fewer different verbs and total verbs than the CWNS. However, previously reported near-significant differences in utterance length between groups would appear to temper the robustness of this finding. The groups did not differ in the proportion of GAP verbs used, suggesting that the CWS did not over-rely on GAP verbs in conversational language production but rather used these verbs to the same extent as their peers. Educational objectives: As a result of this activity, the participant will be able to: (1) relate the purpose and rationale for examining verb use in children who stutter (CWS); (2) summarize the procedures used to assess verb use and GAP verb use in the present study; (3) explain the findings of the present study; (4) relate findings to the extant literature on lexical diversity in CWS.     

Neuroanatomical distribution of five semantic components of verbs: evidence from fMRI

The Simulation Framework, also known as the Embodied Cognition Framework, maintains that conceptual knowledge is grounded in sensorimotor systems. To test several predictions that this theory makes about the neural substrates of verb meanings, we used functional magnetic resonance imaging (fMRI) to scan subjects' brains while they made semantic judgments involving five classes of verbs-specifically, Running verbs (e.g., run, jog, walk), Speaking verbs (e.g., shout, mumble, whisper), Hitting verbs (e.g., hit, poke, jab), Cutting verbs (e.g., cut, slice, hack), and Change of State verbs (e.g., shatter, smash, crack). These classes were selected because they vary with respect to the presence or absence of five distinct semantic components-specifically, ACTION, MOTION, CONTACT, CHANGE OF STATE, and TOOL USE. Based on the Simulation Framework, we hypothesized that the ACTION component depends on the primary motor and premotor cortices, that the MOTION component depends on the posterolateral temporal cortex, that the CONTACT component depends on the intraparietal sulcus and inferior parietal lobule, that the CHANGE OF STATE component depends on the ventral temporal cortex, and that the TOOL USE component depends on a distributed network of temporal, parietal, and frontal regions. Virtually all of the predictions were confirmed. Taken together, these findings support the Simulation Framework and extend our understanding of the neuroanatomical distribution of different aspects of verb meaning.     

Productivity of lexical categories in French-speaking children with cochlear implants

The productivity of lexical categories was studied longitudinally in a sample of 17 young hearing-impaired French-speaking children with cochlear implants. Age of implantation ranged from 22 months to 76 months. Spontaneous speech samples were collected at six-month intervals over a period of 36 months, starting at the one-word stage. Four general measures of their linguistic production (number of utterances, verbal fluency, vocabulary, and grammatical production) as well as 36 specific lexical categories, according to the CHILDES codes, were computed in terms of tokens, i.e., total number of words. Cochlear-implanted children (CI) were compared to a French database of normally hearing children aged 2-4 compiled by the first author. Follow-up results indicate that, at the two-year post-implantation follow-up, noun, and verb morphology was significantly impaired. At the three-year follow-up, the cochlear-implanted group had recovered on adjectives, determiners and nouns, main verbs, and auxiliaries. The two groups differed significantly in processing locative adverbs, prepositions, pronouns, and verbs (infinitive verb, modal, and modal lexical), but individual variability within the cochlear-implanted group was substantial. Results are discussed in terms of recovery and developmental trends and variability in the acquisition of lexical categories by French children two years and three years post-implantation.     

Effects of Verbal Event Structure on Online Thematic Role Assignment

Event structure describes the relationships between general semantics (Aktionsart) of the verb and its syntactic properties, separating verbs into two classes: telic verbs, which denote change of state events with an inherent end-point or boundary (catch, rescue), and atelic, which refer to homogenous activities (tease, host). As telic verbs describe events, in which the internal argument (Patient) is affected, we hypothesized that processing of telic verb template would activate syntactic position of the Patient during sentence comprehension. Event-related brain potentials (ERPs) were recorded from 20 English speakers, who read sentences with reduced Object relative clauses, in which the verb was either telic or atelic. ERPs in relative clauses diverged on the definite article preceding the Agent: the atelic condition was characterized by larger amplitude negativity at the N100. Such processing differences are explained by activation of the syntactic position for the Patient by the event structure template of telic verbs.     

The psychological causality implicit in language

We are concerned with the causality implicit in English verbs that name interactions, either mental or behavioral, between two persons, verbs such as like, notice (mental), and help, cheat (behavioral) in such a context as Ted—Paul. Using four different methods, we show that adult native speakers think of causality in such verbs as unequally apportioned between interactants. For behavioral (or action) verbs greater causal weight is given to the Agent argument of the verb (e.g., Ted in Ted helps Paul) than to the Patient argument (Paul). For mental (or state) verbs greater causal weight is given to the Stimulus argument of the verb (e.g., Paul in Ted likes Paul) than to the Experiencer argument (Ted). For English verbs of the type studied, derivational adjectives often exist (e.g., helpful, cheating, likable, noticeable). Such adjectives are attributive to one or the other argument of the verb base (Agent or Patient; Stimulus or Experiencer). We show that the direction of causal attribution in the adjective (e.g., helpful is attributive to Ted the Agent; likable is attributive to Paul the Stimulus) predicts the primary causal weightings assigned in our experimental tasks. We also show that in the English language adjectives derived from action verbs are almost attributive to the Agent and adjectives derived from state verbs to the Stimulus. Because certain facts about English morphology predict certain ways of thinking about causality, our main finding may seem to be a Whorfian one, a demonstration that language affects thought. However, we argue that it is not that but rather a demonstration that two modes of thought (the Agent-Patient Schema and the Stimulus-Experiencer Schema) affect language use. We suggest that the schemas are universals of human thought.     

动词论元结构复杂性加工的认知神经机制

动词论元结构复杂性表现在论元数量、论元范畴选择模式、题元角色指派模式和映射方式四个方面。大部分实证研究表明, 更多的论元数量、选择性论元范畴、选择性题元角色指派以及非典型映射, 使动词论元结构加工的认知神经机制更复杂。多论元加工功能脑区主要涉及左侧额下回和外侧裂周后部; 选择性论元范畴加工功能脑区主要涉及左侧额下回、额叶中后部、颞上回和颞叶中后部; 选择性题元角色指派加工功能脑区主要涉及外侧裂周后部、左侧额叶中后部和额下回; 非典型映射加工功能脑区主要涉及左侧额下回、颞上回、颞中回和颞叶后部。左侧额下回可能涉及初始句法加工、动词次范畴确定、句法移位和非宾格动词语义加工, 左侧额叶中后部可能涉及初始句法加工和动词次范畴确定, 左侧颞上回和颞叶中后部可能涉及表层句法加工和表层论元句法-语义整合, 外侧裂周后部可能涉及论元语义表征。动词论元结构加工过程和动词词汇特征表明, 复杂性某些方面存在交互作用。动词论元结构复杂性与加工难易的对应关系、复杂性加工难度层级和交互作用的认知神经机制以及汉语动词论元结构复杂性加工认知神经机制等议题, 有待进一步探讨。     

The Two-Level Theory of verb meaning: An approach to integrating the semantics of action with the mirror neuron system

Verbs have two separate levels of meaning. One level reflects the uniqueness of every verb and is called the "root". The other level consists of a more austere representation that is shared by all the verbs in a given class and is called the "event structure template". We explore the following hypotheses about how, with specific reference to the motor features of action verbs, these two distinct levels of semantic representation might correspond to two distinct levels of the mirror neuron system. Hypothesis 1: Root-level motor features of verb meaning are partially subserved by somatotopically mapped mirror neurons in the left primary motor and/or premotor cortices. Hypothesis 2: Template-level motor features of verb meaning are partially subserved by representationally more schematic mirror neurons in Brodmann area 44 of the left inferior frontal gyrus. Evidence has been accumulating in support of the general neuroanatomical claims made by these two hypotheses-namely, that each level of verb meaning is associated with the designated cortical areas. However, as yet no studies have satisfied all the criteria necessary to support the more specific neurobiological claims made by the two hypotheses-namely, that each level of verb meaning is associated with mirror neurons in the pertinent brain regions. This would require demonstrating that within those regions the same neuronal populations are engaged during (a) the linguistic processing of particular motor features of verb meaning, (b) the execution of actions with the corresponding motor features, and (c) the observation of actions with the corresponding motor features.     

Imageability and semantic association in the representation and processing of event verbs

This study examined the relative salience of imageability (the degree to which a word evokes mental imagery) versus semantic association (the density of semantic network in which a word is embedded) in the representation and processing of four types of event verbs: sensory, cognitive, speech, and motor verbs. ERP responses were recorded, while 34 university students performed on a lexical decision task. Analysis focused primarily on amplitude differences across verb conditions within the N400 time window where activities are considered representing meaning activation. Variation in N400 amplitude across four types of verbs was found significantly associated with the level of imageability, but not the level of semantic association. The findings suggest imageability as a more salient factor relative to semantic association in the processing of these verbs. The role of semantic association and the representation of speech verbs are also discussed.     

The time course of argument reactivation revealed: using the visual world paradigm

Previous research has found that the single argument of unaccusative verbs (such as fall) is reactivated during sentence processing, but the argument of agentive verbs (such as jump) is not (Bever & Sanz, 1997; Friedmann, Taranto, Shapiro, & Swinney, 2008). An open question so far was whether this difference in processing is caused by a difference in thematic roles the verbs assign, or a difference in the underlying syntactic structure. In the present study we tease apart these two potential sources. In order to achieve this, we included a set of verbs (like sparkle) which are equal to unaccusative verbs in the thematic role they assign to their argument, but equal to agentive verbs in the syntactic status of their argument (henceforth mixed verbs). As a method we used the visual world paradigm as this enables us to measure processing of the sentences continuously. This method also allowed us to test another hypothesis, namely the hypothesis that not only the argument of unaccusative verbs is reactivated during processing, but also the argument of agentive verbs. This reactivation is expected as the result of integrating the verb and its argument into one representation. In our experiment, participants listened to sentences including one of the three types of verbs. While listening, they viewed a visual display in which one of four objects was strongly related to the argument of the verb (wood-saw). The gaze record showed that the eyes moved to the related object (saw) upon presentation of the argument (wood). More interestingly, the eyes moved back to the related object upon presentation of the verb (fell). We found that looks to the related object increase only late after verb offset for unaccusative verbs, replicating the findings of previous research. We also found a rise in looks to the related object in agentive verbs, but this rise took place much earlier, starting slightly after verb onset. Finally, we found that mixed verbs pattern in processing with agentive verbs. We conclude that the argument of the verb is always reactivated, independent of verb type. In addition, the timing of integration differs per verb type and depends on the syntactic status of the argument and not on the thematic role that is assigned to the argument.