Dissociation and association of the embodied representation of tool-use verbs and hand verbs: An fMRI study

Embodied semantic theories suppose that representation of word meaning and actual sensory-motor processing are implemented in overlapping systems. According to this view, association and dissociation of different word meaning should correspond to dissociation and association of the described sensory-motor processing. Previous studies demonstrate that although tool-use actions and hand actions have overlapping neural substrates, tool-use actions show greater activations in frontal–parietal–temporal regions that are responsible for motor control and tool knowledge processing. In the present study, we examined the association and the dissociation of the semantic representation of tool-use verbs and hand action verbs. Chinese verbs describing tool-use or hand actions without tools were included, and a passive reading task was employed. All verb conditions showed common activations in areas of left middle frontal gyrus, left inferior frontal gyrus (BA 44/45) and left inferior parietal lobule relative to rest, and all conditions showed significant effects in premotor areas within the mask of hand motion effects. Contrasts between tool-use verbs and hand verbs demonstrated that tool verbs elicited stronger activity in left superior parietal lobule, left middle frontal gyrus and left posterior middle temporal gyrus. Additionally, psychophysiological interaction analyses demonstrated that tool verbs indicated greater connectivity among these regions. These results suggest that the brain regions involved in tool-use action processing also play more important roles in tool-use verb processing and that similar systems may be responsible for word meaning representation and actual sensory-motor processing.     

Verb semantic structures in memory for sentences: Evidence for componential representation

This research contrasts two hypotheses concerning componential storage of meaning. The Complexity Hypothesis assumed by Fodor (The language of thought, NY: Crowell, 1975), Kintsch (The representation of meaning in memory, Hillsdale, NJ: Erlbaum, 1974), and Thorndyke (Conceptual complexity and imagery in comprehension and memory. Journal of Verbal Learning and Verbal Behavior, 1975, 14, 359–369) states that a word with many semantic components will require more processing resources, comprehension time, and long-term memory space than a word with few components, and thus will interfere more with memory for surrounding words. This memory prediction was tested against an alternative prediction based on connectivity. The Connectivity Hypothesis views verb semantic structures as frames for sentence representation and states that memory strength between two nouns in a sentence increases with the number of underlying verb subpredicates that connect the nouns. Thus, the Complexity Hypothesis predicts that a verb with many subpredicates will lead to poorer memory strength between the surrounding nouns than a verb with few subpredicates, while the Connectivity Hypothesis predicts that verbs with many subpredicates will lead to greater memory strength between nouns in cases when the additional subpredicates provide semantic connections between the nouns.In three experiments, subjects recalled subject-verb-object sentences, given subject nouns as cues. General verbs, with relatively few subpredicates, were compared with more specific verbs whose additional subpredicates either did or did not provide additional connections between the surrounding nouns. The level of recall of the object noun, given the subject noun as cue, was predicted by the relative number of connecting subpredicates in the verb, but not by the relative number of subpredicates. This finding supports the Connectivity Hypothesis over the Complexity Hypothesis. These results are interpreted in terms of a model in which the verb conveys a structured set of subpredicates that provides a connective framework for sentence memory.     

What matters is the underlying experience: Similar motor responses during processing observed hand actions and hand-related verbs

It is well-accepted that processing observed actions involves at some extent the same neural mechanisms responsible for action execution. More recently, it has been forwarded that also the processing of verbs expressing a specific motor content is subserved by the neural mechanisms allowing individuals to perform the content expressed by that linguistic material. This view is also known as embodiment and contrasts with a more classical approach to language processing that considers it as amodal. In the present study, we used a go/no-go paradigm, in which participants were requested to respond to real words and pictures and refrain from responding when presented stimuli were pseudowords and scrambled images. Real stimuli included pictures depicting hand- and foot-related actions and verbs expressing hand- and foot-related actions. We, therefore, directly compared the modulation of hand motor responses during the observation of actions and the presentation of verbs, expressing actions in the same category. The results have shown that participants gave slower hand motor responses during the observation of hand actions and the processing of hand-related verbs as than observed foot actions and related verbs. These findings support embodiment showing that whatever the modality of presentation (observed action or verb), the modulation of hand motor responses was similar, thus suggesting that processing seen actions and related verbs shares common mechanisms most likely involving the motor system and the underlying motor experience.     

Imageability and semantic association in the representation and processing of event verbs

This study examined the relative salience of imageability (the degree to which a word evokes mental imagery) versus semantic association (the density of semantic network in which a word is embedded) in the representation and processing of four types of event verbs: sensory, cognitive, speech, and motor verbs. ERP responses were recorded, while 34 university students performed on a lexical decision task. Analysis focused primarily on amplitude differences across verb conditions within the N400 time window where activities are considered representing meaning activation. Variation in N400 amplitude across four types of verbs was found significantly associated with the level of imageability, but not the level of semantic association. The findings suggest imageability as a more salient factor relative to semantic association in the processing of these verbs. The role of semantic association and the representation of speech verbs are also discussed.     

The Role of Semantic Features in Verb Processing

The present study examined the general hypothesis that, as for nouns, stable representations of semantic knowledge relative to situations expressed by verbs are available and accessible in long term memory in normal people. Regular associations between verbs and past tenses in French adults allowed to abstract two superordinate semantic features in the representation of verb meaning: durativity and resultativity. A pilot study was designed to select appropriate items according to these features: durative, non-resultative verbs and non-durative, resultative verbs. An experimental study was then conducted to assess semantic priming in French adults with two visual semantic-decision tasks at a 200- and 100-ms SOA. In the durativity decision task, participants had to decide if the target referred to a durable or non-durable situation. In the resultativity decision task, they had to decide if it referred to a situation with a directly observable outcome or without any clear external outcome. Targets were preceded by similar, opposite, and neutral primes. Results showed that semantic priming can tap verb meaning at a 200- and 100-ms SOA, with the restriction that only the positive value of each feature benefited from priming, that is the durative and resultative values. Moreover, processing of durativity and resultativity is far from comparable since facilitation was shown on the former with similar and opposite priming, whereas it was shown on the latter only with similar priming. Overall, these findings support Le Ny’s (in: Saint-Dizier, Viegas (eds) Computational lexical semantics, 1995; Cahier de Recherche Linguistique LanDisCo 12:85–100, 1998; Comment l’esprit produit du sens, 2005) general hypothesis that classificatory properties of verbs could be interpreted as semantic features and the view that semantic priming can tap verb meaning, as noun meaning.     

Walking or talking? Behavioral and neurophysiological correlates of action verb processing

Brain activity elicited by visually presented words was investigated using behavioral measures and current source densities calculated from high-resolution EEG recordings. Verbs referring to actions usually performed with different body parts were compared. Behavioral data indicated faster processing of verbs referring to actions performed with the face muscles and articulators (face-related words) compared to verbs referring to movements involving the lower half of the body (leg-related words). Significant topographical differences in brain activity elicited by verb types were found starting approximately 250 ms after word onset. Differences were seen at recording sites located over the motor strip and adjacent frontal cortex. At the vertex, close to the cortical representation of the leg, leg-related verbs (for example, to walk) produced strongest in-going currents, whereas for face-related verbs (for example, to talk) the most in-going activity was seen at more lateral electrodes placed over the left Sylvian fissure, close to the representation of the articulators. Thus, action words caused differential activation along the motor strip, with strongest in-going activity occurring close to the cortical representation of the body parts primarily used for carrying out the actions the verbs refer to. Topographically specific physiological signs of word processing started earlier for face-related words and lasted longer for verbs referring to leg movements. We conclude that verb types can differ in their processing speed and can elicit neurophysiological activity with different cortical topographies. These behavioral and physiological differences can be related to cognitive processes, in particular to lexical semantic access. Our results are consistent with associative theories postulating that words are organized in the brain as distributed cell assemblies whose cortical distributions reflect the words' meanings.     

A critique of Mark D. Allen's "the preservation of verb subcategory knowledge in a spoken language comprehension deficit"

Allen [Allen, M. (2005). The preservation of verb subcategory knowledge in a spoken language comprehension deficit. Brain and Language, 95, 255-264.] reports a single patient, WBN, who, during spoken language comprehension, is still able to access some of the syntactic properties of verbs despite being unable to access some of their semantic properties. Allen claims that these findings challenge linguistic theories which assume that much of the syntactic behavior of verbs can be predicted from their meanings. I argue, however, that this conclusion is not supported by the data for two reasons: first, Allen focuses on aspects of verb syntax that are not claimed to be influenced by verb semantics; and second, he ignores aspects of verb syntax that are claimed to be influenced by verb semantics.     

镜像神经元的意义

镜像神经元是一种感觉–运动神经元。它的典型特征是在动作观察和动作执行两个阶段皆被激活。多年来, 由于研究伦理的限制, 研究恒河猴时使用的单细胞电极植入方式无法应用于人类, 因而不能确定人类大脑皮层是否也存在着具有同样功能的神经细胞。但是通过脑成像技术, 神经科学家确定人类大脑皮层存在着具有相同或类似功能的脑区, 称为“镜像神经系统”。文章对镜像神经元及其人类镜像神经系统的意义进行了深入分析, 指出：(1)由于镜像机制把动作知觉和动作执行进行匹配, 观察者仅仅通过他人行为的知觉, 就激活了执行这一动作的神经环路, 产生了一种他人动作的具身模拟, 因而可以直接把握他人的行为意图; (2)镜像神经元所表现出来的那种动作知觉与动作执行的双重激活功能支持了身心一体说, 从方法论上证明了身心二元论的缺陷, 为身心的整体观提供了神经生物学的证据; (3)镜像神经机制把他人的动作与自己的运动系统相匹配, 以自身动作的神经环路对他人的动作做出回应, 促进了人际理解和沟通, 成为社会沟通的“神经桥梁”。     

镜像神经元的发现及其对身心二元论的超越

镜像神经元是意大利帕尔玛大学Rizzolatti等人在恒河猴大脑腹侧运动前皮层F5区发现的一种神经元。这种神经元在猴子操作和观察同一个指向某种目标的动作时(如伸手抓食物)皆被激活,似乎这种神经元映射了其它个体的动作,因此被命名为“镜像神经元”。镜像神经元通过具身的模拟把动作的执行和动作的知觉结合在一起,把观察过程与身体运动过程相融合,克服了二元论在身心之间所设置的障碍,为人们正确认识身心关系开辟了新的视角。     

Verbal Integration: The Interaction of Participant Roles and Sentential Argument Structure

This paper explores the interaction between sentence level syntactic information and the semantic information that is carried with the verb during sentence comprehension. A cross-modal integration task was employed to examine whether the number of participant roles (thematic roles associated with the central meaning of the verb) causes an increase in processing load during integration of the verb into on-going sentence comprehension. The effect of preceding sentential structural information (varied with respect to the number of argument and/or adjunct NPs preceding the verb) was also manipulated. Independent of the structural information preceding the verb, verbs with two partici-pant roles were integrated into the sentence faster than verbs with three participant roles. This finding suggests that participant roles are stored with the representation of the verb and made immediately available during integration and comprehension. In addition, the syntactic distinction between arguments and adjuncts is also shown to play an immediate role in parsing and integration of language on-line.     

Task related modulation of the motor system during language processing

Recent neurophysiological and brain imaging studies have shown that the motor system is involved in language processing. However, it is an open question whether this involvement is a necessary requisite to understand language or rather a side effect of distinct cognitive processes underlying it. In order to clarify this issue we carried out three behavioral experiments, using a go-no go paradigm. Italian verbs expressing hand actions, foot actions or an abstract content served as stimuli. Participants used their right hands to respond. In Experiment 1, in which a semantics decision task with an early delivery of the go signal (during processing language material) was used, slower responses were found for hand action-related verbs than for foot action-related verbs. In Experiment 2, using the same task with either an early or a delayed delivery of the go signal (when language material had been already processed), no difference was found between responses to the two verb categories in the delayed delivery condition. In Experiment 3, in which a lexical decision task with an early delivery of the go signal was used, again no difference between the two verb categories was found. The present findings demonstrate that during language processing the modulation of the motor system crucially occurs while performing a semantics decision task, thus supporting the notion that this involvement is a necessary step to understand language rather than a side effect of upstream cognitive processes.     

Children's linguistic intuitions about factive presuppositions

Third and sixth graders' understanding of factive presupposition was investigated via two tasks: One required an abstract truth value judgment of the verb complement; the other called for a more informal judgment of consistency (or contradiction) between the target sentence and the negation of its complement. When compared with corresponding adult data, the present results indicate that the development of factive presupposition continues through late childhood. A further task examined a nonlogical pragmatic variable related to factive meaning. The final task investigated whether children's judgments of overall certainty are governed by factive or pragmatic aspects of meaning. Comparisons across the four tasks indicate that factive presupposition only gradually emerges as a distinct logical component of verb meaning. It is argued that young children's initial discriminations between factive and nonfactive verbs reflect the subjective confidence conveyed by the verb rather than the logical property of factivity, but that later in acquisition, factivity acquires a status superseding that of other facets of meaning.     

Sound symbolism facilitates early verb learning

Some words are sound-symbolic in that they involve a non-arbitrary relationship between sound and meaning. Here, we report that 25-month-old children are sensitive to cross-linguistically valid sound-symbolic matches in the domain of action and that this sound symbolism facilitates verb learning in young children. We constructed a set of novel sound-symbolic verbs whose sounds were judged to match certain actions better than others, as confirmed by adult Japanese- as well as English speakers, and by 2- and 3-year-old Japanese-speaking children. These sound-symbolic verbs, together with other novel non-sound-symbolic verbs, were used in a verb learning task with 3-year-old Japanese children. In line with the previous literature, 3-year-olds could not generalize the meaning of novel non-sound-symbolic verbs on the basis of the sameness of action. However, 3-year-olds could correctly generalize the meaning of novel sound-symbolic verbs. These results suggest that iconic scaffolding by means of sound symbolism plays an important role in early verb learning.     

Learning to represent word meaning: What initial training events reveal about children's developing action verb concepts

Very little experimental research has shown how the events from which verbs are learned affect children's representation of meaning. This study addressed these lacunae by systematically exploring how three different initial training contexts affect children's and adults' interpretation of novel action verbs. Brief, videotaped action events were used to teach children and adults novel verbs in 1 of 3 conditions. Subjects were asked whether these verbs generalized to other events differing only in outcome, manner, instrument, or agent. Initial representation of verb meaning was inferred from generalizations. Unlike 10-year-olds and adults, 3-year-olds' interpretations were (a) significantly context specific—preferring instrument and outcome elements of meaning in one context, but manner in another, and (b) consistently, though moderately biased to favor the manner of action. Results clearly demonstrate that both the young word learner and the context in which word learning occurs are equally important determinants of developing action verb concepts.     

Thematic role properties of subjects and objects

This paper tests two claims about the thematic roles Agent and Patient: first, that they can be decomposed into more primitive features, as laid out in Dowty's (1991) Proto-Roles Hypothesis; and second, that these properties can be inferred directly from the grammatical roles subject and object. In Experiments 1 and 2, participants rated the Proto-Roles properties of the subject and object of transitive sentences with real verbs. Subjects were rated as more Agent-like than objects, while objects were rated as more Patient-like than subjects. Experiment 3 used transitive sentences with nonsense content words (e.g. "The rom mecked the zarg"). Even in the absence of a known verb, the results were the same. Experiment 4 examined the corollary prediction that subjects and objects should not differ on grammatically irrelevant properties (e.g. "being liquid"); this prediction was confirmed. In Experiment 5, verbs that do not permit objects (e.g. "fall," "erupt") were placed in the transitive frame. Results were the same as in Experiments 1 through 3. Moreover, the semantics of the verb were altered by the frame, indicating that participants tried to fuse the semantics of the verb with those of the frame. Possible sources of these inferences are considered.     

Body parts and early-learned verbs

This article reports the structure of associations among 101 common verbs and body parts. The verbs are those typically learned by children learning English prior to 3 years of age. In a free association task, 50 adults were asked to provide the single body part that came to mind when they thought of each verb. Analyses reveal highly systematic and structured patterns of associations that are also related to the normative age of acquisition of the verbs showing a progression from verbs associated with actions by the mouth, to verbs strongly associated with actions by hand and arm, to verbs not so strongly associated with any one body part. The results have implications for proposals about embodied verb meaning and also for processes of early verb learning.     

Wiping the slate clean: a lexical semantic exploration.

This paper presents a case study in lexical semantic analysis aimed at uncovering syntactically relevant components of verb meaning. Our strategy is to investigate the nature of the lexical knowledge that a speaker of English possesses with respect to certain apparently semantically related verbs: a set of verbs that might as a first approximation be classed as verbs of removal. However, a closer examination of these apparently semantically related verbs reveals that their syntactic properties diverge. An exploration of the patterns of behavior of the verbs suggests that the initial class includes three linguistically significant subclasses. The components of meaning that are relevant to characterizing each subclass are identified by isolating those components of meaning that the members of each subclass share. The conclusion considers the implications of the meaning components identified in this study for a lexical semantic representation.     

More questions for mirror neurons

The mirror neuron system is widely held to provide direct access to the motor goals of others. This paper critically investigates this idea, focusing on the so-called ‘intentional worry’. I explore two answers to the intentional worry: first that the worry is premised on too limited an understanding of mirror neuron behaviour (Sections 2 Mirror neurons and the intentional worry, 3 What is the mechanism behind motor chain embeddings?), second that the appeal made to mirror neurons can be refined in such a way as to avoid the worry (Section 4). I argue that the first response requires an account of the mechanism by which small-scale gestures are supposedly mapped to larger chains of actions but that none of the extant accounts of this mechanism are plausible. Section 4 then briefly examines refinements of the mirror neuron-mindreading hypothesis which avoid the intentional worry. I conclude that these refinements may well be plausible but that they undermine many of the claims standardly made for mirror neurons.     

Semantic detail in the developing verb lexicon: An extension of Naigles and Kako (1993)

Verbs are often uttered before the events they describe. By 2 years of age, toddlers can learn from such an encounter. Hearing a novel verb in transitive sentences (e.g. The boy lorped the cat), even with no visual referent present, they later map it to a causative meaning (e.g. feed) (e.g. Yuan & Fisher, 2009 ). How much semantic detail does their verb representation include on this first, underinformative, encounter? Is the representation sparse, including only information for which they have evidence, or do toddlers make more specific guesses about the verb's meaning? In two experiments (N = 76, mean age 27 months), we address this using an event type studied by Naigles and Kako ( 1993 ); they found that when toddlers hear a novel transitive verb while simultaneously viewing a non‐causative referent—a contact event such as patting—they map the verb to the contact event. In Experiment 1 we replicated this basic result. Further, toddlers’ representations persisted over a 5‐minute delay, manifesting again during a retest. In Experiment 2, toddlers heard the verbs while watching two actors converse instead of while seeing contact events. At test, they showed no evidence of mapping the verbs to contact events, either initially or after a 5‐minute delay, despite that in prior work they mapped verbs to causative events under identical circumstances. We infer that on hearing a novel verb in a transitive frame, absent a relevant visual scene, toddlers posit a more specific representation than the evidence requires—one that incorporates causative semantics. A video abstract of this article can be viewed at: https://youtu.be/aRCqSTbr6Bw     

动词理解中空间表征的激活过程

探讨动词理解中空间表征的激活过程。被试听以不同空间轴向动词作谓语的句子后辨认视觉刺激的形状。实验1以肯定句为材料探讨语义理解对视知觉任务的影响。实验2以客观原因否定句为材料排除句子表征的影响。实验3以主观原因否定句为材料探讨动词空间元素的激活机制。总的结果表明,动词理解过程中激活其表征中的空间元素,这种激活是自动的、非策略性的,不受情境中客观原因或主观意愿否定的影响。动词理解空间效应反映了语言表征中的知觉运动特征