Effects of Verbal Event Structure on Online Thematic Role Assignment

Event structure describes the relationships between general semantics (Aktionsart) of the verb and its syntactic properties, separating verbs into two classes: telic verbs, which denote change of state events with an inherent end-point or boundary (catch, rescue), and atelic, which refer to homogenous activities (tease, host). As telic verbs describe events, in which the internal argument (Patient) is affected, we hypothesized that processing of telic verb template would activate syntactic position of the Patient during sentence comprehension. Event-related brain potentials (ERPs) were recorded from 20 English speakers, who read sentences with reduced Object relative clauses, in which the verb was either telic or atelic. ERPs in relative clauses diverged on the definite article preceding the Agent: the atelic condition was characterized by larger amplitude negativity at the N100. Such processing differences are explained by activation of the syntactic position for the Patient by the event structure template of telic verbs.     

ERP evidence for telicity effects on syntactic processing in garden-path sentences

Verbs contain multifaceted information about both the semantics of an action, and potential argument structures. Linguistic theory classifies verbs according to whether the denoted action has an inherent (telic) end-point (fall, awaken), or whether it is considered homogenous, or atelic (read, worship). The aim of our study was to examine how this distinction influences on-line sentence processing, investigating the effects of verbal telicity on the ease of syntactic re-analysis of Object reduced relative clauses. Event-related brain potentials (ERPs) were recorded from 22 English speakers as they read sentences in which the main verb was either telic or atelic, e.g., “The actress awakened/worshipped by the writer left in a hurry”. ERPs elicited by telic and atelic verbs, the preposition “by” introducing the second argument (Agent), and the second argument itself, e.g., “writer”, were compared. Additionally, participants were grouped according to receptive syntactic proficiency: normal (NP) or high (HP). ERPs from the NP group first diverged at the second argument, with the atelic condition eliciting larger amplitude negativity at the N100, and continuing to the P200 interval. In contrast, ERPs from the HP group first diverged earlier in the sentence, on the word “by”. ERPs elicited by “by” in the atelic condition were also characterized by increased negativity, in this case significant at P200 and Anterior Negativity between 320 and 500 ms post stimulus onset. Our results support the postulated conceptual/semantic distinction underlying the two verb categories, and demonstrate that world-knowledge about actions designated by verbs and syntactic proficiency are reflected in on-line processing of sentence structure.     

Shindigs,brunches, and rodeos: The neural basis of event words

Events (e.g., “running” or “eating”) constitute a basic type within human cognition and human language. We asked whether thinking about events, as compared to other conceptual categories, depends on partially independent neural circuits. Indirect evidence for this hypothesis comes from previous studies showing elevated posterior temporal responses to verbs, which typically label events. Neural responses to verbs could, however, be driven either by their grammatical or by their semantic properties. In the present experiment, we separated the effects of grammatical class (verb vs. noun) and semantic category (event vs. object) by measuring neural responses to event nouns (e.g., “the hurricane”). Participants rated the semantic relatedness of event nouns, as well as of two categories of object nouns—animals (e.g., “the alligator”) and plants (e.g., “the acorn”)—and three categories of verbs—manner of motion (e.g., “to roll”), emission (e.g., “to sparkle”), and perception (e.g., “to gaze”). As has previously been observed, we found larger responses to verbs than to object nouns in the left posterior middle (LMTG) and superior (LSTG) temporal gyri. Crucially, we also found that the LMTG responds more to event than to object nouns. These data suggest that part of the posterior lateral temporal response to verbs is driven by their semantic properties. By contrast, a more superior region, at the junction of the temporal and parietal cortices, responded more to verbs than to all nouns, irrespective of their semantic category. We concluded that the neural mechanisms engaged when thinking about event and object categories are partially dissociable.     

A functional role for the motor system in language understanding: evidence from theta-burst transcranial magnetic stimulation

Does language comprehension depend, in part, on neural systems for action? In previous studies, motor areas of the brain were activated when people read or listened to action verbs, but it remains unclear whether such activation is functionally relevant for comprehension. In the experiments reported here, we used off-line theta-burst transcranial magnetic stimulation to investigate whether a causal relationship exists between activity in premotor cortex and action-language understanding. Right-handed participants completed a lexical decision task, in which they read verbs describing manual actions typically performed with the dominant hand (e.g., "to throw," "to write") and verbs describing nonmanual actions (e.g., "to earn," "to wander"). Responses to manual-action verbs (but not to nonmanual-action verbs) were faster after stimulation of the hand area in left premotor cortex than after stimulation of the hand area in right premotor cortex. These results suggest that premotor cortex has a functional role in action-language understanding.     

动词论元结构复杂性加工的认知神经机制

动词论元结构复杂性表现在论元数量、论元范畴选择模式、题元角色指派模式和映射方式四个方面。大部分实证研究表明, 更多的论元数量、选择性论元范畴、选择性题元角色指派以及非典型映射, 使动词论元结构加工的认知神经机制更复杂。多论元加工功能脑区主要涉及左侧额下回和外侧裂周后部; 选择性论元范畴加工功能脑区主要涉及左侧额下回、额叶中后部、颞上回和颞叶中后部; 选择性题元角色指派加工功能脑区主要涉及外侧裂周后部、左侧额叶中后部和额下回; 非典型映射加工功能脑区主要涉及左侧额下回、颞上回、颞中回和颞叶后部。左侧额下回可能涉及初始句法加工、动词次范畴确定、句法移位和非宾格动词语义加工, 左侧额叶中后部可能涉及初始句法加工和动词次范畴确定, 左侧颞上回和颞叶中后部可能涉及表层句法加工和表层论元句法-语义整合, 外侧裂周后部可能涉及论元语义表征。动词论元结构加工过程和动词词汇特征表明, 复杂性某些方面存在交互作用。动词论元结构复杂性与加工难易的对应关系、复杂性加工难度层级和交互作用的认知神经机制以及汉语动词论元结构复杂性加工认知神经机制等议题, 有待进一步探讨。     

When nominal features are marked on verbs: a transcranial magnetic stimulation study

It has been claimed that verb processing (as opposed to noun processing) is subserved by specific neural circuits in the left prefrontal cortex. In this study, we took advantage of the unusual grammatical characteristics of clitic pronouns in Italian (e.g., lo and la in portalo and portala 'bring it [masculine]/[feminine]', respectively)-the fact that clitics have both nominal and verbal characteristics, to explore the neural correlates of verb and clitic processing. We used repetitive transcranial magnetic stimulation (rTMS) to suppress the excitability of the left prefrontal cortex and to assess its role in producing verb+det+noun and verb+clitic phrases. Results showed an interference effect for both kinds of phrases when stimulation was applied to the left but not to the right prefrontal cortex. However, the interference effect was significantly greater for the verb+clitic than for the verb+det+noun phrases. These findings support the view that clitics increase the morphosyntactic complexity of verbs.     

Twenty four-month-old infants’ interpretations of novel verbs and nouns in dynamic scenes

The current experiments address several concerns, both empirical and theoretical in nature, that have surfaced within the verb learning literature. They begin to reconcile what, until now, has been a large and largely unexplained gap between infants’ well-documented ability to acquire verbs in the natural course of their lives and their rather surprising failures to do so in many laboratory-based tasks. We presented 24-month-old infants with dynamic scenes (e.g., a man waving a balloon), and asked (a) whether infants could construe these scenes flexibly, noticing the consistent action (e.g., waving) as well as the consistent object (e.g., the balloon) and (b) whether their construals of the scenes were influenced by the grammatical form of a novel word used to describe them (verb or noun). We document that 24-month-olds’ representations of novel words are sufficiently precise to permit them to map novel verbs to event categories (e.g., waving events) and novel nouns to object categories (e.g., balloons). We also document the time-course underlying infants’ mapping of the novel words. These results beckon us to move beyond asking whether or not infants can represent verb meanings, and to consider instead the conditions that support successful verb learning in infants and young children.     

Young children can extend motion verbs to point-light displays

In the first study using point-light displays (lights corresponding to the joints of the human body) to examine children's understanding of verbs, 3-year-olds were tested to see if they could perceive familiar actions that corresponded to motion verbs (e.g., walking). Experiment 1 showed that children could extend familiar motion verbs (e.g., walking and dancing) to videotaped point-light actions shown in the intermodal preferential looking paradigm. Children watched the action that matched the requested verb significantly more than they watched the action that did not match the verb. In Experiment 2, the findings of Experiment 1 were validated by having children spontaneously produce verbs for these actions. The use of point-light displays may illuminate the factors that contribute to verb learning.     

Dissociation and association of the embodied representation of tool-use verbs and hand verbs: An fMRI study

Embodied semantic theories suppose that representation of word meaning and actual sensory-motor processing are implemented in overlapping systems. According to this view, association and dissociation of different word meaning should correspond to dissociation and association of the described sensory-motor processing. Previous studies demonstrate that although tool-use actions and hand actions have overlapping neural substrates, tool-use actions show greater activations in frontal–parietal–temporal regions that are responsible for motor control and tool knowledge processing. In the present study, we examined the association and the dissociation of the semantic representation of tool-use verbs and hand action verbs. Chinese verbs describing tool-use or hand actions without tools were included, and a passive reading task was employed. All verb conditions showed common activations in areas of left middle frontal gyrus, left inferior frontal gyrus (BA 44/45) and left inferior parietal lobule relative to rest, and all conditions showed significant effects in premotor areas within the mask of hand motion effects. Contrasts between tool-use verbs and hand verbs demonstrated that tool verbs elicited stronger activity in left superior parietal lobule, left middle frontal gyrus and left posterior middle temporal gyrus. Additionally, psychophysiological interaction analyses demonstrated that tool verbs indicated greater connectivity among these regions. These results suggest that the brain regions involved in tool-use action processing also play more important roles in tool-use verb processing and that similar systems may be responsible for word meaning representation and actual sensory-motor processing.     

Neuroanatomical distribution of five semantic components of verbs: evidence from fMRI

The Simulation Framework, also known as the Embodied Cognition Framework, maintains that conceptual knowledge is grounded in sensorimotor systems. To test several predictions that this theory makes about the neural substrates of verb meanings, we used functional magnetic resonance imaging (fMRI) to scan subjects' brains while they made semantic judgments involving five classes of verbs-specifically, Running verbs (e.g., run, jog, walk), Speaking verbs (e.g., shout, mumble, whisper), Hitting verbs (e.g., hit, poke, jab), Cutting verbs (e.g., cut, slice, hack), and Change of State verbs (e.g., shatter, smash, crack). These classes were selected because they vary with respect to the presence or absence of five distinct semantic components-specifically, ACTION, MOTION, CONTACT, CHANGE OF STATE, and TOOL USE. Based on the Simulation Framework, we hypothesized that the ACTION component depends on the primary motor and premotor cortices, that the MOTION component depends on the posterolateral temporal cortex, that the CONTACT component depends on the intraparietal sulcus and inferior parietal lobule, that the CHANGE OF STATE component depends on the ventral temporal cortex, and that the TOOL USE component depends on a distributed network of temporal, parietal, and frontal regions. Virtually all of the predictions were confirmed. Taken together, these findings support the Simulation Framework and extend our understanding of the neuroanatomical distribution of different aspects of verb meaning.     

Effects of noun-verb homonymy on the neural correlates of naming concrete entities and actions

The neural correlates of naming concrete entities such as tools (with nouns) and naming actions (with verbs) are partially distinct: the former are linked to the left inferotemporal (IT) region, whereas the latter are linked to the left frontal opercular (FO) and left posterior middle temporal (MT) regions. This raises an intriguing question: How would such neural patterns be influenced by noun-verb homonymy, specifically, naming tasks in which the target words denote objects or actions (e.g., "comb")? To explore this, we conducted a PET study in which 10 normal participants named visually presented tools or actions. The factor of homonymy yielded interesting effects: For tools, non-homonymous nouns (e.g., "camera") activated left IT, whereas homonymous nouns (e.g., "comb") activated both left IT and left FO. For actions, non-homonymous (e.g., "juggle") and homonymous (e.g., "comb") verbs activated left FO, MT, and IT, but there was evidence that the FO and MT activations were less widespread for the homonymous verbs. We also found that retrieval of the same exact words (e.g., "comb" and "comb") produced differential activation in left MT-there was greater MT activation when the words were being used to name actions, than when they were being used to name tools. Our results suggest that noun-verb homonymy has an important influence on the patterns of neural activation associated with words denoting objects and actions, and that even when the phonological forms are identical, the patterns of neural activation are different according to the demands of the task.     

Auditory verb perception recruits motor systems in the developing brain: an fMRI investigation

This study investigated neural activation patterns during verb processing in children, using fMRI (functional Magnetic Resonance Imaging). Preschool children (aged 4–6) passively listened to lists of verbs and adjectives while neural activation was measured. Findings indicated that verbs were processed differently than adjectives, as the verbs recruited motor systems in the frontal cortex during auditory perception, but the adjectives did not. Further evidence suggested that different types of verbs activated different regions in the motor cortex. The results demonstrate that the motor system is recruited during verb perception in the developing brain, reflecting the embodied nature of language learning and processing.     

Verb generation priming involves conceptual implicit memory

Brain activation patterns differ and generation latencies are reduced when generating verbs to repeated nouns (Raichle et al., 1994). Amnesic participants show normal magnitude of priming (Seger et al., 1997). Despite its importance in neuropsychology, verb generation priming is not well characterized psychologically. Six behavioral studies found that verb generation priming was specific to the verb rather than to the noun or the noun-verb pair, was equivalent after overt or covert generation and after reading verbs or generating verbs, was affected by levels of processing, and transferred completely across languages in bilinguals. These results indicate that verb generation priming involves priming of particular responses and happens at a conceptual level. These findings provide new insights about the significance of brain imaging and neuropsychological studies involving verb generation priming.     

Electrophysiological evidence for the time-course of verifying text ideas

We examined how verb factivity influences the ability of readers to detect and resolve the mismatch of receiving false referents in relation to true referents in discourse contexts. Factive verbs (e.g., know), but not nonfactive verbs (believe), entail the truth of their complements. Recent research by Singer [Singer, M. (2006). Verification of text ideas during reading. Journal of Memory and Language, 54, 574-591] suggests that there are pragmatic costs associated with knowing something that is clearly false and only believing something that is clearly true. However, because Singer measured reading times for full sentences, it could not be determined whether these costs were initiated upon the appearance of the critical target word (i.e., the word that validated or invalidated previous text ideas) or at a later point in the sentences. In the present research we recorded event-related brain potentials while people read the same passages for comprehension and analyzed potentials evoked to the critical target words. Our results demonstrate that the brain distinguishes between true and false target words by at least 200ms after their onset, and that the pragmatic costs identified by Singer lead to interactions between verb factivity and truth in both early (P2) and later occurring brain components (late phase of N400 and late frontal positivity). In general, the results suggest readers had greater difficulty integrating false nouns than true nouns following factive than nonfactive verbs, and that detection of this mismatch also occurred earlier following factive verbs. Our results provide insight into the time-course of the processes that underlie the verification of text ideas, and extend neurocognitive research on anaphoric resolution.     

动、名词词类特异性损伤的研究现状

词汇的各类知识信息（如,语法信息）在人脑中的表征和加工方式是当前学者们研究的热点之一,以患者为研究对象已成为了其中一种重要的研究手段。期间,人们发现脑损伤使得一些患者对动词或名词表现出选择性认知加工障碍,即出现了动、名词词类特异性损伤。通过探讨这一现象发生的机理,将为揭示词类的语法信息在人脑中的表征和加工方式提供了契机。文章介绍了这一现象的表现形式,即一些脑损伤患者对有关动词的知识比有关名词的知识丧失得更严重,而有些患者的损伤模式却与其恰好相反。另外,文中也阐述了对该现象的3种理论解释：语法解释、语义－概念解释和词典解释。     

Draw a Star and Make it Perfect: Incremental Processing of Telicity

Predicates like “coloring-the-star” denote events that have a temporal duration and a culmination point (telos). When combined with perfective aspect (e.g., “Valeria has colored the star”), a culmination inference arises implying that the action has stopped, and the star is fully colored. While the perfective aspect is known to constrain the conceptualization of the event as telic, many reading studies have demonstrated that readers do not make early commitments as to whether the event is bounded or unbounded. A few visual-world studies tested the processing of telic predicates during online sentence processing, demonstrating an early integration of aspectual and temporal cues. By employing the visual-world paradigm, we tested the incremental processing of the perfective aspect in Italian in two eye-tracking studies in which listeners heard durative predicates in the perfective form in a scenario showing a completed and a non-completed event. Differently from previous studies, we compared telic durative predicates such as “coloring-the-star” to punctual predicates such as “lighting-the-candle.” While for punctual predicates, the inferences of telicity (the event has a telos) and of culmination (the telos is reached) are lexically encoded in the perfective verb, for durative predicates, the degree of event completion (visually encoded) needs to be integrated with perfective aspect (linguistically encoded) for the culmination inference derivation. By modulating the interaction of visual and linguistic stimuli across the two experiments, we show that the verb's perfective aspect triggers the culmination inference incrementally during sentence processing, offering novel evidence for the continuous integration of linguistic processing with real-world visual information.     

Orthographic directionality and thematic role illustration in English and Arabic

This study tested the hypotheses that people had a bias for drawing agents on the left of a picture when given a verb stimulus targeting an active or passive event (e.g., "kicked" or "is kicked") and that orthographic directionality would influence the way events were illustrated. Monolingual English speakers, who read and write left-to-right, and Arabic speakers, who read and write right-to-left, drew agents and patients in response to verb stimuli. We found no significant orthographic directionality effects and no preference for positioning agents on the left of pictures in either group or sentence type. Instead, participants drew agents on the right regardless of language or sentence type, and this was exaggerated in English speakers illustrating passive verbs. These findings support the existence of a preference for placing agents in the right hemispace that may result from asymmetrical hemispheric (i.e., left>right) activation induced by language processing. Our results are consistent with findings that people prefer pictures in which focus is on the right, a preference strongest in pictures with no implicit directionality of movement. This suggests that the methodology of the current study encouraged a static rather than dynamic interpretation of the verb in most participants.     

Effects of relative embodiment in lexical and semantic processing of verbs

Research examining semantic richness effects in visual word recognition has shown that multiple dimensions of meaning are activated in the process of word recognition (e.g., Yap et al., 2012). This research has, however, been limited to nouns. In the present research we extended the semantic richness approach to verb stimuli in order to investigate how verb meanings are represented. We characterized a dimension of relative embodiment for verbs, based on the bodily sense described by Borghi and Cimatti (2010), and collected ratings on that dimension for 687 English verbs. The relative embodiment ratings revealed that bodily experience was judged to be more important to the meanings of some verbs (e.g., dance, breathe) than to others (e.g., evaporate, expect). We then tested the effects of relative embodiment and imageability on verb processing in lexical decision (Experiment 1), action picture naming (Experiment 2), and syntactic classification (Experiment 3). In all three experiments results showed facilitatory effects of relative embodiment, but not imageability: latencies were faster for relatively more embodied verbs, even after several other lexical variables were controlled. The results suggest that relative embodiment is an important aspect of verb meaning, and that the semantic richness approach holds promise as a strategy for investigating other aspects of verb meaning.     

Semantic detail in the developing verb lexicon: An extension of Naigles and Kako (1993)

Verbs are often uttered before the events they describe. By 2 years of age, toddlers can learn from such an encounter. Hearing a novel verb in transitive sentences (e.g. The boy lorped the cat), even with no visual referent present, they later map it to a causative meaning (e.g. feed) (e.g. Yuan & Fisher, 2009 ). How much semantic detail does their verb representation include on this first, underinformative, encounter? Is the representation sparse, including only information for which they have evidence, or do toddlers make more specific guesses about the verb's meaning? In two experiments (N = 76, mean age 27 months), we address this using an event type studied by Naigles and Kako ( 1993 ); they found that when toddlers hear a novel transitive verb while simultaneously viewing a non‐causative referent—a contact event such as patting—they map the verb to the contact event. In Experiment 1 we replicated this basic result. Further, toddlers’ representations persisted over a 5‐minute delay, manifesting again during a retest. In Experiment 2, toddlers heard the verbs while watching two actors converse instead of while seeing contact events. At test, they showed no evidence of mapping the verbs to contact events, either initially or after a 5‐minute delay, despite that in prior work they mapped verbs to causative events under identical circumstances. We infer that on hearing a novel verb in a transitive frame, absent a relevant visual scene, toddlers posit a more specific representation than the evidence requires—one that incorporates causative semantics. A video abstract of this article can be viewed at: https://youtu.be/aRCqSTbr6Bw     

Infants Determine Others' Focus of Attention by Pragmatics and Exclusion

ABSTRACT

Children learning a verb may benefit from hearing it across situations . At the same time, in everyday contexts, situations in which a verb is heard will be interrupted by distracting events. Using Structural Alignment theory as a framework, Study 1 asks whether children can learn a verb when irrelevant, interleaved events are present. Two½- and 3½-year-old children saw dynamic events and were randomly assigned to one of three experimental conditions (differing in orders of events) or one of two control conditions. They extended the verbs in the experimental conditions, and not the control conditions. Three ½-year-olds were more successful than 2½-year-olds, though the younger children could extend verbs. A more difficult task is segmenting dynamic action into subevents that could be relevant for a verb (e.g., finding “chopping” in a cooking scene). In Study 2, 2½-, 3½-, and 4½-year-old children were assigned to experimental conditions in which relevant events flowed into irrelevant events (or vice versa) or to a control. Two½-year-olds failed to extend the verbs at test, differing from the older children; children in experimental conditions extended the verbs while children in the control condition did not. Altogether, these results show children can ignore irrelevant events (and subevents), and extend new verbs by 3½ years. Results are important to understand learning in everyday contexts in which verbs are heard in varied situations over time.