Processing events: behavioral and neuromagnetic correlates of Aspectual Coercion

Much recent psycho- and neuro-linguistic work has aimed to elucidate the mechanisms by which sentence meanings are composed by investigating the processing of semantic mismatch. One controversial case for theories of semantic composition is expressions such as the clown jumped for ten minutes, in which the aspectual properties of a punctual verb clash with those of a durative modifier. Such sentences have been proposed to involve a coercion operation which shifts the punctual meaning of the verb to an iterative one. However, processing studies addressing this hypothesis have yielded mixed results. In this study, we tested four hypotheses of how aspectual mismatch is resolved with self-paced reading and magnetoencephalography. Using a set of verbs normed for punctuality, we identified an immediate behavioral cost of mismatch. The neural correlates of this processing were found to match effects in midline prefrontal regions previously implicated in the resolution of complement coercion. We also identified earlier effects in right-lateral frontal and temporal sites. We suggest that of the representational hypotheses currently in the literature, these data are most consistent with an account where aspectual mismatch initially involves the composition of an anomalous meaning that is later repaired via coercion.     

汉语母语者英语动词三种屈折变化形式加工机制的差异

采用ERP技术考察了汉语母语者,英语动词三种屈折变化形式加工机制的差异。结果发现,英语动词进行式的屈折变化形式- ing的错误使用诱发了P600成分;完成式的屈折变化形式- ed的错误使用诱发了N400成分;完成式中没有明显屈折变化标识的不规则词的错误使用没有诱发典型的ERP成分。研究结果表明：对于缺乏英语使用环境、母语为汉语的晚期英语学习者来说,屈折变化形式- ing,完成式规则动词的变化形式- ed和没有明显形态变化标识的不规则动词的变化形式具有不同的加工机制,前者可能处于由陈述性记忆系统向程序性记忆系统加工的转变过程中,而后两者更多地由陈述性系统进行加工。这种加工机制的差异可能与动词屈折变化规则的复杂程度有关。     

Training generative verb usage by imitation and reinforcement procedures

Three retarded children were trained, using imitation and reinforcement procedures, to produce past and present tense forms of verbs in response to verbal requests. Two types of experimental sessions were arranged: training sessions and probe sessions. During training sessions, a child was trained to produce one verb in both the past and the present tense. Then, in a probe session, the generalization of this training was tested by presenting to the child a series of untrained verbs interspersed with previously trained verbs. Responses to untrained verbs were never reinforced. Training sessions alternated with probe sessions throughout a multiple baseline design involving four classes of verb inflections as the baselines. The results showed that, as past and present tense forms of verbs within an inflectional class were trained, the children correctly produced past and present tense forms of untrained verbs within this class. When verbs from two or more classes were trained, the children correctly produced the verb tenses from each of these classes. Thus, the imitation and reinforcement procedures were effective in teaching generative use of verb inflections.     

Grammatical aspect and event recognition in children’s online sentence comprehension

This study investigated whether or not the temporal information encoded in aspectual morphemes can be used immediately by young children to facilitate event recognition during online sentence comprehension. We focused on the contrast between two grammatical aspectual morphemes in Mandarin Chinese, the perfective morpheme –le and the (imperfective) durative morpheme –zhe. The perfective morpheme –le is often used to indicate that an event has been completed, whereas the durative morpheme –zhe indicates that an event is still in progress or continuing. We were interested to see whether young children are able to use the temporal reference encoded in the two aspectual morphemes (i.e., completed versus ongoing) as rapidly as adults to facilitate event recognition during online sentence comprehension. Using the visual world eye-tracking paradigm, we tested 34 Mandarin-speaking adults and 99 Mandarin-speaking children (35 three-year-olds, 32 four-year-olds and 32 five-year-olds). On each trial, participants were presented with spoken sentences containing either of the two aspectual morphemes while viewing a visual image containing two pictures, one representing a completed event and one representing an ongoing event. Participants’ eye movements were recorded from the onset of the spoken sentences. The results show that both the adults and the three age groups of children exhibited a facilitatory effect trigged by the aspectual morpheme: hearing the perfective morpheme –le triggered more eye movements to the completed event area, whereas hearing the durative morpheme –zhe triggered more eye movements to the ongoing event area. This effect occurred immediately after the onset of the aspectual morpheme, both for the adults and the three groups of children. This is evidence that young children are able to use the temporal information encoded in aspectual morphemes as rapidly as adults to facilitate event recognition. Children’s eye movement patterns reflect a rapid mapping of grammatical aspect onto the temporal structures of events depicted in the visual scene.     

Notes on Time and Aspect

Abstract

What is time? Neither the numbering of the motion of things nor their schema, but their way of being. In language, time shows itself as tense. But every verb has both tense and aspect. So what is aspect? Irreducible to tense, it is the way in which anything is at any time whatsoever. Thus the way things are, their being, is not merely temporal – for it is just as aspectual.     

Prosodic influences on the resolution of temporary ambiguity during on-line sentence processing

We present three experiments designed to investigate the role of prosody during sentence processing. The first investigated the question of whether an utterance's prosodic contour influences its comprehension on-line. We spliced the beginning and end portions of direct object and embedded clause sentences and observed the consequent effects on comprehension using a dual-task procedure to measure processing load. Our second experiment sought to determine-whether the constituent structure of these sentences could be reliably predicted using prosodic information. We found that the duration and F₀ contour associated with the main-clause verb and the following NP reliably distinguished between the direct object and embedded clause constructions. In the final experiment, we manipulated the duration of the main-clause verb and found that subjects used this information to guide their initial parse during on-line sentence comprehension. The need for a model of sentence processing that addresses the use of prosodic information is discussed.The work reported in this paper was supported in part by NTH grant DC00494.     

On the interrelations of syntax and semantics

Summary Proceeding from the assumption that the recall of sentence tense is affected by verb meaning, the following variations in verb meaning were introduced: Action vs. State and Terminal vs. Interminal. The influence of these aspects on the recall of the Present and Perfect tenses (in German) was tested in a three-factorial design. A distinct interaction was obtained between the factors Terminal/Interminal and sentence tense. The Action/State condition did not affect the recall of sentence tense. All tested aspects of verb meaning did however influence the recall of sentence content.The author gratefully acknowledges the assistance of Mr. B. Jankowski in the translation of this paper from an original German version.     

The onset and mastery of spatial language in children acquiring British Sign Language

In the course of language development children must solve arbitrary form-to-meaning mappings, in which semantic components are encoded onto linguistic labels. Because sign languages describe motion and location of entities through iconic movements and placement of the hands in space, child signers may find spatial semantics-to-language mapping easier to learn than child speakers. This hypothesis was tested in two studies: a longitudinal analysis of a native signing child's use of British Sign Language to describe motion and location events between the ages 1–10 and 3–0, and performance of 18 native signing children between the ages of 3–0 and 4–11 on a motion and location sentence comprehension task. The results from both studies argue against a developmental advantage for sign language learners for the acquisition of motion and location forms. Early forms point towards gesture and embodied actions followed by protracted mastery of the use of signs in representational space. The understanding of relative spatial relations continues to be difficult, despite the iconicity of these forms in the language, beyond 5 years of age.     

Verb retrieval in brain-damaged subjects: 1. Analysis of stimulus, lexical, and conceptual factors

Verb retrieval for action naming was assessed in 53 brain-damaged subjects by administering a standardized test with 100 items. The goal of the study was to gain further insight into the nature of verb processing impairments by investigating the influence of several kinds of stimulus, lexical, and conceptual factors on the subjects' performance at the level of group tendencies and also at the level of individual differences. (1) Stimulus factors: visual complexity, familiarity, image agreement, and one vs. two pictures (which corresponds to ongoing vs. completed actions); (2) lexical factors: name agreement, verb frequency, and whether the root of the target verb has a homophonous noun; (3) conceptual factors: whether the action is done with the hand or the body, whether the action involves one or two core participants, whether the undergoer of the action has a change of internal state, whether the undergoer has a change of spatial location, and whether the actor makes use of an instrument in carrying out the action. The subjects were divided into an impaired group (n = 19) and an unimpaired group (n = 34) on the basis of their overall performance on the test. For both groups of subjects, verb retrieval was significantly affected by the following factors: familiarity, image agreement, name agreement, homophonous noun, and undergoer change of location. These results indicate that, at the level of group analysis, some factors have a stronger influence on verb retrieval for action naming than others. Moreover, the finding that the two groups exhibited the same general pattern of factor sensitivity suggests that although the processing efficiency of the mechanisms that subserve verb retrieval is degraded in the impaired group, the basic functional properties of these mechanisms may not be qualitatively very different from those of the unimpaired group. Further analyses were conducted at the level of individual subjects and revealed a considerable amount of variation with regard to factor sensitivity. Many patterns of associations and dissociations of factors were found across the subjects, which suggests that the task of retrieving verbs for naming actions is quite complex and that different subjects can be influenced by different properties of both the stimuli and the target verbs.     

Psycholinguistic norms for action photographs in French and their relationships with spoken and written latencies

A set of 142 photographs of actions (taken from Fiez & Tranel, 1997) was standardized in French on name agreement, image agreement, conceptual familiarity, visual complexity, imageability, age of acquisition, and duration of the depicted actions. Objective word frequency measures were provided for the infinitive modal forms of the verbs and for the cumulative frequency of the verbal forms associated with the photographs. Statistics on the variables collected for action items were provided and compared with the statistics on the same variables collected for object items. The relationships between these variables were analyzed, and certain comparisons between the current database and other similar published databases of pictures of actions are reported. Spoken and written naming latencies were also collected for the photographs of actions, and multiple regression analyses revealed that name agreement, image agreement, and age of acquisition are the major determinants of action naming speed. Finally, certain analyses were performed to compare object and action naming times. The norms and the spoken and written naming latencies corresponding to the pictures are available on the Internet (http://www.psy.univ-bpclermont.fr/~pbonin/pbonin-eng.html) and should be of great use to researchers interested in the processing of actions.     

Interaction of morphological structure and prefix transparency in the processing of Bulgarian aspectual verb forms

This study investigates the processing of polymorphemic words in a highly inflected language, Bulgarian. The roles of semantic transparency, aspect, and bound or free root status in the recognition of aspectual verb forms were probed in the visual modality in a simple lexical decision and a masked priming experiment at a short SOA. Results from the two experiments yielded effects of semantic transparency and morphological complexity, demonstrating that both factors influence the recognition of prefixed aspectual forms in Bulgarian and pointing toward different access procedures. In contrast, the status of the root did not influence recognition patterns, suggesting that free-standing and bound roots are equivalent lexical units of access and representation in Bulgarian.     

Psycholinguistic norms for action photographs in French and their relationships with spoken and written latencies.

A set of 142 photographs of actions (taken from Fiez & Tranel, 1997) was standardized in French on name agreement, image agreement, conceptual familiarity, visual complexity, imageability, age of acquisition, and duration of the depicted actions. Objective word frequency measures were provided for the infinitive modal forms of the verbs and for the cumulative frequency of the verbal forms associated with the photographs. Statistics on the variables collected for action items were provided and compared with the statistics on the same variables collected for object items. The relationships between these variables were analyzed, and certain comparisons between the current database and other similar published databases of pictures of actions are reported. Spoken and written naming latencies were also collected for the photographs of actions, and multiple regression analyses revealed that name agreement, image agreement, and age of acquisition are the major determinants of action naming speed. Finally, certain analyses were performed to compare object and action naming times. The norms and the spoken and written naming latencies corresponding to the pictures are available on the Internet (http://www.psy.univ-bpclermont.fr/~pbonin/pbonin-eng.html) and should be of great use to researchers interested in the processing of actions.     

The relationship between phonological and morphological deficits in Broca's aphasia: further evidence from errors in verb inflection

A previous study of 10 patients with Broca's aphasia demonstrated that the advantage for producing the past tense of irregular over regular verbs exhibited by these patients was eliminated when the two sets of past-tense forms were matched for phonological complexity (Bird, Lambon Ralph, Seidenberg, McClelland, & Patterson, 2003). The interpretation given was that a generalised phonological impairment was central to the patients' language deficits, including their poor performance on regular past tense verbs. The current paper provides further evidence in favour of this hypothesis, on the basis of a detailed analysis of the errors produced by these same 10 patients in reading, repetition, and sentence completion for a large number of regular, irregular, and nonce verbs. The patients' predominant error types in all tasks and for all verb types were close and distant phonologically related responses. The balance between close and distant errors varied along three continua: the severity of the patient (more distant errors produced by the more severely impaired patients); the difficulty of the task (more distant errors in sentence completion>reading>repetition); the difficulty of the item (more distant errors for novel word forms than real verbs). A position analysis for these phonologically related errors revealed that vowels were most likely to be preserved and that consonant onsets and offsets were equally likely to be incorrect. Critically, the patients' errors exhibited a strong tendency to simplify the phonological form of the target. These results are consistent with the notion that the patients' relatively greater difficulty with regular past tenses reflects a phonological impairment that is sensitive to the complexity of spoken forms.     

Young children's use of temporal and spatial order information in short-term memory

Encoding and retrieval of temporal and spatial order information was investigated in the free recall and probed recognition performance of 3-, 4-, 5-, and 6-year-olds. In both tasks, three line drawings of familiar objects were presented successively in different spatial locations, so that temporal order was not confounded with spatial order. Subjects of all ages revealed an organization for the stimulus display based on the temporal sequence of presentation. With increasing age, subjects began recall more often with the first item so as to take advantage of this sequential organization. In the probed recognition task, subjects were asked questions requiring the use of temporal or spatial order information. Performance by the older subjects indicated that information about temporal and spatial order could be simultaneously encoded. The results are discussed in terms of a context theory derived from Estes's hierarchical association model.     

Neural correlates of lexicon and grammar: evidence from the production, reading, and judgment of inflection in aphasia

Are the linguistic forms that are memorized in the mental lexicon and those that are specified by the rules of grammar subserved by distinct neurocognitive systems or by a single computational system with relatively broad anatomic distribution? On a dual-system view, the productive -ed-suffixation of English regular past tense forms (e.g., look-looked) depends upon the mental grammar, whereas irregular forms (e.g., dig-dug) are retrieved from lexical memory. On a single-mechanism view, the computation of both past tense types depends on associative memory. Neurological double dissociations between regulars and irregulars strengthen the dual-system view. The computation of real and novel, regular and irregular past tense forms was investigated in 20 aphasic subjects. Aphasics with non-fluent agrammatic speech and left frontal lesions were consistently more impaired at the production, reading, and judgment of regular than irregular past tenses. Aphasics with fluent speech and word-finding difficulties, and with left temporal/temporo-parietal lesions, showed the opposite pattern. These patterns held even when measures of frequency, phonological complexity, articulatory difficulty, and other factors were held constant. The data support the view that the memorized words of the mental lexicon are subserved by a brain system involving left temporal/temporo-parietal structures, whereas aspects of the mental grammar, in particular the computation of regular morphological forms, are subserved by a distinct system involving left frontal structures.     

Dissociation and association of the embodied representation of tool-use verbs and hand verbs: An fMRI study

Embodied semantic theories suppose that representation of word meaning and actual sensory-motor processing are implemented in overlapping systems. According to this view, association and dissociation of different word meaning should correspond to dissociation and association of the described sensory-motor processing. Previous studies demonstrate that although tool-use actions and hand actions have overlapping neural substrates, tool-use actions show greater activations in frontal–parietal–temporal regions that are responsible for motor control and tool knowledge processing. In the present study, we examined the association and the dissociation of the semantic representation of tool-use verbs and hand action verbs. Chinese verbs describing tool-use or hand actions without tools were included, and a passive reading task was employed. All verb conditions showed common activations in areas of left middle frontal gyrus, left inferior frontal gyrus (BA 44/45) and left inferior parietal lobule relative to rest, and all conditions showed significant effects in premotor areas within the mask of hand motion effects. Contrasts between tool-use verbs and hand verbs demonstrated that tool verbs elicited stronger activity in left superior parietal lobule, left middle frontal gyrus and left posterior middle temporal gyrus. Additionally, psychophysiological interaction analyses demonstrated that tool verbs indicated greater connectivity among these regions. These results suggest that the brain regions involved in tool-use action processing also play more important roles in tool-use verb processing and that similar systems may be responsible for word meaning representation and actual sensory-motor processing.     

Focusing on the relation: fewer exemplars facilitate children's initial verb learning and extension

One of the most prominent theories for why children struggle to learn verbs is that verb learning requires the abstraction of relations between an object and its action (Gentner, 2003). Two hypotheses suggest how children extract relations to extend a novel verb: (1) seeing many different exemplars allows children to detect the invariant relation between actions in different contexts (Gentner, 2003), and (2) repetition of fewer exemplars allows children to move beyond the entities involved to extract the relation (Kersten & Smith, 2002). We tested 2 1/2- and 3-year-olds' ability to extend a novel verb after viewing the repetition of one novel actor compared to four different actors performing a novel action. Both ages were better at learning and extending a novel verb to a novel actor when shown only one actor rather than four different actors. These results indicate that during initial verb learning less information is more effective.     

CHANGES IN LANGUAGE BEHAVIOR AS A FUNCTION OF VERACITY

In this experiment 20 subjects were placed in a situation designed to elicit a number of truthful and untruthful statements. Differences in these statements were examined by the SLCA III and LEXIC programs to find variables that discriminate between truth-tellers and liars. The results indicate that when lying, individuals use fewer words, and, as a consequence, fewer unique words with larger type-token ratios and smaller perceptual-cognitive activity measures, use fewer past tense verb forms, and that males tend to use a greater number of indicative mood sentences and fewer subjunctive mood sentences. When used in a discriminant function equation, 14 of the SLCA III and LEXIC variables were able to provide an adequate level of classification for the veracity of the subjects' statements.     

动词的延续性特征及瞬时时间副词对时间转换事件表征的影响

为考察语篇阅读中,汉语动词的延续性特征以及瞬时时间副词对时间转换事件表征的影响,采用探测-判断的语篇实时阅读技术分别进行了两个实验。实验1的结果表明,当描述转换前事件的动词是延续性动词时,短时转换句与瞬时转换句的阅读时间无显著差异;而当描述转换前事件的动词是短暂性动词时,短时转换句的阅读时间明显长于瞬时转换句的阅读时间。实验2的结果表明,当不在时间转换句前添加瞬时时间副词时,长时与短时转换句前探测词的再认时间存在显著差异;而当在时间转换句前添加瞬时时间副词时,长时与短时转换句前探测词的再认时间无显著差异。两个实验结果分别说明,动词的延续性特征和时间转换短句的结合影响了时间转换事件的表征,在长时转换句的前面添加瞬时时间副词缩短了长时转换事件的表征时间。     

Rules, representations, and the English past tense

The significance of the English past tense in current cognitive science is that it offers a clear contrast between a potentially rule-based system-the procedures for forming the regular past tense-and an unpredictable and idiosyncratic set of irregular forms. This contrast has become a focus for a wide-ranging debate about whether mental computation requires the use of symbols. Highly regular combinatorial phenomena, such as the regular past tense, are prime candidates for rule-based symbolic computation. Earlier research concentrated on the evidence for this during language acquisition, looking at how children learned the English regular and irregular verb systems. Over the last five years attention has shifted towards the properties of the adult system, and we review here some recent research into the neural correlates of the two types of procedure. The evidence suggests that there are divergences in the neural systems underlying the generation and perception of regular and irregular forms. Regular inflected forms seem to involve primarily combinatorial processes, while irregular forms appear to have a hybrid status, sharing their semantic properties with the regular forms but diverging in the phonological domain, where their form representations are stored as complete units. This indicates that the regular and irregular past tenses may not, after all, provide a clean contrast in the types of mental computation they implicate.