How iconic gestures enhance communication: an ERP study

EEG was recorded as adults watched short segments of spontaneous discourse in which the speaker's gestures and utterances contained complementary information. Videos were followed by one of four types of picture probes: cross-modal related probes were congruent with both speech and gestures; speech-only related probes were congruent with information in the speech, but not the gesture; and two sorts of unrelated probes were created by pairing each related probe with a different discourse prime. Event-related potentials (ERPs) elicited by picture probes were measured within the time windows of the N300 (250-350 ms post-stimulus) and N400 (350-550 ms post-stimulus). Cross-modal related probes elicited smaller N300 and N400 than speech-only related ones, indicating that pictures were easier to interpret when they corresponded with gestures. N300 and N400 effects were not due to differences in the visual complexity of each probe type, since the same cross-modal and speech-only picture probes elicited N300 and N400 with similar amplitudes when they appeared as unrelated items. These findings extend previous research on gesture comprehension by revealing how iconic co-speech gestures modulate conceptualization, enabling listeners to better represent visuo-spatial aspects of the speaker's meaning.     

Hemispheric differences in the time-course of semantic priming processes: evidence from event-related potentials (ERPs)

To investigate hemispheric differences in the timing of word priming, the modulation of event-related potentials by semantic word relationships was examined in each cerebral hemisphere. Primes and targets, either categorically (silk-wool) or associatively (needle-sewing) related, were presented to the left or right visual field in a go/no-go lexical decision task. The results revealed significant reaction-time and physiological differences in both visual fields only for associatively related word pairs, but an electrophysiological difference also tended to reach significance for categorically related words when presented in the left visual field. ERP waveforms showed a different time-course of associative priming effects according to the field of presentation. In the right visual field/left hemisphere, both N400 and Late Positive Component (LPC/P600) were modulated by semantic relatedness, while only a late effect was present in the left visual field/ right hemisphere.     

Attention to endpoints: a cross-linguistic constraint on spatial meaning

We investigate a possible universal constraint on spatial meaning. It has been proposed that people attend preferentially to the endpoints of spatial motion events, and that languages may therefore make finer semantic distinctions at event endpoints than at event beginnings. We test this proposal. In Experiment 1, we show that people discriminate the endpoints of spatial motion events more readily than they do event beginnings-suggesting a non-linguistic attentional bias toward endpoints. In Experiment 2, speakers of Arabic, Chinese, and English each described a set of spatial events displayed in video clips. Although the spatial systems of these languages differ, speakers of all three languages made finer semantic distinctions at event endpoints, compared to event beginnings. These findings are consistent with the proposal that event endpoints are privileged over event beginnings, in both language and perception.     

Out of one's mind: a study of involuntary semantic memories

The study of memories that pop into one's mind without any conscious attempt to retrieve them began only recently. While there are some studies on involuntary autobiographical memories (e.g., ) research on involuntary semantic memories or mind-popping is virtually non-existent. The latter is defined as an involuntary conscious occurrence of brief items of one's network of semantic knowledge. The recall of these items (e.g., a word, a name, a tune) is not accompanied by additional contextual information and/or involvement of self-a standard feature of involuntary autobiographical memories. The paper reports several diary and questionnaire studies which looked into the nature and frequency of occurrence of these memories. The data show that people do experience involuntary semantic memories which tend to occur without any apparent cues while being engaged in relatively automatic activities. Possible mechanisms of involuntary semantic memories are discussed (e.g., very long-term priming), and the results of the study provide information on the possible duration of the priming effects in everyday life. Related theoretical and methodological issues and future avenues of research in this neglected area are outlined.     

Neural responses to morphological, syntactic, and semantic properties of single words: an fMRI study

Dissociations in the recognition of specific classes of words have been documented in brain-injured populations. These include deficits in the recognition and production of morphologically complex words as well as impairments specific to particular syntactic classes such as verbs. However, functional imaging evidence for distinctions among the neural systems underlying these dissociations has been inconclusive. We explored the neural systems involved in processing different word classes in a functional Magnetic Resonance Imaging study, contrasting four groups of words co-varying morphological complexity (simple, monomorphemic words vs complex derived or inflected words) and syntactic class (verbs vs nouns/adjectives). Subtraction of word from letter string processing showed activation in left frontal and temporal lobe regions consistent with prior studies of visual word processing. No differences were observed for morphologically complex and simple words, despite adequate power to detect stimulus specific effects. A region of posterior left middle temporal gyrus showed significantly increased activation for verbs. Post hoc analyses showed that this elevated activation could also be related to semantic properties of the stimulus items (verbs have stronger action associations than nouns, and action association is correlated with activation). Results suggest that semantic as well as syntactic factors should be considered when assessing the neural systems involved in single word comprehension.     

Naming analog clocks conceptually facilitates naming digital clocks

This study investigates how speakers of Dutch compute and produce relative time expressions. Naming digital clocks (e.g., 2:45, say "quarter to three") requires conceptual operations on the minute and hour information for the correct relative time expression. The interplay of these conceptual operations was investigated using a repetition priming paradigm. Participants named analog clocks (the primes) directly before naming digital clocks (the targets). The targets referred to the hour (e.g., 2:00), half past the hour (e.g., 2:30), or the coming hour (e.g., 2:45). The primes differed from the target in one or two hour and in five or ten minutes. Digital clock naming latencies were shorter with a five- than with a ten-min difference between prime and target, but the difference in hour had no effect. Moreover, the distance in minutes had only an effect for half past the hour and the coming hour, but not for the hour. These findings suggest that conceptual facilitation occurs when conceptual transformations are shared between prime and target in telling time.     

Time-Course of Semantic Composition: The Case of Aspectual Coercion

We examine the time-course of semantic structure formation during real-time sentence comprehension. We do this through the lens of aspectual coercion, a semantic combinatorial operation that lacks morpho-syntactic reflections, yet is indispensable for sentence interpretation. We describe two experiments. Experiment 1 replicates the results of a previously published study (Piñango, Zurif, & Jackendoff, Journal of Psycholinguistic Research, 28(4), 395–414 1999) showing that the cost of implementing aspectual coercion is detectable as late as 250 ms after the operation is licensed. Experiment 2 expands the window of observation by revealing that the implementation of aspectual coercion is not detectable immediately upon its being licensed, that is, at the point at which the syntactic representation is assumed to be fully formed. These findings suggest a dissociation in the integration of information, in which semantic composition—even mandatory and automatic semantic composition—takes time to develop after it is syntactically licensed to do so.The research reported here was supported by NIH Grant DC 03660.     

Effects of perceptual and conceptual similarity in lexical priming of young children who stutter: preliminary findings

The purpose of this study was to investigate the influence of conceptual and perceptual properties of words on the speed and accuracy of lexical retrieval of children who do (CWS) and do not stutter (CWNS) during a picture-naming task. Participants consisted of 13 3–5-year-old CWS and the same number of CWNS. All participants had speech, language, and hearing development within normal limits, with the exception of stuttering for CWS. Both talker groups participated in a picture-naming task where they named, one at a time, computer-presented, black-on-white drawings of common age-appropriate objects. These pictures were named during four auditory priming conditions: (a) a neutral prime consisting of a tone, (b) a word prime physically related to the target word, (c) a word prime functionally related to the target word, and (d) a word prime categorically related to the target word. Speech reaction time (SRT) was measured from the offset of presentation of the picture target to the onset of participant's verbal speech response. Results indicated that CWS were slower than CWNS across priming conditions (i.e., neutral, physical, function, category) and that the speed of lexical retrieval of CWS was more influenced by functional than perceptual aspects of target pictures named. Findings were taken to suggest that CWS tend to organize lexical information functionally more so than physically and that this tendency may relate to difficulties establishing normally fluent speech and language.

Educational objectives: The reader will learn about and be able to (1) communicate the relevance of examining lexical retrieval in relation to childhood stuttering and (2) describe the method of measuring speech reaction times of accurate and fluent responses during a picture-naming task as a means of assessing lexical retrieval skills.     

Processing correlates of lexical semantic complexity

This paper explores how verb meanings that differ in semantic complexity are processed and represented. In particular, we compare eventive verbs, which denote causally structured events, with stative verbs, which denote facts without causal structure. We predicted that the conceptually more complex eventive verbs should take longer to process than stative verbs. Two experiments, a lexical decision task and a self-paced reading study, confirmed this prediction. The findings suggest that (a) semantic complexity is reflected in processing time, (b) processing verb meanings involves activating properties of the event structure beyond participants' roles, and (c) more generally, lexical event structures, which subsume thematic roles, may mediate between syntactic knowledge and semantic interpretation.     

Sensitivity to local sentence context information in lexical ambiguity resolution: evidence from left- and right-hemisphere-damaged individuals

Using a cross-modal semantic priming paradigm, the present study investigated the ability of left-hemisphere-damaged (LHD) nonfluent aphasic, right-hemisphere-damaged (RHD) and non-brain-damaged (NBD) control subjects to use local sentence context information to resolve lexically ambiguous words. Critical sentences were manipulated such that they were either unbiased, or biased toward one of two meanings of sentence-final equibiased ambiguous words. Sentence primes were presented auditorily, followed after a short (0 ms) or long (750 ms) interstimulus interval (ISI) by the presentation of a first- or second-meaning related visual target, on which subjects made a lexical decision. At the short ISI, neither patient group appeared to be influenced by context, in sharp contrast to the performance of the NBD control subjects. LHD nonfluent aphasic subjects activated both meanings of ambiguous words regardless of context, whereas RHD subjects activated only the first meaning in unbiased and second-meaning biased contexts. At the long ISI, LHD nonfluent aphasic subjects failed to show evidence of activation of either meaning, while RHD individuals activated first meanings in unbiased contexts and contextually appropriate meanings in second-meaning biased contexts. These findings suggest that both left (LH) and right hemisphere (RH) damage lead to deficits in using local contextual information to complete the process of ambiguity resolution. LH damage seems to spare initial access to word meanings, but initially impairs the ability to use context and results in a faster than normal decay of lexical activation. RH damage appears to initially disrupt access to context, resulting in an over-reliance on frequency in the activation of ambiguous word meanings.