“I see what you mean”: Oral deaf individuals benefit from speaker's gesturing

Recent studies in the psychological literature reveal that cospeech gestures facilitate the construction of an articulated mental model of an oral discourse by hearing individuals. In particular, they facilitate correct recollections and discourse-based inferences at the expense of memory for discourse verbatim. Do gestures accompanying an oral discourse facilitate the construction of a discourse model also by oral deaf individuals trained to lip-read? The atypical cognitive functioning of oral deaf individuals leads to this prediction. Experiments 1 and 2, each conducted on 16 oral deaf individuals, used a recollection task and confirmed the prediction. Experiment 3, conducted on 36 oral deaf individuals, confirmed the prediction using a recognition task.     

Effects of changes in narrative time on eye movements and recognition responses

Abstract

Gibbs and O'Brien (1990) recently claimed that the images that people associate with everyday idioms reflect the deep conceptual metaphors that underlie the meanings of those idioms. However, because idiomatic strings can convey both a literal and an idiomatic meaning, people must be able to inhibit or ignore literal meanings if they are to produce mental images that uniquely reflect idiomatic meanings. We investigated the potential interference between literal and idiomatic meanings in three experiments. Experiment 1 used a mental-image production task similar to that used by Gibbs and O'Brien. Counter to Gibbs and O'Brien's claim, the images that we obtained referred overwhelmingly to the literal meanings of idiomatic strings rather than to their idiomatic meanings. Experiments 2 and 3 employed a paraphrase verification task to examine the effects of mental imagery on idiom comprehension. If the images associated with an idiom reflect that idiom's meaning, then imagery should facilitate comprehension. No evidence for facilitation was found in either experiment. Instead, imagery interfered with comprehension, as assessed by paraphrase verification time, both for idiomatic meanings and for literal, concrete meanings. We conclude that the images associated with idioms do not reflect idiom meanings.     

The Action-Sentence Compatibility Effect: It's All in the Timing

When participants are asked to make sensibility judgments on sentences that describe action toward the body (i.e., "Mark dealt the cards to you") or away from the body (i.e., "You dealt the cards to Mark"), they are faster to respond when the response requires an arm movement in the same direction as the action described by the sentence. This congruence effect is known as the Action–Sentence Compatibility Effect (ACE). This study reports 4 experiments that extend our understanding of the ACE by exploring how the time at which one prepares the motor response required for the sensibility judgment affects the magnitude of the ACE. Results show that the ACE arises only when participants have the opportunity to plan their motor response while they are processing the sentence.     

Aging and the use of context in ambiguity resolution: complex changes from simple slowing

Older and younger adults' abilities to use context information rapidly during ambiguity resolution were investigated. In Experiments 1 and 2, younger and older adults heard ambiguous words (e.g., fires) in sentences where the preceding context supported either the less frequent or more frequent meaning of the word. Both age groups showed good context use in offline tasks, but only young adults demonstrated rapid use of context in cross-modal naming. A 3rd experiment demonstrated that younger and older adults had similar knowledge about the contexts used in Experiments 1 and 2. The experiment results were simulated in 2 computational models in which different patterns of context use were shown to emerge from varying a single speed parameter. These results suggest that age-related changes in processing efficiency can modulate context use during language comprehension.     

Perception of auditory motion affects language processing

Previous reports have demonstrated that the comprehension of sentences describing motion in a particular direction (toward, away, up, or down) is affected by concurrently viewing a stimulus that depicts motion in the same or opposite direction. We report 3 experiments that extend our understanding of the relation between perception and language processing in 2 ways. First, whereas most previous studies of the relation between perception and language processing have focused on visual perception, our data show that sentence processing can be affected by the concurrent processing of auditory stimuli. Second, it is shown that the relation between the processing of auditory stimuli and the processing of sentences depends on whether the sentences are presented in the auditory or visual modality.     

A Time Course View of Sentence Priming Effects

Meaning activation was estimated during (standard naming) and after (delayed naming) target presentation to chart the time course of priming effects during reading comprehension. Using sentences biasing homographs toward their dominant and subordinate meanings, two experiments evaluated context effects across three naming-cue delays: immediate, baseline, baseline+600 ms all at a 0-ms interstimulus interval. When participants named a target immediately as it was presented, results converged with previous findings demonstrating initial context-sensitive meaning activation. The delayed naming conditions revealed little post-access influences for dominant contexts. Subordinate contexts, however, provided the strongest evidence of continued (or sustained) processing. It was concluded that context has immediate and automatic effects on initial meaning activation, after which, strategies are invoked for fine-tuning an interpretation of a sentence and integrating it with new information.     

Zero Anaphora: Transfer of Reference Tracking Strategies from Chinese to English

English contains many nominals that would be absent in Chinese because Chinese makes greater use of zero anaphora, which is an empty grammatical slot in a sentence standing for a previously mentioned referent. Native Chinese and native English speakers were compared in comprehending modified English passages from a standardized reading test with nominals deleted that would be absent in Chinese. In three experiments, Chinese speakers showed superior comprehension as measured by objective multiple-choice questions in this case, but not when no words were deleted or when nominals were deleted that would not be absent in Chinese. These results imply that native Chinese speakers develop reference tracking strategies that they transfer to comprehending English.This research was supported in part by United States Army Research Institute Contracts MDA903-93-K-0010, DASW01-96-K-0010, DASW01-99-K-0002, and DASW01-03-K-0002 to the University of Colorado (Alice Healy, Principal Investigator).We thank Lyle Bourne and Barbara Fox for stimulating discussions about this research. We are also grateful to the Institute of Cognitive Science at the University of Colorado for their support of this research.Experiments 1 and 2 were reported at the International Conference on Functional Approaches to Grammar, Albuquerque, NM, July 25, 1995, and at the 37th Annual Meeting of the Psychonomic Society, Chicago, IL, November 3, 1996, and all three experiments were reported at the 2001 American Association for Applied Linguistics conference, St. Louis, MO, February 24, 2001.     

An Assessment of Risk Understanding in Hispanic Genetic Counseling Patients

This study sought to identify if differences existed in risk comprehension and risk format understanding between genetic counseling patients of Hispanic and Caucasian ethnicity. A total of 107 questionnaires were collected, 56 from Hispanic patients, and 51 from Caucasian controls. Of the total population 41.1% (44/107) could not demonstrate sufficient risk understanding, which was 71.4% (40/56) of Hispanics and 7.8% (4/51) of Caucasians. Fractions were the best-understood format for all participants. However, both Hispanics and Caucasians had difficulties with the percentage risk format. Discrepancies were also noted in qualitative word format understanding. Awareness of differences in risk comprehension may affect the selection of counseling techniques and strategies utilized by genetic counselors when educating patients about risk related information.     

The Effect of Phonemic Repetition on Syntactic Ambiguity Resolution: Implications for Models of Working Memory

Two reading experiments investigated the extent to which the presence of phonemic repetition in sentences influenced processing difficulty during syntactic ambiguity resolution. In both experiments, participants read sentences silently as reading time was measured. Reading time on sentences containing a temporary syntactic ambiguity was compared to reading time on unambiguous control sentences. Sentences either did or did not contain repeated phonemes. The results showed that reading time was longer for sentences containing a syntactic ambiguity than for unambiguous control sentences. Reading time was also longer on sentences containing repeated phonemes than on sentences that did not contain repeated phonemes. Phonemic repetition did not increase the time taken for syntactic ambiguity resolution; rather, the effects of syntactic ambiguity and phonemic repetition were temporally distinct, with the effect of phonemic repetition following the effect of syntactic ambiguity. Implications for theories of working memory are discussed.