语言加工过程中的视听跨通道整合

日常生活中, 语言的使用往往出现在某个视觉情境里。大量认知科学研究表明, 视觉信息与语言信息加工模块并不是独立工作, 而是存在复杂的交互作用。本文以视觉信息对语言加工的影响为主线, 首先对视觉信息影响言语理解, 言语产生以及言语交流的相关研究进展进行了综述。其次, 重点对视觉信息影响语言加工的机制进行了探讨。最后介绍了关于视觉信息影响语言加工的计算模型, 并对未来的研究方向提出了展望。     

A new look at “the hard problem” of bilingual lexical access: evidence for language-switch costs with univalent stimuli

Considerable work has used language-switching tasks to investigate how bilinguals manage competition between languages. Language-switching costs have been argued to reflect persisting inhibition or persisting activation of a non-target language. However, these costs might instead reflect the use of bivalent stimuli (i.e. pictures or digits that can be responded to in either language). That is, language-switching costs may simply reflect a cost of selecting the task-appropriate response for a given item and so may not be reflective of bilingual lexical access [Finkbeiner, M., Almeida, J., Janssen, N., & Carramaza, A. (2006). Lexical selection in bilingual speech production does not involve language suppression. Journal of Experimental Psychology: Learning, Memory, and Cognition, 32(5), 1075–1089]. The present study addresses this concern by having Chinese/English bilinguals switch between languages in response to inherently univalent stimuli (English words and Chinese Characters) as well as lexically univalent, but orthographically bivalent, stimuli (English words and Chinese Pinyin). Speakers showed switch costs when naming both univalent and orthographically bivalent stimuli, showing that switch costs can be found even with inherently univalent stimuli.     

Do I amuse you? Asymmetric predictors for humor appreciation and humor production

A “sense of humor” can be fractionated into appreciation (enjoying jokes), production fluency (making jokes), and production success (making funny jokes). There is scant research on how appreciation and production relate, and their relation to individual differences. Participants (N = 159) rated the humor of captioned cartoons and created captions for different cartoons. People who wrote funnier captions were less amused by the professionally-captioned cartoons. Production fluency, in contrast, was not related to appreciation. Personality predicted humor appreciation, but not production success. Demographics predicted production success, but not appreciation. Appreciation and production success appear to rely on separable mechanisms and motivations. Our results were also inconsistent with the idea that humor creators are motivated by dominance and humor appreciators by affiliation.     

“I see what you mean”: Oral deaf individuals benefit from speaker's gesturing

Recent studies in the psychological literature reveal that cospeech gestures facilitate the construction of an articulated mental model of an oral discourse by hearing individuals. In particular, they facilitate correct recollections and discourse-based inferences at the expense of memory for discourse verbatim. Do gestures accompanying an oral discourse facilitate the construction of a discourse model also by oral deaf individuals trained to lip-read? The atypical cognitive functioning of oral deaf individuals leads to this prediction. Experiments 1 and 2, each conducted on 16 oral deaf individuals, used a recollection task and confirmed the prediction. Experiment 3, conducted on 36 oral deaf individuals, confirmed the prediction using a recognition task.     

Persistent structural priming from language comprehension to language production

To examine the relationship between syntactic processes in language comprehension and language production, we compared structural persistence from sentence primes that speakers heard to persistence from primes that speakers produced. [Bock, J. K., & Griffin, Z. M. (2000). The persistence of structural priming: transient activation or implicit learning? Journal of Experimental Psychology: General, 129, 177-192.] showed that the production of target priming structures increased the probability of spontaneously using the same structures to describe events in subsequent pictures that were semantically unrelated to the primes. These priming effects persisted across as many as ten intervening filler trials. The present studies replicated these results using auditorily presented primes to which participants only listened. The results indicated persistence of priming across all lags, with relative magnitudes of priming as large as those observed by Bock and Griffin. The implication is that structural priming is persistent regardless of the modality in which language structures are experienced, underscoring the power of priming as an implicit learning mechanism.