语言加工过程中的视听跨通道整合

日常生活中, 语言的使用往往出现在某个视觉情境里。大量认知科学研究表明, 视觉信息与语言信息加工模块并不是独立工作, 而是存在复杂的交互作用。本文以视觉信息对语言加工的影响为主线, 首先对视觉信息影响言语理解, 言语产生以及言语交流的相关研究进展进行了综述。其次, 重点对视觉信息影响语言加工的机制进行了探讨。最后介绍了关于视觉信息影响语言加工的计算模型, 并对未来的研究方向提出了展望。     

Combining gesture with verbal instruction promotes problem-solving skills among young children attempting difficult tasks

Extensive research shows that caregivers’ speech and gestures can scaffold children’s learning. This study examines whether caregivers increase the amount of spoken and gestural instruction when a task becomes difficult for children. We also examine whether increasing the amount of instruction containing both speech and gestures enhances children’s problem-solving. Ninety-three 3- to 4-year-old Chinese children and their caregivers participated in our study. The children tried to assemble two jigsaw puzzles (with 12 pieces in one and 20 in the other); each puzzle was attempted in three phases. The order in which the puzzles were to be solved was randomized. In Phases 1 and 3, the children tried to solve the puzzles alone. In Phase 2, the children received instruction from their caregivers. The children assembled a smaller proportion of the 20-piece puzzle than of the 12-piece one, suggesting that the 20-piece puzzle was more difficult than the 12-piece one. The caregivers produced more spoken and gestural instruction for the 20-piece than for the 12-piece puzzle. The proportion of the instruction employing both speech and gesture (+InstS+InstG) was significantly greater for the 20-piece puzzle than for the 12-piece puzzle. More importantly, the children who received more instruction with +InstS+InstG performed better in solving the 20-piece puzzle than those who received less instruction of the same type. Those who did not receive +InstS+InstG instruction performed less successfully in Phase 3. However, the facilitating effect of instruction with +InstS+InstG was not found with the 12-piece puzzle. Our findings suggest that adults should incorporate speech and gesture in their instruction as frequently as possible when teaching their children to perform a difficult task.     

Estimating group size from human speech: Three's a conversation,but four's a crowd

Much previous research has examined various aspects of auditory processing, including the localization of sounds, and the influence of lexical and indexical information on language processing. In the present set of experiments we explored the ability of listeners to estimate the number of speakers in a group solely from the information in an auditory signal. The bound on accurately estimating the number of simultaneous speakers is 3. We suggest that subitization—the ability to estimate numerosity of visual and auditory elements without explicitly counting these elements—rather than the capacity of short-term memory, may underlie this limitation. The cognitive constraint on estimating the number of simultaneous speakers may have implications for a wide variety of seemingly unrelated psychological phenomena.     

Learning words and learning sounds: Advances in language development

Phonological development is sometimes seen as a process of learning sounds, or forming phonological categories, and then combining sounds to build words, with the evidence taken largely from studies demonstrating ‘perceptual narrowing’ in infant speech perception over the first year of life. In contrast, studies of early word production have long provided evidence that holistic word learning may precede the formation of phonological categories. In that account, children begin by matching their existing vocal patterns to adult words, with knowledge of the phonological system emerging from the network of related word forms. Here I review evidence from production and then consider how the implicit and explicit learning mechanisms assumed by the complementary memory systems model might be understood as reconciling the two approaches.     

More evidence of the linkage between face processing and language processing

This review of the literature on the emergence of language describes two opposing views of phonological development, the sound‐based versus the whole‐word‐based accounts. An integrative model is proposed which claims that learning sublexical speech sounds and producing wordlike vocalizations are in fact parallel processes that feed each other during language development. We argue that this model might find unexpected support from the face processing literature.     

When Authoritarians Confront Prejudice. Differential Effects of SDO and RWA on Support for Hate‐Speech Prohibition

Two nationwide representative studies (N = 653 adolescents; N = 1007 adults) investigated the psychological correlates of the intention to penalize public expressions of prejudice in the form of support for hate‐speech prohibition. We presented participants with preselected examples of hate speech from the Internet and other mass media and assessed their willingness to support the prohibition of public expressions of such remarks. Both studies found that social dominance orientation and right‐wing authoritarianism are positively correlated with outgroup prejudice, but they have differential effects on hate‐speech prohibition. Social dominance orientation was positively related to the acceptance of hate speech, whereas right‐wing authoritarianism was positively related to hate‐speech prohibition. In discussing this counterintuitive finding, we suggest that right‐wing authoritarians are particularly vigilant toward norm violations—and this makes them more punitive toward counternormative expressions of prejudice, such as hate speech.     

Language facilitates introspection: Verbal mind-wandering has privileged access to consciousness

Introspection and language are the cognitive prides of humankind, but their interactions in healthy cognition remain unclear. Episodes of mind-wandering, where personal thoughts often go unnoticed for some time before being introspected, offer a unique opportunity to study the role of language in introspection. In this paper, we show that inner speech facilitates awareness of mind-wandering. In two experiments, we either interfered with verbal working memory, via articulatory suppression (Exp. 1), or entrained it, via presentation of verbal material (Exp. 2), and measured the resulting awareness of mind-wandering. Articulatory suppression decreased the likelihood to spontaneously notice mind-wandering, whereas verbal material increased retrospective awareness of mind-wandering. In addition, an ecological study using smartphones confirmed that inner speech vividness positively predicted mind-wandering awareness (Exp. 3). Together, these findings support the view that inner speech facilitates introspection of one’s thoughts, and therefore provides empirical evidence for a positive relation between language and consciousness.     

Living on a Slippery Slope

Our actions, individually and collectively, inevitably affect others, ourselves, and our institutions. They shape the people we become and the kind of world we inhabit. Sometimes those consequences are positive, a giant leap for moral humankind. Other times they are morally regressive. This propensity of current actions to shape the future is morally important. But slippery slope arguments are a poor way to capture it. That is not to say we can never develop cogent slippery slope arguments. Nonetheless, given their most common usage, it would be prudent to avoid them in moral and political debate. They are often fallacious and have often been used for ill. They are normally used to defend the moral status quo. Even when they are cogent, we can always find an alternate way to capture their insights. Finally, by accepting that the moral roads on which we travel are slippery, we become better able to successfully navigate them.     

Phonetic variability and prosodic structure in mothers

Spontaneous speech acoustics are highly variable. Such variability may be problematic for infants relying on phonological form to solve the segmentation problem. In the present study, acoustic measures of vowel duration and a computer model of speech segmentation were used to evaluate the problem of phonetic variability for a rhythm-based speech segmentation strategy. The specific questions under study were (1) whether or not mothers realized disyllabic vowel duration patterns consistently in spontaneous infant-directed speech, and (2) whether or not these patterns were distinctive enough in the context of an utterance to provide a useful cue for speech segmentation. Data from four English-speaking mothers indicated that the trochaic-like duration pattern may interact with phrase-position and with grammatical category, but when the resulting patterns are consistent, they provide useful segmentation cues for spontaneous infant-directed speech.