Demystifying infant vocal imitation: The roles of mouth looking and speaker’s gaze

Vocal imitation plays a fundamental role in human language acquisition from infancy. Little is known, however, about how infants imitate other's sounds. We focused on three factors: (a) whether infants receive information from upright faces, (b) the infant's observation of the speaker's mouth and (c) the speaker directing their gaze towards the infant. We recorded the eye movements of 6‐month‐olds who participated in experiments watching videos of a speaker producing vowel sounds. We found that an infants’ tendency to vocally imitate such videos increased as a function of (a) seeing upright rather than inverted faces, (b) their increased looking towards the speaker's mouth and (c) whether the speaker directed their gaze towards, rather than away from infants. These latter findings are consistent with theories of motor resonance and natural pedagogy respectively. New light has been shed on the cues and underlying mechanisms linking infant speech perception and production.     

Bilingual infants excel at foreign‐language talker recognition

Bilingual and monolingual infants differ in how they process linguistic aspects of the speech signal. But do they also differ in how they process non‐linguistic aspects of speech, such as who is talking? Here, we addressed this question by testing Canadian monolingual and bilingual 9‐month‐olds on their ability to learn to identify native Spanish‐speaking females in a face‐voice matching task. Importantly, neither group was familiar with Spanish prior to participating in the study. In line with our predictions, bilinguals succeeded in learning the face‐voice pairings, whereas monolinguals did not. We consider multiple explanations for this finding, including the possibility that simultaneous bilingualism enhances perceptual attentiveness to talker‐specific speech cues in infancy (even in unfamiliar languages), and that early bilingualism delays perceptual narrowing to language‐specific talker recognition cues. This work represents the first evidence that multilingualism in infancy affects the processing of non‐linguistic aspects of the speech signal, such as talker identity.     

Inside bilingualism: Language background modulates selective attention to a talker's mouth

Previous findings indicate that bilingual Catalan/Spanish‐learning infants attend more to the highly salient audiovisual redundancy cues normally available in a talker's mouth than do monolingual infants. Presumably, greater attention to such cues renders the challenge of learning two languages easier. Spanish and Catalan are, however, rhythmically and phonologically close languages. This raises the possibility that bilinguals only rely on redundant audiovisual cues when their languages are close. To test this possibility, we exposed 15‐month‐old and 4‐ to 6‐year‐old close‐language bilinguals (Spanish/Catalan) and distant‐language bilinguals (Spanish/”other”) to videos of a talker uttering Spanish or Catalan (native) and English (non‐native) monologues and recorded eye‐gaze to the talker's eyes and mouth. At both ages, the close‐language bilinguals attended more to the talker's mouth than the distant‐language bilinguals. This indicates that language proximity modulates selective attention to a talker's mouth during early childhood and suggests that reliance on the greater salience of audiovisual speech cues depends on the difficulty of the speech‐processing task.     

Specific effects of the Trier Social Stress Test on speech fluency in young and older adults

The notion that speech becomes less fluent during stressful speaking conditions has received little empirical test, and no research has tested this relationship in older adult participants. We analyzed speeches produced during the Trier Social Stress Test (TSST) or during a less stressful placebo (pTSST) version of the task. We measured young and older adults’ speech fillers (e.g., um), unfilled pauses (at least 1 s in duration), and other disfluencies (e.g., repetitions, repairs). Neither young nor older adult participants rated themselves as having greater stress in the TSST than pTSST condition, but behavioral effects were obtained. Participants in the TSST condition produced more mid-phrase speech fillers and unfilled pauses than participants in the pTSST condition. Young adults produced more unfilled pauses than older adults overall, and older adults produced more mid-phrase fillers than young adults. Critically, age group interacted with experimental condition, such that older speakers produced disproportionately more mid-phrase fillers than young adults in the TSST compared to the pTSST condition. In sum, the negative effects of the TSST on fluency were generally similar across age, but this specific age-related increase in mid-phrase fillers indicates that older adults’ word retrieval may have been particularly negatively affected. Findings are generally consistent with previous research and add to understanding of how factors internal to the speaker (i.e., demographic, personality, and cognitive variables) and factors external to the speaker (i.e., variables regarding the situation, context, or content of speech) combine to affect speech fluency.     

语言加工过程中的视听跨通道整合

日常生活中, 语言的使用往往出现在某个视觉情境里。大量认知科学研究表明, 视觉信息与语言信息加工模块并不是独立工作, 而是存在复杂的交互作用。本文以视觉信息对语言加工的影响为主线, 首先对视觉信息影响言语理解, 言语产生以及言语交流的相关研究进展进行了综述。其次, 重点对视觉信息影响语言加工的机制进行了探讨。最后介绍了关于视觉信息影响语言加工的计算模型, 并对未来的研究方向提出了展望。     

Combining gesture with verbal instruction promotes problem-solving skills among young children attempting difficult tasks

Extensive research shows that caregivers’ speech and gestures can scaffold children’s learning. This study examines whether caregivers increase the amount of spoken and gestural instruction when a task becomes difficult for children. We also examine whether increasing the amount of instruction containing both speech and gestures enhances children’s problem-solving. Ninety-three 3- to 4-year-old Chinese children and their caregivers participated in our study. The children tried to assemble two jigsaw puzzles (with 12 pieces in one and 20 in the other); each puzzle was attempted in three phases. The order in which the puzzles were to be solved was randomized. In Phases 1 and 3, the children tried to solve the puzzles alone. In Phase 2, the children received instruction from their caregivers. The children assembled a smaller proportion of the 20-piece puzzle than of the 12-piece one, suggesting that the 20-piece puzzle was more difficult than the 12-piece one. The caregivers produced more spoken and gestural instruction for the 20-piece than for the 12-piece puzzle. The proportion of the instruction employing both speech and gesture (+InstS+InstG) was significantly greater for the 20-piece puzzle than for the 12-piece puzzle. More importantly, the children who received more instruction with +InstS+InstG performed better in solving the 20-piece puzzle than those who received less instruction of the same type. Those who did not receive +InstS+InstG instruction performed less successfully in Phase 3. However, the facilitating effect of instruction with +InstS+InstG was not found with the 12-piece puzzle. Our findings suggest that adults should incorporate speech and gesture in their instruction as frequently as possible when teaching their children to perform a difficult task.     

Estimating group size from human speech: Three's a conversation,but four's a crowd

Much previous research has examined various aspects of auditory processing, including the localization of sounds, and the influence of lexical and indexical information on language processing. In the present set of experiments we explored the ability of listeners to estimate the number of speakers in a group solely from the information in an auditory signal. The bound on accurately estimating the number of simultaneous speakers is 3. We suggest that subitization—the ability to estimate numerosity of visual and auditory elements without explicitly counting these elements—rather than the capacity of short-term memory, may underlie this limitation. The cognitive constraint on estimating the number of simultaneous speakers may have implications for a wide variety of seemingly unrelated psychological phenomena.     

Learning words and learning sounds: Advances in language development

Phonological development is sometimes seen as a process of learning sounds, or forming phonological categories, and then combining sounds to build words, with the evidence taken largely from studies demonstrating ‘perceptual narrowing’ in infant speech perception over the first year of life. In contrast, studies of early word production have long provided evidence that holistic word learning may precede the formation of phonological categories. In that account, children begin by matching their existing vocal patterns to adult words, with knowledge of the phonological system emerging from the network of related word forms. Here I review evidence from production and then consider how the implicit and explicit learning mechanisms assumed by the complementary memory systems model might be understood as reconciling the two approaches.     

More evidence of the linkage between face processing and language processing

This review of the literature on the emergence of language describes two opposing views of phonological development, the sound‐based versus the whole‐word‐based accounts. An integrative model is proposed which claims that learning sublexical speech sounds and producing wordlike vocalizations are in fact parallel processes that feed each other during language development. We argue that this model might find unexpected support from the face processing literature.     

When Authoritarians Confront Prejudice. Differential Effects of SDO and RWA on Support for Hate‐Speech Prohibition

Two nationwide representative studies (N = 653 adolescents; N = 1007 adults) investigated the psychological correlates of the intention to penalize public expressions of prejudice in the form of support for hate‐speech prohibition. We presented participants with preselected examples of hate speech from the Internet and other mass media and assessed their willingness to support the prohibition of public expressions of such remarks. Both studies found that social dominance orientation and right‐wing authoritarianism are positively correlated with outgroup prejudice, but they have differential effects on hate‐speech prohibition. Social dominance orientation was positively related to the acceptance of hate speech, whereas right‐wing authoritarianism was positively related to hate‐speech prohibition. In discussing this counterintuitive finding, we suggest that right‐wing authoritarians are particularly vigilant toward norm violations—and this makes them more punitive toward counternormative expressions of prejudice, such as hate speech.