Demystifying infant vocal imitation: The roles of mouth looking and speaker’s gaze

Vocal imitation plays a fundamental role in human language acquisition from infancy. Little is known, however, about how infants imitate other's sounds. We focused on three factors: (a) whether infants receive information from upright faces, (b) the infant's observation of the speaker's mouth and (c) the speaker directing their gaze towards the infant. We recorded the eye movements of 6‐month‐olds who participated in experiments watching videos of a speaker producing vowel sounds. We found that an infants’ tendency to vocally imitate such videos increased as a function of (a) seeing upright rather than inverted faces, (b) their increased looking towards the speaker's mouth and (c) whether the speaker directed their gaze towards, rather than away from infants. These latter findings are consistent with theories of motor resonance and natural pedagogy respectively. New light has been shed on the cues and underlying mechanisms linking infant speech perception and production.     

A Search for Systematic Personality Differentiae of the Only Child in Young Adulthood

The effects of the affective relationship between the model and the observer and locus of control on imitative behavior were investigated by exposing 28 boys to their most liked peer and least liked peer on a simple imitative task. Locus of control was determined by the Nowicki-Strickland (6) Locus of Control Scale for Children. More imitative responses were exhibited to the most liked peer than to the least liked peer, and a positive correlation between number of imitative responses and internal locus of control was found. Results were interpreted as indicating the need to control the affective relationship between the model and observer and as supporting Bandura (1) in that imitative behavior is primarily under self-reinforcement control.     

How the Eyes Tell Lies: Social Gaze During a Preference Task

Social attention is thought to require detecting the eyes of others and following their gaze. To be effective, observers must also be able to infer the person's thoughts and feelings about what he or she is looking at, but this has only rarely been investigated in laboratory studies. In this study, participants' eye movements were recorded while they chose which of four patterns they preferred. New observers were subsequently able to reliably guess the preference response by watching a replay of the fixations. Moreover, when asked to mislead the person guessing, participants changed their looking behavior and guessing success was reduced. In a second experiment, naïve participants could also guess the preference of the original observers but were unable to identify trials which were lies. These results confirm that people can spontaneously use the gaze of others to infer their judgments, but also that these inferences are open to deception.     

Cultural influences on face scanning are consistent across infancy and adulthood

The emergence of cultural differences in face scanning is thought to be shaped by social experience. However, previous studies mainly investigated eye movements of adults and little is known about early development. The current study recorded eye movements of British and Japanese infants (aged 10 and 16 months) and adults, who were presented with static and dynamic faces on screen. Cultural differences were observed across all age groups, with British participants exhibiting more mouth scanning, and Japanese individuals showing increased central face (nose) scanning for dynamic stimuli. Age-related influences independent of culture were also revealed, with a shift from eye to mouth scanning between 10 and 16 months, while adults distributed their gaze more flexibly. Against our prediction, no age-related increases in cultural differences were observed, suggesting the possibility that cultural differences are largely manifest by 10 months of age. Overall, the findings suggest that individuals adopt visual strategies in line with their cultural background from early in infancy, pointing to the development of a highly adaptive face processing system that is shaped by early sociocultural experience.     

Asymmetries for the visual expression and perception of speech

This study explored asymmetries for movement, expression and perception of visual speech. Sixteen dextral models were videoed as they articulated: 'bat,' 'cat,' 'fat,' and 'sat.' Measurements revealed that the right side of the mouth was opened wider and for a longer period than the left. The asymmetry was accentuated at the beginning and ends of the vocalization and was attenuated for words where the lips did not articulate the first consonant. To measure asymmetries in expressivity, 20 dextral observers watched silent videos and reported what was said. The model's mouth was covered so that the left, right or both sides were visible. Fewer errors were made when the right mouth was visible compared to the left--suggesting that the right side is more visually expressive of speech. Investigation of asymmetries in perception using mirror-reversed clips revealed that participants did not preferentially attend to one side of the speaker's face. A correlational analysis revealed an association between movement and expressivity whereby a more motile right mouth led to stronger visual expressivity of the right mouth. The asymmetries are most likely driven by left hemisphere specialization for language, which causes a rightward motoric bias.     

Neonatal imitation of tongue protrusion and mouth opening: Methodological aspects and evidence of early individual differences

The present work examines imitation of mouth opening and tongue protrusion in 32 full-term infants at three different occasions: When the infants are two to three days, three weeks, and three months old. The analysis focuses (1) on individual differences in imitative behaviour and (2) on how to operationalize the infants' responses. The overall group analysis revealed that imitation of tongue protrusion was statistically significant for both two- to three-day-old and three-week-old infants but not when the children had become three months old. No statistically significant effect was observed for imitation of mouth opening. Two different imitation indexes were constructed in order to assess individual differences in early imitative behaviour. Results show that short-term stability in imitative tendencies exists between the first and second observation. The results further reveal that methodological factors must be seriously considered when studying neonatal imitation: the overall imitation found for tongue protrusion is demonstrated to be dependent on how the infants' responses are coded.     

Gender‐related differences in neonatal imitation

Socio‐emotional behaviour is in part sex‐related in humans, although the contribution of the biological and socio‐cultural factors is not yet known. This study explores sex‐related differences during the earliest communicative exchange, the neonatal imitation in 43 newborn infants (3–96 hours old) using an index finger extension imitative gesture. Results showed that although the experimenter presented comparable stimuli to both sexes, and the total number of movements was similar in boys and girls, girls showed more fine motor movements, a higher number of specific imitative gestures, responded faster during the imitation and showed a higher baseline heart rate during the experiment. Newborn girls, with their faster and more accurate imitative abilities, may create a more responsive and interactive social environment, which in turn may lead to differences in socio‐emotional and cognitive development between girls and boys. Copyright © 2007 John Wiley & Sons, Ltd.     

Evidence of a shift from featural to configural face processing in infancy

Two experiments examined whether 4-, 6-, and 10-month-old infants process natural looking faces by feature, i.e. processing internal facial features independently of the facial context or holistically by processing the features in conjunction with the facial context. Infants were habituated to two faces and looking time was measured. After habituation they were tested with a habituation face, a switch-face, or a novel face. In the switch-faces, the eyes and mouth of the habituation faces were switched. The results showed that the 4-month-olds processed eyes and mouth by feature, whereas the 10-month-olds processed both features holistically. The 6-month-olds were in a transitional stage where they processed the mouth holistically but the eyes still as a feature. Thus, the results demonstrated a shift from featural to holistic processing in the age range of 4 to 10 months.     

Happy mouth and sad eyes: scanning emotional facial expressions

There is evidence that specific regions of the face such as the eyes are particularly relevant for the decoding of emotional expressions, but it has not been examined whether scan paths of observers vary for facial expressions with different emotional content. In this study, eye-tracking was used to monitor scanning behavior of healthy participants while looking at different facial expressions. Locations of fixations and their durations were recorded, and a dominance ratio (i.e., eyes and mouth relative to the rest of the face) was calculated. Across all emotional expressions, initial fixations were most frequently directed to either the eyes or the mouth. Especially in sad facial expressions, participants more frequently issued the initial fixation to the eyes compared with all other expressions. In happy facial expressions, participants fixated the mouth region for a longer time across all trials. For fearful and neutral facial expressions, the dominance ratio indicated that both the eyes and mouth are equally important. However, in sad and angry facial expressions, the eyes received more attention than the mouth. These results confirm the relevance of the eyes and mouth in emotional decoding, but they also demonstrate that not all facial expressions with different emotional content are decoded equally. Our data suggest that people look at regions that are most characteristic for each emotion.     

The movement of internal facial features elicits 7 to 8‐month‐old infants' preference for face patterns

A preference for static face patterns is observed in newborns and disappears around 3 months after birth. A previous study has demonstrated that 5‐month‐old infants prefer schematic faces only when the internal features are moving, suggesting that face‐specific movement enhances infants' preference. The present study investigates the facilitative effect of the movement of internal facial features on infants' preference. To examine infants' preference, we used animated face patterns consisting of a head‐shaped contour and three disk blobs. The inner blobs expanded and contracted to represent the opening and closing of the eyes and mouth, and were constrained to open and close only in a biologically possible vertical direction resembling the facial muscle structure. We compared infants' preferential looking time for this vertically moving (VM) face pattern with their looking time for a horizontally moving (HM) face pattern in which blobs transformed at the same speed in a biologically impossible, horizontal direction. In Experiment 1, 7 to 8‐month‐olds preferred the VM to the HM, but 5 to 6‐month‐olds did not. However, the preference was diminished in both cases when the moving face patterns were presented without contour (Experiment 2). Our results suggest that internal facial features with vertical movements promote face preference in 7 to 8‐month‐olds. Copyright © 2011 John Wiley & Sons, Ltd.     

Patterns of maternal and infant imitation during play

In contrast to recent experimental studies that have sought to establish the infant's ability to imitate, the goal of the current study was to establish the actual performance of imitation by infants and their mothers during episodes of face-to-face play. Three-min play episodes of 20 mothers and their 13- to 16-week-old infants were videotaped. Instances of mouth openings, lip movements, tongue protrusions, smiling, and vocalizations by both partners were coded. Sequential analyses revealed stochastic patterns of imitation by both interactants. Mothers contingently imitated initiations by their infants and were more likely to make like initiations during action in the same category by their infants. Infants did not show onset-to-onset imitation but did show an increased likelihood to initiate actions when their mothers were engaged in a like action. That imitation by the mother is a pervasive characteristic of such interactions is consistent with earlier suggestions of its role in the acquisition of social and emotional skills. The results suggest that infants also display patterns of matching in early social interactions.     

Infant and adult perceptions of possible and impossible body movements: An eye-tracking study

This study investigated how infants perceive and interpret human body movement. We recorded the eye movements and pupil sizes of 9- and 12-month-old infants and of adults (N=14 per group) as they observed animation clips of biomechanically possible and impossible arm movements performed by a human and by a humanoid robot. Both 12-month-old infants and adults spent more time looking at the elbows during impossible compared with possible arm movements, irrespective of the appearance of the actor. These results suggest that by 12months of age, infants recognize biomechanical constraints on how arms move, and they extend this knowledge to humanoid robots. Adults exhibited more pupil dilation in response to the human's impossible arm movements compared with the possible ones, but 9- and 12-month-old infants showed no differential pupil dilation to the same actions. This finding suggests that the processing of human body movements might still be immature in 12-month-olds, as they did not show an emotional response to biomechanically impossible body movements. We discuss these findings in relation to the hypothesis that perception of others' body movements relies upon the infant's own sensorimotor experience.     

Detecting ‘infant‐directedness' in face and voice

Five‐ and 3‐month‐old infants' perception of infant‐directed (ID) faces and the role of speech in perceiving faces were examined. Infants' eye movements were recorded as they viewed a series of two side‐by‐side talking faces, one infant‐directed and one adult‐directed (AD), while listening to ID speech, AD speech, or in silence. Infants showed consistently greater dwell time on ID faces vs. AD faces, and this ID face preference was consistent across all three sound conditions. ID speech resulted in higher looking overall, but it did not increase looking at the ID face per se. Together, these findings demonstrate that infants' preferences for ID speech extend to ID faces.     

A differing bidirectional impact on the recognition accuracy of facial expression

This study explored a bidirectional impact on the recognition accuracy of various facial expressions deriving from both the observer and sender in a sample of Chinese participants. A facial manipulation task was used to examine the ability of an observer's facial feedback to modulate the recognition of various facial expressions. Furthermore, the effect of a sender's facial expression with an open or closed mouth on recognition accuracy was investigated. The results showed that only recognition accuracy of a sad facial expression was influenced simultaneously by bidirectional sources from a sender and observer. Moreover, the impact of the unidirectional cue of a sender's facial feature (i.e., mouth openness) on happy and neutral faces was found to influence the recognition accuracy of these faces, but not the observer's bodily state. These findings indicate that the bidirectional impact derived from an observer and sender on facial expression recognition accuracy differs for emotional and neutral expressions.     

THE EFFECT OF EXPERIMENTER FACIAL ORIENTATION DURING IMITATION MAINTENANCE1

The training and maintenance of imitative responding has become an important therapeutic process with language-handicapped children, as indicated by Garcia and DeHaven (American Journal of Mental Deficiency, 1974, 79 , 169–178). Typically a training “package” is used, that might entail the use of operant shaping, fading, reinforcement, and punishment techniques designed to increase correct imitation and decrease incorrect responding. Only recently have studies begun to concentrate on the components of these training “packages”. Steinman (Journal of Applied Behavior Analysis, 1970, 3 , 159–167) highlighted the roles played by less conspicuous but functionally important components of these packages. The present study attempted to provide a systematic extension of this work within an applied context. Using subjects who were responding at high levels during an imitation-maintenance procedure, experimenter facial orientation (experimenter's eyes and head oriented towards the subject's face and head), was systematically manipulated for experimentally determined “types” of imitative behavior. Differential responding within these parameters provided an evaluation of facial orientation as a functional component within this training package. Three retarded children participated in the study. Two types of topographically different imitative responses were defined for experimental purposes (“standing” and “sitting”). Each subject progressed through four conditions of the study, which called for the reinforcement of all imitative responses. But during preselected conditions, experimenter facial orientation was removed from the therapeutic package for one of the two topographical types of imitation. Results indicated that imitation of the two topographical types of models was dependent on the presence of experimenter facial orientation within the experimental procedure.     

Cardiac-somatic integration: An index of visual attention

Eighteen 15-week-old, normal full-term infants were presented with photographic slides of a human facial expression. The infant's heart rate, body movement, and visual attention were recorded simultaneously. The results showed that heart rate and body movement were significantly correlated during visual attention but not during inattention. Both heart rate and body movement decelerated significantly when the infants visually attended to the target stimulus. The results are discussed with reference to cardiac-somatic integration in early infancy and its implication as a possible index of attention.     

The other-race effect develops during infancy: evidence of perceptual narrowing

Experience plays a crucial role in the development of face processing. In the study reported here, we investigated how faces observed within the visual environment affect the development of the face-processing system during the 1st year of life. We assessed 3-, 6-, and 9-month-old Caucasian infants' ability to discriminate faces within their own racial group and within three other-race groups (African, Middle Eastern, and Chinese). The 3-month-old infants demonstrated recognition in all conditions, the 6-month-old infants were able to recognize Caucasian and Chinese faces only, and the 9-month-old infants' recognition was restricted to own-race faces. The pattern of preferences indicates that the other-race effect is emerging by 6 months of age and is present at 9 months of age. The findings suggest that facial input from the infant's visual environment is crucial for shaping the face-processing system early in infancy, resulting in differential recognition accuracy for faces of different races in adulthood.     

THE DEVELOPMENT AND GENERALIZATION OF DELAYED IMITATION1

An individual's behavior can be identified as imitative if it temporally follows the behavior of another individual and if its topography is controlled by the demonstrated behavior [Baer, Peterson, and Sherman (Journal of the Experimental Analysis of Behavior, 1967, 10 , 405–416)]. This definition takes into account both temporal and topographical characteristics of the behavior in question. More recent research in the area of imitation has interpreted the temporal component of the above definition differentially by limiting imitation to those topographically similar responses occurring within 3, 5, or 10 sec after a model's demonstration. Yet, Gewirtz and Stingle (Psychological Review, 1968, 75 , 375–397) pointed out that much of the imitation seen in young children is not of this immediate nature, but instead occurs sometime after a model's response. They further suggest that this type of imitative behavior can be characterized as a response class and is susceptible to development and modification as a function of consequences delivered to subjects contingent on this type of delayed responding. Four retarded children, three initially imitative and one nonimitative, were individually trained to imitate a number of motor responses in an immediate and a delayed fashion. Immediate imitation was defined as a response similar to a model's demonstration occurring within 5 sec after the model's demonstration; delayed imitation was defined as a response similar to a model's demonstration occurring more than 5 sec, but not more than 25 sec, after the model's demonstration. A reversal (ABAB) design was employed to examine the experimental development of a generalized delayed imitative repertoire. Untrained probe responses were demonstrated to subjects systematically through the ongoing training. Generalized immediate and delayed imitation were observed in each subject; this generalization was restricted to the type of imitation currently undergoing training. This development of a generalized imitation repertoire was observed in each subject. That is, these subjects imitated some responses that had never been specifically trained. More importantly, a training package consisting of prompting, fading, and consequences for delayed imitation functioned to develop generalized delayed imitation. These data exemplify a special case of generalization that was a function of the most recent training history of immediate or delayed imitation. The reversal design demonstrated that imitations of nontrained models were either delayed or immediate, depending upon which form of imitation was currently receiving training. Therefore, for each form of imitation trained, delayed or immediate, a corresponding response class was demonstrated. These data relate to data reported by Garcia, Baer, and Firestone (Journal of Applied Behavior Analysis, 1971, 4 , 101–112). The association lies in the proposition that there are identifiable boundaries of generalized imitation and that these boundaries are functionally related to previous training histories.     

Imitative reactions among 14–21 day old infants

Imitative reactions in 11 infants, 14–21 days old, were observed. Stimuli were presented by the infant's mother, who protruded her tongue, opened her mouth, or interacted spontaneously. No conclusive overall group effects of the modeled action were found. However, when the responses of the infants were matched with the mothers' judgments concerning whether imitation had occurred, 6 infants showed imitative responses. It is concluded that observations on early imitation are influenced by individual differences between infants and that there may exist two different subgroups: High and low imitators.     

Receptive fields for flexible face categorizations

Abstract-Examining the receptive fields of brain signals can elucidate how information impinging on the former modulates the latter. We applied this time-honored approach in early vision to the higher-level brain processes underlying face categorizations. Electroencephalograms in response to face-information samples were recorded while observers resolved two different categorizations (gender, expressive or not). Using a method with low bias and low variance, we compared, in a common space of information states, the information determining behavior (accuracy and reaction time) with the information that modulates emergent brain signals associated with early face encoding and later category decision. Our results provide a time line for face processing in which selective attention to diagnostic information for categorizing stimuli (the eyes and their second-order relationships in gender categorization; the mouth in expressive-or-not categorization) correlates with late electrophysiological (P300) activity, whereas early face-sensitive occipito-temporal (N170) activity is mainly driven by the contralateral eye, irrespective of the categorization task.