Perceptual similarity of mirror images in infancy

Perception of mirror images by three-to four-month infants was studied in five experiments using habituation paradigms. In the first experiment, babies discriminated right profiles of two different faces but not the left and right profile of the same face. In the second, babies discriminated a 45° oblique from a vertical line, but not the oblique from its mirror image. In the third, babies discriminated oblique lines that differed by 50° and were not mirror images. In the final experiments. 90° rotations of a ?-shape were discriminated but not 180° rotations that formed lateral or vertical mirror images. These results demonstrated that although babies were able to discriminate differences in orientation (even among obliques) they tended to view mirror images, especially lateral mirror images, as equivalent stimuli. We propose that the perceptual equivalence of mirror images reflects an adaptive mode of visual processing; mirror images in nature are almost always aspects of the same object, and they usually need not be discriminated. The relations of the perceptual similarity of mirror images to the ontogeny of the object concept and to the development of reading are discussed.     

Facial expression recognition in peripheral versus central vision: role of the eyes and the mouth

This study investigated facial expression recognition in peripheral relative to central vision, and the factors accounting for the recognition advantage of some expressions in the visual periphery. Whole faces or only the eyes or the mouth regions were presented for 150 ms, either at fixation or extrafoveally (2.5° or 6°), followed by a backward mask and a probe word. Results indicated that (a) all the basic expressions were recognized above chance level, although performance in peripheral vision was less impaired for happy than for non-happy expressions, (b) the happy face advantage remained when only the mouth region was presented, and (c) the smiling mouth was the most visually salient and most distinctive facial feature of all expressions. This suggests that the saliency and the diagnostic value of the smile account for the advantage in happy face recognition in peripheral vision. Because of saliency, the smiling mouth accrues sensory gain and becomes resistant to visual degradation due to stimulus eccentricity, thus remaining accessible extrafoveally. Because of diagnostic value, the smile provides a distinctive single cue of facial happiness, thus bypassing integration of face parts and reducing susceptibility to breakdown of configural processing in peripheral vision.     

Influence of emotional facial expressions on 3-5-year-olds’ face recognition

Three experiments examined 3- and 5-year-olds’ recognition of faces in constant and varied emotional expressions. Children were asked to identify repeatedly presented target faces, distinguishing them from distractor faces, during an immediate recognition test and during delayed assessments after 10 min and one week. Emotional facial expression remained neutral (Experiment 1) or varied between immediate and delayed tests: from neutral to smile and anger (Experiment 2), from smile to neutral and anger (Experiment 3, condition 1), or from anger to neutral and smile (Experiment 3, condition 2). In all experiments, immediate face recognition was not influenced by emotional expression for either age group. Delayed face recognition was most accurate for faces in identical emotional expression. For 5-year-olds, delayed face recognition (with varied emotional expression) was not influenced by which emotional expression had been displayed during the immediate recognition test. Among 3-year-olds, accuracy decreased when facial expressions varied from neutral to smile and anger but was constant when facial expressions varied from anger or smile to neutral, smile or anger. Three-year-olds’ recognition was facilitated when faces initially displayed smile or anger expressions, but this was not the case for 5-year-olds. Results thus indicate a developmental progression in face identity recognition with varied emotional expressions between ages 3 and 5.     

Recognition,discrimination and categorization of smiling by 5-month-old infants

Perceiving emotions correctly is foundational to the development of interpersonal skills. Five-month-old infants’ abilities to recognize, discriminate and categorize facial expressions of smiling were tested in three coordinated experiments. Infants were habituated to four degrees of smiling modeled by the same or different people; following habituation, infants were presented with a new degree of smile worn by the same and by a new person (Experiment 1), a new degree of smile and a fearful expression worn by the same person (Experiment 2) or a new degree of smile and a fearful expression worn by new people (Experiment 3). Infants showed significant novelty preferences for the new person smiling and for the fearful expressions over the new degree of smiling. These findings indicate that infants at 5 months can categorize the facial expression of smiling in static faces, and yet recognize the same person despite changes in facial expression; this is the youngest age at which these abilities have been demonstrated. The findings are discussed in light of the significance of emotion expression face processing in social interaction and infants’ categorization of faces.     

Effects of motion and audio-visual redundancy on upright and inverted face and feature preferences in 4-13-month old pre- and full-term NICU graduates

NICU infants are reported to have diminished social orientation and increased risk of socio-communicative disorders. In this eye tracking study, we used a preference for upright compared to inverted faces as a gauge of social interest in high medical risk full- and pre-term NICU infants. We examined the effects of facial motion and audio-visual redundancy on face and eye/mouth preferences across the first year. Upright and inverted baby faces were simultaneously presented in a paired-preference paradigm with motion and synchronized vocalization varied. NICU risk factors including birth weight, sex, and degree of CNS injury were examined. Overall, infants preferred the more socially salient upright faces, making this the first report, to our knowledge, of an upright compared to inverted face preference among high medical risk NICU infants. Infants with abnormalities on cranial ultrasound displayed lower social interest, i.e. less of a preferential interest in upright faces, when viewing static faces. However, motion selectively increased their upright face looking time to a level equal that of infants in other CNS injury groups. We also observed an age-related sex effect suggesting higher risk in NICU males. Females increased their attention to the mouth in upright faces across the first year, especially between 7–10 months, but males did not. Although vocalization increased diffuse attention toward the screen, contrary to our predictions, there was no evidence that the audio-visual redundancy embodied in a vocalizing face focused additional attention on upright faces or mouths. This unexpected result may suggest a vulnerability in response to talking faces among NICU infants that could potentially affect later verbal and socio-communicative development.     

Infants' discrimination of photographs of faces following redundant presentations

Infants' discrimination of photographs of faces, as indicated by fixation toward novel targets, was the criterion used to evaluate familiarization conditions designed to facilitate the exercise of selective attention. Groups of 19- and 23-week-old infants were shown either pictures of different faces of the same sex, differing poses of the same face, or repeated exposures of the face that served as a test stimulus. The older infants demonstrated differential attention to novel over familiar stimuli during subsequent recognition tests, and an examination of their responsiveness during familiarization presentations indicated differing trends of looking activity.     

Language experience influences audiovisual speech integration in unimodal and bimodal bilingual infants

Infants as young as 2 months can integrate audio and visual aspects of speech articulation. A shift of attention from the eyes towards the mouth of talking faces occurs around 6 months of age in monolingual infants. However, it is unknown whether this pattern of attention during audiovisual speech processing is influenced by speech and language experience in infancy. The present study investigated this question by analysing audiovisual speech processing in three groups of 4‐ to 8‐month‐old infants who differed in their language experience: monolinguals, unimodal bilinguals (infants exposed to two or more spoken languages) and bimodal bilinguals (hearing infants with Deaf mothers). Eye‐tracking was used to study patterns of face scanning while infants were viewing faces articulating syllables with congruent, incongruent and silent auditory tracks. Monolinguals and unimodal bilinguals increased their attention to the mouth of talking faces between 4 and 8 months, while bimodal bilinguals did not show any age difference in their scanning patterns. Moreover, older (6.6 to 8 months), but not younger, monolinguals (4 to 6.5 months) showed increased visual attention to the mouth of faces articulating audiovisually incongruent rather than congruent faces, indicating surprise or novelty. In contrast, no audiovisual congruency effect was found in unimodal or bimodal bilinguals. Results suggest that speech and language experience influences audiovisual integration in infancy. Specifically, reduced or more variable experience of audiovisual speech from the primary caregiver may lead to less sensitivity to the integration of audio and visual cues of speech articulation.     

The role of facial orientation in newborn infants’ preference for attractive faces

Several previous experiments have found that newborn and young infants will spend more time looking at attractive faces when these are shown paired with faces judged by adults to be unattractive. Two experimental conditions are described whose aim was to find whether the ‘attractiveness effect’ is affected by the orientation of the facial stimuli. Pairs of attractive and less attractive faces (as judged by adults) were shown to newborn infants (mean age 2 days 20.5 hours), where each pair was presented both upright and inverted through 180°. In the former (upright) condition, but not the latter (inverted) condition, the infants looked longer at the attractive faces, and the difference in attractiveness preference between the conditions was statistically significant. These findings are clear evidence that infants’ early representation of faces contains information about faces that is orientation‐specific. The results are discussed in terms of innate facial representations and rapid learning about faces in the hours from birth.     

Evolutionary Relevance and Experience Contribute to Face Discrimination in Infant Macaques (Macaca mulatta)

In human children and adults, familiar face types—typically own-age and own-species faces—are discriminated better than other face types; however, human infants do not appear to exhibit an own-age bias but instead better discriminate adult faces, which they see more often. There are two possible explanations for this pattern: Perceptual attunement predicts advantages in discrimination for the most experienced face types. Additionally or alternatively, there may be an experience-independent bias for infants to discriminate own-species faces, an adaptation for evolutionarily relevant faces. These possibilities have not been disentangled in studies thus far, and these studies did not control infants’ early experiences with faces. In the present study, we tested these predictions in infant macaques (Macaca mulatta) reared under controlled environments, not exposed to adult conspecifics. We measured newborns’ (15–25 days; n = 27) and 6- to 7-month-olds’ (n = 35) discrimination of human and macaque faces at 3 ages—young infants, old infants, and adults—in a visual paired comparison task. We found that 6- to 7-month-olds were the best at discriminating adult macaque faces; however, in the first few seconds of looking, tthey additionally discriminated familiar face types—same-aged peer and adult human faces—thereby highlighting the importance of experience with certain face categories. The present data suggest that macaque infants possess both experience-independent and experientially tuned face biases. In human infants, early face skills may likewise be driven by both experience and evolutionary relevance; future studies should consider both of these factors.     

Neural correlates of perceptual narrowing in cross‐species face‐voice matching

Integrating the multisensory features of talking faces is critical to learning and extracting coherent meaning from social signals. While we know much about the development of these capacities at the behavioral level, we know very little about the underlying neural processes. One prominent behavioral milestone of these capacities is the perceptual narrowing of face–voice matching, whereby young infants match faces and voices across species, but older infants do not. In the present study, we provide neurophysiological evidence for developmental decline in cross‐species face–voice matching. We measured event‐related brain potentials (ERPs) while 4‐ and 8‐month‐old infants watched and listened to congruent and incongruent audio‐visual presentations of monkey vocalizations and humans mimicking monkey vocalizations. The ERP results indicated that younger infants distinguished between the congruent and the incongruent faces and voices regardless of species, whereas in older infants, the sensitivity to multisensory congruency was limited to the human face and voice. Furthermore, with development, visual and frontal brain processes and their functional connectivity became more sensitive to the congruence of human faces and voices relative to monkey faces and voices. Our data show the neural correlates of perceptual narrowing in face–voice matching and support the notion that postnatal experience with species identity is associated with neural changes in multisensory processing ( Lewkowicz & Ghazanfar, 2009 ).     

Face detection in 2‐ to 6‐month‐old infants is influenced by gaze direction and species

Humans detect faces efficiently from a young age. Face detection is critical for infants to identify and learn from relevant social stimuli in their environments. Faces with eye contact are an especially salient stimulus, and attention to the eyes in infancy is linked to the emergence of later sociality. Despite the importance of both of these early social skills—attending to faces and attending to the eyes—surprisingly little is known about how they interact. We used eye tracking to explore whether eye contact influences infants' face detection. Longitudinally, we examined 2‐, 4‐, and 6‐month‐olds' (N = 65) visual scanning of complex image arrays with human and animal faces varying in eye contact and head orientation. Across all ages, infants displayed superior detection of faces with eye contact; however, this effect varied as a function of species and head orientation. Infants were more attentive to human than animal faces and were more sensitive to eye and head orientation for human faces compared to animal faces. Unexpectedly, human faces with both averted heads and eyes received the most attention. This pattern may reflect the early emergence of gaze following—the ability to look where another individual looks—which begins to develop around this age. Infants may be especially interested in averted gaze faces, providing early scaffolding for joint attention. This study represents the first investigation to document infants' attention patterns to faces systematically varying in their attentional states. Together, these findings suggest that infants develop early, specialized functional conspecific face detection.     

The role of motion and speech in face recognition at birth

Newborns, a few hours after birth, already encounter many different faces, talking or silently moving. How do they process these faces and which cues are important in early face recognition? In a series of six experiments, newborns were familiarized with an unfamiliar face in different contexts (photographs, talking, silently moving, and with only external movements of the head with speech sound). At test, they saw the familiar and a new faces either in photographs, silently moving, or talking. A novelty preference was evidenced at test when photographs were presented in the two phases. This result supports those already evidenced in several studies. A familiarity preference appeared only when the face was seen talking in the familiarization phase and in a photograph or talking again at test. This suggests that the simultaneous presence of speech sound, and rigid and nonrigid movements present in a talking face enhances recognition of interactive faces at birth.     

When the smile is a cue to familiarity

The question discussed in the two following experiments concerns the effect of facial expressions on face recognition. Famous and unknown faces with neutral or smiling expression were presented for different inspection durations (15 ms vs 1000 ms). Subjects had to categorize these faces as famous or unknown (Experiment 1), or estimate their degree of familiarity on a rating scale (Experiment 2). Results showed that the smile increased ratings of familiarity for unfamiliar faces (Experiments 1 and 2) and for famous faces (Experiment 2). These data are discussed in the framework of current face-recognition models and are interpreted in terms of social value of the smile. It is proposed that the smiling bias found here acts at the level of the decision process.     

When the smile is a cue to familiarity

The question discussed in the two following experiments concerns the effect of facial expressions on face recognition. Famous and unknown faces with neutral or smiling expression were presented for different inspection durations (15 ms vs 1000 ms). Subjects had to categorise these faces as famous or unknown (Experiment 1), or estimate their degree of familiarity on a rating scale (Experiment 2). Results showed that the smile increased ratings of familiarity for unfamiliar faces (Experiments 1 and 2) and for famous faces (Experiment 2). These data are discussed in the framework of current face-recognition models and are interpreted in terms of social value of the smile. It is proposed that the smiling bias found here acts at the level of the decision process.     

Infant face interest is associated with voice information and maternal psychological health

Early infant interest in their mother's face is driven by an experience based face processing system, and is associated with maternal psychological health, even within a non clinical community sample. The present study examined the role of the voice in eliciting infants’ interest in mother and stranger faces and in the association between infant face interest and maternal psychological health.Infants aged 3.5-months were shown photographs of their mother's and a stranger's face paired with an audio recording of their mother's and a stranger's voice that was either matched (e.g., mother's face and voice) or mismatched (e.g., mother's face and stranger's voice). Infants spent more time attending to the stranger's matched face and voice than the mother's matched face and voice and the mismatched faces and voices. Thus, infants demonstrated an earlier preference for a stranger's face when given voice information than when the face is presented alone. In the present sample, maternal psychological health varied with 56.7% of mothers reporting mild mood symptoms (depression, anxiety or stress response to childbirth). Infants of mothers with significant mild maternal mood symptoms looked longer at the faces and voices compared to infants of mothers who did not report mild maternal mood symptoms. In sum, infants’ experience based face processing system is sensitive to their mothers’ maternal psychological health and the multimodal nature of faces.     

Representation of the gender of human faces by infants: a preference for female

Six experiments based on visual preference procedures were conducted to examine gender categorization of female versus male faces by infants aged 3 to 4 months. In experiment 1, infants familiarized with male faces preferred a female face over a novel male face, but infants familiarized with female faces divided their attention between a male face and a novel female face. Experiment 2 demonstrated that these asymmetrical categorization results were likely due to a spontaneous preference for females. Experiments 3 and 4 showed that the preference for females was based on processing of the internal facial features in their upright orientation, and not the result of external hair cues or higher-contrast internal facial features. While experiments 1 through 4 were conducted with infants reared with female primary caregivers, experiment 5 provided evidence that infants reared with male primary caregivers tend to show a spontaneous preference for males. Experiment 6 showed that infants reared with female primary caregivers displayed recognition memory for individual females, but not males. These results suggest that representation of information about human faces by young infants may be influenced by the gender of the primary caregiver.     

Face processing in humans and new world monkeys: the influence of experiential and ecological factors

This study tests whether the face-processing system of humans and a nonhuman primate species share characteristics that would allow for early and quick processing of socially salient stimuli: a sensitivity toward conspecific faces, a sensitivity toward highly practiced face stimuli, and an ability to generalize changes in the face that do not suggest a new identity, such as a face differently oriented. The look rates by adult tamarins and humans toward conspecific and other primate faces were examined to determine if these characteristics are shared. A visual paired comparison (VPC) task presented subjects with either a human face, chimpanzee face, tamarin face, or an object as a sample, and then a pair containing the previous stimulus and a novel stimulus was presented. The stimuli were either presented all in an upright orientation, or all in an inverted orientation. The novel stimulus in the pair was either an orientation change of the same face/object or a new example of the same type of face/object, and the stimuli were shown either in an upright orientation or in an inverted orientation. Preference to novelty scores revealed that humans attended most to novel individual human faces, and this effect decreased significantly if the stimuli were inverted. Tamarins showed preferential looking toward novel orientations of previously seen tamarin faces in the upright orientation, but not in an inverted orientation. Similarly, their preference to look longer at novel tamarin and human faces within the pair was reduced significantly with inverted stimuli. The results confirmed prior findings in humans that novel human faces generate more attention in the upright than in the inverted orientation. The monkeys also attended more to faces of conspecifics, but showed an inversion effect to orientation change in tamarin faces and to identity changes in tamarin and human faces. The results indicate configural processing restricted to particular kinds of primate faces by a New World monkey species, with configural processing influenced by life experience (human faces and tamarin faces) and specialized to process orientation changes specific to conspecific faces.     

Perceptual asymmetries in left- and right-handers for cartoon and real faces

We examined 40 left-handers and 40 right-handers on two free-vision tests of face processing. A chimeric face composed of a smiling half-face joined to either a neutral half-face (real faces) or a sad half-face (cartoon faces) and its mirror image were presented on each trial. Subjects judged which chimeric face looked happier, the one with the smile to the left or the one with the smile to the right. Right-handers, but not left-handers, had a highly significant leftward attentional bias, since chimeras with the smile to the left were judged happier than those with the smile to the right. The cartoon- and real-face tasks did not differ in the mean perceptual asymmetries they elicited. However, correlations between attentional-asymmetry scores for the two tasks, although high for both left- and right-handers, were significantly smaller than task reliabilities. Thus, the cartoon- and real-face tasks overlap to a major extent in the lateralized processes they measure, but to a lesser extent, they also index different lateralized processes.     

Revisiting the perception of upside-down faces

In two experiments, the effect of orientation on face perception was assessed. Using a scale from 1 ( normal ) to 7 ( bizarre ), participants rated normal, unaltered faces and faces in which changes had been made to spatial-relational properties (eyes and mouth inverted or relative position of the eyes and mouth altered) or to component properties (eyes whitened and teeth blackened). For unaltered and component-distortion faces, bizarreness ratings increased linearly as orientation increased from 0° to 180°. For spatial-distortion faces, a discontinuity in the function relating orientation and bizarreness was in evidence between 90° and 120°. The results provide support for the view that there is a qualitative difference in the processing of upright and inverted faces due to the disproportionate effect of inversion on the encoding of spatial-relational information.     

Discrimination of faces and houses by rhesus monkeys: the role of stimulus expertise and rotation angle

The face inversion effect, or impaired recognition of upside down compared to upright faces, is used as a marker for the configural processing of faces in primates. The inversion effect in humans and chimpanzees is strongest for categories of stimuli for which subjects have considerable expertise, primarily conspecifics’ faces. Moreover, discrimination performance decreases linearly as faces are incrementally rotated from upright to inverted. This suggests that rotated faces must be transformed, or normalized back into their most typical viewpoint before configural processing can ensue, and the greater the required normalization, the greater the likelihood of errors resulting. Previous studies in our lab have demonstrated a general face inversion effect in rhesus monkeys that was not influenced by expertise. Therefore, the present study examined the influence of rotation angle on the visual perception of face and nonface stimuli that varied in their level of expertise to further delineate the processes underlying the inversion effect in rhesus monkeys. Five subjects discriminated images in five orientation angles. Results showed significant linear impairments for all stimulus categories, including houses. However, compared to the upright images, only rhesus faces resulted in worse performance at rotation angles greater than 45°, suggesting stronger configural processing for stimuli for which subjects had the greatest expertise.