Development of the other-race effect during infancy: Evidence toward universality?

The other-race effect in face processing develops within the first year of life in Caucasian infants. It is currently unknown whether the developmental trajectory observed in Caucasian infants can be extended to other cultures. This is an important issue to investigate because recent findings from cross-cultural psychology have suggested that individuals from Eastern and Western backgrounds tend to perceive the world in fundamentally different ways. To this end, the current study investigated 3-, 6-, and 9-month-old Chinese infants’ ability to discriminate faces within their own racial group and within two other racial groups (African and Caucasian). The 3-month-olds demonstrated recognition in all conditions, whereas the 6-month-olds recognized Chinese faces and displayed marginal recognition for Caucasian faces but did not recognize African faces. The 9-month-olds’ recognition was limited to Chinese faces. This pattern of development is consistent with the perceptual narrowing hypothesis that our perceptual systems are shaped by experience to be optimally sensitive to stimuli most commonly encountered in one’s unique cultural environment.     

Face processing in humans and new world monkeys: the influence of experiential and ecological factors

This study tests whether the face-processing system of humans and a nonhuman primate species share characteristics that would allow for early and quick processing of socially salient stimuli: a sensitivity toward conspecific faces, a sensitivity toward highly practiced face stimuli, and an ability to generalize changes in the face that do not suggest a new identity, such as a face differently oriented. The look rates by adult tamarins and humans toward conspecific and other primate faces were examined to determine if these characteristics are shared. A visual paired comparison (VPC) task presented subjects with either a human face, chimpanzee face, tamarin face, or an object as a sample, and then a pair containing the previous stimulus and a novel stimulus was presented. The stimuli were either presented all in an upright orientation, or all in an inverted orientation. The novel stimulus in the pair was either an orientation change of the same face/object or a new example of the same type of face/object, and the stimuli were shown either in an upright orientation or in an inverted orientation. Preference to novelty scores revealed that humans attended most to novel individual human faces, and this effect decreased significantly if the stimuli were inverted. Tamarins showed preferential looking toward novel orientations of previously seen tamarin faces in the upright orientation, but not in an inverted orientation. Similarly, their preference to look longer at novel tamarin and human faces within the pair was reduced significantly with inverted stimuli. The results confirmed prior findings in humans that novel human faces generate more attention in the upright than in the inverted orientation. The monkeys also attended more to faces of conspecifics, but showed an inversion effect to orientation change in tamarin faces and to identity changes in tamarin and human faces. The results indicate configural processing restricted to particular kinds of primate faces by a New World monkey species, with configural processing influenced by life experience (human faces and tamarin faces) and specialized to process orientation changes specific to conspecific faces.     

The development of expert face processing: are infants sensitive to normal differences in second-order relational information?

Sensitivity to second-order relational information (i.e., spatial relations among features such as the distance between eyes) is a vital part of achieving expertise with face processing. Prior research is unclear on whether infants are sensitive to second-order differences seen in typical human populations. In the current experiments, we examined whether infants are sensitive to changes in the space between the eyes and between the nose and the mouth that are within the normal range of variability in Caucasian female faces. In Experiment 1, 7-month-olds detected these changes in second-order relational information. Experiment 2 extended this finding to 5-month-olds and also found that infants detect second-order relations in upright faces but not in inverted faces, thereby exhibiting an inversion effect that has been considered to be a hallmark of second-order relational processing during adulthood. These results suggest that infants as young as 5 months are sensitive to second-order relational changes that are within the normal range of human variability. They also indicate that at least rudimentary aspects of face processing expertise are available early in life.     

Multiple perceptual strategies used by macaque monkeys for face recognition

Successful integration of individuals in macaque societies suggests that monkeys use fast and efficient perceptual mechanisms to discriminate between conspecifics. Humans and great apes use primarily holistic and configural, but also feature-based, processing for face recognition. The relative contribution of these processes to face recognition in monkeys is not known. We measured face recognition in three monkeys performing a visual paired comparison task. Monkey and humans faces were (1) axially rotated, (2) inverted, (3) high-pass filtered, and (4) low-pass filtered to isolate different face processing strategies. The amount of time spent looking at the eyes, mouth, and other facial features was compared across monkey and human faces for each type of stimulus manipulation. For all monkeys, face recognition, expressed as novelty preference, was intact for monkey faces that were axially rotated or spatially filtered and was supported in general by preferential looking at the eyes, but was impaired for inverted faces in two of the three monkeys. Axially rotated, upright human faces with a full range of spatial frequencies were also recognized, however, the distribution of time spent exploring each facial feature was significantly different compared to monkey faces. No novelty preference, and hence no inferred recognition, was observed for inverted or low-pass filtered human faces. High-pass filtered human faces were recognized, however, the looking pattern on facial features deviated from the pattern observed for monkey faces. Taken together these results indicate large differences in recognition success and in perceptual strategies used by monkeys to recognize humans versus conspecifics. Monkeys use both second-order configural and feature-based processing to recognize the faces of conspecifics, but they use primarily feature-based strategies to recognize human faces.     

Perceptual narrowing in face- and speech-perception domains in infancy: A longitudinal approach

During the first year of life, infants undergo a process known as perceptual narrowing, which reduces their sensitivity to classes of stimuli which the infants do not encounter in their environment. It has been proposed that perceptual narrowing for faces and speech may be driven by shared domain-general processes. To investigate this theory, our study longitudinally tested 50 German Caucasian infants with respect to these domains first at 6 months of age followed by a second testing at 9 months of age. We used an infant-controlled habituation-dishabituation paradigm to test the infants’ ability to discriminate among other-race Asian faces and non-native Cantonese speech tones, as well as same-race Caucasian faces as a control. We found that while at 6 months of age infants could discriminate among all stimuli, by 9 months of age they could no longer discriminate among other-race faces or non-native tones. However, infants could discriminate among same-race stimuli both at 6 and at 9 months of age. These results demonstrate that the same infants undergo perceptual narrowing for both other-race faces and non-native speech tones between the ages of 6 and 9 months. This parallel development of perceptual narrowing occurring in both the face and speech perception modalities over the same period of time lends support to the domain-general theory of perceptual narrowing in face and speech perception.     

The inversion effect in infancy: the role of internal and external features

The present work examined the changing role of inner and outer facial features in the recognition of upright and inverted faces in 5-, 7-, and 9-month-olds. Study 1 established that the “inversion effect” (impaired recognition of an inverted face) was present in infants as young as 5 months. In Study 2, internal and external features were inverted separately. Disrupting the internal configuration by inversion impaired recognition at all ages; disrupting the external configuration impaired recognition only at 5-months. In Study 3, an upright familiar face was paired with one having either novel internal or novel external features. The results confirmed that the 5-month-olds used only the external features to recognize faces, whereas older infants were as adept at using internal features as external ones. These findings suggest a shift, after 5 months, away from dependence on external features for face recognition and toward greater reliance on internal ones.     

Internal feature saliency as a marker of familiarity and configural processing

Two experiments that explore the internal feature advantage (IFA) in familiar face processing are reported. The IFA involves more efficient processing of internal features for familiar faces over unfamiliar ones. Experiment 1 examined the possibility of a configural basis for this effect through use of a matching task for familiar and unfamiliar faces presented both upright and upside-down. Results revealed the predicted IFA for familiar faces when stimuli were upright, but this was removed when stimuli were inverted. Experiment 2 examined the degree of training required before the IFA was demonstrated. Latency results revealed that whilst 90–180 s of exposure was sufficient to generate an IFA of intermediate magnitude, 180–270 s of exposure was required before the IFA was equivalent to that demonstrated for a familiar face. Taken together, these results offer three conclusions: First, the IFA is reaffirmed as an objective indicator of familiarity; second, the IFA is seen to rest on configural processing; and finally, the development of the IFA with familiarity indicates a development of configural processing with familiarity. As such, insight is gained as to the type of processing changes that occur as familiarity is gradually acquired.     

Perceptual integrality of componential and configural information in faces

The relative contribution of componential and configural information to face perception is controversial. We addressed this issue in the present study by examining how componential information and configural information interact during face processing, using Garner’s (1974) speeded classification paradigm. When classifying upright faces varying in components (eyes, nose, and mouth) and configural information (intereyes and nose-mouth spacing), observers could not selectively attend to components without being influenced by irrelevant variation in configural information, and vice versa, indicating that componential information and configural information are integral in upright face processing. Performance with inverted faces showed selective attention to components but not to configural information, implying dominance of componential information in processing inverted faces. When faces varied only in components, selective attention to different components was observed in upright and inverted faces, indicating that facial components are perceptually separable. These results provide strong evidence that integrality of componential and configural information, rather than the relative dominance of either, is the hallmark of upright face perception.     

Perceptual biases in processing facial identity and emotion

Normal observers demonstrate a bias to process the left sides of faces during perceptual judgments about identity or emotion. This effect suggests a right cerebral hemisphere processing bias. To test the role of the right hemisphere and the involvement of configural processing underlying this effect, young and older control observers and patients with right hemisphere damage completed two chimeric faces tasks (emotion judgment and face identity matching) with both upright and inverted faces. For control observers, the emotion judgment task elicited a strong left-sided perceptual bias that was reduced in young controls and eliminated in older controls by face inversion. Right hemisphere damage reversed the bias, suggesting the right hemisphere was dominant for this task, but that the left hemisphere could be flexibly recruited when right hemisphere mechanisms are not available or dominant. In contrast, face identity judgments were associated most clearly with a vertical bias favouring the uppermost stimuli that was eliminated by face inversion and right hemisphere lesions. The results suggest these tasks involve different neurocognitive mechanisms. The role of the right hemisphere and ventral cortical stream involvement with configural processes in face processing is discussed.     

Discrimination of faces and houses by rhesus monkeys: the role of stimulus expertise and rotation angle

The face inversion effect, or impaired recognition of upside down compared to upright faces, is used as a marker for the configural processing of faces in primates. The inversion effect in humans and chimpanzees is strongest for categories of stimuli for which subjects have considerable expertise, primarily conspecifics’ faces. Moreover, discrimination performance decreases linearly as faces are incrementally rotated from upright to inverted. This suggests that rotated faces must be transformed, or normalized back into their most typical viewpoint before configural processing can ensue, and the greater the required normalization, the greater the likelihood of errors resulting. Previous studies in our lab have demonstrated a general face inversion effect in rhesus monkeys that was not influenced by expertise. Therefore, the present study examined the influence of rotation angle on the visual perception of face and nonface stimuli that varied in their level of expertise to further delineate the processes underlying the inversion effect in rhesus monkeys. Five subjects discriminated images in five orientation angles. Results showed significant linear impairments for all stimulus categories, including houses. However, compared to the upright images, only rhesus faces resulted in worse performance at rotation angles greater than 45°, suggesting stronger configural processing for stimuli for which subjects had the greatest expertise.     

The face inversion effect—Parts and wholes: Individual features and their configuration

The face inversion effect (FIE) is a reduction in recognition performance for inverted faces (compared to upright faces) that is greater than that typically observed with other stimulus types (e.g., houses). The work of Diamond and Carey, suggests that a special type of configural information, “second-order relational information” is critical in generating this inversion effect. However, Tanaka and Farah concluded that greater reliance on second-order relational information did not directly result in greater sensitivity to inversion, and they suggested that the FIE is not entirely due to a reliance on this type of configural information. A more recent review by McKone and Yovel provides a meta-analysis that makes a similar point. In this paper, we investigated the contributions made by configural and featural information to the FIE. Experiments 1a and1b investigated the link between configural information and the FIE. Remarkably, Experiment 1b showed that disruption of all configural information of the type considered in Diamond and Carey's analysis (both first and second order) was effective in reducing recognition performance, but did not significantly impact on the FIE. Experiments 2 and 3 revealed that face processing is affected by the orientation of individual features and that this plays a major role in producing the FIE. The FIE was only completely eliminated when we disrupted the single feature orientation information in addition to the configural information, by using a new type of transformation similar to Thatcherizing our sets of scrambled faces. We conclude by noting that our results for scrambled faces are consistent with an account that has recognition performance entirely determined by the proportion of upright facial features within a stimulus, and that any ability to make use of the spatial configuration of these features seems to benefit upright and inverted normal faces alike.     

Is the inversion effect in rhesus monkeys face-specific?

This study investigated the face inversion effect in rhesus monkeys (Macaca mulatta). Face stimuli consisted of ten black-and-white examples of unfamiliar rhesus monkey faces, brown capuchin faces, and human faces. Two non-face categories included ten examples of automobiles and abstract shapes. All stimuli were presented in a sequential matching-to-sample format using an automated joystick-testing paradigm. Subjects performed significantly better on upright than on inverted presentations of automobiles, rhesus monkey and capuchin faces, but not human faces or abstract shapes. These results are inconsistent with data from humans and chimpanzees that show the inversion effect only for categories of stimuli for which subjects have developed expertise. The inversion effect in rhesus monkeys does not appear to be face-specific, and should therefore not be used as a marker of specialized face processing in this species. Received: 18 November 1998 / Accepted after revision: 9 May 1999     

A unique look at face processing: the impact of masked faces on the processing of facial features

This experiment utilized a masked priming paradigm to explore the early processes involved in face recognition. The first experiment investigated implicit processing of the eyes and mouth in an upright face, using prime durations of 33 and 50 ms. The results demonstrate implicit processing of both the eyes and mouth, and support the configural processing theory of face processing. The second experiment used the same method with inverted faces and the third experiment was a combination of Experiments 1 and 2. The fourth experiment utilized misaligned faces as the primes. Based on the pattern of results from these experiments, we suggest that, when a face is inverted, the eyes and mouth are initially processed individually and are not linked until a later stage of processing. An upright face is proposed to be processed by analysis of its configuration, whereas an inverted face is initially processed using first-order relational information, and then converted to an upright representation and transferred to face specific regions for configural analysis.     

The development of perceptual sensitivity to second-order facial relations in children

This study investigated children’s perceptual ability to process second-order facial relations. In total, 78 children in three age groups (7, 9, and 11 years) and 28 adults were asked to say whether the eyes were the same distance apart in two side-by-side faces. The two faces were similar on all points except the space between the eyes, which was either the same or different, with various degrees of difference. The results showed that the smallest eye spacing children were able to discriminate decreased with age. This ability was sensitive to face orientation (upright or upside-down), and this inversion effect increased with age. It is concluded here that, despite early sensitivity to configural/holistic information, the perceptual ability to process second-order relations in faces improves with age and constrains the development of the face recognition ability.     

Categorical perception of face identity in noise isolates configural processing.

Neuropsychological evidence suggests that face recognition based on configural (holistic) information can occur in isolation from recognition based on local feature cues. The present study shows that configural processing can be isolated experimentally in normal subjects. A phenomenon is reported that exists only for upright whole faces, namely categorical perception (CP) of face identity in noise. Three discrimination tasks (ABX, better likeness, and similarity ratings) were used to test for perceptual distortion across the category boundary predicted from binary classification of face morphs. Noise was added such that any single local region provided unreliable cues to identity. Under these conditions, CP was found for upright faces but not for inverted faces or single features, even with more than 10,000 trials. The CP-in-noise signature phenomenon was then used to show that configural processing survives image plane rotations of 45 degrees-90 degrees.     

The effect of inversion on the encoding of normal and “thatcherized” faces

In the “Thatcher illusion” a face, in which the eyes and mouth are inverted relative to the rest of the face, looks grotesque when shown upright but not when inverted. In four experiments we investigated the contribution of local and global processing to this illusion in normal observers. We examined inversion effects (i.e., better performance for upright than for inverted faces) in a task requiring discrimination of whether faces were or were not “thatcherized”. Observers made same/different judgements to isolated face parts (Experiments 1-2) and to whole faces (Experiments 3-4). Face pairs had the same or different identity, allowing for different process- ing strategies using feature-based or configural information, respectively. In Experiment 1, feature-based matching of same-person face parts yielded only a small inversion effect for normal face parts. However, when feature-based matching was prevented by using the face parts of different people on all trials (Experiment 2) an inversion effect occurred for normal but not for thatcherized parts. In Experiments 3 and 4, inversion effects occurred with normal but not with thatcherized whole faces, on both same- and different-person matching tasks. This suggests that a common configural strategy was used with whole (normal) faces. Face context facilitated attention to misoriented parts in same-person but not in different-person matching. The results indicate that (1) face inversion disrupts local configural processing, but not the processing of image features, and (2) thatcherization disrupts local configural processing in upright faces.     

Development of body emotion perception in infancy: From discrimination to recognition

Research suggests that infants progress from discrimination to recognition of emotions in faces during the first half year of life. It is unknown whether the perception of emotions from bodies develops in a similar manner. In the current study, when presented with happy and angry body videos and voices, 5-month-olds looked longer at the matching video when they were presented upright but not when they were inverted. In contrast, 3.5-month-olds failed to match even with upright videos. Thus, 5-month-olds but not 3.5-month-olds exhibited evidence of recognition of emotions from bodies by demonstrating intermodal matching. In a subsequent experiment, younger infants did discriminate between body emotion videos but failed to exhibit an inversion effect, suggesting that discrimination may be based on low-level stimulus features. These results document a developmental change from discrimination based on non-emotional information at 3.5 months to recognition of body emotions at 5 months. This pattern of development is similar to face emotion knowledge development and suggests that both the face and body emotion perception systems develop rapidly during the first half year of life.     

Emotional context at learning systematically biases memory for facial information

Emotion influences memory in many ways. For example, when a mood-dependent processing shift is operative, happy moods promote global processing and sad moods direct attention to local features of complex visual stimuli. We hypothesized that an emotional context associated with to-be-learned facial stimuli could preferentially promote global or local processing. At learning, faces with neutral expressions were paired with a narrative providing either a happy or a sad context. At test, faces were presented in an upright or inverted orientation, emphasizing configural or analytical processing, respectively. A recognition advantage was found for upright faces learned in happy contexts relative to those in sad contexts, whereas recognition was better for inverted faces learned in sad contexts than for those in happy contexts. We thus infer that a positive emotional context prompted more effective storage of holistic, configural, or global facial information, whereas a negative emotional context prompted relatively more effective storage of local or feature-based facial information     

Beyond U-Shaped Development in Infants' Processing of Faces: An Information-Processing Account

The development of the "inversion" effect in face processing was examined in infants 3 to 6 months of age by testing their integration of the internal and external features of upright and inverted faces using a variation of the "switch" visual habituation paradigm. When combined with previous findings showing that 7-month-olds use integrative processing of an upright face, but featural processing of an inverted face (Cohen & Cashon, 2001a), the present findings suggest that from 3 to 7 months, infants' ability to integrate facial features follows an N-shaped developmental pattern for upright faces and an inverted U-shaped pattern for inverted faces. We discuss these results in terms of a set of domain-general information-processing principles.     

The recognition and categorization of upright and inverted emotional expressions by 7-month-old infants

Upright and inverted faces were used to determine whether 7-month-old infants discriminate emotional expressions on the basis of affectively relevant information. In Experiment 1, infants recognized the similarity of happy faces over changing identities and discriminated this expression from fear and anger when the stimuli were presented upright, but not when they were inverted. In Experiment 2, infants were able to discriminate happiness from fear and anger posed by a single model, regardless of the orientation of the stimuli. From these studies it was suggested that categorizing emotional expressions depends upon attending to affectively relevant, orientation-specific information, whereas the discrimination of emotional expressions can be done on a featural basis, something that remains invariant regardless of the orientation of the stimuli. In Experiment 3, infants discriminated toothy happiness posed by several models from nontoothy happiness and nontoothy anger when the stimuli were presented upright and inverted. Thus, when salient features were available, the infants based their discriminations on perceptual aspects rather than on conceptual aspects such as categories of emotions.