Race categorization modulates holistic face encoding

Recent studies have shown that same-race (SR) faces are processed more holistically than other-race (OR) faces, a difference that may underlie the greater difficulty at recognizing OR than SR faces (the "other-race effect"). This article provides original evidence suggesting that the holistic processing of faces may be sensitive to the observers' racial categorization of the face. In Experiment 1, Caucasian participants performed a face-composite task with Caucasian faces, Asian faces, and racially ambiguous morphed face stimuli. Identical morphed face stimuli were processed more holistically when categorized as SR than as OR faces. Experiment 2 further suggests that this finding was not underlain by strategic or training effects. Overall, these results support the view that one's categorization of a face as belonging to the same or another race plays a critical role in the holistic processing of this face.     

面孔加工的结构编码阶段异族效应的加工方式： ERPs研究

实验采用事件相关电位（ERPs）技术,以大学生为被试,运用非洲、欧洲、亚洲三个不同种族的面孔照片,探究异族效应与加工方式的关系。行为实验结果显示,被试对非洲面孔的反应时快于欧洲面孔,且两者均快于亚洲面孔。ERP研究结果显示,亚洲面孔的N170波幅显著小于非洲和欧洲面孔的波幅,后两者的N170波幅没有差异,而且亚洲面孔的倒置效应最大。研究结果说明相对于异族面孔,本族面孔更多地使用构型编码的加工方式,且N170成分表现出右半球优势。     

Socio-cognitive,expertise-based and appearance-based accounts of the other-‘race’ effect in face perception: A label-based systematic review of neuroimaging results

Two competing theories explain the other-‘race’ effect (ORE) either by greater perceptual expertise to same-‘race’ (SR) faces or by social categorization of other-‘race’ (OR) faces at the expense of individuation. To assess expertise and categorization contributions to the ORE, a promising—yet overlooked—approach is comparing activations for different other-‘races’. We present a label-based systematic review of neuroimaging studies reporting increased activity in response to OR faces (African, Caucasian, or Asian) when compared with the SR of participants. Hypothetically, while common activations would reflect general aspects of OR perception, ‘race’-preferential ones would represent effects of ‘race’-specific visual appearance. We find that several studies report activation of occipito-temporal and midcingulate areas in response to faces across different other-‘races’, presumably due to high demand on the visual system and category processing. Another area reported in response to all OR faces, the caudate nucleus, suggests the involvement of socio-affective processes and behavioural regulation. Overall, our results support hybrid models—both expertise and social categorization contribute to the ORE, but they provide little evidence for reduced motivation to process OR faces. Additionally, we identify areas preferentially responding to specific OR faces, reflecting effects of visual appearance.     

Categorization,categorical perception,and asymmetry in infants’ representation of face race

The present study examined whether 6‐ and 9‐month‐old Caucasian infants could categorize faces according to race. In Experiment 1, infants were familiarized with different female faces from a common ethnic background (i.e. either Caucasian or Asian) and then tested with female faces from a novel race category. Nine‐month‐olds were able to form discrete categories of Caucasian and Asian faces. However, 6‐month‐olds did not form discrete categories of faces based on race. In Experiment 2, a second group of 6‐ and 9‐month‐olds was tested to determine whether they could discriminate between different faces from the same race category. Results showed that both age groups could only discriminate between different faces from the own‐race category of Caucasian faces. The findings of the two experiments taken together suggest that 9‐month‐olds formed a category of Caucasian faces that are further differentiated at the individual level. In contrast, although they could form a category of Asian faces, they could not discriminate between such other‐race faces. This asymmetry in category formation at 9 months (i.e. categorization of own‐race faces vs. categorical perception of other‐race faces) suggests that differential experience with own‐ and other‐race faces plays an important role in infants’ acquisition of face processing abilities.     

Holistic processing is finely tuned for faces of one's own race

Recognizing individual faces outside one's race poses difficulty, a phenomenon known as the other-race effect. Most researchers agree that this effect results from differential experience with same-race (SR) and other-race (OR) faces. However, the specific processes that develop with visual experience and underlie the other-race effect remain to be clarified. We tested whether the integration of facial features into a whole representation-holistic processing-was larger for SR than OR faces in Caucasians and Asians without life experience with OR faces. For both classes of participants, recognition of the upper half of a composite-face stimulus was more disrupted by the bottom half (the composite-face effect) for SR than OR faces, demonstrating that SR faces are processed more holistically than OR faces. This differential holistic processing for faces of different races, probably a by-product of visual experience, may be a critical factor in the other-race effect.     

Individuation experience predicts other-race effects in holistic processing for both Caucasian and Black participants

Same-race (SR) faces are recognized better than other-race (OR) faces, and this other-race effect (ORE) is correlated with experience. SR faces are also processed more holistically than OR faces, suggesting one possible mechanism for poorer performance on OR faces. Studies of object expertise have shown that individuating experiences are necessary for holistic processing to develop; yet thus far no studies have investigated the role of quality of experience and the ORE for holistic processing. In the present study, we found a strong negative correlation between a self-report of individuating experience and the ORE in holistic processing in both Caucasian and Black participants, indicating that the more individuating experience a person has, the less ORE in holistic processing. This confirms the critical role of individuating experience in development of holistic processing for faces and suggests that quality of experience is a key determinant of the manner in which OR faces are processed.     

The neural plasticity of other-race face recognition

Although it is well established that people are better at recognizing own-race faces than at recognizing other-race faces, the neural mechanisms mediating this advantage are not well understood. In this study, Caucasian participants were trained to differentiate African American (or Hispanic) faces at the individual level (e.g., Joe, Bob) and to categorize Hispanic (or African American) faces at the basic level of race (e.g., Hispanic, African American). Behaviorally, subordinate-level individuation training led to improved performance on a posttraining recognition test, relative to basic-level training. As measured by event-related potentials, subordinate- and basic-level training had relatively little effect on the face N170 component. However, as compared with basic-level training, subordinate-level training elicited an increased response in the posterior expert N250 component. These results demonstrate that learning to discriminate other-race faces at the subordinate level of the individual leads to improved recognition and enhanced activation of the expert N250 component.     

Expertise training with novel objects leads to left-lateralized facelike electrophysiological responses

Scalp event-related potentials (ERPs) in humans indicate that face and object processing differ approximately 170 ms following stimulus presentation, at the point of the N170 occipitotemporal component. The N170 is delayed and enhanced to inverted faces but not to inverted objects. We tested whether this inversion effect reflects early mechanisms exclusive to faces or whether it generalizes to other stimuli as a function of visual expertise. ERPs to upright and inverted faces and novel objects (Greebles) were recorded in 10 participants before and after 2 weeks of expertise training with Greebles. The N170 component was observed for both faces and Greebles. The results are consistent with previous reports in that the N170 was delayed and enhanced for inverted faces at recording sites in both hemispheres. For Greebles, the same effect of inversion was observed only for experts, primarily in the left hemisphere. These results suggest that the mechanisms underlying the electrophysiological face-inversion effect extend to visually homogeneous nonface object categories, at least in the left hemisphere, but only when such mechanisms are recruited by expertise.     

Deficits in early-stage face perception in excessive internet users

Excessive Internet use is associated with a limited ability to communicate effectively socially, which depends largely on the capacity for perception of the human face. We used a passive visual detection paradigm to compare the early stages of the processing of face-related information in young excessive Internet users (EIUs) and healthy normal subjects by analyzing event-related potentials (ERPs) elicited by faces and by nonface stimuli (tables), each presented in the upright and inverted position. The P1 and N170 components of the spectrum of ERPs elicited at occipital-temporal sites by the viewing of faces were larger and peaked sooner than the same ERP components elicited by tables, and inverted faces significantly enhanced and delayed the N170 component. EIUs had a generally smaller P1 component than did normal subjects, whether elicited by faces or by tables, and the N170 effect, or difference in amplitude of the N170 component for faces versus tables, was significantly smaller in the EIUs than in normal subjects. However, the N170 inversion effect, or difference in amplitude of the N170 component elicited by upright versus inverted faces, was similar in the EIUs and normal subjects. These data indicate that EIUs have deficits in the early stage of face-perception processing but may have intact holistic/configural processing of faces. Whether some deeper processes of face perception, such as face memory and face identification, are affected in EIUs needs to be investigated further with more specific procedures.     

Processes underlying the cross-race effect: an investigation of holistic, featural, and relational processing of own-race versus other-race faces

Adults are often better at recognising own-race than other-race faces. Unlike previous studies that reported an own-race advantage after administering a single test of either holistic processing or of featural and relational processing, we used a cross-over design and multiple tasks to assess differential processing of faces from a familiar race versus a less familiar race. Caucasian and Chinese adults performed four tasks, each with Caucasian and Chinese faces. Two tasks measured holistic processing: the composite face task and the part/whole task. Both tasks indicated holistic processing of own-race and other-race faces that did not differ in degree. Two tasks measured featural and relational processing: the Jane/Ling task, in which same/ different judgments were made about face pairs that differed in features of their spacing, and the scrambled/blurred task, in which test faces were scrambled (isolates memory for components) or blurred (isolates memory for relations). Both tasks provided evidence of an own-race advantage in both featural and relational processing. We conclude that even when adults process other-race faces holistically, other manifestations of an own-race advantage remain.     

Holistic face encoding is modulated by perceived face race: Evidence from perceptual adaptation

Human expertise at processing faces relies on how facial features are encoded: as a whole template rather than as a sum of independent features. This holistic encoding is less prominent for other-race faces, possibly accounting for the difficulty one encounters in recognizing these faces (the ‘other-race effect’). Here, we tested the hypothesis that the magnitude of holistic face encoding can be modulated by racial categorization of the face. Caucasian participants performed a face-composite task with ‘racially-ambiguous’ face-stimuli (cross-race morphed faces, equally categorized as Asian or Caucasian faces in an independent task). The perceived race of the ambiguous faces was manipulated using adaptation. Experiment 1 showed that identical morphed face-stimuli were processed more holistically when perceived as ‘same-race’ than as ‘other-race’, i.e., following adaptation to ‘other-race’ versus ‘same-race’, respectively. Experiment 2 ascertained that the determining factor in the observed holistic processing modulation was the race of the racially-ambiguous face as perceived, rather than expected, by the participants, which supports the idea that the holistic processing of the face-stimuli was modulated by their race-categorization at the perceptual level.     

Domain specificity versus expertise: factors influencing distinct processing of faces

To explore face specificity in visual processing, we compared the role of task-associated strategies and expertise on the N170 event-related potential (ERP) component elicited by human faces with the ERPs elicited by cars, birds, items of furniture, and ape faces. In Experiment 1, participants performed a car monitoring task and an animacy decision task. In Experiment 2, participants monitored human faces while faces of apes were the distracters. Faces elicited an equally conspicuous N170, significantly larger than the ERPs elicited by non-face categories regardless of whether they were ignored or had an equal status with other categories (Experiment 1), or were the targets (in Experiment 2). In contrast, the negative component elicited by cars during the same time range was larger if they were targets than if they were not. Furthermore, unlike the posterior-temporal distribution of the N170, the negative component elicited by cars and its modulation by task were more conspicuous at occipital sites. Faces of apes elicited an N170 that was similar in amplitude to that elicited by the human face targets, albeit peaking 10 ms later. As our participants were not ape experts, this pattern indicates that the N170 is face-specific, but not specie-specific, i.e. it is elicited by particular face features regardless of expertise. Overall, these results demonstrate the domain specificity of the visual mechanism implicated in processing faces, a mechanism which is not influenced by either task or expertise. The processing of other objects is probably accomplished by a more general visual processor, which is sensitive to strategic manipulations and attention.     

Building biases in infancy: the influence of race on face and voice emotion matching

Early in the first year of life infants exhibit equivalent performance distinguishing among people within their own race and within other races. However, with development and experience, their face recognition skills become tuned to groups of people they interact with the most. This developmental tuning is hypothesized to be the origin of adult face processing biases including the other-race bias. In adults the other-race bias has also been associated with impairments in facial emotion processing for other-race faces. The present investigation aimed to show perceptual narrowing for other-race faces during infancy and to determine whether the race of a face influences infants' ability to match emotional sounds with emotional facial expressions. Behavioral (visual-paired comparison; VPC) and electrophysiological (event-related potentials; ERPs) measures were recorded in 5-month-old and 9-month-old infants. Behaviorally, 5-month-olds distinguished faces within their own race and within another race, whereas 9-month-olds only distinguish faces within their own race. ERPs were recorded while an emotion sound (laughing or crying) was presented prior to viewing an image of a static African American or Caucasian face expressing either a happy or a sad emotion. Consistent with behavioral findings, ERPs revealed race-specific perceptual processing of faces and emotion/sound face congruency at 9 months but not 5 months of age. In addition, from 5 to 9 months, the neural networks activated for sound/face congruency were found to shift from an anterior ERP component (Nc) related to attention to posterior ERP components (N290, P400) related to perception.     

Simulating the 'other-race' effect with autoassociative neural networks: further evidence in favor of the face-space model

Other-race (OR) faces are less accurately recognized than same-race (SR) faces, but faster classified by race. This phenomenon has often been reported as the 'other-race' effect (ORE). Valentine (1991 Quarterly Journal of Experimental Psychology A: Human Experimental Psychology 43 161-204) proposed a theoretical multidimensional face-space model that explained both of these results, in terms of variations in exemplar density between races. According to this model, SR faces are more widely distributed across the dimensions of the space than OR faces. However, this model does not quantify nor state the dimensions coded within this face space. The aim of the present study was to test the face-space explanation of the ORE with neural network simulations by quantifying its dimensions. We found the predicted density properties of Valentine's framework in the face-projection spaces of the autoassociative memories. This was supported by an interaction for exemplar density between the race of the learned face set and the race of the faces. In addition, the elaborated face representations showed optimal responses for SR but not for OR faces within SR face spaces when explored at the individual level, as gender errors occurred significantly more often in OR than in SR face-space representations. Altogether, our results add further evidence in favor of a statistical exemplar density explanation of the ORE as suggested by Valentine, and question the plausibility of such coding for faces in the framework of recent neuroimaging studies.     

The influence of ingroup/outgroup categorization on same- and other-race face processing: The moderating role of inter- versus intra-racial context

We investigated the impact of ingroup/outgroup categorization on the encoding of same-race and other-race faces presented in inter-racial and intra-racial contexts (Experiments 1 and 2, respectively). White participants performed a same/different matching task on pairs of upright and inverted faces that were either same-race (White) or other-race (Black), and labeled as being from the same university or a different university. In Experiment 1, the same- and other-race faces were intermixed. For other-race faces, participants demonstrated greater configural processing following same- than other-university labeling. Same-race faces showed strong configural coding irrespective of the university labeling. In Experiment 2, faces were blocked by race. Participants demonstrated greater configural processing of same- than other-university faces, but now for both same- and other-race faces. These results demonstrate that other-race face processing is sensitive to non-racial ingroup/outgroup status regardless of racial context, but that the sensitivity of same-race face processing to the same cues depends on the racial context in which targets are encountered.     

Biracial and monoracial infant own‐race face perception: an eye tracking study

We know that early experience plays a crucial role in the development of face processing, but we know little about how infants learn to distinguish faces from different races, especially for non‐Caucasian populations. Moreover, it is unknown whether differential processing of different race faces observed in typically studied monoracial infants extends to biracial infants as well. Thus, we investigated 3‐month‐old Caucasian, Asian and biracial (Caucasian‐Asian) infants’ ability to distinguish Caucasian and Asian faces. Infants completed two within‐subject, infant‐controlled habituation sequences and test trials as an eye tracker recorded looking times and scanning patterns. Examination of individual differences revealed significant positive correlations between own‐race novelty preference and scanning frequency between eye and mouth regions of own‐race habituation stimuli for Caucasian and Asian infants, suggesting that facility in own‐race face discrimination stems from active inspection of internal facial features in these groups. Biracial infants, however, showed the opposite effect: An ‘own‐race’ novelty preference was associated with reduced scanning between eye and mouth regions of ‘own‐race’ habituation stimuli, suggesting that biracial infants use a distinct approach to processing frequently encountered faces. Future directions for investigating face processing development in biracial populations are discussed. A video abstract of this article can be viewed at http://youtu.be/a_dDXfFuEfY     

Chinese characters elicit face-like N170 inversion effects

Recognition of both faces and Chinese characters is commonly believed to rely on configural information. While faces typically exhibit behavioral and N170 inversion effects that differ from non-face stimuli (Rossion, Joyce, Cottrell, & Tarr, 2003), the current study examined whether a similar reliance on configural processing may result in similar inversion effects for faces and Chinese characters. Participants were engaged in an orientation judgment task (Experiment 1) and a one-back identity matching task (Experiment 2). Across two experiments, the N170 was delayed and enhanced in magnitude for upside-down faces and compound Chinese characters, compared to upright stimuli. The inversion effects for these two stimulus categories were bilateral for latency and right-lateralized for amplitudes. For simple Chinese characters, only the latency inversion effects were significant. Moreover, the size of the right-hemisphere inversion effects in N170 amplitude was larger for faces than Chinese characters. These findings show the N170 inversion effects from non-face stimuli closely parallel effects seen with faces. Face-like N170 inversion effects elicited by Chinese compound characters were attributed to the difficulty of part-whole integration as well as the disrupted regularity in relational information due to inversion. Hemispheric difference in Chinese character processing is also discussed.     

Chinese characters elicit face-like N170 inversion effects

Recognition of both faces and Chinese characters is commonly believed to rely on configural information. While faces typically exhibit behavioral and N170 inversion effects that differ from non-face stimuli (Rossion, Joyce, Cottrell, & Tarr, 2003), the current study examined whether a similar reliance on configural processing may result in similar inversion effects for faces and Chinese characters. Participants were engaged in an orientation judgment task (Experiment 1) and a one-back identity matching task (Experiment 2). Across two experiments, the N170 was delayed and enhanced in magnitude for upside-down faces and compound Chinese characters, compared to upright stimuli. The inversion effects for these two stimulus categories were bilateral for latency and right-lateralized for amplitudes. For simple Chinese characters, only the latency inversion effects were significant. Moreover, the size of the right-hemisphere inversion effects in N170 amplitude was larger for faces than Chinese characters. These findings show the N170 inversion effects from non-face stimuli closely parallel effects seen with faces. Face-like N170 inversion effects elicited by Chinese compound characters were attributed to the difficulty of part-whole integration as well as the disrupted regularity in relational information due to inversion. Hemispheric difference in Chinese character processing is also discussed.     

The influence of target and perceiver race in the categorisation of male sexual orientation

Although sexual orientation can be judged from faces, in previous work Caucasian or racially unspecified targets and perceivers have been primarily studied. Here, target and perceiver race were considered in the accurate categorisation of male sexual orientation. Asian, Black, and Caucasian participants categorised the sexual orientations of Asian, Black, and Caucasian men. Accuracy was significantly above chance and consistent across all combinations of perceivers and targets. Response bias scores showed that targets were significantly more likely to be categorised as straight, rather than gay, regardless of target or perceiver race. Moreover, judgments of individual targets were significantly correlated for perceivers from all three groups, suggesting cross-race consistency in target legibility. The perception of sexual orientation from faces therefore appears to be robust against variations in target and perceiver race.     

Meaningful processing of meaningless stimuli: the influence of perceptual experience on early visual processing of faces

The N170 is an event-related potential component associated with extrastriate visual mechanisms involved in detecting human faces and leading to their characteristic structural encoding. Consequently the N170 discriminates the processing of stimuli providing physiognomic information from the processing of other, similarly complex, visual patterns. We have used this effect to explore the top-down influence of newly acquired experience on the initial visual categorization of physiognomic stimuli. Schematic faces having the inner components mislocated did not elicit an N170 effect in naive participants. However, after normally configured versions of the schematic faces were exposed, suggesting what the ambiguous patterns represented, the same patterns elicited an N170 effect as conspicuous as that elicited by regular schematic faces. This priming effect, which changed the visual processing of distorted faces in extrastriate regions, could not be explained by post-perceptual decisions. Although accounts based on changes in focal attention, or within-vision constraints could not be categorically rejected, this outcome might suggest cognitive penetrability of early visual categorization.