Bayesian face recognition and perceptual narrowing in face-space

During the first year of life, infants' face recognition abilities are subject to 'perceptual narrowing', the end result of which is that observers lose the ability to distinguish previously discriminable faces (e.g. other-race faces) from one another. Perceptual narrowing has been reported for faces of different species and different races, in developing humans and primates. Though the phenomenon is highly robust and replicable, there have been few efforts to model the emergence of perceptual narrowing as a function of the accumulation of experience with faces during infancy. The goal of the current study is to examine how perceptual narrowing might manifest as statistical estimation in 'face-space', a geometric framework for describing face recognition that has been successfully applied to adult face perception. Here, I use a computer vision algorithm for Bayesian face recognition to study how the acquisition of experience in face-space and the presence of race categories affect performance for own and other-race faces. Perceptual narrowing follows from the establishment of distinct race categories, suggesting that the acquisition of category boundaries for race is a key computational mechanism in developing face expertise.     

The social-encoding benefit in face recognition is generalized to other-race faces

Faces are visual stimuli that convey rich social information. Previous experiments found better recognition for faces that were evaluated based on their social traits than on their perceptual features during encoding. Here, we ask whether this social-encoding benefit in face recognition is also found for categories of faces that we have no previous social experience with, such as other-race faces. To answer this question, we first explored whether social and perceptual evaluations for other-race faces are consistent and valid. We then asked whether social evaluations during encoding improve recognition for other-race faces. Results show that social and perceptual evaluations of own- and other-race faces were valid. We also found high agreement in social and perceptual evaluations across individuals from different races. This indicates that evaluations of other-race faces are not random but meaningful. Furthermore, we found that social evaluations facilitated face recognition regardless of race, demonstrating a social-encoding benefit for both own- and other-race faces. Our findings highlight the role of social information in face recognition and show how it can be used to improve recognition of categories of faces that are hard to recognize due to lack of experience with them.     

Brief daily exposures to Asian females reverses perceptual narrowing for Asian faces in Caucasian infants

Perceptual narrowing in the visual, auditory, and multisensory domains has its developmental origins during infancy. The current study shows that experimentally induced experience can reverse the effects of perceptual narrowing on infants' visual recognition memory of other-race faces. Caucasian 8- to 10-month-olds who could not discriminate between novel and familiarized Asian faces at the beginning of testing were given brief daily experience with Asian female faces in the experimental condition and Caucasian female faces in the control condition. At the end of 3 weeks, only infants who received daily experience with Asian females showed above-chance recognition of novel Asian female and male faces. Furthermore, infants in the experimental condition showed greater efficiency in learning novel Asian females compared with infants in the control condition. Thus, visual experience with a novel stimulus category can reverse the effects of perceptual narrowing during infancy via improved stimulus recognition and encoding.     

Building biases in infancy: the influence of race on face and voice emotion matching

Early in the first year of life infants exhibit equivalent performance distinguishing among people within their own race and within other races. However, with development and experience, their face recognition skills become tuned to groups of people they interact with the most. This developmental tuning is hypothesized to be the origin of adult face processing biases including the other-race bias. In adults the other-race bias has also been associated with impairments in facial emotion processing for other-race faces. The present investigation aimed to show perceptual narrowing for other-race faces during infancy and to determine whether the race of a face influences infants' ability to match emotional sounds with emotional facial expressions. Behavioral (visual-paired comparison; VPC) and electrophysiological (event-related potentials; ERPs) measures were recorded in 5-month-old and 9-month-old infants. Behaviorally, 5-month-olds distinguished faces within their own race and within another race, whereas 9-month-olds only distinguish faces within their own race. ERPs were recorded while an emotion sound (laughing or crying) was presented prior to viewing an image of a static African American or Caucasian face expressing either a happy or a sad emotion. Consistent with behavioral findings, ERPs revealed race-specific perceptual processing of faces and emotion/sound face congruency at 9 months but not 5 months of age. In addition, from 5 to 9 months, the neural networks activated for sound/face congruency were found to shift from an anterior ERP component (Nc) related to attention to posterior ERP components (N290, P400) related to perception.     

Reducing the own-race bias in face recognition by shifting attention

The own-race bias (ORB) in face recognition can be interpreted as a failure to generalize expert perceptual encoding developed for own-race faces to other-race faces. Further, black participants appear to use different features to describe faces from those used by white participants (Shepherd & Deregowski, 1981). An experiment is reported where the size of the ORB was assessed using a standard face recognition procedure. Four groups were tested at two time intervals. One group received a training regime involving learning to distinguish faces that varied only on their chin, cheeks, nose, and mouth. Three control groups did not receive this training. The ORB, present prior to training, was reduced after the critical perceptual training. It is concluded that the ORB is a consequence of a failure of attention being directed to those features of other race faces that are useful for identification.     

Reducing the own-race bias in face recognition by shifting attention

The own-race bias (ORB) in face recognition can be interpreted as a failure to generalize expert perceptual encoding developed for own-race faces to other-race faces. Further, black participants appear to use different features to describe faces from those used by white participants (Shepherd & Deregowski, 1981). An experiment is reported where the size of the ORB was assessed using a standard face recognition procedure. Four groups were tested at two time intervals. One group received a training regime involving learning to distinguish faces that varied only on their chin, cheeks, nose, and mouth. Three control groups did not receive this training. The ORB, present prior to training, was reduced after the critical perceptual training. It is concluded that the ORB is a consequence of a failure of attention being directed to those features of other race faces that are useful for identification.     

知觉经验对面孔整体加工的影响

基于经验的整体加工理论认为, 随着知觉经验的增多, 人们加工面孔的专家化能力逐渐增强。其中一种表现形式为, 在知觉面孔时更倾向于整体加工。该理论已经得到了一些实验证据的支持, 但未能解释另外一些研究的发现, 即对他族人群没有长期知觉经验的被试在加工他族面孔时也有强烈的整体加工。本研究旨在考察知觉经验对面孔整体加工的影响, 包括两个实验。实验1a通过组合面孔范式测量了中国被试在辨别本族面孔、他族面孔和种族融合面孔时的组合面孔效应(即面孔整体加工强度)。结果发现, 被试在知觉种族融合面孔时没有表现出组合面孔效应, 在知觉本族面孔和他族面孔时都表现出强烈的组合面孔效应。实验1b以灰阶图重复了实验1a。结果发现, 被试在知觉种族融合面孔时仍然没有表现出组合面孔效应, 在知觉本族面孔和他族面孔时表现出强烈的组合面孔效应。实验2通过操纵种族融合面孔的有或无, 测量5 s的知觉经验对融合面孔的组合效应的影响。结果发现, 在经过短时的知觉经验后, 被试在知觉融合面孔时也表现出强烈的组合面孔效应。上述实验结果表明, 中国被试在加工本族面孔、他族面孔和种族融合面孔时所诱发组合面孔效应有显著的、量的差别, 且这种整体加工的差异不会受到面孔肤色信息的影响。在经过短时的知觉经验后, 中国被试在加工种族融合面孔时表现出强烈的整体加工。该研究的发现提示, 不论是短时知觉经验还是长期知觉经验, 知觉经验的增加是面孔整体加工的一个关键要素。     

Encoding differences affect the number and precision of own-race versus other-race faces stored in visual working memory

Other-race faces are discriminated and recognized less accurately than own-race faces. Despite a wealth of research characterizing this other-race effect (ORE), little is known about the nature of the representations of own-race versus other-race faces. This is because traditional measures of this ORE provide a binary measure of discrimination or recognition (correct/incorrect), failing to capture potential variation in the quality of face representations. We applied a novel continuous-response paradigm to independently measure the number of own-race and other-race face representations stored in visual working memory (VWM) and the precision with which they are stored. Participants reported target own-race or other-race faces on a circular face space that smoothly varied along the dimension of identity. Using probabilistic mixture modeling, we found that following ample encoding time, the ORE is attributable to differences in the probability of a face being maintained in VWM. Reducing encoding time, a manipulation that is more sensitive to encoding limitations, caused a loss of precision or an increase in variability of VWM for other-race but not own-race faces. These results suggest that the ORE is driven by the inefficiency with which other-race faces are rapidly encoded in VWM and provide novel insights about how perceptual experience influences the representation of own-race and other-race faces in VWM.

     

Default categorization of outgroup faces and the other race effect: Commentary on the special issue

This commentary addresses how studies examining the neurophysiological correlates of racial categorization can provide insight into the neurocognitive mechanisms of the other-race effect in recognition memory. Several articles in the special issue describe how event-related potentials (ERPs) have been used to examine processing of faces that vary according to race, some of which have concluded that larger ERP amplitudes elicited by other-race (relative to own-race) faces indicates less efficient visual processing of other-race faces. I describe findings from ERP studies of race categorization that suggest an alternative interpretation–that other-race faces elicit stronger categorization, which impedes individuation of other-race faces. Suggestions for future research are offered.     

知觉适应对种族融合面孔的种族分类和知觉辨别的影响

面孔加工的种族效应(the other-race effects)指人们对面孔做个体辨别任务时辨别本族面孔的绩效优于辨别他族面孔的绩效, 而做种族分类任务时分类他族面孔的绩效优于分类本族面孔的绩效。本研究通过知觉适应操纵被试对种族两歧(高加索和亚洲)融合面孔的种族知觉, 进而比较被试在两种条件下对同一张融合面孔进行种族分类和知觉辨别的绩效的差异。结果发现, 知觉适应能使被试产生将两歧融合面孔知觉为与原始面孔所属种族相反种族的知觉偏向, 并且, 伴随着这种知觉偏向, 两歧融合面孔的加工出现了他族分类优势和本族辨别优势, 提示社会认知因素对面孔加工的种族效应有重要作用。     

Perceptual expertise and the plasticity of other-race face recognition

In this paper, we argue that our ability to recognize own-race faces can be treated as a form of perceptual expertise. Similar to object experts (e.g., birdwatchers), people differentiate own-race faces at the subordinate level of categorization. In contrast, like novices, we tend to classify other-race faces at the basic level of race. We demonstrate that, as a form of perceptual expertise, other-race face recognition can be systematically taught in the lab through subordinate-level training. When participants learn to quickly and accurately differentiate other-race faces at the subordinate level of the individual, the individuating training transfers to improved recognition of untrained other-race faces, produces changes in event-related brain components, and reduces implicit racial bias. Subsequent work has shown that other-race learning can be optimized by directing participants to the diagnostic features of a racial group. The benefits of other-race training are fairly long-lived and are evident even 2 weeks after training. Collectively, the training studies demonstrate the plasticity of other-race face recognition. Rather than a process that is fixed by early developmental events, other-race face recognition is malleable and dynamic, continually being reshaped by the perceptual experiences of the observer.     

Computational perspectives on the other-race effect

Psychological studies have long shown that human memory is superior for faces of our own-race than for faces of other-races. In this paper, we review computational studies of own- versus other-race face processing. Computational models examine the visual challenges of representing the uniqueness of individual faces that vary both within and across demographic categories. These models isolate the visual components of the other-race effect and provide an objective control for socioaffective responses to other-race faces. This control allows researchers to compare and test the role of experience/contact in the other-race effect, using various operational definitions of this theoretical construct. The models show that to produce an other-race effect computationally, biased experience or learning must intervene during the process of feature selection. This implicates the critical importance of “developmental” learning in the other-race effect.     

Development of own-race biases

This review examines the emergence and development of perceptual and social biases towards own-race individuals. We first discuss evidence regarding the early emergence of an own-race bias in facial preferences and face recognition abilities demonstrated by infants with an abundance of visual experience with own-race individuals, but little to no experience with other-race individuals. We then consider perceptual categorization of face race, visual scanning, and differential processing of own- and other-race faces in relation to recognition of face identity. Finally, we review evidence regarding own-race preferences for social partners and own-race biases in social evaluations that emerge during early childhood. Implications of the existing evidence for understanding the role of experience in perceptual development and the emergence of racial preferences and stereotypes are discussed.     

The other-race effect does not rely on memory: Evidence from a matching task

Viewers are typically better at remembering faces from their own race than from other races; however, it is not yet established whether this effect is due to memorial or perceptual processes. In this study, UK and Egyptian viewers were given a simultaneous face-matching task, in which the target faces were presented upright or upside down. As with previous research using face memory tasks, participants were worse at matching other-race faces than own-race faces and showed a stronger face inversion effect for own-race faces. However, subjects' performance on own and other-race faces was highly correlated. These data provide strong evidence that difficulty in perceptual encoding of unfamiliar faces contributes substantially to the other-race effect and that accounts based entirely on memory cannot capture the full data. Implications for forensic settings are also discussed.     

Perceptual narrowing in face- and speech-perception domains in infancy: A longitudinal approach

During the first year of life, infants undergo a process known as perceptual narrowing, which reduces their sensitivity to classes of stimuli which the infants do not encounter in their environment. It has been proposed that perceptual narrowing for faces and speech may be driven by shared domain-general processes. To investigate this theory, our study longitudinally tested 50 German Caucasian infants with respect to these domains first at 6 months of age followed by a second testing at 9 months of age. We used an infant-controlled habituation-dishabituation paradigm to test the infants’ ability to discriminate among other-race Asian faces and non-native Cantonese speech tones, as well as same-race Caucasian faces as a control. We found that while at 6 months of age infants could discriminate among all stimuli, by 9 months of age they could no longer discriminate among other-race faces or non-native tones. However, infants could discriminate among same-race stimuli both at 6 and at 9 months of age. These results demonstrate that the same infants undergo perceptual narrowing for both other-race faces and non-native speech tones between the ages of 6 and 9 months. This parallel development of perceptual narrowing occurring in both the face and speech perception modalities over the same period of time lends support to the domain-general theory of perceptual narrowing in face and speech perception.     

Race-specific perceptual discrimination improvement following short individuation training with faces

This study explores the effect of individuation training on the acquisition of race-specific expertise. First, we investigated whether practice individuating other-race faces yields improvement in perceptual discrimination for novel faces of that race. Second, we asked whether there was similar improvement for novel faces of a different race for which participants received equal practice, but in an orthogonal task that did not require individuation. Caucasian participants were trained to individuate faces of one race (African American or Hispanic) and to make difficult eye-luminance judgments on faces of the other race. By equating these tasks we are able to rule out raw experience, visual attention, or performance/success-induced positivity as the critical factors that produce race-specific improvements. These results indicate that individuation practice is one mechanism through which cognitive, perceptual, and/or social processes promote growth of the own-race face recognition advantage.     

Own- and other-race categorization of faces by race,gender, and age

We investigated how visual experience with faces of a particular race affects subordinate group-level categorizations in Chinese and Israeli participants living in the respective countries. Categorization of faces by race, gender, and age was examined within subjects with participants who had only minimal experience with the other-race faces. As would be predicted by the previously documented other-race advantage effect, both Chinese and Israeli participants classified the race of the face more quickly and more accurately for other-race than for own-race faces. In contrast, the observers’ race did not interact with the race of the rated face either for gender or for age categorization. The absence of these interactions suggests that the physiognomic characteristics that determine the gender and age of a face are universal, rather than race specific. Furthermore, these data suggest that determining the race of a face is not imposed as a first step in face processing, preempting the perception of other category-defining physiognomic characteristics.     

Other-race face perception

The other-race effect (or own-race bias or cross-racial identification effect) refers to the finding that recognition memory tends to be better for faces of members of subjects' own race than for faces of members of other races. The current study was designed to test the hypothesis that perceptual skills specific to identifying faces of particular racial groups contribute to this effect. On each of 50 trials, a photograph of a face was tachistoscopically presented for 120 ms, followed by a pattern mask and then a plain-view test pair composed of the previously presented face and a matched foil. As predicted, an other-race effect was obtained on this perceptual task: White subjects performed significantly more poorly on trials involving African American faces than on trials involving White faces, whereas no such difference was obtained among African American subjects.     

The other-race effect does not rely on memory: Evidence from a matching task

Viewers are typically better at remembering faces from their own race than from other races; however, it is not yet established whether this effect is due to memorial or perceptual processes. In this study, UK and Egyptian viewers were given a simultaneous face-matching task, in which the target faces were presented upright or upside down. As with previous research using face memory tasks, participants were worse at matching other-race faces than own-race faces and showed a stronger face inversion effect for own-race faces. However, subjects' performance on own and other-race faces was highly correlated. These data provide strong evidence that difficulty in perceptual encoding of unfamiliar faces contributes substantially to the other-race effect and that accounts based entirely on memory cannot capture the full data. Implications for forensic settings are also discussed.     

Holistic face encoding is modulated by perceived face race: Evidence from perceptual adaptation

Human expertise at processing faces relies on how facial features are encoded: as a whole template rather than as a sum of independent features. This holistic encoding is less prominent for other-race faces, possibly accounting for the difficulty one encounters in recognizing these faces (the ‘other-race effect’). Here, we tested the hypothesis that the magnitude of holistic face encoding can be modulated by racial categorization of the face. Caucasian participants performed a face-composite task with ‘racially-ambiguous’ face-stimuli (cross-race morphed faces, equally categorized as Asian or Caucasian faces in an independent task). The perceived race of the ambiguous faces was manipulated using adaptation. Experiment 1 showed that identical morphed face-stimuli were processed more holistically when perceived as ‘same-race’ than as ‘other-race’, i.e., following adaptation to ‘other-race’ versus ‘same-race’, respectively. Experiment 2 ascertained that the determining factor in the observed holistic processing modulation was the race of the racially-ambiguous face as perceived, rather than expected, by the participants, which supports the idea that the holistic processing of the face-stimuli was modulated by their race-categorization at the perceptual level.