Holistic face encoding is modulated by perceived face race: Evidence from perceptual adaptation

Human expertise at processing faces relies on how facial features are encoded: as a whole template rather than as a sum of independent features. This holistic encoding is less prominent for other-race faces, possibly accounting for the difficulty one encounters in recognizing these faces (the ‘other-race effect’). Here, we tested the hypothesis that the magnitude of holistic face encoding can be modulated by racial categorization of the face. Caucasian participants performed a face-composite task with ‘racially-ambiguous’ face-stimuli (cross-race morphed faces, equally categorized as Asian or Caucasian faces in an independent task). The perceived race of the ambiguous faces was manipulated using adaptation. Experiment 1 showed that identical morphed face-stimuli were processed more holistically when perceived as ‘same-race’ than as ‘other-race’, i.e., following adaptation to ‘other-race’ versus ‘same-race’, respectively. Experiment 2 ascertained that the determining factor in the observed holistic processing modulation was the race of the racially-ambiguous face as perceived, rather than expected, by the participants, which supports the idea that the holistic processing of the face-stimuli was modulated by their race-categorization at the perceptual level.     

Examining the durability of incidentally learned trust from gaze cues

In everyday interactions we find our attention follows the eye gaze of faces around us. As this cueing is so powerful and difficult to inhibit, gaze can therefore be used to facilitate or disrupt visual processing of the environment, and when we experience this we infer information about the trustworthiness of the cueing face. However, to date no studies have investigated how long these impressions last. To explore this we used a gaze-cueing paradigm where faces consistently demonstrated either valid or invalid cueing behaviours. Previous experiments show that valid faces are subsequently rated as more trustworthy than invalid faces. We replicate this effect (Experiment 1) and then include a brief interference task in Experiment 2 between gaze cueing and trustworthiness rating, which weakens but does not completely eliminate the effect. In Experiment 3, we explore whether greater familiarity with the faces improves the durability of trust learning and find that the effect is more resilient with familiar faces. Finally, in Experiment 4, we push this further and show that evidence of trust learning can be seen up to an hour after cueing has ended. Taken together, our results suggest that incidentally learned trust can be durable, especially for faces that deceive.     

Learning about faces: effects of trustworthiness on affective evaluation

The results of two studies on the relationship between evaluations of trustworthiness, valence and arousal of faces are reported. In Experiment 1, valence and trustworthiness judgments of faces were positively correlated, while arousal was negatively correlated with both trustworthiness and valence. In Experiment 2, learning about faces based on their emotional expression and the extent to which this learning is influenced by perceived trustworthiness was investigated. Neutral faces of different models differing in trustworthiness were repeatedly associated with happy or with angry expressions and the participants were asked to categorize each neutral face as belonging to a "friend" or to an "enemy" based on these associations. Four pairing conditions were defined in terms of the congruency between trustworthiness level and expression: Trustworthy-congruent, trustworthy-incongruent, untrustworthy-congruent and untrustworthy-incongruent. Categorization accuracy during the learning phase and face evaluation after learning were measured. During learning, participants learned to categorize with similar efficiency trustworthy and untrustworthy faces as friends or enemies and thus no effects of congruency were found. In the evaluation phase, faces of enemies were rated as more negative and arousing than those of friends, thus showing that learning was effective to change the affective value of the faces. However, faces of untrustworthy models were still judged on average more negative and arousing than those of trustworthy ones. In conclusion, although face trustworthiness did not influence learning of associations between faces and positive or negative social information it did have a significant influence on face evaluation that was manifest even after that learning.     

The contribution of shape and surface information in the other-race face effect

Faces from another race are generally more difficult to recognize than faces from one's own race. However, faces provide multiple cues for recognition and it remains unknown what are the relative contribution of these cues to this “other-race effect”. In the current study, we used three-dimensional laser-scanned head models which allowed us to independently manipulate two prominent cues for face recognition: the facial shape morphology and the facial surface properties (texture and colour). In Experiment 1, Asian and Caucasian participants implicitly learned a set of Asian and Caucasian faces that had both shape and surface cues to facial identity. Their recognition of these encoded faces was then tested in an old/new recognition task. For these face stimuli, we found a robust other-race effect: Both groups were more accurate at recognizing own-race than other-race faces. Having established the other-race effect, in Experiment 2 we provided only shape cues for recognition and in Experiment 3 we provided only surface cues for recognition. Caucasian participants continued to show the other-race effect when only shape information was available, whereas Asian participants showed no effect. When only surface information was available, there was a weak pattern for the other-race effect in Asians. Performance was poor in this latter experiment, so this pattern needs to be interpreted with caution. Overall, these findings suggest that Asian and Caucasian participants rely differently on shape and surface cues to recognize own-race faces, and that they continue to use the same cues for other-race faces, which may be suboptimal for these faces.     

知觉适应对种族融合面孔的种族分类和知觉辨别的影响

面孔加工的种族效应(the other-race effects)指人们对面孔做个体辨别任务时辨别本族面孔的绩效优于辨别他族面孔的绩效, 而做种族分类任务时分类他族面孔的绩效优于分类本族面孔的绩效。本研究通过知觉适应操纵被试对种族两歧(高加索和亚洲)融合面孔的种族知觉, 进而比较被试在两种条件下对同一张融合面孔进行种族分类和知觉辨别的绩效的差异。结果发现, 知觉适应能使被试产生将两歧融合面孔知觉为与原始面孔所属种族相反种族的知觉偏向, 并且, 伴随着这种知觉偏向, 两歧融合面孔的加工出现了他族分类优势和本族辨别优势, 提示社会认知因素对面孔加工的种族效应有重要作用。     

Face in profile view reduces perceived facial expression intensity: An eye-tracking study

Recent studies measuring the facial expressions of emotion have focused primarily on the perception of frontal face images. As we frequently encounter expressive faces from different viewing angles, having a mechanism which allows invariant expression perception would be advantageous to our social interactions. Although a couple of studies have indicated comparable expression categorization accuracy across viewpoints, it is unknown how perceived expression intensity and associated gaze behaviour change across viewing angles. Differences could arise because diagnostic cues from local facial features for decoding expressions could vary with viewpoints. Here we manipulated orientation of faces (frontal, mid-profile, and profile view) displaying six common facial expressions of emotion, and measured participants' expression categorization accuracy, perceived expression intensity and associated gaze patterns. In comparison with frontal faces, profile faces slightly reduced identification rates for disgust and sad expressions, but significantly decreased perceived intensity for all tested expressions. Although quantitatively viewpoint had expression-specific influence on the proportion of fixations directed at local facial features, the qualitative gaze distribution within facial features (e.g., the eyes tended to attract the highest proportion of fixations, followed by the nose and then the mouth region) was independent of viewpoint and expression type. Our results suggest that the viewpoint-invariant facial expression processing is categorical perception, which could be linked to a viewpoint-invariant holistic gaze strategy for extracting expressive facial cues.     

The perception of attractiveness and trustworthiness in male faces affects hypothetical voting decisions differently in wartime and peacetime scenarios

Facial appearance of candidates has been linked to real election outcomes. Here we extend these findings by examining the contributions of attractiveness and trustworthiness in male faces to perceived votability. We first use real faces to show that attractiveness and trustworthiness are positively and independently related to perceptions of good leadership (rating study). We then show that computer graphic manipulations of attractiveness and trustworthiness influence choice of leader (Experiments 1 and 2). Finally, we show that changing context from wartime to peacetime can affect which face receives the most votes. Attractive faces were relatively more valued for wartime and trustworthy faces relatively more valued for peacetime (Experiments 1 and 2). This pattern suggests that attractiveness, which may indicate health and fitness, is perceived to be a useful attribute in wartime leaders, whereas trustworthiness, which may indicate prosocial traits, is perceived to be more important during peacetime. Our studies highlight the possible role of facial appearance in voting behaviour and the role of attributions of attractiveness and trust. We also show that there may be no general characteristics of faces that make them perceived as the best choice of leader; leaders may be chosen because of characteristics that are perceived as the best for leaders to possess in particular situations.     

The perception of attractiveness and trustworthiness in male faces affects hypothetical voting decisions differently in wartime and peacetime scenarios

Facial appearance of candidates has been linked to real election outcomes. Here we extend these findings by examining the contributions of attractiveness and trustworthiness in male faces to perceived votability. We first use real faces to show that attractiveness and trustworthiness are positively and independently related to perceptions of good leadership (rating study). We then show that computer graphic manipulations of attractiveness and trustworthiness influence choice of leader (Experiments 1 and 2). Finally, we show that changing context from wartime to peacetime can affect which face receives the most votes. Attractive faces were relatively more valued for wartime and trustworthy faces relatively more valued for peacetime (Experiments 1 and 2). This pattern suggests that attractiveness, which may indicate health and fitness, is perceived to be a useful attribute in wartime leaders, whereas trustworthiness, which may indicate prosocial traits, is perceived to be more important during peacetime. Our studies highlight the possible role of facial appearance in voting behaviour and the role of attributions of attractiveness and trust. We also show that there may be no general characteristics of faces that make them perceived as the best choice of leader; leaders may be chosen because of characteristics that are perceived as the best for leaders to possess in particular situations.     

Looking the other way: The role of gaze direction in the cross-race memory effect

One of the most replicable findings reported in the social psychological literature is the cross-race memory effect. We argue this effect derives from higher-order interactions among social cues that determine the perceived relevance of a face to an observer. The current research tested this hypothesis by examining the combined influences of eye gaze direction and race on face memory. The physical subtlety of eye gaze belies its powerful influence on social perception, and in this case helps specify the relevance of same- versus other-race faces. We found that only in faces making direct eye contact—not those displaying averted eye gaze—was the cross-race memory effect evident. Likewise, only in same-race faces did direct relative to averted-gaze enhance face memory. These findings have implications for our general understanding of the combinatorial nature of social perception and help clarify the underlying cause of the cross-race memory effect.     

Independent influences of verbalization and race on the configural and featural processing of faces: a behavioral and eye movement study

Describing a face in words can either hinder or help subsequent face recognition. Here, the authors examined the relationship between the benefit from verbally describing a series of faces and the same-race advantage (SRA) whereby people are better at recognizing unfamiliar faces from their own race as compared with those from other races. Verbalization and the SRA influenced face recognition independently, as evident on both behavioral (Experiment 1) and eye movement measures (Experiment 2). The findings indicate that verbalization and the SRA each recruit different types of configural processing, with verbalization modulating face learning and the SRA modulating both face learning and recognition. Eye movement patterns demonstrated greater feature sampling for describing as compared with not describing faces and for other-race as compared with same-race faces. In both cases, sampling of the eyes, nose, and mouth played a major role in performance. The findings support a single process account whereby verbalization can influence perceptual processing in a flexible and yet fundamental way through shifting one's processing orientation.     

The influence of ingroup/outgroup categorization on same- and other-race face processing: The moderating role of inter- versus intra-racial context

We investigated the impact of ingroup/outgroup categorization on the encoding of same-race and other-race faces presented in inter-racial and intra-racial contexts (Experiments 1 and 2, respectively). White participants performed a same/different matching task on pairs of upright and inverted faces that were either same-race (White) or other-race (Black), and labeled as being from the same university or a different university. In Experiment 1, the same- and other-race faces were intermixed. For other-race faces, participants demonstrated greater configural processing following same- than other-university labeling. Same-race faces showed strong configural coding irrespective of the university labeling. In Experiment 2, faces were blocked by race. Participants demonstrated greater configural processing of same- than other-university faces, but now for both same- and other-race faces. These results demonstrate that other-race face processing is sensitive to non-racial ingroup/outgroup status regardless of racial context, but that the sensitivity of same-race face processing to the same cues depends on the racial context in which targets are encountered.     

Eye-tracking the own-race bias in face recognition: Revealing the perceptual and socio-cognitive mechanisms

Own-race faces are recognised more accurately than other-race faces and may even be viewed differently as measured by an eye-tracker (Goldinger, Papesh, & He, 2009). Alternatively, observer race might direct eye-movements (Blais, Jack, Scheepers, Fiset, & Caldara, 2008). Observer differences in eye-movements are likely to be based on experience of the physiognomic characteristics that are differentially discriminating for Black and White faces. Two experiments are reported that employed standard old/new recognition paradigms in which Black and White observers viewed Black and White faces with their eye-movements recorded. Experiment 1 showed that there were observer race differences in terms of the features scanned but observers employed the same strategy across different types of faces. Experiment 2 demonstrated that other-race faces could be recognised more accurately if participants had their first fixation directed to more diagnostic features using fixation crosses. These results are entirely consistent with those presented by Blais et al. (2008) and with the perceptual interpretation that the own-race bias is due to inappropriate attention allocated to the facial features ( and ).     

Asymmetrical responding to male versus female other-race categories in 9- to 12-month-old infants

Faces can be categorized along various dimensions including gender or race, an ability developing in infancy. Infant categorization studies have focused on facial attributes in isolation, but the interaction between these attributes remains poorly understood. Experiment 1 examined gender categorization of other-race faces in 9- and 12-month-old White infants. Nine- and 12-month-olds were familiarized with Asian male or female faces, and tested with a novel exemplar from the familiarized category paired with a novel exemplar from a novel category. Both age groups showed novel category preferences for novel Asian female faces after familiarization with Asian male faces, but showed no novel category preference for novel Asian male faces after familiarization with Asian female faces. This categorization asymmetry was not due to a spontaneous preference hindering novel category reaction (Experiment 2), and both age groups displayed difficulty discriminating among male, but not female, other-race faces (Experiment 3). These results indicate that category formation for male other-race faces is mediated by categorical perception. Overall, the findings suggest that even by 12 months of age, infants are not fully able to form gender category representations of other-race faces, responding categorically to male, but not female, other-race faces.     

知觉经验对面孔整体加工的影响

基于经验的整体加工理论认为, 随着知觉经验的增多, 人们加工面孔的专家化能力逐渐增强。其中一种表现形式为, 在知觉面孔时更倾向于整体加工。该理论已经得到了一些实验证据的支持, 但未能解释另外一些研究的发现, 即对他族人群没有长期知觉经验的被试在加工他族面孔时也有强烈的整体加工。本研究旨在考察知觉经验对面孔整体加工的影响, 包括两个实验。实验1a通过组合面孔范式测量了中国被试在辨别本族面孔、他族面孔和种族融合面孔时的组合面孔效应(即面孔整体加工强度)。结果发现, 被试在知觉种族融合面孔时没有表现出组合面孔效应, 在知觉本族面孔和他族面孔时都表现出强烈的组合面孔效应。实验1b以灰阶图重复了实验1a。结果发现, 被试在知觉种族融合面孔时仍然没有表现出组合面孔效应, 在知觉本族面孔和他族面孔时表现出强烈的组合面孔效应。实验2通过操纵种族融合面孔的有或无, 测量5 s的知觉经验对融合面孔的组合效应的影响。结果发现, 在经过短时的知觉经验后, 被试在知觉融合面孔时也表现出强烈的组合面孔效应。上述实验结果表明, 中国被试在加工本族面孔、他族面孔和种族融合面孔时所诱发组合面孔效应有显著的、量的差别, 且这种整体加工的差异不会受到面孔肤色信息的影响。在经过短时的知觉经验后, 中国被试在加工种族融合面孔时表现出强烈的整体加工。该研究的发现提示, 不论是短时知觉经验还是长期知觉经验, 知觉经验的增加是面孔整体加工的一个关键要素。     

Similarity and difference in the processing of same- and other-race faces as revealed by eye tracking in 4- to 9-month-olds

Fixation duration for same-race (i.e., Asian) and other-race (i.e., Caucasian) female faces by Asian infant participants between 4 and 9 months of age was investigated with an eye-tracking procedure. The age range tested corresponded with prior reports of processing differences between same- and other-race faces observed in behavioral looking time studies, with preference for same-race faces apparent at 3 months of age and recognition memory differences in favor of same-race faces emerging between 3 and 9 months of age. The eye-tracking results revealed both similarity and difference in infants’ processing of own- and other-race faces. There was no overall fixation time difference between same race and other race for the whole face stimuli. In addition, although fixation time was greater for the upper half of the face than for the lower half of the face and trended higher on the right side of the face than on the left side of the face, face race did not impact these effects. However, over the age range tested, there was a gradual decrement in fixation time on the internal features of other-race faces and a maintenance of fixation time on the internal features of same-race faces. Moreover, the decrement in fixation time for the internal features of other-race faces was most prominent on the nose. The findings suggest that (a) same-race preferences may be more readily evidenced in paired comparison testing formats, (b) the behavioral decline in recognition memory for other-race faces corresponds in timing with a decline in fixation on the internal features of other-race faces, and (c) the center of the face (i.e., the nose) is a differential region for processing same- versus other-race faces by Asian infants.     

Neural evidence for the contribution of holistic processing but not attention allocation to the other-race effect on face memory

Multiple mechanisms have been suggested to contribute to the other-race effect on face memory, the phenomenon of better memory performance for own-race than other-race faces. Here, two of these mechanisms, increased attention allocation and greater holistic processing during memory encoding for own-race than other-race faces, were tested in two separate experiments. In these experiments event-related potentials were measured during study (the difference due to memory, Dm) and test phase (old/new effects) to examine brain activation related to memory encoding and retrieval, allowing for selective investigations of these memory sub-processes. In Experiment 1, participants studied own-race (Caucasian) and other-race (Chinese) faces under focused or divided attention. In Experiment 2, participants studied own-race (Caucasian) and other-race (African American) faces presented upright or upside down (i.e., inverted). Both experiments showed decreases in memory performance when attention allocation or holistic processing was reduced, but these effects were similar for own-race and other-race faces. Manipulations of holistic processing, but not attention allocation, influenced the neural other-race effects during memory encoding. Inverted own-race faces showed similar neural patterns as upright other-race faces, indicating that when holistic processing of own-race faces was reduced, these faces were encoded similarly as upright other-race faces. No influences of the experimental manipulations on other-race effects during memory retrieval were found. The present study provides the first neural evidence that increased holistic processing during memory encoding contributes to the other-race effect on face memory.     

Perceptual expertise and the plasticity of other-race face recognition

In this paper, we argue that our ability to recognize own-race faces can be treated as a form of perceptual expertise. Similar to object experts (e.g., birdwatchers), people differentiate own-race faces at the subordinate level of categorization. In contrast, like novices, we tend to classify other-race faces at the basic level of race. We demonstrate that, as a form of perceptual expertise, other-race face recognition can be systematically taught in the lab through subordinate-level training. When participants learn to quickly and accurately differentiate other-race faces at the subordinate level of the individual, the individuating training transfers to improved recognition of untrained other-race faces, produces changes in event-related brain components, and reduces implicit racial bias. Subsequent work has shown that other-race learning can be optimized by directing participants to the diagnostic features of a racial group. The benefits of other-race training are fairly long-lived and are evident even 2 weeks after training. Collectively, the training studies demonstrate the plasticity of other-race face recognition. Rather than a process that is fixed by early developmental events, other-race face recognition is malleable and dynamic, continually being reshaped by the perceptual experiences of the observer.     

Building biases in infancy: the influence of race on face and voice emotion matching

Early in the first year of life infants exhibit equivalent performance distinguishing among people within their own race and within other races. However, with development and experience, their face recognition skills become tuned to groups of people they interact with the most. This developmental tuning is hypothesized to be the origin of adult face processing biases including the other-race bias. In adults the other-race bias has also been associated with impairments in facial emotion processing for other-race faces. The present investigation aimed to show perceptual narrowing for other-race faces during infancy and to determine whether the race of a face influences infants' ability to match emotional sounds with emotional facial expressions. Behavioral (visual-paired comparison; VPC) and electrophysiological (event-related potentials; ERPs) measures were recorded in 5-month-old and 9-month-old infants. Behaviorally, 5-month-olds distinguished faces within their own race and within another race, whereas 9-month-olds only distinguish faces within their own race. ERPs were recorded while an emotion sound (laughing or crying) was presented prior to viewing an image of a static African American or Caucasian face expressing either a happy or a sad emotion. Consistent with behavioral findings, ERPs revealed race-specific perceptual processing of faces and emotion/sound face congruency at 9 months but not 5 months of age. In addition, from 5 to 9 months, the neural networks activated for sound/face congruency were found to shift from an anterior ERP component (Nc) related to attention to posterior ERP components (N290, P400) related to perception.     

Race categorization modulates holistic face encoding

Recent studies have shown that same-race (SR) faces are processed more holistically than other-race (OR) faces, a difference that may underlie the greater difficulty at recognizing OR than SR faces (the "other-race effect"). This article provides original evidence suggesting that the holistic processing of faces may be sensitive to the observers' racial categorization of the face. In Experiment 1, Caucasian participants performed a face-composite task with Caucasian faces, Asian faces, and racially ambiguous morphed face stimuli. Identical morphed face stimuli were processed more holistically when categorized as SR than as OR faces. Experiment 2 further suggests that this finding was not underlain by strategic or training effects. Overall, these results support the view that one's categorization of a face as belonging to the same or another race plays a critical role in the holistic processing of this face.     

The face of an angel: Effect of exposure to details of moral behavior on facial recognition memory

The Dangerous Decisions Theory (DDT; Porter & ten Brinke, 2009) posits that instantaneous perceptions of trustworthiness based on a stranger's face influence the manner in which ensuing information about the target is processed. This study tested a bi-directional DDT model, proposing that information concerning a target's moral behavior could distort eyewitness memory for the individual's facial trustworthiness. Participants (N = 141) viewed a target individual's face (previously rated as appearing “neutral” on trustworthiness) and then were exposed to one of the three vignettes describing the target's behavior (either immoral, morally neutral, or altruistic). Following a delay, observers were asked to identify the target individual on a facial morph video (continuously ranging in levels of perceived trustworthiness). Results indicated that behavioral information varying in morality influenced facial recognition memory; specifically, faces were recalled as having less trustworthy features following a disclosure of immoral/criminal behavior.