Familiarity,memorability, and the effect of typicality on the recognition of faces

Typical faces are more poorly discriminated on tests of recognition than are atypical faces, an effect suggested to mediate similar findings for attractive or likable faces. We tested the hypothesis that the effect of typicality on recognition is a function of context-free familiarity and memorability, which function in opposition. Two orthogonal principal components were extracted from subjects' ratings of faces for typicality, familiarity, attractiveness, likability, and memorability--one consisting of the ratings of familiarity, attractiveness, and likability, and reflecting context-free familiarity, and the other consisting of the memorability rating. As expected, typicality loaded equally (r approximately .66), but with opposite sign, on both components. In subsequent experiments, both components were found to be significant and additive predictors of face recognition with no residual effect of typicality. General familiarity decreased discrimination, and the memorability component enhanced it, supporting the hypothesis. The results are discussed in terms of the mirror effect.     

Distinctiveness,typicality, and recollective experience in face recognition: A principal components analysis

In this study, participants rated previously unseen faces on six dimensions: familiarity, distinctiveness, attractiveness, memorability, typicality, and resemblance to a familiar person. The faces were then presented again in a recognition test in which participants assigned their positive recognition decisions to either remember (R), know (K), or guess categories. On all dimensions except typicality, faces that were categorized as R responses were associated with significantly higher ratings than were faces categorized as K responses. Study ratings for R and K responses were then subjected to a principal components analysis. The factor loadings suggested that R responses were influenced primarily by the distinctiveness of faces, but K responses were influenced by moderate ratings on all six dimensions. These findings indicate that the structural features of a face influence the subjective experience of recognition.     

Typicality and face recognition: A critical re-evaluation of the two factor theory

Vokey and Read (1992) proposed that the effect of typicality on face recognition was a function of familiarity and rated memorability, reporting that typicality loaded equally on components that they identified with these variables. We offer an alternative interpretation to that of Vokey and Read in terms of the relationship between typicality and attractiveness (when the former is measured as a deviation from the typical face), the mere exposure effect, and the metamemorial beliefs of participants. In our study we identified distinctiveness , attractiveness , and residual memory components. Supporting our interpretation, three of our four measures of typicality failed to load with familiarity on the attractiveness component. Only our measure of deviation from the typical face replicated Vokey and Read's results because of its correlation with attractiveness.     

Familiarity breeds attraction: effects of exposure on the attractiveness of typical and distinctive faces

Several studies have shown that facial attractiveness is positively correlated with both familiarity and typicality. Here we manipulated the familiarity of typical and distinctive faces to measure the effect on attractiveness. In our first experiment, we collected ratings of attractiveness, distinctiveness, and familiarity using three different groups of participants. Our stimuli included 84 images of female faces, presented in a full-face view. We replicated the finding that attractiveness ratings negatively correlate with distinctiveness ratings. In addition, we showed that attractiveness ratings were positively correlated with familiarity ratings. In our second experiment, we demonstrated that increasing exposure to faces increases their attractiveness, although there was no differential effect of exposure on typical and distinctive faces. Our results suggest that episodic familiarity affects attractiveness ratings independently of general or structural familiarity. The implications of our findings for the 'face-space' model are discussed.     

Attractiveness of own-race, other-race, and mixed-race faces

Averaged face composites, which represent the central tendency of a familiar population of faces, are attractive. If this prototypicality contributes to their appeal, then averaged composites should be more attractive when their component faces come from a familiar, own-race population than when they come from a less familiar, other-race population. We compared the attractiveness of own-race composites, other-race composites, and mixed-race composites (where the component faces were from both races). In experiment 1, Caucasian participants rated own-race composites as more attractive than other-race composites, but only for male faces. However, mixed-race (Caucasian/Japanese) composites were significantly more attractive than own-race composites, particularly for the opposite sex. In experiment 2, Caucasian and Japanese participants living in Australia and Japan, respectively, selected the most attractive face from a continuum with exaggerated Caucasian characteristics at one end and exaggerated Japanese characteristics at the other, with intervening images including a Caucasian averaged composite, a mixed-race averaged composite, and a Japanese averaged composite. The most attractive face was, again, a mixed-race composite, for both Caucasian and Japanese participants. In experiment 3, Caucasian participants rated individual Eurasian faces as significantly more attractive than either Caucasian or Asian faces. Similar results were obtained with composites. Eurasian faces and composites were also rated as healthier than Caucasian or Asian faces and composites, respectively. These results suggest that signs of health may be more important than prototypicality in making average faces attractive.     

Expert face coding: Configural and component coding of own-race and other-race faces

Configural and holistic coding are hallmarks of face perception. Although recent studies have shown that own-race faces are coded more holistically than other-race faces, the evidence for better configural coding of own-race faces is equivocal. We directly measured configural and component coding of own- and other-race male faces in Caucasian and Chinese participants. We manipulated individual features (components) or their spatial relations (configurations) using a novel morphing method to vary difficulty parametrically and tested sensitivity to these changes in a sequential matching task. Both configural and component coding were better for upright own-race than for upright other-race faces. Inversion impaired detection of configural changes more than it did detection of component changes, but also impaired performance more for easier discriminations,independent of type of change. These results challenge explanations of face expertise that rely solely on configural and holistic processing, and also call into question the widespread interpretation of large inversion decrements as diagnostic of configural coding.     

Identification of own-race and other-race faces: Implications for the representation of race in face space

Own-race faces are recognized more easily than faces of a different, unfamiliar race. According to the multidimensional space (MDS) framework, the poor discriminability of other-race faces is due to their being more densely clustered in face space than own-race faces. Multidimensional scaling analyses of similarity ratings (Caucasian participants, n = 22) showed that other-race (Chinese) faces are more densely clustered in face space. We applied a formal model to test whether the spatial location of face stimuli could account for identification accuracy of another group of Caucasian participants (n = 30). As expected, own-race (Caucasian) faces were identified more accurately (higher hit rate, lower false alarms, and higher A) than other-race faces, which were more densely clustered than ownrace faces. A quantitative model successfully predicted identification performance from the spatial locations of the stimuli. The results are discussed in relation to the standard MDS account of race effects and also an alternative “race-feature” hypothesis.     

Neural evidence for the contribution of holistic processing but not attention allocation to the other-race effect on face memory

Multiple mechanisms have been suggested to contribute to the other-race effect on face memory, the phenomenon of better memory performance for own-race than other-race faces. Here, two of these mechanisms, increased attention allocation and greater holistic processing during memory encoding for own-race than other-race faces, were tested in two separate experiments. In these experiments event-related potentials were measured during study (the difference due to memory, Dm) and test phase (old/new effects) to examine brain activation related to memory encoding and retrieval, allowing for selective investigations of these memory sub-processes. In Experiment 1, participants studied own-race (Caucasian) and other-race (Chinese) faces under focused or divided attention. In Experiment 2, participants studied own-race (Caucasian) and other-race (African American) faces presented upright or upside down (i.e., inverted). Both experiments showed decreases in memory performance when attention allocation or holistic processing was reduced, but these effects were similar for own-race and other-race faces. Manipulations of holistic processing, but not attention allocation, influenced the neural other-race effects during memory encoding. Inverted own-race faces showed similar neural patterns as upright other-race faces, indicating that when holistic processing of own-race faces was reduced, these faces were encoded similarly as upright other-race faces. No influences of the experimental manipulations on other-race effects during memory retrieval were found. The present study provides the first neural evidence that increased holistic processing during memory encoding contributes to the other-race effect on face memory.     

Multisensory stimulation with other-race faces and the reduction of racial prejudice

This study investigated whether multisensory stimulation with other-race faces can reduce racial prejudice. In three experiments, the faces of Caucasian observers were stroked with a cotton bud while they watched a black face being stroked in synchrony on a computer screen. This was compared with a neutral condition, in which no tactile stimulation was administered (Experiment 1 and 2), and with a condition in which observers’ faces were stroked in asynchrony with the onscreen face (Experiment 3). In all experiments, observers experienced an enfacement illusion after synchronous stimulation, whereby they reported to embody the other-race face. However, this effect did not produce concurrent changes in implicit or explicit racial prejudice. This outcome contrasts with other procedures for the reduction of self-other differences that decrease racial prejudice, such as behavioural mimicry and intergroup contact. We speculate that enfacement is less effective for such prejudice reduction because it does not encourage perspective-taking.     

Systems Factorial Technology provides new insights on the other-race effect

The other-race effect refers to the difficulty of discriminating between faces from ethnic and racial groups other than one’s own. This effect may be caused by a slow, feature-by-feature, analytic process, whereas the discrimination of own-race faces occurs faster and more holistically. However, this distinction has received inconsistent support. To provide a critical test, we employed Systems Factorial Technology (Townsend & Nozawa in Journal of Mathematical Psychology, 39, 321–359, 1995), which is a powerful tool for analyzing the organization of mental networks underlying perceptual processes. We compared Taiwanese participants’ face discriminations of both own-race (Taiwanese woman) and other-race (Caucasian woman) faces according to the faces’ nose-to-mouth separation and eye-to-eye separation. We found evidence for weak holistic processing (parallel processing) coupled with the strong analytic property of a self-terminating stopping rule for own-race faces, in contrast to strong analytic processing (serial self-terminating processing) for other-race faces, supporting the holistic/analytic hypothesis.     

The perception of face gender: The role of stimulus structure in recognition and classification

The perception of face gender was examined in the context of extending “face space” models of human face representations to include the perceptual categories defined by male and female faces. We collected data on the recognizability, gender classifiability (reaction time to classify a face as male/female), attractiveness, and masculinity/femininity of individual male and female faces. Factor analyses applied separately to the data for male and female faces yielded the following results. First, for both male and female faces, the recognizability and gender classifiability of faces were independent—a result inconsistent with the hypothesis that both recognizability and gender classifiability depend on a face’s “distance” from the subcategory gender prototype. Instead, caricatured aspects of gender (femininity/masculinity ratings) related to the gender classifiability of the faces. Second, facial attractiveness related inversely to face recognizability for male, but not for female, faces—a result that resolves inconsistencies in previous studies. Third, attractiveness and femininity for female faces were nearly equivalent, but attractiveness and masculinity for male faces were not equivalent. Finally, we applied principal component analysis to the pixel-coded face images with the aim of extracting measures related to the gender classifiability and recognizability of individual faces. We incorporated these model-derived measures into the factor analysis with the human rating and performance measures.     

Race-based perceptual asymmetries underlying face processing in infancy

Adults process other-race faces differently than own-race faces. For instance, a single other-race face in an array of own-race faces attracts Caucasians’ attention, but a single own-race face among other-race faces does not. This perceptual asymmetry has been explained by the presence of an other-race feature in other-race faces and its absence in own-race faces; this difference is thought to underlie race-based differences in face processing. We examined the developmental origins of this mechanism in two groups of Caucasian 9-month-olds. Infants in the experimental group exhibited a preference for a pattern containing a single Asian face among seven Caucasian faces over a pattern containing a single Caucasian face among seven Asian faces. This preference was not driven by the majority of elements in the images, because a control group of infants failed to exhibit a preference between homogeneous patterns containing eight Caucasian versus eight Asian faces. The results demonstrate that an other-race face among own-race faces attracts infants’ attention but not vice versa. This perceptual asymmetry suggests that the other-race feature is available to Caucasians by 9 months of age, thereby indicating that mechanisms of specialization in face processing originate early in life.     

The neural plasticity of other-race face recognition

Although it is well established that people are better at recognizing own-race faces than at recognizing other-race faces, the neural mechanisms mediating this advantage are not well understood. In this study, Caucasian participants were trained to differentiate African American (or Hispanic) faces at the individual level (e.g., Joe, Bob) and to categorize Hispanic (or African American) faces at the basic level of race (e.g., Hispanic, African American). Behaviorally, subordinate-level individuation training led to improved performance on a posttraining recognition test, relative to basic-level training. As measured by event-related potentials, subordinate- and basic-level training had relatively little effect on the face N170 component. However, as compared with basic-level training, subordinate-level training elicited an increased response in the posterior expert N250 component. These results demonstrate that learning to discriminate other-race faces at the subordinate level of the individual leads to improved recognition and enhanced activation of the expert N250 component.     

Lip colour affects perceived sex typicality and attractiveness of human faces

The luminance contrast between facial features and facial skin is greater in women than in men, and women's use of make-up enhances this contrast. In black-and-white photographs, increased luminance contrast enhances femininity and attractiveness in women's faces, but reduces masculinity and attractiveness in men's faces. In Caucasians, much of the contrast between the lips and facial skin is in redness. Red lips have been considered attractive in women in geographically and temporally diverse cultures, possibly because they mimic vasodilation associated with sexual arousal. Here, we investigate the effects of lip luminance and colour contrast on the attractiveness and sex typicality (masculinity/femininity) of human faces. In a Caucasian sample, we allowed participants to manipulate the colour of the lips in colour-calibrated face photographs along CIELab L* (light--dark), a* (red--green), and b* (yellow--blue) axes to enhance apparent attractiveness and sex typicality. Participants increased redness contrast to enhance femininity and attractiveness of female faces, but reduced redness contrast to enhance masculinity of men's faces. Lip blueness was reduced more in female than male faces. Increased lightness contrast enhanced the attractiveness of both sexes, and had little effect on perceptions of sex typicality. The association between lip colour contrast and attractiveness in women's faces may be attributable to its association with oxygenated blood perfusion indicating oestrogen levels, sexual arousal, and cardiac and respiratory health.     

Holistic face encoding is modulated by perceived face race: Evidence from perceptual adaptation

Human expertise at processing faces relies on how facial features are encoded: as a whole template rather than as a sum of independent features. This holistic encoding is less prominent for other-race faces, possibly accounting for the difficulty one encounters in recognizing these faces (the ‘other-race effect’). Here, we tested the hypothesis that the magnitude of holistic face encoding can be modulated by racial categorization of the face. Caucasian participants performed a face-composite task with ‘racially-ambiguous’ face-stimuli (cross-race morphed faces, equally categorized as Asian or Caucasian faces in an independent task). The perceived race of the ambiguous faces was manipulated using adaptation. Experiment 1 showed that identical morphed face-stimuli were processed more holistically when perceived as ‘same-race’ than as ‘other-race’, i.e., following adaptation to ‘other-race’ versus ‘same-race’, respectively. Experiment 2 ascertained that the determining factor in the observed holistic processing modulation was the race of the racially-ambiguous face as perceived, rather than expected, by the participants, which supports the idea that the holistic processing of the face-stimuli was modulated by their race-categorization at the perceptual level.     

Building biases in infancy: the influence of race on face and voice emotion matching

Early in the first year of life infants exhibit equivalent performance distinguishing among people within their own race and within other races. However, with development and experience, their face recognition skills become tuned to groups of people they interact with the most. This developmental tuning is hypothesized to be the origin of adult face processing biases including the other-race bias. In adults the other-race bias has also been associated with impairments in facial emotion processing for other-race faces. The present investigation aimed to show perceptual narrowing for other-race faces during infancy and to determine whether the race of a face influences infants' ability to match emotional sounds with emotional facial expressions. Behavioral (visual-paired comparison; VPC) and electrophysiological (event-related potentials; ERPs) measures were recorded in 5-month-old and 9-month-old infants. Behaviorally, 5-month-olds distinguished faces within their own race and within another race, whereas 9-month-olds only distinguish faces within their own race. ERPs were recorded while an emotion sound (laughing or crying) was presented prior to viewing an image of a static African American or Caucasian face expressing either a happy or a sad emotion. Consistent with behavioral findings, ERPs revealed race-specific perceptual processing of faces and emotion/sound face congruency at 9 months but not 5 months of age. In addition, from 5 to 9 months, the neural networks activated for sound/face congruency were found to shift from an anterior ERP component (Nc) related to attention to posterior ERP components (N290, P400) related to perception.     

Familiar other-race faces show normal holistic processing and are robust to perceptual stress

Other-race individuals are remembered more poorly and receive less holistic/configural processing than same-race individuals, at least when faces are novel. Here, we examine the amelioration of these effects with familiarity, using distinctiveness-matched Caucasian and Asian stimulus sets. We confirmed a cross-race deficit for upright faces following a single encoding trial, which disappeared rapidly with practice on a small set of other-race 'friends' and did not re-emerge when perceptual processing was put under stress (presentation in the periphery). We also examined holistic/configural processing for familiarised faces using the peripheral inversion effect (McKone, 2004 Journal of Experimental Psychology: Learning, Memory, and Cognition 30 181 - 197). A test for faces and nonface objects (dogs) confirmed the validity of this technique as providing a direct measure of holistic processing; we then showed that, after 1 h of training, holistic processing was as strong for other-race as same-race faces. We conclude that practice with other-race individuals can rapidly engage normal face-processing mechanisms.     

Distinctiveness and the recognition mirror effect: evidence for an item-based criterion placement heuristic

Superior detection and rejection of 1 versus another class of items during recognition is called the mirror effect. Some mirror effects may involve strategic criterion adjustments based on item distinctiveness and its relation to memorability. Three experiments demonstrated mirror effects for known versus unknown scenes and 1 suggested a similar pattern for faces. In opposition to preexperimental familiarity, lures from known and frequently encountered locations were confidently rejected more often than unknown lures. Forgetting and speeding recognition reversed this lure response pattern, suggesting abandonment of strategic adjustment in favor of a single fixed criterion. With sufficient response time and recent encoding, observers demand more evidence for conceptually distinctive items, perhaps because such items typically foster vivid recollection during retrieval.     

Attractiveness of facial averageness and symmetry in non-western cultures: in search of biologically based standards of beauty.

Averageness and symmetry are attractive in Western faces and are good candidates for biologically based standards of beauty. A hallmark of such standards is that they are shared across cultures. We examined whether facial averageness and symmetry are attractive in non-Western cultures. Increasing the averageness of individual faces, by warping those faces towards an averaged composite of the same race and sex, increased the attractiveness of both Chinese (experiment 1) and Japanese (experiment 2) faces, for Chinese and Japanese participants, respectively. Decreasing averageness by moving the faces away from an average shape decreased attractiveness. We also manipulated the symmetry of Japanese faces by blending each original face with its mirror image to create perfectly symmetric versions. Japanese raters preferred the perfectly symmetric versions to the original faces (experiment 2). These findings show that preferences for facial averageness and symmetry are not restricted to Western cultures, consistent with the view that they are biologically based. Interestingly, it made little difference whether averageness was manipulated by using own-race or other-race averaged composites and there was no preference for own-race averaged composites over other-race or mixed-race composites (experiment 1). We discuss the implications of these results for understanding what makes average faces attractive. We also discuss some limitations of our studies, and consider other lines of converging evidence that may help determine whether preferences for average and symmetric faces are biologically based.