Identity specific adaptation with composite faces

A composite face, made from the top half of a celebrity face and the bottom half of an unfamiliar face, appears to be a single, “new” face (e.g., Young, Hellawell, & Hay, 1987). Composite faces were used within the face identity aftereffect (FIAE) paradigm, in which prolonged exposure to a face reduces sensitivity to it (adaptation). Adaptation occurred both with an intact face and with composites containing its upper half, but only when composites were explicitly recognized during the adaptation phase. Unrecognized composites produced no adaptation. These findings imply that the FIAE is a relatively high-level perceptual effect, given that identical stimuli either did or did not produce adaptation depending on whether or not they were recognized. They also suggest a perceptual locus for the “composite face effect”.     

Long-term effects of covert face recognition

Covert face recognition has previously been thought to produce only very short-lasting effects. In this study we demonstrate that manipulating subjects' attentional load affects explicit, but not implicit memory for faces, and that implicit effects can persist over much longer intervals than is normally reported. Subjects performed letter-string tasks of high vs. low perceptual load (Lavie, N. (1995). Perceptual load as a necessary condition for selective attention. Journal of Experimental Psychology: Human Perception and Perfomance. 21, 451-468.), while ignoring task-irrelevant celebrity faces. Memory for the faces was then assessed using (a) a surprise recognition test for the celebrities' names, and (b) repetition priming in a face familiarity task. The load manipulation strongly influenced explicit recognition memory, but had no effect on repetition priming from the same items. Moreover, faces from the high load condition produced the same amount of priming whether they were explicitly remembered or not. This result resolves a long-standing anomaly in the face recognition literature, and is discussed in relation to covert processing in prosopagnosia.     

The role of higher level adaptive coding mechanisms in the development of face recognition

Developmental improvements in face identity recognition ability are widely documented, but the source of children’s immaturity in face recognition remains unclear. Differences in the way in which children and adults visually represent faces might underlie immaturities in face recognition. Recent evidence of a face identity aftereffect (FIAE), in which adaptation (exposure) to a particular identity causes a previously neutral face to take on the computationally opposite identity, suggests that adults code faces in an opponent fashion relative to an average face. One previous study showed comparable FIAEs in 8-year-olds and adults but did not demonstrate that adaptation was selective for high-level representations in both groups. Using a developmentally appropriate FIAE task, we investigated whether children show adult-like adaptation for facial identity when adapting and test images differ in size. Both age groups showed an equivalent FIAE, suggesting that qualitative changes in the use of higher level adaptive coding mechanisms do not drive the developmental improvements in face recognition ability, at least from 8 years of age.     

TMS to the “occipital face area” affects recognition but not categorization of faces

The human cortical system for face perception is comprised of a network of connected regions including the middle fusiform gyrus (“fusiform face area” or FFA), the inferior occipital cortex (“occipital face area” or OFA), and the superior temporal sulcus. The traditional hierarchical feedforward model of visual processing suggests information flows from early visual cortex to the OFA for initial face feature analysis to higher order regions including the FFA for identity recognition. However, patient data suggest an alternative model. Patients with acquired prosopagnosia, an inability to visually recognize faces, have been documented with lesions to the OFA but who nevertheless show face-selective activation in the FFA. Moreover, their ability to categorize faces remains intact. This suggests that the FFA is not solely responsible for face recognition and the network is not strictly hierarchical, but may be organized in a reverse hierarchical fashion. We used transcranial magnetic stimulation (TMS) to temporarily disrupt processing in the OFA in neurologically-intact individuals and found participants’ ability to categorize intact versus scrambled faces was unaffected, however face identity discrimination was significantly impaired. This suggests that face categorization but not recognition can occur without the “earlier” OFA being online and indicates that “lower level” face category processing may be assumed by other intact face network regions such as the FFA. These results are consistent with the patient data and support a non-hierarchical, global-to-local model with re-entrant connections between the OFA and other face processing areas.     

Is positivity a cue or a response option? Warm glow vs evaluative matching in the familiarity for attractive and not-so-attractive faces

Monin (2003) showed that the attractiveness of a face increases its perceived familiarity regardless of prior exposure, and suggested that this beautiful-is-familiar effect was due to the misattribution to familiarity of the positive affect (or “warm glow”) elicited by attractive faces. This research tests the alternative interpretation that an evaluative match between a positive stimulus (an attractive face) and a positive response (“familiar”) accounts for this effect in the absence of any misattribution. In a face recognition task, participants were led to signal their sense of familiarity with previously seen and unseen faces by selecting either a pleasant (affectively congruent) or unpleasant (affectively incongruent) image. Consistent with the warm glow heuristic, higher false alarm rates were obtained for more attractive distracters, and this effect survived (and was, if anything, stronger) when an affectively incongruent response format was used. These findings are discussed in the context of current face memory and perceptual fluency models.     

When two become one: Temporally dynamic integration of the face and voice

In everyday interactions with others, people have to deal with the sight of a face and sound of a voice at the same time. How the perceptual system brings this information together over hundreds of milliseconds to perceive others remains unclear. In 2 studies, we investigated how facial and vocal cues are integrated during real-time social categorization by recording participants' hand movements (via the streaming x, y coordinates of the computer mouse) en route to “male” and “female” responses on the screen. Participants were presented with male and female faces that were accompanied by a same-sex voice morphed to be either sex-typical (e.g., masculinized male voice) or sex-atypical (i.e., feminized male voice). Before settling into ultimate sex categorizations of the face, the simultaneous processing of a sex-atypical voice led the hand to be continuously attracted to the opposite sex-category response across construal. This is evidence that ongoing results from voice perception continuously influence face perception across processing. Thus, social categorization involves dynamic updates of gradual integration of the face and voice.     

Face adaptation to gender: Does adaptation transfer across age categories?

We examined gender adaptation effects for the faces of children and adults and measured the transfer of these effects across age categories. Face gender adaptation is defined by a bias to classify the gender of a gender-neutral face to be opposite to that of an adapting face. An androgynous face, for example, appears male following adaptation to a female face. Participants adapted to male or female faces from the two age categories and classified the gender of morphed adult and child faces from a male–female morph trajectory. Gender adaptation effects were found for children's and adults’ faces and for the transfer between the age categories. The size of these effects was comparable when participants adapted to adult faces and identified the gender of either adult or child faces, and when participants adapted to child faces and identified the gender of child faces. A smaller adaptation effect was found when participants adapted to a child's face but identified the gender of an adult's face. The results indicate an interconnected and partially shared representation of the gender information for child and adult faces. The lack of symmetry in adaptation transfer between child and adult faces suggests that adaptation to adult faces is more effective than adaptation to child faces in activating a gender representation that generalizes across age categories.     

Removing the own-race bias in face recognition by attentional shift using fixation crosses to diagnostic features: An eye-tracking study

Hills and Lewis (2011) have demonstrated that the own-race bias in face recognition can be reduced or even removed by guiding participants' attention and potentially eye movements to the most diagnostic visual features. Using the same old/new recognition paradigm as Hills and Lewis, we recorded Black and White participants' eye movements whilst viewing Black and White faces following fixation crosses that preceded the bridge of the nose (between the eyes) or the tip of the nose. White faces were more accurately recognized when following high fixation crosses (that preceded the bridge of the nose) than when following low fixation crosses. The converse was true for Black faces. These effects were independent of participant race. The fixation crosses attracted the first fixation but had less effect on other eye-tracking measures. Furthermore, the location of the first fixation was predictive of recognition accuracy. These results are consistent with an attentional allocation model of the own-race bias in face recognition and highlight the importance of the first fixation for face perception (cf. Hsiao & Cottrell, 2008).     

Variability in photos of the same face

Psychological studies of face recognition have typically ignored within-person variation in appearance, instead emphasising differences between individuals. Studies typically assume that a photograph adequately captures a person’s appearance, and for that reason most studies use just one, or a small number of photos per person. Here we show that photographs are not consistent indicators of facial appearance because they are blind to within-person variability. Crucially, this within-person variability is often very large compared to the differences between people. To investigate variability in photos of the same face, we collected images from the internet to sample a realistic range for each individual. In Experiments 1 and 2, unfamiliar viewers perceived images of the same person as being different individuals, while familiar viewers perfectly identified the same photos. In Experiment 3, multiple photographs of any individual formed a continuum of good to bad likeness, which was highly sensitive to familiarity. Finally, in Experiment 4, we found that within-person variability exceeded between-person variability in attractiveness. These observations are critical to our understanding of face processing, because they suggest that a key component of face processing has been ignored. As well as its theoretical significance, this scale of variability has important practical implications. For example, our findings suggest that face photographs are unsuitable as proof of identity.     

Task effects, performance levels, features, configurations, and holistic face processing: A reply to Rossion

A recent article in Acta Psychologica (“Picture-plane inversion leads to qualitative changes of face perception” by Rossion [Rossion, B. (2008). Picture-plane inversion leads to qualitative changes of face perception. Acta Psychologica (Amst), 128(2), 274-289]) criticized several aspects of an earlier paper of ours [Riesenhuber, M., Jarudi, I., Gilad, S., & Sinha, P. (2004). Face processing in humans is compatible with a simple shape-based model of vision. Proceedings of the Royal Society of London B (Supplements), 271, S448-S450]. We here address Rossion’s criticisms and correct some misunderstandings. To frame the discussion, we first review our previously presented computational model of face recognition in cortex [Jiang, X., Rosen, E., Zeffiro, T., Vanmeter, J., Blanz, V., & Riesenhuber, M. (2006). Evaluation of a shape-based model of human face discrimination using FMRI and behavioral techniques. Neuron, 50(1), 159-172] that provides a concrete biologically plausible computational substrate for holistic coding, namely a neural representation learned for upright faces, in the spirit of the original simple-to-complex hierarchical model of vision by Hubel and Wiesel. We show that Rossion’s and others’ data support the model, and that there is actually a convergence of views on the mechanisms underlying face recognition, in particular regarding holistic processing.     

Aftereffects for face attributes with different natural variability: Children are more adaptable than adolescents

Adults can be adapted to a particular facial distortion in which both eyes are shifted symmetrically (Robbins, R., McKone, E., & Edwards, M. (2007). Aftereffects for face attributes with different natural variability: Adapter position effects and neural models. Journal of Experimental Psychology: Human Perception and Performance, 33, 570–592), but they do not show as great adaptation to an asymmetrical eye distortion. We adapted children and adolescents to symmetrical and asymmetrical eye distortions and measured the aftereffects. Children (aged 6–12, mean age 9 years) showed larger aftereffects than adolescents (aged 13–18, mean age 15 years) and demonstrated aftereffects of a similar magnitude for both asymmetrical and symmetrical distortions. Adolescents only showed aftereffects for symmetrical distortions. We propose that children may have a more flexible face norm and neural responses that allow a broader range of adapted states compared to adolescents.     

What the face and body reveal: in-group emotion effects and stereotyping of emotion in African American and European American children

This study examined whether 3- to 7-year-old African American and European American children’s assessment of emotion in face-only, face + body, and body-only photographic stimuli was affected by in-group emotion recognition effects and racial or gender stereotyping of emotion. Evidence for racial in-group effects was found, with European American children being more accurate when assessing emotion in European American photographs than African American photographs for some emotions. African American children were either equally proficient in recognizing emotion in African American and European American photographs or were more accurate with European American photographs for some emotions. Stereotyping of emotion was also found, with boys being more often labeled with “masculine” emotions (e.g., mad) and at least some girls being more often labeled with “feminine” emotions (e.g., happy). However, stereotyping effects were found only when the face was present in the stimuli and were not found with body-only stimuli. In-group effects, however, were not affected by type of photograph (face-only, body-only, or face + body), with children being unable to recognize at least some emotions from just the body postures alone (mad). These results have important implications for how future studies assess emotion recognition in children, particularly in terms of how emotion stimuli are constructed, the diversity of the stimuli, and who judges the stimuli.     

The role of motion and speech in face recognition at birth

Newborns, a few hours after birth, already encounter many different faces, talking or silently moving. How do they process these faces and which cues are important in early face recognition? In a series of six experiments, newborns were familiarized with an unfamiliar face in different contexts (photographs, talking, silently moving, and with only external movements of the head with speech sound). At test, they saw the familiar and a new faces either in photographs, silently moving, or talking. A novelty preference was evidenced at test when photographs were presented in the two phases. This result supports those already evidenced in several studies. A familiarity preference appeared only when the face was seen talking in the familiarization phase and in a photograph or talking again at test. This suggests that the simultaneous presence of speech sound, and rigid and nonrigid movements present in a talking face enhances recognition of interactive faces at birth.     

Hemispheric asymmetry in cross-race face recognition

This study examines two phenomena related to face perception, both of which depend on experience and holistic processing: perceivers process faces more efficiently in the right hemisphere of the brain (a hemispheric asymmetry), and they typically show greater recognition accuracy for members of their racial ingroup (a cross-race recognition deficit). The current study tests the possibility that these two effects are related. If asymmetry depends on experience, it should be particularly evident with (more familiar) ingroup faces; if cross-race recognition relies on holistic processing, it should be particularly evident for faces presented to the right hemisphere. Black and White participants viewed Black and White faces presented to either the left or right visual field. As predicted, participants showed a more pronounced asymmetry for ingroup (rather than outgroup) faces, and cross-race recognition deficits were more pronounced for stimuli presented to the left (rather than the right) visual field.     

Sad people are more accurate at face recognition than happy people

Mood has varied effects on cognitive performance including the accuracy of face recognition (Lundh & Ost, 1996). Three experiments are presented here that explored face recognition abilities in mood-induced participants. Experiment 1 demonstrated that happy-induced participants are less accurate and have a more conservative response bias than sad-induced participants in a face recognition task. Using a remember/know/guess procedure, Experiment 2 showed that sad-induced participants had more conscious recollections of faces than happy-induced participants. Additionally, sad-induced participants could recognise all faces accurately, whereas, happy- and neutral-induced participants recognised happy faces more accurately than sad faces. In Experiment 3, these effects were not observed when participants intentionally learnt the faces, rather than incidentally learnt the faces. It is suggested that happy-induced participants do not process faces as elaborately as sad-induced participants.     

Electrophysiological correlates of face distortion after-effects

When observers are exposed to a distorted face the perceived configuration of a subsequently presented face is altered, a phenomenon called face distortion after-effect (FDAE). We compared the face-related components of the event-related potential (ERP) after adaptation to noise images—veridical and distorted faces. We found large bilateral adaptation effects on the P100 and N170 components that are related to face detection. Moreover, we found smaller adaptation effects on the N170, recorded over the right hemisphere, which can be related to the behavioural distortion after-effect and to face configurations. Our results suggest that the observed ERP adaptation effects are general for various steps of face processing and that the FDAEs similarly to gender after-effects are related to the early face-specific ERP components.     

Reducing the own-race bias in face recognition by attentional shift using fixation crosses preceding the lower half of a face

Hills and Lewis (2006) reduced White participants’ own-race bias (ORB) in face recognition by training them to attend to features critical for Black faces (lower portion of the face). Here, the ORB was investigated following a brief fixation cross either in the upper portion of the face (critical for White faces) or the lower portion of the face. Results showed that when the cross preceded the lower portion of the face, Black faces were recognized more accurately than White faces and vice versa when it preceded the upper portion of the face. A second experiment demonstrated that this effect disappears if the participants are forced to delay their responses by 4 s. These results suggest that an immediate attentional mechanism can attenuate the ORB when immediate attention is paid to diagnostic features but this can be overridden with increased time spent viewing faces.     

Race categorization modulates holistic face encoding

Recent studies have shown that same-race (SR) faces are processed more holistically than other-race (OR) faces, a difference that may underlie the greater difficulty at recognizing OR than SR faces (the "other-race effect"). This article provides original evidence suggesting that the holistic processing of faces may be sensitive to the observers' racial categorization of the face. In Experiment 1, Caucasian participants performed a face-composite task with Caucasian faces, Asian faces, and racially ambiguous morphed face stimuli. Identical morphed face stimuli were processed more holistically when categorized as SR than as OR faces. Experiment 2 further suggests that this finding was not underlain by strategic or training effects. Overall, these results support the view that one's categorization of a face as belonging to the same or another race plays a critical role in the holistic processing of this face.     

Typicality effects in face and object perception: further evidence for the attractor field model

In a previous study, it was shown that a 50/50 morph of a typical and an atypical parent face was perceived to be more similar to the atypical parent face than to the typical parent face (Tanaka, Giles, Kremen, & Simon, 1998). Experiments 1 and 2 examine face typicality effects in a same/different discrimination task in which typical or atypical faces and their 80%, 70%, 60%, and 50% morphs were presented sequentially (Experiment 1) or simultaneously (Experiment 2). The main finding was that in both modes of presentation, atypical morphs were more poorly discriminated than their corresponding typical morphs. In Experiment 3, typicality effects were extended to the perception of nonface objects; in this instance, it was found that 50/50 morphs of birds and cars were judged to be more similar to their atypical parents than to their typical parents. These results are consistent with an attractor field model, in which it is proposed that the perception of a face or object stimulus depends not only on its fit to an underlying representation, but also on the representation's location in the similarity space.     

Knowing what to look for: Voice affects face race judgements

The study examined the effect that auditory information (speaker language/accent: Japanese or French) had on the processing of visual information (the speaker's race: Asian or Caucasian) in two forced-choice tasks: Classification and perceptual judgement on animated talking characters. Two (male and female) sets of facial morphs were constructed such that a 3-D head of Caucasian appearance was gradually morphed (in 11 steps) into one of Asian appearance. Each facial morph was animated in association with spoken French/Japanese or English with a French/Japanese accent. To examine the auditory effect, each animation was played with or without sound. Experiment 1 used an Asian or Caucasian classification task. Results showed that faces heard in conjunction with Japanese or a Japanese accent were more likely to be classified as Asian compared to those presented without sound. Experiment 2 used a same or different judgement task. Results showed that accuracy was improved by hearing a Japanese accent compared to without sound. These results were discussed in terms of the voice information acting as a cue to assist in organizing and attending to face features.