The role of spatial and surface cues in the age-processing of unfamiliar faces

Two experiments investigated the importance of spatial and surface cues in the age-processing of unfamiliar faces aged between one and 80 years. Three manipulations known to affect face recognition were used, individually and in various combinations: inversion, negation, and blurring. Faces were presented either in whole or in part. Age-estimation performance was largely unaffected by most of these manipulations; age-processing appears to be a highly robust process, due to the numerous cues available. Experiment 1 showed that, in contrast to face recognition, age-perception appears to be substantially unimpaired by inversion or negation. Experiment 2 suggests that age-estimates can be made on the basis of either surface information (the 2D disposition of the internal facial features, together with texture information) or shape information (head-shape plus feature configuration, as long as shape-from-shading information is present).     

Face processing and familiarity: Evidence from eye‐movement data

How is information extracted from familiar and unfamiliar faces? Three experiments, in which eye‐movement measures were used, examined whether there was differential sampling of the internal face region according to familiarity. Experiment 1 used a face familiarity task and found that whilst the majority of fixations fell within the internal region, there were no differences in the sampling of this region according to familiarity. Experiment 2 replicated these findings, using a standard recognition memory paradigm. The third experiment employed a matching task, and once again found that the majority of fixations fell within the internal region. Additionally, this experiment found that there was more sampling of the internal region when faces were familiar compared with when they were unfamiliar. The use of eye fixation measures affirms the importance of internal facial features in the recognition of familiar faces compared with unfamiliar faces, but only when viewers compare pairs of faces.     

Tolerance for distorted faces: Challenges to a configural processing account of familiar face recognition

Face recognition is widely held to rely on ‘configural processing’, an analysis of spatial relations between facial features. We present three experiments in which viewers were shown distorted faces, and asked to resize these to their correct shape. Based on configural theories appealing to metric distances between features, we reason that this should be an easier task for familiar than unfamiliar faces (whose subtle arrangements of features are unknown). In fact, participants were inaccurate at this task, making between 8% and 13% errors across experiments. Importantly, we observed no advantage for familiar faces: in one experiment participants were more accurate with unfamiliars, and in two experiments there was no difference. These findings were not due to general task difficulty – participants were able to resize blocks of colour to target shapes (squares) more accurately. We also found an advantage of familiarity for resizing other stimuli (brand logos). If configural processing does underlie face recognition, these results place constraints on the definition of ‘configural’. Alternatively, familiar face recognition might rely on more complex criteria – based on tolerance to within-person variation rather than highly specific measurement.     

Expression influences the recognition of familiar faces

Face recognition has been assumed to be independent of facial expression. We used familiar and unfamiliar faces that were morphed from a happy to an angry expression within a given identity. Participants performed speeded two-choice decisions according to whether or not a face was familiar. Consistent with earlier findings, reaction times for classifications of unfamiliar faces were independent of facial expressions. In contrast, expression clearly influenced the recognition of familiar faces. with fastest recognition for moderately happy expressions. This suggests that representations of familiar faces for recognition preserve some information about typical emotional expressions.     

Order of feature recognition in familiar and unfamiliar faces

Three experiments measured order of processing for single faces presented to the left or right visual field (VF) using a same-different matching task. In contrast to earlier studies, the stimuli in the present experiments were carefully matched for overall similarity prior to the actual experiments. Experiments 1 and 2 showed that a significant top-to-bottom order of processing occurred for line drawings of unfamiliar faces but not for line drawings of familiar faces. Experiment 3 found evidence supporting top-to-bottom processing for unfamiliar photographic face stimuli. The photographic stimuli in Experiment 3 were matched more quickly when presented in the left VF (right hemisphere); however, this VF asymmetry was not related to previously reported differences in order of processing. It is suggested that under some conditions faces presented to the right hemisphere may be processed more like familiar faces than faces presented to the left hemisphere; however, this difference is not critical for the left VF (right hemisphere) superiority often found in face recognition tasks.     

The effect of familiarity on face adaptation

Face aftereffects can provide information on how faces are stored by the human visual system (eg Leopold et al, 2001 Nature Neuroscience 4 89-94), but few studies have used robustly represented (highly familiar) faces. In this study we investigated the influence of facial familiarity on adaptation effects. Participants were adapted to a series of distorted faces (their own face, a famous face, or an unfamiliar face). In experiment 1, figural aftereffects were significantly smaller when participants were adapted to their own face than when they were adapted to the other faces (ie their own face appeared significantly less distorted than a famous or unfamiliar face). Experiment 2 showed that this 'own-face' effect did not occur when the same faces were used as adaptation stimuli for participants who were unfamiliar with them. Experiment 3 replicated experiment 1, but included a pre-adaptation baseline. The results highlight the importance of considering facial familiarity when conducting research on face aftereffects.     

Dominance of texture over shape in facial identity processing is modulated by individual abilities

For face recognition, observers utilize both shape and texture information. Here, we investigated the relative diagnosticity of shape and texture for delayed matching of familiar and unfamiliar faces (Experiment 1) and identifying familiar and newly learned faces (Experiment 2). Within each familiarity condition, pairs of 3D‐captured faces were morphed selectively in either shape or texture in 20% steps, holding the respective other dimension constant. We also assessed participants’ individual face‐processing skills via the Bielefelder Famous Faces Test (BFFT), the Glasgow Face Matching Test, and the Cambridge Face Memory Test (CFMT). Using multilevel model analyses, we examined probabilities of same versus different responses (Experiment 1) and of original identity versus other/unknown identity responses (Experiment 2). Overall, texture was more diagnostic than shape for both delayed matching and identification, particularly so for familiar faces. On top of these overall effects, above‐average BFFT performance was associated with enhanced utilization of texture in both experiments. Furthermore, above‐average CFMT performance coincided with slightly reduced texture dominance in the delayed matching task (Experiment 1) and stronger sensitivity to morph‐based changes overall, that is irrespective of morph type, in the face identification task (Experiment 2). Our findings (1) show the disproportionate importance of texture information for processing familiar face identity and (2) provide further evidence that familiar and unfamiliar face identity perception are mediated by different underlying processes.     

Hearing facial identities

While audiovisual integration is well known in speech perception, faces and speech are also informative with respect to speaker recognition. To date, audiovisual integration in the recognition of familiar people has never been demonstrated. Here we show systematic benefits and costs for the recognition of familiar voices when these are combined with time-synchronized articulating faces, of corresponding or noncorresponding speaker identity, respectively. While these effects were strong for familiar voices, they were smaller or nonsignificant for unfamiliar voices, suggesting that the effects depend on the previous creation of a multimodal representation of a person's identity. Moreover, the effects were reduced or eliminated when voices were combined with the same faces presented as static pictures, demonstrating that the effects do not simply reflect the use of facial identity as a “cue” for voice recognition. This is the first direct evidence for audiovisual integration in person recognition.     

Effects of geometric distortions on face-recognition performance

The importance of 'configural' processing for face recognition is now well established, but it remains unclear precisely what it entails. Through four experiments we attempted to clarify the nature of configural processing by investigating the effects of various affine transformations on the recognition of familiar faces. Experiment 1 showed that recognition was markedly impaired by inversion of faces, somewhat impaired by shearing or horizontally stretching them, but unaffected by vertical stretching of faces to twice their normal height. In experiment 2 we investigated vertical and horizontal stretching in more detail, and found no effects of either transformation. Two further experiments were performed to determine whether participants were recognising stretched faces by using configural information. Experiment 3 showed that nonglobal vertical stretching of faces (stretching either the top or the bottom half while leaving the remainder undistorted) impaired recognition, implying that configural information from the stretched part of the face was influencing the process of recognition--ie that configural processing involves global facial properties. In experiment 4 we examined the effects of Gaussian blurring on recognition of undistorted and vertically stretched faces. Faces remained recognisable even when they were both stretched and blurred, implying that participants were basing their judgments on configural information from these stimuli, rather than resorting to some strategy based on local featural details. The tolerance of spatial distortions in human face recognition suggests that the configural information used as a basis for face recognition is unlikely to involve information about the absolute position of facial features relative to each other, at least not in any simple way.     

Hearing facial identities

While audiovisual integration is well known in speech perception, faces and speech are also informative with respect to speaker recognition. To date, audiovisual integration in the recognition of familiar people has never been demonstrated. Here we show systematic benefits and costs for the recognition of familiar voices when these are combined with time-synchronized articulating faces, of corresponding or noncorresponding speaker identity, respectively. While these effects were strong for familiar voices, they were smaller or nonsignificant for unfamiliar voices, suggesting that the effects depend on the previous creation of a multimodal representation of a person's identity. Moreover, the effects were reduced or eliminated when voices were combined with the same faces presented as static pictures, demonstrating that the effects do not simply reflect the use of facial identity as a “cue” for voice recognition. This is the first direct evidence for audiovisual integration in person recognition.     

Face recognition and emotional valence: processing without awareness by neurologically intact participants does not simulate covert recognition in prosopagnosia

Covert face recognition in neurologically intact participants was investigated with the use of very brief stimulus presentation to prevent awareness of the stimulus. In Experiment 1, skin conductance response (SCR) to photographs of celebrity and unfamiliar faces was recorded; the faces were displayed for 220 msec and for 17 msec in a within-participants design. SCR to faces presented for 220 msec was larger and more likely to occur with familiar faces than with unfamiliar faces. Face familiarity did not affect the SCR to faces presented for 17 msec. SCR was larger for faces of good than for faces of evil celebrities presented for 17 msec, but valence did not affect SCR to faces displayed for 220 msec. In Experiment 2, associative priming was found in a face familiarity decision task when the prime face was displayed for 220 msec, but no facilitation occurred when primes were presented for 17 msec. In Experiment 3, participants were able to differentiate evil and good faces presented without awareness in a two-alternative forced-choice decision. The results provide no evidence of familiarity detection outside awareness in normal participants and suggest that, contrary to previous research, very brief presentation to neurologically intact participants is not a useful model for the types of covert recognition found in prosopagnosia. However, a response based on affective valence appears to be available from brief presentation.     

Geometric distortions affect face recognition in chimpanzees (<Emphasis Type="Italic">Pan troglodytes</Emphasis>) and monkeys (<Emphasis Type="Italic">Macaca mulatta</Emphasis>)

All primates can recognize faces and do so by analyzing the subtle variation that exists between faces. Through a series of three experiments, we attempted to clarify the nature of second-order information processing in nonhuman primates. Experiment one showed that both chimpanzees (Pan troglodytes) and rhesus monkeys (Macaca mulatta) tolerate geometric distortions along the vertical axis, suggesting that information about absolute position of features does not contribute to accurate face recognition. Chimpanzees differed from monkeys, however, in that they were more sensitive to distortions along the horizontal axis, suggesting that when building a global representation of facial identity, horizontal relations between features are more diagnostic of identity than vertical relations. Two further experiments were performed to determine whether the monkeys were simply less sensitive to horizontal relations compared to chimpanzees or were instead relying on local features. The results of these experiments confirm that monkeys can utilize a holistic strategy when discriminating between faces regardless of familiarity. In contrast, our data show that chimpanzees, like humans, use a combination of holistic and local features when the faces are unfamiliar, but primarily holistic information when the faces become familiar. We argue that our comparative approach to the study of face recognition reveals the impact that individual experience and social organization has on visual cognition.     

Recognition memory across the adult life span: The role of prior knowledge

Two experiments were performed to investigate the effects of prior knowledge on recognition memory in young adults, younger old adults, 76-year-olds, and 85-year-olds. In Experiment 1, we examined episodic recognition of dated and contemporary famous persons presented as faces, names, and faces plus names. In Experiment 2, four types of faces were presented for later recognition: dated familiar, contemporary familiar, old unfamiliar, and young unfamiliar. The results of both experiments showed that young adults performed better with contemporary than with dated famous persons, whereas the reverse was true for all groups of older adults. In addition, the data of Experiment 2 indicated that (1) young adults showed better recognition for young than for old unfamiliar faces, (2) younger old adults performed better with old than with young unfamiliar faces, and (3) the two oldest age groups showed no effect of age of face. These results suggest that the ability to utilize rich semantic knowledge to improve episodic memory is preserved in very old age, although the aging process may be associated with deficits in the ability to utilize prior knowledge to support memory when the underlying representation lacks semantic and contextual features. The overall data pattern was discussed in relation to the notion that, with increasing adult age, there is an increase in the level of cognitive support required to enhance episodic remembering.     

Covert detection of attractiveness among the neurologically intact: evidence from skin-conductance responses

Several studies have shown that participants, without a deficit in face recognition, give an increased skin conductance response (SCR) to familiar faces when presented subliminally, hence suggesting covert recognition of these faces. In the experiment presented here we manipulated familiarity and attractiveness and tested whether participants distinguished between faces for these variables when presented too fast to allow conscious recognition. Three sets of faces were presented: famous attractive; unfamiliar attractive; and unfamiliar less attractive. SCRs were the same for each category of faces whether presented subliminally or supraliminally, and were the same for attractive faces, whether famous or unfamiliar; however, SCRs differed between the attractive and less attractive faces. The findings support those of Stone et al (2001 Cognitive, Affective and Behavioral Neuroscience 1 183-191) and suggest that higher SCRs to famous faces are not necessarily due to covert recognition, but may be a response to the positive affective valence of the stimuli.     

Two routes to face perception: evidence from psychophysics and computational modeling

The aim of this study was to separately analyze the role of featural and configural face representations. Stimuli containing only featural information were created by cutting the faces into their parts and scrambling them. Stimuli only containing configural information were created by blurring the faces. Employing an old-new recognition task, the aim of Experiments 1 and 2 was to investigate whether unfamiliar faces (Exp. 1) or familiar faces (Exp. 2) can be recognized if only featural or configural information is provided. Both scrambled and blurred faces could be recognized above chance level. A further aim of Experiments 1 and 2 was to investigate whether our method of creating configural and featural stimuli is valid. Pre-activation of one form of representation did not facilitate recognition of the other, neither for unfamiliar faces (Exp. 1) nor for familiar faces (Exp. 2). This indicates a high internal validity of our method for creating configural and featural face stimuli. Experiment 3 examined whether features placed in their correct categorical relational position but with distorted metrical distances facilitated recognition of unfamiliar faces. These faces were recognized no better than the scrambled faces in Experiment 1, providing further evidence that facial features are stored independently of configural information. From these results we conclude that both featural and configural information are important to recognize a face and argue for a dual-mode hypothesis of face processing. Using the psychophysical results as motivation, we propose a computational framework that implements featural and configural processing routes using an appearance-based representation based on local features and their spatial relations. In three computational experiments (Experiments 4–6) using the same sets of stimuli, we show how this framework is able to model the psychophysical data.     

Recognizing familiar and unfamiliar faces

These experiments addressed why, in episodic-memory tests, familiar faces are recognized better than unfamiliar faces. Memory for faces of well-known public figures and unfamiliar persons was tested, not only with old/new recognition tests, in which initially viewed faces were discriminated from dis tractors, but also with tests of memory for specific information. These included: detail recall, in which a masked feature had to be described; orientation recognition, in which discrimination between originally seen faces and mirror-image reversals was required; and recognition and recall of labels for the public figures. Experiments 1 and 2 showed that memory for orientation and featural details was not robustly related either to facial familiarity or to old/new recognition rates. Experiment 3 showed that memory for labels was not the exclusive determinant of the famous-face advantage in recognition, since famous faces were highly recognizable even they were not labelable or when labels were forgotten. These results suggest that the familiarity effect, and face recognition in general, may reflect a nonverbal memory representation that is relatively abstract.     

Telling faces together: Learning new faces through exposure to multiple instances

We are usually able to recognize novel instances of familiar faces with little difficulty, yet recognition of unfamiliar faces can be dramatically impaired by natural within-person variability in appearance. In a card-sorting task for facial identity, different photos of the same unfamiliar face are often seen as different people. Here we report two card-sorting experiments in which we manipulate whether participants know the number of identities present. Without constraints, participants sort faces into many identities. However, when told the number of identities present, they are highly accurate. This minimal contextual information appears to support viewers in “telling faces together”. In Experiment 2 we show that exposure to within-person variability in the sorting task improves performance in a subsequent face-matching task. This appears to offer a fast route to learning generalizable representations of new faces.     

Tolerance of geometric distortions in infant's face recognition

The aim of the current study is to reveal the effect of global linear transformations (shearing, horizontal stretching, and vertical stretching) on the recognition of familiar faces (e.g., a mother's face) in 6- to 7-month-old infants. In this experiment, we applied the global linear transformations to both the infants’ own mother's face and to a stranger's face, and we tested infants’ preference between these faces. We found that only 7-month-old infants maintained preference for their own mother's face during the presentation of vertical stretching, while the preference for the mother's face disappeared during the presentation of shearing or horizontal stretching. These findings suggest that 7-month-old infants might not recognize faces based on calculating the absolute distance between facial features, and that the vertical dimension of facial features might be more related to infants’ face recognition rather than the horizontal dimension.     

The sibling familiarity effect: Is within-person facial variability shared across siblings?

Humans are experts at familiar face recognition, but poor at unfamiliar face recognition. Familiarity is created when a face is encountered across varied conditions, but the way in which a person’s appearance varies is identity-specific, so familiarity with one identity does not benefit recognition of other individuals. However, the faces of biological siblings share structural similarities, so we explored whether the benefits of familiarity are shared across siblings. Results show that familiarity with one half of a sibling pair improves kin detection (experiment 1), and that unfamiliar face matching is more accurate when targets are the siblings of familiar versus unfamiliar individuals (experiment 2). PCA applied to facial images of celebrities and their siblings demonstrates that faces are generally better reconstructed in the principal components of a same-sex sibling than those of an unrelated individual. When we encounter the unfamiliar sibling of someone we already know, our pre-existing representation of their familiar relation may usefully inform processing of the unfamiliar face. This can benefit both kin detection and identity processing, but the benefits are constrained by the degree to which facial variability is shared.     

Recognizing people from the inner or outer parts of their faces: Developmental data concerning ‘unfamiliar’ faces

Existing data demonstrate a developmental trend in the way in which highly familiar faces are recognized, such that young children rely more on the outer facial features (the hairline, chin and ears) than the inner facial features (the eyes, nose and mouth) and adults demonstrate the reverse pattern. However, little is known about the developmental pattern of importance of inner and outer facial features for recognizing people who are not highly familiar. Here we report a study which attempts to describe this pattern. Using a two‐alternative forced‐choice procedure, we presented 5‐, 7‐, and 9‐year‐olds and adults (N = 22 in each group) with the task of recognizing an experimentally familiarized face (initially seen in a short video) from a still picture of either the whole face, just the inner, or just the outer parts. The results showed that, for all ages, recognition was faster (and in most cases, more accurate) for outer features alone than for inner features alone (and was fastest for whole faces). These data demonstrate the importance of outer facial features for the recognition of relatively unfamiliar faces. Taken together with previous findings, they enhance our picture of the effects of age and experience with individual faces on recognition and configural processing.