Recognizing face identity from natural and morphed smiles

It is easier to identify a degraded familiar face when it is shown moving (smiling, talking; nonrigid motion), than when it is displayed as a static image (Knight & Johnston, 1997; Lander, Christie, & Bruce, 1999). Here we explore the theoretical underpinnings of the moving face recognition advantage. In Experiment 1 we show that the identification of personally familiar faces when shown naturally smiling is significantly better than when the person is shown artificially smiling (morphed motion), as a single static neutral image or as a single static smiling image. In Experiment 2 we demonstrate that speeding up the motion significantly impairs the recognition of identity from natural smiles, but has little effect on morphed smiles. We conclude that the recognition advantage for face motion does not reflect a general benefit for motion, but suggests that, for familiar faces, information about their characteristic motion is stored in memory.     

Why are moving faces easier to recognize?

Previous work has suggested that seeing a famous face move aids the recognition of identity, especially when viewing conditions are degraded (Knight & Johnston, ; Lander, Christie, & Bruce, ). Experiment 1 investigated whether the beneficial effects of motion are related to a particular type of facial motion (expressing, talking, or rigid motion). Results showed a significant beneficial effect of both expressive and talking movements, but no advantage for rigid motion, compared with a single static image. Experiment 2 investigated whether the advantage for motion is uniform across identity. Participants rated moving famous faces for distinctiveness of motion. The famous faces (moving and static freeze frame) were then used as stimuli in a recognition task. The advantage for face motion was significant only when the motion displayed was distinctive. Results suggest that a reason why moving faces are easier to recognize is because some familiar faces have characteristic motion patterns, which act as an additional cue to identity.     

Exploring the role of characteristic motion when learning new faces

Previous research has shown that it is easier to recognize familiar faces when shown moving, rather than static, especially when viewing conditions are difficult (Knight & Johnston, 1997; Lander, Christie, & Bruce, 1999). One possible theoretical reason for the moving-face advantage is that we learn "characteristic motion signatures" for familiar faces, associated with the face representation in memory. To examine this idea we investigated the role of motion at test when learning faces from either static images or moving sequences (Experiment 1). Results suggest that there is only an advantage for motion at test when the face is learned moving. In Experiment 2 we map the importance of facial motion as a face becomes increasingly familiar, on a television drama. We demonstrate that the beneficial effect of motion is not dependent on the amount of time the face is viewed. Results from both experiments support the idea of rapidly learned characteristic motion patterns.     

Repetition priming from moving faces

Recent experiments have suggested that seeing a familiar face move provides additional dynamic information to the viewer, useful in the recognition of identity. In four experiments, repetition priming was used to investigate whether dynamic information is intrinsic to the underlying face representations. The results suggest that a moving image primes more effectively than a static image, even when the same static image is shown in the prime and the test phases (Experiment 1). Furthermore, when moving images are presented in the test phase (Experiment 2), there is an advantage for moving prime images. The most priming advantage is found with naturally moving faces, rather than with those shown in slow motion (Experiment 3). Finally, showing the same moving sequence at prime and test produced more priming than that found when different moving sequences were shown (Experiment 4). The results suggest that dynamic information is intrinsic to the face representations and that there is an advantage to viewing the same moving sequence at prime and test.     

The role of motion in learning new faces

Four experiments are reported that investigate the usefulness of rigid (head nodding, shaking) and nonrigid (talking, expressions) motion for establishing new face representations of previously unfamiliar faces. Results show that viewing a face in motion leads to more accurate face learning, compared with viewing a single static image (Experiment 1). The advantage for viewing the face moving rigidly seems to be due to the different angles of view contained in these sequences (Experiment 2). However, the advantage for nonrigid motion is not simply due to multiple images (Experiment 3) and is not specifically linked to forwards motion but extends to reversed sequences (Experiment 4). Thus, although we have demonstrated beneficial effects of motion for face learning, they do not seem to be due to the specific dynamic properties of the sequences shown. Instead, the advantage for nonrigid motion may reflect increased attention to faces moving in a socially important manner.     

The role of movement in the recognition of famous faces

The effects of movement on the recognition of famous faces shown in difficult conditions were investigated. Images were presented as negatives, upside down (inverted), and thresholded. Results indicate that, under all these conditions, moving faces were recognized significantly better than static ones. One possible explanation of this effect could be that a moving sequence contains more static information about the different views and expressions of the face than does a single static image. However, even when the amount of static information was equated (Experiments 3 and 4), there was still an advantage for moving sequences that contained their original dynamic properties. The results suggest that the dynamics of the motion provide additional information, helping to access an established familiar face representation. Both the theoretical and the practical implications for these findings are discussed.     

Repetition priming and face processing: Priming occurs within the system that responds to the identity of a face

A familiar stimulus that has recently been recognized will be recognized a second time more quickly and more accurately than if it had not been primed by the earlier encounter. This is the phenomenon of “repetition priming”. Four experiments on repetition priming of face recognition suggest that repetition priming is a consequence of changes within the system that responds to the familiarity of a stimulus. In Experiment 1, classifying familiar faces by occupation facilitated subsequent responses to the same faces in a familiarity decision task (Is this face familiar or unfamiliar?) but not in an expression decision task (Is this face smiling or unsmiling?) or a sex decision task (Is this face male or female?). In Experiment 2, familiar faces showed repetition priming in a familiarity decision task, regardless of whether a familiarity judgment or an expression judgment had been required when the faces were first encountered. Expression decisions to familiar faces again failed to show repetition priming. In Experiment 3, familiar faces showed repetition priming in a familiarity decision task, regardless of whether a familiarity judgment or a sex judgment had been asked for when the faces were first encountered. Sex decisions to familiar faces again failed to show repetition priming. In Experiment 4, familiarity decisions continued to show repetition priming when a brief presentation time with encouragement to respond while the face was displayed reduced response latencies to speeds comparable to those for sex and expression judgments in Experiments 1 to 3. The results are problematic for theories that propose that repetition priming is mediated by episodic records of previous acts of stimulus encoding.     

The role of dynamic information in the recognition of unfamiliar faces

The effects of movement on unfamiliar face recognition were investigated. In an incidental learning task, faces were studied either as computer-animated (moving) displays or as a series of static images, with identical numbers of frames shown for each. The movements were either nonrigid transformations (changes in expression) or rigid rotations in depth (nodding or shaking). At test, participants saw either single, static images or moving sequences. Only one experiment showed a significant effect of study type, in favor of static instances. There was no additional advantage from studying faces in motion in these experiments, in which both study types showed the same amounts of information. Recognition memory was relatively unaffected by changes in expression between study and test. Effects of viewpoint change were large when expressive transformations had been studied but much smaller when rigid rotations in depth had been studied. The series of experiments did reveal a slight advantage for testing memory with moving compared with static faces, consistent with recent findings using familiar faces. Future work will need to examine whether such effects may also be due to the additional information provided by an animated sequence.     

中国学生的自我面孔识别

已有研究表明大脑右半球具有自我面孔再认的优势。为了进一步验证这个观点,该研究使用面孔识别任务,以13名右利手的中国大学生为被试,测量被试对morphing面孔的左右手反应差异。给被试呈现第一张面孔向第二张面孔的morphing过程,当被试看到morphing的面孔更像第二张面孔时报告停止。研究有两个morphing过程：一个为由自我面孔向名人面孔morphing,另一个为好朋友面孔（熟悉的）向名人面孔morphing。结果表明当用左手反应时,被试倾向于把morphing的面孔识别为自己,研究中自我面孔再认的左手优势与已有的发现一致。另外,研究还发现在一定trials条件下,熟悉面孔再认也具有左手优势,这一结果与西方被试的结果不一致,但东西方被试对熟悉面孔再认的差异与独立型自我和互倚型自我的观点一致。该文认为神经心理学有关自我的研究可能需要考虑文化和情境的复杂性。     

Learning the moves: the effect of familiarity and facial motion on person recognition across large changes in viewing format

Familiarity with a face or person can support recognition in tasks that require generalization to novel viewing contexts. Using naturalistic viewing conditions requiring recognition of people from face or whole body gait stimuli, we investigated the effects of familiarity, facial motion, and direction of learning/test transfer on person recognition. Participants were familiarized with previously unknown people from gait videos and were tested on faces (experiment 1a) or were familiarized with faces and were tested with gait videos (experiment 1b). Recognition was more accurate when learning from the face and testing with the gait videos, than when learning from the gait videos and testing with the face. The repetition of a single stimulus, either the face or gait, produced strong recognition gains across transfer conditions. Also, the presentation of moving faces resulted in better performance than that of static faces. In experiment 2, we investigated the role of facial motion further by testing recognition with static profile images. Motion provided no benefit for recognition, indicating that structure-from-motion is an unlikely source of the motion advantage found in the first set of experiments.     

Do children utilize motion when recognizing faces?

Previous research indicates that unfamiliar faces may be recognized better if they are viewed in motion. This study utilized a three trial learning paradigm to investigate whether unfamiliar faces are learnt more quickly from moving clips than from static images. Children aged 6–7 years and 10–11 years were shown a series of faces as either static images or dynamic clips, followed by either by a static or a dynamic recognition test. Faces were recognized more accurately when presented in motion, but there was no advantage for testing in motion. Although older children were more accurate overall, younger females performed as well as older children for faces presented in motion, suggesting that females’ face processing skills develop more quickly than those of males. Results are discussed in terms of the motion advantage arising due to additional structural information enhancing the internal representation of the face.     

The effect of motion at encoding and retrieval for same- and other-race face recognition

In an experimental study, we assessed the role of motion when encoding and recognizing unfamiliar faces, using an old/new recognition memory paradigm. Our findings revealed a clear advantage for learning unfamiliar faces moving non-rigidly, compared with static faces. This advantage for motion was found with both same- and other-race faces. Furthermore, results indicate that it is more important that the face is learnt in motion than recognized from a moving clip. Interestingly, despite a reliable other-race effect being revealed, participants were able to utilize motion information exhibited by other-race faces in a manner akin to the motion advantage found for same-race faces. The implications of these findings are discussed in relation to the nature of the stored face representations, considering whether the facilitative role found here can be explained by factors other than motion per se.     

The importance of internal facial features in learning new faces

For familiar faces, the internal features (eyes, nose, and mouth) are known to be differentially salient for recognition compared to external features such as hairstyle. Two experiments are reported that investigate how this internal feature advantage accrues as a face becomes familiar. In Experiment 1, we tested the contribution of internal and external features to the ability to generalize from a single studied photograph to different views of the same face. A recognition advantage for the internal features over the external features was found after a change of viewpoint, whereas there was no internal feature advantage when the same image was used at study and test. In Experiment 2, we removed the most salient external feature (hairstyle) from studied photographs and looked at how this affected generalization to a novel viewpoint. Removing the hair from images of the face assisted generalization to novel viewpoints, and this was especially the case when photographs showing more than one viewpoint were studied. The results suggest that the internal features play an important role in the generalization between different images of an individual's face by enabling the viewer to detect the common identity-diagnostic elements across non-identical instances of the face.     

I Recognize Your Face, But I Can't Remember Your Name: A Grown up Explanation

Contemporary models of face recognition explain everyday difficulties in name retrieval by proposing that name information can only be accessed after semantic information (e.g. Bruce & Young, 1986) or by proposing an architecture which puts name retrieval at a disadvantage (e.g. Burton& Bruce,1992). Experiments reportedhere examined the time requiredto access name and semantic details by adult and child subjects. In Experiment 1 adult subjects took more time to match familiar faces to names than to other semantic details (e.g. occupation), a finding consistent with all the previous literature on name retrieval. Experiment 2, however, showed that the youngest subjects were significantly faster in matching familiar faces to names than to semantic details. Experiment 3 also showed that children were faster at accessing names than occupations when giving vocal responses to presentations of familiar faces. These findings are not predicted by rigidly sequential models of face recognition and are discussed with specific reference to the ontogenesis of models based on a more flexible connectionist architecture.     

Getting to know you: How we learn new faces

Previous work has shown an advantage for matching the internal features of familiar faces in contrast to an advantage for the external features of unfamiliar faces. In the current experiment, we tracked this shift towards an internal feature advantage as subjects were familiarized with a set of initially unfamiliar faces. They were asked to learn a set of 24 faces from video images and complete a face matching task on 3 consecutive days. Half of the faces were learned from moving images while the others were learned from static images to determine whether movement was necessary to produce the internal advantage found when matching familiar faces. We found that by the end of the 3 days, performance on the internal features had improved and was equivalent to performance on the external features. In contrast, matching of the external features remained at a relatively constant level across the experiment. Faces were learned equally well from moving and static images suggesting that movement is not necessary to promote learning of the internal features.     

Repetition Priming Follows Spontaneous but not Prompted Recognition of Familiar Faces

Reaction times to make a familiarity decision to the faces of famous people were measured after recognition of the faces in a pre-training phase had occurred spontaneously or following prompting with a name or other cue. At test, reaction times to familiar faces that had been recognized spontaneously in the pre-training phase were significantly facilitated relative to an unprimed comparison condition. Reaction times to familiar faces recognized only after prompting in the pre-training phase were not significantly facilitated. This was demonstrated both when a name prompt was used (Experiments 1 and 3) and when subjects were cued with brief semantic information (Experiment 2).

Repetition priming was not found to depend on prior spontaneous recognition per se. In Experiment 3, spontaneously recognizing a familiar face did not prime subsequent familiarity judgements when the same face had only been identified following prompting on a prior encounter. In Experiment 4, recognition memory for faces recognized after cueing was found to be over 90% accurate. This indicates that prompted recognition does not yield repetition priming, even though subjects can remember the faces. A fusion of “face recognition unit” and “episodic record” accounts of the repetition priming effect may be more useful than either theory alone in explaining these results.     

The State of Ecological Psychology

We report on two experiments that investigated the role of facial motion in the recognition of degraded famous face images. The results of these experiments suggest that seeing a face move is advantageous for the correct recognition of identity. This effect is not solely due to the extra static-based information contained in a moving sequence but is also due to additional dynamic information available from a moving face. Furthermore, famous faces were recognized more accurately when the original dynamic characteristics of the motion were maintained (Experiment 1), compared to when either the tempo or the direction of motion were altered (Experiment 2). It is suggested that there may be general benefit for viewing naturally moving faces, not specific benefit to any particular face identity. Alternatively, individual faces may have associated characteristic motion signatures.     

Dominance of texture over shape in facial identity processing is modulated by individual abilities

For face recognition, observers utilize both shape and texture information. Here, we investigated the relative diagnosticity of shape and texture for delayed matching of familiar and unfamiliar faces (Experiment 1) and identifying familiar and newly learned faces (Experiment 2). Within each familiarity condition, pairs of 3D‐captured faces were morphed selectively in either shape or texture in 20% steps, holding the respective other dimension constant. We also assessed participants’ individual face‐processing skills via the Bielefelder Famous Faces Test (BFFT), the Glasgow Face Matching Test, and the Cambridge Face Memory Test (CFMT). Using multilevel model analyses, we examined probabilities of same versus different responses (Experiment 1) and of original identity versus other/unknown identity responses (Experiment 2). Overall, texture was more diagnostic than shape for both delayed matching and identification, particularly so for familiar faces. On top of these overall effects, above‐average BFFT performance was associated with enhanced utilization of texture in both experiments. Furthermore, above‐average CFMT performance coincided with slightly reduced texture dominance in the delayed matching task (Experiment 1) and stronger sensitivity to morph‐based changes overall, that is irrespective of morph type, in the face identification task (Experiment 2). Our findings (1) show the disproportionate importance of texture information for processing familiar face identity and (2) provide further evidence that familiar and unfamiliar face identity perception are mediated by different underlying processes.     

知觉适应对种族融合面孔的种族分类和知觉辨别的影响

面孔加工的种族效应(the other-race effects)指人们对面孔做个体辨别任务时辨别本族面孔的绩效优于辨别他族面孔的绩效, 而做种族分类任务时分类他族面孔的绩效优于分类本族面孔的绩效。本研究通过知觉适应操纵被试对种族两歧(高加索和亚洲)融合面孔的种族知觉, 进而比较被试在两种条件下对同一张融合面孔进行种族分类和知觉辨别的绩效的差异。结果发现, 知觉适应能使被试产生将两歧融合面孔知觉为与原始面孔所属种族相反种族的知觉偏向, 并且, 伴随着这种知觉偏向, 两歧融合面孔的加工出现了他族分类优势和本族辨别优势, 提示社会认知因素对面孔加工的种族效应有重要作用。     

Evaluating the effectiveness of pixelation and blurring on masking the identity of familiar faces

Two experiments are reported that assess how well the identity of highly familiar (famous) faces can be masked from short naturalistic television clips. Recognition of identity was made more difficult by either pixelating (Experiment 1) or blurring (Experiment 2) the viewed face. Participants were asked to identify faces from both moving and static clips. Results indicated that participants were still able to recognize some of the viewed faces, despite these image degradations. In addition, moving images of faces were recognized better than static ones. The practical and theoretical implications of these findings are discussed. Copyright © 2001 John Wiley & Sons, Ltd.