Exploring levels of face familiarity by using an indirect face-matching measure

An experiment is reported in which participants matched complete images of unfamiliar, moderately familiar, and highly familiar faces with simultaneously presented images of internal and external features. Participants had to decide if the two images depicted same or different individuals. Matches to internal features were made faster to highly familiar faces than both to moderately familiar and to unfamiliar faces, and matches to moderately familiar faces were made faster than to unfamiliar faces. For external feature matches, this advantage was only found for "different" decision matches to highly familiar faces compared to unfamiliar faces. The results indicate that the differences in familiar and unfamiliar face processing are not the result of all-or-none effects, but seem to have a graded impact on matching performance. These findings extend the earlier work of Young et al (1985 Perception 14 737-746), and we discuss the possibility of using the matching task as an indirect measure of face familiarity.     

Improving Discrimination and Face Matching with Caricature

Identification of faces from photographs is a common security measure, but matching unfamiliar faces produces high rates of error. Caricatures of familiar people are highly identifiable because they exaggerate distinctive features. We investigated whether exaggerating unfamiliar faces through caricaturing could also improve face‐matching accuracy. In Experiment 1, face‐matching arrays were caricatured relative to an average by 30%, 50% and 70%. Correct rejection of the target‐absent arrays was improved at all levels. Accurate matches increased at 30%, but at 70%, the transformation was too extreme, and all of the arrays were more likely to be rejected. In Experiment 2, photographic identification (ID) images were caricatured by 30% and 50% and matched to life‐size photographs. Rejection of foils improved, but the ID of matching images was impaired. Modest levels of caricature may improve discrimination in unfamiliar face matching, but at stronger levels, a conservative response bias may inhibit accurate ID. Copyright © 2013 John Wiley & Sons, Ltd.     

熟悉面孔与陌生面孔识别的差异

摘 要：面孔识别包括熟悉面孔识别和陌生面孔识别,两者之间的差异已经得到了多方面的证明。神经生理学的研究发现,识别陌生面孔和熟悉面孔所激活的脑区存在差异,与识别陌生面孔相比,识别熟悉面孔的脑区活动范围更大,包括双侧前额叶、单侧颞叶、海马回、杏仁核、后扣带回和右下额叶。并且也存在脑电的差异,比如 N400和P600的差异。对陌生面孔和熟悉面孔识别具有相同影响的因素有：遮挡、倒置等;具有不同影响的因素有：视角、表情、内外部特征等。文章也探讨了陌生面孔变成熟悉面孔的过程,以及在这一过程中起主要作用的编码形式等。     

Matching familiar and unfamiliar faces on internal and external features

Two experiments are reported in which subjects were asked to match a photograph of a complete face and a simultaneously presented photograph of internal or external features of a face, deciding whether or not the two photographs were pictures of the same person. In experiment 1 'same' pairs were derived from different pictures of the same face, so that subjects had to match the faces and not the particular photographs used. Matches based on internal features were found to be faster for familiar than for unfamiliar faces, whereas there was no difference in reaction time between matches based on the external features of familiar and unfamiliar faces. Faster matching of internal features of familiar faces was found to hold equally for pairs of photographs that differed in orientation of the face or in facial expression. In experiment 2 'same' pairs were derived from the same photographs, which gave subjects the choice of matching on the basis of the features of the depicted faces or matching the photographs. Reaction times were faster than in experiment 1, and there were no differences between familiar and unfamiliar faces. The study confirms reports of differential saliency of the internal features of familiar faces, and shows that this only holds when stimuli are treated as faces. The finding thus reflects properties of structural rather than pictorial codes.     

Face processing and familiarity: Evidence from eye‐movement data

How is information extracted from familiar and unfamiliar faces? Three experiments, in which eye‐movement measures were used, examined whether there was differential sampling of the internal face region according to familiarity. Experiment 1 used a face familiarity task and found that whilst the majority of fixations fell within the internal region, there were no differences in the sampling of this region according to familiarity. Experiment 2 replicated these findings, using a standard recognition memory paradigm. The third experiment employed a matching task, and once again found that the majority of fixations fell within the internal region. Additionally, this experiment found that there was more sampling of the internal region when faces were familiar compared with when they were unfamiliar. The use of eye fixation measures affirms the importance of internal facial features in the recognition of familiar faces compared with unfamiliar faces, but only when viewers compare pairs of faces.     

Getting to know you: How we learn new faces

Previous work has shown an advantage for matching the internal features of familiar faces in contrast to an advantage for the external features of unfamiliar faces. In the current experiment, we tracked this shift towards an internal feature advantage as subjects were familiarized with a set of initially unfamiliar faces. They were asked to learn a set of 24 faces from video images and complete a face matching task on 3 consecutive days. Half of the faces were learned from moving images while the others were learned from static images to determine whether movement was necessary to produce the internal advantage found when matching familiar faces. We found that by the end of the 3 days, performance on the internal features had improved and was equivalent to performance on the external features. In contrast, matching of the external features remained at a relatively constant level across the experiment. Faces were learned equally well from moving and static images suggesting that movement is not necessary to promote learning of the internal features.     

Identification of familiar and unfamiliar faces from internal and external features: some implications for theories of face recognition

Three experiments are reported in which recognition of faces from whole faces or internal or external features was compared. In the first experiment, where the faces were of famous people, an advantage was found for identification from internal features. In the second experiment involving unfamiliar faces, however, no difference was found in recognition rates when subjects were given the internal or the external features. In a third experiment famous faces were presented and mixed with other famous faces for a recognition test. As in experiment 1, better recognition occurred from internals as compared with external features. It is argued that the internal representation for familiar faces may be qualitatively different from that for face seen just once. In particular some advantage in feature saliency may accrue to the internal or 'expressive' features of familiar faces. The implications of these results are considered in relation to general theories of face perception and recognition.     

Two routes to face perception: evidence from psychophysics and computational modeling

The aim of this study was to separately analyze the role of featural and configural face representations. Stimuli containing only featural information were created by cutting the faces into their parts and scrambling them. Stimuli only containing configural information were created by blurring the faces. Employing an old-new recognition task, the aim of Experiments 1 and 2 was to investigate whether unfamiliar faces (Exp. 1) or familiar faces (Exp. 2) can be recognized if only featural or configural information is provided. Both scrambled and blurred faces could be recognized above chance level. A further aim of Experiments 1 and 2 was to investigate whether our method of creating configural and featural stimuli is valid. Pre-activation of one form of representation did not facilitate recognition of the other, neither for unfamiliar faces (Exp. 1) nor for familiar faces (Exp. 2). This indicates a high internal validity of our method for creating configural and featural face stimuli. Experiment 3 examined whether features placed in their correct categorical relational position but with distorted metrical distances facilitated recognition of unfamiliar faces. These faces were recognized no better than the scrambled faces in Experiment 1, providing further evidence that facial features are stored independently of configural information. From these results we conclude that both featural and configural information are important to recognize a face and argue for a dual-mode hypothesis of face processing. Using the psychophysical results as motivation, we propose a computational framework that implements featural and configural processing routes using an appearance-based representation based on local features and their spatial relations. In three computational experiments (Experiments 4–6) using the same sets of stimuli, we show how this framework is able to model the psychophysical data.     

The role of attention and familiarity in face identification

How is attention allocated during face identification? Previous work using famous and unfamiliar faces suggests that either no attention or a special attentional mechanism is required. We used a conventional attentional blink (AB) procedure to measure face identification with temporarily reduced attention. The participants viewed a rapid series of face images with one embedded nonface abstract pattern (T1). They judged the texture of T1 and then detected a prespecified face (T2) presented at varying lags after T1. T2 was either famous or unfamiliar, as were distractor faces. Regardless of distractor type, detection of an unfamiliar T2 face was significantly impaired at short versus long T1-T2 lags, indicating an attentional requirement for face identification. Detection of a famous T2 face was unaffected by lag, suggesting that familiarity protects against atemporal attentional bottleneck These findings do not support propositions that face identification is "special" in its need for attentional control     

Demonstrating how unfamiliar faces become familiar using a face matching task

Two experiments examine a novel method of assessing face familiarity that does not require explicit identification of presented faces. Earlier research (Clutterbuck & Johnston, 2002; Young, Hay, McWeeny, Flude, & Ellis, 1985) has shown that different views of the same face can be matched more quickly for familiar than for unfamiliar faces. This study examines whether exposure to previously novel faces allows the speed with which they can be matched to be increased, thus allowing a means of assessing how faces become familiar. In Experiment 1, participants viewed two sets of unfamiliar faces presented for either many, short intervals or for few, long intervals. At test, previously familiar (famous) faces were matched more quickly than novel faces or learned faces. In addition, learned faces seen on many, brief occasions were matched more quickly than the novel faces or faces seen on fewer, longer occasions. However, this was only observed when participants performed “different” decision matches. In Experiment 2, the similarity between face pairs was controlled more strictly. Once again, matches were performed on familiar faces more quickly than on unfamiliar or learned items. However, matches made to learned faces were significantly faster than those made to completely novel faces. This was now observed for both same and different match decisions. The use of this matching task as a means of tracking how unfamiliar faces become familiar is discussed.     

Matching as an index of face familiarity

An experiment is reported which explores a method of assessing familiarity that does not rely on the overt recognition or identification of faces. Earlier findings (Clutterbuck & Johnston, 2002; Young, Hay, McWeeny, Flude, & Ellis, 1985) have shown that familiar faces can be matched faster on their internal features than unfamiliar faces. This study examines whether familiarization in the form of repeated exposure to novel faces over a 2 day period can facilitate internal feature match performance. Participants viewed each of a set of unfamiliar faces for 1 min in total. At test on the second day previously familiar (famous) faces were matched faster than unfamiliar and familiarized faces. However the familiarized faces were matched faster than the unfamiliar faces. We discuss the use of this task as a means of accessing a measure of familiarity formation and as a means of tracking how faces become familiar.     

Learning unfamiliar faces in infants: The advantage of the regular sequence presentation and the three‐quarter view superiority

We investigated the effect of the regular sequence of different views and the three‐quarter view effect on the learning of unfamiliar faces by infants. 3–8‐month‐old infants were familiarized with unfamiliar female faces in either the regular condition (presenting 11 different face views from the frontal view to the left‐side profile view in regular order) or the random condition (presenting the same 11 different face views in random order). Following the familiarization, infants were tested with a pair of a familiarized and a novel female face either in a three‐quarter (Experiment 1) or in a profile view (Experiment 2). Results showed that only 6–8‐month‐old infants could identify a familiarized face in the regular condition when they were tested in three‐quarter views. In contrast, 6–8‐month‐old infants showed no significant novelty preference in profile views. The results suggest that the regular sequence of different face views promotes the learning of unfamiliar faces by infants over 6 months old. Moreover, our findings imply that the three‐quarter view effect appears in infants.     

The contribution of external and internal features to the matching of unfamiliar faces

The relative efficacy of external and internal features in matching unfamiliar faces was studied in three experiments in which the subjects matched target and test faces differing in terms of external or internal features, or both. In Experiment 1 only full congruency between target and test faces was considered a match; in Experiments 2 and 3 faces sharing the same external and internal features were also considered to be matches. A total of 100 subjects matched 192 pairs of target and test faces in a same-different task. Reaction times and matching errors were recorded for analyses of variance. In all three experiments performance was best when either all features matched or all features mismatched, with mismatches having a slight edge. When matches of external and internal features with the target faces were inconsistent with each other, mismatches of external features led to faster responses in Experiments 1 and 2, and mismatches of internal features led to faster responses in Experiment 3. The results suggest that since faces are configurational stimuli, face matching is influenced by the non-relevant set of features; and that mismatches, especially of external features, influence face matching more than matches do.     

Perceptual learning in face processing: Comparison facilitates face recognition

Theoretical analyses of perceptual learning suggest that comparison between similar stimuli aids subsequent discrimination between them. The current studies examined whether the opportunity to compare a target face to other similar faces during a preexposure phase facilitated performance on a matching task. Performance was better when the target face had been presented in alternation with similar comparator faces than if that target had not been exposed before test. Exposure to the target face without comparators, or exposure alternating with dissimilar faces, improved performance relative to the nonexposed control but performance was not as good as when target exposure was given in alternation to similar comparison faces. The effects were not influenced by image changes between exposure and test. It is suggested that exposure to a face in comparison to similar stimuli focuses the central representation of a face on its unique features. In practical terms these results suggest that reliable identification of an individual from their photograph would be improved by viewing that photograph in comparison with photographs of similar people.     

Dominance of texture over shape in facial identity processing is modulated by individual abilities

For face recognition, observers utilize both shape and texture information. Here, we investigated the relative diagnosticity of shape and texture for delayed matching of familiar and unfamiliar faces (Experiment 1) and identifying familiar and newly learned faces (Experiment 2). Within each familiarity condition, pairs of 3D‐captured faces were morphed selectively in either shape or texture in 20% steps, holding the respective other dimension constant. We also assessed participants’ individual face‐processing skills via the Bielefelder Famous Faces Test (BFFT), the Glasgow Face Matching Test, and the Cambridge Face Memory Test (CFMT). Using multilevel model analyses, we examined probabilities of same versus different responses (Experiment 1) and of original identity versus other/unknown identity responses (Experiment 2). Overall, texture was more diagnostic than shape for both delayed matching and identification, particularly so for familiar faces. On top of these overall effects, above‐average BFFT performance was associated with enhanced utilization of texture in both experiments. Furthermore, above‐average CFMT performance coincided with slightly reduced texture dominance in the delayed matching task (Experiment 1) and stronger sensitivity to morph‐based changes overall, that is irrespective of morph type, in the face identification task (Experiment 2). Our findings (1) show the disproportionate importance of texture information for processing familiar face identity and (2) provide further evidence that familiar and unfamiliar face identity perception are mediated by different underlying processes.     

Unfamiliar face matching: Pairs out‐perform individuals and provide a route to training

Matching unfamiliar faces is known to be difficult. Here, we ask whether performance can be improved by asking viewers to work in pairs, a manipulation known to increase accuracy for low‐level visual discrimination tasks. Across four experiments we consistently find that face matching accuracy is higher for pairs of viewers than for individuals. This ‘pairs advantage’ is generally driven by adopting the response of the higher scoring partner. However, when the task becomes difficult, both partners' performance is improved by working in a pair. In two experiments, we find evidence that working in a pair can lead to subsequent improvements in individual performance, specifically for viewers whose accuracy is initially low. The pairs' technique therefore offers the opportunity for substantial improvements in face matching performance, along with an added training benefit.     

“Do I Know You?” Altering hairstyle affects facial recognition

Background: Research has demonstrated that both internal features (e.g., eyes) and external features (e.g., hair) are important for recognizing unfamiliar faces; however, the impact of altering hairstyle on the recognition of unfamiliar faces has yet to be isolated and investigated in the absence of deep processing. Objectives: We sought to examine the extent to which altering hair impacts the recognition of a previously viewed face. Methods: Participants were presented with a series of face images followed by a recognition probe of either a new face or a face that was among the previously presented images with either the same hairstyle (identical face) or a different hairstyle (disguised face). Results: Participants showed significantly less accuracy in the disguised condition compared to the identical condition. Conclusions: Our results provide evidence that hairstyle plays a role in recognizing unfamiliar faces. This appears to hold true across race and sex, as well as across deep and shallow processing.     

Matching Face Images Taken on the Same Day or Months Apart: the Limitations of Photo ID

It is well‐established that matching images of unfamiliar faces is rather error prone. However, there is an important mismatch between face matching in laboratory and realistic settings. All of the currently available face‐matching databases were designed to establish the baseline level of unfamiliar face perception. Therefore, target and test images for each face identity have been taken on the same day, minimizing within‐face variations. In realistic settings, on the other hand, faces do vary, even day to day. This study examined the proficiency of matching images of unfamiliar faces, which were taken on the same day or months apart. In two experiments, same‐day images were matched substantially more accurately and faster than different‐date photographs using the standard 1‐in‐10 and pairwise face‐matching tasks. This suggests that experimental studies on face matching underestimate its difficulty in real‐world situations. Photographs of unfamiliar faces seem to be unreliable proofs of identity, especially if the ID documents do not use very recent images of the holders. Copyright © 2013 John Wiley & Sons, Ltd.     

The relative importance of external and internal features of facial composites

Three experiments are reported that compare the quality of external with internal regions within a set of facial composites using two matching‐type tasks. Composites are constructed with the aim of triggering recognition from people familiar with the targets, and past research suggests internal face features dominate representations of familiar faces in memory. However the experiments reported here show that the internal regions of composites are very poorly matched against the faces they purport to represent, while external feature regions alone were matched almost as well as complete composites. In Experiments 1 and 2 the composites used were constructed by participant‐witnesses who were unfamiliar with the targets and therefore were predicted to demonstrate a bias towards the external parts of a face. In Experiment 3 we compared witnesses who were familiar or unfamiliar with the target items, but for both groups the external features were much better reproduced in the composites, suggesting it is the process of composite construction itself which is responsible for the poverty of the internal features. Practical implications of these results are discussed.     

Sensitivity to feature displacement in familiar and unfamiliar faces: beyond the internal/external feature distinction

Previous studies of face recognition and of face matching have shown a general improvement for the processing of internal features as a face becomes more familiar to the participant. In this study, we used a psychophysical two-alternative forced-choice paradigm to investigate thresholds for the detection of a displacement of the eyes, nose, mouth, or ears for familiar and unfamiliar faces. No clear division between internal and external features was observed. Rather, for familiar (compared to unfamiliar) faces participants were more sensitive to displacements of internal features such as the eyes or the nose; yet, for our third internal feature-the mouth no such difference was observed. Despite large displacements, many subjects were unable to perform above chance when stimuli involved shifts in the position of the ears. These results are consistent with the proposal that familiarity effects may be mediated by the construction of a robust representation of a face, although the involvement of attention in the encoding of face stimuli cannot be ruled out. Furthermore, these effects are mediated by information from a spatial configuration of features, rather than by purely feature-based information.