Matching familiar and unfamiliar faces on identity and expression

Summary Subjects were asked to decide whether or not simultaneously presented photographs of pairs of faces were pictures of the same person or of different people (identity matching), or to decide whether or not the pairs of face showed the same expressions or different expressions (expression matching). Faces of familiar and unfamiliar people were used as stimuli. For identity matching, reaction times to familiar faces were faster than reaction times to unfamiliar faces, but there was no difference between familiar and unfamiliar faces for expression matching. These results support the view derived from neuropsychological and neurophysiological studies that analyses of facial expressions proceed independently from processes involved in establishing the person's identity.This research was supported by the ESRC (Grant C 0023 2075)     

Identification of familiar and unfamiliar faces from internal and external features: some implications for theories of face recognition

Three experiments are reported in which recognition of faces from whole faces or internal or external features was compared. In the first experiment, where the faces were of famous people, an advantage was found for identification from internal features. In the second experiment involving unfamiliar faces, however, no difference was found in recognition rates when subjects were given the internal or the external features. In a third experiment famous faces were presented and mixed with other famous faces for a recognition test. As in experiment 1, better recognition occurred from internals as compared with external features. It is argued that the internal representation for familiar faces may be qualitatively different from that for face seen just once. In particular some advantage in feature saliency may accrue to the internal or 'expressive' features of familiar faces. The implications of these results are considered in relation to general theories of face perception and recognition.     

Recognizing familiar and unfamiliar faces

These experiments addressed why, in episodic-memory tests, familiar faces are recognized better than unfamiliar faces. Memory for faces of well-known public figures and unfamiliar persons was tested, not only with old/new recognition tests, in which initially viewed faces were discriminated from dis tractors, but also with tests of memory for specific information. These included: detail recall, in which a masked feature had to be described; orientation recognition, in which discrimination between originally seen faces and mirror-image reversals was required; and recognition and recall of labels for the public figures. Experiments 1 and 2 showed that memory for orientation and featural details was not robustly related either to facial familiarity or to old/new recognition rates. Experiment 3 showed that memory for labels was not the exclusive determinant of the famous-face advantage in recognition, since famous faces were highly recognizable even they were not labelable or when labels were forgotten. These results suggest that the familiarity effect, and face recognition in general, may reflect a nonverbal memory representation that is relatively abstract.     

The time course of processing external and internal features of unfamiliar faces

The time course of processing internal and external facial features was studied in a sequential face matching task, where first a target face was presented, followed by a test face. The exposure duration of the test face was varied systematically (90, 120, 150 ms, and self-paced). In three tasks, participants were instructed to match either the whole face, only external features, or only internal features of the target and test face. Taken together, the results in all the three tasks provide evidence for very fast matching processes. For upright faces, maximal performance was achieved at 90 ms exposure duration and longer exposure durations (120, 150 ms, self-paced) did not improve accuracy. For inverted whole faces, reduced exposure duration resulted in an increase of matching errors, suggesting that below 150 ms of exposure duration, inverted faces cannot be matched reliably. When matching selected facial features only, no such inversion effect was found. Our data challenges previous claims that external features are matched faster than internal: no difference of time course was found between external and internal features. However, external features were matched more accurately.     

Lateralised processing of the internal and the external facial features of personally familiar and unfamiliar faces: a visual half-field study

In this visual half field (VHF) experiment, we investigated possible differences between the left and the right hemisphere in the processing of the internal and external features of familiar and unfamiliar faces. Previous studies using famous and unknown faces had indicated that both hemispheres use the same qualitative mode of processing with the internal features being more important for the perception of familiar faces. In this experiment, personally familiar faces rather than famous faces are used. There are several, mainly methodological, reasons why personally familiar faces are more appropriate stimuli to investigate face processing. The results of the present study showed that no overall visual field effect occurred, but more importantly, that face processing in the left hemisphere differed qualitatively from that in the right hemisphere. The theoretical repercussions of these findings are discussed.     

The contribution of external and internal features to the matching of unfamiliar faces

The relative efficacy of external and internal features in matching unfamiliar faces was studied in three experiments in which the subjects matched target and test faces differing in terms of external or internal features, or both. In Experiment 1 only full congruency between target and test faces was considered a match; in Experiments 2 and 3 faces sharing the same external and internal features were also considered to be matches. A total of 100 subjects matched 192 pairs of target and test faces in a same-different task. Reaction times and matching errors were recorded for analyses of variance. In all three experiments performance was best when either all features matched or all features mismatched, with mismatches having a slight edge. When matches of external and internal features with the target faces were inconsistent with each other, mismatches of external features led to faster responses in Experiments 1 and 2, and mismatches of internal features led to faster responses in Experiment 3. The results suggest that since faces are configurational stimuli, face matching is influenced by the non-relevant set of features; and that mismatches, especially of external features, influence face matching more than matches do.     

Sensitivity to feature displacement in familiar and unfamiliar faces: beyond the internal/external feature distinction

Previous studies of face recognition and of face matching have shown a general improvement for the processing of internal features as a face becomes more familiar to the participant. In this study, we used a psychophysical two-alternative forced-choice paradigm to investigate thresholds for the detection of a displacement of the eyes, nose, mouth, or ears for familiar and unfamiliar faces. No clear division between internal and external features was observed. Rather, for familiar (compared to unfamiliar) faces participants were more sensitive to displacements of internal features such as the eyes or the nose; yet, for our third internal feature-the mouth no such difference was observed. Despite large displacements, many subjects were unable to perform above chance when stimuli involved shifts in the position of the ears. These results are consistent with the proposal that familiarity effects may be mediated by the construction of a robust representation of a face, although the involvement of attention in the encoding of face stimuli cannot be ruled out. Furthermore, these effects are mediated by information from a spatial configuration of features, rather than by purely feature-based information.     

Order of feature recognition in familiar and unfamiliar faces

Three experiments measured order of processing for single faces presented to the left or right visual field (VF) using a same-different matching task. In contrast to earlier studies, the stimuli in the present experiments were carefully matched for overall similarity prior to the actual experiments. Experiments 1 and 2 showed that a significant top-to-bottom order of processing occurred for line drawings of unfamiliar faces but not for line drawings of familiar faces. Experiment 3 found evidence supporting top-to-bottom processing for unfamiliar photographic face stimuli. The photographic stimuli in Experiment 3 were matched more quickly when presented in the left VF (right hemisphere); however, this VF asymmetry was not related to previously reported differences in order of processing. It is suggested that under some conditions faces presented to the right hemisphere may be processed more like familiar faces than faces presented to the left hemisphere; however, this difference is not critical for the left VF (right hemisphere) superiority often found in face recognition tasks.     

Electrodermal discrimination of familiar but not unfamiliar faces in prosopagnosia

It has been previously shown that prosopagnosics can electrodermally "recognize" faces they cannot verbally identify and with which they feel no familiarity. This study extended previous results by showing that electrodermal discrimination of faces exists only on a famous face identification task, and not on a matching-to-sample task involving unfamiliar faces. This suggests that electrodermal recognition reflects the activation of stored identity-specific information built up on the basis of past contact with faces, and provides a psychophysiological distinction between familiar and unfamiliar face processing. Implications for cognitive models of face recognition, and for understanding the nature of prosopagnosia, are discussed.     

Demonstrating how unfamiliar faces become familiar using a face matching task

Two experiments examine a novel method of assessing face familiarity that does not require explicit identification of presented faces. Earlier research (Clutterbuck & Johnston, 2002; Young, Hay, McWeeny, Flude, & Ellis, 1985) has shown that different views of the same face can be matched more quickly for familiar than for unfamiliar faces. This study examines whether exposure to previously novel faces allows the speed with which they can be matched to be increased, thus allowing a means of assessing how faces become familiar. In Experiment 1, participants viewed two sets of unfamiliar faces presented for either many, short intervals or for few, long intervals. At test, previously familiar (famous) faces were matched more quickly than novel faces or learned faces. In addition, learned faces seen on many, brief occasions were matched more quickly than the novel faces or faces seen on fewer, longer occasions. However, this was only observed when participants performed “different” decision matches. In Experiment 2, the similarity between face pairs was controlled more strictly. Once again, matches were performed on familiar faces more quickly than on unfamiliar or learned items. However, matches made to learned faces were significantly faster than those made to completely novel faces. This was now observed for both same and different match decisions. The use of this matching task as a means of tracking how unfamiliar faces become familiar is discussed.     

Self-face advantage over familiar and unfamiliar faces: A three-level meta-analytic approach

Despite the increasing number of researchers interested in self-face, so far, no study has summarized the behavioral findings that contribute to the debate on self-face advantage. Most studies have focused on neural correlates of the self, although functional uniqueness can also be considered an important criterion for determining whether a stimulus is unique. The present meta-analysis systematically compared reaction time (RT) responses for self-face with other face identities across 54 studies. Different moderator factors were tested: familiarity, identity, head angle, laterality, and culture. We used a three-level meta-analytic approach, which is the best approach to account for the dependency of effect sizes. Results showed a significant (Hedges’s g_av = ?0.298) effect size, indicating faster RT for self-face than for other faces in general. Except for culture, none of the moderators employed significantly impacted on the main effect. Regarding culture, results showed that participants from Western cultures tend to respond faster to their own face than to other people’s faces, while for participants from Eastern cultures, the effect was not significant. In summary, our results indicate that the self-face benefits from an advantage in terms of reaction time and may be considered a unique stimulus. Implications and limitations of the results are discussed.     

Second-order isomorphism of internal representations of familiar faces

Following a suggestion by Shepard and Chipman (1970), photographs and names of 15 well-known faces were used as stimuli in judgments of similarity. Ss ranked all pairs of stimuli in terms of facial similarity either from memory when presented with pairs of names, or from photographs. There was a highly significant positive correlation between these two types of judgment. A simple classificatory analysis of the 15 faces in terms of the physical features provided evidence that judgments based on the internal representation of the faces utilized pictorial information. These results extend the generality of Shepard and Chipman’s findings and confirm the usefulness of an approach to the problem of mental images based on the concept of second-order isomorphism.     

Phenomenological differences between familiar and unfamiliar odours

Unfamiliar odours are harder to discriminate than familiar odours. We explored the phenomenal basis of this difference. In experiments la and 1b, participants profiled odour quality for two sets of familiar and unfamiliar odours. In both cases unfamiliar odours were redolent of more odour qualities than familiar stimuli. In experiment 2, participants received (i) a set of familiar and unfamiliar odours and learnt their names, and (ii) a further set of familiar and unfamiliar odours to which they were exposed. Participants then profiled these stimuli as well as a further unexposed set of familiar and unfamiliar odours. Exposure, but not naming, led to a significantly smaller difference between the familiar and unfamiliar stimuli, in terms of their redolence to other odours, when compared to unexposed control stimuli. Unfamiliar exposed odours were also judged as less redolent than unexposed unfamiliar odours. These observations are consistent with a mnemonic basis for odour-quality perception.     

Canine responses to familiar and unfamiliar humans

Dogs were observed during controlled approaches by their owners and by strangers. Significant differences between the dogs' responses to their owners and their responses to strangers were found. These results supported the popular belief that dogs respond differently to different persons, and not merely to different situations in which persons are usually encountered.     

Attention to internal face features in unfamiliar face matching

Accurate matching of unfamiliar faces is vital in security and forensic applications, yet previous research has suggested that humans often perform poorly when matching unfamiliar faces. Hairstyle and facial hair can strongly influence unfamiliar face matching but are potentially unreliable cues. This study investigated whether increased attention to the more stable internal face features of eyes, nose, and mouth was associated with more accurate face‐matching performance. Forty‐three first‐year psychology students decided whether two simultaneously presented faces were of the same person or not. The faces were displayed for either 2 or 6 seconds, and had either similar or dissimilar hairstyles. The level of attention to internal features was measured by the proportion of fixation time spent on the internal face features and the sensitivity of discrimination to changes in external feature similarity. Increased attention to internal features was associated with increased discrimination in the 2‐second display‐time condition, but no significant relationship was found in the 6‐second condition. Individual differences in eye‐movements were highly stable across the experimental conditions.     

Verbal and behavioral responses to familiar and unfamiliar music

Thirty adult subjects completed an Operant Music Listening Recorder (OMLR) task with two unfamiliar and two familiar music channels (one “popular” and one “classical” in each case), then rated the music on each channel on seven-point scales for liking, quality, and familiarity. The two familiar music channels received significantly higher ratings than the two unfamiliar channels on all three rating scales, and there were no significant main effects or interactions involving musical style. The predictions (a) that subjects would spend more time listening to the familiar channels on the OMLR task, and (b) that measures of listening time would display higher correlations with ratings of liking than with those of quality both received weak support from the direction of the results, but neither was confirmed by statistical significance tests. The results are discussed in terms of the fragmentation between the affective and evaluative components of attitudes toward music.