Recognising faces seen alone or with others: when two heads are worse than one

There is a large body of work investigating face identification, but most of this addresses recognition of a single person. Here, we examine how recognition is affected by the presence of a second face. In Experiments 1 and 2, we demonstrate that memory for an unfamiliar face is severely reduced if it is seen alongside a second person. Sequential presentation of two target faces further reduces accuracy. In Experiments 3 and 4, we demonstrate the same disadvantage for two‐face targets in a matching task, where subjects have no time limits or memory requirement. In matching, the damaging effect of a second face is greatest when the targets are placed close together. Furthermore, there is a general advantage for faces presented to the left. We suggest that it may not be possible to extrapolate results from single‐face studies to experiments (or realistic situations) involving more than one person. Copyright © 2006 John Wiley & Sons, Ltd.     

Identification of familiar and unfamiliar faces from internal and external features: some implications for theories of face recognition

Three experiments are reported in which recognition of faces from whole faces or internal or external features was compared. In the first experiment, where the faces were of famous people, an advantage was found for identification from internal features. In the second experiment involving unfamiliar faces, however, no difference was found in recognition rates when subjects were given the internal or the external features. In a third experiment famous faces were presented and mixed with other famous faces for a recognition test. As in experiment 1, better recognition occurred from internals as compared with external features. It is argued that the internal representation for familiar faces may be qualitatively different from that for face seen just once. In particular some advantage in feature saliency may accrue to the internal or 'expressive' features of familiar faces. The implications of these results are considered in relation to general theories of face perception and recognition.     

Subliminal access to abstract face representations does not rely on attention

The present study used masked repetition priming to examine whether face representations can be accessed without attention. Two experiments using a face recognition task (fame judgement) presented masked repetition and control primes in spatially unattended locations prior to target onset. Experiment 1 (n=20) used the same images as primes and as targets and Experiment 2 (n=17) used different images of the same individual as primes and targets. Repetition priming was observed across both experiments regardless of whether spatial attention was cued to the location of the prime. Priming occurred for both famous and non-famous targets in Experiment 1 but was only reliable for famous targets in Experiment 2, suggesting that priming in Experiment 1 indexed access to view-specific representations whereas priming in Experiment 2 indexed access to view-invariant, abstract representations. Overall, the results indicate that subliminal access to abstract face representations does not rely on attention.     

Recognizing people seen in events via dynamic "mug shots"

This study examined effects of an event and dynamic mug shots on facial recognition. Witnesses saw either a film of a liquor store holdup staged by six perpetrators, slides of the same targets, or freeze-framed views from the filmed event. Slides of different facial views of targets among 12 foils, or dynamic 180 degrees mug shots of the same men, or multiple static views were administered 24 hr later in yes-no recognition tests. Recognition (d') was poorer for the same men seen in the event than in slides, but better for dynamic than for static mug shots. Nondynamic event characteristics were responsible for poor recognition of people seen in events, whereas dynamic aspects of facial transformations, not multiple views, seemed responsible for the superiority of dynamic mug shots. The implications of these results for issues of ecological validity of traditional face recognition methodology and for static feature models vs. dynamic transformation models of face recognition are discussed.     

Capacity limits for face processing

We present three experiments in which subjects were asked to make speeded sex judgements (Experiment 1) or semantic judgements (Experiments 2 and 3) to face targets and nonface items, while ignoring a solitary flanking distractor face or a nonface stimulus. Distractors could be either congruent (same response category) or incongruent (different response category) with the target. Distractor congruency effects were consistently observed in all combinations of target-distractor stimulus pairs, except when a distractor face flanked a target face. The failure to find congruency effects in this condition was explored further in a fourth experiment, in which four task-irrelevant flankers were simultaneously presented. Once again, no face-face congruency effects were found, even though comparison distractors interfered with face and nonface targets alike. However, four simultaneously presented distractor faces did not interfere with nonface targets either. We suggest that these experiments demonstrate a capacity limit for visual processing in these conditions, such that no more than one face is processed at a time.     

The role of integration in recognition failure and action memory

In three experiments, we studied memory for action events with respect to exceptions from the Tulving-Wiseman function demonstrated in experiments on recognition failure of recallable words. In Experiment 1, we examined exceptions of poor integration in a regular recognition failure condition (i.e., recognition of targets without contextual cues, followed by recall of targets in the presence of contextual cues). In Experiment 2, we examined exceptions of cue overlap in which subjects also had access to the information of contextual cues at recognition test. In Experiment 3, we attempted to equate the levels of recognition across the action and verbal encoding. In addition, the cue overlap and no-cue overlap conditions were studied in a within-subjects design. Results from the three experiments indicated that encoding enactment (episodic integration) and conceptual integration (semantic integration) are related to each other. As a consequence of this relationship, there is a larger independence between recognition and recall of well-integrated items with encoding enactment. On the other hand, for the poorly integrated items without encoding enactment, there is a larger dependence between recognition and recall. Even in the cue overlap condition, where there is a case of large dependence between recognition and recall, the same pattern of data was observed. The results are discussed in terms of an episodic integration view of encoding enactment.     

Recognizing faces in and out of context

Two experiments are reported which examined the influence of context on face recognition accuracy for novel and familiar faces respectively. Context was manipulated by varying the physical background against which the faces appeared. In Experiment I, 80 student subjects observed 18 faces before attempting to recognize them in a sequence of 36 alternatives. For half the subjects, the backgrounds changed from study to test, while for the remainder they stayed the same. In addition, for half the subjects, both the pose and expression of the face also changed, while for the others it remained constant. Changes in pose plus expression and context significantly reduced recognition accuracy for the target faces. Experiment II used an identical design, except that the faces of celebrities replaced the novel faces. The influence of context was eliminated but the effects of pose and expression were maintained. However, when only faces which were actually identified by subjects were considered, the effects of pose and expression, too, were eliminated. The significance of these findings for theories of contextual memory are discussed.     

Evidence for holistic processing of faces viewed as photographic negatives

Inversion and photographic negation both impair face recognition. Inversion seems to disrupt processing of the spatial relationship between facial features ('relational' processing) which normally occurs with upright faces and which facilitates their recognition. It remains unclear why negation affects recognition. To find out if negation impairs relational processing, we investigated whether negative faces are subject to the 'chimeric-face effect'. Recognition of the top half of a composite face (constructed from top and bottom halves of different faces) is difficult when the face is upright, but not when it is inverted. To perform this task successfully, the bottom half of the face has to be disregarded, but the relational processing which normally occurs with upright faces makes this difficult. Inversion reduces relational processing and thus facilitates performance on this particular task. In our experiments, subjects saw pairs of chimeric faces and had to decide whether or not the top halves were identical. On half the trials the two chimeras had identical tops; on the remaining trials the top halves were different. (The bottom halves were always different.) All permutations of orientation (upright or inverted) and luminance (normal or negative) were used. In experiment 1, each pair of 'identical' top halves were the same in all respects. Experiment 2 used differently oriented views of the same person, to preclude matches being based on incidental features of the images rather than the faces displayed within them. In both experiments, similar chimeric-face effects were obtained with both positive and negative faces, implying that negative faces evoke some form of relational processing. It is argued that there may be more than one kind of relational processing involved in face recognition: the 'chimeric-face effect' may reflect an initial 'holistic' processing which binds facial features into a 'Gestalt', rather than being a demonstration of the configurational processing involved in individual recognition.     

Recognizing faces in and out of context

Two experiments are reported which examined the influence of context on face recognition accuracy for novel and familiar faces respectively. Context was manipulated by varying the physical background against which the faces appeared. In Experiment I, 80 student subjects observed 18 faces before attempting to recognize them in a sequence of 36 al ternatives , For half the subj ects, the backgrounds changed from study to test, while for the remainder they stayed the same. In addition, for half the subjects, both the pose and expression of the face also changed, while for the others it remained constant. Changes in pose plus expression and context significantly reduced recognition accuracy for the target faces. Experiment 11 used an identical design, except that the faces of celebrities replaced the novel faces. The influence of context was eliminated but the effects of pose and expression were maintained. However, when only faces which were actually identified by subjects were considered, the effects of pose and expression, too, were eliminated. The significance of these findings for theories of contextual memory are discussed.     

Some influences of accent structure on melody recognition

Two experiments were carried out to investigate the roles of joint accent structure and familiarity in delayed recognition of relatively long tonal melodies. Melodic themes of target melodies were defined by correlating contour-related pitch accents with temporal accents (accent coupling) during an initial familiarization phase. Later, subjects gave recognition responses to key-transposed versions of the target melodies as well as to decoys with same and different contour accent patterns. In Experiment 1, all to-be-recognized melodies occurred both in an original rhythm, which preserved accent coupling, and in a new rhythm, which did not. Listeners were best at distinguishing targets from different decoys, especially in the original rhythm. In Experiment 2, the familiarity of target tunes and the rhythmic similarity in recognition were varied. Similar rhythms preserved accent coupling, whereas dissimilar rhythms did not. Listeners were most adept in distinguishing familiar targets from different decoys (Experiment 2A), particularly when they appeared in novel but similar rhythms. However, in similar rhythm conditions, listeners also frequently mistook same decoys for targets. With less familiar targets (Experiment 2B), these effects were attenuated, and performance showed general effects of pitch contour.     

Familiarity,Target Set and False Positives in Face Recognition

Distinctiveness of a face predicts both miss errors (MEs) and false positives (FPs) but correlations between these errors are low (e.g. Hancock, Burton, & Bruce, 1996). To investigate this, distinctiveness and personal familiarity were analysed as predictors of MEs and FPs in a face recognition experiment. Faces were assigned to three groups, which meant that each set were distractor faces for two different sets of targets. Mean ratings of distinctiveness predicted MEs, whereas familiarity predicted FPs only if individual ratings were used. The degree to which subjects were consistent in their ratings and performance over different faces was also considered. Good subject consistency was found on FPs when the subjects saw the same target faces. If subjects who had seen different target faces were compared, then the consistency of FPs was lower than the consistency of MEs. The results imply that distinctiveness predicts MEs as a general property of the population of faces, whereas familiarity predicts FPs according to the idiosyncrasies of subjects.     

Features and their configuration in face recognition

Tanaka and Farah (1993) have proposed a holistic approach to face recognition in which information about the features of a face and their configuration are combined together in the face representation. An implication of the holistic hypothesis is that alterations in facial configuration should interfere with retrieval of features. In four experiments, the effect of configuration on feature recognition was investigated by creating two configurations of a face, one with eyes close together and one with eyes far apart. After subjects studied faces presented in one of the two configurations (eyes-close or eyes-far), they were tested for their recognition of features shown in isolation, in a new face configuration, and in the old face configuration. It was found that subjects recognized features best when presented in the old configuration, next best in the new configuration, and poorest in isolation. Moreover, subjects were not sensitive to configural information in inverted faces (Experiment 2) or nonface stimuli (i.e., houses; Experiments 3 and 4). Importantly, for normal faces, altering the spatial location of the eyes not only impaired subjects’ recognition of the eye features but also impaired their recognition of the nose and mouth features—features whose spatial locations were not directly altered. These findings emphasize the interdependency of featural and configural information in a holistic face representation.     

Cross-domain semantic priming in normal subjects and a prosopagnosic patient

Cross-domain semantic priming of person recognition (from face primes to name targets at 500msecs SOA) is investigated in normal subjects and a brain-injured patient (PH) with a very severe impairment of overt face recognition ability. Experiment 1 demonstrates equivalent semantic priming effects for normal subjects from face primes to name targets (cross-domain priming) and from name primes to name targets (within-domain priming). Experiment 2 demonstrates cross-domain semantic priming effects from face primes that PH cannot recognize overtly. Experiment 3 shows that cross-domain semantic priming effects can be found for normal subjects when target names are repeated across all conditions. This (repeated targets) method is then used in Experiment 4 to establish that PH shows equivalent semantic priming to normal subjects from face primes which he is very poor at identifying overtly and from name primes which he can identify overtly. These findings demonstrate that automatic aspects of face recognition can remain intact even when all sense of overt recognition has been lost.     

Comparison of accuracy in auditory and tactile recognition memory for environmental stimuli.

Accuracy rates for auditory and tactile recognition of naturalistic stimuli over a 7-day period are compared. 40 subjects listened to 50, 107, or 194 naturalistic sounds and were tested immediately or after delays of 2 or 7 days. 30 other subjects handled but did not visually inspect 150 common objects and were tested over the same three delay intervals. Recognition accuracy for sounds was 87.5%, 82.5%, and 80.4% while common objects were recognized at 96.0%, 93.8%, and 88.5% rates of accuracy. Tactile recognition memory was superior to auditory recognition memory. The recognition accuracies of both modalities were affected by the delay interval. The number of items inspected had no effect on the recognition memory for sounds. Following a delay of 1 wk., the accuracy of recognition relative to the original level of function was 92% for both modalities.     

Face value: testing the utility of contextual face cues for face recognition

The presence of multiple faces during a crime may provide a naturally-occurring contextual cue to support eyewitness recognition for those faces later. Across two experiments, we sought to investigate mechanisms underlying previously-reported cued recognition effects, and to determine whether such effects extended to encoding conditions involving more than two faces. Participants studied sets of individual faces, pairs of faces, or groups of four faces. At test, participants in the single-face condition were tested only on those individual faces without cues. Participants in the two and four-face conditions were tested using no cues, correct cues (a face previously studied with the target test face), or incorrect cues (a never-before-seen face). In Experiment 2, associative encoding was promoted by a rating task. Neither hit rates nor false-alarm rates were significantly affected by cue type or face encoding condition in Experiment 1, but cuing of any kind (correct or incorrect) in Experiment 2 appeared to provide a protective buffer to reduce false-alarm rates through a less liberal response bias. Results provide some evidence that cued recognition techniques could be useful to reduce false recognition, but only when associative encoding is strong.     

The role of active exploration of 3D face stimuli on recognition memory of facial information

Research on face recognition has mainly relied on methods in which observers are relatively passive viewers of face stimuli. This study investigated whether active exploration of three-dimensional (3D) face stimuli could facilitate recognition memory. A standard recognition task and a sequential matching task were employed in a yoked design. Observers in the active condition explored 3D views of faces via a mouse or joystick during the training and test sessions of the task, whereas observers in the passive condition simply viewed the replay of the same sequence of face stimuli generated by the active observers. It was found that the active condition produced better recognition accuracy than the passive condition. The study provides the first evidence that active exploration of 3D face stimuli can lead to better face recognition memory and matching performance.     

Configural information in gender categorisation

The role of configural information in gender categorisation was studied by aligning the top half of one face with the bottom half of another. The two faces had the same or different genders. Experiment 1 shows that participants were slower and made more errors in categorising the gender in either half of these composite faces when the two faces had a different gender, relative to control conditions where the two faces were nonaligned or had the same gender. This result parallels the composite effect for face recognition (Young et al, 1987 Perception 16 747-759) and facial-expression recognition (Calder et al, 2000 Journal of Experimental Psychology: Human Perception and Performance 26 527-551). Similarly to responses to face identity and expression, the composite effect on gender discrimination was disrupted by inverting the faces (experiment 2). Both experiments also show that the composite paradigm is sensitive to general contextual interference in gender categorisation.     

Face processing in autistics: Evidence for a generalised deficit?

Several studies have recently highlighted specific impairments in face processing in autistic subjects (memory for faces, recognition of emotional expressions, identity recognition of familiar faces). The goal of the present study was to explore whether there was a generalised face processing deficit in this population. A variety of tasks examining different, and possibly dissociative, aspects of face processing was investigated. The results of autistic subjects were compared with data from (a) a group of children with Down syndrome and (b) two individually matched control groups. The study suggests that autistic subjects are impaired in the various face processing tasks, but not always to the same extent.