Performance of typical and superior face recognizers on a novel interactive face matching procedure

Unfamiliar simultaneous face matching is error prone. Reducing incorrect identification decisions will positively benefit forensic and security contexts. The absence of view-independent information in static images likely contributes to the difficulty of unfamiliar face matching. We tested whether a novel interactive viewing procedure that provides the user with 3D structural information as they rotate a facial image to different orientations would improve face matching accuracy. We tested the performance of ‘typical’ (Experiment 1) and ‘superior’ (Experiment 2) face recognizers, comparing their performance using high-quality (Experiment 3) and pixelated (Experiment 4) Facebook profile images. In each trial, participants responded whether two images featured the same person with one of these images being either a static face, a video providing orientation information, or an interactive image. Taken together, the results show that fluid orientation information and interactivity prompt shifts in criterion and support matching performance. Because typical and superior face recognizers both benefited from the structural information provided by the novel viewing procedures, our results point to qualitatively similar reliance on pictorial encoding in these groups. This also suggests that interactive viewing tools can be valuable in assisting face matching in high-performing practitioner groups.     

Face averages and multiple images in a live matching task

We know from previous research that unfamiliar face matching (determining whether two simultaneously presented images show the same person or not) is very error-prone. A small number of studies in laboratory settings have shown that the use of multiple images or a face average, rather than a single image, can improve face matching performance. Here, we tested 1,999 participants using four-image arrays and face averages in two separate live matching tasks. Matching a single image to a live person resulted in numerous errors (79.9% accuracy across both experiments), and neither multiple images (82.4% accuracy) nor face averages (76.9% accuracy) improved performance. These results are important when considering possible alterations which could be made to photo-ID. Although multiple images and face averages have produced measurable improvements in performance in recent laboratory studies, they do not produce benefits in a real-world live face matching context.     

Individual differences in visual acuity and face matching ability

The visual acuity of the eyes varies outside the range of normal vision, requiring corrective lenses, but also within the normal range. This study investigated whether both types of variation relate to individual differences in face-identity matching, considering this applied task requires perception of detail. Across two experiments, face-matching accuracy correlated with variation in acuity when this fell outside the normal range of vision and was uncorrected with glasses or contact lenses. In contrast, variation in visual acuity within the normal range did not affect face-matching accuracy, whereas matching accuracy at a given level of acuity could vary substantially. These results indicate that visual acuity is only a problem for occupations performing face-identity matching when below-normal acuity is not diagnosed or adequately corrected. In turn, these findings suggest that variation in acuity within the normal range is not a contributing factor to individual differences in face matching accuracy.     

Image-size disparity reduces difference detection in face matching

Face matching is the act of deciding whether two facial images depict the same person or different people. The real-world face-matching task of checking photo IDs typically occurs under conditions of image-size disparity: A small picture is compared with a life-size face. We examined the effect of image-size disparity on face-matching accuracy. In three experiments, subjects were presented with pairs of equivalently or disparately sized images that depicted the same person or different people. Subjects made same/different judgments and, in two experiments, also reported confidence. Difference detection was significantly poorer given disparate (versus equivalent) image size. Confidence was significantly higher when responses were correct versus incorrect. These findings held whether viewing and decision time was unlimited or limited. Our results raise the practical concern that image-size disparity may undermine difference detection in ID checking, while also indicating that people have some insight into the accuracy of their face-matching judgments.     

Unfamiliar face matching: Pairs out‐perform individuals and provide a route to training

Matching unfamiliar faces is known to be difficult. Here, we ask whether performance can be improved by asking viewers to work in pairs, a manipulation known to increase accuracy for low‐level visual discrimination tasks. Across four experiments we consistently find that face matching accuracy is higher for pairs of viewers than for individuals. This ‘pairs advantage’ is generally driven by adopting the response of the higher scoring partner. However, when the task becomes difficult, both partners' performance is improved by working in a pair. In two experiments, we find evidence that working in a pair can lead to subsequent improvements in individual performance, specifically for viewers whose accuracy is initially low. The pairs' technique therefore offers the opportunity for substantial improvements in face matching performance, along with an added training benefit.     

Famous face recognition,face matching,and extraversion

It has been previously established that extraverts who are skilled at interpersonal interaction perform significantly better than introverts on a face-specific recognition memory task. In our experiment we further investigate the relationship between extraversion and face recognition, focusing on famous face recognition and face matching. Results indicate that more extraverted individuals perform significantly better on an upright famous face recognition task and show significantly larger face inversion effects. However, our results did not find an effect of extraversion on face matching or inverted famous face recognition.     

Super-Recognisers show an advantage for other race face identification

The accurate identification of an unfamiliar individual from a face photo is a critical factor in several applied situations (e.g., border control). Despite this, matching faces to photographic ID is highly prone to error. In lieu of effective training measures, which could reduce face matching errors, the selection of “super-recognisers” (SRs) provides the most promising route to combat misidentification or fraud. However, to date, super-recognition has been defined and tested using almost exclusively “own-race” face memory and matching tests. Here, across three studies, we test Caucasian participants' performance on own- and other-race face identification tasks (GFMT, MFMT, CFMT+, EFMT, CFMT-Chinese). Our findings show that compared to controls, high-performing typical recognisers (Studies 1 and 2) and SRs (Study 3) show superior performance on both the own- and other-race tests. These findings suggest that recruiting SRs in ethnically diverse applied settings could be advantageous.     

Influence of emotional facial expressions on 3-5-year-olds’ face recognition

Three experiments examined 3- and 5-year-olds’ recognition of faces in constant and varied emotional expressions. Children were asked to identify repeatedly presented target faces, distinguishing them from distractor faces, during an immediate recognition test and during delayed assessments after 10 min and one week. Emotional facial expression remained neutral (Experiment 1) or varied between immediate and delayed tests: from neutral to smile and anger (Experiment 2), from smile to neutral and anger (Experiment 3, condition 1), or from anger to neutral and smile (Experiment 3, condition 2). In all experiments, immediate face recognition was not influenced by emotional expression for either age group. Delayed face recognition was most accurate for faces in identical emotional expression. For 5-year-olds, delayed face recognition (with varied emotional expression) was not influenced by which emotional expression had been displayed during the immediate recognition test. Among 3-year-olds, accuracy decreased when facial expressions varied from neutral to smile and anger but was constant when facial expressions varied from anger or smile to neutral, smile or anger. Three-year-olds’ recognition was facilitated when faces initially displayed smile or anger expressions, but this was not the case for 5-year-olds. Results thus indicate a developmental progression in face identity recognition with varied emotional expressions between ages 3 and 5.     

Individual differences in face and voice matching abilities: The relationship between accuracy and consistency

Deciding whether two different face photographs or voice samples are from the same person represent fundamental challenges within applied settings. To date, most research has focussed on average performance in these tests, failing to consider individual differences and within‐person consistency in responses. Here, participants completed the same face (Experiment 1) or voice matching test (Experiment 2) on two separate occasions, allowing comparison of overall accuracy across the two timepoints as well as consistency in trial‐level responses. In both experiments, participants were highly consistent in their performances. In addition, we demonstrated a large association between consistency and accuracy, with the most accurate participants also tending to be the most consistent. This is an important result for applied settings in which organisational groups of super‐matchers are deployed in real‐world contexts. Being able to reliably identify these high performers based upon only a single test informs regarding recruitment for law enforcement agencies worldwide.     

Finding an unfamiliar face in a line-up: Viewing multiple images of the target is beneficial on target-present trials but costly on target-absent trials

When viewing unfamiliar faces, photographs of the same person often are perceived as belonging to different people and photographs of different people as belonging to the same person. Identity matching of unfamiliar faces is especially challenging when the photographs are of a person whose ethnicity differs from that of the observer. In contrast, matching is trivial when viewing familiar faces, regardless of race. Viewing multiple images of an own-race target identity improves accuracy on a line-up task when the target is known to be present (Dowsett et al., 2016, Q J Exp Psychol, 69, 1), suggesting that exposure to within-person variability in appearance is key to face learning. Across three experiments, we show that viewing multiple images of a target identity also improves accuracy for other-race faces on target-present trials. However, viewing multiple images decreases accuracy (i.e., increases false alarms) on target-absent trials for both own- and other-race faces. We discuss the implications of our findings for models of face recognition and for forensic settings.     

Searching for faces in crowd chokepoint videos

Investigations of face identification have typically focussed on matching faces to photographic IDs. Few researchers have considered the task of searching for a face in a crowd. In Experiment 1, we created the Chokepoint Search Test to simulate real-time search for a target. Performance on this test was poor (39% accuracy) and showed moderate associations with tests of face matching and memory. In addition, trial-level confidence predicted accuracy, and for those participants who were previously familiar with one or more targets, higher familiarity was associated with increased accuracy. In Experiment 2, we found improvements in performance on the test when three recent images of the target, but not three social media images, were displayed during searches. Taken together, our results highlight the difficulties inherent in real-time searching for faces, with important implications for those security personnel who carry out this task on a daily basis.     

Metacognition during unfamiliar face matching

Kruger and Dunning (1999) described a metacognitive bias in which insight into performance is linked to competence: poorer performers are less aware of their mistakes than better performers. Competence-based insight has been argued to apply generally across task domains, including a recent report investigating social cognition using a variety of face-matching tasks. Problematically, serious statistical and methodological criticisms have been directed against the traditional method of analysis used by researchers in this field. Here, we further illustrate these issues and investigate new sources of insight within unfamiliar face matching. Over two experiments (total N = 1077), where Experiment 2 was a preregistered replication of the key findings from Experiment 1, we found that insight into performance was multi-faceted. Participants demonstrated insight which was not based on competence, in the form of accurate updating of estimated performance. We also found evidence of insight which was based on competence: the difference in confidence on correct versus incorrect trials increased with competence. By providing ways that we can move beyond problematic, traditional approaches, we have begun to reveal a more realistic story regarding the nature of insight into face perception.     

Holistic face perception: Mind the gap!

The most widely used measurement of holistic face perception, the composite face effect (CFE), is challenged by two apparently contradictory goals: having a defined face part (i.e., the top half), and yet perceiving the face as an integrated unit (i.e., holistically). Here, we investigated the impact of a small gap between top and bottom face halves in the standard composite face paradigm, requiring matching of sequentially presented top face halves. In Experiment 1, the CFE was larger for no-gap than gap stimuli overall, but not for participants who were presented with gap stimuli first, suggesting that the area of the top face half was unknown without a gap. This was confirmed in Experiment 2, in which these two stimulus sets were mixed up: the gap stimuli thus provided information about the area of a top face half and the magnitude of the CFE did not differ between stimulus sets. These observations indicate that the CFE might be artificially inflated in the absence of a stimulus cue that objectively defines a border between the face halves. Finally, in Experiment 3, observers were asked to determine which of two simultaneously presented faces was the composite face. Perceptual judgements for no-gap stimuli approached ceiling; however, with a gap, participants were almost unable to distinguish the composite face from a veridical face. This effect was not only due to low-level segmentation cues at the border of no-gap face halves, because stimulus inversion decreased performance in both conditions. This result indicates that the two halves of different faces may be integrated more naturally with a small gap that eliminates an enhanced contrast border. Collectively, these observations suggest that a small gap between face halves provides an objective definition of the face half to match and is beneficial for valid measurement of the behavioural CFE.     

A matching advantage for dynamic human faces

In a series of three experiments, we used a sequential matching task to explore the impact of non-rigid facial motion on the perception of human faces. Dynamic prime images, in the form of short video sequences, facilitated matching responses relative to a single static prime image. This advantage was observed whenever the prime and target showed the same face but an identity match was required across expression (experiment 1) or view (experiment 2). No facilitation was observed for identical dynamic prime sequences when the matching dimension was shifted from identity to expression (experiment 3). We suggest that the observed dynamic advantage, the first reported for non-degraded facial images, arises because the matching task places more emphasis on visual working memory than typical face recognition tasks. More specifically, we believe that representational mechanisms optimised for the processing of motion and/or change-over-time are established and maintained in working memory and that such 'dynamic representations' (Freyd, 1987 Psychological Review 94 427-438) capitalise on the increased information content of the dynamic primes to enhance performance.     

Not looking yourself: The cost of self‐selecting photographs for identity verification

Photo‐identification is based on the premise that photographs are representative of facial appearance. However, previous studies show that ratings of likeness vary across different photographs of the same face, suggesting that some images capture identity better than others. Two experiments were designed to examine the relationship between likeness judgments and face matching accuracy. In Experiment 1, we compared unfamiliar face matching accuracy for self‐selected and other‐selected high‐likeness images. Surprisingly, images selected by previously unfamiliar viewers – after very limited exposure to a target face – were more accurately matched than self‐selected images chosen by the target identity themselves. Results also revealed extremely low inter‐rater agreement in ratings of likeness across participants, suggesting that perceptions of image resemblance are inherently unstable. In Experiment 2, we test whether the cost of self‐selection can be explained by this general disagreement in likeness judgments between individual raters. We find that averaging across rankings by multiple raters produces image selections that provide superior identification accuracy. However, benefit of other‐selection persisted for single raters, suggesting that inaccurate representations of self interfere with our ability to judge which images faithfully represent our current appearance.     

Recognizing face identity from natural and morphed smiles

It is easier to identify a degraded familiar face when it is shown moving (smiling, talking; nonrigid motion), than when it is displayed as a static image (Knight & Johnston, 1997; Lander, Christie, & Bruce, 1999). Here we explore the theoretical underpinnings of the moving face recognition advantage. In Experiment 1 we show that the identification of personally familiar faces when shown naturally smiling is significantly better than when the person is shown artificially smiling (morphed motion), as a single static neutral image or as a single static smiling image. In Experiment 2 we demonstrate that speeding up the motion significantly impairs the recognition of identity from natural smiles, but has little effect on morphed smiles. We conclude that the recognition advantage for face motion does not reflect a general benefit for motion, but suggests that, for familiar faces, information about their characteristic motion is stored in memory.     

Recognizing face identity from natural and morphed smiles

It is easier to identify a degraded familiar face when it is shown moving (smiling, talking; nonrigid motion), than when it is displayed as a static image (Knight & Johnston, 1997; Lander, Christie, & Bruce, 1999). Here we explore the theoretical underpinnings of the moving face recognition advantage. In Experiment 1 we show that the identification of personally familiar faces when shown naturally smiling is significantly better than when the person is shown artificially smiling (morphed motion), as a single static neutral image or as a single static smiling image. In Experiment 2 we demonstrate that speeding up the motion significantly impairs the recognition of identity from natural smiles, but has little effect on morphed smiles. We conclude that the recognition advantage for face motion does not reflect a general benefit for motion, but suggests that, for familiar faces, information about their characteristic motion is stored in memory.     

Facial identity and facial expression matching in 5–12‐year‐old children and adults

Facial identity and facial expression matching tasks were completed by 5–12‐year‐old children and adults using stimuli extracted from the same set of normalized faces. Configural and feature processing were examined using speed and accuracy of responding and facial feature selection, respectively. Facial identity matching was slower than face expression matching for all age groups. Large age effects were found on both speed and accuracy of responding and feature use in both identity and expression matching tasks. Eye region preference was found on the facial identity task and mouth region preference on the facial expression task. Use of mouth region information for facial expression matching increased with age, whereas use of eye region information for facial identity matching peaked early. The feature use information suggests that the specific use of primary facial features to arrive at identity and emotion matching judgments matures across middle childhood. Copyright © 2009 John Wiley & Sons, Ltd.     

In the Dock: Chimeric Image Composites Reduce Identification Accuracy

The aim of presenting chimeric images (formed from opposing halves of a pair of same or different faces) in court settings is to optimise the accuracy of identification decisions based on CCTV evidence. The experiments reported here examined the utility of this technique. Experiment 1 examined the accuracy of face matching with vertically split, aligned chimeric images, misaligned hemi‐faces and full‐face images. Experiment 2 replicated the first experiment but replaced the misaligned images with opposing hemi‐faces separated by a gap. The final experiment used horizontally split faces. All three experiments showed that matching was less accurate with aligned chimeric images than with full‐face images. Furthermore, the pattern of responses obtained with chimeric images differed significantly from full‐face matching and misaligned/separated hemi‐face matching. Chimeric images produced a bias towards same responses even when the face halves were different. The results suggest caution in the use of chimeric images in court. Copyright © 2011 John Wiley & Sons, Ltd.