Searching for faces in crowd chokepoint videos

Investigations of face identification have typically focussed on matching faces to photographic IDs. Few researchers have considered the task of searching for a face in a crowd. In Experiment 1, we created the Chokepoint Search Test to simulate real-time search for a target. Performance on this test was poor (39% accuracy) and showed moderate associations with tests of face matching and memory. In addition, trial-level confidence predicted accuracy, and for those participants who were previously familiar with one or more targets, higher familiarity was associated with increased accuracy. In Experiment 2, we found improvements in performance on the test when three recent images of the target, but not three social media images, were displayed during searches. Taken together, our results highlight the difficulties inherent in real-time searching for faces, with important implications for those security personnel who carry out this task on a daily basis.     

Perceptual experience shapes our ability to categorize faces by national origin: A new other-race effect

People are better at recognizing own-race than other-race faces. This other-race effect has been argued to be the result of perceptual expertise, whereby face-specific perceptual mechanisms are tuned through experience. We designed new tasks to determine whether other-race effects extend to categorizing faces by national origin. We began by selecting sets of face stimuli for these tasks that are typical in appearance for each of six nations (three Caucasian, three Asian) according to people from those nations (Study 1). Caucasian and Asian participants then categorized these faces by national origin (Study 2). Own-race faces were categorized more accurately than other-race faces. In contrast, Asian American participants, with more extensive other-race experience than the first Asian group, categorized other-race faces better than own-race faces, demonstrating a reversal of the other-race effect. Therefore, other-race effects extend to the ability to categorize faces by national origin, but only if participants have greater perceptual experience with own-race, than other-race faces. Study 3 ruled out non-perceptual accounts by showing that Caucasian and Asian faces were sorted more accurately by own-race than other-race participants, even in a sorting task without any explicit labelling required. Together, our results demonstrate a new other-race effect in sensitivity to national origin of faces that is linked to perceptual expertise.     

Smiles in face matching: Idiosyncratic information revealed through a smile improves unfamiliar face matching performance

Unfamiliar face matching is a surprisingly difficult task, yet we often rely on people's matching decisions in applied settings (e.g., border control). Most attempts to improve accuracy (including training and image manipulation) have had very limited success. In a series of studies, we demonstrate that using smiling rather than neutral pairs of images brings about significant improvements in face matching accuracy. This is true for both match and mismatch trials, implying that the information provided through a smile helps us detect images of the same identity as well as distinguishing between images of different identities. Study 1 compares matching performance when images in the face pair display either an open-mouth smile or a neutral expression. In Study 2, we add an intermediate level, closed-mouth smile, to identify the effect of teeth being exposed, and Study 3 explores face matching accuracy when only information about the lower part of the face is available. Results demonstrate that an open-mouth smile changes the face in an idiosyncratic way which aids face matching decisions. Such findings have practical implications for matching in the applied context where we typically use neutral images to represent ourselves in official documents.     

Unfamiliar face matching: Pairs out‐perform individuals and provide a route to training

Matching unfamiliar faces is known to be difficult. Here, we ask whether performance can be improved by asking viewers to work in pairs, a manipulation known to increase accuracy for low‐level visual discrimination tasks. Across four experiments we consistently find that face matching accuracy is higher for pairs of viewers than for individuals. This ‘pairs advantage’ is generally driven by adopting the response of the higher scoring partner. However, when the task becomes difficult, both partners' performance is improved by working in a pair. In two experiments, we find evidence that working in a pair can lead to subsequent improvements in individual performance, specifically for viewers whose accuracy is initially low. The pairs' technique therefore offers the opportunity for substantial improvements in face matching performance, along with an added training benefit.     

Not looking yourself: The cost of self‐selecting photographs for identity verification

Photo‐identification is based on the premise that photographs are representative of facial appearance. However, previous studies show that ratings of likeness vary across different photographs of the same face, suggesting that some images capture identity better than others. Two experiments were designed to examine the relationship between likeness judgments and face matching accuracy. In Experiment 1, we compared unfamiliar face matching accuracy for self‐selected and other‐selected high‐likeness images. Surprisingly, images selected by previously unfamiliar viewers – after very limited exposure to a target face – were more accurately matched than self‐selected images chosen by the target identity themselves. Results also revealed extremely low inter‐rater agreement in ratings of likeness across participants, suggesting that perceptions of image resemblance are inherently unstable. In Experiment 2, we test whether the cost of self‐selection can be explained by this general disagreement in likeness judgments between individual raters. We find that averaging across rankings by multiple raters produces image selections that provide superior identification accuracy. However, benefit of other‐selection persisted for single raters, suggesting that inaccurate representations of self interfere with our ability to judge which images faithfully represent our current appearance.     

Face recognition as a predictor of social cognitive ability: Effects of emotion and race on face processing

The human face conveys important social signals when people interact in social contexts. The current study investigated the relationship between face recognition and emotional intelligence, and how societal factors of emotion and race influence people's face recognition. Participants’ recognition accuracy, reaction time, sensitivity, and response bias were measured to examine their face‐processing ability. Fifty Caucasian undergraduates (38 females, 12 males; average age = 21.76 years) participated in a face recognition task in which they discriminated previously presented target faces from novel distractor faces. A positive correlation between participants’ emotional intelligence scores and their performance on the face recognition task was observed, suggesting that face recognition ability was associated with emotional or social intelligence. Additionally, Caucasian participants recognized happy faces better than angry or neutral faces. It was also observed that people recognized Asian faces better than Caucasian ones, which appears to be contradictory to the classic other‐race effect. The present study suggests that some societal factors could influence face processing, and face recognition ability could in turn predict social intelligence.     

Performance of typical and superior face recognizers on a novel interactive face matching procedure

Unfamiliar simultaneous face matching is error prone. Reducing incorrect identification decisions will positively benefit forensic and security contexts. The absence of view-independent information in static images likely contributes to the difficulty of unfamiliar face matching. We tested whether a novel interactive viewing procedure that provides the user with 3D structural information as they rotate a facial image to different orientations would improve face matching accuracy. We tested the performance of ‘typical’ (Experiment 1) and ‘superior’ (Experiment 2) face recognizers, comparing their performance using high-quality (Experiment 3) and pixelated (Experiment 4) Facebook profile images. In each trial, participants responded whether two images featured the same person with one of these images being either a static face, a video providing orientation information, or an interactive image. Taken together, the results show that fluid orientation information and interactivity prompt shifts in criterion and support matching performance. Because typical and superior face recognizers both benefited from the structural information provided by the novel viewing procedures, our results point to qualitatively similar reliance on pictorial encoding in these groups. This also suggests that interactive viewing tools can be valuable in assisting face matching in high-performing practitioner groups.     

Recognising faces but not traits: Accurate personality judgment from faces is unrelated to superior face memory

It is suggested that accurate personality judgments of faces are driven by a morphological ‘kernel of truth’ from face shape. We hypothesised that this relationship could lead to those with better face identification ability being better at personality judgments. We investigated the relationship between face memory, face matching, Big Five personality traits, and accuracy in recognising Big Five personality traits from 50 photographs of unknown faces. In our sample (n = 792) there was overall good (but varying) face memory and personality judgment accuracy. However, there was convincing evidence that these two skills do not correlate (all r < 0.06). We also replicate the known relationship between extraversion and face memory ability in the largest sample to date.     

Disguising Superman: How Glasses Affect Unfamiliar Face Matching

Could a simple pair of glasses really fool us into thinking Superman and Clark Kent are two different people? Here, we investigated the perception of identity from face images with a task that relies on visual comparison rather than memory. Participants were presented with two images simultaneously and were asked whether the images depicted the same person or two different people. The image pairs showed neither image with glasses, both images with glasses, and ‘mixed’ pairs of one image with and one without glasses. Participants' accuracies, measured by both percentage correct and d′ sensitivity, were significantly lower for ‘mixed’ trials. Analysis of response bias showed that when only one face wore glasses, people tended to respond ‘different’. We demonstrate that glasses affect face matching ability using unconstrained images, and this has implications for both disguise research and authenticating identity in the real world. Copyright © 2016 John Wiley & Sons, Ltd.     

Wisdom of the social versus non-social crowd in face identification

Face identification is more accurate when people collaborate in social dyads than when they work alone (Dowsett & Burton, 2015, Br. J. Psychol., 106, 433). Identification accuracy is also increased when the responses of two people are averaged for each item to create a ‘non-social’ dyad (White, Burton, Kemp, & Jenkins, 2013, Appl. Cogn. Psychol., 27, 769; White et al., 2015, Proc. R. Soc. B Biol. Sci., 282, 20151292). Does social collaboration add to the benefits of response averaging for face identification? We compared individuals, social dyads, and non-social dyads on an unfamiliar face identity-matching test. We also simulated non-social collaborations for larger groups of people. Individuals and social dyads judged whether face image pairs depicted the same- or different identities, responding on a 5-point certainty scale. Non-social dyads were constructed by averaging the responses of paired individuals. Both social and non-social dyads were more accurate than individuals. There was no advantage for social over non-social dyads. For larger non-social groups, performance peaked at near perfection with a crowd size of eight participants. We tested three computational models of social collaboration and found that social dyad performance was predicted by the decision of the more accurate partner. We conclude that social interaction does not bolster accuracy for unfamiliar face identity matching in dyads beyond what can be achieved by averaging judgements.     

Dominance of texture over shape in facial identity processing is modulated by individual abilities

For face recognition, observers utilize both shape and texture information. Here, we investigated the relative diagnosticity of shape and texture for delayed matching of familiar and unfamiliar faces (Experiment 1) and identifying familiar and newly learned faces (Experiment 2). Within each familiarity condition, pairs of 3D‐captured faces were morphed selectively in either shape or texture in 20% steps, holding the respective other dimension constant. We also assessed participants’ individual face‐processing skills via the Bielefelder Famous Faces Test (BFFT), the Glasgow Face Matching Test, and the Cambridge Face Memory Test (CFMT). Using multilevel model analyses, we examined probabilities of same versus different responses (Experiment 1) and of original identity versus other/unknown identity responses (Experiment 2). Overall, texture was more diagnostic than shape for both delayed matching and identification, particularly so for familiar faces. On top of these overall effects, above‐average BFFT performance was associated with enhanced utilization of texture in both experiments. Furthermore, above‐average CFMT performance coincided with slightly reduced texture dominance in the delayed matching task (Experiment 1) and stronger sensitivity to morph‐based changes overall, that is irrespective of morph type, in the face identification task (Experiment 2). Our findings (1) show the disproportionate importance of texture information for processing familiar face identity and (2) provide further evidence that familiar and unfamiliar face identity perception are mediated by different underlying processes.     

知觉场理论对面孔知觉年龄偏差效应的解释

使用融合面孔范式和倒置面孔范式来研究面孔知觉的年龄偏差效应,检验知觉场能否作为面孔整体加工的指标,并以此发展年龄偏差的整体加工解释。结果发现：（1）成人和儿童在加工正立面孔时的知觉场均大于加工倒置面孔时的知觉场;（2）在加工正立面孔时,成人加工本年龄面孔比加工他年龄面孔的知觉场更大。上述结果表明：（1）知觉场大小可以作为面孔整体加工的指标,且受面孔朝向的影响;（2）知觉场假设可以解释面孔的年龄偏差效应。     

知觉场理论对面孔知觉年龄偏差效应的解释

使用融合面孔范式和倒置面孔范式来研究面孔知觉的年龄偏差效应,检验知觉场能否作为面孔整体加工的指标,并以此发展年龄偏差的整体加工解释。结果发现：（1）成人和儿童在加工正立面孔时的知觉场均大于加工倒置面孔时的知觉场;（2）在加工正立面孔时,成人加工本年龄面孔比加工他年龄面孔的知觉场更大。上述结果表明：（1）知觉场大小可以作为面孔整体加工的指标,且受面孔朝向的影响;（2）知觉场假设可以解释面孔的年龄偏差效应。     

Applying the attractor field model to social cognition: Perceptual discrimination is facilitated, but memory is impaired for faces displaying evaluatively congruent expressions

A new model of mental representation is applied to social cognition: the attractor field model. Using the model, the authors predicted and found a perceptual advantage but a memory disadvantage for faces displaying evaluatively congruent expressions. In Experiment 1, participants completed a same/different perceptual discrimination task involving morphed pairs of angry-to-happy Black and White faces. Pairs of faces displaying evaluatively incongruent expressions (i.e., happy Black, angry White) were more likely to be labeled as similar and were less likely to be accurately discriminated from one another than faces displaying evaluatively congruent expressions (i.e., angry Black, happy White). Experiment 2 replicated this finding and showed that objective discriminability of stimuli moderated the impact of attractor field effects on perceptual discrimination accuracy. In Experiment 3, participants completed a recognition task for angry and happy Black and White faces. Consistent with the attractor field model, memory accuracy was better for faces displaying evaluatively incongruent expressions. Theoretical and practical implications of these findings are discussed.     

Facial Wipes don't Wash: Facial Image Comparison by Video Superimposition Reduces the Accuracy of Face Matching Decisions

In cases of disputed CCTV identification, expert testimony based on the results of analysis by facial image comparison may be presented to the Jury. However, many of the techniques lack empirical data to support their use. Using a within‐participants design, we compared the accuracy of face‐matching decisions when images were presented using a ‘facial wipe’ technique (where one image is superimposed on another and the display gradually ‘wipes’ between the two) with decisions based on static images. Experiment 1 used high‐quality image pairs; Experiment 2 used disguised target images; and Experiment 3 used degraded target images. Across all three experiments, rather than optimising performance, facial wipes reduced accuracy relative to static presentations. Further, there is evidence that video wipes increase false positives and therefore may increase the likelihood that images of two different people will be incorrectly judged to show the same individual.Copyright © 2016 John Wiley & Sons, Ltd.     

Holistic face encoding is modulated by perceived face race: Evidence from perceptual adaptation

Human expertise at processing faces relies on how facial features are encoded: as a whole template rather than as a sum of independent features. This holistic encoding is less prominent for other-race faces, possibly accounting for the difficulty one encounters in recognizing these faces (the ‘other-race effect’). Here, we tested the hypothesis that the magnitude of holistic face encoding can be modulated by racial categorization of the face. Caucasian participants performed a face-composite task with ‘racially-ambiguous’ face-stimuli (cross-race morphed faces, equally categorized as Asian or Caucasian faces in an independent task). The perceived race of the ambiguous faces was manipulated using adaptation. Experiment 1 showed that identical morphed face-stimuli were processed more holistically when perceived as ‘same-race’ than as ‘other-race’, i.e., following adaptation to ‘other-race’ versus ‘same-race’, respectively. Experiment 2 ascertained that the determining factor in the observed holistic processing modulation was the race of the racially-ambiguous face as perceived, rather than expected, by the participants, which supports the idea that the holistic processing of the face-stimuli was modulated by their race-categorization at the perceptual level.     

Hemisphere-dependent holistic processing of familiar faces

In two behavioral experiments involving lateralized stimulus presentation, we tested whether one of the most commonly used measures of holistic face processing—the composite face effect—would be more pronounced for stimuli presented to the right as compared to the left hemisphere. In experiment 1, we investigated the composite face effect in a verbal identification task, similar to its original report (Young, Hellawell, & Hay, 1987). Aligning top and bottom halves of composite face stimuli led to performance decreases irrespective of hemifield, indicating holistic processing of comparable magnitude for inputs provided separately to either hemisphere. However, when matching of the same top parts was required in experiment 2, an alignment-dependent performance decrease was found for stimuli presented in the left, but not right visual field. These observations suggest that the right hemisphere dominates in early stages of holistic processing, as indexed by the composite face effect, but that later processes such as face identification and naming are based on unified representations that are independent of input lateralization. Moreover, the composite face effect may not rely on the exact same representation(s) when measured in matching and identification tasks.     

An encoding advantage for own-race versus other-race faces

Studies have shown that individuals are better able to recognise the faces of people from their own race than the faces of people from other races. Although the so-called own-race effect has been generally regarded as an advantage in recognition memory, differences in the processing of the own-race versus other-race faces might also be found at the earlier stages of perceptual encoding. In this study, the perceptual basis of the own-race effect was investigated by generating a continuum of images by morphing an East Asian parent face with a Caucasian parent face. In a same/different discrimination task, East Asian and Caucasian participants judged whether the morph faces were physically identical to, or different from, their parent faces. The results revealed a significant race-of-participant by race-of-face interaction such that East Asian participants were better able to discriminate East Asian faces, whereas Caucasian participants were better able to discriminate Caucasian faces. These results indicate that an own-race advantage occurs at the encoding stage of face processing.     

The accuracy of memory for faces of personally known individuals

The present study was aimed at evaluating whether the very high accuracy of memory for familiar faces, demonstrated by Ge et al (2003, Perception 32 601-614) with a very familiar famous person, generalises to faces of personally known individuals. The accuracy of participants' perceptual memory for a close colleague's face and for their own face was evaluated by presenting original and manipulated pictures of these two targets. The manipulation consisted of increasing or decreasing the interocular distance. As in Ge et al's study, results indicated that proportions of correct recognition of the original faces, and just noticeable differences for the detection of alterations in the recognition task, were not significantly different from the corresponding measures in a perceptual discrimination task performed by a sample of participants who did not know the target persons at all. High accuracy of memory generalises to faces of personally known individuals.     

Effect of photographic negation on matching the expressions and identities of faces

In four experiments, participants made speeded same-different responses to pairs of face photographs showing the same woman or different women with the same expression or different expressions. Compared with responses to positive pairs, negative pairs were matched more slowly on identity than on expression. A secondary finding showed that face expressions (same, different) influenced identity responses, and identities influenced expression responses, equally for positive and negative pairs. The independence of this irrelevant-dimension effect from the contrast effect supports the conclusion required by the main finding that negation slows perceptual encoding of surface-based information used for identification more than it does encoding of edge-based information used for expression recognition.