OVERT AND COVERT RECOGNITION OF FACES IN CHILDREN AND ADULTS

Abstract— There has been considerable recent interest in covert face-recognition effects. In Experiment 1, we adapted a paradigm, previously shown to produce covert recognition effects, to test 5-year-old children. Classmates' photographs served as the familiar faces. Children showed effects of familiarity on face matching similar to the effect normal adults and prosopagnosics had previously shown for famous faces In Experiment 2, we investigated whether brief familiarization with the photographs used in Experiment 1 would suffice to produce the effects, in children and adults. It did not, even though the exposure did lead to above-chance overt recognition. Taken together with previous studies, the data suggest that covert recognition may be doubly dissociable from overt recognition. Finding a double dissociation would place constraints on models of face recognition.     

Neuropsychological Impairment of Face Recognition Units

Despite the absence of “conscious”, overt identification, some patients with face recognition impairments continue covertly to process information regarding face familiarity. The fact that by no means all patients show these covert effects has led to the suggestion that indirect recogntion tasks may help in identifying different types of face recognition impairment. The present report describes a number of experiments with the patient NR, who, after a closed head injury, has been severely impaired at recognizing familiar faces. Investigations mostly failed to show overt or covert face recognition, but NR performed at an above-chance level in selecting the familiar face on a task requiring a forced-choice between a familiar and an unfamiliar face. This discrepancy between a degree of rudimentary overt recognition and absence of covert effects on most indirect tests was addressed using a cross-domaim identity priming paradigm. This examined separately the possibility of preserved recognition for faces that NR consistently chose correctly in a forced-choice familiarity decision and those on which he performed at chance level. Priming effects were apparent only for the faces that were consistently chosen as “familiar” in forced-choice. We suggest that NR's stored representations of familiar faces are degraded, so that face recognition is possible only via a limited set of relatively preserved representations able to support a rudimentary form of overt recognition and to facilitate performance in matching and priming tasks.     

What is Overt and what is Covert in Congenital Prosopagnosia?

The term covert recognition refers to recognition without awareness. In the context of face recognition, it refers to the fact that some individuals show behavioural, electrophysiological or autonomic indices of recognition in the absence of overt, conscious recognition. Originally described in cases of people that have lost their ability to overtly recognize faces (acquired prosopagnosia, AP), covert face recognition has more recently also been described in cases of congenital prosopagnosia (CP), who never develop typical overt face recognition skills. The presence of covert processing in a developmental disorder such as CP is a particularly intriguing phenomenon, and its investigation is relevant for a variety of reasons. From a theoretical point of view, it is useful to help shed light on the cognitive and neural underpinnings of face recognition deficits. From a clinical point of view, it has the potential to aid the design of rehabilitation protocols aimed at improving face recognition skills in this population. In the current review we selectively summarize the recent literature on covert face recognition in CP, highlight its main findings, and provide a theoretical interpretation for them.     

Covert processing of faces in prosopagnosia is restricted to facial expressions: evidence from cross-modal bias

We present a single case study of a brain-damaged patient, AD, suffering from visual face and object agnosia, with impaired visual perception and preserved mental imagery. She is severely impaired in all aspects of overt recognition of faces as well as in covert recognition of familiar faces. She shows a complete loss of processing facial expressions in recognition as well as in matching tasks. Nevertheless, when presented with a task where face and voice expressions were presented concurrently, there was a clear impact of face expressions on her ratings of the voice. The cross-modal paradigm used here and validated previously with normal subjects (de Gelder & Vroomen, 1995, 2000), appears as a useful tool in investigating spared covert face processing in a neuropsychological perspective, especially with prosopagnosic patients. These findings are discussed against the background of different models of the covert recognition of face expressions.     

Long-term effects of covert face recognition

Covert face recognition has previously been thought to produce only very short-lasting effects. In this study we demonstrate that manipulating subjects' attentional load affects explicit, but not implicit memory for faces, and that implicit effects can persist over much longer intervals than is normally reported. Subjects performed letter-string tasks of high vs. low perceptual load (Lavie, N. (1995). Perceptual load as a necessary condition for selective attention. Journal of Experimental Psychology: Human Perception and Perfomance. 21, 451-468.), while ignoring task-irrelevant celebrity faces. Memory for the faces was then assessed using (a) a surprise recognition test for the celebrities' names, and (b) repetition priming in a face familiarity task. The load manipulation strongly influenced explicit recognition memory, but had no effect on repetition priming from the same items. Moreover, faces from the high load condition produced the same amount of priming whether they were explicitly remembered or not. This result resolves a long-standing anomaly in the face recognition literature, and is discussed in relation to covert processing in prosopagnosia.     

The sibling familiarity effect: Is within-person facial variability shared across siblings?

Humans are experts at familiar face recognition, but poor at unfamiliar face recognition. Familiarity is created when a face is encountered across varied conditions, but the way in which a person’s appearance varies is identity-specific, so familiarity with one identity does not benefit recognition of other individuals. However, the faces of biological siblings share structural similarities, so we explored whether the benefits of familiarity are shared across siblings. Results show that familiarity with one half of a sibling pair improves kin detection (experiment 1), and that unfamiliar face matching is more accurate when targets are the siblings of familiar versus unfamiliar individuals (experiment 2). PCA applied to facial images of celebrities and their siblings demonstrates that faces are generally better reconstructed in the principal components of a same-sex sibling than those of an unrelated individual. When we encounter the unfamiliar sibling of someone we already know, our pre-existing representation of their familiar relation may usefully inform processing of the unfamiliar face. This can benefit both kin detection and identity processing, but the benefits are constrained by the degree to which facial variability is shared.     

Covert detection of attractiveness among the neurologically intact: evidence from skin-conductance responses

Several studies have shown that participants, without a deficit in face recognition, give an increased skin conductance response (SCR) to familiar faces when presented subliminally, hence suggesting covert recognition of these faces. In the experiment presented here we manipulated familiarity and attractiveness and tested whether participants distinguished between faces for these variables when presented too fast to allow conscious recognition. Three sets of faces were presented: famous attractive; unfamiliar attractive; and unfamiliar less attractive. SCRs were the same for each category of faces whether presented subliminally or supraliminally, and were the same for attractive faces, whether famous or unfamiliar; however, SCRs differed between the attractive and less attractive faces. The findings support those of Stone et al (2001 Cognitive, Affective and Behavioral Neuroscience 1 183-191) and suggest that higher SCRs to famous faces are not necessarily due to covert recognition, but may be a response to the positive affective valence of the stimuli.     

Demonstrating the acquired familiarity of faces by using a gender-decision task

We report an experiment in which participants made gender judgments (male or female) to faces. There were three groups of faces: unfamiliar, familiar (celebrities), and a set which had been learned earlier by the participants during the experimental session. The principal purpose of this study was to establish an indirect measure of assessing whether faces have become familiar through learning that does not require overt recognition. Bruce and Young's (1986 British Journal of Psychology 77 305-327) model of face recognition suggests face-processing tasks are independent of one another and so familiarity should have no impact on the time taken to perform gender decisions. However, recent studies have suggested that some face processes are not completely independent. A gender judgment is a simple task which would be useful in face-learning experiments. We examined whether exposure to previously novel faces facilitates a later gender decision to those faces. During a learning stage, participants viewed a set of unfamiliar faces. At test, participants were able to assign gender faster to previously familiar (famous) faces and learned faces than they were to unfamiliar faces. Therefore familiarity can influence the speed at which gender is analysed. We explain our findings with reference to the Burton et al (1990 British Journal of Psychology 81 361-380) interactive activation and competition (IAC) model of face recognition and discuss how the gender judgment might be employed as a means of tracking the acquisition of familiarity in face-learning studies.     

Electrodermal discrimination of familiar but not unfamiliar faces in prosopagnosia

It has been previously shown that prosopagnosics can electrodermally "recognize" faces they cannot verbally identify and with which they feel no familiarity. This study extended previous results by showing that electrodermal discrimination of faces exists only on a famous face identification task, and not on a matching-to-sample task involving unfamiliar faces. This suggests that electrodermal recognition reflects the activation of stored identity-specific information built up on the basis of past contact with faces, and provides a psychophysiological distinction between familiar and unfamiliar face processing. Implications for cognitive models of face recognition, and for understanding the nature of prosopagnosia, are discussed.     

Dissociating positive and negative influences of verbal processing on the recognition of pictures of faces and objects

Four experiments investigated the role of verbal processing in the recognition of pictures of faces and objects. We used (a) a stimulus-encoding task where participants learned sequentially presented pictures in control, articulatory suppression, and describe conditions and then engaged in an old-new picture recognition test and (b) a poststimulus-encoding task where participants learned the stimuli without any secondary task and then either described or not a single item from memory before the recognition test. The main findings were as follows: First, verbalization influenced picture recognition. Second, there were contrasting influences of verbalization on the recognition of faces, compared with objects, that were driven by (a) the stage of processing during which verbalization took place (as assessed by the stimulus-encoding and poststimulus-encoding tasks), (b) whether verbalization was subvocal (whereby one goes through the motions of speaking but without making any sound) or overt, and (c) stimulus familiarity. During stimulus encoding there was a double dissociation whereby subvocal verbalization interfered with the recognition of faces but not objects, while overt verbalization benefited the recognition of objects but not faces. In addition, stimulus familiarity provided an independent and beneficial influence on performance. Post stimulus encoding, overt verbalization interfered with the recognition of both faces and objects, and this interference was apparent for unfamiliar but not familiar stimuli. Together these findings extend work on verbalization to picture recognition and place important parameters on stimulus and task constraints that contribute to contrasting beneficial and detrimental effects of verbalization on recognition memory.     

Effect of familiarity and viewpoint on face recognition in chimpanzees

Numerous studies have shown that familiarity strongly influences how well humans recognize faces. This is particularly true when faces are encountered across a change in viewpoint. In this situation, recognition may be accomplished by matching partial or incomplete information about a face to a stored representation of the known individual, whereas such representations are not available for unknown faces. Chimpanzees, our closest living relatives, share many of the same behavioral specializations for face processing as humans, but the influence of familiarity and viewpoint have never been compared in the same study. Here, we examined the ability of chimpanzees to match the faces of familiar and unfamiliar conspecifics in their frontal and 3/4 views using a computerized task. Results showed that, while chimpanzees were able to accurately match both familiar and unfamiliar faces in their frontal orientations, performance was significantly impaired only when unfamiliar faces were presented across a change in viewpoint. Therefore, like in humans, face processing in chimpanzees appears to be sensitive to individual familiarity. We propose that familiarization is a robust mechanism for strengthening the representation of faces and has been conserved in primates to achieve efficient individual recognition over a range of natural viewing conditions.     

Face processing and familiarity: Evidence from eye‐movement data

How is information extracted from familiar and unfamiliar faces? Three experiments, in which eye‐movement measures were used, examined whether there was differential sampling of the internal face region according to familiarity. Experiment 1 used a face familiarity task and found that whilst the majority of fixations fell within the internal region, there were no differences in the sampling of this region according to familiarity. Experiment 2 replicated these findings, using a standard recognition memory paradigm. The third experiment employed a matching task, and once again found that the majority of fixations fell within the internal region. Additionally, this experiment found that there was more sampling of the internal region when faces were familiar compared with when they were unfamiliar. The use of eye fixation measures affirms the importance of internal facial features in the recognition of familiar faces compared with unfamiliar faces, but only when viewers compare pairs of faces.     

The influence of positive and negative facial expressions on face familiarity

Recent studies have shown that smiling faces are judged as more familiar than those showing a neutral expression (Baudouin, Gilibert, Sansone, & Tiberghien, 2000). Here we compare judged familiarity of unknown and famous faces when displaying a positive, neutral, or negative expression. Our results confirm a smiling familiarity bias, with positive-expression faces judged as being more familiar. Importantly, we also show significantly reduced familiarity for negative-expression faces, compared with neutral- or positive-expression faces. This difference in judged familiarity is not due to differences in expression intensity, but instead related to expression valence. Results are discussed with regard to the independence of facial identity and expression processing, and in terms of factors that influence face familiarity and memory.     

The association of physical activity to occipito-temporal processing during face recognition

ObjectivesThis study examined the association between physical activity level and primitive cognitive processing during a face recognition task in young adults, a topic that has received little attention.DesignCross-sectional.MethodsThe face recognition task required participants to respond to famous faces but not respond to unfamiliar faces. Task performance and several occipito-temporal event-related brain potentials reflecting the various stages of face processing, from perceptual encoding (N170) to recognition (N250 and face-N400), were assessed during the face recognition task.ResultsAlthough analyses revealed no significant group differences in behavioral performance measures, neuroelectric data showed different time courses of face recognition processes between groups. Active individuals exhibited larger N250 amplitude, reflecting an early stage of facial recognition, for famous relative to unfamiliar faces, whereas inactive individuals did not exhibit such a difference.ConclusionsThese findings are suggestive of a possible association between physical activity and relatively early, primitive cognitive processes.     

Dominance of texture over shape in facial identity processing is modulated by individual abilities

For face recognition, observers utilize both shape and texture information. Here, we investigated the relative diagnosticity of shape and texture for delayed matching of familiar and unfamiliar faces (Experiment 1) and identifying familiar and newly learned faces (Experiment 2). Within each familiarity condition, pairs of 3D‐captured faces were morphed selectively in either shape or texture in 20% steps, holding the respective other dimension constant. We also assessed participants’ individual face‐processing skills via the Bielefelder Famous Faces Test (BFFT), the Glasgow Face Matching Test, and the Cambridge Face Memory Test (CFMT). Using multilevel model analyses, we examined probabilities of same versus different responses (Experiment 1) and of original identity versus other/unknown identity responses (Experiment 2). Overall, texture was more diagnostic than shape for both delayed matching and identification, particularly so for familiar faces. On top of these overall effects, above‐average BFFT performance was associated with enhanced utilization of texture in both experiments. Furthermore, above‐average CFMT performance coincided with slightly reduced texture dominance in the delayed matching task (Experiment 1) and stronger sensitivity to morph‐based changes overall, that is irrespective of morph type, in the face identification task (Experiment 2). Our findings (1) show the disproportionate importance of texture information for processing familiar face identity and (2) provide further evidence that familiar and unfamiliar face identity perception are mediated by different underlying processes.     

Haven't we met before? The effect of facial familiarity on repetition priming

Within the word recognition literature, word‐frequency and hence familiarity has been shown to affect the degree of repetition priming. The current paper reports two experiments which examine whether familiarity also affects the degree of repetition priming for faces. The results of Experiment 1 confirmed that familiarity did moderate the degree of priming in a face recognition task. Low familiarity faces were primed to a significantly greater degree than high familiarity faces in terms of accuracy, speed, and efficiency of processing. Experiment 2 replicated these results but additionally, demonstrated that familiarity moderates priming for name recognition as well as face recognition. These results can be accommodated within both a structural account of repetition priming ( Burton, Bruce & Johnston, 1990 ) and an Episodic Memory account of repetition priming (see Roediger, 1990 ), and are discussed in terms of a common mechanism for priming, learning and the representation of familiarity.     

A bottleneck in face identification: repetition priming from flanker images

There is evidence that face processing is capacity-limited in distractor interference tasks and in tasks requiring overt recognition memory. We examined whether capacity limits for faces can be observed with a more sensitive measure of visual processing, by measuring repetition priming of flanker faces that were presented alongside a face or a nonface target. In Experiment 1, we found identity priming for face flankers, by measuring repetition priming across a change in image, during task-relevant nonface processing, but not during the processing of a concurrently-presented face target. Experiment 2 showed perceptual priming of the flanker faces, across identical images at prime and test, when they were presented alongside a face target. In a third Experiment, all of these effects were replicated by measuring identity priming and perceptual priming within the same task. Overall, these results imply that face processing is capacity limited, such that only a single face can be identified at one time. Merely attending to a target face appears sufficient to trigger these capacity limits, thereby extinguishing identification of a second face in the display, although our results demonstrate that the additional face remains at least subject to superficial image processing.     

Structure and function in acquired prosopagnosia: Lessons from a series of 10 patients with brain damage

Acquired prosopagnosia varies in both behavioural manifestations and the location and extent of underlying lesions. We studied 10 patients with adult‐onset lesions on a battery of face‐processing tests. Using signal detection methods, we found that discriminative power for the familiarity of famous faces was most reduced by bilateral occipitotemporal lesions that involved the fusiform gyri, and better preserved with unilateral right‐sided lesions. Tests of perception of facial structural configuration showed severe deficits with lesions that included the right fusiform gyrus, whether unilateral or bilateral. This deficit was most consistent for eye configuration, with some patients performing normally for mouth configuration. Patients with anterior temporal lesions had better configuration perception, though at least one patient showed a more subtle failure to integrate configural data from different facial regions. Facial imagery, an index of facial memories, was severely impaired by bilateral lesions that included the right anterior temporal lobe and marginally impaired by fusiform lesions alone; unilateral right fusiform lesions tended to spare imagery for facial features. These findings suggest that (1) prosopagnosia is more severe with bilateral than unilateral lesions, indicating a minor contribution of the left hemisphere to face recognition, (2) perception of facial configuration critically involves the right fusiform gyrus and (3) access to facial memories is most disrupted by bilateral lesions that also include the right anterior temporal lobe. This supports assertions that more apperceptive variants of prosopagnosia are linked to fusiform damage, whereas more associative variants are linked to anterior temporal damage. Next, we found that behavioural indices of covert recognition correlated with measures of overt familiarity, consistent with theories that covert behaviour emerges from the output of damaged neural networks, rather than alternative pathways. Finally, to probe the face specificity of the prosopagnosic defect, we tested recognition of fruits and vegetables: While face specificity was not found in most of our patients, the data of one patient suggested that this may be possible with more focal lesions of the right fusiform gyrus.     

Why are moving faces easier to recognize?

Previous work has suggested that seeing a famous face move aids the recognition of identity, especially when viewing conditions are degraded (Knight & Johnston, ; Lander, Christie, & Bruce, ). Experiment 1 investigated whether the beneficial effects of motion are related to a particular type of facial motion (expressing, talking, or rigid motion). Results showed a significant beneficial effect of both expressive and talking movements, but no advantage for rigid motion, compared with a single static image. Experiment 2 investigated whether the advantage for motion is uniform across identity. Participants rated moving famous faces for distinctiveness of motion. The famous faces (moving and static freeze frame) were then used as stimuli in a recognition task. The advantage for face motion was significant only when the motion displayed was distinctive. Results suggest that a reason why moving faces are easier to recognize is because some familiar faces have characteristic motion patterns, which act as an additional cue to identity.