The role of holistic face processing in acquired prosopagnosia: evidence from the composite face effect

Faces are processed more holistically than other objects, and it has been suggested that the loss of holistic face processing causes acquired prosopagnosia. Support for this hypothesis comes from several cases who failed to show holistic face effects as well as the absence of reports of prosopagnosics with unequivocally normal holistic face perception. The current study examines the relationship between holistic face processing and prosopagnosia by testing seven acquired prosopagnosics with the face composite task, a classic measure of holistic face processing. To enhance the robustness of the findings, each prosopagnosic was tested with two versions of the composite task showing upright faces. We also tested an inverted condition to exclude the possibility that more general factors account for composite effects for upright faces. Four of the seven acquired prosopagnosic participants showed consistent upright face composite effects with minimal inverted face composite effects. We conclude that severe face processing deficits can co-occur with intact holistic face processing and that factors other than a loss of holistic processing contribute to the perceptual and recognition deficits in acquired prosopagnosia.     

Individual differences in holistic processing predict face recognition ability

Why do some people recognize faces easily and others frequently make mistakes in recognizing faces? Classic behavioral work has shown that faces are processed in a distinctive holistic manner that is unlike the processing of objects. In the study reported here, we investigated whether individual differences in holistic face processing have a significant influence on face recognition. We found that the magnitude of face-specific recognition accuracy correlated with the extent to which participants processed faces holistically, as indexed by the composite-face effect and the whole-part effect. This association is due to face-specific processing in particular, not to a more general aspect of cognitive processing, such as general intelligence or global attention. This finding provides constraints on computational models of face recognition and may elucidate mechanisms underlying cognitive disorders, such as prosopagnosia and autism, that are associated with deficits in face recognition.     

Impaired holistic and analytic face processing in congenital prosopagnosia: Evidence from the eye-contingent mask/window paradigm

There is abundant evidence that face recognition, in comparison to the recognition of other objects, is based on holistic processing rather than analytic processing. One line of research that provides evidence for this hypothesis is based on the study of people who experience pronounced difficulties in visually identifying conspecifics on the basis of their face. Earlier, we developed a behavioural paradigm to directly test analytic vs. holistic face processing. In comparison to a to be remembered reference face stimulus, one of two test stimuli was either presented in full view, with an eye-contingently moving window (only showing the fixated face feature, and therefore only affording analytic processing), or with an eye-contingently moving mask or scotoma (masking the fixated face feature, but still allowing holistic processing). In the present study we use this paradigm (that we used earlier in acquired prosopagnosia) to study face perception in congenital prosopagnosia (people having difficulties recognizing faces from birth on, without demonstrable brain damage). We observe both holistic and analytic face processing deficits in people with congenital prosopagnosia. Implications for a better understanding, both of congenital prosopagnosia and of normal face perception, are discussed.     

Priming global and local processing of composite faces: revisiting the processing-bias effect on face perception

We used the composite-face illusion and Navon stimuli to determine the consequences of priming local or global processing on subsequent face recognition. The composite-face illusion reflects the difficulty of ignoring the task-irrelevant half-face while attending the task-relevant half if the half-faces in the composite are aligned. On each trial, participants first matched two Navon stimuli, attending to either the global or the local level, and then matched the upper halves of two composite faces presented sequentially. Global processing of Navon stimuli increased the sensitivity to incongruence between the upper and the lower halves of the composite face, relative to a baseline in which the composite faces were not primed. Local processing of Navon stimuli did not influence the sensitivity to incongruence. Although incongruence induced a bias toward different responses, this bias was not modulated by priming. We conclude that global processing of Navon stimuli augments holistic processing of the face.     

Investigating the stability of and relationships among global/local processing measures

Global/local stimuli have been used to estimate global processing biases in individuals and groups, as well as in response to various manipulations. Throughout the literature, multiple different versions of global/local stimuli have been used, such as traditional hierarchical letters and numbers (i.e., Navon letters), abstract hierarchical shapes, and high- and low-spatial-frequency gratings and faces. However, currently it is unclear how reliable or stable performance is on these measures within individuals over time, and whether these seemingly different measures are tapping into the same underlying process. As such, the purpose of the present study was to examine the stability of individual performance on three distinct global/local measures over time and to examine the relationships among the measures. In two studies, we examined the reliability of the biases within, and the relationships among, standard Navon letters in a traditional interference task, hierarchical shapes in a forced choice task, and superimposed high- and low-pass spatial frequency faces in a forced choice task. In both studies, participants completed all three of the tasks, and then returned 7–10 days later to again complete the same tasks. The degree of global/local bias within an individual was found to be highly reliable in the hierarchical shape task and the spatial frequency face task, but less reliable in the traditional Navon letter task. Interestingly, in both studies we found that none of the three measures of global bias were related to each other. Therefore, while these measures do appear to be reliable over time, they may be tapping into distinct aspects of global/local processing.     

What aspects of face processing are impaired in developmental prosopagnosia?

Developmental prosopagnosia (DP) is a severe impairment in identifying faces that is present from early in life and that occurs despite no apparent brain damage and intact visual and intellectual function. Here, we investigated what aspects of face processing are impaired/spared in developmental prosopagnosia by examining a relatively large group of individuals with DP (n = 8) using an extensive battery of well-established tasks. The tasks included measures of sensitivity to global motion and to global form, detection that a stimulus is a face, determination of its sex, holistic face processing, processing of face identity based on features, contour, and the spacing of features, and judgments of attractiveness. The DP cases showed normal sensitivity to global motion and global form and performed normally on our tests of face detection and holistic processing. On the other tasks, many DP cases were impaired but there was no systematic pattern. At least half showed deficits in processing of facial identity based on either the outer contour or spacing of the internal features, and/or on judgments of attractiveness. Three of the eight were impaired in processing facial identify based on the shape of internal features. The results show that DP is a heterogeneous condition and that impairment in recognizing faces cannot be predicted by poor performance on any one measure of face processing.     

Carry-over effects in face recognition: Processing mode or attentional window?

This study investigates whether or not the dominant processing mode (global or local) in a Navon task is carried over to a face recognition task when the dominant processing mode (configural or featural) in an encoding phase is manipulated. In Experiment 1, Navon figures that were equal in size to a facial photograph were prepared. Participants performed better on the face recognition task after reading large letters in the Navon figures than after reading small letters when configural processing was required in the encoding phase. In Experiment 2, Navon figures that were equal in size to the parts of a face were prepared. The performance after reading large letters did not differ from that after reading small letters. This suggests that both the dominant processing mode in Navon tasks and the size of Navon figures should be considered when discussing the effects of Navon tasks in face recognition.     

Processing orientation and emotion recognition

There is evidence that some emotional expressions are characterized by diagnostic cues from individual face features. For example, an upturned mouth is indicative of happiness, whereas a furrowed brow is associated with anger. The current investigation explored whether motivating people to perceive stimuli in a local (i.e., feature-based) rather than global (i.e., holistic) processing orientation was advantageous for recognizing emotional facial expressions. Participants classified emotional faces while primed with local and global processing orientations, via a Navon letter task. Contrary to previous findings for identity recognition, the current findings are indicative of a modest advantage for face emotion recognition under conditions of local processing orientation. When primed with a local processing orientation, participants performed both significantly faster and more accurately on an emotion recognition task than when they were primed with a global processing orientation. The impacts of this finding for theories of emotion recognition and face processing are considered.     

The “parts and wholes” of face recognition: A review of the literature

It has been claimed that faces are recognized as a “whole” rather than by the recognition of individual parts. In a paper published in the Quarterly Journal of Experimental Psychology in 1993, Martha Farah and I attempted to operationalize the holistic claim using the part/whole task. In this task, participants studied a face and then their memory presented in isolation and in the whole face. Consistent with the holistic view, recognition of the part was superior when tested in the whole-face condition compared to when it was tested in isolation. The “whole face” or holistic advantage was not found for faces that were inverted, or scrambled, nor for non-face objects, suggesting that holistic encoding was specific to normal, intact faces. In this paper, we reflect on the part/whole paradigm and how it has contributed to our understanding of what it means to recognize a face as a “whole” stimulus. We describe the value of part/whole task for developing theories of holistic and non-holistic recognition of faces and objects. We discuss the research that has probed the neural substrates of holistic processing in healthy adults and people with prosopagnosia and autism. Finally, we examine how experience shapes holistic face recognition in children and recognition of own- and other-race faces in adults. The goal of this article is to summarize the research on the part/whole task and speculate on how it has informed our understanding of holistic face processing.     

Damasio's error – Prosopagnosia with intact within‐category object recognition

The sudden inability to recognize individual faces following brain damage was first reported in a scientific journal 150 years ago and termed ‘prosopagnosia’ 70 years ago. While the term originally identified a face‐selective neurological condition, it is now obscured by a sequence of imprecisions. First, prosopagnosia is routinely used to define symptoms of individual face recognition (IFR) difficulties in the context of visual object agnosia or other neurological conditions, or even in the normal population. Second, this over‐expansive definition has lent support to a long‐standing within‐category recognition account of prosopagnosia, that is, that the impairment of IFR reflects a general impairment in recognizing within‐category objects. However, stringent experimental studies of classical cases of prosopagnosia following brain damage show that their core impairment is not in recognizing physically similar exemplars within non‐face object categories. Instead, the impairment presents specifically for recognizing exemplars of the category of faces. Moreover, compared to typical observers, the impairment appears even more severe for recognizing individual faces against physically dissimilar than similar distractors. Here, I argue that we need to limit accordingly our definition of prosopagnosia to a clinical (i.e., neurological) condition in which there is no basic‐level object recognition impairment. Other criteria for prosopagnosia are proposed, with the hope that this conservative definition enables the study of human IFR processes in isolation, and supports progress in understanding the nature of these processes.     

Is the loss of diagnosticity of the eye region of the face a common aspect of acquired prosopagnosia?

A recent study published in this journal has shown an abnormal performance at discriminating differences with respect to the eyes of unfamiliar faces in two acquired prosopagnosic patients, but preserved processing of the mouth region. Here we extend these findings by showing a similar lack of sensitivity to the eyes in the very same face matching experiment for the prosopagnosic patient PS, who also showed normal performance for detecting differences in the mouth region. These results complement previously published evidence that the patient PS presents a lack of sensitivity to diagnostic information located on the eyes of familiar faces during individual face recognition tasks. More generally, they indicate that the impaired processing of the eyes of faces is a fundamental aspect of acquired prosopagnosia that can arise following damage to different brain localizations.     

Global precedence effects account for individual differences in both face and object recognition performance

There has been an increase in studies adopting an individual difference approach to examine visual cognition and in particular in studies trying to relate face recognition performance with measures of holistic processing (the face composite effect and the part-whole effect). In the present study we examine whether global precedence effects, measured by means of non-face stimuli in Navon’s paradigm, can also account for individual differences in face recognition and, if so, whether the effect is of similar magnitude for faces and objects. We find evidence that global precedence effects facilitate both face and object recognition, and to a similar extent. Our results suggest that both face and object recognition are characterized by a coarse-to-fine temporal dynamic, where global shape information is derived prior to local shape information, and that the efficiency of face and object recognition is related to the magnitude of the global precedence effect.     

Same,same — but different: On the use of Navon derived measures of global/local processing in studies of face processing

Some studies have reported a significant correlation between face discrimination/recognition ability and indexes of global/local processing derived from the Navon paradigm. Other studies, however, have failed to find such a relationship. In this paper we examine three aspects related to the Navon paradigm that may have contributed to this discrepancy but which have been largely neglected: (i) the use of different types of compound stimuli across studies, (ii) differences between studies in the type of index derived from the Navon paradigm, and (iii) the reliability of these indexes. In a Navon experiment comparing performance with compound letters and compound shapes in normal participants, we find little consistency both within and across participants in how they perform with these stimulus types, despite the fact that both stimulus types give rise to the typical effects. In addition we find that many of the Navon derived indexes of global/local effects used in studies examining face processing have low reliability and do not measure the same aspects of global/local processing. Echoing the results from the normal participants, we also find little consistency in how a congenital prosopagnosic performs in the Navon paradigm. With compound letters, she responds much faster to local than to global aspects of the stimuli; a pattern not seen in a single of the normal participants. With compound shapes, however, she exhibits no such abnormality. These findings question the validity of the conclusions in studies relating Navon derived indexes of global/local processing to face processing.     

Reduced fixation on the upper area of personally familiar faces following acquired prosopagnosia

Selective impairment of face recognition following brain damage, as in acquired prosopagnosia, may cause a dramatic loss of diagnosticity of the eye area of the face and an increased reliance on the mouth for identification ( Caldara et al., 2005 ). To clarify the nature of this phenomenon, we measured eye fixation patterns in a case of pure prosopagnosia (PS, Rossion et al., 2003 ) during her identification of photographs of personally familiar faces (27 children of her kindergarten). Her age‐matched colleague served as a control. Consistent with previous evidence, the normal control identified the faces within two fixations located just below the eyes (central upper nose). This pattern (location and duration) of fixations remained unchanged even by increasing difficulty by presenting anti‐caricatures of the faces. In contrast, the great majority of the patient's fixations, irrespective of her accuracy, were located on the mouth. Overall, these observations confirm the abnormally reduced processing of the upper area of the face in acquired prosopagnosia. Most importantly, the prosopagnosic patient also fixated the area of the eyes spontaneously in between the first and last fixation, ruling out alternative accounts of her behaviour such as, for example, avoidance or failure to orient attention to the eyes, as observed in autistic or bilateral amygdala patients. Rather, they reinforce our proposal of a high‐level perceptual account ( Caldara et al., 2005 ), according to which acquired prosopagnosic patients have lost the ability to represent multiple elements of an individual face as a perceptual unit (holistic face perception). To identify a given face, they focus very precisely on local features rather than seeing the whole of a face from its diagnostic centre (i.e. just below the eyes). The upper area of the face is particularly less attended to and less relevant for the prosopagnosic patient because it contains multiple features that require normal holistic perception in order to be the most diagnostic region. Consequently, prosopagnosic patients develop a more robust representation of the mouth, a relatively isolated feature in the face that may contain more information than any single element of the upper face area, and is thus sampled repeatedly for resolving ambiguity in the process of identification.     

Faces are "spatial"--holistic face perception is supported by low spatial frequencies

Faces are perceived holistically, a phenomenon best illustrated when the processing of a face feature is affected by the other features. Here, the authors tested the hypothesis that the holistic perception of a face mainly relies on its low spatial frequencies. Holistic face perception was tested in two classical paradigms: the whole-part advantage (Experiment 1) and the composite face effect (Experiments 2-4). Holistic effects were equally large or larger for low-pass filtered faces as compared to full-spectrum faces and significantly larger than for high-pass filtered faces. The disproportionate composite effect found for low-pass filtered faces was not observed when holistic perception was disrupted by inversion (Experiment 3). Experiment 4 showed that the composite face effect was enhanced only for low spatial frequencies, but not for intermediate spatial frequencies known be critical for face recognition. These findings indicate that holistic face perception is largely supported by low spatial frequencies. They also suggest that holistic processing precedes the analysis of local features during face perception.     

Face to face with emotion: holistic face processing is modulated by emotional state

Negative emotions are linked with a local, rather than global, visual processing style, which may preferentially facilitate feature-based, relative to holistic, processing mechanisms. Because faces are typically processed holistically, and because social contexts are prime elicitors of emotions, we examined whether negative emotions decrease holistic processing of faces. We induced positive, negative, or neutral emotions via film clips and measured holistic processing before and after the induction: participants made judgements about cued parts of chimeric faces, and holistic processing was indexed by the interference caused by task-irrelevant face parts. Emotional state significantly modulated face-processing style, with the negative emotion induction leading to decreased holistic processing. Furthermore, self-reported change in emotional state correlated with changes in holistic processing. These results contrast with general assumptions that holistic processing of faces is automatic and immune to outside influences, and they illustrate emotion's power to modulate socially relevant aspects of visual perception.     

Face Recognition in Young Children: When the Whole is Greater than the Sum of Its Parts

Do young children recognize faces differently than older children and adults? Previous research (Carey & Diamond, 1977) has suggested that, before the age of 8, children recognize a face by its individual features; after the age of 8, they switch to a whole-face (holistic) recognition strategy. The part-whole paradigm provides a suitable test for the encoding switch hypothesis. In this paradigm, memory for a face part is probed when the part is presented in isolation and in the whole face. The difference in performance between the two test conditions serves as an index of holistic processing. Results from such studies reveal that even 6-year-olds remember parts from upright faces better when tested in the whole-face context than in isolation. When faces are inverted, the holistic processes of young children and older children are disrupted. These results indicate that counter to the encoding switch hypothesis, children recognize faces holistically by 6 years of age.     

Normal perception of Mooney faces in developmental prosopagnosia: Evidence from the N170 component and rapid neural adaptation

Individuals with developmental prosopagnosia (DP) have a severe difficulty recognizing the faces of known individuals in the absence of any history of neurological damage. These recognition problems may be linked to selective deficits in the holistic/configural processing of faces. We used two‐tone Mooney images to study the processing of faces versus non‐face objects in DP when it is based on holistic information (or the facial gestalt) in the absence of obvious local cues about facial features. A rapid adaptation procedure was employed for a group of 16 DPs. Naturalistic photographs of upright faces were preceded by upright or inverted Mooney faces or by Mooney houses. DPs showed face‐sensitive N170 components in response to Mooney faces versus houses, and N170 amplitude reductions for inverted as compared to upright Mooney faces. They also showed the typical pattern of N170 adaptation effects, with reduced N170 components when upright naturalistic test faces were preceded by upright Mooney faces, demonstrating that the perception of Mooney and naturalistic faces recruits shared neural populations. Our findings demonstrate that individuals with DP can utilize global information about face configurations for categorical discriminations between faces and non‐face objects, and suggest that face processing deficits emerge primarily at more fine‐grained higher level stages of face perception.     

The effects of precedence on Navon-induced processing bias in face recognition

Macrae and Lewis (2002) showed that repeated reporting of the global dimension of Navon stimuli improved performance in a subsequent face identification task, whilst reporting the features of the Navon stimuli impaired performance. Using a face composite task, which is assumed to require featural processing, Weston and Perfect (2005) showed the complementary pattern: Featural responding to Navon letters speeded performance. However, both studies used Navon stimuli with global precedence, in which the overall configuration is easier to report than the features. Here we replicate the two studies above, whilst manipulating the precedence (global or featural) of the letter stimuli in the orientation task. Both studies replicated the previously reported findings with global precedence stimuli, but showed the reverse pattern with local precedence stimuli. These data raise important questions as to what is transferred between the Navon orientation task and the face-processing tasks that follow.     

Prosopagnosia: a case study involving problems in processing configural information

An ongoing issue in face recognition research is whether holistic face processing relies on the segregation of local discrete facial parts. Evidence in favor of the holistic-plus-parts view stems from a recent study reported by Arguin and Saumier (1999), who show that the priming effects of individual facial parts (i.e., eyes, nose, mouth, orcontour) depends on the presence of configural information and that the magnitude of priming augments as the number of facial parts serving as primes increase. The present study demonstrates that these global processing effects are absent in a prosopagnosic patient (A.R.), who shows no priming from single face parts and a linear increase in the magnitude of priming as a function of the number of parts presented. These findings indicate that A.R. is incapable of integrating individual facial parts into a global facial configuration ant that this is likely at the root of her prosopagnosia.