Perceptual load effects on processing distractor faces indicate face-specific capacity limits

The claim that face perception is mediated by a specialized “face module” that proceeds automatically, independently of attention (e.g., Kanwisher, 2000) can be reconciled with load theory claims that visual perception has limited capacity (e.g., Lavie, 1995) by hypothesizing that face perception has face-specific capacity limits. We tested this hypothesis by comparing the effects of face and nonface perceptual load on distractor face processing. Participants searched a central array of either faces or letter strings for a pop star versus politician's face or name and made speeded classification responses. Perceptual load was varied through the relevant search set size. Response competition effects from a category-congruent or -incongruent peripheral distractor face were eliminated with more than two faces in the face search task, but were unaffected by perceptual load in the name search task. These results support the hypothesis that face perception has face-specific capacity limits and resolve apparent discrepancies in previous research.     

Specificity of face processing without awareness

The recognition memory for inverted faces is especially difficult when compared with that for non-face stimuli. This face inversion effect has often been used as a marker of face-specific holistic processing. However, whether face processing without awareness is still specific remains unknown. The present study addressed this issue by examining the face inversion effect with the technique of binocular rivalry. Results showed that invisible upright faces could break suppression faster than invisible inverted faces. Nevertheless, no difference was found for invisible upright houses and invisible inverted houses. This suggested that face processing without awareness is still specific. Some face-specific information can be processed by high-level brain areas even when that information is invisible.     

Individual differences in holistic processing predict face recognition ability

Why do some people recognize faces easily and others frequently make mistakes in recognizing faces? Classic behavioral work has shown that faces are processed in a distinctive holistic manner that is unlike the processing of objects. In the study reported here, we investigated whether individual differences in holistic face processing have a significant influence on face recognition. We found that the magnitude of face-specific recognition accuracy correlated with the extent to which participants processed faces holistically, as indexed by the composite-face effect and the whole-part effect. This association is due to face-specific processing in particular, not to a more general aspect of cognitive processing, such as general intelligence or global attention. This finding provides constraints on computational models of face recognition and may elucidate mechanisms underlying cognitive disorders, such as prosopagnosia and autism, that are associated with deficits in face recognition.     

Ignoring famous faces: category-specific dilution of distractor interference

The extent to which famous distractor faces can be ignored was assessed in six experiments. Subjects categorized famous printed target names as those of pop stars or politicians, while attempting to ignore a flanking famous face distractor that could be congruent (e.g, a politician's name and face) or incongruent (e.g., a politician's name with a pop stars face). Congruency effects on reaction times indicated distractor intrusion. An additional, response-neutral flanker (neither pop star nor politician) could also be present. Congruency effects from the critical distractor face were reduced (diluted) by the presence of an intact anonymous face, but not by phase-shifted versions, inverted faces, or meaningful nonface objects. By contrast, congruency effects from other types of distracting objects (musical instruments, fruits), when printed names for these classes were categorized, were diluted equivalently by intact faces, phase-shifted faces, or meaningful nonface objects. Our results suggest that distractor faces act differently from other types of distractors, suffering from only face-specific capacity limits.     

Attention capture by faces

We report three experiments that investigate whether faces are capable of capturing attention when in competition with other non-face objects. In Experiment 1a participants took longer to decide that an array of objects contained a butterfly target when a face appeared as one of the distracting items than when the face did not appear in the array. This irrelevant face effect was eliminated when the items in the arrays were inverted in Experiment 1b ruling out an explanation based on some low-level image-based properties of the faces. Experiment 2 replicated and extended the results of Experiment 1a. Irrelevant faces once again interfered with search for butterflies but, when the roles of faces and butterflies were reversed, irrelevant butterflies no longer interfered with search for faces. This suggests that the irrelevant face effect is unlikely to have been caused by the relative novelty of the faces or arises because butterflies and faces were the only animate items in the arrays. We conclude that these experiments offer evidence of a stimulus-driven capture of attention by faces.     

Face processing is enhanced in the left and upper visual hemi-fields

We tested whether two known hemi-field asymmetries would affect visual search with face stimuli. Holistic processing of spatial configurations is better in the left hemi-field, reflecting a right hemisphere specialization, and object recognition is better in the upper visual field, reflecting stronger projections into the ventral stream. Faces tap into holistic processing and object recognition at the same time, which predicts better performance in the left and upper hemi-field, respectively. In the first experiment, participants had to detect a face with a gaze direction different from the remaining faces. Participants were faster to respond when targets were presented in the left and upper hemi-field. The same pattern of results was observed when only the eye region was presented. In the second experiment, we turned the faces upside-down, which eliminated the typical spatial configuration of faces. The left hemi-field advantage disappeared, showing that it is related to holistic processing of faces, whereas the upper hemi-field advantage related to object recognition persisted. Finally, we made the search task easier by asking observers to search for a face with open among closed eyes or vice versa. The easy search task eliminated the need for complex object recognition and, accordingly, the advantage of the upper visual field disappeared. Similarly, the left hemi-field advantage was attenuated. In sum, our findings show that both horizontal and vertical asymmetries affect the search for faces and can be selectively suppressed by changing characteristics of the stimuli.     

Ensemble coding of facial identity is not refined by experience: Evidence from other-race and inverted faces

The ability to recognize identity despite within-person variability in appearance is likely a face-specific skill and shaped by experience. Ensemble coding – the automatic extraction of the average of a stimulus array – has been proposed as a mechanism underlying face learning (allowing one to recognize novel instances of a newly learned face). We investigated whether ensemble encoding, like face learning and recognition, is refined by experience by testing participants with upright own-race faces and two categories of faces with which they lacked experience: other-race faces (Experiment 1) and inverted faces (Experiment 2). Participants viewed four images of an unfamiliar identity and then were asked whether a test image of that same identity had been in the study array. Each test image was a matching exemplar (from the array), matching average (the average of the images in the array), non-matching exemplar (a novel image of the same identity), or non-matching average (an average of four different images of the same identity). Adults showed comparable ensemble coding for all three categories (i.e., reported that matching averages had been present more than non-matching averages), providing evidence that this early stage of face learning is not shaped by face-specific experience.     

A bottleneck in face identification: repetition priming from flanker images

There is evidence that face processing is capacity-limited in distractor interference tasks and in tasks requiring overt recognition memory. We examined whether capacity limits for faces can be observed with a more sensitive measure of visual processing, by measuring repetition priming of flanker faces that were presented alongside a face or a nonface target. In Experiment 1, we found identity priming for face flankers, by measuring repetition priming across a change in image, during task-relevant nonface processing, but not during the processing of a concurrently-presented face target. Experiment 2 showed perceptual priming of the flanker faces, across identical images at prime and test, when they were presented alongside a face target. In a third Experiment, all of these effects were replicated by measuring identity priming and perceptual priming within the same task. Overall, these results imply that face processing is capacity limited, such that only a single face can be identified at one time. Merely attending to a target face appears sufficient to trigger these capacity limits, thereby extinguishing identification of a second face in the display, although our results demonstrate that the additional face remains at least subject to superficial image processing.     

Recognizing rotated faces and Greebles: What properties drive the face inversion effect?

The fact that faces are strongly affected by picture-plane inversion has often been cited as evidence for face-specific mechanisms. It is unclear, however, whether this “face inversion effect” is driven by properties shared by faces or whether the effect is specific to faces as a category. To address this issue, we compared the recognition of faces and novel Greebles, which were specifically matched to faces along various stimulus dimensions. In two experiments, participants were required to name individual faces or Greebles following training at either single or multiple orientations. We found that performance systematically decreased with increasing misorientation from either the upright (Experiment 1) or nearest trained orientation (Experiment 2). Importantly, the magnitude of this orientation effect was similar for both faces and Greebles. Taken together, these results suggest that the face inversion effect may be a consequence of the visual homogeneity of the stimulus category, regardless of the category.     

Facilitated detection of angry faces: Initial orienting and processing efficiency

In a visual search task, displays of four schematic faces (angry, sad, happy, or neutral) were presented. Participants decided whether the faces were all the same or whether one was different. A discrepant angry face in a context of three neutral faces was detected faster than other faces. This occurred in the absence of a higher probability of first fixation on the angry face. Moreover, angry faces were more accurately detected even when presented parafoveally. These results are not consistent with the hypothesis that angry faces are detected faster because they are looked at earlier. In contrast, angry faces were looked at less than other faces during the search process and were more accurately detected than other faces when the display duration was reduced to 150 ms. These results support the processing efficiency hypothesis, according to which fewer attentional resources are needed to identify angry faces, which would account for their speeded detection time. In addition, parafoveal analysis of the angry faces may start preattentively, which would account for the fewer and shorter fixations that they need later, when they come under the focus of attention.     

Beyond localisation: a dynamical dual route account of face recognition

After decades of research the notion that faces are special is still at the heart of heated debates. New techniques like brain imaging have advanced some of the arguments but empirical data from brain-damaged patients like paradoxical recognition effects have required more complex explanations aside from localisation of the face area in normal adults. In this paper we focus on configural face processes and discuss configural processes in prosopagnosics in the light of findings obtained in brain-imaging studies. In order to account for data like paradoxical face recognition effects we propose a dual route model of face recognition. The model is based on the distinction between two separate aspects of face recognition, detection and identification, considered as dynamical and interrelated. In this perspective the face detection system appears as the stronger candidate for face-specific processes. The face identification system on the other hand is part of the object recognition system but derives its specificity in part from interaction with the face-specific detection system. The fact that face detection appears intact in some patients provides us with a possible explanation for the interference of configural processes on feature-based identification.     

Females excel at basic face perception

Females are generally better than males at recognizing facial emotions. However, it is not entirely clear whether and in what way females may also excel at non-affective face recognition. Here, we tested males and females on two perceptual face recognition tasks that involved only neutral expressions: detection and identity discrimination. On face detection (Experiment 1), females were significantly more accurate than males in detecting upright faces. This gender difference was reduced during inverted face detection, and not present during tree detection, suggesting that the magnitude of the gender difference for performance co-varies with the extent to which face processing mechanisms are involved. On facial identity discrimination (Experiment 2), females again outperformed males, particularly when face images were masked by visual noise, or the delay between comparison face images was extended from 0.5 to 3 s. These results reveal a female advantage in processing face-specific information and underscore the role of perceptual factors in socially relevant gender differences.     

Can generic expertise explain special processing for faces?

Does face recognition involve face-specific cognitive and neural processes ('domain specificity') or do faces only seem special because people have had more experience of individuating them than they have of individuating members of other homogeneous object categories ('the expertise hypothesis')? Here, we summarize new data that test these hypotheses by assessing whether classic face-selective effects - holistic processing, recognition impairments in prosopagnosia and fusiform face area activation - remain face selective in comparison with objects of expertise. We argue that evidence strongly supports domain specificity rather than the expertise hypothesis. We conclude that the crucial social function of face recognition does not reflect merely a general practice phenomenon and that it might be supported by evolved mechanisms (visual or nonvisual) and/or a sensitive period in infancy.     

The perception of unfamiliar faces and houses by chimpanzees: influence of rotation angle

The inversion effect, or impaired recognition of upside-down faces, is used as evidence supporting the configural processing of faces. Human studies report a linear relationship between face-discrimination performance and orientation, such that recognition is more difficult as faces are rotated away from their typical viewpoint. Previous studies on chimpanzees also support a configural bias for processing faces, particularly faces for which subjects have developed expertise. In the present study, we examined the influence of expertise and rotation angle on the visual perception of faces in chimpanzees. Six subjects were presented with unaltered and blurred conspecific faces and houses in five orientation angles. A computerized paradigm was used to further delineate the nature of configural face processing in this species. The data were consistent with those reported in humans: chimpanzees showed a significant linear impairment when discriminating conspecific faces as they rotated away from their upright orientation. No inversion effect was observed for discriminations involving houses. Thus, chimpanzees, like humans, show a face-specific inversion effect that is linearly affected by angle of orientation, suggesting that their visual processing of faces is strongly influenced by the extraction of configural cues and closely resembles the perceptual strategies of humans.     

Priming visual face-processing mechanisms: electrophysiological evidence

Accumulated evidence from electrophysiology and neuroimaging suggests that face perception involves extrastriate visual mechanisms specialized in processing physiognomic features and building a perceptual representation that is categorically distinct and can be identified by face-recognition units. In the present experiment, we recorded event-related brain potentials in order to explore possible contextual influences on the activity of this perceptual mechanism. Subjects were first exposed to pairs of small shapes, which did not elicit any face-specific brain activity. The same stimuli, however, elicited face-specific brain activity after subjects saw them embedded in schematic faces, which probably primed the subjects to interpret the shapes as schematic eyes. No face-specific activity was observed when objects rather than faces were used to form the context. We conclude that the activity of face-specific extrastriate perceptual mechanisms can be modulated by contextual constraints that determine the significance of the visual input.     

The speed of recognition of personally familiar faces

Despite the generally accepted notion that humans are very good and fast at recognising familiar individuals from their faces, the actual speed with which this fundamental brain function can be achieved remains largely unknown. Here, two groups of participants were required to respond by finger-lift when presented with either a photograph of a personally familiar face (classmate), or an unfamiliar one. This speeded manual go/no-go categorisation task revealed that personally familiar faces could be categorised as early as 380 ms after presentation, about 80 ms faster than unfamiliar faces. When response times were averaged across all 8 stimulus presentations, we found that minimum RTs for both familiar and unfamiliar face decisions were substantially lower (310 ms and 370 ms). Analyses confirmed that stimulus repetition enhanced the speed with which faces were categorised, irrespective of familiarity, and that repetition did not affect the observed benefit in RTS for familiar over unfamiliar faces. These data, representing the elapsed time from stimulus onset to motor output, put constraints on the time course of familiar face recognition in the human brain, which can be tracked more precisely by high temporal resolution electrophysiological measures.     

Carryover of scanning behaviour affects upright face recognition differently to inverted face recognition

Face perception is characterized by a distinct scanpath. While eye movements are considered functional, there has not been direct evidence that disrupting this scanpath affects face recognition performance. The present experiment investigated the influence of an irrelevant letter-search task (with letter strings arranged horizontally, vertically, or randomly) on the subsequent scanning strategies in processing upright and inverted famous faces. Participants’ response time to identify the face and the direction of their eye movements were recorded. The orientation of the letter search influenced saccadic direction when viewing the face images, such that a direct carryover-effect was observed. Following a vertically oriented letter-search task, the recognition of famous faces was slower and less accurate for upright faces, and faster for inverted faces. These results extend the carryover findings of Thompson and Crundall into a novel domain. Crucially they also indicate that upright and inverted faces are better processed by different eye movements, highlighting the importance of scanpaths in face recognition.     

Understanding provoked overt recognition in prosopagnosia

Prosopagnosic patients are unable to recognize overtly the faces of familiar people. However, under specific experimental conditions, overt recognition of faces has been induced in some prosopagnosics. This phenomenon of provoked overt recognition has proved challenging for current theories of face recognition. We first describe clinical demonstrations of provoked overt recognition, before highlighting some critical features that any satisfactory explanation of the phenomenon must accommodate. An account of provoked overt recognition is then put forward, couched within the framework of Burton, Bruce, and Johnston's (1990) IAC model of face recognition. This theory is tested by running computer simulations with the model. Finally, the present explanation of provoked overt recognition is scrutinized to discover whether it has implications for rehabilitation work with prosopagnosic patients.     

Learning influences the encoding of static and dynamic faces and their recognition across different spatial frequencies

Studies on face recognition have shown that observers are faster and more accurate at recognizing faces learned from dynamic sequences than those learned from static snapshots. Here, we investigated whether different learning procedures mediate the advantage for dynamic faces across different spatial frequencies. Observers learned two faces—one dynamic and one static—either in depth (Experiment 1) or using a more superficial learning procedure (Experiment 2). They had to search for the target faces in a subsequent visual search task. We used high-spatial frequency (HSF) and low-spatial frequency (LSF) filtered static faces during visual search to investigate whether the behavioural difference is based on encoding of different visual information for dynamically and statically learned faces. Such encoding differences may mediate the recognition of target faces in different spatial frequencies, as HSF may mediate featural face processing whereas LSF mediates configural processing. Our results show that the nature of the learning procedure alters how observers encode dynamic and static faces, and how they recognize those learned faces across different spatial frequencies. That is, these results point to a flexible usage of spatial frequencies tuned to the recognition task.     

Dual task performance in children: generalized and lateralized effects of memory encoding upon the rate and variability of concurrent finger tapping

Interference between concurrent tasks was used to investigate the brain basis of capacity limitations apparent when children encode information. Seventy-three right-handed children in Grades 1-4 engaged in speeded unilateral finger tapping while encoding a variable number of faces or numbers for subsequent recognition testing. With both face and number encoding, tapping rate decreased as memory load increased. Encoding numbers was more disruptive than encoding faces. Both encoding tasks slowed right-hand tapping more than left-hand tapping, relative to control tapping performance, but had only a bilateral effect on the variability of tapping. Although overall interference was less than that observed with a comparison task (i.e., speaking), the asymmetry of interference was comparable. The results suggest that cerebral lateralization for memory encoding, as well as for speech, is constant across the age range of 6-10 years. Findings regarding developmental change in overall capacity, however, are task specific: interference from speaking but not from memory encoding decreases with increasing age.