Neural evidence for the contribution of holistic processing but not attention allocation to the other-race effect on face memory

Multiple mechanisms have been suggested to contribute to the other-race effect on face memory, the phenomenon of better memory performance for own-race than other-race faces. Here, two of these mechanisms, increased attention allocation and greater holistic processing during memory encoding for own-race than other-race faces, were tested in two separate experiments. In these experiments event-related potentials were measured during study (the difference due to memory, Dm) and test phase (old/new effects) to examine brain activation related to memory encoding and retrieval, allowing for selective investigations of these memory sub-processes. In Experiment 1, participants studied own-race (Caucasian) and other-race (Chinese) faces under focused or divided attention. In Experiment 2, participants studied own-race (Caucasian) and other-race (African American) faces presented upright or upside down (i.e., inverted). Both experiments showed decreases in memory performance when attention allocation or holistic processing was reduced, but these effects were similar for own-race and other-race faces. Manipulations of holistic processing, but not attention allocation, influenced the neural other-race effects during memory encoding. Inverted own-race faces showed similar neural patterns as upright other-race faces, indicating that when holistic processing of own-race faces was reduced, these faces were encoded similarly as upright other-race faces. No influences of the experimental manipulations on other-race effects during memory retrieval were found. The present study provides the first neural evidence that increased holistic processing during memory encoding contributes to the other-race effect on face memory.     

The influence of divided attention on holistic face perception.

There is evidence that upright, but not inverted, faces are encoded holistically. The holistic coding of faces was examined in four experiments by manipulating the attention allocated to target faces. In Experiment 1, participants in a divided attention condition were asked to match two upright flanker faces while encoding a centrally presented upright target face. Although holistic coding was evident in the full attention conditions, dividing attention disrupted holistic coding of target faces. In Experiment 2, we found that while matching upright flanker faces disrupted holistic coding, matching inverted flanker faces did not. Experiment 3 demonstrated that the differential effects of flanker orientation were not due to participants taking longer to match upright, than inverted, flanker faces. In Experiment 4, we found that matching fractured faces had an intermediate effect to that of matching upright and inverted flankers, on the holistic coding of the target faces. The findings emphasize the differences in processing of upright, fractured and inverted faces and suggest that there are limitations in the number of faces that can be holistically coded in a brief time.     

Effects of spatial frequency content on classification of face gender and expression

The role of different spatial frequency bands on face gender and expression categorization was studied in three experiments. Accuracy and reaction time were measured for unfiltered, low-pass (cut-off frequency of 1 cycle/deg) and high-pass (cutoff frequency of 3 cycles/deg) filtered faces. Filtered and unfiltered faces were equated in root-mean-squared contrast. For low-pass filtered faces reaction times were higher than unfiltered and high-pass filtered faces in both categorization tasks. In the expression task, these results were obtained with expressive faces presented in isolation (Experiment 1) and also with neutral-expressive dynamic sequences where each expressive face was preceded by a briefly presented neutral version of the same face (Experiment 2). For high-pass filtered faces different effects were observed on gender and expression categorization. While both speed and accuracy of gender categorization were reduced comparing to unfiltered faces, the efficiency of expression classification remained similar. Finally, we found no differences between expressive and non expressive faces in the effects of spatial frequency filtering on gender categorization (Experiment 3). These results show a common role of information from the high spatial frequency band in the categorization of face gender and expression.     

Why 8-year-olds cannot tell the difference between Steve Martin and Paul Newman: factors contributing to the slow development of sensitivity to the spacing of facial features

Children are nearly as sensitive as adults to some cues to facial identity (e.g., differences in the shape of internal features and the external contour), but children are much less sensitive to small differences in the spacing of facial features. To identify factors that contribute to this pattern, we compared 8-year-olds' sensitivity to spacing cues with that of adults under a variety of conditions. In the first two experiments, participants made same/different judgments about faces differing only in the spacing of facial features, with the variations being kept within natural limits. To measure the effect of attention, we reduced the salience of featural information by blurring faces and occluding features (Experiment 1). To measure the role of encoding speed and memory limitations, we presented pairs of faces simultaneously and for an unlimited time (Experiment 2). To determine whether participants' sensitivity would increase when spacing distortions were so extreme as to make the faces grotesque, we manipulated the spacing of features beyond normal limits and asked participants to rate each face on a "bizarreness" scale (Experiment 3). The results from the three experiments indicate that low salience, poor encoding efficiency, and limited memory can partially account for 8-year-olds' poor performance on face processing tasks that require sensitivity to the spacing of features, a kind of configural processing that underlies adults' expertise. However, even when the task is modified to compensate for these problems, children remain less sensitive than adults to the spacing of features.     

The influence of ingroup/outgroup categorization on same- and other-race face processing: The moderating role of inter- versus intra-racial context

We investigated the impact of ingroup/outgroup categorization on the encoding of same-race and other-race faces presented in inter-racial and intra-racial contexts (Experiments 1 and 2, respectively). White participants performed a same/different matching task on pairs of upright and inverted faces that were either same-race (White) or other-race (Black), and labeled as being from the same university or a different university. In Experiment 1, the same- and other-race faces were intermixed. For other-race faces, participants demonstrated greater configural processing following same- than other-university labeling. Same-race faces showed strong configural coding irrespective of the university labeling. In Experiment 2, faces were blocked by race. Participants demonstrated greater configural processing of same- than other-university faces, but now for both same- and other-race faces. These results demonstrate that other-race face processing is sensitive to non-racial ingroup/outgroup status regardless of racial context, but that the sensitivity of same-race face processing to the same cues depends on the racial context in which targets are encountered.     

Learning influences the encoding of static and dynamic faces and their recognition across different spatial frequencies

Studies on face recognition have shown that observers are faster and more accurate at recognizing faces learned from dynamic sequences than those learned from static snapshots. Here, we investigated whether different learning procedures mediate the advantage for dynamic faces across different spatial frequencies. Observers learned two faces—one dynamic and one static—either in depth (Experiment 1) or using a more superficial learning procedure (Experiment 2). They had to search for the target faces in a subsequent visual search task. We used high-spatial frequency (HSF) and low-spatial frequency (LSF) filtered static faces during visual search to investigate whether the behavioural difference is based on encoding of different visual information for dynamically and statically learned faces. Such encoding differences may mediate the recognition of target faces in different spatial frequencies, as HSF may mediate featural face processing whereas LSF mediates configural processing. Our results show that the nature of the learning procedure alters how observers encode dynamic and static faces, and how they recognize those learned faces across different spatial frequencies. That is, these results point to a flexible usage of spatial frequencies tuned to the recognition task.     

A tale of two negatives: differential memory modulation by threat-related facial expressions

Facial expressions serve as cues that encourage viewers to learn about their immediate environment. In studies assessing the influence of emotional cues on behavior, fearful and angry faces are often combined into one category, such as "threat-related," because they share similar emotional valence and arousal properties. However, these expressions convey different information to the viewer. Fearful faces indicate the increased probability of a threat, whereas angry expressions embody a certain and direct threat. This conceptualization predicts that a fearful face should facilitate processing of the environment to gather information to disambiguate the threat. Here, we tested whether fearful faces facilitated processing of neutral information presented in close temporal proximity to the faces. In Experiment 1, we demonstrated that, compared with neutral faces, fearful faces enhanced memory for neutral words presented in the experimental context, whereas angry faces did not. In Experiment 2, we directly compared the effects of fearful and angry faces on subsequent memory for emotional faces versus neutral words. We replicated the findings of Experiment 1 and extended them by showing that participants remembered more faces from the angry face condition relative to the fear condition, consistent with the notion that anger differs from fear in that it directs attention toward the angry individual. Because these effects cannot be attributed to differences in arousal or valence processing, we suggest they are best understood in terms of differences in the predictive information conveyed by fearful and angry facial expressions.     

Affective theory of mind inferences contextually influence the recognition of emotional facial expressions

The recognition of emotional facial expressions is often subject to contextual influence, particularly when the face and the context convey similar emotions. We investigated whether spontaneous, incidental affective theory of mind inferences made while reading vignettes describing social situations would produce context effects on the identification of same-valenced emotions (Experiment 1) as well as differently-valenced emotions (Experiment 2) conveyed by subsequently presented faces. Crucially, we found an effect of context on reaction times in both experiments while, in line with previous work, we found evidence for a context effect on accuracy only in Experiment 1. This demonstrates that affective theory of mind inferences made at the pragmatic level of a text can automatically, contextually influence the perceptual processing of emotional facial expressions in a separate task even when those emotions are of a distinctive valence. Thus, our novel findings suggest that language acts as a contextual influence to the recognition of emotional facial expressions for both same and different valences.     

When inverted faces are recognized: The role of configural information in face recognition

The identification of upright faces seems to involve a special sensitivity to "configural" information, the processing of which is less effective when the face is inverted. However the precise meaning of "configural" remains unclear. Five experiments are presented, which showed that the disruption of the processing of relational, rather than holistic, information largely determines the occurrence as well as the size of the face-inversion effect. In Experiment 1, faces could be identified either by unique combinations of local information (e.g. a specific eye colour plus hair colour) or by unique relational information (e.g. nose-mouth distance). The former showed no inversion effect, whereas the latter did. A combination of local and relational information (Experiment 2) again produced an inversion effect, although this effect was smaller than that found when only relational information was used. The results were replicated in Experiment 3 when differences in the brightness of local features were used instead of specific colour combinations. Experiment 4 used different retrieval conditions to distinguish relational from holistic processing, and demonstrated again that spatial relations between single features appeared to provide crucial information for face recognition. In Experiment 5, the importance of relational information was confirmed using faces that also varied in the shapes of local features.     

自闭症谱系障碍儿童对面孔加工的同龄偏向效应

采用视觉追踪技术,探讨自闭症谱系障碍(autism spectrum disorders, ASD)儿童面孔加工的同龄偏向效应。实验1选取19名ASD儿童和23名生理年龄匹配的普通儿童(typically developing, TD)为被试,通过自由观看同龄和异龄中性面孔,探讨ASD儿童是否存在面孔加工的同龄偏向效应;实验2选取22名ASD儿童和生理年龄匹配的25名TD儿童,通过自由观看快乐、愤怒和恐惧面孔,探讨情绪对ASD儿童面孔加工同龄偏向的影响。结果发现,(1)ASD儿童对同龄中性面孔的注视时间显著大于异龄中性面孔;(2)ASD儿童在愤怒和恐惧情绪下对同龄面孔的注视时间显著大于异龄面孔,而在快乐情绪下同龄和异龄的注视时间则无显著差异。这表明ASD儿童对面孔的注视加工存在同龄偏向效应,且受情绪的影响。     

Holistic face encoding is modulated by perceived face race: Evidence from perceptual adaptation

Human expertise at processing faces relies on how facial features are encoded: as a whole template rather than as a sum of independent features. This holistic encoding is less prominent for other-race faces, possibly accounting for the difficulty one encounters in recognizing these faces (the ‘other-race effect’). Here, we tested the hypothesis that the magnitude of holistic face encoding can be modulated by racial categorization of the face. Caucasian participants performed a face-composite task with ‘racially-ambiguous’ face-stimuli (cross-race morphed faces, equally categorized as Asian or Caucasian faces in an independent task). The perceived race of the ambiguous faces was manipulated using adaptation. Experiment 1 showed that identical morphed face-stimuli were processed more holistically when perceived as ‘same-race’ than as ‘other-race’, i.e., following adaptation to ‘other-race’ versus ‘same-race’, respectively. Experiment 2 ascertained that the determining factor in the observed holistic processing modulation was the race of the racially-ambiguous face as perceived, rather than expected, by the participants, which supports the idea that the holistic processing of the face-stimuli was modulated by their race-categorization at the perceptual level.     

The role of the head in configural body processing: Behavioural and electrophysiological evidence from the inversion and scrambling effect

The present study aimed to further explore the role of the head for configural body processing by comparing complete bodies with headless bodies and faceless heads (Experiment 1). A second aim was to further explore the role of the eye region in configural face processing (Experiment 2). Due to that, we conducted a second experiment with complete faces, eyeless faces, and eyes. In addition, we used two effects to manipulate configural processing: the effect of stimulus inversion and scrambling. The current data clearly show an inversion effect for intact bodies presented with head and faces including the eye region. Thus, the head and the eye region seem to be central for configural processes that are manipulated by the effect of stimulus inversion. Furthermore, the behavioural and electrophysiological body inversion effect depends on the intact configuration of bodies and is associated with the N170 as the face inversion effect depends on the intact face configuration. Hence, configural body processing depends not only on the presence of the head but rather on a complete representation of human bodies that includes the body and the head. Furthermore, configural face processing relies on intact and complete face representations that include faces and eyes.     

Order of feature recognition in familiar and unfamiliar faces

Three experiments measured order of processing for single faces presented to the left or right visual field (VF) using a same-different matching task. In contrast to earlier studies, the stimuli in the present experiments were carefully matched for overall similarity prior to the actual experiments. Experiments 1 and 2 showed that a significant top-to-bottom order of processing occurred for line drawings of unfamiliar faces but not for line drawings of familiar faces. Experiment 3 found evidence supporting top-to-bottom processing for unfamiliar photographic face stimuli. The photographic stimuli in Experiment 3 were matched more quickly when presented in the left VF (right hemisphere); however, this VF asymmetry was not related to previously reported differences in order of processing. It is suggested that under some conditions faces presented to the right hemisphere may be processed more like familiar faces than faces presented to the left hemisphere; however, this difference is not critical for the left VF (right hemisphere) superiority often found in face recognition tasks.     

Recognizing disguised faces

Across three experiments, we evaluated the effects of “disguises” on observers’ face identification performance using naturalistic images in which individuals posed with a variety of wigs and eyeglasses. Experiment 1 tested recognition memory performance with and without disguises and showed that any changes in these facial attributes hindered performance, replicating previous findings. More interestingly, Experiment 1 revealed that a change in hairstyle or the removal of eyeglasses had more impact on performance than did the addition of eyeglasses. In Experiment 2, disguised and undisguised faces were presented upright or inverted to examine whether the performance decrements seen in Experiment 1 were attributable to disruption of processing strategies for faces. Despite showing an overall effect of disguise on performance, there was no interaction between inversion and disguise. This suggests that disguises are not directly affecting processing strategies, but instead disguises are likely encoded as part of the overall representation. Similarly, in Experiment 3, the composite face paradigm was used to examine whether the impact of disguises is attributable to disruption of holistic processing for faces. Again, we found an overall effect of disguise on performance, but here we also observed that the presence of disguises interacted with participants’ tendency to form holistic face representations.     

Eye-movement assessment of the time course in facial expression recognition: Neurophysiological implications

Happy, surprised, disgusted, angry, sad, fearful, and neutral faces were presented extrafoveally, with fixations on faces allowed or not. The faces were preceded by a cue word that designated the face to be saccaded in a two-alternative forced-choice discrimination task (2AFC; Experiments 1 and 2), or were followed by a probe word for recognition (Experiment 3). Eye tracking was used to decompose the recognition process into stages. Relative to the other expressions, happy faces (1) were identified faster (as early as 160 msec from stimulus onset) in extrafoveal vision, as revealed by shorter saccade latencies in the 2AFC task; (2) required less encoding effort, as indexed by shorter first fixations and dwell times; and (3) required less decision-making effort, as indicated by fewer refixations on the face after the recognition probe was presented. This reveals a happy-face identification advantage both prior to and during overt attentional processing. The results are discussed in relation to prior neurophysiological findings on latencies in facial expression recognition.     

A bottleneck in face identification: repetition priming from flanker images

There is evidence that face processing is capacity-limited in distractor interference tasks and in tasks requiring overt recognition memory. We examined whether capacity limits for faces can be observed with a more sensitive measure of visual processing, by measuring repetition priming of flanker faces that were presented alongside a face or a nonface target. In Experiment 1, we found identity priming for face flankers, by measuring repetition priming across a change in image, during task-relevant nonface processing, but not during the processing of a concurrently-presented face target. Experiment 2 showed perceptual priming of the flanker faces, across identical images at prime and test, when they were presented alongside a face target. In a third Experiment, all of these effects were replicated by measuring identity priming and perceptual priming within the same task. Overall, these results imply that face processing is capacity limited, such that only a single face can be identified at one time. Merely attending to a target face appears sufficient to trigger these capacity limits, thereby extinguishing identification of a second face in the display, although our results demonstrate that the additional face remains at least subject to superficial image processing.     

Face value: testing the utility of contextual face cues for face recognition

The presence of multiple faces during a crime may provide a naturally-occurring contextual cue to support eyewitness recognition for those faces later. Across two experiments, we sought to investigate mechanisms underlying previously-reported cued recognition effects, and to determine whether such effects extended to encoding conditions involving more than two faces. Participants studied sets of individual faces, pairs of faces, or groups of four faces. At test, participants in the single-face condition were tested only on those individual faces without cues. Participants in the two and four-face conditions were tested using no cues, correct cues (a face previously studied with the target test face), or incorrect cues (a never-before-seen face). In Experiment 2, associative encoding was promoted by a rating task. Neither hit rates nor false-alarm rates were significantly affected by cue type or face encoding condition in Experiment 1, but cuing of any kind (correct or incorrect) in Experiment 2 appeared to provide a protective buffer to reduce false-alarm rates through a less liberal response bias. Results provide some evidence that cued recognition techniques could be useful to reduce false recognition, but only when associative encoding is strong.     

An encoding advantage for own-race versus other-race faces

Studies have shown that individuals are better able to recognise the faces of people from their own race than the faces of people from other races. Although the so-called own-race effect has been generally regarded as an advantage in recognition memory, differences in the processing of the own-race versus other-race faces might also be found at the earlier stages of perceptual encoding. In this study, the perceptual basis of the own-race effect was investigated by generating a continuum of images by morphing an East Asian parent face with a Caucasian parent face. In a same/different discrimination task, East Asian and Caucasian participants judged whether the morph faces were physically identical to, or different from, their parent faces. The results revealed a significant race-of-participant by race-of-face interaction such that East Asian participants were better able to discriminate East Asian faces, whereas Caucasian participants were better able to discriminate Caucasian faces. These results indicate that an own-race advantage occurs at the encoding stage of face processing.     

Faces are "spatial"--holistic face perception is supported by low spatial frequencies

Faces are perceived holistically, a phenomenon best illustrated when the processing of a face feature is affected by the other features. Here, the authors tested the hypothesis that the holistic perception of a face mainly relies on its low spatial frequencies. Holistic face perception was tested in two classical paradigms: the whole-part advantage (Experiment 1) and the composite face effect (Experiments 2-4). Holistic effects were equally large or larger for low-pass filtered faces as compared to full-spectrum faces and significantly larger than for high-pass filtered faces. The disproportionate composite effect found for low-pass filtered faces was not observed when holistic perception was disrupted by inversion (Experiment 3). Experiment 4 showed that the composite face effect was enhanced only for low spatial frequencies, but not for intermediate spatial frequencies known be critical for face recognition. These findings indicate that holistic face perception is largely supported by low spatial frequencies. They also suggest that holistic processing precedes the analysis of local features during face perception.     

The effect of inversion on the encoding of normal and “thatcherized” faces

In the “Thatcher illusion” a face, in which the eyes and mouth are inverted relative to the rest of the face, looks grotesque when shown upright but not when inverted. In four experiments we investigated the contribution of local and global processing to this illusion in normal observers. We examined inversion effects (i.e., better performance for upright than for inverted faces) in a task requiring discrimination of whether faces were or were not “thatcherized”. Observers made same/different judgements to isolated face parts (Experiments 1-2) and to whole faces (Experiments 3-4). Face pairs had the same or different identity, allowing for different process- ing strategies using feature-based or configural information, respectively. In Experiment 1, feature-based matching of same-person face parts yielded only a small inversion effect for normal face parts. However, when feature-based matching was prevented by using the face parts of different people on all trials (Experiment 2) an inversion effect occurred for normal but not for thatcherized parts. In Experiments 3 and 4, inversion effects occurred with normal but not with thatcherized whole faces, on both same- and different-person matching tasks. This suggests that a common configural strategy was used with whole (normal) faces. Face context facilitated attention to misoriented parts in same-person but not in different-person matching. The results indicate that (1) face inversion disrupts local configural processing, but not the processing of image features, and (2) thatcherization disrupts local configural processing in upright faces.