Neurocognitive mechanisms of individual differences in face cognition: A replication and extension

Face cognition performance is related to individual differences in cognitive subprocesses, as reflected in the amplitudes and latencies of event-related brain potentials (ERPs; Herzmann, Kunina, Sommer, & Wilhelm, 2010). In order to replicate and extend these findings, 110 participants were tested on a comprehensive task battery measuring face cognition abilities and established cognitive abilities, followed by ERP recordings in a face-learning-and-recognition task. We replicated the links of the ERP components indicating the speed of structural face encoding (N170 latency) and access to structural representations in memory (early repetition effect [ERE]/N250r) with the accuracy and speed of face cognition and with established cognitive abilities. As a novel result, we differentiated between the accuracy of face perception and face memory on the behavioral and electrophysiological levels and report a relationship between basic visual processes (P100 amplitude) and face memory. Moreover, the brain–behavior relationships for the ERE/N250r held true, even though we eliminated pictorial and perceptual structural codes from the priming effects by using backward masking of the primes with novel unfamiliar faces. On a methodological level, we demonstrated the utility of the latent difference score modeling technique to parameterize ERP difference components (e.g., ERE/N250r) on a latent level and link them to face cognition abilities.     

Behavioral and ERP measures of holistic face processing in a composite task

Holistic processing of faces is characterized by encoding of the face as a single stimulus. This study employed a composite face task to examine whether holistic processing varies when attention is restricted to the top as compared to the bottom half of the face, and whether evidence of holistic processing would be observed in event-related potentials. Analyses of behavioral data showed that spatial misalignment of the face halves disrupted holistic processing and enhanced detection of repeated attended halves. Effects of misalignment on the N170, VPP and N250 ERP components resembled effects of face inversion. Attention to the top half of the face was associated with faster P1, N170, VPP, and P2 latencies than attending to the bottom, suggesting automatic processing of the eye region. Further, N170 latency effects suggested that structural encoding of the face is facilitated during holistic processing. N250 latency effects reflected task difficulty. Finally, an overall right hemispheric asymmetry was most pronounced when holistic face processing was greatest. Results are discussed in light of recent proposals that holistic face processing is a subtype of configural face processing.     

Figural aftereffects in the perception of faces

We examined figural aftereffects in images of human faces, for which changes in configuration are highly discriminable. Observers either matched or rated faces before or after viewing distorted images of faces. Prior adaptation strongly biases face perception by causing the original face to appear distorted in a direction opposite to the adapting distortion. Aftereffects transferred across different faces and were similar for upright or inverted faces, but were weaker when the adapting and test faces had different orientations (e.g., adapt inverted and test upright). Thus the aftereffects depend on which images are distorted, and not simply on the type of distortion introduced. We further show that the aftereffects are asymmetric, for adapting to the original face has little effect on the perception of a distorted face. This asymmetry suggests that adaptation may play an important normalizing role in face perception. Our results suggest that in normal viewing, figural aftereffects may strongly influence form perception and could provide a novel method for probing properties of human face perception.     

Event-Related Potentials Related to Normal and Morphed Emotional Faces

S. Bentin and L. Y. Deouell (2000) have suggested that face recognition is achieved through a special-purpose neural mechanism, and its existence can be identified by a specific event-related potential (ERP) correlate, the N170 effect. In the present study, the authors explored the structural significance of N170 by comparing normal vs. morphed stimuli. They used a morphing procedure that allows a fine modification of some perceptual details (first-order relations). The authors also aimed to verify the independence of face identification from other cognitive mechanisms, such as comprehension of emotional facial expressions, by applying an emotion-by-emotion analysis to examine the emotional effect on N170 ERP variation. They analyzed the peak amplitude and latency variables in the temporal window of 120-180 ms. The ERP correlate showed a classic N170 ERP effect, more negative and more posteriorly distributed for morphed faces compared with normal faces. In addition, they found a lateralization effect, with a greater right-side distribution of the N170, but not directly correlated to the morphed or normal conditions. Two cognitive codes, structural and expression, are discussed, and the results are compared with the multilevel model proposed by V. Bruce and A. W. Young (1986, 1998).     

Event-related potentials related to normal and morphed emotional faces

S. Bentin and L. Y. Deouell (2000) have suggested that face recognition is achieved through a special-purpose neural mechanism, and its existence can be identified by a specific event-related potential (ERP) correlate, the N170 effect. In the present study, the authors explored the structural significance of N170 by comparing normal vs. morphed stimuli. They used a morphing procedure that allows a fine modification of some perceptual details (first-order relations). The authors also aimed to verify the independence of face identification from other cognitive mechanisms, such as comprehension of emotional facial expressions, by applying an emotion-by-emotion analysis to examine the emotional effect on N170 ERP variation. They analyzed the peak amplitude and latency variables in the temporal window of 120-180 ms. The ERP correlate showed a classic N170 ERP effect, more negative and more posteriorly distributed for morphed faces compared with normal faces. In addition, they found a lateralization effect, with a greater right-side distribution of the N170, but not directly correlated to the morphed or normal conditions. Two cognitive codes, structural and expression, are discussed, and the results are compared with the multilevel model proposed by V. Bruce and A. W. Young (1986, 1998).     

面部表情加工的ERP成分

面部表情加工的ERP成分主要包括P1 (80~120 ms)、N170 (120~200 ms), 早期后部负电位(Early Posterior Negativity, EPN, 200~300 ms)和晚期正成分(Late Positive Potential, LPP, 300 ms以后)。这些成分代表了表情加工的不同阶段, 具有不同的心理含义。P1成分只对威胁类表情(恐惧, 厌恶和愤怒)敏感, 反映了对威胁面孔的快速探测, 具有自动加工的性质。N170成分与表情结构信息的编码有关, 同样具有自动加工的性质。EPN反映了对情绪信息的选择性注意, 具有情绪普遍性, 情绪场景图片和表情刺激都会对它产生影响, 在特定的条件下具有自动加工的性质。LPP则反映了对情绪信息的高级认知加工, 较易受注意控制的影响。在对上述成分的特性了解的基础上, 将来的研究应该探索以下问题：(1) P1是否受表情威胁程度的影响？(2) N170受到哪些自上而下因素的影响？(3)那些不能影响N170成分, 却能影响EPN成分的表情刺激是否被当成了普通的情绪刺激来看待？(4)表情加工引发的LPP是否能具有自动加工的性质？(5)不同的基本表情类型(如恐惧和厌恶)是否具有特异性的ERP成分？     

Normal perception of Mooney faces in developmental prosopagnosia: Evidence from the N170 component and rapid neural adaptation

Individuals with developmental prosopagnosia (DP) have a severe difficulty recognizing the faces of known individuals in the absence of any history of neurological damage. These recognition problems may be linked to selective deficits in the holistic/configural processing of faces. We used two‐tone Mooney images to study the processing of faces versus non‐face objects in DP when it is based on holistic information (or the facial gestalt) in the absence of obvious local cues about facial features. A rapid adaptation procedure was employed for a group of 16 DPs. Naturalistic photographs of upright faces were preceded by upright or inverted Mooney faces or by Mooney houses. DPs showed face‐sensitive N170 components in response to Mooney faces versus houses, and N170 amplitude reductions for inverted as compared to upright Mooney faces. They also showed the typical pattern of N170 adaptation effects, with reduced N170 components when upright naturalistic test faces were preceded by upright Mooney faces, demonstrating that the perception of Mooney and naturalistic faces recruits shared neural populations. Our findings demonstrate that individuals with DP can utilize global information about face configurations for categorical discriminations between faces and non‐face objects, and suggest that face processing deficits emerge primarily at more fine‐grained higher level stages of face perception.     

返回抑制过程中情绪面孔加工优先：ERPs研究

返回抑制(IOR)是指注意过程中个体对已搜索过的位置进行抑制, 从而在随后该位置上出现目标时发生注意重新定向或反应变慢的过程。本研究使用ERPs技术, 采用线索-靶子范式, 考察了情绪目标辨别任务中IOR的发生过程及二者的神经机制。结果发现, 与无效线索相比, 有效线索下的P1波幅更小, N1波幅更大, 正性、负性面孔N170的波幅比中性面孔大。表明当要求被试做情绪辨别任务时, IOR与对情绪信息的反应之间发生了分离, 表现出情绪加工的优先。这说明IOR和情绪偏向是发生在两种不同神经通路上的适应机制, 也为进一步探究注意与情绪的关系问题提供了来自神经电生理学的证据。     

Effects of repetition and configural changes on the development of face recognition processes

We investigated the effect of repetition on recognition of upright, inverted and contrast-reversed target faces in children from 8 to 15 years when engaged in a learning phase/test phase paradigm with target and distractor faces. Early (P1, N170) and late ERP components were analysed Children across age groups performed equally well, and were better at recognizing upright faces. However, teenagers and adults were equally accurate for all three face types. The neurophysiological responses to upright, inverted and negative faces matured until adulthood and showed different effects at different ages. P1 and N170 components were affected by face type at all ages, suggesting early configural disruption on encoding processes regardless of age. Frontal ERPs reflected the difficulty of processing these stimuli. Distinct repetition effects were seen at frontal, temporal frontal and parietal sites, suggesting differential involvement of these brain regions underlying working memory and recognition processes. Thus, a learning phase was sufficient (a) for 8-year-olds to perform as accurately as 15-year-olds and (b) to eliminate face type effects in teenagers and adults, but not in younger children.     

Deficits in early-stage face perception in excessive internet users

Excessive Internet use is associated with a limited ability to communicate effectively socially, which depends largely on the capacity for perception of the human face. We used a passive visual detection paradigm to compare the early stages of the processing of face-related information in young excessive Internet users (EIUs) and healthy normal subjects by analyzing event-related potentials (ERPs) elicited by faces and by nonface stimuli (tables), each presented in the upright and inverted position. The P1 and N170 components of the spectrum of ERPs elicited at occipital-temporal sites by the viewing of faces were larger and peaked sooner than the same ERP components elicited by tables, and inverted faces significantly enhanced and delayed the N170 component. EIUs had a generally smaller P1 component than did normal subjects, whether elicited by faces or by tables, and the N170 effect, or difference in amplitude of the N170 component for faces versus tables, was significantly smaller in the EIUs than in normal subjects. However, the N170 inversion effect, or difference in amplitude of the N170 component elicited by upright versus inverted faces, was similar in the EIUs and normal subjects. These data indicate that EIUs have deficits in the early stage of face-perception processing but may have intact holistic/configural processing of faces. Whether some deeper processes of face perception, such as face memory and face identification, are affected in EIUs needs to be investigated further with more specific procedures.     

The role of eyes in early face processing: a rapid adaptation study of the inversion effect

The current study employed a rapid adaptation procedure to test the neuronal mechanisms of the face inversion effect (FIE) on the early face-sensitive event-related potential (ERP) component N170. Five categories of face-related stimuli (isolated eyes, isolated mouths, eyeless faces, mouthless faces, and full faces) and houses were presented in upright and inverted orientations as adaptors for inverted full face test stimuli. Strong adaptation was found for all face-related stimuli except mouths. The adaptation effect was larger for inverted than upright stimuli, but only when eyes were present. These results underline an important role of eyes in early face processing. A mechanism of eye-dependent orientation sensitivity during the structural encoding stage of faces is proposed.     

面孔识别特异性本质的ERP研究

本研究记录了16名被试在完成有整体结构变化和局部特征变化的面孔/房屋图片的一致性判断时的脑内时程变化,以期对面孔识别的特异性本质进行探讨。结果显示,N170波幅和潜伏期的刺激类型主效应显著;面孔/房屋所诱发的N170成分在波幅和潜伏期上均不存在加工方式上的显著差异。晚期成分(300～700ms)上也得到类似的结果。这表明:面孔与房屋(非面孔)的加工在早期和晚期成分上都有差异性,体现出面孔的加工在早期视觉刺激的加工和晚期识别的加工上都具有特异性;晚期识别加工的脑电结果不支持"面孔识别是整体的,结构的,而非面孔客体的识别是局部的,基于特征的"加工观点。     

“Wanted!” The effects of reward on face recognition: electrophysiological correlates

The aim of the present study was to uncover the temporal dynamics of face recognition as a function of reward. Event-related potentials (ERPs) were recorded during the encoding and the subsequent old/new memory test in response to faces that could be associated with a monetary reward. The behavioral results showed that faces associated with reward at both encoding and retrieval were recognized better than the unrewarded ones. ERP responses highlighted that successful encoding predictive of subsequent memory was greater for faces associated with reward than for faces without reward-driven motivational learning. At retrieval, an early positive-going component was elicited for potentially rewarded faces on frontal regions, while the occipito-temporal N170 component showed priming effects as a function of reward. Later on, larger centro-parietal ERP components, related to recognition memory, were found selectively for reward-associated faces. Remarkably, electrophysiological responses varied in a graded manner, with the largest amplitude yielded by faces with double reward, followed by faces associated with reward only at encoding. Taken together, the present data show that the processing of outcome expectations affects face structural encoding and increases memory efficiency, yielding a robust and sustained modulation over frontal and temporal areas where reward and memory mechanisms operate in conjunction.     

正立和倒立的威胁性身体表情的识别

为探索身体表情的加工时程以及加工方式是否为构形加工,采用ERP技术考察对正立和倒立的威胁性身体表情（恐惧和愤怒）的识别。行为结果发现倒置效应存在。ERP结果发现：早期阶段已有对威胁性情绪（P1）和倒置效应（N1）的加工;中期阶段主要存在对倒置效应的加工（N170）;晚期阶段,威胁性情绪在正立条件上得到更多的加工（P3和LPP）。结果表明,威胁性身体表情加工有独特的时间进程,加工方式以构形加工为主。     

Event-related brain potential correlates of the other-race effect: A review

People are better at remembering own-race relative to other-race faces. Here, we review event-related brain potential (ERP) correlates of this so-called other-‘race’ effect (ORE) by discussing three critical aspects that characterize the neural signature of this phenomenon. First, difficulties with other-race faces initially emerge during perceptual processing, which is indexed by an increased N170. Second, as evidenced by ‘difference due to subsequent memory’ effects, more effortful processing of other-race faces is needed for successful encoding into long-term memory. Third, ERP old/new effects reveal that a stronger engagement of processing resources is also required for successful retrieval of other-race faces from memory. The ERP evidence available to date thus suggests widespread ethnicity-related modulations during both perceptual and mnemonic processing stages. We further discuss how findings from the ORE compared with potentially related memory biases (e.g. other-gender or other-age effects) and how ERP findings inform the ongoing debate regarding the mechanisms underlying the ORE. Finally, we outline open questions and potential future directions with an emphasis on using multiple, ecologically more valid ‘ambient’ images for each face to assess the ORE in paradigms that capture identity rather than image recognition.     

Recognition memory for emotional faces in amnestic mild cognitive impairment: An event-related potential study

ABSTRACT

This study examined the temporal course of emotional face recognition in amnestic mild cognitive impairment (aMCI). Patients and healthy controls (HC) performed a face recognition task, giving old/new responses to previously studied and novel faces displaying a negative or neutral expression. In aMCI patients, recognition accuracy was preserved for negative faces. Event-related potentials (ERPs) revealed disease-related changes in early perceptual components but not in ERP indices of explicit recognition. Specifically, aMCI patients showed impaired recognition effects for negative faces on the amplitudes of N170 and P2, suggesting deficient memory-related processing of negative faces at the stage of structural encoding and during an early recognition stage at which faces are individuated, respectively. Moreover, while a right-lateralized emotion effect specifically observed for correctly recognized faces on the amplitude of N170 was absent in aMCI, a similar emotion effect for successfully recognized faces on P2 was preserved in the patients, albeit with a different distribution. This suggests that in aMCI facilitated processing of successfully recognized emotional faces starts later in the processing sequence. Nonetheless, an early frontal old/new effect confined to negative faces and a parietal old/new effect unaffected by facial emotion were observed in both groups. This indicates that familiarity and conceptual priming processes may specifically contribute to recognition of negative faces in older adults and that aMCI patients can recruit the same retrieval mechanisms as controls, despite disease-related changes on early perceptual ERP components.     

Featural and configural face processing in adults and infants: a behavioral and electrophysiological investigation

We sought to elucidate the behavioral and electrophysiological correlates of face processing, in adults and infants, by manipulating either the featural or configural information within the face. Two different experiments are reported. In these experiments, event-related potentials (ERPs) were recorded from the scalp while adult, 8-month-old, and 4-month-old participants completed configural-change and featural-change face tasks. The infants also completed a behavioral visual paired-comparison task with featural and configural face changes. ERP results reveal hemispheric differences in processing featural but not configural changes for the N170 in adults. Furthermore, featural and configural changes are processed differently within the right and left hemispheres. The right hemisphere N170 is significantly greater for configural compared to featural changes. The left hemisphere N170, however, exhibits the opposite effect. Infant data suggest that similar to adults, 8-month-old, but not 4-month-old participants, exhibit similar hemispheric differences between featural and configural changes for the P400 component. Behavioral results suggest increased sensitivity to both featural and configural face changes in 8-month-olds compared to 4-month-olds.     

The neurophysiological correlates of face processing in adults and children with Asperger's syndrome

Past research has found evidence for face and emotional expression processing differences between individuals with Asperger's syndrome (AS) and neurotypical (NT) controls at both the neurological and behavioural levels. The aim of the present study was to examine the neurophysiological basis of emotional expression processing in children and adults with AS relative to age- and gender-matched NT controls. High-density event-related potentials were recorded during explicit processing of happy, sad, angry, scared, and neutral faces. Adults with AS were found to exhibit delayed P1 and N170 latencies and smaller N170 amplitudes in comparison to control subjects for all expressions. This may reflect impaired holistic and configural processing of faces in AS adults. However, these differences were not observed between AS and control children. This may result from incomplete development of the neuronal generators of these ERP components and/or early intervention.     

The speed of individual face categorization

How fast does the human visual system discriminate individual faces? To address this question, we used a continuous-stimulation paradigm in which event-related potentials (ERPs) to a face stimulus are recorded with respect to another face stimulus, rather than to a preceding blank-screen baseline epoch. Following the shift between two face stimuli, posterior sites showed an early negative ERP deflection that started at 130 ms and peaked at 160 ms, the latency of the N170, an ERP component associated with discriminating faces from objects. The ERP we recorded was larger in amplitude when the preceding stimulus was perceived as a different individual face rather than the same individual face, although face pairs were of equal physical distance in the two conditions. These findings provide direct evidence that individual face discrimination in humans can take place as early as 130 ms following stimulus onset, during the same time window as face detection.     

Automatic change detection in vision: Adaptation,memory mismatch,or both? II: Oddball and adaptation effects on event-related potentials

In this study we compared the event-related potentials (ERPs) obtained in two different paradigms: a passive visual oddball paradigm and an adaptation paradigm. The aim of the study was to investigate the relation between the effects of activity decrease following an adaptor (stimulus-specific adaptation) and the effects of an infrequent stimulus within sequences of frequent ones. In Experiment 1, participants were presented with different line textures. The frequent (standard) and rare (deviant) texture elements differed in their orientation. In Experiment 2, windmill pattern stimuli were presented in which the number of vanes differentiated the deviant and standard stimuli. In Experiment 1 the ERP differences elicited between the oddball deviant and the standard were similar to the differences between the ERPs to the nonadapted and adapted stimuli in the adaptation paradigm. In both paradigms the differences appeared as a posterior negativity with the latency of 120–140 ms. This finding demonstrates that the representation of a sequential rule (successive presentation of the standard) and the violation of this rule are not necessary for deviancy effects to emerge. In Experiment 2 (windmill pattern), in the oddball paradigm the difference potentials appeared as a long-lasting negativity. In the adaptation condition, the later part of this negativity (after 200 ms) was absent. We identified the later part of the oddball difference potential as the genuine visual mismatch negativity—that is, an ERP correlate of sequence violations. The latencies of the difference potentials (deviant minus standard) and the endogenous components (P1 and N1) diverged; therefore, the adaptation of these particular ERP components cannot explain the deviancy effect. Accordingly, the sources contributing to the standard-versus-deviant modulations differed from those related to visual adaptation; that is, they generated distinct ERP components.