情绪对项目记忆和来源记忆的影响

最近几十年以来, 情绪对记忆的影响越来越受到认知心理学家的关注。本文总结了我在中科院心理研究所师从傅小兰研究员攻读博士学位期间所开展的主要研究工作。我的研究以中文词语为学习材料, 分别考察了在编码过程中和编码结束后诱发情绪对项目记忆和来源记忆的影响。当情绪在编码阶段被诱发, 主要的研究发现如下：1)负性情绪增强自由回忆, 但正性情绪只呈现出增强自由回忆的趋势。2)负性情绪降低总体再认记忆, 但正性情绪对总体再认记忆没有影响。此外, 正性和负性情绪均不影响“记得”反应的正确率; 然而, 负性情绪降低了“知道”反应的正确率, 正性情绪对“知道”反应的正确率没有影响。3)正性和负性情绪均对来源记忆(即对词语字体颜色的记忆)没有影响。当情绪在编码结束后被诱发, 主要的研究发现如下：1)对女性被试而言, 负性情绪增强了项目记忆的巩固, 然而, 对男性被试而言, 正性和负性情绪均不影响项目记忆的巩固。2)无论对男性还是女性被试, 正性和负性情绪对来源记忆的巩固均没有影响。本研究的上述发现对建立情绪和记忆的关系具有理论意义, 对如何在教学情境中如何利用情绪诱发促进学生的记忆巩固也具有现实指导意义。     

情绪记忆编码增强效应的认知神经机制

相对于中性刺激,情绪信息在记忆的准确性和细节方面都会得到显著的增强,这种增强效应在编码阶段受到情绪效价和唤醒的影响。涉及到的脑区主要包括:双侧杏仁核、海马前部、海马回和前额叶皮层。杏仁核—内侧颞叶(MTL)系统支持唤醒信息的编码增强效应,反映的是情绪对记忆自动化的影响,属于自动加工,主要受情绪唤醒的调节;前额叶网络支持消极无唤醒信息的编码增强效应,对情绪信息的加工属于控制加工,主要受情绪效价的调节。     

奖赏预期对面孔情绪加工的影响：一项事件相关电位研究

采用事件相关电位(ERPs)技术考察了奖赏预期对人类面孔情绪识别的影响。实验采用线索-目标范式, 分别记录了被试在奖赏预期条件下以及无奖赏预期条件下对正性、中性和负性面孔进行情绪辨别任务的ERP数据。行为结果显示, 被试在奖赏预期条件下的反应时快于无奖赏预期条件下的反应时, 对情绪面孔的反应时快于对中性面孔的反应时。ERPs数据显示, 奖赏线索比无奖赏线索诱发了更正的P1、P2和P300成分。目标刺激诱发的P1、N170波幅以及N300均受到奖赏预期的调节, 在奖赏预期条件下目标诱发了更正的ERPs。P1、N170、VPP等成分没有受到面孔情绪的影响, 而额中央位置的N300波幅显示情绪(正性与负性)面孔与中性面孔加工的差异。重要的是, N300波幅出现奖赏预期与情绪的交互作用, 正、负情绪加工效应以及负性偏向效应受奖赏预期的差异性影响。正性情绪加工效应不受奖赏预期的影响, 而负性情绪加工效应和负性偏向效应在奖赏预期条件下显著大于无奖赏预期条件下。这些结果说明, 奖赏预期能够调节对面孔情绪的加工, 且不同加工进程中奖赏对情绪加工的调节作用不同。动机性信息调节注意资源的分配, 促进了个体在加工面孔情绪时的负性偏向。     

厌恶和恐惧情绪对跨期选择的不同影响：基于ERP的研究

本研究运用事件相关电位技术(ERPs)考察厌恶和恐惧情绪对跨期选择的影响。其中,厌恶和恐惧情绪采用情绪面孔图片进行启动,分析跨期选择任务中评估阶段所诱发的ERP成分。行为结果发现,与中性面孔相比,厌恶面孔启动使个体倾向于选择立即奖赏。ERP结果发现,在选项评估阶段,厌恶面孔比中性和恐惧面孔启动诱发更大的P2、P3和LPP波幅。这说明,厌恶情绪促使个体投入更多的注意和动机资源对跨期选项进行评估,进而使个体倾向即时满足。     

厌恶和恐惧情绪对跨期选择的不同影响：基于ERP的研究

本研究运用事件相关电位技术(ERPs)考察厌恶和恐惧情绪对跨期选择的影响。其中,厌恶和恐惧情绪采用情绪面孔图片进行启动,分析跨期选择任务中评估阶段所诱发的ERP成分。行为结果发现,与中性面孔相比,厌恶面孔启动使个体倾向于选择立即奖赏。ERP结果发现,在选项评估阶段,厌恶面孔比中性和恐惧面孔启动诱发更大的P2、P3和LPP波幅。这说明,厌恶情绪促使个体投入更多的注意和动机资源对跨期选项进行评估,进而使个体倾向即时满足。     

双加工再认提取中的情绪记忆增强效应

根据双加工理论, 再认提取可以划分为两种不同的加工：熟悉性与回想。以往的研究普遍认为情绪对再认提取具有增强效应, 但是情绪对再认记忆中两种不同加工方式(熟悉性与回想)的增强效应的神经机制尚存争议。本研究以ERP作为测量手段, 采用修正的“记得/知道”范式对情绪图片进行再认测验, 旨在探究在学习?测验间隔较长的条件下, 情绪信息如何对熟悉性与回想产生增强效应。在行为结果中, 对于知道判断, 情绪图片的记忆表现显著高于中性图片, 情绪效价间没有差异; 对于记得判断, 负性情绪图片的记忆表现要显著高于正性与中性图片。在ERP数据上, 对于知道判断, 情绪图片的FN400新旧效应有增强作用。对于记得判断, 负性图片的LPC的新旧效应波幅显著高于中性与负性图片; 而正性图片的LPC新旧效应增强作用不显著。以上证据表明：学习?测验间隔较长的情况下, 熟悉性再认提取中, 情绪记忆增强效应主要体现在情绪唤醒对记忆强度的提高, 而不仅仅体现在情绪效价对熟悉判断反应倾向的影响。在回想的再认提取中, 情绪效价的调节占据主导地位, 负性情绪图片有显著的情绪记忆增强效应; 正性情绪图片则不具有增强效应。     

情绪一致性编码与情绪一致性提取的非对称性研究

采用情绪一致性记忆范式,探索情绪一致性编码与提取之间的关系。两个实验先后选取180名普通大学生和180名普通中学生做被试,情绪电影片段诱发被试在编码或提取阶段高兴或悲伤的情绪状态,被试在学习情绪词后完成分心任务再进行自由回忆。实验分别控制被试在编码或提取时的情绪状态和被试在学习情绪词时的加工策略。结果发现:长时记忆存在情绪一致性编码和情绪一致性提取效应,但是不同加工策略下情绪一致性提取存在差异,情绪渗透模型无法解释该差异。结果表明,从行为研究层面发现情绪一致性编码与提取存在非对称性。     

阈下情绪面孔的注视线索提示效应

采用线索-靶子范式，利用2个预实验和1个正式实验，考察阈下不同情绪面孔的注视线索提示效应。要求被试在具有表情与注视线索的面孔呈现完毕后，快速而准确地对目标的位置进行判断。记录被试反应时间。结果显示，当被试未有意识的觉察到注视线索与面孔表情时，注视线索提示效应存在，并受到表情的调节。表现为：在注视线索有效并伴有恐惧表情时，被试对于目标的判断更加迅速；当比较不同表情下线索无效与线索有效条件下的反应时差异时发现，恐惧表情面孔出现时，线索无效与线索有效条件之间反应时的差异最大。结果表明，阈下情绪刺激能够激发个体更原始的生物性反应；在早期注意阶段，个体对于恐惧信息更加敏感，注意存在负向情绪偏差。     

来源记忆中背景的情绪效价与唤醒对提取过程的影响

以往研究表明情绪背景对来源记忆存在影响,但背景的情绪效价和唤醒如何影响熟悉性及回想尚存争议。本研究以ERPs技术作为测量手段,采用来源记忆多键范式,操纵背景的情绪效价及唤醒强度,以探讨编码阶段背景情绪影响来源记忆提取的认知神经机制。学习阶段,呈现中性汉字及情绪图片（正性高唤醒、正性低唤醒、负性高唤醒、负性低唤醒）;测验阶段,仅呈现汉字,被试进行五键判断。行为结果发现：来源正确的比率比来源错误的比率更高,反应时更短;同时提取正性背景的辨别力更强,反应时更短;提取高唤醒背景反应时更短。脑电结果发现了分别代表熟悉性及回想的FN400及LPC新旧效应,且在500～700 ms,提取正性背景及高唤醒背景诱发显著更正的ERPs,但效价与唤醒没有交互作用。总体来说,来源记忆中背景效价及唤醒度对回想过程存在独立影响,体现为正性背景及高唤醒背景对来源提取的促进作用。     

自传体记忆的情绪对其相关信息内隐提取的影响

本研究主要考察自传体记忆本身的情绪是否影响该记忆相关信息的内隐提取过程。取大学生15人完成实验, 实验分为两部分：记忆提取和词汇判断。首先在记忆提取阶段, 要求被试根据词对(形容词-中性名词)提取积极、消极和中性情绪色彩的自传体记忆事件。接着在词汇判断任务中, 要求被试对包含提取过记忆的中性名词的词语进行词和非词的判断, 并且记录相应的脑电波。结果发现：(1)被试按要求成功提取了积极、消极和中性三类自传体记忆事件。词汇判断任务中, 内隐提取三类自传体记忆信息的反应时和正确率均无显著差异。(2)相比于积极、中性自传体记忆信息, 消极自传体记忆信息提取的过程中的ERP波幅更大, 更偏向于正向。这表明自传体记忆信息的内隐提取受到记忆本身情绪的影响, 消极自传体记忆信息提取需要付出更多资源。     

Fearful expressions enhance recognition memory: electrophysiological evidence

Facial expressions play a key role in affective and social behavior. However, the temporal dynamics of the brain responses to emotional faces remain still unclear, in particular an open question is at what stage of face processing expressions might influence encoding and recognition memory. To try and answer this question we recorded the event-related potentials (ERPs) elicited in an old/new recognition task. A novel aspect of the present design was that whereas faces were presented during the study phase with either a happy, fearful or neutral expression, they were always neutral during the memory retrieval task. The ERP results showed three main findings: An enhanced early fronto-central positivity for faces encoded as fearful, both during the study and the retrieval phase. During encoding subsequent memory (Dm effect) was influenced by emotion. At retrieval the early components P100 and N170 were modulated by the emotional expression of the face at the encoding phase. Finally, the later ERP components related to recognition memory were modulated by the previously encoded facial expressions. Overall, these results suggest that face recognition is modulated by top-down influences from brain areas associated with emotional memory, enhancing encoding and retrieval in particular for fearful emotional expressions.     

Recognition memory for emotional faces in amnestic mild cognitive impairment: An event-related potential study

ABSTRACT

This study examined the temporal course of emotional face recognition in amnestic mild cognitive impairment (aMCI). Patients and healthy controls (HC) performed a face recognition task, giving old/new responses to previously studied and novel faces displaying a negative or neutral expression. In aMCI patients, recognition accuracy was preserved for negative faces. Event-related potentials (ERPs) revealed disease-related changes in early perceptual components but not in ERP indices of explicit recognition. Specifically, aMCI patients showed impaired recognition effects for negative faces on the amplitudes of N170 and P2, suggesting deficient memory-related processing of negative faces at the stage of structural encoding and during an early recognition stage at which faces are individuated, respectively. Moreover, while a right-lateralized emotion effect specifically observed for correctly recognized faces on the amplitude of N170 was absent in aMCI, a similar emotion effect for successfully recognized faces on P2 was preserved in the patients, albeit with a different distribution. This suggests that in aMCI facilitated processing of successfully recognized emotional faces starts later in the processing sequence. Nonetheless, an early frontal old/new effect confined to negative faces and a parietal old/new effect unaffected by facial emotion were observed in both groups. This indicates that familiarity and conceptual priming processes may specifically contribute to recognition of negative faces in older adults and that aMCI patients can recruit the same retrieval mechanisms as controls, despite disease-related changes on early perceptual ERP components.     

The amygdala is involved in affective priming effect for fearful faces

The object of this study was to investigate whether the amygdala is involved in affective priming effect after stimuli are encoded unconsciously and consciously. During the encoding phase, each masked face (fearful or neutral) was presented to participants six times for 17ms each, using a backward masking paradigm. During the retrieval phase, participants made a fearful/neutral judgment for each face. Half of the faces had the same valence as that seen during encoding (congruent condition) and the other half did not (incongruent condition). Participants were divided into unaware and aware groups based on their subjective and objective awareness assessments. The fMRI results showed that during encoding, the amygdala elicited stronger activation for fearful faces than neutral faces but differed in the hemisphere according to the awareness level. During retrieval, the amygdala showed a significant repetition priming effect, with the congruent faces producing less activation than the incongruent faces, especially for fearful faces. These data suggest that the amygdala is important in unconscious retrieving of memories for emotional faces whether they are encoded consciously or unconsciously.     

记忆编码中目标与背景的情绪一致性对记忆提取的影响

摘 要 本研究将经典情绪启动范式和学习-再认范式相结合,探讨学习时启动与目标的情绪一致性对目标再认的影响。在记忆编码阶段,以情绪面孔图片为启动刺激、一般情绪图片为目标刺激,要求被试对目标图片的效价进行判断;在提取阶段向被试呈现一般情绪图片,要求被试判断是否在前一阶段见过。结果表明,编码阶段的加工背景对记忆提取产生了显著影响。一致启动促进了认知加工与记忆编码,提高了再认正确率。ERP结果也表明,在目标刺激呈现后300-500ms,编码时的情绪一致性对再认阶段消极目标诱发的ERP产生了显著影响。     

“Wanted!” The effects of reward on face recognition: electrophysiological correlates

The aim of the present study was to uncover the temporal dynamics of face recognition as a function of reward. Event-related potentials (ERPs) were recorded during the encoding and the subsequent old/new memory test in response to faces that could be associated with a monetary reward. The behavioral results showed that faces associated with reward at both encoding and retrieval were recognized better than the unrewarded ones. ERP responses highlighted that successful encoding predictive of subsequent memory was greater for faces associated with reward than for faces without reward-driven motivational learning. At retrieval, an early positive-going component was elicited for potentially rewarded faces on frontal regions, while the occipito-temporal N170 component showed priming effects as a function of reward. Later on, larger centro-parietal ERP components, related to recognition memory, were found selectively for reward-associated faces. Remarkably, electrophysiological responses varied in a graded manner, with the largest amplitude yielded by faces with double reward, followed by faces associated with reward only at encoding. Taken together, the present data show that the processing of outcome expectations affects face structural encoding and increases memory efficiency, yielding a robust and sustained modulation over frontal and temporal areas where reward and memory mechanisms operate in conjunction.     

Mapping the time course of the positive classification advantage: An ERP study

The aim of the present study was to investigate the time course of the positive advantage in the expression classification of faces by recording event-related potentials (ERPs). Although neutral faces were classified more quickly than either happy or sad faces, a significant positive classification advantage (PCA)—that is, faster classification for happy than for sad faces—was found. For ERP data, as compared with sad faces, happy faces elicited a smaller N170 and a larger posterior N2 component. The P3 was modulated by facial expressions with higher amplitudes and shorter latencies for both happy and neutral stimuli than for sad stimuli, and the reaction times were significantly correlated with the amplitude and latency of the P3. Overall, these data showed robust PCA in expression classification, starting when the stimulus has been recognized as a face revealed by the N170 component.     

知觉负载对负性分心面孔的知觉加工和记忆的影响

本研究采用视觉搜索和意外再认记忆任务,结合事件相关电位技术,考察知觉负载对负性分心面孔的知觉加工和记忆的影响。在视觉搜索任务中,行为上恐惧分心面孔在高负载下干扰任务。ERP结果上,恐惧比中性分心面孔诱发更大的N170和N250;在低负载下恐惧比中性分心面孔诱发更大的N700,在高负载下没有差异。在意外再认记忆中,个体对低负载下的恐惧分心面孔表现出记忆。这些结果说明负性分心物在早期是自动化加工;晚期加工受知觉负载的调节,负载越低对负性分心物的过滤越少,存在对负性分心物的记忆偏向。     

内隐与外显记忆的编码与提取非对称性关系

实验采用“学习-测验”范式, 考察在编码或提取中分别附加的干扰任务对内隐测验或外显测验中获得的ERP新旧效应产生的影响。结果表明, 在内隐测验中, 编码干扰对随后测验中的ERP新旧效应没有产生影响, 而提取干扰却改变了300~500ms新旧效应的脑区位置, 破坏了500~700ms新旧效应; 与之相反, 在外显测验中, 编码干扰破坏了500~700ms新旧效应, 而提取干扰对这一效应没有产生影响, 即编码与提取干扰对内隐或外显测验中的ERP新旧效应都产生了非对称性的影响, 但又存在着差异, 从而为两种记忆在编码与提取加工的关系上存在的分离现象提供了神经生理方面的证据。     

The influence of indirect and direct emotional processing on memory for facial expressions

We used the remember-know procedure (Tulving, 1985 ) to test the behavioural expression of memory following indirect and direct forms of emotional processing at encoding. Participants (N=32) viewed a series of facial expressions (happy, fearful, angry, and neutral) while performing tasks involving either indirect (gender discrimination) or direct (emotion discrimination) emotion processing. After a delay, participants completed a surprise recognition memory test. Our results revealed that indirect encoding of emotion produced enhanced memory for fearful faces whereas direct encoding of emotion produced enhanced memory for angry faces. In contrast, happy faces were better remembered than neutral faces after both indirect and direct encoding tasks. These findings suggest that fearful and angry faces benefit from a recollective advantage when they are encoded in a way that is consistent with the predictive nature of their threat. We propose that the broad memory advantage for happy faces may reflect a form of cognitive flexibility that is specific to positive emotions.     

Event-related brain potential correlates of the other-race effect: A review

People are better at remembering own-race relative to other-race faces. Here, we review event-related brain potential (ERP) correlates of this so-called other-‘race’ effect (ORE) by discussing three critical aspects that characterize the neural signature of this phenomenon. First, difficulties with other-race faces initially emerge during perceptual processing, which is indexed by an increased N170. Second, as evidenced by ‘difference due to subsequent memory’ effects, more effortful processing of other-race faces is needed for successful encoding into long-term memory. Third, ERP old/new effects reveal that a stronger engagement of processing resources is also required for successful retrieval of other-race faces from memory. The ERP evidence available to date thus suggests widespread ethnicity-related modulations during both perceptual and mnemonic processing stages. We further discuss how findings from the ORE compared with potentially related memory biases (e.g. other-gender or other-age effects) and how ERP findings inform the ongoing debate regarding the mechanisms underlying the ORE. Finally, we outline open questions and potential future directions with an emphasis on using multiple, ecologically more valid ‘ambient’ images for each face to assess the ORE in paradigms that capture identity rather than image recognition.