Color and context: An ERP study on intrinsic and extrinsic feature binding in episodic memory

Episodic memory for intrinsic item and extrinsic context information is postulated to rely on two distinct types of representation: object and episodic tokens. These provide the basis for familiarity and recollection, respectively. Electrophysiological indices of these processes (ERP old-new effects) were used together with behavioral data to test these assumptions. We manipulated an intrinsic object feature (color; Experiment 1) and a contextual feature (background; Experiments 1 and 2). In an inclusion task (Experiment 1), the study-test manipulation of color affected object recognition performance and modulated ERP old-new effects associated with both familiarity and recollection. In contrast, a contextual manipulation had no effect, although both intrinsic and extrinsic information was available in a direct feature (source memory) test. When made task relevant (exclusion task; Experiment 2), however, context affected the ERP recollection effect, while still leaving the ERP familiarity effect uninfluenced. We conclude that intrinsic features bound in object tokens are involuntarily processed during object recognition, thus influencing familiarity, whereas context features bound in episodic tokens are voluntarily accessed, exclusively influencing recollection. Figures depicting all the electrodes analyzed are available in an online supplement at www.psychonomic.org/archive.     

The impact of aging on associative memory for preexisting unitized associations

Aging is accompanied by a decline in associative memory that can, however, be attenuated when associations are unitized at encoding, that is, when they form an integrated entity. Unitization is thought to promote familiarity-based recognition memory, which is preserved in aging. We examined whether preexperimentally unitized associations (compound words (CWs)) do indeed reduce age differences in memory, and whether preexperimental unitization promotes familiarity. In Experiment 1, we assessed the memory of 20 young and 20 older participants for compound versus unrelated word pairs using a yes/no recognition test with Remember/Know/Guess judgments. In Experiment 2, we tested 20 young and 20 older participants using the same procedure, except for the use of a two-alternative forced-choice recognition paradigm, which is thought to enhance the contribution of familiarity. The results of both experiments corroborated the greater contribution of familiarity to recognition of unitized associations. In Experiment 1, however, the use of CWs did not attenuate the age-related associative decline. We suggest that preexisting knowledge associated with recombined compounds induced high absolute familiarity and illusory recollection, leading to high false-recognition rates for the older adults. By contrast, the two groups performed similarly across both conditions in Experiment 2. Thus, the forced-choice procedure facilitates the use of familiarity in such a way that it improves older adults’ associative memory to the level of young participants. These results suggest that the modulation of associative memory in aging by preexisting unitization varies according to methodological parameters, such as the nature of the lures and the test format.     

从整合的角度看联结记忆中的项目再认

联结记忆由三种成分构成：项目1, 项目2以及项目1-项目2之间的联结, 其中, 对项目1和项目2的再认称之为项目再认, 而对项目1-项目2之间联结的再认称之为联结再认。双加工理论认为项目再认可以由熟悉性和回想加工来完成, 而联结再认只能由回想加工来完成。但近期有大量的研究发现：当要学习的项目对被整合为一个新的整体表征时, 熟悉性也能够支持联结再认。而关于整合对联结记忆中项目再认的研究较少, 总结已有研究提出两种观点：一种是“只有受益”观点(benefits-only)认为整合在增加联结再认的同时不影响项目再认; 另一种是“收支平衡”观点(costs and benefits)认为整合增加联结再认是以牺牲项目再认为代价的。未来研究应该关注整合对联结记忆中项目再认的影响及其神经机制, 了解整合对联结再认和项目再认的具体作用, 有助于针对具体记忆任务选择合适的编码方式来提高记忆表现。     

一体化促进联结记忆的作用机制：熟悉性和回想加工

当两个或两个以上项目进行一体化编码时, 熟悉性也能够支持联结再认, 这一观点已经得到大量研究证据的支持。然而, 关于一体化如何影响联结再认和构成联结的单个项目再认仍存在分歧。通过回顾现有研究发现：(1)一体化一致性是调节一体化与联结再认关系的重要因素; (2)认知资源有限和新/旧词语义相关性是影响一体化对项目再认作用的重要因素; (3)一体化的发生机制存在“项目假说”、“图式假说”以及“精细加工假说”三种可能的理论解释。未来研究不仅需要控制一体化一致性, 还可以比较不同一体化方式的作用大小以及探索一体化效应的毕生发展规律。     

合体字与复合词中联结编码和项目编码的关系

本研究通过考察合体字和复合词加工过程中联结记忆和项目记忆的变化,探究了在将不同项目绑定为整体的过程中联结编码和项目编码间的关系,并结合脑电技术比较了合体字和复合词的加工过程在神经机制上的差异。行为结果显示:与不能组成字或词的编码条件相比,合体字和复合词编码条件下的联结记忆成绩有显著提升,且项目记忆成绩没有下降;与复合词编码相比,合体字编码条件下的联结记忆和项目记忆成绩都显著更好。脑电结果显示:复合词编码时晚期负成分(LNC)主要位于额区且发生较早,而合体字编码时的LNC主要位于枕区且发生更晚;合体字编码比复合词编码在α/β频段的神经振荡去同步化更强。这些结果表明,将不同项目绑定为整体的操作可以强化大脑对联结信息的加工,同时不会损害对项目的加工,支持了“只有收益”的观点。本研究也从实证的角度为汉语学习材料的编排提供了参考。     

双加工再认提取中的情绪记忆增强效应

根据双加工理论, 再认提取可以划分为两种不同的加工：熟悉性与回想。以往的研究普遍认为情绪对再认提取具有增强效应, 但是情绪对再认记忆中两种不同加工方式(熟悉性与回想)的增强效应的神经机制尚存争议。本研究以ERP作为测量手段, 采用修正的“记得/知道”范式对情绪图片进行再认测验, 旨在探究在学习?测验间隔较长的条件下, 情绪信息如何对熟悉性与回想产生增强效应。在行为结果中, 对于知道判断, 情绪图片的记忆表现显著高于中性图片, 情绪效价间没有差异; 对于记得判断, 负性情绪图片的记忆表现要显著高于正性与中性图片。在ERP数据上, 对于知道判断, 情绪图片的FN400新旧效应有增强作用。对于记得判断, 负性图片的LPC的新旧效应波幅显著高于中性与负性图片; 而正性图片的LPC新旧效应增强作用不显著。以上证据表明：学习?测验间隔较长的情况下, 熟悉性再认提取中, 情绪记忆增强效应主要体现在情绪唤醒对记忆强度的提高, 而不仅仅体现在情绪效价对熟悉判断反应倾向的影响。在回想的再认提取中, 情绪效价的调节占据主导地位, 负性情绪图片有显著的情绪记忆增强效应; 正性情绪图片则不具有增强效应。     

联结再认中双语者第二语言记忆优势效应

研究使用ERPs技术, 考察了双语者在联结再认中是否存在第二语言记忆优势效应。实验要求被试完成维吾尔语(L1)和汉语(L2)两类“学习-测试”任务。学习阶段要求被试学习混合呈现的复合词和无关词, 测验阶段要求被试区分“旧”、“重组”或“新”词对。行为结果发现：(1)复合词中, L2的正确率高于L1, L2的反应时快于L1; 无关词中, L2的正确率与L1无显著差异, 但L2的反应时快于L1。(2) 在L2和L1中, 复合词的正确率均高于无关词, 反应时均快于无关词。ERPs结果发现：(1)在高整合条件下, L2仅诱发了FN400效应, L1诱发了FN400效应和LPC效应; 在低整合条件下, L2和L1都只诱发了LPC效应。(2)在时间进程上, L2和L1分别在650 ms和900 ms完成联结关系的提取。上述结果表明, 在高整合条件下, 双语者在联结再认中存在L2记忆优势。此外, 实验结果也从双语角度证明了, 整合编码能促进熟悉性在维吾尔语联结再认中发挥作用。本研究结果的实践意义在于, 为我国少数民族学生习得国家通用语言文字提供了认知神经科学依据。     

不同情绪背景下来源记忆的ERPs研究*

使用事件相关电位(ERP)技术和测试来源记忆的多键范式,探讨不同情绪效价背景下来源提取的认知神经机制。学习阶段,同时呈现汉字和3种效价情绪图片(重叠);测验阶段,只呈现汉字,要求被试进行四键判断：旧字且背景为中性,旧字且背景为正性,旧字且背景为负性,新字。结果发现：在提取阶段,刺激呈现后300~500 ms,3种情绪背景下来源判断正确项目和来源判断错误项目都比新项目诱发了更正的ERPs(即都存在新旧效应),这一结果反映出刺激呈现后300~500 ms 是一个早期的项目提取阶段,它独立于来源提取。并且,在中性背景下,两种新旧效应没有差别;而在正性和负性背景下,来源判断正确项目的新旧效应显著大于来源判断错误项目。说明相比于中性背景,情绪背景下被试可能更早对来源信息产生熟悉感。在500~650 ms,3种情绪背景下都存在来源判断正确项目的新旧效应,在来源判断错误项目和新项目之间没有显著差异,来源正确与来源错误有显著的新旧效应差异,但二者在头皮分布上是类似的,这反映了晚期的来源提取过程。同时来源正确的新旧效应在这两个时段有显著不同的头皮分布,表明这两个时段有不同加工过程。另外,在500~650 ms,存在显著的情绪效应,正性背景下正确判断来源诱发的ERPs比中性和负性背景下的更正,而且来源判断错误条件下没有情绪效应。综上所述,来源正确和来源错误可能仅仅反映了大脑激活在量上的不同,并不能推断两者存在质的差异;大脑神经活动的早期不仅反映了对记忆项目的熟悉性,而且也受情绪效应的影响,500 ms之后大脑神经活动反映的是对记忆项目回想的过程,这一回想过程也与情绪效应有关,受到情绪效应的调节。     

Misrecollection prevents older adults from benefitting from semantic relatedness of the memoranda in associative memory

Memory for episodic associations declines in aging, ostensibly due to decreased recollection abilities. Accordingly, associative unitization - the encoding of associated items as one integrated entity - may potentially attenuate age-related associative deficits by enabling familiarity-based retrieval, which is relatively preserved in aging. To test this hypothesis, we induced bottom-up unitization by manipulating semantic relatedness between memoranda. Twenty-four young and 24 older adults studied pairs of object pictures that were either semantically related or unrelated. Participants subsequently discriminated between intact, recombined and new pairs. We found that semantic relatedness increased the contributions of both familiarity and recollection in young adults, but did not improve older adults' performance. Instead, they showed associative deficits, driven by increased recollection-based false recognition. This may reflect a “misrecollection” phenomenon, in which older adults make more false alarms to recombined pairs with particularly high confidence, due to poorer retrieval monitoring regarding semantically-related associative probes.     

Associative recognition processes are modulated by the semantic unitizability of memoranda

Although memory of episodic associations is generally considered to be recollective in nature, it has been suggested that when stimuli are experienced as a unit, familiarity processes might contribute to their subsequent associative recognition. To investigate the effect of semantic relatedness during episodic encoding on the processes of retrieval of associative information, we had participants interactively encode pairs of object pictures, vertically arranged so as to suggest a functional or configural relationship between them. Half the pairs were independently judged to be of related objects (e.g., a lamp over a table) and half of unrelated objects (e.g., a key-ring over an apple). At test, participants discriminated between intact, recombined, and new pairs while event related potentials (ERPs) were recorded. In an early ERP marker of retrieval success generally associated with familiarity processes, differences related to associative memory only emerged for related pairs, while differences associated with item memory emerged for both related and unrelated pairs. In contrast, in a later ERP effect associated with recollection, differences related to associative memory emerged for both related and unrelated pairs. These findings may indicate that retrieval of episodic associations formed between two semantically related visual stimuli can be supported by familiarity-related processes.     

The contribution of familiarity to within- and between-domain associative recognition memory: Use of a modified remember/know procedure

The purpose of the present study was to determine the extent to which familiarity can support associative recognition memory as a function of whether the associations are within- or between-domain. Standard recognition and familiarity only performance were compared in different participants, using a new adaptation of the remember/know procedure. The results indicated that within-domain (face–face) associative recognition was mainly supported by familiarity. In contrast, familiarity provided relatively poor support to between-domain (face–name) associative recognition for which optimal performance required a major recollection contribution. These findings suggest that familiarity can support associative recognition memory, particularly for within-domain associations, and contrast with the widely held view that associative recognition depends largely on recollection.     

情绪效价和唤醒对熟悉性和回想的不同影响

本研究检验了情绪的效价和唤醒对记忆提取阶段熟悉性过程和回想过程的影响及其心理机制。结果发现,编码阶段无分心任务时,积极图片的高、低自信再认准确率均高于消极图片,而唤醒对于高自信再认准确率的影响只限于消极图片;在编码阶段设置分心任务时,发现积极和消极的高唤醒图片的高自信再认准确率显著高于低唤醒图片。这些结果说明情绪的效价影响了熟悉性和回想两类记忆过程,而唤醒只影响回想过程,效价效应是编码阶段被试调用认知资源对积极图片进行精细加工的结果,而唤醒对回想过程的影响是自动编码高唤醒刺激细节的结果。     

情绪对项目记忆和来源记忆的影响

最近几十年以来, 情绪对记忆的影响越来越受到认知心理学家的关注。本文总结了我在中科院心理研究所师从傅小兰研究员攻读博士学位期间所开展的主要研究工作。我的研究以中文词语为学习材料, 分别考察了在编码过程中和编码结束后诱发情绪对项目记忆和来源记忆的影响。当情绪在编码阶段被诱发, 主要的研究发现如下：1)负性情绪增强自由回忆, 但正性情绪只呈现出增强自由回忆的趋势。2)负性情绪降低总体再认记忆, 但正性情绪对总体再认记忆没有影响。此外, 正性和负性情绪均不影响“记得”反应的正确率; 然而, 负性情绪降低了“知道”反应的正确率, 正性情绪对“知道”反应的正确率没有影响。3)正性和负性情绪均对来源记忆(即对词语字体颜色的记忆)没有影响。当情绪在编码结束后被诱发, 主要的研究发现如下：1)对女性被试而言, 负性情绪增强了项目记忆的巩固, 然而, 对男性被试而言, 正性和负性情绪均不影响项目记忆的巩固。2)无论对男性还是女性被试, 正性和负性情绪对来源记忆的巩固均没有影响。本研究的上述发现对建立情绪和记忆的关系具有理论意义, 对如何在教学情境中如何利用情绪诱发促进学生的记忆巩固也具有现实指导意义。     

Familiarity supports associative recognition memory for face stimuli that can be unitised: Evidence from receiver operating characteristics

According to dual-process models, associative recognition memory mainly relies on recollection without benefiting from familiarity. This study investigates the circumstances under which familiarity may support associative recognition judgements by comparing recognition memory for arbitrarily paired items (i.e., pairs of face stimuli depicting two different persons; interitem associations) with recognition memory for pairs of items that are highly overlapping and can be unitised into a coherent whole (i.e., pairs of physically different but very similar face stimuli depicting the same person; intraitem associations). Estimates of familiarity and recollection were derived from receiver operating characteristics. Consistent with the hypothesis that familiarity is able to support associative recognition memory, but only when the to-be-associated stimuli can be unitised, results from two experiments revealed higher familiarity estimates for intra- compared to interitem associations. By contrast, recollection for recombined pairs was higher for inter- compared to intraitem associations. We propose a hypothetical model on how intraitem associations may benefit from familiarity.     

Recognition memory deficits in mild cognitive impairment

ABSTRACT There is no agreement on the pattern of recognition memory deficits characteristic of patients diagnosed with mild cognitive impairment (MCI). Whereas lower performance in recollection is the hallmark of MCI, there is a strong controversy about possible deficits in familiarity estimates when using recognition memory tasks. The aim of this research is to shed light on the pattern of responding in recollection and familiarity in MCI. Five groups of participants were tested. The main participant samples were those formed by two MCI groups differing in age and an Alzheimer's disease group (AD), which were compared with two control groups. Whereas one of the control groups served to assess the performance of the MCI and AD people, the other one, composed of young healthy participants, served the purpose of evaluating the adequacy of the experimental tasks used in the evaluation of the different components of recognition memory. We used an associative recognition task as a direct index of recollection and a choice task on a pair of stimuli, one of which was perceptually similar to those studied in the associative recognition phase, as an index of familiarity. Our results indicate that recollection decreases with age and neurological status, and familiarity remains stable in the elderly control sample but it is deficient in MCI. This research shows that a unique encoding situation generated deficits in recollective and familiarity mechanisms in mild cognitive impaired individuals, providing evidence for the existence of deficits in both retrieval processes in recognition memory in a MCI stage.     

Event-related potentials and recognition memory

According to dual-process models, recognition memory is supported by distinct retrieval processes known as familiarity and recollection. Important evidence supporting the dual-process framework has come from studies using event-related brain potentials (ERPs). These studies have identified two topographically distinct ERP correlates of recognition memory--the "parietal" and "mid-frontal" old/new effects--that are dissociated by variables that selectively modulate recollection and familiarity, respectively. We evaluate the extent to which ERP data support dual-process models in light of the proposal that recollection is a continuous rather than a discrete memory process. We also examine the claim that the putative ERP index of familiarity is a reflection of implicit rather than explicit memory. We conclude that ERP findings continue to offer strong support for the dual-process perspective.     

Masked repetition priming hinders subsequent recollection but not familiarity: A behavioral and event-related potential study

The present study used the masked repetition priming paradigm in the study phase and the R/K paradigm in the test phase to investigate whether repetition priming can hinder recognition memory and which recognition process (familiarity or recollection) is hindered. Event-related potentials (ERPs) in the study and test phase were recorded to explore the temporal course of how repetition priming hinders subsequent recognition memory and which old/new effect (FN400 or LPC) is affected. Converging behavioral and ERP results indicated that masked repetition priming hindered subsequent recollection but not familiarity. The analysis of ERP priming effects in the study phase indicated that primed words were associated with less negative N400 and less positive LPC compared to unprimed words. The analysis of the priming effect as a function of subsequent memory revealed that only the LPC priming effect was predictive of priming effect on subsequent memory, which suggested that the “prediction-error” account might be a possible explanation of how repetition priming affects subsequent recognition memory.     

Recognition memory deficits in mild cognitive impairment

ABSTRACT

There is no agreement on the pattern of recognition memory deficits characteristic of patients diagnosed with mild cognitive impairment (MCI). Whereas lower performance in recollection is the hallmark of MCI, there is a strong controversy about possible deficits in familiarity estimates when using recognition memory tasks. The aim of this research is to shed light on the pattern of responding in recollection and familiarity in MCI. Five groups of participants were tested. The main participant samples were those formed by two MCI groups differing in age and an Alzheimer's disease group (AD), which were compared with two control groups. Whereas one of the control groups served to assess the performance of the MCI and AD people, the other one, composed of young healthy participants, served the purpose of evaluating the adequacy of the experimental tasks used in the evaluation of the different components of recognition memory. We used an associative recognition task as a direct index of recollection and a choice task on a pair of stimuli, one of which was perceptually similar to those studied in the associative recognition phase, as an index of familiarity. Our results indicate that recollection decreases with age and neurological status, and familiarity remains stable in the elderly control sample but it is deficient in MCI. This research shows that a unique encoding situation generated deficits in recollective and familiarity mechanisms in mild cognitive impaired individuals, providing evidence for the existence of deficits in both retrieval processes in recognition memory in a MCI stage.     

Recognition memory for faces: When familiarity supports associative recognition judgments

Recognition memory for single items can be dissociated from recognition memory for the associations between items. For example, recognition tests for single words produce curvilinear receiver operating characteristics (ROCs), but associative recognition tests for word pairs produce linear ROCs. These dissociations are consistent with dual-process theories of recognition and suggest that associative recognition relies on recollection but that item recognition relies on a combination of recollection and assessments of familiarity. In the present study, we examined associative recognition ROCs for facial stimuli by manipulating the central and external features, in order to determine whether linear ROCs would be observed for stimuli other than arbitrary word pairs. When the faces were presented upright, familiarity estimates were significantly above zero, and the associative ROCs were curvilinear, suggesting that familiarity contributed to associative judgments. However, presenting the faces upside down effectively eliminated the contribution of familiarity to associative recognition, and the ROCs were linear. The results suggest that familiarity can support associative recognition judgments, if the associated components are encoded as a coherent gestalt, as in upright faces.     

Associative interference in recognition memory: A dual-process account

Associative interference from overlapping word pairs (A-B, A-D) reduces recall but has inconsistent effects on recognition. A dual-process account suggests that interference conditions reduce recollection but increase familiarity. This is predicted to increase recognition false alarms but have variable effects on recognition hits, depending on the relative contribution of recollection and familiarity. In three experiments that varied materials (sentences or random nouns) and test type (associative or pair recognition), interference conditions always increased recognition false alarms, but sometimes increased and sometimes decreased recognition hits. However, remember hits always decreased and know hits always increased with interference, patterns predicted of the recollection and familiarity processes, respectively. According to the dual-process view, a manipulation that affects the component processes in opposite ways can produce inconsistent patterns of recognition performance as the relative contribution of recollection and familiarity changes across tasks.