Reward-priming impacts visual working memory maintenance: Evidence from human electrophysiology

Reward can benefit visual processing of reward-associated objects in a non-strategic way. Recent studies have suggested that such influence extends also to visual working memory (VWM) representations of reward-associated stimuli. However, it is not clear yet which mechanisms underlie the behavioural effects in VWM tasks: reward could directly impact on our ability to maintain representations in VWM or it could influence memory indirectly via priming of attentional selection. To distinguish between these alternatives we measured event-related potential indices of selective attention – the N2pc – and VWM maintenance – the CDA (contralateral delay activity) – while participants completed a VWM task. Results show that reward outcome in one trial caused similarly coloured targets to be strongly represented in VWM in subsequent trials, as expressed in a larger-amplitude CDA This was not preceded by a corresponding effect on attentional selection, in so far as our key manipulation had no impact on the N2pc. In a second experiment, we found that reward priming produced a behavioural benefit that emerged over time, suggesting that the representations of reward-associated items stored in VWM are more resistant to interference and decay. We conclude that when the task stresses VWM maintenance, it is at this representational level that reward will have impact.     

Does maintaining bindings in visual working memory require more attention than maintaining features?

ABSTRACT

Whether more attention is required for maintaining bindings than maintaining features in visual working memory (VWM) remains an open question. If maintaining bindings in VWM does not require more attention than maintaining features, is it related to the stability of binding representations? In this study, we explored whether maintaining bindings requires more attention than maintaining features for similar and dissimilar objects by inserting a feature report task into the maintenance phase of VWM in Experiments 1 and 2. We also investigated whether the effect of similarity on the attentional requirement for maintaining bindings and features is due to the stability of VWM representations by inserting a suffix during the maintenance phase of VWM in Experiment 3. The results showed that when object-based attention was consumed, bindings were more impaired than features for dissimilar objects but not for similar objects. We also found that the bindings of similar objects were less interfered by the suffix than those of dissimilar objects. Our findings suggest that maintaining bindings does not require more attention than maintaining features when the binding representations are stable in VWM and similarity improves the stability of binding representations.     

厌恶与恐惧面孔的记忆编码、保持、提取

情绪记忆增强效应在负性情绪记忆研究中被反复证实。尽管厌恶和恐惧同属负性情绪, 提示威胁的存在, 但由于它们的进化意义和生理功能不同, 可能导致它们对记忆的编码、保持、提取三个阶段不同的调节方向或调节强度。本文采用延迟再认任务, 采用事件相关电位考察健康成年被试对唤醒度和效价相当的恐惧和厌恶面孔的记忆编码、保持和提取。结果显示, 1)在记忆编码的早期, 被试主要加强了对恐惧面孔的注意(P1)和结构编码(N170), 而厌恶信息的加工受到了抑制; 2)从记忆编码晚期到记忆保持的整个阶段, 被试对厌恶信息的精细评估(编码阶段P3)和复述保持(保持阶段的负走向慢波)均强于恐惧信息; 3)相比于恐惧面孔, 厌恶面孔可能在工作记忆系统形成了更强的表征, 从而使被试在记忆提取时可回忆起更多的细节, 对记忆提取的信心更足(提取阶段P3)。这后两条发现是导致行为层面上厌恶情绪记忆优于恐惧情绪记忆的原因。本研究为“厌恶比恐惧具有更强的记忆增强效应”提供了高时间分辨率的脑活动层面的证据, 从而进一步揭示了负性情绪增强记忆的认知机制。     

客体复杂度影响工作记忆可存储的客体数目

采用变化觉察范式,以对侧延迟活动（contralateral delay activity,CDA）的幅值为指标,通过操纵记忆刺激的复杂程度,对视觉工作记忆中可存储的客体数目（即工作记忆容量）问题进行了探讨。结果表明,2个复杂客体条件下的CDA幅值与4个复杂客体条件无显著差异,而4个简单客体条件的CDA幅值显著高于2个简单客体条件,即CDA的幅值受客体复杂度的调节。基于该结果推论：并非视觉工作记忆总能存储4个客体,其可存储的客体数目受客体复杂度影响。     

编码与提取干扰对内隐和外显记忆的非对称性影响

以往研究表明在外显记忆中,编码与提取加工存在着非对称性,但在内隐记忆中,二者的关系并不明确,因此实验采用“学习-再认”范式,考察在编码或提取中分别附加的干扰任务对词汇判断或再认产生的影响。结果证实编码与提取干扰对内隐或外显记忆都具有非对称性的影响,但又存在着差异,即编码干扰会导致随后外显记忆成绩显著减少,而提取干扰对其影响较小,相反,编码干扰对随后内隐测验中启动效应的影响较小,但提取干扰会破坏启动效应,从而为内隐记忆和外显记忆的分离提供了进一步的证据     

Distinct capacity limits for attention and working memory: Evidence from attentive tracking and visual working memory paradigms

A hallmark of both visual attention and working memory is their severe capacity limit: People can attentively track only about four objects in a multiple object tracking (MOT) task and can hold only up to four objects in visual working memory (VWM). It has been proposed that attention underlies the capacity limit of VWM. We tested this hypothesis by determining the effect of varying the load of a MOT task performed during the retention interval of a VWM task and comparing the resulting dual-task costs with those observed when a VWM task was performed concurrently with another VWM task or with a verbal working memory task. Instead of supporting the view that the capacity limit of VWM is solely attention based, the results indicate that VWM capacity is set by the interaction of visuospatial attentional, central amodal, and local task-specific sources of processing.     

The effects of categorical similarity and feature-space proximity on visual working memory processing

Two patterns of data predict that similarity has a positive effect and a negative effect on visual working memory (VWM) processing. We assume that these two empirical outcomes do not distinguish categorical similarity from feature-space proximity, resulting in this divergence. To investigate how categorical similarity and feature-space proximity modulate VWM, we tested memory for an array of pictures drawn from either mixed categories or a single category in which feature-space proximity varied along a morph continuum in a change-detection task. We found that memory under the mixed-category condition was better than that under the single-category condition, whereas memory under high feature-space proximity was superior to that under low feature-space proximity. These patterns were unaffected by manipulations of stimulus type (faces or scenes), encoding duration (limited or self-paced), and presentation format (simultaneous or sequential). These results are consistent with our hypotheses that categorical similarity inhibits VWM, whereas feature-space proximity facilitates VWM. We also found that memory for items with low feature-space proximity benefited more from mixed-category encoding than that for items with high feature-space proximity. Memory for faces benefited more from mixed-category encoding than scenes, whereas memory for scenes benefited more from feature-space proximity than faces. These results suggest that centre-surround inhibition organization might underlie similarity effects in VWM. Centre-surround inhibition organization for complex real-world objects could have both categorical level and feature-space level. The feature-space level might differ by category.     

Electrophysiological correlates of encoding processes in a full-report visual working memory paradigm

Why are some visual stimuli remembered, whereas others are forgotten? A limitation of recognition paradigms is that they measure aggregate behavioral performance and/or neural responses to all stimuli presented in a visual working memory (VWM) array. To address this limitation, we paired an electroencephalography (EEG) frequency-tagging technique with two full-report VWM paradigms. This permitted the tracking of individual stimuli as well as the aggregate response. We recorded high-density EEG (256 channel) while participants viewed four shape stimuli, each flickering at a different frequency. At retrieval, participants either recalled the location of all stimuli in any order (simultaneous full report) or were cued to report the item in a particular location over multiple screen displays (sequential full report). The individual frequency tag amplitudes evoked for correctly recalled items were significantly larger than the amplitudes of subsequently forgotten stimuli, regardless of retrieval task. An induced-power analysis examined the aggregate neural correlates of VWM encoding as a function of items correctly recalled. We found increased induced power across a large number of electrodes in the theta, alpha, and beta frequency bands when more items were successfully recalled. This effect was more robust for sequential full report, suggesting that retrieval demands can influence encoding processes. These data are consistent with a model in which encoding-related resources are directed to a subset of items, rather than a model in which resources are allocated evenly across the array. These data extend previous work using recognition paradigms and stress the importance of encoding in determining later VWM retrieval success.     

多特征刺激在视觉工作记忆中的存储模式

使用事件相关电位技术, 采用变化觉察范式, 以双色块和单色块为刺激材料, 通过两个实验探讨了多特征刺激在视觉工作记忆中的存储模式。实验1通过对双色块和单色块的比较来考察特征数量对视觉工作记忆资源分配的影响, 通过操控双色方块的变化幅度来考察精度需求对资源分配的影响。结果发现, 特征数量的增加诱发了更强的对侧延迟活动(CDA), 而精度需求的提高并没有引起对侧延迟活动上的差异, 却诱发了指示自上而下的控制的晚期正成分(LPC)的增强。实验2通过在测验阶段加入指示可能变化的部分的提示符, 发现提示符并未能促进变化觉察的行为反应。整个研究表明, 特征数量影响视觉工作记忆资源的分配, 而精度需求并不起作用, 同时多特征刺激在视觉工作记忆中的存储单位并不是单个的独立特征, 而是整合的客体。     

内隐与外显记忆的编码与提取非对称性关系

实验采用“学习-测验”范式, 考察在编码或提取中分别附加的干扰任务对内隐测验或外显测验中获得的ERP新旧效应产生的影响。结果表明, 在内隐测验中, 编码干扰对随后测验中的ERP新旧效应没有产生影响, 而提取干扰却改变了300~500ms新旧效应的脑区位置, 破坏了500~700ms新旧效应; 与之相反, 在外显测验中, 编码干扰破坏了500~700ms新旧效应, 而提取干扰对这一效应没有产生影响, 即编码与提取干扰对内隐或外显测验中的ERP新旧效应都产生了非对称性的影响, 但又存在着差异, 从而为两种记忆在编码与提取加工的关系上存在的分离现象提供了神经生理方面的证据。     

视觉工作记忆负载类型对注意选择的影响

通过操纵Flanker任务相对于视觉工作记忆任务的呈现位置, 探讨在视觉工作记忆编码和保持阶段, 精度负载和容量负载对注意选择的影响。行为结果发现, Flanker任务呈现位置和视觉工作记忆负载类型影响注意选择; ERP结果发现, 在保持阶段, 当搜索目标和干扰项不一致时, 负载类型影响N2成分。研究表明, 在编码阶段, 视觉工作记忆负载主要通过占用更多知觉资源降低干扰效应, 支持知觉负载理论; 而在保持阶段, 当Flanker任务位于记忆项内部时, 两类负载在工作记忆表征过程中不同的神经活动导致投入到注意选择的认知控制资源不同, 可能是两类负载影响保持阶段注意选择的机制。     

Fearful expressions enhance recognition memory: electrophysiological evidence

Facial expressions play a key role in affective and social behavior. However, the temporal dynamics of the brain responses to emotional faces remain still unclear, in particular an open question is at what stage of face processing expressions might influence encoding and recognition memory. To try and answer this question we recorded the event-related potentials (ERPs) elicited in an old/new recognition task. A novel aspect of the present design was that whereas faces were presented during the study phase with either a happy, fearful or neutral expression, they were always neutral during the memory retrieval task. The ERP results showed three main findings: An enhanced early fronto-central positivity for faces encoded as fearful, both during the study and the retrieval phase. During encoding subsequent memory (Dm effect) was influenced by emotion. At retrieval the early components P100 and N170 were modulated by the emotional expression of the face at the encoding phase. Finally, the later ERP components related to recognition memory were modulated by the previously encoded facial expressions. Overall, these results suggest that face recognition is modulated by top-down influences from brain areas associated with emotional memory, enhancing encoding and retrieval in particular for fearful emotional expressions.     

Investigating the other-race effect in working memory

People have difficulties in remembering other-race faces; this so-called other-race effect (ORE) has been frequently observed in long-term recognition memory (LTM). Several theories argue that the ORE in LTM is caused by differences in earlier processing stages, such as encoding of ingroup and outgroup faces. We test this hypothesis by exploring whether the ORE can already be observed in visual working memory (VWM)—an intermediate system located between encoding processes and LTM storage. In four independent experiments, we observed decreased performance for outgroup faces compared to ingroup faces using three different VWM tasks: an adaptive N-back task, a self-ordered pointing task, and a change detection task. Also, we found that the number of items stored in VWM is smaller for outgroup faces than for ingroup faces. Further, we explored whether performance differences in the change detection task are related to the classic ORE in recognition memory. Our results provide further evidence that the ORE originates during earlier stages of cognitive processing. We discuss that (how) future ORE research may benefit from considering theories and evidence from the VWM literature.     

客体相似性对不同认知方式个体视觉工作记忆表征的影响

采用整体检测的变化察觉范式,探讨客体的相似性对客体—空间型认知方式个体视觉工作记忆表征的影响。行为结果显示,在不相似客体的视觉工作记忆表征任务中,客体型者在长延时条件的成绩优于空间型者,而在相似客体的视觉工作记忆表征任务中,两者无差异;ERP结果显示,在不相似客体视觉工作记忆表征任务中,与客体型者相比,空间型者在大脑皮层诱发出更大的负SP。以上结果表明,客体型者比空间型者对不相似客体视觉工作记忆加工具有优势,其潜在机制可能在于,客体型者对不相似客体视觉工作记忆表征时的神经活动效能更高。     

客体相似性对不同认知方式个体视觉工作记忆表征的影响

采用整体检测的变化察觉范式,探讨客体的相似性对客体—空间型认知方式个体视觉工作记忆表征的影响。行为结果显示,在不相似客体的视觉工作记忆表征任务中,客体型者在长延时条件的成绩优于空间型者,而在相似客体的视觉工作记忆表征任务中,两者无差异;ERP结果显示,在不相似客体视觉工作记忆表征任务中,与客体型者相比,空间型者在大脑皮层诱发出更大的负SP。以上结果表明,客体型者比空间型者对不相似客体视觉工作记忆加工具有优势,其潜在机制可能在于,客体型者对不相似客体视觉工作记忆表征时的神经活动效能更高。     

Location and binding in visual working memory

Visual working memory (VWM) wa sexplored separatelyfor features and for their binding. Features were better recognized when the probes retained the same binding as in the original display, but changing the locations had little effect overall. However, there were strong interactions of location with binding and with matching or new features, suggesting that, when objects are attended, features and locations are spontaneously integrated in VWM. Despite this, when the locations arechanged, features can also be accessed with little decrement, perhaps from separate feature maps. Bindings, on the other hand, are more vulnerable to location changes, suggesting that locations play a central role in the early maintenance and retrieval of bound objects as well as in their initial encoding, at least when verbal coding is prevented. The results qualify past claims about the separation of locations and objects in VWM.     

The influence of similarity on visual working memory representations

In verbal memory, similarity between items in memory often leads to interference and impaired memory performance. The present study sought to determine whether analogous interference effects would be observed in visual working memory by varying the similarity of the to-be-remembered objects in a colour change detection task. Instead of leading to interference and impaired performance, increased similarity among the items being held in memory led to improved performance. Moreover, when two similar colours were presented along with one dissimilar colour, memory performance was better for the similar colours than for the dissimilar colour. Similarity produced better performance even when the objects were presented sequentially and even when memory for the first item in the sequence was tested. These findings show that similarity does not lead to interference between representations in visual working memory. Instead, similarity may lead to improved task performance, possibly due to increased stability or precision of the memory representations during maintenance.     

Electrophysiological correlates of exemplar-specific processes in implicit and explicit memory

The present ERP study investigated the retrieval of task-irrelevant exemplar-specific information under implicit and explicit memory conditions. Subjects completed either an indirect memory test (a natural/artificial judgment) or a direct recognition memory test. Both test groups were presented with new items, identical repetitions, and perceptually different but conceptually similar exemplars of previously seen study objects. Implicit and explicit memory retrieval elicited clearly dissociable ERP components that were differentially affected by exemplar changes from study to test. In the indirect test, identical repetitions, but not different exemplars, elicited a significant ERP repetition priming effect. In contrast, both types of repeated objects gave rise to a reliable old/new effect in the direct test. The results corroborate that implicit and explicit memory fall back on distinct cognitive representation and, more importantly, indicate that these representations differ in the type of stimulus information stored. Implicit retrieval entailed obligatory access to exemplar-specific perceptual information, despite its being task irrelevant. In contrast, explicit retrieval proved to be more flexible with conceptual and perceptual information accessed according to task demands.     

Understanding age-related reductions in visual working memory capacity: Examining the stages of change detection

Visual working memory (VWM) capacity is reduced in older adults. Research has shown age-related impairments to VWM encoding, but aging is likely to affect multiple stages of VWM. In the present study, we recorded the event-related potentials (ERPs) of younger and older adults during VWM maintenance and retrieval. We measured encoding-stage processing with the P1 component, maintenance-stage processing with the contralateral delay activity (CDA), and retrieval-stage processing by comparing the activity for old and new items (old–new effect). Older adults showed lower behavioral capacity estimates (K) than did younger adults, but surprisingly, their P1 components and CDAs were comparable to those of younger adults. This remarkable dissociation between neural activity and behavior in the older adults indicated that the P1 and CDA did not accurately assess their VWM capacity. However, the neural activity evoked during VWM retrieval yielded results that helped clarify the age-related differences. During retrieval, younger adults showed early old–new effects in frontal and occipital areas and a late central–parietal old–new effect, whereas older adults showed a late right-lateralized parietal old–new effect. The younger adults’ early old–new effects strongly resembled an index of perceptual fluency, suggesting that perceptual implicit memory was activated. The activation of implicit memory could have facilitated the younger adults’ behavior, and the lack of these early effects in older adults may suggest that they have much lower-resolution memory than do younger adults. From these data, we speculated that younger and older adults store the same number of items in VWM, but that younger adults store a higher-resolution representation than do older adults.