The contents of visual working memory reduce uncertainty during visual search

Information held in visual working memory (VWM) influences the allocation of attention during visual search, with targets matching the contents of VWM receiving processing benefits over those that do not. Such an effect could arise from multiple mechanisms: First, it is possible that the contents of working memory enhance the perceptual representation of the target. Alternatively, it is possible that when a target is presented among distractor items, the contents of working memory operate postperceptually to reduce uncertainty about the location of the target. In both cases, a match between the contents of VWM and the target should lead to facilitated processing. However, each effect makes distinct predictions regarding set-size manipulations; whereas perceptual enhancement accounts predict processing benefits regardless of set size, uncertainty reduction accounts predict benefits only with set sizes larger than 1, when there is uncertainty regarding the target location. In the present study, in which briefly presented, masked targets were presented in isolation, there was a negligible effect of the information held in VWM on target discrimination. However, in displays containing multiple masked items, information held in VWM strongly affected target discrimination. These results argue that working memory representations act at a postperceptual level to reduce uncertainty during visual search.     

Memory-based attentional capture by colour and shape contents in visual working memory

Current theories assume that there is substantial overlap between visual working memory (VWM) and visual attention functioning, such that active representations in VWM automatically act as an attentional set, resulting in attentional biases towards objects that match the mnemonic content. Most evidence for this comes from visual search tasks in which a distractor similar to the memory interferes with the detection of a simultaneous target. Here we provide additional evidence using one of the most popular paradigms in the literature for demonstrating an active attentional set: The contingent spatial orienting paradigm of Folk and colleagues. This paradigm allows memory-based attentional biases to be more directly attributed to spatial orienting. Experiment 1 demonstrated a memory-contingent spatial attention effect for colour but not for shape contents of VWM. Experiment 2 tested the hypothesis that the placeholders used for spatial cueing interfered with the shape processing, and showed that memory-based attentional capture for shape returned when placeholders were removed. The results of the present study are consistent with earlier findings from distractor interference paradigms, and provide additional evidence that biases in spatial orienting contribute to memory-based influences on attention.     

Looking sharp: Becoming a search template boosts precision and stability in visual working memory

Visual working memory (VWM) plays a central role in visual cognition, and current work suggests that there is a special state in VWM for items that are the goal of visual searches. However, whether the quality of memory for target templates differs from memory for other items in VWM is currently unknown. In this study, we measured the precision and stability of memory for search templates and accessory items to determine whether search templates receive representational priority in VWM. Memory for search templates exhibited increased precision and probability of recall, whereas accessory items were remembered less often. Additionally, while memory for Templates showed benefits when instances of the Template appeared in search, this benefit was not consistently observed for Accessory items when they appeared in search. Our results show that becoming a search template can substantially affect the quality of a representation in VWM.     

视觉工作记忆对前注意阶段注意定向的调节

在注意阶段,视觉工作记忆与注意共享某些特征时,视觉工作记忆内容会引导注意定向。在前注意阶段的影响又是如何？对此问题的研究却很少见,本研究采用工作记忆与基于特征的视觉搜索相结合的任务深入探讨了此问题。研究结果发现：即使在前注意阶段,注意定向也会受到视觉工作记忆自上而下的调节。然而与注意阶段不同的是：当视觉工作记忆内容与随后视觉搜索任务的目标相关时,与记忆内容匹配的搜索项目会引导注意定向到该项目所在的位置,但只有此项目作为分心物时,才会明显地延迟对靶子的加工,而此项目作为靶子时,这种影响并不明显;当视觉工作记忆中保持的项目与随后视觉搜索任务的目标无关时,注意会忽略视觉工作记忆中保持的项目,有效地检测靶子     

客体复杂度影响工作记忆可存储的客体数目

采用变化觉察范式,以对侧延迟活动（contralateral delay activity,CDA）的幅值为指标,通过操纵记忆刺激的复杂程度,对视觉工作记忆中可存储的客体数目（即工作记忆容量）问题进行了探讨。结果表明,2个复杂客体条件下的CDA幅值与4个复杂客体条件无显著差异,而4个简单客体条件的CDA幅值显著高于2个简单客体条件,即CDA的幅值受客体复杂度的调节。基于该结果推论：并非视觉工作记忆总能存储4个客体,其可存储的客体数目受客体复杂度影响。     

Visual working memory for simple and complex visual stimuli

Does the magical number four characterize our visual working memory (VWM) capacity for all kinds of objects, or is the capacity of VWM inversely related to the perceptual complexity of those objects? To find out how perceptual complexity affects VWM, we used a change detection task to measure VWM capacity for six types of stimuli of different complexity: colors, letters, polygons, squiggles, cubes, and faces. We found that the estimated capacity decreased for more complex stimuli, suggesting that perceptual complexity was an important factor in determining VWM capacity. However, the considerable correlation between perceptual complexity and VWM capacity declined significantly if subjects were allowed to view the sample memory display longer. We conclude that when encoding limitations are minimized, perceptual complexity affects, but does not determine, VWM capacity.     

Orienting attention in visual working memory reduces interference from memory probes

Given a changing visual environment, and the limited capacity of visual working memory (VWM), the contents of VWM must be in constant flux. Using a change detection task, the authors show that VWM is subject to obligatory updating in the face of new information. Change detection performance is enhanced when the item that may change is retrospectively cued 1 s after memory encoding and 0.5 s before testing. The retro-cue benefit cannot be explained by memory decay or by a reduction in interference from other items held in VWM. Rather, orienting attention to a single memory item makes VWM more resistant to interference from the test probe. The authors conclude that the content of VWM is volatile unless it receives focused attention, and that the standard change detection task underestimates VWM capacity.     

Searching while loaded: Visual working memory does not interfere with hybrid search efficiency but hybrid search uses working memory capacity

In “hybrid search” tasks, such as finding items on a grocery list, one must search the scene for targets while also searching the list in memory. How is the representation of a visual item compared with the representations of items in the memory set? Predominant theories would propose a role for visual working memory (VWM) either as the site of the comparison or as a conduit between visual and memory systems. In seven experiments, we loaded VWM in different ways and found little or no effect on hybrid search performance. However, the presence of a hybrid search task did reduce the measured capacity of VWM by a constant amount regardless of the size of the memory or visual sets. These data are broadly consistent with an account in which VWM must dedicate a fixed amount of its capacity to passing visual representations to long-term memory for comparison to the items in the memory set. The data cast doubt on models in which the search template resides in VWM or where memory set item representations are moved from LTM through VWM to earlier areas for comparison to visual items.     

Visual working memory supports the inhibition of previously processed information: evidence from preview search

In four experiments we assessed whether visual working memory (VWM) maintains a record of previously processed visual information, allowing old information to be inhibited, and new information to be prioritized. Specifically, we evaluated whether VWM contributes to the inhibition (i.e., visual marking) of previewed distractors in a preview search. We evaluated this proposal by testing three predictions. First, Experiments 1 and 2 demonstrate that preview inhibition is more effective when the number of previewed distractors is below VWM capacity than above; an effect that can only be observed at small preview set sizes (Experiment 2A) and when observers are allowed to move their eyes freely (Experiment 2B). Second, Experiment 3 shows that, when quantified as the number of inhibited distractors, the magnitude of the preview effect is stable across different search difficulties. Third, Experiment 4 demonstrates that individual differences in preview inhibition are correlated with individual differences in VWM capacity. These findings provide converging evidence that VWM supports the inhibition of previewed distractors. More generally, these findings demonstrate how VWM contributes to the efficiency of human visual information processing--VWM prioritizes new information by inhibiting old information from being reselected for attention.     

视觉工作记忆负载类型对注意选择的影响

通过操纵Flanker任务相对于视觉工作记忆任务的呈现位置, 探讨在视觉工作记忆编码和保持阶段, 精度负载和容量负载对注意选择的影响。行为结果发现, Flanker任务呈现位置和视觉工作记忆负载类型影响注意选择; ERP结果发现, 在保持阶段, 当搜索目标和干扰项不一致时, 负载类型影响N2成分。研究表明, 在编码阶段, 视觉工作记忆负载主要通过占用更多知觉资源降低干扰效应, 支持知觉负载理论; 而在保持阶段, 当Flanker任务位于记忆项内部时, 两类负载在工作记忆表征过程中不同的神经活动导致投入到注意选择的认知控制资源不同, 可能是两类负载影响保持阶段注意选择的机制。     

Exploring the contributions of spatial and non-spatial working memory to priming of pop-out

Priming of pop-out (PoP) refers to the facilitation of performance that occurs when a target-defining feature is repeated across consecutive trials in a pop-out oddball search task. The underlying mechanism of PoP has been poorly understood and raises important questions about how our visual system is guided by past experiences, even during bottom-up processing. Lee, Mozer, and Vecera (Attention, Perception, & Psychophysics, 71, 1059–1071, 2009) demonstrated that PoP remained unaffected by a concurrent non-spatial visual working memory (VWM) load, and they concluded that PoP occurs through feature gain modulation, essentially eliminating the contribution of memory representations in VWM to PoP. In the present study, we followed up on those results by (a) replicating the null effect of non-spatial VWM load on PoP and (b) examining the effect of spatial VWM load on PoP. The results showed that spatial VWM load does interfere with PoP, supporting the notion that spatial VWM is involved in PoP. In Experiment 2, we extended this finding by manipulating VWM load and observing its consequence on the magnitude of PoP. Increasing spatial VWM load decreased the amount of PoP observed, in a dose-dependent manner, whereas changes in non-spatial VWM load did not. Contrary to Lee et al.’s conclusions, these results suggest that VWM resources appear to contribute to the occurrence of PoP, supporting the theory that PoP is, in fact, a multilevel process in which the deployment of spatial attention, relying on VWM representations, plays an important role.     

Tuning perception: Visual working memory biases the quality of visual awareness

Studies of consciousness reveal that it is possible to manipulate subjective awareness of a visual stimulus. For example, items held in visual working memory (VWM) that match target features increase the speed with which the target reaches visual awareness. To examine the effect of VWM on perception, previous studies have mainly used coarse measures of awareness, such as present/absent or forced-choice judgments. These methods can reveal whether or not an individual has seen an item, but they do not provide information about the quality with which the item was seen. Using continuous report methods it has been shown that the fidelity of a perceived item can be affected by whether or not that item is masked. In the present study, we used an object-substitution masking task to examine whether items held in VWM would influence the quality with which a masked target reached awareness, or whether the threshold for awareness was instead affected by stimuli held in memory. We observed that targets matching the contents of VWM were recalled with greater precision compared to items that did not match the contents of VWM. Importantly, this effect occurred without affecting the likelihood of the target being perceived. These results suggest that VWM plays a greater role in modulating the fidelity of perceived representations than in lowering the overall threshold of awareness.     

How retaining objects containing multiple features in visual working memory regulates the priority for access to visual awareness

The content of visual working memory influences the access to visual awareness. Thus far, research has focused on retention of a single feature, whereas memoranda in real life typically contain multiple features. Here, we intermixed a delayed match-to-sample task to manipulate VWM content, and a breaking Continuous Flash Suppression (b-CFS) task to measure prioritization for visual awareness. Observers memorized either the color (Exp. 1), the shape (Exp. 2) or both the features (Exp. 3) of an item and indicated the location of a suppressed target. We observed that color-matching targets broke suppression faster than color-mismatching targets both when color was memory relevant or irrelevant. Shape only impacted priority for visual awareness through an interaction with color. We conclude that: (1) VWM can regulate the priority of visual information to access visual awareness along a single feature dimension; (2) different features of a memorandum vary in their potency to impact access to visual awareness, and the more dominant feature may even suppress the effect of the less dominant feature; (3) even stimuli that match an irrelevant feature dimension of the memorandum can be prioritized for visual awareness.     

Visual working memory for trained and novel polygons

This study investigates whether training changes the capacity of visual working memory (VWM). We compared change detection performance for novel and trained polygons. During training, subjects developed familiarity with 8 random polygons. Specifically, 4 polygons from a set of 8 were presented on each trial. After a brief retention interval, one of the polygons changed and subjects judged which one had changed (Exps. 1–2) or whether there was a change (Exp. 3). After 320 training trials, subjects could recognize the trained polygons with high accuracy. In the testing phase, subjects carried out the same task again, only this time each trial might contain all familiar polygons, all novel polygons, or a mixture of familiar and novel polygons. We found that change detection performance improved during training, but the improvement was not limited to trained polygons. We suggest that familiarity of non-nameable shapes plays a limited role in modulating the capacity of VWM.     

视觉搜索中基于工作记忆内容的注意捕获与抑制

注意是对有关信息的选择及对无关信息的抑制, 工作记忆是对有关信息的保持以及对无关信息的抑制, 两者在一定程度上都体现了选择性地指向与当前任务有关的刺激并同时抑制无关刺激。在系统地回顾已有研究的基础上结合新近的ERP研究, 从视觉搜索中基于工作记忆内容的注意捕获与注意抑制两个角度综述了视觉工作记忆与视觉选择性注意的相关研究。研究者们主要从两方面对该领域的问题进行了探讨：(1)视觉工作记忆内容对视觉选择性注意的导向作用; (2)视觉工作记忆内容对视觉选择性注意产生导向作用的条件。文章对以往的研究进行了总结, 指出了无论保持在视觉工作记忆的内容是捕获注意还是受到抑制, 都存在着自上而下和自下而上两种加工机制。     

Distinct capacity limits for attention and working memory: Evidence from attentive tracking and visual working memory paradigms

A hallmark of both visual attention and working memory is their severe capacity limit: People can attentively track only about four objects in a multiple object tracking (MOT) task and can hold only up to four objects in visual working memory (VWM). It has been proposed that attention underlies the capacity limit of VWM. We tested this hypothesis by determining the effect of varying the load of a MOT task performed during the retention interval of a VWM task and comparing the resulting dual-task costs with those observed when a VWM task was performed concurrently with another VWM task or with a verbal working memory task. Instead of supporting the view that the capacity limit of VWM is solely attention based, the results indicate that VWM capacity is set by the interaction of visuospatial attentional, central amodal, and local task-specific sources of processing.     

Cognitive control over working memory biases of selection

Across many studies, researchers have found that representations in working memory (WM) can guide visual attention toward items that match the features of the WM contents. While some researchers have contended that this occurs involuntarily, others have suggested that the impact of WM contents on attention can be strategically controlled. Here, we varied the probability that WM items would coincide with either targets or distractors in a visual search task to examine (1) whether participants could intentionally enhance or inhibit the influence of WM items on attention and (2) whether cognitive control over WM biases would also affect access to the memory contents in a surprise recognition test. We found visual search to be faster when the WM item coincided with the search target, and this effect was enhanced when the memory item reliably predicted the location of the target. Conversely, visual search was slowed when the memory item coincided with a search distractor, and this effect was diminished, but not abolished, when the memory item was reliably associated with distractors. This strategic dampening of the influence of WM items on attention came at a price to memory, however, as participants were slowest to perform WM recognition tests on blocks in which the WM contents were consistently invalid. These results document that attentional capture by WM contents is partly, but not fully, malleable by top-down control, which appears to adjust the state of the WM contents to optimize search behavior. These data illustrate the role of cognitive control in modulating the strength of WM biases of selection, and they support a tight coupling between WM and attention.     

The perceptual root of object-based storage: an interactive model of perception and visual working memory

Mainstream theories of visual perception assume that visual working memory (VWM) is critical for integrating online perceptual information and constructing coherent visual experiences in changing environments. Given the dynamic interaction between online perception and VWM, we propose that how visual information is processed during visual perception can directly determine how the information is going to be selected, consolidated, and maintained in VWM. We demonstrate the validity of this hypothesis by investigating what kinds of perceptual information can be stored as integrated objects in VWM. Three criteria for object-based storage are introduced: (a) automatic selection of task-irrelevant features, (b) synchronous consolidation of multiple features, and (c) stable maintenance of feature conjunctions. The results show that the outputs of parallel perception meet all three criteria, as opposed to the outputs of serial attentive processing, which fail all three criteria. These results indicate that (a) perception and VWM are not two sequential processes, but are dynamically intertwined; (b) there are dissociated mechanisms in VWM for storing information identified at different stages of perception; and (c) the integrated object representations in VWM originate from the "preattentive" or "proto" objects created by parallel perception. These results suggest how visual perception, attention, and VWM can be explained by a unified framework.     

Working memory can enhance unconscious visual perception

We demonstrate that unconscious processing of a stimulus property can be enhanced when there is a match between the contents of working memory and the stimulus presented in the visual field. Participants first held a cue (a colored circle) in working memory and then searched for a brief masked target shape presented simultaneously with a distractor shape. When participants reported having no awareness of the target shape at all, search performance was more accurate in the valid condition, where the target matched the cue in color, than in the neutral condition, where the target mismatched the cue. This effect cannot be attributed to bottom-up perceptual priming from the presentation of a memory cue, because unconscious perception was not enhanced when the cue was merely perceptually identified but not actively held in working memory. These findings suggest that reentrant feedback from the contents of working memory modulates unconscious visual perception.