Tuning perception: Visual working memory biases the quality of visual awareness

Studies of consciousness reveal that it is possible to manipulate subjective awareness of a visual stimulus. For example, items held in visual working memory (VWM) that match target features increase the speed with which the target reaches visual awareness. To examine the effect of VWM on perception, previous studies have mainly used coarse measures of awareness, such as present/absent or forced-choice judgments. These methods can reveal whether or not an individual has seen an item, but they do not provide information about the quality with which the item was seen. Using continuous report methods it has been shown that the fidelity of a perceived item can be affected by whether or not that item is masked. In the present study, we used an object-substitution masking task to examine whether items held in VWM would influence the quality with which a masked target reached awareness, or whether the threshold for awareness was instead affected by stimuli held in memory. We observed that targets matching the contents of VWM were recalled with greater precision compared to items that did not match the contents of VWM. Importantly, this effect occurred without affecting the likelihood of the target being perceived. These results suggest that VWM plays a greater role in modulating the fidelity of perceived representations than in lowering the overall threshold of awareness.     

The aftermath of memory retrieval for recycling visual working memory representations

We examined the aftermath of accessing and retrieving a subset of information stored in visual working memory (VWM)—namely, whether detection of a mismatch between memory and perception can impair the original memory of an item while triggering recognition-induced forgetting for the remaining, untested items. For this purpose, we devised a consecutive-change detection task wherein two successive testing probes were displayed after a single set of memory items. Across two experiments utilizing different memory-testing methods (whole vs. single probe), we observed a reliable pattern of poor performance in change detection for the second test when the first test had exhibited a color change. The impairment after a color change was evident even when the same memory item was repeatedly probed; this suggests that an attention-driven, salient visual change made it difficult to reinstate the previously remembered item. The second change detection, for memory items untested during the first change detection, was also found to be inaccurate, indicating that recognition-induced forgetting had occurred for the unprobed items in VWM. In a third experiment, we conducted a task that involved change detection plus continuous recall, wherein a memory recall task was presented after the change detection task. The analyses of the distributions of recall errors with a probabilistic mixture model revealed that the memory impairments from both visual changes and recognition-induced forgetting are explained better by the stochastic loss of memory items than by their degraded resolution. These results indicate that attention-driven visual change and recognition-induced forgetting jointly influence the “recycling” of VWM representations.     

Eye movements can cause item-specific visual recognition advantages

Prior research suggests that spontaneous saccades localized towards blank regions of space during memory storage and recall improve memory for items at the saccade locations. In the present study, we examined whether a recognition advantage can be observed when a single, exogenously directed saccade occurs during memory maintenance. We manipulated whether participants made a saccade to an item’s previous location or maintained fixation, as well as whether tested items reappeared in their original location or not. The results of three experiments showed that visual recognition was better after a saccade to the location of a probed object than after no saccade or after a saccade to the location of a non-probed object, so long as saccades went to the to-be-tested location more often than chance. Taken together, our findings demonstrate that eye movements can elicit an item-specific recognition advantage in visual working memory.     

The contents of visual working memory reduce uncertainty during visual search

Information held in visual working memory (VWM) influences the allocation of attention during visual search, with targets matching the contents of VWM receiving processing benefits over those that do not. Such an effect could arise from multiple mechanisms: First, it is possible that the contents of working memory enhance the perceptual representation of the target. Alternatively, it is possible that when a target is presented among distractor items, the contents of working memory operate postperceptually to reduce uncertainty about the location of the target. In both cases, a match between the contents of VWM and the target should lead to facilitated processing. However, each effect makes distinct predictions regarding set-size manipulations; whereas perceptual enhancement accounts predict processing benefits regardless of set size, uncertainty reduction accounts predict benefits only with set sizes larger than 1, when there is uncertainty regarding the target location. In the present study, in which briefly presented, masked targets were presented in isolation, there was a negligible effect of the information held in VWM on target discrimination. However, in displays containing multiple masked items, information held in VWM strongly affected target discrimination. These results argue that working memory representations act at a postperceptual level to reduce uncertainty during visual search.     

Orienting attention in visual working memory reduces interference from memory probes

Given a changing visual environment, and the limited capacity of visual working memory (VWM), the contents of VWM must be in constant flux. Using a change detection task, the authors show that VWM is subject to obligatory updating in the face of new information. Change detection performance is enhanced when the item that may change is retrospectively cued 1 s after memory encoding and 0.5 s before testing. The retro-cue benefit cannot be explained by memory decay or by a reduction in interference from other items held in VWM. Rather, orienting attention to a single memory item makes VWM more resistant to interference from the test probe. The authors conclude that the content of VWM is volatile unless it receives focused attention, and that the standard change detection task underestimates VWM capacity.     

视觉工作记忆对前注意阶段注意定向的调节

在注意阶段,视觉工作记忆与注意共享某些特征时,视觉工作记忆内容会引导注意定向。在前注意阶段的影响又是如何？对此问题的研究却很少见,本研究采用工作记忆与基于特征的视觉搜索相结合的任务深入探讨了此问题。研究结果发现：即使在前注意阶段,注意定向也会受到视觉工作记忆自上而下的调节。然而与注意阶段不同的是：当视觉工作记忆内容与随后视觉搜索任务的目标相关时,与记忆内容匹配的搜索项目会引导注意定向到该项目所在的位置,但只有此项目作为分心物时,才会明显地延迟对靶子的加工,而此项目作为靶子时,这种影响并不明显;当视觉工作记忆中保持的项目与随后视觉搜索任务的目标无关时,注意会忽略视觉工作记忆中保持的项目,有效地检测靶子     

Looking sharp: Becoming a search template boosts precision and stability in visual working memory

Visual working memory (VWM) plays a central role in visual cognition, and current work suggests that there is a special state in VWM for items that are the goal of visual searches. However, whether the quality of memory for target templates differs from memory for other items in VWM is currently unknown. In this study, we measured the precision and stability of memory for search templates and accessory items to determine whether search templates receive representational priority in VWM. Memory for search templates exhibited increased precision and probability of recall, whereas accessory items were remembered less often. Additionally, while memory for Templates showed benefits when instances of the Template appeared in search, this benefit was not consistently observed for Accessory items when they appeared in search. Our results show that becoming a search template can substantially affect the quality of a representation in VWM.     

不同空间构型下邻近性对视觉工作记忆中相似性效应的影响

相似性对视觉工作记忆表征的促进被称为相似性效应。以相似项目间的距离和是否插入其他项目改变邻近性,并操纵记忆项空间构型有序性,探讨邻近性对相似性效应的影响。结果发现,不同空间构型和邻近性条件下相似项目的记忆正确率高于非相似项目;在空间构型有序下,相似项目距离远时,插入其他项目时的相似性效应值低于不插入,而空间构型无序下未发现显著差异。这表明相似性促进视觉工作记忆表征,空间构型在邻近性对相似性效应的影响中起重要作用。     

Spatial attention based on 2D location and relative depth order modulates visual working memory in a 3D environment

The attentional effect on visual working memory (VWM) has been a heated research topic in the past two decades. Studies show that VWM performance for an attended memory item can be improved by cueing its two-dimensional (2D) spatial location during retention. However, few studies have investigated the effect of attentional selection on VWM in a three-dimensional setting, and it remains unknown whether depth information can produce beneficial attentional effects on 2D visual representations similar to 2D spatial information. Here we conducted four experiments, displaying memory items at various stereoscopic depth planes, and examined the retro-cue effects of four types of cues – a cue would either indicate the 2D or depth location of a memory item, and either in the form of physical (directly pointing to a location) or symbolic (numerically mapping onto a location) cues. We found that retro-cue benefits were only observed for cues directly pointing to a 2D location, whereas a null effect was observed for cues directly pointing to a depth location. However, there was a retro-cue effect when cueing the relative depth order, though the effect was weaker than that for cueing the 2D location. The selective effect on VWM based on 2D spatial attention is different from depth-based attention, and the divergence suggests that an object representation is primarily bound with its 2D spatial location, weakly bound with its depth order but not with its metric depth location. This indicates that attentional selection based on memory for depth, particularly metric depth, is ineffective.     

Searching while loaded: Visual working memory does not interfere with hybrid search efficiency but hybrid search uses working memory capacity

In “hybrid search” tasks, such as finding items on a grocery list, one must search the scene for targets while also searching the list in memory. How is the representation of a visual item compared with the representations of items in the memory set? Predominant theories would propose a role for visual working memory (VWM) either as the site of the comparison or as a conduit between visual and memory systems. In seven experiments, we loaded VWM in different ways and found little or no effect on hybrid search performance. However, the presence of a hybrid search task did reduce the measured capacity of VWM by a constant amount regardless of the size of the memory or visual sets. These data are broadly consistent with an account in which VWM must dedicate a fixed amount of its capacity to passing visual representations to long-term memory for comparison to the items in the memory set. The data cast doubt on models in which the search template resides in VWM or where memory set item representations are moved from LTM through VWM to earlier areas for comparison to visual items.     

Does visual working memory work as a few fixed slots?

The present study investigated whether visual working memory (VWM) functions as a few (about 3?～ 4) fixed slots by examining how the distribution of VWM is adjusted. Adopting a change-detection paradigm, we required subjects to memorize four items, one of which was prioritized. If VWM functions as 3?～?4 slots, allocating multiple slots to the prioritized item would leave no slot for some other items; consequently no information would be stored for them, leading to a substantial decrease in change-detection performance no matter whether small or large changes occurred. The result showed that small changes on the unfavoured items were detected less accurately, indicating that more VWM was allocated to the favoured item. Yet meanwhile large changes that occurred on those unfavoured items could still be detected as well as those on the favoured one, indicating that each of them was still stored to some extent rather than completely discarded. The results suggested that VWM may not work as 3?～?4 fixed slots. Possible mechanisms were discussed based on the present results, including a modified slot model with more available slots, a continuous resource model, and a hierarchical model that assumes storage of ensemble information in addition to the information of individual items.     

Development of visual working memory precision in childhood

Visual working memory (VWM) is the facility to hold in mind visual information for brief periods of time. Developmental studies have suggested an increase during childhood in the maximum number of complete items that can simultaneously be stored in VWM. Here, we exploit a recent theoretical and empirical innovation to investigate instead the precision with which items are stored in VWM, where precision is a continuous measure reflecting VWM resolution. Ninety boys aged 7 to 13 years completed one-item and three-item VWM tasks in which stimuli were coloured bars varying in orientation. On each trial, participants used a rotating dial to reproduce the probed stimulus from memory. Results show linear age-related improvement in recall precision for both one-item and three-item VWM tasks. However, even the youngest age group stored a significant amount of information about all three items on the difficult 3-item VWM task. Importantly, the development of VWM precision was not accounted for by development on a sensorimotor control task. Whereas storage of a single complete item was previously thought to be well within the capacity limitations of the current age range, these results suggest protracted development during childhood and early adolescence in the resolution with which single and multiple items are stored in VWM. Probabilistic modelling of response distribution data suggests that improvement in VWM performance is attributable to a specific decrease in variability of stored feature representations, rather than to a decrease in misbinding or random noise. As such, we highlight a novel, potentially developmentally plausible mechanism that may underlie developmental improvement in VWM performance, independent of any alterations in the maximum number of complete items which can be stored.     

The role of eye movements in subitizing and counting

Previous work has suggested that eye movements may be necessary for accurate enumeration beyond the subitization range of about 4 items. This study determined the frequency of eye movements normally made during enumeration, their relationship to response times, and whether they are required for accurate performance. This was achieved by monitoring eye movements and comparing performance when observers were allowed to saccade and when they were not. The results showed that (a) there was a sharp increase in saccadic frequency beyond about 4 items (from < 0.2 saccades per item to about 1 per item), and (b) enumeration of fewer than 4 items remained rapid and accurate even when eye movements were prevented, whereas enumeration beyond this became less efficient and sometimes less accurate. The results are discussed in relation to the memory and processing requirements of enumeration tasks.     

Pop-out and pop-in: Visual working memory advantages for unique items

Attentional control is thought to play a critical role in determining the amount of information that can be stored and retrieved from visual working memory (VWM). We tested whether and how task-irrelevant feature-based salience, known to affect the control of visual attention, affects VWM performance. Our results show that features of a task-irrelevant color singleton are more likely to be recalled from VWM than non-singleton items and that this increased memorability comes at a cost to the other items in the display. Furthermore, the singleton effect in VWM was negatively correlated with an individual’s baseline VWM capacity. Taken together, these results suggest that individual differences in VWM storage capacity may be partially attributable to the ability to ignore differences in task-irrelevant physical salience.     

Eye movements and visual memory: detecting changes to saccade targets in scenes

Saccade-contingent change detection provides a powerful tool for investigating scene representation and scene memory. In the present study, critical objects presented within color images of naturalistic scenes were changed during a saccade toward or away from the target. During the saccade,the critical object was changed to another object type, to a visually different token of the same object type, or was deleted from the scene. There were three main results. First, the deletion of a saccade target was special: Detection performance for saccade target deletions was very good, and this level of performance did not decline with the amplitude of the saccade. In contrast, detection of type and token changes at the saccade target, and of all changes including deletions at a location that had just been fixated but was not the saccade target, decreased as the amplitude of the saccade increased. Second, detection performance for type and token changes, both when the changing object was the target of the saccade and when the object had just been fixated but was not the saccade target, was well above chance. Third, mean gaze durations were reliably elevated for those trials in which the change was not overtly detected. The results suggest that the presence of the saccade target plays a special role in trassaccadic integration, and together with other recent findings, suggest more generally that a relatively rich scene representation is retained across saccades and stored in visual memory.     

Attention and memory protection: Interactions between retrospective attention cueing and interference

Visual working memory (VWM) and attention have a number of features in common, but despite extensive research it is still unclear how the two interact. Can focused attention improve VWM precision? Can it protect VWM from interference? Here we used a partial-report, continuous-response orientation memory task to examine how attention and interference affect different aspects of VWM and how they interact with one another. Both attention and interference were orthogonally manipulated during the retention interval. Attention was manipulated by presenting informative retro-cues, whereas interference was manipulated by introducing a secondary interfering task. Mixture-model analyses revealed that retro-cues, compared to uninformative cues, improved all aspects of performance: Attention increased recall precision and decreased guessing rate and swap-errors (reporting a wrong item in memory). Similarly, performing a secondary task impaired all aspects of the VWM task. In particular, an interaction between retro-cue and secondary task interference was found primarily for swap-errors. Together these results suggest that both the quantity and quality of VWM representations are sensitive to attention cueing and interference modulations, and they highlight the role of attention in protecting the feature–location associations needed to access the correct items in memory.     

Improving metacognitive accuracy: How failing to retrieve practice items reduces overconfidence

People often exhibit inaccurate metacognitive monitoring. For example, overconfidence occurs when people judge that they will remember more information on a future test then they actually do. The present experiments examined whether a small number of retrieval practice opportunities would improve participants’ metacognitive accuracy by reducing overconfidence. Participants studied Lithuanian–English paired associates and predicted their performance on an upcoming memory test. Then they attempted to retrieve one or more practice items (or none in the control condition) and made a second prediction. Experiment 1 showed that failing to retrieve a single practice item lead to improved subsequent performance predictions – participants became less overconfident. Experiment 2 directly manipulated retrieval failure and showed that again failure to retrieve a single practice item significantly improved subsequent predictions, relative to when participants successfully retrieved the practice item. Finally, Experiment 3 showed that additional retrieval practice opportunities reduced overconfidence and improved prediction accuracy.     

Action relevance induces an attentional weighting of representations in visual working memory

Information maintained in visual working memory (VWM) can be strategically weighted according to its task-relevance. This is typically studied by presenting cues during the maintenance interval, but under natural conditions, the importance of certain aspects of our visual environment is mostly determined by intended actions. We investigated whether representations in VWM are also weighted with respect to their potential action relevance. In a combined memory and movement task, participants memorized a number of items and performed a pointing movement during the maintenance interval. The test item in the memory task was subsequently presented either at the movement goal or at another location. We found that performance was better for test items presented at a location that corresponded to the movement goal than for test items presented at action-irrelevant locations. This effect was sensitive to the number of maintained items, suggesting that preferential maintenance of action relevant information becomes particularly important when the demand on VWM is high. We argue that weighting according to action relevance is mediated by the deployment of spatial attention to action goals, with representations spatially corresponding to the action goal benefitting from this attentional engagement. Performance was also better at locations next to the action goal than at locations farther away, indicating an attentional gradient spreading out from the action goal. We conclude that our actions continue to influence visual processing at the mnemonic level, ensuring preferential maintenance of information that is relevant for current behavioral goals.     

The mnemonic effects of recall on immediate retention

In three experiments, we investigated the mnemonic effects of an initial recall on later recall in an immediate memory setting. Recall is generally assumed to interfere with the recall of subsequent items (output interference), but previous experiments have failed to control for the confounding effects of time. In the experiments reported here, the passage of time was held constant on all trials; what varied was whether an additional item was recalled (or simply presented) during the retention interval. The results revealed clear evidence of recall's mnemonic effects, but output interference seemed strongest when the initial recall was of an item that followed the target item in the memory list. When participants initially recalled an item immediately preceding the target, target recall improved. This pattern of results places constraints on current models of immediate retention.     

视觉工作记忆负载类型对注意选择的影响

通过操纵Flanker任务相对于视觉工作记忆任务的呈现位置, 探讨在视觉工作记忆编码和保持阶段, 精度负载和容量负载对注意选择的影响。行为结果发现, Flanker任务呈现位置和视觉工作记忆负载类型影响注意选择; ERP结果发现, 在保持阶段, 当搜索目标和干扰项不一致时, 负载类型影响N2成分。研究表明, 在编码阶段, 视觉工作记忆负载主要通过占用更多知觉资源降低干扰效应, 支持知觉负载理论; 而在保持阶段, 当Flanker任务位于记忆项内部时, 两类负载在工作记忆表征过程中不同的神经活动导致投入到注意选择的认知控制资源不同, 可能是两类负载影响保持阶段注意选择的机制。