Indirect assessment of visual working memory for simple and complex objects

Previous research has shown that visual search performance is modulated by the current contents in visual working memory (VWM), even when the contents of VWM are irrelevant to the search task. For example, visual search is faster when the target--rather than a distractor--is surrounded by a shape currently held in VWM. This study uses the modulation of visual search by VWM to investigate properties of VWM. Participants wereasked to remember the color or the shape of novel polygons whose "goodness" of figure varied according to Garner's (1962) rotation and reflection transformation principle. During the memory retention interval, participants searched for a tilted line among vertical lines embedded inside colored polygons. Search was faster when the target--rather than a distractor--was enclosed by the remembered polygons. The congruity effect diminished with increasing memory load and decreasing figure goodness. We conclude that congruity effects in visual search can indirectly assess VWM representation strength.     

The change probability effect: incidental learning, adaptability, and shared visual working memory resources

Statistical properties in the visual environment can be used to improve performance on visual working memory (VWM) tasks. The current study examined the ability to incidentally learn that a change is more likely to occur to a particular feature dimension (shape, color, or location) and use this information to improve change detection performance for that dimension (the change probability effect). Participants completed a change detection task in which one change type was more probable than others. Change probability effects were found for color and shape changes, but not location changes, and intentional strategies did not improve the effect. Furthermore, the change probability effect developed and adapted to new probability information quickly. Finally, in some conditions, an improvement in change detection performance for a probable change led to an impairment in change detection for improbable changes.     

Selective working memory disables inhibition of visual features

Recent research suggests that information held in working memory can facilitate subsequent attentional processing. Here, we explore the negative corollary of this conception: Under which circumstances does information in working memory disrupt subsequent processing? Seventy participants performed visual discriminations in a dual-task paradigm. They were asked to judge colors or shapes in an online attention task under three different working-memory conditions: Same, Switch, or Unknown. In the Same condition, participants selectively maintained one visual feature in working memory, from the same dimension as in the online attention task. In the Switch condition, participants selectively maintained one visual feature in working memory, but had to focus on another visual dimension in the online attention task. In the Unknown condition, participants could not predict which visual feature would be relevant for the working-memory task. We found that irrelevant features in the online attention task were particularly difficult to ignore in the Switch condition, that is, when the irrelevant features belong to a visual dimension that is simultaneously prioritized in selective working memory. The findings are consistent with accounts in terms of neural overlap between working-memory and attention circuits, and suggest that mechanisms of selection, rather than resource limitations, critically determine the extent of visual interference.     

Tuning perception: Visual working memory biases the quality of visual awareness

Studies of consciousness reveal that it is possible to manipulate subjective awareness of a visual stimulus. For example, items held in visual working memory (VWM) that match target features increase the speed with which the target reaches visual awareness. To examine the effect of VWM on perception, previous studies have mainly used coarse measures of awareness, such as present/absent or forced-choice judgments. These methods can reveal whether or not an individual has seen an item, but they do not provide information about the quality with which the item was seen. Using continuous report methods it has been shown that the fidelity of a perceived item can be affected by whether or not that item is masked. In the present study, we used an object-substitution masking task to examine whether items held in VWM would influence the quality with which a masked target reached awareness, or whether the threshold for awareness was instead affected by stimuli held in memory. We observed that targets matching the contents of VWM were recalled with greater precision compared to items that did not match the contents of VWM. Importantly, this effect occurred without affecting the likelihood of the target being perceived. These results suggest that VWM plays a greater role in modulating the fidelity of perceived representations than in lowering the overall threshold of awareness.     

Does high memory load kick task-irrelevant information out of visual working memory?

The limited capacity of visual working memory (VWM) requires the existence of an efficient information selection mechanism. While it has been shown that under low VWM load, an irrelevant simple feature can be processed, its fate under high load (e.g., six objects) remains unclear. We explored this issue by probing the “irrelevant-change distracting effect,” in which the change of a stored irrelevant feature affects performance. Simple colored shapes were used as stimuli, with color as the target. Using a whole-probe method (presenting six objects in both the memory and test arrays), in Experiment 1 we found that a change to one of the six shapes led to a significant distracting effect. Using a partial-probe method (presenting the probe either at the screen center or at a location selected from the memory array), in Experiment 2 we showed the distracting effect again. These results suggest that irrelevant simple features can be stored into VWM, regardless of memory load.     

视觉工作记忆中基于客体的存储机制：来自ERPs的证据

该研究以简单形状和颜色构成的客体为材料,采用延迟匹配范式,通过记录事件相关电位,以反映工作记忆表征与知觉输入间冲突的N270为指标,就视觉工作记忆中的客体存储机制进行了探讨。结果发现,无关维度特征变化与目标维度特征变化均可诱发N270。该结果表明,视觉工作记忆对客体目标特征进行存储时,无关特征亦自动得到选择加工,支持基于客体的存储说。     

视觉工作记忆负载类型对注意选择的影响

通过操纵Flanker任务相对于视觉工作记忆任务的呈现位置, 探讨在视觉工作记忆编码和保持阶段, 精度负载和容量负载对注意选择的影响。行为结果发现, Flanker任务呈现位置和视觉工作记忆负载类型影响注意选择; ERP结果发现, 在保持阶段, 当搜索目标和干扰项不一致时, 负载类型影响N2成分。研究表明, 在编码阶段, 视觉工作记忆负载主要通过占用更多知觉资源降低干扰效应, 支持知觉负载理论; 而在保持阶段, 当Flanker任务位于记忆项内部时, 两类负载在工作记忆表征过程中不同的神经活动导致投入到注意选择的认知控制资源不同, 可能是两类负载影响保持阶段注意选择的机制。     

The aftermath of memory retrieval for recycling visual working memory representations

We examined the aftermath of accessing and retrieving a subset of information stored in visual working memory (VWM)—namely, whether detection of a mismatch between memory and perception can impair the original memory of an item while triggering recognition-induced forgetting for the remaining, untested items. For this purpose, we devised a consecutive-change detection task wherein two successive testing probes were displayed after a single set of memory items. Across two experiments utilizing different memory-testing methods (whole vs. single probe), we observed a reliable pattern of poor performance in change detection for the second test when the first test had exhibited a color change. The impairment after a color change was evident even when the same memory item was repeatedly probed; this suggests that an attention-driven, salient visual change made it difficult to reinstate the previously remembered item. The second change detection, for memory items untested during the first change detection, was also found to be inaccurate, indicating that recognition-induced forgetting had occurred for the unprobed items in VWM. In a third experiment, we conducted a task that involved change detection plus continuous recall, wherein a memory recall task was presented after the change detection task. The analyses of the distributions of recall errors with a probabilistic mixture model revealed that the memory impairments from both visual changes and recognition-induced forgetting are explained better by the stochastic loss of memory items than by their degraded resolution. These results indicate that attention-driven visual change and recognition-induced forgetting jointly influence the “recycling” of VWM representations.     

Encoding strategies in self-initiated visual working memory

During a typical day, visual working memory (VWM) is recruited to temporarily maintain visual information. Although individuals often memorize external visual information provided to them, on many other occasions they memorize information they have constructed themselves. The latter aspect of memory, which we term self-initiated WM, is prevalent in everyday behavior but has largely been overlooked in the research literature. In the present study we employed a modified change detection task in which participants constructed the displays they memorized, by selecting three or four abstract shapes or real-world objects and placing them at three or four locations in a circular display of eight locations. Half of the trials included identical targets that participants could select. The results demonstrated consistent strategies across participants. To enhance memory performance, participants reported selecting abstract shapes they could verbalize, but they preferred real-world objects with distinct visual features. Furthermore, participants constructed structured memory displays, most frequently based on the Gestalt organization cue of symmetry, and to a lesser extent on cues of proximity and similarity. When identical items were selected, participants mostly placed them in close proximity, demonstrating the construction of configurations based on the interaction between several Gestalt cues. The present results are consistent with recent findings in VWM, showing that memory for visual displays based on Gestalt organization cues can benefit VWM, suggesting that individuals have access to metacognitive knowledge on the benefit of structure in VWM. More generally, this study demonstrates how individuals interact with the world by actively structuring their surroundings to enhance performance.     

Attention and memory protection: Interactions between retrospective attention cueing and interference

Visual working memory (VWM) and attention have a number of features in common, but despite extensive research it is still unclear how the two interact. Can focused attention improve VWM precision? Can it protect VWM from interference? Here we used a partial-report, continuous-response orientation memory task to examine how attention and interference affect different aspects of VWM and how they interact with one another. Both attention and interference were orthogonally manipulated during the retention interval. Attention was manipulated by presenting informative retro-cues, whereas interference was manipulated by introducing a secondary interfering task. Mixture-model analyses revealed that retro-cues, compared to uninformative cues, improved all aspects of performance: Attention increased recall precision and decreased guessing rate and swap-errors (reporting a wrong item in memory). Similarly, performing a secondary task impaired all aspects of the VWM task. In particular, an interaction between retro-cue and secondary task interference was found primarily for swap-errors. Together these results suggest that both the quantity and quality of VWM representations are sensitive to attention cueing and interference modulations, and they highlight the role of attention in protecting the feature–location associations needed to access the correct items in memory.     

视觉客体工作记忆中图形特征存储与捆绑时程

采用单探测变化检测范式,考察了形状和颜色客体在工作记忆中的表征方式、特征检测类型及初始刺激呈现时间对工作记忆表征的影响。结果表明:(1)视觉客体工作记忆的表征包括两个水平,首先是对客体的特征进行加工存储,其次才是对特征的捆绑;(2)不同特征的加工时间不同,颜色的加工完成的较早,记忆效果好,而形状的加工完成的较晚,记忆效果也差,表现出颜色的子系统优势;(3)特征的捆绑不是必需的,只有在任务需要时才进行,并且捆绑的过程符合特征捆绑的双阶段理论。     

Asymmetrical access to color and location in visual working memory

Models of visual working memory (VWM) have benefitted greatly from the use of the delayed-matching paradigm. However, in this task, the ability to recall a probed feature is confounded with the ability to maintain the proper binding between the feature that is to be reported and the feature (typically location) that is used to cue a particular item for report. Given that location is typically used as a cue-feature, we used the delayed-estimation paradigm to compare memory for location to memory for color, rotating which feature was used as a cue and which was reported. Our results revealed several novel findings: 1) the likelihood of reporting a probed object’s feature was superior when reporting location with a color cue than when reporting color with a location cue; 2) location report errors were composed entirely of swap errors, with little to no random location reports; and 3) both colour and location reports greatly benefitted from the presence of nonprobed items at test. This last finding suggests that it is uncertainty over the bindings between locations and colors at memory retrieval that drive swap errors, not at encoding. We interpret our findings as consistent with a representational architecture that nests remembered object features within remembered locations.     

Feature binding in visual short-term memory is unaffected by task-irrelevant changes of location,shape, and color

Three experiments used a change detection paradigm across a range of study–test intervals to address the respective contributions of location, shape, and color to the formation of bindings of features in sensory memory and visual short-term memory (VSTM). In Experiment 1, location was designated task irrelevant and was randomized between study and test displays. The task was to detect changes in the bindings between shape and color. In Experiments 2 and 3, shape and color, respectively, were task irrelevant and randomized, with bindings tested between location and color (Experiment 2) and location and shape (Experiment 3). At shorter study–test intervals, randomizing location was most disruptive, followed by shape and then color. At longer intervals, randomizing any task-irrelevant feature had no impact on change detection for bindings between features, and location had no special role. Results suggest that location is crucial for initial perceptual binding but loses that special status once representations are formed in VSTM, which operates according to different principles, than do visual attention and perception.     

No evidence for binding of items to task-irrelevant backgrounds in visual working memory

When representing visual features such as color and shape in visual working memory (VWM), participants also represent the locations of those features as a spatial configuration of the locations of those features in the display. In everyday life, we encounter objects against some background, yet it is unclear whether the configural representation in memory obligatorily constitutes the entire display, including that (often task-irrelevant) background information. In three experiments, participants completed a change detection task on color and shape; the memoranda were presented in front of uniform gray backgrounds, a textured background (Exp. 1), or a background containing location placeholders (Exps. 2 and 3). When whole-display probes were presented, changes to the objects’ locations or feature bindings impacted memory performance—implying that the spatial configuration of the probes influenced participants’ change decisions. Furthermore, when only a single item was probed, the effect of changing its location or feature bindings was either diminished or completely extinguished, implying that single probes do not necessarily elicit the entire spatial configuration. Critically, when task-irrelevant backgrounds were also presented that may have provided a spatial configuration for the single probes, the effect of location or bindings was not moderated. These findings suggest that although the spatial configuration of a display guides VWM-based recognition, this information does not necessarily always influence the decision process during change detection.     

The role of top-down suppression in mitigating the disruptive effects of task-irrelevant feature changes in visual working memory

Studies of change detection have shown that changing the task-irrelevant features of remembered objects impairs change detection for task-relevant features, a phenomenon known as the irrelevant change effect. Although this effect is pronounced at short study-test intervals, it is eliminated at longer delays. This has prompted the proposal that although all features of attended objects are initially stored together in visual working memory (VWM), top-down control can be used to suppress task-irrelevant features over time. The present study reports the results of three experiments aimed at testing the top-down suppression hypothesis. Experiments 1 and 2 tested whether the magnitude or time course of the irrelevant change effect was affected by the concurrent performance of a demanding executive load task (counting backwards by threes). Contrary to the top-down suppression view, the decreased availability of executive resources did not prolong the duration of the irrelevant change effect in either experiment, as would be expected if these resources were necessary to actively suppress task-irrelevant features. Experiment 3 showed that a visual pattern mask eliminates the irrelevant change effect and suggests that the source of the effect may lie in the use a high-resolution, sensory memory representation to match the memory and test displays when no task-irrelevant feature changes are present. These results suggest that the dissipation of the irrelevant change effect over time likely does not depend on the use of top-down control and raises questions about what can be inferred about the nature of storage in VWM from studies of this effect.     

The privileged role of location in visual working memory

Reports have conflicted about the possible special role of location in visual working memory (WM). One important question is: Do we maintain the locations of objects in WM even when they are irrelevant to the task at hand? Here we used a continuous response scale to study the types of reporting errors that participants make when objects are presented at the same or at different locations in space. When several objects successively shared the same location, participants exhibited a higher tendency to report features of the wrong object in memory; that is, they responded with features that belonged to objects retained in memory but not probed at retrieval. On the other hand, a similar effect was not observed when objects shared a nonspatial feature, such as color. Furthermore, the effect of location on reporting errors was present even when its manipulation was orthogonal to the task at hand. These findings are consistent with the view that binding together different nonspatial features of an object in memory might be mediated through an object’s location. Hence, spatial location may have a privileged role in WM. The relevance of these findings to conceptual models, as well as to neural accounts of visual WM, is discussed.     

空间距离对视觉工作记忆巩固的影响

以往研究发现,个体对不同类型的视觉信息进行视觉工作记忆巩固的模式存在差异,如对于方向信息,一次只能有一个项目被巩固进入视觉工作记忆系统,而对于颜色信息,个体则可以一次巩固两个项目进入视觉工作记忆系统。但对于视觉信息的巩固模式是否会受其他因素的影响,目前仍然没有明确的定论。本研究将探讨视觉信息的巩固模式是否可能受到记忆项目空间距离因素的影响。研究采用变化觉察范式、序列-同时呈现操作及控制记忆项目呈现间距的方法,通过3个实验考察记忆项目之间的空间距离是否能够影响个体对颜色信息和方向信息的巩固模式。在三种空间距离水平上序列呈现或同时呈现两个记忆项目,实验结果一致发现记忆项目之间的空间距离会对视觉工作记忆巩固模式产生明显影响,个体在同时呈现条件下的正确率会随着空间距离的增大而降低。这些结果表明对同一类视觉信息进行巩固的过程中所存在的项目数量限制并不是固定的,个体可以采用序列模式或有限容量的并行模式对同一类信息进行巩固,巩固的模式可能与视觉空间注意的分配以及视觉信息所能获得的注意资源有关。     

Repetition priming in visual search: Episodic retrieval,not feature priming

Previous research has shown that when the targets of successive visual searches have features in common, response times are shorter. However, the nature of the representation underlying this priming and how priming is affected by the task remain uncertain. In four experiments, subjects searched for an odd-sized target and reported its orientation. The color of the items was irrelevant to the task. When target size was repeated from the previous trial, repetition of target color speeded the response. However, when target size was different from that in the previous trial, repetition of target color slowed responses, rather than speeding them. Our results suggest that these priming phenomena reflect the same automatic mechanism as the priming of pop-out reported by Maljkovic and Nakayama (1994). However, the crossover interaction between repetition of one feature and another rules out Maljkovic and Nakayama's (1994) theory of independent potentiation of distinct feature representations. Instead, we suggest that the priming pattern results from contact with an episodic memory representation of the previous trial.     

Working memory can compare two visual items without accessing visual consciousness

Recent studies argued that unconscious visual information could access the working memory, however, it is still unclear whether the central executive could be activated unconsciously. We investigated, using a delayed match-to-sample task, whether the central executive is an unconscious process. In the experiment of the present study, participants were asked to compare the locations of two given visual targets. Both targets (or one of the two targets, depending on the experimental condition) were masked by a visual masking paradigm. The results showed an above-chance-level performance even in the condition that participants compared two unconscious targets. However, when the trials with the non-visual conscious experience of the target were removed from the analysis, the performance was no longer significantly different from chance level. Our results suggest that the central executive could be activated unconsciously by some level of stimulus signal, that is still below the threshold for a subjective report.     

Attention shifts or volatile representations: What causes binding deficits in visual working memory?

The current study tested two hypotheses of feature binding memory: The attention hypothesis, which suggests that attention is needed to maintain feature bindings in visual working memory (VWM) and the volatile representation hypothesis, which suggests that feature bindings in memory are volatile and easily overwritten, but do not require sustained attention. Experiment 1 tested the attention hypothesis by measuring shifts of overt attention during the study array of a change detection task; serial shifts of attention did not disrupt feature bindings. Experiments 2 and 3 encouraged encoding of more volatile (Experiment 2) or durable (Experiment 3) representations during the study array. Binding change detection performance was impaired in Experiment 2, but not in Experiment 3, suggesting that binding performance is impaired when encoding supports a less durable memory representation. Together, these results suggest that although feature bindings may be volatile and easily overwritten, attention is not required to maintain feature bindings in VWM.