Visual–spatial attention aids the maintenance of object representations in visual working memory

Theories have proposed that the maintenance of object representations in visual working memory is aided by a spatial rehearsal mechanism. In this study, we used two different approaches to test the hypothesis that overt and covert visual–spatial attention mechanisms contribute to the maintenance of object representations in visual working memory. First, we tracked observers’ eye movements while they remembered a variable number of objects during change-detection tasks. We observed that during the blank retention interval, participants spontaneously shifted gaze to the locations that the objects had occupied in the memory array. Next, we hypothesized that if attention mechanisms contribute to the maintenance of object representations, then drawing attention away from the object locations during the retention interval should impair object memory during these change-detection tasks. Supporting this prediction, we found that attending to the fixation point in anticipation of a brief probe stimulus during the retention interval reduced change-detection accuracy, even on the trials in which no probe occurred. These findings support models of working memory in which visual–spatial selection mechanisms contribute to the maintenance of object representations.     

Strategic and automatic effects of visual working memory on attention in visual search

Previous research indicates that visual attention can be automatically captured by sensory inputs that match the contents of visual working memory. However, Woodman and Luck (2007) showed that information in working memory can be used flexibly as a template for either selection or rejection according to task demands. We report two experiments that extend their work. Participants performed a visual search task while maintaining items in visual working memory. Memory items were presented for either a short or long exposure duration immediately prior to the search task. Memory was tested by a change-detection task immediately afterwards. On a random half of trials items in memory matched either one distractor in the search task (Experiment 1) or three (Experiment 2). The main result was that matching distractors speeded or slowed target detection depending on whether memory items were presented for a long or short duration. These effects were more in evidence with three matching distractors than one. We conclude that the influence of visual working memory on visual search is indeed flexible but is not solely a function of task demands. Our results suggest that attentional capture by perceptual inputs matching information in visual working memory involves a fast automatic process that can be overridden by a slower top-down process of attentional avoidance.     

不同注意对视觉工作记忆外部特征绑定的影响

采用变化觉察范式,在工作记忆保持阶段插入客体特征辨别或视觉搜索次任务,探讨基于客体的注意和基于空间的注意对视觉工作记忆外部特征绑定表征的影响。结果发现,与单特征相比,两类次任务均对外部特征绑定的记忆成绩损耗更大。这表明视觉工作记忆中外部特征绑定的表征比单特征消耗更多基于客体的注意和更多基于空间的注意。     

Working memory consolidation is abnormally slow in schizophrenia

This study reports evidence that patients with schizophrenia demonstrate a slowing of working memory (WM) consolidation, which is the process of transforming transient perceptual representations into durable WM representations. Sixteen schizophrenia patients and 16 healthy control participants performed a task measuring the visual WM consolidation rate in a change-detection paradigm. A target display containing 3 colored squares was followed by a variable delay of 17-483 ms, a pattern mask, and then a test stimulus. This pattern mask does not interfere with perception but disrupts WM consolidation. Control participants reached no-mask performance by 250 ms, indicating completed WM consolidation, whereas patients failed to reach no-mask performance by 483 ms. Slowed consolidation may play an important and largely unrecognized role in schizophrenia.     

工作记忆表征的激活与抑制状态对注意引导效应的影响

本研究采用双任务范式, 通过定向遗忘任务操纵工作记忆表征状态, 分别在目标无关和目标相关条件下考察工作记忆激活与抑制状态对视觉搜索早期注意引导效应的影响。实验1与实验2发现当工作记忆表征只可能与视觉搜索分心物匹配时(目标无关条件), 处于激活状态的工作记忆表征会引导视觉注意偏向到与之匹配的分心物, 表现出注意引导效应, 而处于抑制状态的工作记忆表征则没有观察到注意引导效应。实验3与实验4发现, 当工作记忆表征有可能与视觉搜索目标匹配时(目标相关条件), 处于激活状态的工作记忆表征能捕获注意, 而处于抑制状态的工作记忆表征只有与视觉搜索目标匹配时, 才表现出对该搜索目标反应的延迟。这些研究的结果表明(1)处于激活状态的工作记忆表征能有效地引导注意偏向到与之匹配的搜索目标或分心物, 并且这种注意引导效应并未受到抑制动机的影响而被消除或反转; (2)处于抑制状态的工作记忆表征能将抑制状态传递到视觉搜索阶段, 并延迟对与之匹配的搜索目标的反应。     

Response-time evidence for mixed memory states in a sequential-presentation change-detection task

Response-time (RT) and choice-probability data were obtained in a rapid visual sequential-presentation change-detection task in which memory set size, study-test lag, and objective change probabilities were manipulated. False “change” judgments increased dramatically with increasing lag, consistent with the idea that study items with long lags were ejected from a discrete-slots buffer. Error RTs were nearly invariant with set size and lag, consistent with the idea that the errors were produced by a stimulus-independent guessing process. The patterns of error and RT data could not be explained in terms of encoding limitations, but were consistent with the hypothesis that long retention lags produced a zero-stimulus-information state that required guessing. Formal modeling of the change-detection RT and error data pointed toward a hybrid model of visual working memory. The hybrid model assumed mixed states involving a combination of memory and guessing, but with higher memory resolution for items with shorter retention lags. The work raises new questions concerning the nature of the memory representations that are produced across the closely related tasks of change detection and visual memory search.     

工作记忆表征引导视觉注意选择的眼动研究

工作记忆表征能否引导视觉注意选择？目前实验结果尚不一致。有研究者认为能否观察到注意引导效应取决于视觉搜索类型。研究采用工作记忆任务与视觉搜索任务相结合的双任务范式, 结合眼动追踪技术, 对不同视觉搜索类型下的注意引导效应进行验证。实验1结果发现, 不管视觉搜索任务的靶子是否变化, 在早期的眼动指标上都发现了显著的注意引导效应, 但注意引导效应在靶子固定的视觉搜索任务下表现得更强。实验2在平衡两种视觉搜索任务中的工作记忆负载后发现, 两种视觉搜索任务下都出现了显著的注意引导效应, 但没有发现实验1中所出现的任务间差异。实验结果否定了视觉搜索类型对注意引导效应的决定性影响, 同时也提示工作记忆负载可能在注意引导效应中起重要作用。     

Voluntary and automatic attentional control of visual working memory

Previous studies of attention-directing cues have focused largely on the effects of cuing on perceptual processes, but cuing may also influence the transfer of perceptual representations into visual working memory. In the present study, we examined this potential role of cues, using both predictive and nonpredictive cues in the context of a visual working memory task. Each trial began with a cue, followed by an array of six colored squares, a delay interval, and then a probe square presented at the location of one of the squares in the previous array. The subjects were required to indicate whether the color of the probe square was the same as the color of the square that had previously been presented at the same location. Performance on this working memory task was more accurate when the cued location was probed than when an uncued location was probed, even when the cued location was no more likely to be probed than any of the uncued locations. An additional experiment using the abrupt-onset paradigm of Yantis and Jonides (1984) yielded similar results. Thus, visual transients may automatically influence the transfer of perceptual representations into visual working memory.     

Voluntazy and automatic attentional control of visual working memory

Previous studies of attention-directing cues have focused largely on the effects of cuing on perceptual processes, but cuing may also influence the transfer of perceptual representations into visual working memory. In the present study, we examined this potential role of cues, using both predictive and non-predictive cues in the context of a visual working memory task. Each trial began with a cue, followed by an array of six colored squares, a delay interval, and then a probe square presented at th e location of one of the squares in the previous array. The subjects were required to indicate whether the color of the probe square was the same as the color of the square that had previously been presented at the same location. Performance on this working memory task was more accurate when the cued location was probed than when an uncued location was probed, even when the cued location was no more likely to be probed than any of the uncued locations. An additional experiment using the abrupt-onset paradigm of Yantis and Jonides (1984) yielded similar results. Thus, visual transients may automatically influence the transfer of perceptual representations into visual working memory.     

无关工作记忆表征的负性情绪信息能否捕获视觉注意?一项眼动研究

研究通过分析视觉搜索任务的首次注视点和行为反应时, 探讨无关工作记忆表征的负性情绪信息对视觉注意选择的影响。实验1发现在反映早期注意选择的首次注视点百分率指标上, 不管工作记忆表征的情绪效价如何, 均出现了显著的注意捕获效应; 实验2发现当采用中性情绪靶子刺激时, 首次注视点百分率指标上仍表现出了稳健的注意捕获效应; 在首次注视点持续时间指标上, 实验1和实验2均发现记忆匹配条件的干扰刺激显著小于控制条件的干扰刺激, 表现出注意的快速脱离; 而在行为反应时指标上, 早期的注意捕获效应消失(实验1), 甚至被反转为注意抑制效应(实验2)。这些结果表明在早期注意选择阶段, 记忆驱动的注意捕获效应不受工作记忆表征情绪效价的影响, 但认知控制会在早期注意捕获之后促使注意快速脱离记忆匹配的干扰刺激, 其作用效果受靶子刺激情绪效价的调节。     

The role of attention in the maintenance of feature bindings in visual short-term memory

This study examined the role of attention in maintaining feature bindings in visual short-term memory. In a change-detection paradigm, participants attempted to detect changes in the colors and orientations of multiple objects; the changes consisted of new feature values in a feature-memory condition and changes in how existing feature values were combined in a binding-memory condition. In the critical experiment, a demanding visual search task requiring sequential shifts of spatial attention was interposed during the delay interval of the change-detection task. If attention is more important for the maintenance of feature bindings than for the maintenance of unbound feature values, the attention-requiring search task should specifically disrupt performance in the binding-memory task. Contrary to this proposal, it was found that memory for bindings and memory for features were equally impaired by the search task.     

Concurrent guidance of attention by multiple working memory items: Behavioral and computational evidence

During visual search, task-relevant representations in visual working memory (VWM), known as attentional templates, are assumed to guide attention. A current debate concerns whether only one (Single-Item-Template hypothesis; SIT) or multiple (Multiple-Item-Template hypothesis; MIT) items can serve as attentional templates simultaneously. The current study was designed to test these two hypotheses. Participants memorized two colors, prior to a visual-search task in which the target and the distractor could match or not match the colors held in VWM. Robust attentional guidance was observed when one of the memory colors was presented as the target (reduced response times (RTs) on target-match trials) or the distractor (increased RTs on distractor-match trials). We constructed two drift-diffusion models that implemented the MIT and SIT hypotheses, which are similar in their predictions about overall RTs, but differ in their predictions about RTs on individual trials. Critically, simulated RT distributions and error rates revealed a better match of the MIT hypothesis to the observed data than the SIT hypothesis. Taken together, our findings provide behavioral and computational evidence for the concurrent guidance of attention by multiple items in VWM.

     

Familiarity enhances visual working memory for faces

Although it is intuitive that familiarity with complex visual objects should aid their preservation in visual working memory (WM), empirical evidence for this is lacking. This study used a conventional change-detection procedure to assess visual WM for unfamiliar and famous faces in healthy adults. Across experiments, faces were upright or inverted and a low- or high-load concurrent verbal WM task was administered to suppress contribution from verbal WM. Even with a high verbal memory load, visual WM performance was significantly better and capacity estimated as significantly greater for famous versus unfamiliar faces. Face inversion abolished this effect. Thus, neither strategic, explicit support from verbal WM nor low-level feature processing easily accounts for the observed benefit of high familiarity for visual WM. These results demonstrate that storage of items in visual WM can be enhanced if robust visual representations of them already exist in long-term memory.     

Searching while loaded: Visual working memory does not interfere with hybrid search efficiency but hybrid search uses working memory capacity

In “hybrid search” tasks, such as finding items on a grocery list, one must search the scene for targets while also searching the list in memory. How is the representation of a visual item compared with the representations of items in the memory set? Predominant theories would propose a role for visual working memory (VWM) either as the site of the comparison or as a conduit between visual and memory systems. In seven experiments, we loaded VWM in different ways and found little or no effect on hybrid search performance. However, the presence of a hybrid search task did reduce the measured capacity of VWM by a constant amount regardless of the size of the memory or visual sets. These data are broadly consistent with an account in which VWM must dedicate a fixed amount of its capacity to passing visual representations to long-term memory for comparison to the items in the memory set. The data cast doubt on models in which the search template resides in VWM or where memory set item representations are moved from LTM through VWM to earlier areas for comparison to visual items.     

Working memory capacity predicts search accuracy for novel as well as repeated targets

Visual search behaviour is guided by mental representations of targets that direct attention toward relevant features in the environment. Electrophysiological data suggests these target templates are maintained by visual working memory during search for novel targets and rapidly transfer to long term memory with target repetition. If this account is correct, an individual’s working memory capacity should be more predictive of search performance for novel targets than repeated targets. Across six experiments, we tested this hypothesis using both single (Experiments 5 and 6) and multiple (Experiments 1–4) target search tasks with three different types of stimuli (real world objects, letters, and triple conjunction shapes). Each target set was repeated for six consecutive trials. In addition, we estimated visual working memory capacity using a change detection working memory task. Overall, working memory capacity did not predict response time or efficiency in the visual search task. However, working memory capacity was equally predictive of search accuracy for both novel and repeated targets. These results suggest that working memory requirements do not substantially differ between novel and repeated target search, and working memory capacity may continue to play an important role in the encoding or maintenance of target representations after they are presumed to be in long term memory.     

Attention is required for maintenance of feature binding in visual working memory

Working memory and attention are intimately connected. However, understanding the relationship between the two is challenging. Currently, there is an important controversy about whether objects in working memory are maintained automatically or require resources that are also deployed for visual or auditory attention. Here we investigated the effects of loading attention resources on precision of visual working memory, specifically on correct maintenance of feature-bound objects, using a dual-task paradigm. Participants were presented with a memory array and were asked to remember either direction of motion of random dot kinematograms of different colour, or orientation of coloured bars. During the maintenance period, they performed a secondary visual or auditory task, with varying levels of load. Following a retention period, they adjusted a coloured probe to match either the motion direction or orientation of stimuli with the same colour in the memory array. This allowed us to examine the effects of an attention-demanding task performed during maintenance on precision of recall on the concurrent working memory task. Systematic increase in attention load during maintenance resulted in a significant decrease in overall working memory performance. Changes in overall performance were specifically accompanied by an increase in feature misbinding errors: erroneous reporting of nontarget motion or orientation. Thus in trials where attention resources were taxed, participants were more likely to respond with nontarget values rather than simply making random responses. Our findings suggest that resources used during attention-demanding visual or auditory tasks also contribute to maintaining feature-bound representations in visual working memory—but not necessarily other aspects of working memory.     

The time course of consolidation in visual working memory

How long does it take to form a durable representation in visual working memory? Several theorists have proposed that this consolidation process is very slow. Here, we measured the time course of consolidation. Observers performed a change-detection task for colored squares, and shortly after the presentation of the first array, pattern masks were presented at the locations of each of the colored squares to disrupt representations that had not yet been consolidated. Performance on the memory task was impaired when the delay between the colored squares and the masks was short, and this effect became larger when the number of colored squares was increased. The rate of consolidation was approximately 50 ms per item, which is considerably faster than previous proposals.     

Effects of facial expressions on visual short-term memory in relation to alexithymia traits

We examined dysfunctional memory processing of facial expressions in relation to alexithymia. Individuals with high and low alexithymia, as measured by the Toronto Alexithymia Scale (TAS-20), participated in a visual search task (Experiment 1A) and a change-detection task (Experiments 1B and 2), to assess differences in their visual short-term memory (VSTM). In the visual search task, the participants were asked to judge whether all facial expressions (angry and happy faces) in the search display were the same or different. In the change-detection task, they had to decide whether all facial expressions changed between successive two displays. We found individual differences only in the change-detection task. Individuals with high alexithymia showed lower sensitivity for the happy faces compared to the angry faces, while individuals with low alexithymia showed sufficient recognition for both facial expressions. Experiment 2 examined whether individual differences were observed during early storage or later retrieval stage of the VSTM process using a single-probe paradigm. We found no effect of single-probe, indicating that individual differences occurred at the storage stage. The present results provide new evidence that individuals with high alexithymia show specific impairment in VSTM processes (especially the storage stage) related to happy but not to angry faces.     

Cognitive Control of Attentional Guidance by Visual and Verbal Working Memory Representations

Both visual and verbal information in working memory guide visual attention toward a memory‐matching object. We tested whether: (a) visual and verbal representations have different effects on the deployment of attention; and (b) both types of representations can be used equally in a top‐down manner. We asked participants to maintain a visual cue or a verbal cue at the beginning of each trial, and ended with a memory task to ensure that each cue was represented actively in working memory. Before the memory task, a visual search task appeared where validity was manipulated as valid, neutral, or invalid. We also manipulated the probability of valid trials (20%, 50%, and 80%), which had been told to the participants prior to the task. Consistent with earlier findings, attentional guidance by visual representations was modulated by the probability. We also found that this was true for verbal representations, and that these effects did not differ between representation types. These results suggest that both visual and verbal representations in working memory can be used strategically to control attentional guidance.     

The benefit of forgetting

Recent research using change-detection tasks has shown that a directed-forgetting cue, indicating that a subset of the information stored in memory can be forgotten, significantly benefits the other information stored in visual working memory. How do these directed-forgetting cues aid the memory representations that are retained? We addressed this question in the present study by using a recall paradigm to measure the nature of the retained memory representations. Our results demonstrated that a directed-forgetting cue leads to higher-fidelity representations of the remaining items and a lower probability of dropping these representations from memory. Next, we showed that this is made possible by the to-be-forgotten item being expelled from visual working memory following the cue, allowing maintenance mechanisms to be focused on only the items that remain in visual working memory. Thus, the present findings show that cues to forget benefit the remaining information in visual working memory by fundamentally improving their quality relative to conditions in which just as many items are encoded but no cue is provided.