Action relevance induces an attentional weighting of representations in visual working memory

Information maintained in visual working memory (VWM) can be strategically weighted according to its task-relevance. This is typically studied by presenting cues during the maintenance interval, but under natural conditions, the importance of certain aspects of our visual environment is mostly determined by intended actions. We investigated whether representations in VWM are also weighted with respect to their potential action relevance. In a combined memory and movement task, participants memorized a number of items and performed a pointing movement during the maintenance interval. The test item in the memory task was subsequently presented either at the movement goal or at another location. We found that performance was better for test items presented at a location that corresponded to the movement goal than for test items presented at action-irrelevant locations. This effect was sensitive to the number of maintained items, suggesting that preferential maintenance of action relevant information becomes particularly important when the demand on VWM is high. We argue that weighting according to action relevance is mediated by the deployment of spatial attention to action goals, with representations spatially corresponding to the action goal benefitting from this attentional engagement. Performance was also better at locations next to the action goal than at locations farther away, indicating an attentional gradient spreading out from the action goal. We conclude that our actions continue to influence visual processing at the mnemonic level, ensuring preferential maintenance of information that is relevant for current behavioral goals.     

The effects of direction similarity in visual working memory: Behavioural and event-related potential studies

Object similarity can improve visual working memory (VWM) performance in the change-detection task, but impair the recognition performance when it occurs at retrieval of VWM in the recognition task. The effect of direction similarity is an issue that has not been well resolved. Furthermore, electrophysiological evidence in support of the mechanisms that underlie the effects of similarity is still scarce. In the current study, we conducted three behavioural experiments to examine the effects of direction similarity on memory performance with regard to both the encoding and retrieval phases of VWM and one event-related potential (ERP) experiment to explore the neural signatures of direction similarity in VWM. Our behavioural studies indicated that direction similarity improved performance when it occurred at the encoding phase but impaired performance when it occurred at the retrieval phase. Moreover, the ERP experiment showed that the amplitude of the contralateral delay activity (CDA) increased with the increasing set size for similar but not dissimilar directions. In addition, the CDA amplitude for similar directions was lower than that for dissimilar directions at set size 2. Taken together, these findings suggest that direction similarity at encoding has a positive effect on VWM performance and at retrieval has a negative effect. Given that VWM capacity depends on information load and the number of objects, the positive effect of similarity may be attributed to reduced information load of memory objects.     

Spatial attention based on 2D location and relative depth order modulates visual working memory in a 3D environment

The attentional effect on visual working memory (VWM) has been a heated research topic in the past two decades. Studies show that VWM performance for an attended memory item can be improved by cueing its two-dimensional (2D) spatial location during retention. However, few studies have investigated the effect of attentional selection on VWM in a three-dimensional setting, and it remains unknown whether depth information can produce beneficial attentional effects on 2D visual representations similar to 2D spatial information. Here we conducted four experiments, displaying memory items at various stereoscopic depth planes, and examined the retro-cue effects of four types of cues – a cue would either indicate the 2D or depth location of a memory item, and either in the form of physical (directly pointing to a location) or symbolic (numerically mapping onto a location) cues. We found that retro-cue benefits were only observed for cues directly pointing to a 2D location, whereas a null effect was observed for cues directly pointing to a depth location. However, there was a retro-cue effect when cueing the relative depth order, though the effect was weaker than that for cueing the 2D location. The selective effect on VWM based on 2D spatial attention is different from depth-based attention, and the divergence suggests that an object representation is primarily bound with its 2D spatial location, weakly bound with its depth order but not with its metric depth location. This indicates that attentional selection based on memory for depth, particularly metric depth, is ineffective.     

Does maintaining bindings in visual working memory require more attention than maintaining features?

ABSTRACT

Whether more attention is required for maintaining bindings than maintaining features in visual working memory (VWM) remains an open question. If maintaining bindings in VWM does not require more attention than maintaining features, is it related to the stability of binding representations? In this study, we explored whether maintaining bindings requires more attention than maintaining features for similar and dissimilar objects by inserting a feature report task into the maintenance phase of VWM in Experiments 1 and 2. We also investigated whether the effect of similarity on the attentional requirement for maintaining bindings and features is due to the stability of VWM representations by inserting a suffix during the maintenance phase of VWM in Experiment 3. The results showed that when object-based attention was consumed, bindings were more impaired than features for dissimilar objects but not for similar objects. We also found that the bindings of similar objects were less interfered by the suffix than those of dissimilar objects. Our findings suggest that maintaining bindings does not require more attention than maintaining features when the binding representations are stable in VWM and similarity improves the stability of binding representations.     

Mechanisms of priming of pop-out: Stored representations or feature-gain modulations?

Previous research has shown that repetition of a task-relevant attention-capturing feature facilitates popout search. This priming of pop-out effect is due to some residual memory from recent trials. We explore two possible mechanisms of priming of pop-out: a top-down attentional benefit from a memory of the previous target representation that is stored in visual short-term memory (VSTM) and a bottom-up change of attentional gains from perceptual features of the previously attended target. We manipulated participants’ ability to form a memory trace in VSTM by occupying it with a distractor task and found that occupying VSTM did not interfere with priming of pop-out. We next manipulated attentional gains associated with feature values by inserting an irrelevant task between pop-out searches. We found that the color of the target from the intervening perceptual task influenced pop-out search: The current pop-out search was facilitated when the intervening task’s target matched the target color of the pop-out search. These results suggest that priming of pop-out might not be due to a memory trace of the previous targets in VSTM but, rather, might be due to changes in attentional control based on priming from relatively low-level feature representations of previously attended objects.     

Visual working memory load disrupts the space‐based attentional guidance of target selection

During visual search, the selection of target objects is guided by stored representations of target‐defining features (attentional templates). It is commonly believed that such templates are maintained in visual working memory (WM), but empirical evidence for this assumption remains inconclusive. Here, we tested whether retaining non‐spatial object features (shapes) in WM interferes with attentional target selection processes in a concurrent search task that required spatial templates for target locations. Participants memorized one shape (low WM load) or four shapes (high WM load) in a sample display during a retention period. On some trials, they matched them to a subsequent memory test display. On other trials, a search display including two lateral bars in the upper or lower visual field was presented instead, and participants reported the orientation of target bars that were defined by their location (e.g., upper left or lower right). To assess the efficiency of attentional control under low and high WM load, EEG was recorded and the N2pc was measured as a marker of attentional target selection. Target N2pc components were strongly delayed when concurrent WM load was high, indicating that holding multiple object shapes in WM competes with the simultaneous retention of spatial attentional templates for target locations. These observations provide new electrophysiological evidence that such templates are maintained in WM, and also challenge suggestions that spatial and non‐spatial contents are represented in separate independent visual WM stores.     

Electrophysiological evidence for cognitive control during conflict processing in visual spatial attention

Event-related potentials were measured to investigate the role of visual spatial attention mechanisms in conflict processing. We suggested that a more difficult target selection leads to stronger attentional top-down control, thereby reducing the effects of arising conflicts. This hypothesis was tested by varying the selection difficulty in a location negative priming (NP) paradigm. The difficult task resulted in prolonged responses as compared to the easy task. A behavioral NP effect was only evident in the easy task. Psychophysiologically the easy task was associated with reduced parietal N1, enhanced frontocentral N2 and N2pc components and a prolonged P3 latency for the conflict as compared to the control condition. The N2pc effect was also obvious in the difficult task. Additionally frontocentral N2 amplitudes increased and latencies of N2pc and P3 were delayed compared to the easy task. The differences at frontocentral and parietal electrodes are consistent with previous studies ascribing activity in the prefrontal and parietal cortex as the source of top-down attentional control. Thus, we propose that stronger cognitive control is involved in the difficult task, resulting in a reduced behavioral NP conflict.     

Reward history but not search history explains value-driven attentional capture

In past years, an extensive amount of research has focused on how past experiences guide future attention. Humans automatically attend to stimuli previously associated with reward and stimuli that have been experienced during visual search, even when it is disadvantageous in present situations. Recently, the relationship between “reward history” and “search history” has been discussed critically. We review results from research on value-driven attentional capture (VDAC) with a focus on these two experience-based attentional selection processes and their distinction. To clarify inconsistencies, we examined VDAC within a design that allows a direct comparison with other mechanisms of attentional selection. Eighty-four healthy adults were trained to incidentally associate colors with reward (10 cents, 2 cents) or with no reward. In a subsequent visual search task, distraction by reward-associated and unrewarded stimuli was contrasted. In the training phase, reward signals facilitated performance. When these value-signaling stimuli appeared as distractors in the test phase, they continuously shaped attentional selection, despite their task irrelevance. Our findings clearly cannot be attributed to a history of target search. We conclude that once an association is established, value signals guide attention automatically in new situations, which can be beneficial or not, depending on the congruency with current goals.     

视觉工作记忆中的内部注意选择：效果、特性及机制

视觉工作记忆中(VWM)已稳定存储的表征，依然会受内部注意选择的影响，说明内部注意选择对VWM发挥重要作用。本文首先阐述该领域主要的研究方法，然后对VWM中内部注意选择的效果和四个特性：时程、对象、容量和可持续性，以及其背后可能的理论机制和神经机制进行分析和总结。并据此从VWM的存储结构、内部注意的产生机制和处理方式等方面，为未来研究提出方向和建议。     

Cognitive-behavioral and electrophysiological evidence of the affective consequences of ignoring stimulus representations in working memory

Ignoring visual stimuli in the external environment leads to decreased liking of those items, a phenomenon attributed to the affective consequences of attentional inhibition. Here we investigated the generality of this “distractor devaluation” phenomenon by asking whether ignoring stimuli represented internally within visual working memory has the same affective consequences. In two experiments we presented participants with two or three visual stimuli and then, after the stimuli were no longer visible, provided an attentional cue indicating which item in memory was the target they would have to later recall, and which were task-irrelevant distractors. Participants subsequently judged how much they liked these stimuli. Previously-ignored distractors were consistently rated less favorably than targets, replicating prior findings of distractor devaluation. To gain converging evidence, in Experiment 2, we also examined the electrophysiological processes associated with devaluation by measuring individual differences in attention (N2pc) and working memory (CDA) event-related potentials following the attention cue. Larger amplitude of an N2pc-like component was associated with greater devaluation, suggesting that individuals displaying more effective selection of memory targets—an act aided by distractor inhibition—displayed greater levels of distractor devaluation. Individuals showing a larger post-cue CDA amplitude (but not pre-cue CDA amplitude) also showed greater distractor devaluation, supporting prior evidence that visual working-memory resources have a functional role in effecting devaluation. Together, these findings demonstrate that ignoring working-memory representations has affective consequences, and adds to the growing evidence that the contribution of selective-attention mechanisms to a wide range of human thoughts and behaviors leads to devaluation.     

工作记忆表征精度加工需求对注意引导的影响

采用注意捕获范式, 通过行为和事件相关脑电位(ERP)实验, 探讨工作记忆表征精度加工需求对注意引导的影响, 行为结果发现, 在低精度加工需求条件下, 只有一个工作记忆表征引导注意, 且处于高激活状态的工作记忆表征产生的注意捕获大于低激活状态; 而在高精度加工需求条件下, 有两个工作记忆表征引导注意, 且处于高、低激活状态的工作记忆表征产生的注意捕获没有差异。ERP结果显示, 高精度加工需求条件下诱发的NSW和LPC大于低精度加工需求条件; 在高精度加工需求条件下, 干扰项与记忆项匹配比不匹配时, 诱发更大的N2和更小的N2pc, 而在低精度加工需求条件下, 干扰项与记忆项匹配和不匹配时诱发的N2、N2pc没有差异。研究表明, 工作记忆表征精度加工需求影响注意引导的机制可能是高精度加工需求下, 工作记忆表征消耗的认知资源增加, 搜索目标获得的资源减少, 干扰项捕获的注意增加。     

客体复杂度影响工作记忆可存储的客体数目

采用变化觉察范式,以对侧延迟活动（contralateral delay activity,CDA）的幅值为指标,通过操纵记忆刺激的复杂程度,对视觉工作记忆中可存储的客体数目（即工作记忆容量）问题进行了探讨。结果表明,2个复杂客体条件下的CDA幅值与4个复杂客体条件无显著差异,而4个简单客体条件的CDA幅值显著高于2个简单客体条件,即CDA的幅值受客体复杂度的调节。基于该结果推论：并非视觉工作记忆总能存储4个客体,其可存储的客体数目受客体复杂度影响。     

视觉工作记忆负载类型对注意选择的影响

通过操纵Flanker任务相对于视觉工作记忆任务的呈现位置, 探讨在视觉工作记忆编码和保持阶段, 精度负载和容量负载对注意选择的影响。行为结果发现, Flanker任务呈现位置和视觉工作记忆负载类型影响注意选择; ERP结果发现, 在保持阶段, 当搜索目标和干扰项不一致时, 负载类型影响N2成分。研究表明, 在编码阶段, 视觉工作记忆负载主要通过占用更多知觉资源降低干扰效应, 支持知觉负载理论; 而在保持阶段, 当Flanker任务位于记忆项内部时, 两类负载在工作记忆表征过程中不同的神经活动导致投入到注意选择的认知控制资源不同, 可能是两类负载影响保持阶段注意选择的机制。     

What top-down task sets do for us: an ERP study on the benefits of advance preparation in visual search

When target-defining features are specified in advance, attentional target selection in visual search is controlled by preparatory top-down task sets. We used ERP measures to study voluntary target selection in the absence of such feature-specific task sets, and to compare it to selection that is guided by advance knowledge about target features. Visual search arrays contained two different color singleton digits, and participants had to select one of these as target and report its parity. Target color was either known in advance (fixed color task) or had to be selected anew on each trial (free color-choice task). ERP correlates of spatially selective attentional target selection (N2pc) and working memory processing (SPCN) demonstrated rapid target selection and efficient exclusion of color singleton distractors from focal attention and working memory in the fixed color task. In the free color-choice task, spatially selective processing also emerged rapidly, but selection efficiency was reduced, with nontarget singleton digits capturing attention and gaining access to working memory. Results demonstrate the benefits of top-down task sets: Feature-specific advance preparation accelerates target selection, rapidly resolves attentional competition, and prevents irrelevant events from attracting attention and entering working memory.     

Distinct capacity limits for attention and working memory: Evidence from attentive tracking and visual working memory paradigms

A hallmark of both visual attention and working memory is their severe capacity limit: People can attentively track only about four objects in a multiple object tracking (MOT) task and can hold only up to four objects in visual working memory (VWM). It has been proposed that attention underlies the capacity limit of VWM. We tested this hypothesis by determining the effect of varying the load of a MOT task performed during the retention interval of a VWM task and comparing the resulting dual-task costs with those observed when a VWM task was performed concurrently with another VWM task or with a verbal working memory task. Instead of supporting the view that the capacity limit of VWM is solely attention based, the results indicate that VWM capacity is set by the interaction of visuospatial attentional, central amodal, and local task-specific sources of processing.     

The effects of self-focus on attentional biases in social anxiety:An ERP study

Cognitive theories of social anxiety disorder suggest that biased attention plays a key role in maintaining symptoms. These biases include self-focus and attention to socially threatening stimuli in the environment. The goal of this study was to utilize ERPs that are elicited by a change detection task to examine biases in selective attention (i.e., N2pc) and working memory maintenance (i.e., contralateral delay activity; CDA). Additionally, the effect of self-focus was examined using false heart rate feedback. In support of the manipulation, self-focus cues resulted in greater self-reported self-consciousness and task interference, enhanced anterior P2 amplitude and reduced SPN amplitude. Moreover, P2 amplitude for self-focus cues was correlated with reduced task performance for socially anxious subjects only. The difference in P2 amplitude between self-focus and standard cues was correlated with social anxiety independent of depression. As hypothesized, socially anxious participants (n = 20) showed early selection and maintenance of disgust faces relative to neutral faces as indicated by the N2pc and CDA components. Nonanxious controls (n = 22) did not show these biases. During self-focus cues, controls showed marginal evidence of biased selection for disgust faces, whereas socially anxious subjects showed no bias in this condition. Controls showed an ipsilateral delay activity after being cued to attend to one hemifield. Overall, this study supports early and persistent attentional bias for social threat in socially anxious individuals. Furthermore, self-focus may disrupt these biases. These findings and supplementary data are discussed in light of cognitive models of social anxiety disorder, recent empirical findings, and treatment.     

Visual short-term memory load strengthens selective attention

Perceptual load theory accounts for many attentional phenomena; however, its mechanism remains elusive because it invokes underspecified attentional resources. Recent dual-task evidence has revealed that a concurrent visual short-term memory (VSTM) load slows visual search and reduces contrast sensitivity, but it is unknown whether a VSTM load also constricts attention in a canonical perceptual load task. If attentional selection draws upon VSTM resources, then distraction effects—which measure attentional “spill-over”—will be reduced as competition for resources increases. Observers performed a low perceptual load flanker task during the delay period of a VSTM change detection task. We observed a reduction of the flanker effect in the perceptual load task as a function of increasing concurrent VSTM load. These findings were not due to perceptual-level interactions between the physical displays of the two tasks. Our findings suggest that perceptual representations of distractor stimuli compete with the maintenance of visual representations held in memory. We conclude that access to VSTM determines the degree of attentional selectivity; when VSTM is not completely taxed, it is more likely for task-irrelevant items to be consolidated and, consequently, affect responses. The “resources” hypothesized by load theory are at least partly mnemonic in nature, due to the strong correspondence they share with VSTM capacity.     

Unconscious reward facilitates motion perceptual learning

Reward signal plays an important role in guiding human learning behaviour. Recent studies have provided evidence that reward signal modulates perceptual learning of basic visual features. Typically, the reward effects on perceptual learning were accompanied with consciously presented reward during the learning process. However, whether an unconsciously presented reward signal that minimizes the contribution of attentional and motivational factors can facilitate perceptual learning remains less well understood. We trained human subjects on a visual motion detection task and subliminally delivered a monetary reward for correct response during the training. The results showed significantly larger learning effect for high reward-associated motion direction than low reward-associated motion direction. Importantly, subjects could neither discriminate the relative values of the subliminal monetary reward nor correctly report the reward-direction contingencies. Our findings suggest that reward signal plays an important modulatory role in perceptual learning even if the magnitude of the reward was not consciously perceived.     

Searching while loaded: Visual working memory does not interfere with hybrid search efficiency but hybrid search uses working memory capacity

In “hybrid search” tasks, such as finding items on a grocery list, one must search the scene for targets while also searching the list in memory. How is the representation of a visual item compared with the representations of items in the memory set? Predominant theories would propose a role for visual working memory (VWM) either as the site of the comparison or as a conduit between visual and memory systems. In seven experiments, we loaded VWM in different ways and found little or no effect on hybrid search performance. However, the presence of a hybrid search task did reduce the measured capacity of VWM by a constant amount regardless of the size of the memory or visual sets. These data are broadly consistent with an account in which VWM must dedicate a fixed amount of its capacity to passing visual representations to long-term memory for comparison to the items in the memory set. The data cast doubt on models in which the search template resides in VWM or where memory set item representations are moved from LTM through VWM to earlier areas for comparison to visual items.     

Concurrent guidance of attention by multiple working memory items: Behavioral and computational evidence

During visual search, task-relevant representations in visual working memory (VWM), known as attentional templates, are assumed to guide attention. A current debate concerns whether only one (Single-Item-Template hypothesis; SIT) or multiple (Multiple-Item-Template hypothesis; MIT) items can serve as attentional templates simultaneously. The current study was designed to test these two hypotheses. Participants memorized two colors, prior to a visual-search task in which the target and the distractor could match or not match the colors held in VWM. Robust attentional guidance was observed when one of the memory colors was presented as the target (reduced response times (RTs) on target-match trials) or the distractor (increased RTs on distractor-match trials). We constructed two drift-diffusion models that implemented the MIT and SIT hypotheses, which are similar in their predictions about overall RTs, but differ in their predictions about RTs on individual trials. Critically, simulated RT distributions and error rates revealed a better match of the MIT hypothesis to the observed data than the SIT hypothesis. Taken together, our findings provide behavioral and computational evidence for the concurrent guidance of attention by multiple items in VWM.