Selective working memory disables inhibition of visual features

Recent research suggests that information held in working memory can facilitate subsequent attentional processing. Here, we explore the negative corollary of this conception: Under which circumstances does information in working memory disrupt subsequent processing? Seventy participants performed visual discriminations in a dual-task paradigm. They were asked to judge colors or shapes in an online attention task under three different working-memory conditions: Same, Switch, or Unknown. In the Same condition, participants selectively maintained one visual feature in working memory, from the same dimension as in the online attention task. In the Switch condition, participants selectively maintained one visual feature in working memory, but had to focus on another visual dimension in the online attention task. In the Unknown condition, participants could not predict which visual feature would be relevant for the working-memory task. We found that irrelevant features in the online attention task were particularly difficult to ignore in the Switch condition, that is, when the irrelevant features belong to a visual dimension that is simultaneously prioritized in selective working memory. The findings are consistent with accounts in terms of neural overlap between working-memory and attention circuits, and suggest that mechanisms of selection, rather than resource limitations, critically determine the extent of visual interference.     

言语记忆对视觉选择的影响:基于维度的自动注意引导

两个实验分别考察外显和内隐言语记忆中的特征维度信息对基于维度的视觉选择性注意的自动引导作用。实验一要求被试在言语工作记忆(外显言语记忆)保持阶段完成一个视觉注意任务,结果发现了显著的一致性效应,即记忆任务相关维度和注意任务相关维度不一致条件下的注意任务反应时要显著慢于两者一致条件下的反应时;实验二采用go/no-go任务以考察内隐言语记忆对视觉选择的影响,结果也发现了类似的一致性效应。这些结果表明外显和内隐言语记忆中的抽象维度信息自动引导注意选择视场中与之匹配的视觉维度,而不管该维度是否为当前注意任务的相关维度。     

Early, involuntary top-down guidance of attention from working memory

Four experiments explored the interrelations between working memory, attention, and eye movements. Observers had to identify a tilted line amongst vertical distractors. Each line was surrounded by a colored shape that could be precued by a matching item held in memory. Relative to a neutral baseline, in which no shapes matched the memory item, search was more efficient when the memory cue matched the shape containing the target, and it was less efficient when the cued stimulus contained a distractor. Cuing affected the shortest reaction times and the first saccade in search. The effect occurred even when the memory cue was always invalid but not when the cue did not have to be held in memory. There was also no evidence for priming effects between consecutive trials. The results suggest that there can be early, involuntary top-down directing of attention to a stimulus matching the contents of working memory.     

Intentional attention switching in dichotic listening: Exploring the efficiency of nonspatial and spatial selection

Using an auditory variant of task switching, we examined the ability to intentionally switch attention in a dichotic-listening task. In our study, participants responded selectively to one of two simultaneously presented auditory number words (spoken by a female and a male, one for each ear) by categorizing its numerical magnitude. The mapping of gender (female vs. male) and ear (left vs. right) was unpredictable. The to-be-attended feature for gender or ear, respectively, was indicated by a visual selection cue prior to auditory stimulus onset. In Experiment 1, explicitly cued switches of the relevant feature dimension (e.g., from gender to ear) and switches of the relevant feature within a dimension (e.g., from male to female) occurred in an unpredictable manner. We found large performance costs when the relevant feature switched, but switches of the relevant feature dimension incurred only small additional costs. The feature-switch costs were larger in ear-relevant than in gender-relevant trials. In Experiment 2, we replicated these findings using a simplified design (i.e., only within-dimension switches with blocked dimensions). In Experiment 3, we examined preparation effects by manipulating the cueing interval and found a preparation benefit only when ear was cued. Together, our data suggest that the large part of attentional switch costs arises from reconfiguration at the level of relevant auditory features (e.g., left vs. right) rather than feature dimensions (ear vs. gender). Additionally, our findings suggest that ear-based target selection benefits more from preparation time (i.e., time to direct attention to one ear) than gender-based target selection.     

Attentional effects on orientation judgements are dependent on memory consolidation processes

Are the effects of memory and attention on perception synergistic, antagonistic, or independent? Tested separately, memory and attention have been shown to affect the accuracy of orientation judgements. When multiple stimuli are presented sequentially versus simultaneously, error variance is reduced. When a target is validly cued, precision is increased. What if they are manipulated together? We combined memory and attention manipulations in an orientation judgement task to answer this question. Two circular gratings were presented sequentially or simultaneously. On some trials a brief luminance cue preceded the stimuli. Participants were cued to report the orientation of one of the two gratings by rotating a response grating. We replicated the finding that error variance is reduced on sequential trials. Critically, we found interacting effects of memory and attention. Valid cueing reduced the median, absolute error only when two stimuli appeared together and improved it to the level of performance on uncued sequential trials, whereas invalid cueing always increased error. This effect was not mediated by cue predictiveness; however, predictive cues reduced the standard deviation of the error distribution, whereas nonpredictive cues reduced “guessing”. Our results suggest that, when the demand on memory is greater than a single stimulus, attention is a bottom-up process that prioritizes stimuli for consolidation. Thus attention and memory are synergistic.     

Top-down attentional modulation of spatial frequency processing in scene perception

Recent evidence suggests that spatial frequency (SF) processing of simple and complex visual patterns is flexible. The use of spatial scale in scene perception seems to be influenced by people's expectations. However as yet there is no direct evidence for top-down attentional effects on flexible scale use in scene perception. In two experiments we provide such evidence. We presented participants with low- and high-pass SF filtered scenes and cued their attention to the relevant scale. In Experiment 1 we subsequently presented them with hybrid scenes (both low- and high-pass scenes present). We observed that participants reported detecting the cued component of hybrids. To explore if this might be due to decision biases, in Experiment 2, we replaced hybrids with images containing meaningful scenes at uncued SFs and noise at the cued SFs (invalid cueing). We found that participants performed poorly on invalid cueing trials. These findings are consistent with top-down attentional modulation of early spatial frequency processing in scene perception.     

Facilitation and inhibition caused by the orienting of attention in propositional reasoning tasks

In an attempt to study the orienting of attention in reasoning, we developed a set of propositional reasoning tasks structurally similar to Posner's (1980) spatial cueing paradigm, widely used to study the orienting of attention in perceptual tasks. We cued the representation in working memory of a reasoning premise, observing whether inferences drawn using that premise or a different, uncued one were facilitated, hindered, or unaffected. The results of Experiments 1a, 1b, 1c, and 1d, using semantically (1a–1c) or statistically (1d) informative cues, showed a robust, long-lasting facilitation for drawing inferences from the cued rule. In Experiment 2, using uninformative cues, inferences from the cued rule were facilitated with a short stimulus onset asynchrony (SOA), whereas they were delayed when the SOA was longer, an effect that is similar to the “inhibition of return” (IOR) in perceptual tasks. Experiment 3 used uninformative cues, three different SOAs, and inferential rules with disjunctive antecedents, replicating the IOR-like effect with the long SOAs and, at the short SOA, finding evidence of a gradient-like behaviour of the facilitation effect. Our findings show qualitative similarities to some effects typically observed in the orienting of visual attention, although the tasks did not involve spatial orienting.     

Facilitation and inhibition caused by the orienting of attention in propositional reasoning tasks

In an attempt to study the orienting of attention in reasoning, we developed a set of propositional reasoning tasks structurally similar to Posner's (1980) spatial cueing paradigm, widely used to study the orienting of attention in perceptual tasks. We cued the representation in working memory of a reasoning premise, observing whether inferences drawn using that premise or a different, uncued one were facilitated, hindered, or unaffected. The results of Experiments 1a, 1b, 1c, and 1d, using semantically (1a-1c) or statistically (1d) informative cues, showed a robust, long-lasting facilitation for drawing inferences from the cued rule. In Experiment 2, using uninformative cues, inferences from the cued rule were facilitated with a short stimulus onset asynchrony (SOA), whereas they were delayed when the SOA was longer, an effect that is similar to the “inhibition of return” (IOR) in perceptual tasks. Experiment 3 used uninformative cues, three different SOAs, and inferential rules with disjunctive antecedents, replicating the IOR-like effect with the long SOAs and, at the short SOA, finding evidence of a gradient-like behaviour of the facilitation effect. Our findings show qualitative similarities to some effects typically observed in the orienting of visual attention, although the tasks did not involve spatial orienting.     

Escaping capture: bilingualism modulates distraction from working memory

We ask whether bilingualism aids cognitive control over the inadvertent guidance of visual attention from working memory and from bottom-up cueing. We compare highly-proficient Catalan-Spanish bilinguals with Spanish monolinguals in three visual search conditions. In the working memory (WM) condition, attention was driven in a top-down fashion by irrelevant objects held in WM. In the Identify condition, attention was driven in a bottom-up fashion by visual priming. In the Singleton condition, attention was driven in a bottom-up fashion by including a unique distracting object in the search array. The results showed that bilinguals were overall faster than monolinguals in the three conditions, replicating previous findings that bilinguals can be more efficient than monolinguals in the deployment of attention. Interestingly, bilinguals were less captured by irrelevant information held in WM but were equally affected by visual priming and unique singletons in the search displays. These observations suggest that bilingualism aids top-down WM-mediated guidance of attention, facilitating processes that keep separate representations in WM from representations that guide visual attention. In contrast, bottom-up attentional capture by salient yet unrelated input operates similarly in bilinguals and monolinguals.     

Attentional cueing by cross-modal congruency produces both facilitation and inhibition on short-term visual recognition

The attentional modulation of performance in a memory task, comparable to the one obtained in a perceptual task, is at the focus of contemporary research. We hypothesized that a biphasic effect (namely, facilitation followed by inhibition) can be obtained in visual working memory when attention is cued towards one item of the memorandum and participants must recognize a delayed probe as being identical to any item of the memorandum. In every trial, a delayed spiky/curvy probe appeared centrally, to be matched with the same-category shape maintained in visual working memory which could be either physically identical (positive trials) or only categorically similar (negative trials). To orient the participant's attention towards a selected portion of a two-item memorandum, a (tzk/wow) sound was played simultaneously with two lateral visual shapes (one spiky and one curved). Our results indicate that an exogenous attentional shift during perception of the memorandum, induced by a congruent audio–visual pairing, first facilitates and then inhibits the recognition of a cued item (but not of a non-cued item) stored in visual working memory. A coherent pattern of individual differences emerged, indicating that the amount of early facilitation in congruent-sound trials was negatively correlated with recognition sensitivity in no-sound trials (suggesting that the inverse effectiveness rule may also apply to memory) and positively correlated with later inhibition, as well as with the self-reported susceptibility to memory failures.     

Distinguishing non-spatial from spatial biases in visual selection: neuropsychological evidence

Recently, it has been shown that patients with visual extinction can show enhanced awareness of contralesional stimuli that match the contents of working memory [Soto, D., & Humphreys, G.W. (2006). Proceedings of the National Academy of Sciences, USA, 103, 4789–4792]. Here we investigate whether these effects extend to cases where the working memory cue is verbal rather than visual (Study 1), and we show that non-spatial cues can overcome problems in spatial disengagement in patients, and this can affect the first eye movement made in search (Study 2). We discuss the implications of the data for understanding the relations between the cueing of attention from visual and conceptual information held in working memory and the cueing of spatial attention, and for understanding the relations between non-spatial and spatial biases in selection.     

Feature-based memory-driven attentional capture: visual working memory content affects visual attention

In 7 experiments, the authors explored whether visual attention (the ability to select relevant visual information) and visual working memory (the ability to retain relevant visual information) share the same content representations. The presence of singleton distractors interfered more strongly with a visual search task when it was accompanied by an additional memory task. Singleton distractors interfered even more when they were identical or related to the object held in memory, but only when it was difficult to verbalize the memory content. Furthermore, this content-specific interaction occurred for features that were relevant to the memory task but not for irrelevant features of the same object or for once-remembered objects that could be forgotten. Finally, memory-related distractors attracted more eye movements but did not result in longer fixations. The results demonstrate memory-driven attentional capture on the basis of content-specific representations.     

Working memory dependence of spatial contextual cueing for visual search

When spatial stimulus configurations repeat in visual search, a search facilitation, resulting in shorter search times, can be observed that is due to incidental learning. This contextual cueing effect appears to be rather implicit, uncorrelated with observers’ explicit memory of display configurations. Nevertheless, as I review here, this search facilitation due to contextual cueing depends on visuospatial working memory resources, and it disappears when visuospatial working memory is loaded by a concurrent delayed match to sample task. However, the search facilitation immediately recovers for displays learnt under visuospatial working memory load when this load is removed in a subsequent test phase. Thus, latent learning of visuospatial configurations does not depend on visuospatial working memory, but the expression of learning, as memory‐guided search in repeated displays, does. This working memory dependence has also consequences for visual search with foveal vision loss, where top‐down controlled visual exploration strategies pose high demands on visuospatial working memory, in this way interfering with memory‐guided search in repeated displays. Converging evidence for the contribution of working memory to contextual cueing comes from neuroimaging data demonstrating that distinct cortical areas along the intraparietal sulcus as well as more ventral parieto‐occipital cortex are jointly activated by visual working memory and contextual cueing.     

Stressing the mind: the effect of cognitive load and articulatory suppression on attentional guidance from working memory

Four experiments explored the effect of cognitive load on the time course of top-down guidance of attention from working memory (WM). Observers had to search for a target presented among several distractors, with the target and distractor stimuli embedded inside different objects. On half of the trials, one of the distractor objects was cued by a matching item held in WM. When a single item was maintained in memory, search performance was impaired relative to a neutral baseline, where the memory and search displays did not match. These effects of WM on subsequent search were reduced by including a verbal suppression task during the WM and search displays, and by varying the WM load. The degree of competition for resources in WM is a key factor in determining the time course and magnitude of the interaction between WM and visual selection.     

Retro-cue benefits in working memory without sustained focal attention

In working memory (WM) tasks, performance can be boosted by directing attention to one memory object: When a retro-cue in the retention interval indicates which object will be tested, responding is faster and more accurate (the retro-cue benefit). We tested whether the retro-cue benefit in WM depends on sustained attention to the cued object by inserting an attention-demanding interruption task between the retro-cue and the memory test. In the first experiment, the interruption task required participants to shift their visual attention away from the cued representation and to a visual classification task on colors. In the second and third experiments, the interruption task required participants to shift their focal attention within WM: Attention was directed away from the cued representation by probing another representation from the memory array prior to probing the cued object. The retro-cue benefit was not attenuated by shifts of perceptual attention or by shifts of attention within WM. We concluded that sustained attention is not needed to maintain the cued representation in a state of heightened accessibility.     

Feature bindings endure without attention: Evidence from an explicit recall task

Are integrated objects the unit of capacity of visual working memory, or is continued attention needed to maintain bindings between independently stored features? In a delayed recall task, participants reported the color and shape of a probed item from a memory array. During the delay, attention was manipulated with an exogenous cue. Recall was elevated at validly cued positions, indicating that the cue affected item memory. On invalid trials, participants most frequently recalled either both features (perfect object memory) or neither of the two features (no object memory); the frequency with which only one feature was recalled was significantly lower than predicted by feature independence as determined in a single-feature recall task. These data do not support the view that features are remembered independently when attention is withdrawn. Instead, integrated objects are stored in visual working memory without need for continued attention.     

Orienting attention in visual working memory reduces interference from memory probes

Given a changing visual environment, and the limited capacity of visual working memory (VWM), the contents of VWM must be in constant flux. Using a change detection task, the authors show that VWM is subject to obligatory updating in the face of new information. Change detection performance is enhanced when the item that may change is retrospectively cued 1 s after memory encoding and 0.5 s before testing. The retro-cue benefit cannot be explained by memory decay or by a reduction in interference from other items held in VWM. Rather, orienting attention to a single memory item makes VWM more resistant to interference from the test probe. The authors conclude that the content of VWM is volatile unless it receives focused attention, and that the standard change detection task underestimates VWM capacity.     

Sequence effects of the involuntary and the voluntary components of symbolic cueing

The orienting of attention has been found to be influenced by the previous cueing status in a spatial-cueing paradigm. The explanation for this sequence effect remains uncertain. This study separated the involuntary and the voluntary components of arrow cueing by manipulating the predicted target locations. For example, a left arrow cue may have indicated that the target was more likely to appear at the up location. Therefore, three trial types were repeated or switched between trials: cued (targets appeared along the direction of the arrows), predicted (targets appeared at the locations predicted by the arrows), and unrelated (targets appeared at the other two locations, neither cued nor predicted). RTs of cued trials were found to be significantly facilitated after a previous cued trial; however, the same effect was not observed for predicted trials. The results suggest that significant sequence effects are induced only in the involuntary component of arrow cueing. The findings support the feature-integration hypothesis for the sequence effect of symbolic cueing.

     

空间工作记忆负载对真实场景情境提示效应的影响

重复的画面布局能够促进观察者对目标项的搜索 (情境提示效应)。本研究采用双任务范式,分别在视觉搜索任务的学习阶段 (实验2a) 和测验阶段 (实验2b) 加入空间工作记忆任务, 并与单任务基线 (实验1)进行比较, 考察空间工作记忆负载对真实场景搜索中情境线索学习和情境提示效应表达的影响。结果发现: 空间负载会增大学习阶段的情境提示效应量, 同时削弱测验阶段的情境提示效应量, 而不影响情境线索的外显提取。由此可见, 真实场景中情境线索的学习和提示效应的表达均会受到有限的工作记忆资源的影响, 但情境线索提取的外显性不变。     

Interactions between working memory, attention and eye movements

This paper reviews the recent findings on working memory, attention and eye movements. We discuss the research that shows that many phenomena related to visual attention taking place when selecting relevant information from the environment are similar to processes needed to keep information active in working memory. We discuss new data that show that when retrieving information from working memory, people may allocate visual spatial attention to the empty location in space that used to contain the information that has to be retrieved. Moreover, we show that maintaining a location in working memory not only may involve attention rehearsal, but might also recruit the oculomotor system. Recent findings seem to suggest that remembering a location may involve attention-based rehearsal in higher brain areas, while at the same time there is inhibition of specific motor programs at lower brain areas. We discuss the possibility that working memory functions do not reside at a special area in the brain, but emerge from the selective recruitment of brain areas that are typically involved in spatial attention and motor control.