Using the memory activation capture (MAC) procedure to investigate the temporal dynamics of hypothesis generation

Research investigating top-down capture has demonstrated a coupling of working memory content with attention and eye movements. By capitalizing on this relationship, we have developed a novel methodology, called the memory activation capture (MAC) procedure, for measuring the dynamics of working memory content supporting complex cognitive tasks (e.g., decision making, problem solving). The MAC procedure employs briefly presented visual arrays containing task-relevant information at critical points in a task. By observing which items are preferentially fixated, we gain a measure of working memory content as the task evolves through time. The efficacy of the MAC procedure was demonstrated in a dynamic hypothesis generation task in which some of its advantages over existing methods for measuring changes in the contents of working memory over time are highlighted. In two experiments, the MAC procedure was able to detect the hypothesis that was retrieved and placed into working memory. Moreover, the results from Experiment 2 suggest a two-stage process following hypothesis retrieval, whereby the hypothesis undergoes a brief period of heightened activation before entering a lower activation state in which it is maintained for output. The results of both experiments are of additional general interest, as they represent the first demonstrations of top-down capture driven by participant-established WM content retrieved from long-term memory.     

Working memory and target-related distractor effects on visual search

We examined two forms of top-down effects on visual selection: (1) information held in working memory (WM) and (2) the semantic relations between targets and distractors. We found that items held in WM affected search for a different target. This WM-based interference effect generalized across different exemplars, even though participants could remember the specific exemplar on the trial. This argues against a memory top-up account of performance. In addition, there was interference from distractors that were not held in WM but were semantically related to the target. The effects of WM capture and the effects of capture by a distractor related to the target combined additively. The data suggest that task-irrelevant information in WM and task-relevant templates for targets compete separately for selection. The implications for understanding top-down processes in search are discussed.     

视觉搜索中基于工作记忆内容的注意捕获与抑制

注意是对有关信息的选择及对无关信息的抑制, 工作记忆是对有关信息的保持以及对无关信息的抑制, 两者在一定程度上都体现了选择性地指向与当前任务有关的刺激并同时抑制无关刺激。在系统地回顾已有研究的基础上结合新近的ERP研究, 从视觉搜索中基于工作记忆内容的注意捕获与注意抑制两个角度综述了视觉工作记忆与视觉选择性注意的相关研究。研究者们主要从两方面对该领域的问题进行了探讨：(1)视觉工作记忆内容对视觉选择性注意的导向作用; (2)视觉工作记忆内容对视觉选择性注意产生导向作用的条件。文章对以往的研究进行了总结, 指出了无论保持在视觉工作记忆的内容是捕获注意还是受到抑制, 都存在着自上而下和自下而上两种加工机制。     

Content-embedded tasks beat complex span for predicting comprehension

Discourse comprehension requires one to process information that is actively maintained in working memory (WM). Therefore, we hypothesized that individual differences in comprehension would be predicted better by working memory tasks that capture the concurrent demands of processing and maintenance of the same memory elements (i.e., content-embedded tasks) than by WM tasks that require the maintenance of an extraneous memory load during processing (e.g., complex span tasks). Two hundred sixty-one undergraduates completed three content-embedded tasks, three complex span tasks, and three measures of comprehension. Results of structural equation modeling indicated that the content-embedded tasks accounted for a greater amount of variance in comprehension than did complex span tasks. Thus, tasks that require one to coordinate the processing and maintenance of task-specific memory elements are preferable for capturing the relationship between WM and comprehension.     

The illusion of control: Sequential dependencies underlie contingent attentional capture

The degree to which humans have top-down control over which information they process remains a central debate within the attention literature. Most of the evidence supporting the top-down control of visuospatial attention has come from cueing paradigms in which target stimuli are preceded by cues that are similar or dissimilar from the target. These studies find that the cues similar to targets capture attention, but dissimilar cues do not, suggesting the top-down control of attention. Here, we used a modified cueing paradigm to investigate an alternative possibility that the cue type differences are due to sequential dependency effects occurring between cue and target processing rather than the top-down control of attention. When individuals searched for color targets, we replicated contingent capture effects in RTs, which are susceptible to sequential dependencies, but memory performance was always best at the cued locations, regardless of the cue’s identity. When individuals searched for onset targets, we observed contingent capture in both tasks. These results demonstrate the utility of the memory probe paradigm and suggest an asymmetry between how strongly onsets and color defined cues capture attention.     

Top-down modulation: bridging selective attention and working memory

Selective attention, the ability to focus our cognitive resources on information relevant to our goals, influences working memory (WM) performance. Indeed, attention and working memory are increasingly viewed as overlapping constructs. Here, we review recent evidence from human neurophysiological studies demonstrating that top-down modulation serves as a common neural mechanism underlying these two cognitive operations. The core features include activity modulation in stimulus-selective sensory cortices with concurrent engagement of prefrontal and parietal control regions that function as sources of top-down signals. Notably, top-down modulation is engaged during both stimulus-present and stimulus-absent stages of WM tasks; that is, expectation of an ensuing stimulus to be remembered, selection and encoding of stimuli, maintenance of relevant information in mind and memory retrieval.     

Cognitive control over working memory biases of selection

Across many studies, researchers have found that representations in working memory (WM) can guide visual attention toward items that match the features of the WM contents. While some researchers have contended that this occurs involuntarily, others have suggested that the impact of WM contents on attention can be strategically controlled. Here, we varied the probability that WM items would coincide with either targets or distractors in a visual search task to examine (1) whether participants could intentionally enhance or inhibit the influence of WM items on attention and (2) whether cognitive control over WM biases would also affect access to the memory contents in a surprise recognition test. We found visual search to be faster when the WM item coincided with the search target, and this effect was enhanced when the memory item reliably predicted the location of the target. Conversely, visual search was slowed when the memory item coincided with a search distractor, and this effect was diminished, but not abolished, when the memory item was reliably associated with distractors. This strategic dampening of the influence of WM items on attention came at a price to memory, however, as participants were slowest to perform WM recognition tests on blocks in which the WM contents were consistently invalid. These results document that attentional capture by WM contents is partly, but not fully, malleable by top-down control, which appears to adjust the state of the WM contents to optimize search behavior. These data illustrate the role of cognitive control in modulating the strength of WM biases of selection, and they support a tight coupling between WM and attention.     

Control of the contents of working memory--a comparison of two paradigms and two age groups

Two experiments investigated whether young and old adults can temporarily remove information from a capacity-limited central component of working memory (WM) into another component, the activated part of long-term memory (LTM). Experiment 1 used a modified Sternberg recognition task (S. Sternberg, 1969); Experiment 2 used an arithmetic memory-updating task. In both paradigms, participants memorized 2 lists, one of which was cued as temporarily irrelevant. Removal of the irrelevant list from capacity-limited WM was indexed by the disappearance of list-length effects of that list on latencies for concurrent processing tasks. Young adults could outsource the irrelevant list within 2-3 s and retrieve it back into the central part of WM later. Old adults showed the same flexibility in the arithmetic updating task but seemed somewhat less able or inclined to temporarily move information into the activated part of LTM in the modified Sternberg task.     

工作记忆负荷、形状干扰对聋人与听力正常人注意捕获影响的眼动研究

通过记录和分析被试的行为和眼动指标,本研究试图探讨不同工作记忆负荷下,形状干扰对聋人与听力正常人不同视野位置上刺激信息捕获注意的异同。研究结果表明：（1）形状干扰刺激虽然没有影响被试视觉加工的认知绩效,但被试的眼动模式会由于工作记忆负荷的改变而改变,高工作记忆负荷时,有形状干扰的注视次数高于无形状干扰。（2）工作记忆负荷、视野位置影响被试视觉加工任务的完成,被试在不同视野位置的加工过程表现出不一致的眼动模式。（3）聋人视觉加工在高工作记忆负荷时存在一定的劣势,但其对不同视野位置的信息加工及形状干扰所产生的注意捕获效应与听力正常人一致。     

What happens to an individual visual working memory representation when it is interrupted?

This study tested the hypothesis that even the simplest cognitive tasks require the storage of information in working memory (WM), distorting any information that was previously stored in WM. Experiment 1 tested this hypothesis by requiring observers to perform a simple letter discrimination task while they were holding a single orientation in WM. We predicted that performing the task on the interposed letter stimulus would cause the orientation memory to become less precise and more categorical compared to when the letter was absent or when it was present but could be ignored. This prediction was confirmed. Experiment 2 tested the modality specificity of this effect by replacing the visual letter discrimination task with an auditory pitch discrimination task. Unlike the interposed visual stimulus, the interposed auditory stimulus produced little or no disruption of WM, consistent with the use of modality‐specific representations. Thus, performing a simple visual discrimination task, but not a simple auditory discrimination task, distorts information about a single feature being maintained in visual WM. We suggest that the interposed task eliminates information stored within the focus of attention, leaving behind a WM representation outside the focus of attention that is relatively imprecise and categorical.     

Individual differences in multiple types of shifting attention

Many researchers consider costs in shifting attention and mental set to reflect a basic ability to use top-down goal information to guide action. Although switch costs have been used as measures of individuals' executive function, whether common abilities underlie task set switching across different types of shifting tasks has not been well studied. In 249 participants, we studied whether switch costs in a novel two-choice reaction time task were correlated across variations in two variables: thelocus of representation (stimuli were either perceptually available or stored in working memory [WM]) and which of two judgment tasks was performed. Switch costs were asymmetrical, in that it was easier to switch to the easier judgment, and were related to overall and relative processing speed: Switch costs were higher when the task was more difficult. These factors should be accounted for when one is measuring individual differences in switch costs. After controlling for these effects, we found evidence for a common ability underlying switch costs that involved both task set preparation and response selection; however, residual shift costs, which involve only response selection, were uncorrelated across tasks. Correlations among switch costs were substantially higher within task type (e.g., correlations of WM shifting tasks with other WM shifting tasks and of perceptual tasks with perceptual ones), suggesting that there are also processes unique to switching within WM and switching among visible stimuli.     

Capture of the gaze does not capture the mind

Sudden visual changes attract our gaze, and related eye movement control requires attentional resources. Attention is a limited resource that is also involved in working memory??for instance, memory encoding. As a consequence, theory suggests that gaze capture could impair the buildup of memory respresentations due to an attentional resource bottleneck. Here we developed an experimental design combining a serial memory task (verbal or spatial) and concurrent gaze capture by a distractor (of high or low similarity to the relevant item). The results cannot be explained by a general resource bottleneck. Specifically, we observed that capture by the low-similar distractor resulted in delayed and reduced saccade rates to relevant items in both memory tasks. However, while spatial memory performance decreased, verbal memory remained unaffected. In contrast, the high-similar distractor led to capture and memory loss for both tasks. Our results lend support to the view that gaze capture leads to activation of irrelevant representations in working memory that compete for selection at recall. Activation of irrelevant spatial representations distracts spatial recall, whereas activation of irrelevant verbal features impairs verbal memory performance.     

Variation in the use of cues to guide visual working memory

Across two experiments we examined individual differences in the use of precues and retrocues to guide the selective encoding and maintenance of information in visual working memory (WM). In Experiment 1, we used spatial cues to indicate which item would be tested either before or after the presentation of a memory array. Regression analyses allowed us to separate variance due to visual WM capacity and attention control differences. In Experiment 2, we used categorical cues to indicate from which subset of items the tested item would be drawn, and we measured attention control with two independent tasks. Collectively, the results supported the idea that an element of individual differences in WM is the ability to flexibly allocate attention to encode only relevant information and subsequently select relevant information during maintenance stages.     

Novel n-back spatial working memory task using eye movement response

We created a novel eye movement version of the n-back task to measure spatial working memory (WM). Rather than one continuous trial, discrete trials were presented in order to develop a simpler WM task. In Experiment 1, we varied the visibility of the final stimulus to maximize the difference in performance between 0-back and 1-back tasks (WM effect). In Experiment 2, we administered the optimized task to children. In Experiment 3, we further simplified the task. Both adults and children easily completed our task, displaying significant WM effects. Further, similar WM effects were obtained in our original and simplified n-back spatial WM tasks, demonstrating flexibility. Because WM deficits are often an early feature of disease and a marker of disease progression, our saccadic measure of spatial WM may be particularly useful in hard-to-test populations, such as patients and children, and may have application in brain-imaging studies that require discrete trials.     

Escaping capture: bilingualism modulates distraction from working memory

We ask whether bilingualism aids cognitive control over the inadvertent guidance of visual attention from working memory and from bottom-up cueing. We compare highly-proficient Catalan-Spanish bilinguals with Spanish monolinguals in three visual search conditions. In the working memory (WM) condition, attention was driven in a top-down fashion by irrelevant objects held in WM. In the Identify condition, attention was driven in a bottom-up fashion by visual priming. In the Singleton condition, attention was driven in a bottom-up fashion by including a unique distracting object in the search array. The results showed that bilinguals were overall faster than monolinguals in the three conditions, replicating previous findings that bilinguals can be more efficient than monolinguals in the deployment of attention. Interestingly, bilinguals were less captured by irrelevant information held in WM but were equally affected by visual priming and unique singletons in the search displays. These observations suggest that bilingualism aids top-down WM-mediated guidance of attention, facilitating processes that keep separate representations in WM from representations that guide visual attention. In contrast, bottom-up attentional capture by salient yet unrelated input operates similarly in bilinguals and monolinguals.     

Getting a grip on drinking behavior: training working memory to reduce alcohol abuse

Alcohol abuse disrupts core executive functions, including working memory (WM)--the ability to maintain and manipulate goal-relevant information. When executive functions like WM are weakened, drinking behavior gets out of control and is guided more strongly by automatic impulses. This study investigated whether training WM restores control over drinking behavior. Forty-eight problem drinkers performed WM training tasks or control tasks during 25 sessions over at least 25 days. Before and after training, we measured WM and drinking behavior. Training WM improved WM and reduced alcohol intake for more than 1 month after the training. Further, the indirect effect of training on alcohol use through improved WM was moderated by participants' levels of automatic impulses: Increased WM reduced alcohol consumption in participants with relatively strong automatic preferences for alcohol. These findings are consistent with the theoretical framework and demonstrate that training WM may be an effective strategy to reduce alcohol use by increasing control over automatic impulses to drink alcohol.     

Complex span tasks, simple span tasks, and cognitive abilities: A reanalysis of key studies

There is great interest in the relationships between memory span tasks and cognitive abilities. However, the causes underlying their correlation remain unknown. In the present article, five key data sets were reanalyzed according to two criteria: They must consider complex span tasks (so-called working memory [WM] tasks) and simple span tasks (so-called short-term memory [STM] tasks), and they must comprise cognitive ability measures. The obtained results offer several points of interest. First, memory span tasks should be conceived from a hierarchical perspective: They comprise both general and specific components. Second, the general component explains about four times the variance explained by the specific components. Third, STM and WM measures are closely related. Fourth, STM and WM measures share the same common variance with cognitive abilities. Finally, the strong relationship usually found between memory span tasks and cognitive abilities could be tentatively interpreted by the component shared by STM and WM--namely, the capacity for temporarily preserving a reliable memory representation of any given information.     

Why do we move our eyes while trying to remember? The relationship between non-visual gaze patterns and memory

Non-visual gaze patterns (NVGPs) involve saccades and fixations that spontaneously occur in cognitive activities that are not ostensibly visual. While reasons for their appearance remain obscure, convergent empirical evidence suggests that NVGPs change according to processing requirements of tasks. We examined NVPGs in tasks with long-term memory (LTM) and working memory (WM) requirements. Experiment 1 yielded significantly higher eye movement rate (EMR) in tasks requiring LTM search than in a WM task requiring maintenance of information. Experiment 2 manipulated accessibility of items in study-test episodic tasks using the levels of processing paradigm. EMR was high in episodic recall irrespective of item accessibility. Experiment 3 examined functional significance of saccades in LTM tasks. Voluntary saccadic suppression produced no evidence that saccades contribute to task performance. We discuss the apparent epiphenomenal nature of spontaneous saccades from an evolutionary perspective and outline a neuroanatomical model of the link between the saccadic and memory system.     

The real relationship between short-term memory and working memory

Storage-oriented memory span tasks with no explicit concurrent processing are usually referred as short-term memory (STM) tasks, whereas tasks involving storage plus concurrent processing requirements are designated as working memory (WM) tasks. The present study explores a question that remains unsolved: Do STM and WM tasks clearly tap distinguishable theoretical constructs? For that purpose, a large sample of 403 participants was tested through 12 diverse memory span tasks. Half of those tasks are widely accepted as measures of STM, whereas the other half measure WM. The results show that STM and WM share largely overlapping underlying capacity limitations, suggesting that all memory span tasks tap essentially the same construct. Some implications are discussed.     

The real relationship between short-term memory and working memory

Storage-oriented memory span tasks with no explicit concurrent processing are usually referred as short-term memory (STM) tasks, whereas tasks involving storage plus concurrent processing requirements are designated as working memory (WM) tasks. The present study explores a question that remains unsolved: Do STM and WM tasks clearly tap distinguishable theoretical constructs? For that purpose, a large sample of 403 participants was tested through 12 diverse memory span tasks. Half of those tasks are widely accepted as measures of STM, whereas the other half measure WM. The results show that STM and WM share largely overlapping underlying capacity limitations, suggesting that all memory span tasks tap essentially the same construct. Some implications are discussed.