Interactions between visual working memory representations

We investigated whether the representations of different objects are maintained independently in working memory or interact with each other. Observers were shown two sequentially presented orientations and required to reproduce each orientation after a delay. The sequential presentation minimized perceptual interactions so that we could isolate interactions between memory representations per se. We found that similar orientations were repelled from each other whereas dissimilar orientations were attracted to each other. In addition, when one of the items was given greater attentional priority by means of a cue, the representation of the high-priority item was not influenced very much by the orientation of the low-priority item, but the representation of the low-priority item was strongly influenced by the orientation of the high-priority item. This indicates that attention modulates the interactions between working memory representations. In addition, errors in the reported orientations of the two objects were positively correlated under some conditions, suggesting that representations of distinct objects may become grouped together in memory. Together, these results demonstrate that working-memory representations are not independent but instead interact with each other in a manner that depends on attentional priority.     

The influence of similarity on visual working memory representations

In verbal memory, similarity between items in memory often leads to interference and impaired memory performance. The present study sought to determine whether analogous interference effects would be observed in visual working memory by varying the similarity of the to-be-remembered objects in a colour change detection task. Instead of leading to interference and impaired performance, increased similarity among the items being held in memory led to improved performance. Moreover, when two similar colours were presented along with one dissimilar colour, memory performance was better for the similar colours than for the dissimilar colour. Similarity produced better performance even when the objects were presented sequentially and even when memory for the first item in the sequence was tested. These findings show that similarity does not lead to interference between representations in visual working memory. Instead, similarity may lead to improved task performance, possibly due to increased stability or precision of the memory representations during maintenance.     

The aftermath of memory retrieval for recycling visual working memory representations

We examined the aftermath of accessing and retrieving a subset of information stored in visual working memory (VWM)—namely, whether detection of a mismatch between memory and perception can impair the original memory of an item while triggering recognition-induced forgetting for the remaining, untested items. For this purpose, we devised a consecutive-change detection task wherein two successive testing probes were displayed after a single set of memory items. Across two experiments utilizing different memory-testing methods (whole vs. single probe), we observed a reliable pattern of poor performance in change detection for the second test when the first test had exhibited a color change. The impairment after a color change was evident even when the same memory item was repeatedly probed; this suggests that an attention-driven, salient visual change made it difficult to reinstate the previously remembered item. The second change detection, for memory items untested during the first change detection, was also found to be inaccurate, indicating that recognition-induced forgetting had occurred for the unprobed items in VWM. In a third experiment, we conducted a task that involved change detection plus continuous recall, wherein a memory recall task was presented after the change detection task. The analyses of the distributions of recall errors with a probabilistic mixture model revealed that the memory impairments from both visual changes and recognition-induced forgetting are explained better by the stochastic loss of memory items than by their degraded resolution. These results indicate that attention-driven visual change and recognition-induced forgetting jointly influence the “recycling” of VWM representations.     

Clear evidence for item limits in visual working memory

There is a consensus that visual working memory (WM) resources are sharply limited, but debate persists regarding the simple question of whether there is a limit to the total number of items that can be stored concurrently. Zhang and Luck (2008) advanced this debate with an analytic procedure that provided strong evidence for random guessing responses, but their findings can also be described by models that deny guessing while asserting a high prevalence of low precision memories. Here, we used a whole report memory procedure in which subjects reported all items in each trial and indicated whether they were guessing with each response. Critically, this procedure allowed us to measure memory performance for all items in each trial. When subjects were asked to remember 6 items, the response error distributions for about 3 out of the 6 items were best fit by a parameter-free guessing model (i.e. a uniform distribution). In addition, subjects’ self-reports of guessing precisely tracked the guessing rate estimated with a mixture model. Control experiments determined that guessing behavior was not due to output interference, and that there was still a high prevalence of guessing when subjects were instructed not to guess. Our novel approach yielded evidence that guesses, not low-precision representations, best explain limitations in working memory. These guesses also corroborate a capacity-limited working memory system – we found evidence that subjects are able to report non-zero information for only 3–4 items. Thus, WM capacity is constrained by an item limit that precludes the storage of more than 3–4 individuated feature values.     

Action relevance induces an attentional weighting of representations in visual working memory

Information maintained in visual working memory (VWM) can be strategically weighted according to its task-relevance. This is typically studied by presenting cues during the maintenance interval, but under natural conditions, the importance of certain aspects of our visual environment is mostly determined by intended actions. We investigated whether representations in VWM are also weighted with respect to their potential action relevance. In a combined memory and movement task, participants memorized a number of items and performed a pointing movement during the maintenance interval. The test item in the memory task was subsequently presented either at the movement goal or at another location. We found that performance was better for test items presented at a location that corresponded to the movement goal than for test items presented at action-irrelevant locations. This effect was sensitive to the number of maintained items, suggesting that preferential maintenance of action relevant information becomes particularly important when the demand on VWM is high. We argue that weighting according to action relevance is mediated by the deployment of spatial attention to action goals, with representations spatially corresponding to the action goal benefitting from this attentional engagement. Performance was also better at locations next to the action goal than at locations farther away, indicating an attentional gradient spreading out from the action goal. We conclude that our actions continue to influence visual processing at the mnemonic level, ensuring preferential maintenance of information that is relevant for current behavioral goals.     

No evidence of binding items to spatial configuration representations in visual working memory

When detecting changes in visual features (e.g., colour or shape), object locations, represented as points within a configuration, might also be automatically represented in working memory. If the configuration of a scene is represented automatically, the locations of individual items might form part of this representation, irrespective of their relevance to the task. Participants took part in a change-detection task in which they studied displays containing different sets of items (shapes, letters, objects), which varied in their task relevance. Specifically, they were asked to remember the features of two sets, and ignore the third set. During the retention interval, an audio cue indicated which of the to-be-remembered sets would become the target set (having a 50% probability of containing a new feature). At test, they were asked to indicate whether a new feature was present amongst the target set. We measured binding of individual items to the configuration by manipulating the locations of the different sets so that their position in the test display either matched or mismatched their original location in the study display. If items are automatically bound to the configuration, location changes should disrupt performance, even if they were explicitly instructed not to remember the features of that particular set of items. There was no effect on performance of changing the locations of any of the sets between study and test displays, indicating that the configural representation did not enter their decision stage, and therefore that individual item representations are not necessarily bound to the configuration.     

Hierarchical encoding in visual working memory: ensemble statistics bias memory for individual items

Influential models of visual working memory treat each item to be stored as an independent unit and assume that there are no interactions between items. However, real-world displays have structure that provides higher-order constraints on the items to be remembered. Even in the case of a display of simple colored circles, observers can compute statistics, such as mean circle size, to obtain an overall summary of the display. We examined the influence of such an ensemble statistic on visual working memory. We report evidence that the remembered size of each individual item in a display is biased toward the mean size of the set of items in the same color and the mean size of all items in the display. This suggests that visual working memory is constructive, encoding displays at multiple levels of abstraction and integrating across these levels, rather than maintaining a veridical representation of each item independently.     

Affective evidence that inhibition is involved in separating accessory representations from active representations in visual working memory

ABSTRACT

The multiple state theory of working memory suggests that representations are divided into two states: focused-on active representations and accessory memories held for later use. Here we tested two competing hypotheses regarding the neurocognitive mechanisms responsible for this separation: (1) that accessory memories undergo inhibition or (2) that accessory memories are amplified less than active representations. We explored whether accessory memories undergo affective devaluation, a known index of the involvement of inhibition in a visual task. On each trial participants memorized four items, were cued to focus on one, and then completed a visual search or an affective evaluation task. While search distractors matching the colour of an active item slowed search, those matching an accessory memory did not, replicating previous findings that only active items guide search. Also, accessory items were affectively devalued compared to baseline and active items, supporting the hypothesis that accessory memories undergo inhibition.     

Configural representations in spatial working memory

Two studies investigate the nature of representations in spatial working memory, directly addressing the question of whether people represent the configuration information above and beyond independent positional information when representing multiple sequentially presented locations. In Experiment 1, participants performed a location memory task in which they recalled the location of objects that were presented sequentially on a screen. Comparison of participants' data with simulated data modelled to represent independent positional representation of spatial locations revealed that participants represented the configural properties of shorter sequences (3 and 4 locations) but not of longer ones (5 and 7 locations). Experiment 2 employed a sequential recognition task in which participants were asked to judge whether two consequently presented spatial sequences were identical. These experiments confirmed sensitivity to configural properties of spatial sequences.     

The number and quality of representations in working memory

Flexible-resource theories characterize working memory as a flexible resource that can store either a large number of low-quality representations or a small number of high-quality representations. In contrast, limited-item theories propose that the number of items that can be stored in working memory is strictly limited and cannot be increased by decreasing the quality of the representations. We tested these fundamentally different conceptualizations of working memory capacity by determining whether observers could trade quality for quantity in working memory when given incentives to do so. We found no evidence that observers could increase the number of representations by decreasing their quality in working memory, but observers could make such a trade-off at earlier processing stages. Our results show that the capacity limit of working memory is best characterized as a limit on the number of items that can be stored and not as a limit on a finely divisible resource that simultaneously determines the number and quality of the representations.     

视觉工作记忆的过滤效能

过滤效能反映了视觉工作记忆的干扰抑制功能, 研究者可基于储存容量或表征精度对其进行测量, 其神经加工过程主要分为觉察分心项目、过滤启动、实现过滤或储存, 涉及前额叶皮层和基底核、后顶叶皮层的协同作用。过滤效能的变化方向受到年龄、特殊障碍、情绪、认知特点等因素的影响。未来研究仍需解决的问题包括厘清过滤效能与工作记忆容量的关系, 辨明过滤效能的心理实现过程, 探索不同年龄、特殊障碍和职业等群体过滤效能的脑机制以及提升基础研究范式的生态学效度。     

Coordination in visual working memory

Coordination of mental procedures is considered in terms of control processes (Baddeley, 1989) in visual working memory and appears to be a separable aspect of the demand imposed by cascaded serial processes (Carlson & Lundy, 1992). The main task required subjects to indicate whether symbolically suggested rotations and reflections correctly describe the difference between matrix patterns of filled-in squares within a 3 x 3 grid or between line drawings. Experiments were carried out to show that coordination is a separable component in this transformation task. A marker for coordination is the difference between the time taken to execute two transformations as a whole and the sum of the component transformations in isolation. The separate coordination demand was found in an experiment with matrix patterns mentioned, in an experiment with letter-like line drawings, and also in an experiment that forced subjects to maintain whole-pattern representations. A last experiment checked whether coordination is carried out by an autonomous control unit. There was a self-paced control of serial presentation of transformation symbols instead of a simultaneous presentation of those symbols. This additional external triggering resulted in a substantial decrease in the demand for coordination. Coordination of mental procedures and temporary representations is a fundamental constraint on the use of working-memory processes.     

Proactive interference and item similarity in working memory

Proactive interference (PI) may influence the predictive utility of working memory span tasks. Participants in one experiment (N=70) completed Ravens Advanced Progressive Matrices (RAPM) and multiple versions of operation span and probed recall, modified for the type of memoranda (digits or words). Changing memoranda within- or across-trials released PI, but not doing so permitted PI buildup. Scores from PI-build trials, but not PI-release trials, correlated with RAPM and accounted for as much variance in RAPM as unmodified tasks. These results are consistent with controlled attention and inhibition accounts of working memory, and they elucidate a fundamental component of working memory span tasks.     

Angry expressions strengthen the encoding and maintenance of face identity representations in visual working memory

Visual working memory (WM) for face identities is enhanced when faces express negative versus positive emotion. To determine the stage at which emotion exerts its influence on memory for person information, we isolated expression (angry/happy) to the encoding phase (Experiment 1; neutral test faces) or retrieval phase (Experiment 2; neutral study faces). WM was only enhanced by anger when expression was present at encoding, suggesting that retrieval mechanisms are not influenced by emotional expression. To examine whether emotional information is discarded on completion of encoding or sustained in WM, in Experiment 3 an emotional word categorisation task was inserted into the maintenance interval. Emotional congruence between word and face supported memory for angry but not for happy faces, suggesting that negative emotional information is preferentially sustained during WM maintenance. Our findings demonstrate that negative expressions exert sustained and beneficial effects on WM for faces that extend beyond encoding.     

The neural bases of distracter-resistant working memory

A major difference between humans and other animals is our capacity to maintain information in working memory (WM) while performing secondary tasks, which enables sustained, complex cognition. A common assumption is that the lateral prefrontal cortex (PFC) is critical for WM performance in the presence of distracters, but direct evidence is scarce. We assessed the relationship between fMRI activity and WM performance within subjects, with performance matched across distracter and no-distracter conditions. Activity in the ventrolateral PFC during WM encoding and maintenance positively predicted performance in both conditions, whereas activity in the presupplementary motor area (pre-SMA) predicted performance only under distraction. Other parts of the dorsolateral and ventrolateral PFCs predicted performance only in the no-distracter condition. These findings challenge a lateral-PFC-centered view of distracter resistance, and suggest that the lateral PFC supports a type of WM representation that is efficient for dealing with task-irrelevant input but is, nonetheless, easily disrupted by dual-task demands.     

The privileged role of location in visual working memory

Reports have conflicted about the possible special role of location in visual working memory (WM). One important question is: Do we maintain the locations of objects in WM even when they are irrelevant to the task at hand? Here we used a continuous response scale to study the types of reporting errors that participants make when objects are presented at the same or at different locations in space. When several objects successively shared the same location, participants exhibited a higher tendency to report features of the wrong object in memory; that is, they responded with features that belonged to objects retained in memory but not probed at retrieval. On the other hand, a similar effect was not observed when objects shared a nonspatial feature, such as color. Furthermore, the effect of location on reporting errors was present even when its manipulation was orthogonal to the task at hand. These findings are consistent with the view that binding together different nonspatial features of an object in memory might be mediated through an object’s location. Hence, spatial location may have a privileged role in WM. The relevance of these findings to conceptual models, as well as to neural accounts of visual WM, is discussed.     

The time course of consolidation in visual working memory

How long does it take to form a durable representation in visual working memory? Several theorists have proposed that this consolidation process is very slow. Here, we measured the time course of consolidation. Observers performed a change-detection task for colored squares, and shortly after the presentation of the first array, pattern masks were presented at the locations of each of the colored squares to disrupt representations that had not yet been consolidated. Performance on the memory task was impaired when the delay between the colored squares and the masks was short, and this effect became larger when the number of colored squares was increased. The rate of consolidation was approximately 50 ms per item, which is considerably faster than previous proposals.     

工作记忆与知觉负载对工作记忆表征引导注意的调节

本研究采用4个眼动实验探讨不同知觉负载条件下的视觉搜索任务中工作记忆负载对基于工作记忆表征的注意引导效应的影响。实验1和实验3采用低知觉负载的视觉搜索任务,结果在视觉工作记忆负载为1和2时观察到了显著的注意引导效应,但当负载增加到4时注意引导效应消失了;实验2和实验4采用高知觉负载的视觉搜索任务,结果发现注意引导效应在工作记忆负载增加到2时就已经消失了。上述结果表明:工作记忆负载和知觉负载都能够通过调控认知资源的方式来影响工作记忆表征对注意的引导,当认知资源充足时,工作记忆能够同时保持多个记忆表征对视觉注意的引导。     

Stronger neural dynamics capture changes in infants' visual working memory capacity over development

Visual working memory (VWM) capacity has been studied extensively in adults, and methodological advances have enabled researchers to probe capacity limits in infancy using a preferential looking paradigm. Evidence suggests that capacity increases rapidly between 6 and 10 months of age. To understand how the VWM system develops, we must understand the relationship between the looking behavior used to study VWM and underlying cognitive processes. We present a dynamic neural field model that captures both real-time and developmental processes underlying performance. Three simulation experiments show how looking is linked to VWM processes during infancy and how developmental changes in performance could arise through increasing neural connectivity. These results provide insight into the sources of capacity limits and VWM development more generally.