Working memory training improves visual short-term memory capacity

Since antiquity, philosophers, theologians, and scientists have been interested in human memory. However, researchers today are still working to understand the capabilities, boundaries, and architecture. While the storage capabilities of long-term memory are seemingly unlimited (Bahrick, J Exp Psychol 113:1–2, 1984), working memory, or the ability to maintain and manipulate information held in memory, seems to have stringent capacity limits (e.g., Cowan, Behav Brain Sci 24:87–185, 2001). Individual differences, however, do exist and these differences can often predict performance on a wide variety of tasks (cf. Engle What is working-memory capacity? 297–314, 2001). Recently, researchers have promoted the enticing possibility that simple behavioral training can expand the limits of working memory which indeed may also lead to improvements on other cognitive processes as well (cf. Morrison and Chein, Psychol Bull Rev 18:46–60 2011). However, initial investigations across a wide variety of cognitive functions have produced mixed results regarding the transferability of training-related improvements. Across two experiments, the present research focuses on the benefit of working memory training on visual short-term memory capacity—a cognitive process that has received little attention in the training literature. Data reveal training-related improvement of global measures of visual short-term memory as well as of measures of the independent sub-processes that contribute to capacity (Awh et al., Psychol Sci 18(7):622–628, 2007). These results suggest that the ability to inhibit irrelevant information within and between trials is enhanced via n-back training allowing for selective improvement on untrained tasks. Additionally, we highlight a potential limitation of the standard adaptive training procedure and propose a modified design to ensure variability in the training environment.     

Color relations increase the capacity of visual short-term memory

Do color relations such as similarity or harmony influence the ease with which colored patterns can be perceived and held in mind? We tested the influence of a relation supported in research on color harmony--similarity of hue--on the capacity of visual short-term memory (VSTM) for colors in patterns. Palettes of 4 similar-hue colors were rated as more pleasant (harmonious) than dissimilar-color palettes. The palettes were used in a VSTM color task. Patterns of 9 to 15 colored squares were presented, and accuracy of color change detection was measured. Memory performance was higher overall for similar-color palettes than for dissimilar-color palettes (experiments 1 and 3). Is this due to color similarity per se, or due to the harmony between colors in similar palettes? A final experiment provided strong support for the importance of color similarity as opposed to harmony. Overall, the advantages for color similarity, in terms of number of color squares held in memory (memory capacity) were 26% to 45% over dissimilar colors. The results indicate that color relations can have a strong impact on the capacity for perceiving and retaining color patterns.     

Dissociations of the number and precision of visual short-term memory representations in change detection

The present study dissociated the number (i.e., quantity) and precision (i.e., quality) of visual short-term memory (STM) representations in change detection using receiver operating characteristic (ROC) and experimental manipulations. Across three experiments, participants performed both recognition and recall tests of visual STM using the change-detection task and the continuous color-wheel recall task, respectively. Experiment 1 demonstrated that the estimates of the number and precision of visual STM representations based on the ROC model of change-detection performance were robustly correlated with the corresponding estimates based on the mixture model of continuous-recall performance. Experiments 2 and 3 showed that the experimental manipulation of mnemonic precision using white-noise masking and the experimental manipulation of the number of encoded STM representations using consolidation masking produced selective effects on the corresponding measures of mnemonic precision and the number of encoded STM representations, respectively, in both change-detection and continuous-recall tasks. Altogether, using the individual-differences (Experiment 1) and experimental dissociation (Experiment 2 and 3) approaches, the present study demonstrated the some-or-none nature of visual STM representations across recall and recognition.     

Understanding age-related reductions in visual working memory capacity: Examining the stages of change detection

Visual working memory (VWM) capacity is reduced in older adults. Research has shown age-related impairments to VWM encoding, but aging is likely to affect multiple stages of VWM. In the present study, we recorded the event-related potentials (ERPs) of younger and older adults during VWM maintenance and retrieval. We measured encoding-stage processing with the P1 component, maintenance-stage processing with the contralateral delay activity (CDA), and retrieval-stage processing by comparing the activity for old and new items (old–new effect). Older adults showed lower behavioral capacity estimates (K) than did younger adults, but surprisingly, their P1 components and CDAs were comparable to those of younger adults. This remarkable dissociation between neural activity and behavior in the older adults indicated that the P1 and CDA did not accurately assess their VWM capacity. However, the neural activity evoked during VWM retrieval yielded results that helped clarify the age-related differences. During retrieval, younger adults showed early old–new effects in frontal and occipital areas and a late central–parietal old–new effect, whereas older adults showed a late right-lateralized parietal old–new effect. The younger adults’ early old–new effects strongly resembled an index of perceptual fluency, suggesting that perceptual implicit memory was activated. The activation of implicit memory could have facilitated the younger adults’ behavior, and the lack of these early effects in older adults may suggest that they have much lower-resolution memory than do younger adults. From these data, we speculated that younger and older adults store the same number of items in VWM, but that younger adults store a higher-resolution representation than do older adults.     

Improving visual short-term memory by sequencing the stimulus array

When multiple objects are presented briefly and simultaneously in a visual array, visual short-term memory (VSTM) can maintain only a limited number of these items. The present research report reveals that splitting the to-be-remembered items into two sequential arrays significantly increases VSTM performance relative to the simultaneous presentation of the same items. A memory benefit also emerges when the full object array is flashed twice (repeated) rather than being presented continuously for the same duration. Moreover, the sequential and repetition benefits are specifically pronounced for individuals with low performance for simultaneously presented items. Our results suggest that the conventional, simultaneous presentation mode may underestimate VSTM performance due to attentional limitations and/or competition between stimulus representations. In contrast, temporal segregation of the stimulus input may help participants maximize their performance and utilize their full VSTM capacity.     

The reliability and stability of visual working memory capacity

Because of the central role of working memory capacity in cognition, many studies have used short measures of working memory capacity to examine its relationship to other domains. Here, we measured the reliability and stability of visual working memory capacity, measured using a single-probe change detection task. In Experiment 1, the participants (N = 135) completed a large number of trials of a change detection task (540 in total, 180 each of set sizes 4, 6, and 8). With large numbers of both trials and participants, reliability estimates were high (α > .9). We then used an iterative down-sampling procedure to create a look-up table for expected reliability in experiments with small sample sizes. In Experiment 2, the participants (N = 79) completed 31 sessions of single-probe change detection. The first 30 sessions took place over 30 consecutive days, and the last session took place 30 days later. This unprecedented number of sessions allowed us to examine the effects of practice on stability and internal reliability. Even after much practice, individual differences were stable over time (average between-session r = .76).     

The capacity of visual short-term memory within and between hemifields

Visual short-term memory (VSTM) and attention are both thought to have a capacity limit of four items [e.g. Luck, S. J., & Vogel, E. K. (1997). The capacity of visual working memory for features and conjunctions. Nature, 309, 279-281; Pylyshyn, Z. W., & Storm, R. W. (1988). Tracking multiple independent targets: evidence for a parallel tracking mechanism. Spatial Vision, 3, 179-197.]. Using the multiple object visual tracking paradigm (MOT), it has recently been shown that twice as many items can be simultaneously attended when they are separated between two visual fields compared to when they are all presented within the same hemifield [Alvarez, G. A., & Cavanagh, P. (2004). Independent attention resources for the left and right visual hemifields (Abstract). Journal of Vision, 4(8), 29a.]. Does VSTM capacity also increase when the items to be remembered are distributed between the two visual fields? The current paper investigated this central issue in two different tasks, namely a color and spatial location change detection task, in which the items were displayed either in the two visual fields or in the same hemifield. The data revealed that only memory capacity for spatial locations and not colors increased when the items were separated between the two visual fields. These findings support the view of VSTM as a chain of capacity limited operations where the spatial selection of stimuli, which dominates in both spatial location VSTM and MOT, occupies the first place and shows independence between the two fields.     

Accessing long-term memory representations during visual change detection

In visual change detection tasks, providing a cue to the change location concurrent with the test image (post-cue) can improve performance, suggesting that, without a cue, not all encoded representations are automatically accessed. Our studies examined the possibility that post-cues can encourage the retrieval of representations stored in long-term memory (LTM). Participants detected changes in images composed of familiar objects. Performance was better when the cue directed attention to the post-change object. Supporting the role of LTM in the cue effect, the effect was similar regardless of whether the cue was presented during the inter-stimulus interval, concurrent with the onset of the test image, or after the onset of the test image. Furthermore, the post-cue effect and LTM performance were similarly influenced by encoding time. These findings demonstrate that monitoring the visual world for changes does not automatically engage LTM retrieval.     

The objects of visuospatial short-term memory: Perceptual organization and change detection

We used a colour change-detection paradigm where participants were required to remember colours of six equally spaced circles. Items were superimposed on a background so as to perceptually group them within (a) an intact ring-shaped object, (b) a physically segmented but perceptually completed ring-shaped object, or (c) a corresponding background segmented into three arc-shaped objects. A nonpredictive cue at the location of one of the circles was followed by the memory items, which in turn were followed by a test display containing a probe indicating the circle to be judged same/different. Reaction times for correct responses revealed a same-object advantage; correct responses were faster to probes on the same object as the cue than to equidistant probes on a segmented object. This same-object advantage was identical for physically and perceptually completed objects, but was only evident in reaction times, and not in accuracy measures. Not only, therefore, is it important to consider object-level perceptual organization of stimulus elements when assessing the influence of a range of factors (e.g., number and complexity of elements) in visuospatial short-term memory, but a more detailed picture of the structure of information in memory may be revealed by measuring speed as well as accuracy.     

Organization of visual short-term memory

The authors examined the organization of visual short-term memory (VSTM). Using a change-detection task, they reported that VSTM stores relational information between individual items. This relational processing is mediated by the organization of items into spatial configurations. The spatial configuration of visual objects is important for VSTM of spatial locations, colors, and shapes. When color VSTM is compared with location VSTM, spatial configuration plays an integral role because configuration is important for color VSTM, whereas color is not important for location VSTM. The authors also examined the role of attention and found that the formation of configuration is modulated by both top-down and bottom-up attentional factors. In summary, the authors proposed that VSTM stores the relational information of individual visual items on the basis of global spatial configuration.     

Characteristics of visual short-term memory

Abstract

It is clear that human beings have the capacity to retain visual information over brief intervals, and that the representation may take the form of active visualisation. However, the characteristics of the cognitive mechanism(s) or system(s) involved in visualisation and temporary storage of visual information are as yet unclear. Of particular interest are the limitations on the operation of such a system. One suggestion is that the system has a capacity of a single pattern (Phillips, 1983). Other studies have suggested that several patterns may be retained. More recent work has suggested a limitation in terms of pattern complexity or the similarity of pattern elements.

Studies of verbal short-term memory have benefited from the exploration of the effects on retention of phonological similarity or word length. Both of these effects constitute limitations on the effective function of verbal “working memory”. This paper will review contrasting views and data on the characteristics of visual short-term memory, in order to assess whether an understanding of this function might benefit from an approach analogous to that used in the theoretical development of verbal short-term memory. It is argued that there are a number of different limitations on visual short-term storage, and that these limitations may be interpreted within the context of a specialised mechanism for short-term visual storage as a component of a working memory system.     

Posterior parietal cortex activity predicts individual differences in visual short-term memory capacity

Humans show a severe capacity limit in the number of objects they can store in visual short-term memory (VSTM). We recently demonstrated with functional magnetic resonance imaging that VSTM storage capacity estimated in averaged group data correlated strongly with posterior parietal/superior occipital cortex activity (Todd & Marois, 2004). However, individuals varied widely in their VSTM capacity. Here, we examined the neural basis of these individual differences. A voxelwise, individualdifferences analysis revealed a significant correlation between posterior parietal cortex (PPC) activity and individuals’ VSTM storage capacity. In addition, a region-of-interest analysis indicated that other brain regions, particularly visual occipital cortex, may contribute to individual differences in VSTM capacity. Thus, although not ruling out contributions from other brain regions, the individual-differences approach supports a key role for the PPC in VSTM by demonstrating that its activity level predicts individual differences in VSTM storage capacity.     

A severe capacity limit in the consolidation of orientation information into visual short-term memory

Previous research has suggested that two color patches can be consolidated into visual short-term memory (VSTM) via an unlimited parallel process. Here we examined whether the same unlimited-capacity parallel process occurs for two oriented grating patches. Participants viewed two gratings that were presented briefly and masked. In blocks of trials, the gratings were presented either simultaneously or sequentially. In Experiments 1 and 2, the presentation of the stimuli was followed by a location cue that indicated the grating on which to base one’s response. In Experiment 1, participants responded whether the target grating was oriented clockwise or counterclockwise with respect to vertical. In Experiment 2, participants indicated whether the target grating was oriented along one of the cardinal directions (vertical or horizontal) or was obliquely oriented. Finally, in Experiment 3, the location cue was replaced with a third grating that appeared at fixation, and participants indicated whether either of the two test gratings matched this probe. Despite the fact that these responses required fairly coarse coding of the orientation information, across all methods of responding we found superior performance for sequential over simultaneous presentations. These findings suggest that the consolidation of oriented gratings into VSTM is severely limited in capacity and differs from the consolidation of color information.     

Interference with visual short-term memory

Working memory (Baddeley and Hitch 1974) incorporates the notion of a visuo-spatial sketch pad; a mechanism thought to be specialized for short-term storage of visuo-spatial material. However, the nature and characteristics of this hypothesized mechanism are as yet unclear. Two experiments are reported which examined selective interference in short-term visual memory. Experiment 1 contrasted recognition memory span for visual matrix patterns with that for visually presented letter sequences. These two span tasks were combined with concurrent arithmetic or a concurrent task which involved manipulation of visuo-spatial material. Results suggested that although there was a small, significant disruption by concurrent arithmetic of span for the matrix patterns, there was a substantially larger disruption of the letter span task. The converse was true for the secondary visuo-spatial task. Experiment 2 combined the span tasks with two established tasks developed by Brooks (1967). Span for matrix patterns was disrupted by a visuo-spatial task but not by a secondary verbal task. The converse was true for letter span. These results suggest that the impairment in short-term visual memory resulting from secondary arithmetic reflects a small general processing load, but that the selective interference due to mode of processing is by far the stronger effect. Results are interpreted as being entirely consistent with the notion of a specialized visuo-spatial mechanism in working memory.     

Binding in short-term visual memory

The integration of complex information in working memory, and its effect on capacity, shape the limits of conscious cognition. The literature conflicts on whether short-term visual memory represents information as integrated objects. A change-detection paradigm using objects defined by color with location or shape was used to investigate binding in short-term visual memory. Results showed that features from the same dimension compete for capacity, whereas features from different dimensions can be stored in parallel. Binding between these features can occur, but focused attention is required to create and maintain the binding over time, and this integrated format is vulnerable to interference. In the proposed model, working memory capacity is limited both by the independent capacity of simple feature stores and by demands on attention networks that integrate this distributed information into complex but unified thought objects.     

Visual short-term memory: Central capacity limitations in short-term consolidation

We investigated whether there are central capacity limitations on consolidating information in visual short-term memory (VSTM). Subjects performed a visual memory task (deciding if two displays were the same or different) and a speeded tone pitch discrimination. When the tasks were performed concurrently, interference was observed in both tasks, suggesting that VSTM consolidation requires central resources. The cost of consolidating information in VSTM (as indexed by tone task performance) did not change as the number of to-be-consolidated items was increased, in contrast to previous work that used verbal materials (Jolic?ur & Dell'Acqua, 1998 Jolic?ur, P. and Dell'Acqua, R. 1998. The demonstration of short-term consolidation. Cognitive Psychology, 36: 138–202. [Crossref], [PubMed], [Web of Science ®] , [Google Scholar]). Results from Experiments 2 and 3 suggest that this apparent difference reflected a contribution from verbal coding in previous studies. Experiments 1 and 4 provided evidence that the capacity limitations had a central locus and were not merely due to preparing for a secondary task.     

The capacity of visual short-term memory is not a fixed number of objects

Luck and Vogel (1997) have reported several striking results in support of the view that visual short-term memory (VSTM) has a fixed capacity of four objects, irrespective of how many relevant features those objects comprise. However, more recent studies have challenged this account, indicating only a weak effect of the number of objects once other factors are more evenly equated across conditions. Here, we employed a symmetry manipulation to verify object segmentation in our displays, to demonstrate that when spatial and masking factors are held constant, the number of objects per se has no effect on VSTM. Instead, VSTM capacity may reflect the number of object "parts" or feature conjunctions in a given display.     

Direct measures of short-term visual storage

Two experiments, involving seven conditions, explored the use of direct measures of visual persistence. In each, the subject was asked to judge if an intermittent stimulus appeared perceptually continuous, or whether it completely faded before the next presentation occurred. The first experiment showed that visual persistence was set at approximately 250 msec. for a recycling presentation of a circle in a tachistoscope; in another task employing a moving opaque slit passing back and forth over a circle, persistence times averaged 50 msec. longer. Reducing luminance by 2 log units increased persistence only slightly, though removing the adapting field increased it by over 100 msec. The second experiment, using the repeating circle, varied the duration of the stimulus, and compared monoptic with dichoptic presentations. Visual persistence was found to be independent of stimulus duration over a range of 4 to 200 msec., where all durations were above recognition threshold for the stimulus. Persistence was unaffected whether the stimulus was repeatedly presented in the same eye or alternated between eyes, strongly suggesting that the storage is central. Finally, a re-analysis of Dodwell and Engel's paper on stereopsis suggests that their effects can be adequately explained by visual persistence of the asynchronous stereo pairs, rather than a more complex fusion model. All of these results strongly support the use of visual persistence as a direct measure of short-term visual storage.     

How to measure working memory capacity in the change detection paradigm

Although the measurement of working memory capacity is crucial to understanding working memory and its interaction with other cognitive faculties, there are inconsistencies in the literature on how to measure capacity. We address the measurement in the change detection paradigm, popularized by Luck and Vogel (Nature, 390, 279-281, 1997). Two measures for this task-from Pashler (Perception & Psychophysics, 44, 369-378, 1988) and Cowan (The Behavioral and Brain Sciences, 24, 87-114, 2001), respectively-have been used interchangeably, even though they may yield qualitatively different conclusions. We show that the choice between these two measures is not arbitrary. Although they are motivated by the same underlying discrete-slots working memory model, each is applicable only to a specific task; the two are never interchangeable. In the course of deriving these measures, we discuss subtle but consequential flaws in the underlying discrete-slots model. These flaws motivate revision in the modal model and capacity measures.