Working memory training improves visual short-term memory capacity

Since antiquity, philosophers, theologians, and scientists have been interested in human memory. However, researchers today are still working to understand the capabilities, boundaries, and architecture. While the storage capabilities of long-term memory are seemingly unlimited (Bahrick, J Exp Psychol 113:1–2, 1984), working memory, or the ability to maintain and manipulate information held in memory, seems to have stringent capacity limits (e.g., Cowan, Behav Brain Sci 24:87–185, 2001). Individual differences, however, do exist and these differences can often predict performance on a wide variety of tasks (cf. Engle What is working-memory capacity? 297–314, 2001). Recently, researchers have promoted the enticing possibility that simple behavioral training can expand the limits of working memory which indeed may also lead to improvements on other cognitive processes as well (cf. Morrison and Chein, Psychol Bull Rev 18:46–60 2011). However, initial investigations across a wide variety of cognitive functions have produced mixed results regarding the transferability of training-related improvements. Across two experiments, the present research focuses on the benefit of working memory training on visual short-term memory capacity—a cognitive process that has received little attention in the training literature. Data reveal training-related improvement of global measures of visual short-term memory as well as of measures of the independent sub-processes that contribute to capacity (Awh et al., Psychol Sci 18(7):622–628, 2007). These results suggest that the ability to inhibit irrelevant information within and between trials is enhanced via n-back training allowing for selective improvement on untrained tasks. Additionally, we highlight a potential limitation of the standard adaptive training procedure and propose a modified design to ensure variability in the training environment.     

The capacity of visual short-term memory within and between hemifields

Visual short-term memory (VSTM) and attention are both thought to have a capacity limit of four items [e.g. Luck, S. J., & Vogel, E. K. (1997). The capacity of visual working memory for features and conjunctions. Nature, 309, 279-281; Pylyshyn, Z. W., & Storm, R. W. (1988). Tracking multiple independent targets: evidence for a parallel tracking mechanism. Spatial Vision, 3, 179-197.]. Using the multiple object visual tracking paradigm (MOT), it has recently been shown that twice as many items can be simultaneously attended when they are separated between two visual fields compared to when they are all presented within the same hemifield [Alvarez, G. A., & Cavanagh, P. (2004). Independent attention resources for the left and right visual hemifields (Abstract). Journal of Vision, 4(8), 29a.]. Does VSTM capacity also increase when the items to be remembered are distributed between the two visual fields? The current paper investigated this central issue in two different tasks, namely a color and spatial location change detection task, in which the items were displayed either in the two visual fields or in the same hemifield. The data revealed that only memory capacity for spatial locations and not colors increased when the items were separated between the two visual fields. These findings support the view of VSTM as a chain of capacity limited operations where the spatial selection of stimuli, which dominates in both spatial location VSTM and MOT, occupies the first place and shows independence between the two fields.     

Organization of visual short-term memory

The authors examined the organization of visual short-term memory (VSTM). Using a change-detection task, they reported that VSTM stores relational information between individual items. This relational processing is mediated by the organization of items into spatial configurations. The spatial configuration of visual objects is important for VSTM of spatial locations, colors, and shapes. When color VSTM is compared with location VSTM, spatial configuration plays an integral role because configuration is important for color VSTM, whereas color is not important for location VSTM. The authors also examined the role of attention and found that the formation of configuration is modulated by both top-down and bottom-up attentional factors. In summary, the authors proposed that VSTM stores the relational information of individual visual items on the basis of global spatial configuration.     

Characteristics of visual short-term memory

Abstract

It is clear that human beings have the capacity to retain visual information over brief intervals, and that the representation may take the form of active visualisation. However, the characteristics of the cognitive mechanism(s) or system(s) involved in visualisation and temporary storage of visual information are as yet unclear. Of particular interest are the limitations on the operation of such a system. One suggestion is that the system has a capacity of a single pattern (Phillips, 1983). Other studies have suggested that several patterns may be retained. More recent work has suggested a limitation in terms of pattern complexity or the similarity of pattern elements.

Studies of verbal short-term memory have benefited from the exploration of the effects on retention of phonological similarity or word length. Both of these effects constitute limitations on the effective function of verbal “working memory”. This paper will review contrasting views and data on the characteristics of visual short-term memory, in order to assess whether an understanding of this function might benefit from an approach analogous to that used in the theoretical development of verbal short-term memory. It is argued that there are a number of different limitations on visual short-term storage, and that these limitations may be interpreted within the context of a specialised mechanism for short-term visual storage as a component of a working memory system.     

Changing change detection: Improving the reliability of measures of visual short-term memory capacity

The change detection paradigm is a popular way of measuring visual short-term memory capacity. Using the paradigm, researchers have found evidence for a capacity of about four independent visual objects, confirming classic estimates that were based on the number of items that could be reported. Here, we determine the reliability of capacity measures found by change detection. We derive theoretical predictions of the variance of the capacity estimates and show how they depend on the number of items to be remembered and the guessing strategy of the observer. We compare the theoretically derived variance to the variance estimated over repeated blocks of trials with the same observer and find close correspondence between predicted and observed variances. Also, we propose a new version of the two-alternative choice change detection paradigm, in which the choice is unforced. This new paradigm reduces the variance of the capacity estimate substantially.     

Posterior parietal cortex activity predicts individual differences in visual short-term memory capacity

Humans show a severe capacity limit in the number of objects they can store in visual short-term memory (VSTM). We recently demonstrated with functional magnetic resonance imaging that VSTM storage capacity estimated in averaged group data correlated strongly with posterior parietal/superior occipital cortex activity (Todd & Marois, 2004). However, individuals varied widely in their VSTM capacity. Here, we examined the neural basis of these individual differences. A voxelwise, individualdifferences analysis revealed a significant correlation between posterior parietal cortex (PPC) activity and individuals’ VSTM storage capacity. In addition, a region-of-interest analysis indicated that other brain regions, particularly visual occipital cortex, may contribute to individual differences in VSTM capacity. Thus, although not ruling out contributions from other brain regions, the individual-differences approach supports a key role for the PPC in VSTM by demonstrating that its activity level predicts individual differences in VSTM storage capacity.     

A severe capacity limit in the consolidation of orientation information into visual short-term memory

Previous research has suggested that two color patches can be consolidated into visual short-term memory (VSTM) via an unlimited parallel process. Here we examined whether the same unlimited-capacity parallel process occurs for two oriented grating patches. Participants viewed two gratings that were presented briefly and masked. In blocks of trials, the gratings were presented either simultaneously or sequentially. In Experiments 1 and 2, the presentation of the stimuli was followed by a location cue that indicated the grating on which to base one’s response. In Experiment 1, participants responded whether the target grating was oriented clockwise or counterclockwise with respect to vertical. In Experiment 2, participants indicated whether the target grating was oriented along one of the cardinal directions (vertical or horizontal) or was obliquely oriented. Finally, in Experiment 3, the location cue was replaced with a third grating that appeared at fixation, and participants indicated whether either of the two test gratings matched this probe. Despite the fact that these responses required fairly coarse coding of the orientation information, across all methods of responding we found superior performance for sequential over simultaneous presentations. These findings suggest that the consolidation of oriented gratings into VSTM is severely limited in capacity and differs from the consolidation of color information.     

Interference with visual short-term memory

Working memory (Baddeley and Hitch 1974) incorporates the notion of a visuo-spatial sketch pad; a mechanism thought to be specialized for short-term storage of visuo-spatial material. However, the nature and characteristics of this hypothesized mechanism are as yet unclear. Two experiments are reported which examined selective interference in short-term visual memory. Experiment 1 contrasted recognition memory span for visual matrix patterns with that for visually presented letter sequences. These two span tasks were combined with concurrent arithmetic or a concurrent task which involved manipulation of visuo-spatial material. Results suggested that although there was a small, significant disruption by concurrent arithmetic of span for the matrix patterns, there was a substantially larger disruption of the letter span task. The converse was true for the secondary visuo-spatial task. Experiment 2 combined the span tasks with two established tasks developed by Brooks (1967). Span for matrix patterns was disrupted by a visuo-spatial task but not by a secondary verbal task. The converse was true for letter span. These results suggest that the impairment in short-term visual memory resulting from secondary arithmetic reflects a small general processing load, but that the selective interference due to mode of processing is by far the stronger effect. Results are interpreted as being entirely consistent with the notion of a specialized visuo-spatial mechanism in working memory.     

Binding in short-term visual memory

The integration of complex information in working memory, and its effect on capacity, shape the limits of conscious cognition. The literature conflicts on whether short-term visual memory represents information as integrated objects. A change-detection paradigm using objects defined by color with location or shape was used to investigate binding in short-term visual memory. Results showed that features from the same dimension compete for capacity, whereas features from different dimensions can be stored in parallel. Binding between these features can occur, but focused attention is required to create and maintain the binding over time, and this integrated format is vulnerable to interference. In the proposed model, working memory capacity is limited both by the independent capacity of simple feature stores and by demands on attention networks that integrate this distributed information into complex but unified thought objects.     

The capacity of visual short-term memory is not a fixed number of objects

Luck and Vogel (1997) have reported several striking results in support of the view that visual short-term memory (VSTM) has a fixed capacity of four objects, irrespective of how many relevant features those objects comprise. However, more recent studies have challenged this account, indicating only a weak effect of the number of objects once other factors are more evenly equated across conditions. Here, we employed a symmetry manipulation to verify object segmentation in our displays, to demonstrate that when spatial and masking factors are held constant, the number of objects per se has no effect on VSTM. Instead, VSTM capacity may reflect the number of object "parts" or feature conjunctions in a given display.     

Time-dependent forgetting in visual short-term memory

ABSTRACT

Whether visual short-term memory can be lost over an unfilled delay, in line with time-dependent forgetting, is controversial and prior work has yielded mixed results. The present study explored time-dependent forgetting in visual short-term memory in relation to other factors. In three experiments, participants compared single target and probe objects over a 2 s or 10 s retention interval. The objects across trials were either similar or dissimilar (Experiment 1) and had to be remembered in the presence of an additional distractor (Experiment 2) or under conditions where the amount of time separating trials varied (Experiment 3). In all experiments, the retention interval manipulation made the biggest contribution to performance, with accuracy decreasing as the retention interval was lengthened from 2 s to 10 s. These results pose problems for interference and temporal distinctiveness models of memory but are compatible with temporal forgetting mechanisms such as decay.     

Sequential dynamics in visual short-term memory

Visual short-term memory (VSTM) is thought to help bridge across changes in visual input, and yet many studies of VSTM employ static displays. Here we investigate how VSTM copes with sequential input. In particular, we characterize the temporal dynamics of several different components of VSTM performance, including: storage probability, precision, variability in precision, guessing, and swapping. We used a variant of the continuous-report VSTM task developed for static displays, quantifying the contribution of each component with statistical likelihood estimation, as a function of serial position and set size. In Experiments 1 and 2, storage probability did not vary by serial position for small set sizes, but showed a small primacy effect and a robust recency effect for larger set sizes; precision did not vary by serial position or set size. In Experiment 3, the recency effect was shown to reflect an increased likelihood of swapping out items from earlier serial positions and swapping in later items, rather than an increased rate of guessing for earlier items. Indeed, a model that incorporated responding to non-targets provided a better fit to these data than alternative models that did not allow for swapping or that tried to account for variable precision. These findings suggest that VSTM is updated in a first-in-first-out manner, and they bring VSTM research into closer alignment with classical working memory research that focuses on sequential behavior and interference effects.     

Insensitivity of visual short-term memory to irrelevant visual information

Several authors have hypothesized that visuo-spatial working memory is functionally analogous to verbal working memory. Irrelevant background speech impairs verbal short-term memory. We investigated whether irrelevant visual information has an analogous effect on visual short-term memory, using a dynamic visual noise (DVN) technique known to disrupt visual imagery (Quinn & McConnell, 1996b). Experiment 1 replicated the effect of DVN on pegword imagery. Experiments 2 and 3 showed no effect of DVN on recall of static matrix patterns, despite a significant effect of a concurrent spatial tapping task. Experiment 4 showed no effect of DVN on encoding or maintenance of arrays of matrix patterns, despite testing memory by a recognition procedure to encourage visual rather than spatial processing. Serial position curves showed a one-item recency effect typical of visual short-term memory. Experiment 5 showed no effect of DVN on short-term recognition of Chinese characters, despite effects of visual similarity and a concurrent colour memory task that confirmed visual processing of the characters. We conclude that irrelevant visual noise does not impair visual short-term memory. Visual working memory may not be functionally analogous to verbal working memory, and different cognitive processes may underlie visual short-term memory and visual imagery.     

The capacity of visual short-term memory is set both by visual information load and by number of objects

Previous research has suggested that visual short-term memory has a fixed capacity of about four objects. However, we found that capacity varied substantially across the five stimulus classes we examined, ranging from 1.6 for shaded cubes to 4.4 for colors (estimated using a change detection task). We also estimated the information load per item in each class, using visual search rate. The changes we measured in memory capacity across classes were almost exactly mirrored by changes in the opposite direction in visual search rate (r2=.992 between search rate and the reciprocal of memory capacity). The greater the information load of each item in a stimulus class (as indicated by a slower search rate), the fewer items from that class one can hold in memory. Extrapolating this linear relationship reveals that there is also an upper bound on capacity of approximately four or five objects. Thus, both the visual information load and number of objects impose capacity limits on visual short-term memory.     

A feature-segmentation model of short-term visual memory

A feature-segmentation model of short-term visual memory (STVM) for contours is proposed. Memory of the First stimulus is maintained until the second stimulus is observed. Three processes interact to determine the relationship between stimulus and response: feature encoding, memory, and decision. Basic assumptions of the model are twofold: (i) the STVM system divides a contour into convex parts at regions of concavity; and (ii) the value of each convex part represented in STVM is an independent Gaussian random variable. Simulation showed that the five-parameter fits give a good account of the effects of the four experimental variables. The model provides evidence that: (i) contours are successfully encoded within 0.5 s exposure, regardless of pattern complexity; (ii) memory noise increases as a linear function of retention interval; (iii) the capacity of STVM, defined by pattern complexity (the degree that a pattern can be handled for several seconds with little loss), is about 4 convex parts; and (iv) the confusability contributing to the decision process is a primary factor in deteriorating recognition of complex figures. It is concluded that visually presented patterns can be retained in STVM with considerable precision for prolonged periods of time, though some loss of precision is inevitable.     

Splitting attention across the two visual fields in visual short-term memory

Humans have the ability to attentionally select the most relevant visual information from their extrapersonal world and to retain it in a temporary buffer, known as visual short-term memory (VSTM). Research suggests that at least two non-contiguous items can be selected simultaneously when they are distributed across the two visual hemifields. In two experiments, we show that attention can also be split between the left and right sides of internal representations held in VSTM. Participants were asked to remember several colors, while cues presented during the delay instructed them to orient their attention to a subset of memorized colors. Experiment 1 revealed that orienting attention to one or two colors strengthened equally participants' memory for those colors, but only when they were from separate hemifields. Experiment 2 showed that in the absence of attentional cues the distribution of the items in the visual field per se had no effect on memory. These findings strongly suggest the existence of independent attentional resources in the two hemifields for selecting and/or consolidating information in VSTM.     

Perfect visual short-term memory for periodic patterns

Abstract

The short-term memory for spatial frequency information was assessed by measuring the spatial frequency discrimination thresholds for briefly flashed luminance gratings as a function of the time interval between the test and reference gratings, using a computer-controlled two-interval forced-choice procedure. Discrimination thresholds were stable for interstimulus intervals in the range 1–30 sec under all conditions tested. At low contrasts, short exposure times and low spatial frequencies discrimination thresholds increased, but no interactions between stimulus parameters affecting thresholds and interstimulus interval were observed. It is concluded that factors limiting spatial discrimination are associated with the sensory coding stage. Spatial discrimination and visual memory may be based on a common representation, which is perfectly retained in short-term memory. Visual half-field tests revealed no hemispheric differences in the processing and retention of spatial frequency information.     

Letter string processing and visual short-term memory

The present study investigated whether expertise with letter string processing influences visual short-term memory capacity. Specifically, we examined whether performance in a change-detection task would vary as a function of stimulus type (letters vs. symbols) and type of display (horizontal, vertical, and circular). Participants were asked to detect a one-character change in a briefly presented character array following a delay of 900?ms. Concurrent articulation was used to limit effects of rehearsal. Type of display significantly affected performance with letters, but not with symbols, with a selective increase in change-detection accuracy for horizontally presented letter arrays compared with vertical and circular arrays. These findings confirm the standard limits of storage in visual short-term memory, but critically reveal a selective advantage for letter arrays over symbol arrays when presented horizontally. Such an advantage is probably due to the utilization of a specialized encoding mechanism built up over years of reading experience.