Perfect visual short-term memory for periodic patterns

Abstract

The short-term memory for spatial frequency information was assessed by measuring the spatial frequency discrimination thresholds for briefly flashed luminance gratings as a function of the time interval between the test and reference gratings, using a computer-controlled two-interval forced-choice procedure. Discrimination thresholds were stable for interstimulus intervals in the range 1–30 sec under all conditions tested. At low contrasts, short exposure times and low spatial frequencies discrimination thresholds increased, but no interactions between stimulus parameters affecting thresholds and interstimulus interval were observed. It is concluded that factors limiting spatial discrimination are associated with the sensory coding stage. Spatial discrimination and visual memory may be based on a common representation, which is perfectly retained in short-term memory. Visual half-field tests revealed no hemispheric differences in the processing and retention of spatial frequency information.     

A visual short-term memory advantage for faces

What determines how much can be stored in visual short-term memory (VSTM)? Studies of VSTM have focused largely on stimulus-based properties such as the number or complexity of the items stored. Recent work also suggests that capacity is severely reduced for items within the same category. However, the importance for VSTM capacity of more qualitative differences in processing for different categories has not been investigated. For example, faces are processed more holistically than other objects. In Experiments 1 and 2, we show that the processing of faces, objects that are crucial socially and for which we possess considerable expertise, overcomes these limitations. More faces can be stored in VSTM than objects from other complex nonface categories. As in prior studies, at short encoding durations we found that capacity for faces was less than that for other categories. However, at longer encoding durations, capacity for faces exceeded that for nonface objects, and this advantage was specific to upright faces. Because inversion reduces holistic processing, the interaction of orientation with VSTM capacity—which occurred for faces but not objects in Experiment 3—suggests that it is holistic processing that confers an advantage for face VSTM when sufficient encoding time is allowed.     

Binding in short-term visual memory

The integration of complex information in working memory, and its effect on capacity, shape the limits of conscious cognition. The literature conflicts on whether short-term visual memory represents information as integrated objects. A change-detection paradigm using objects defined by color with location or shape was used to investigate binding in short-term visual memory. Results showed that features from the same dimension compete for capacity, whereas features from different dimensions can be stored in parallel. Binding between these features can occur, but focused attention is required to create and maintain the binding over time, and this integrated format is vulnerable to interference. In the proposed model, working memory capacity is limited both by the independent capacity of simple feature stores and by demands on attention networks that integrate this distributed information into complex but unified thought objects.     

Organization of visual short-term memory

The authors examined the organization of visual short-term memory (VSTM). Using a change-detection task, they reported that VSTM stores relational information between individual items. This relational processing is mediated by the organization of items into spatial configurations. The spatial configuration of visual objects is important for VSTM of spatial locations, colors, and shapes. When color VSTM is compared with location VSTM, spatial configuration plays an integral role because configuration is important for color VSTM, whereas color is not important for location VSTM. The authors also examined the role of attention and found that the formation of configuration is modulated by both top-down and bottom-up attentional factors. In summary, the authors proposed that VSTM stores the relational information of individual visual items on the basis of global spatial configuration.     

Interference with visual short-term memory

Working memory (Baddeley and Hitch 1974) incorporates the notion of a visuo-spatial sketch pad; a mechanism thought to be specialized for short-term storage of visuo-spatial material. However, the nature and characteristics of this hypothesized mechanism are as yet unclear. Two experiments are reported which examined selective interference in short-term visual memory. Experiment 1 contrasted recognition memory span for visual matrix patterns with that for visually presented letter sequences. These two span tasks were combined with concurrent arithmetic or a concurrent task which involved manipulation of visuo-spatial material. Results suggested that although there was a small, significant disruption by concurrent arithmetic of span for the matrix patterns, there was a substantially larger disruption of the letter span task. The converse was true for the secondary visuo-spatial task. Experiment 2 combined the span tasks with two established tasks developed by Brooks (1967). Span for matrix patterns was disrupted by a visuo-spatial task but not by a secondary verbal task. The converse was true for letter span. These results suggest that the impairment in short-term visual memory resulting from secondary arithmetic reflects a small general processing load, but that the selective interference due to mode of processing is by far the stronger effect. Results are interpreted as being entirely consistent with the notion of a specialized visuo-spatial mechanism in working memory.     

Characteristics of visual short-term memory

Abstract

It is clear that human beings have the capacity to retain visual information over brief intervals, and that the representation may take the form of active visualisation. However, the characteristics of the cognitive mechanism(s) or system(s) involved in visualisation and temporary storage of visual information are as yet unclear. Of particular interest are the limitations on the operation of such a system. One suggestion is that the system has a capacity of a single pattern (Phillips, 1983). Other studies have suggested that several patterns may be retained. More recent work has suggested a limitation in terms of pattern complexity or the similarity of pattern elements.

Studies of verbal short-term memory have benefited from the exploration of the effects on retention of phonological similarity or word length. Both of these effects constitute limitations on the effective function of verbal “working memory”. This paper will review contrasting views and data on the characteristics of visual short-term memory, in order to assess whether an understanding of this function might benefit from an approach analogous to that used in the theoretical development of verbal short-term memory. It is argued that there are a number of different limitations on visual short-term storage, and that these limitations may be interpreted within the context of a specialised mechanism for short-term visual storage as a component of a working memory system.     

Working memory training improves visual short-term memory capacity

Since antiquity, philosophers, theologians, and scientists have been interested in human memory. However, researchers today are still working to understand the capabilities, boundaries, and architecture. While the storage capabilities of long-term memory are seemingly unlimited (Bahrick, J Exp Psychol 113:1–2, 1984), working memory, or the ability to maintain and manipulate information held in memory, seems to have stringent capacity limits (e.g., Cowan, Behav Brain Sci 24:87–185, 2001). Individual differences, however, do exist and these differences can often predict performance on a wide variety of tasks (cf. Engle What is working-memory capacity? 297–314, 2001). Recently, researchers have promoted the enticing possibility that simple behavioral training can expand the limits of working memory which indeed may also lead to improvements on other cognitive processes as well (cf. Morrison and Chein, Psychol Bull Rev 18:46–60 2011). However, initial investigations across a wide variety of cognitive functions have produced mixed results regarding the transferability of training-related improvements. Across two experiments, the present research focuses on the benefit of working memory training on visual short-term memory capacity—a cognitive process that has received little attention in the training literature. Data reveal training-related improvement of global measures of visual short-term memory as well as of measures of the independent sub-processes that contribute to capacity (Awh et al., Psychol Sci 18(7):622–628, 2007). These results suggest that the ability to inhibit irrelevant information within and between trials is enhanced via n-back training allowing for selective improvement on untrained tasks. Additionally, we highlight a potential limitation of the standard adaptive training procedure and propose a modified design to ensure variability in the training environment.     

Improving visual short-term memory by sequencing the stimulus array

When multiple objects are presented briefly and simultaneously in a visual array, visual short-term memory (VSTM) can maintain only a limited number of these items. The present research report reveals that splitting the to-be-remembered items into two sequential arrays significantly increases VSTM performance relative to the simultaneous presentation of the same items. A memory benefit also emerges when the full object array is flashed twice (repeated) rather than being presented continuously for the same duration. Moreover, the sequential and repetition benefits are specifically pronounced for individuals with low performance for simultaneously presented items. Our results suggest that the conventional, simultaneous presentation mode may underestimate VSTM performance due to attentional limitations and/or competition between stimulus representations. In contrast, temporal segregation of the stimulus input may help participants maximize their performance and utilize their full VSTM capacity.     

Dynamic visual noise reduces confidence in short-term memory for visual information

Previous research has shown effects of the visual interference technique, dynamic visual noise (DVN), on visual imagery, but not on visual short-term memory, unless retention of precise visual detail is required. This study tested the prediction that DVN does also affect retention of gross visual information, specifically by reducing confidence. Participants performed a matrix pattern memory task with three retention interval interference conditions (DVN, static visual noise and no interference control) that varied from trial to trial. At recall, participants indicated whether or not they were sure of their responses. As in previous research, DVN did not impair recall accuracy or latency on the task, but it did reduce recall confidence relative to static visual noise and no interference. We conclude that DVN does distort visual representations in short-term memory, but standard coarse-grained recall measures are insensitive to these distortions.     

Time-dependent forgetting in visual short-term memory

ABSTRACT

Whether visual short-term memory can be lost over an unfilled delay, in line with time-dependent forgetting, is controversial and prior work has yielded mixed results. The present study explored time-dependent forgetting in visual short-term memory in relation to other factors. In three experiments, participants compared single target and probe objects over a 2 s or 10 s retention interval. The objects across trials were either similar or dissimilar (Experiment 1) and had to be remembered in the presence of an additional distractor (Experiment 2) or under conditions where the amount of time separating trials varied (Experiment 3). In all experiments, the retention interval manipulation made the biggest contribution to performance, with accuracy decreasing as the retention interval was lengthened from 2 s to 10 s. These results pose problems for interference and temporal distinctiveness models of memory but are compatible with temporal forgetting mechanisms such as decay.     

Sequential dynamics in visual short-term memory

Visual short-term memory (VSTM) is thought to help bridge across changes in visual input, and yet many studies of VSTM employ static displays. Here we investigate how VSTM copes with sequential input. In particular, we characterize the temporal dynamics of several different components of VSTM performance, including: storage probability, precision, variability in precision, guessing, and swapping. We used a variant of the continuous-report VSTM task developed for static displays, quantifying the contribution of each component with statistical likelihood estimation, as a function of serial position and set size. In Experiments 1 and 2, storage probability did not vary by serial position for small set sizes, but showed a small primacy effect and a robust recency effect for larger set sizes; precision did not vary by serial position or set size. In Experiment 3, the recency effect was shown to reflect an increased likelihood of swapping out items from earlier serial positions and swapping in later items, rather than an increased rate of guessing for earlier items. Indeed, a model that incorporated responding to non-targets provided a better fit to these data than alternative models that did not allow for swapping or that tried to account for variable precision. These findings suggest that VSTM is updated in a first-in-first-out manner, and they bring VSTM research into closer alignment with classical working memory research that focuses on sequential behavior and interference effects.     

Insensitivity of visual short-term memory to irrelevant visual information

Several authors have hypothesized that visuo-spatial working memory is functionally analogous to verbal working memory. Irrelevant background speech impairs verbal short-term memory. We investigated whether irrelevant visual information has an analogous effect on visual short-term memory, using a dynamic visual noise (DVN) technique known to disrupt visual imagery (Quinn & McConnell, 1996b). Experiment 1 replicated the effect of DVN on pegword imagery. Experiments 2 and 3 showed no effect of DVN on recall of static matrix patterns, despite a significant effect of a concurrent spatial tapping task. Experiment 4 showed no effect of DVN on encoding or maintenance of arrays of matrix patterns, despite testing memory by a recognition procedure to encourage visual rather than spatial processing. Serial position curves showed a one-item recency effect typical of visual short-term memory. Experiment 5 showed no effect of DVN on short-term recognition of Chinese characters, despite effects of visual similarity and a concurrent colour memory task that confirmed visual processing of the characters. We conclude that irrelevant visual noise does not impair visual short-term memory. Visual working memory may not be functionally analogous to verbal working memory, and different cognitive processes may underlie visual short-term memory and visual imagery.     

Surface assignment modulates object formation for visual short-term memory

Recent results have suggested that the operational units of visual short-term memory (VSTM) are whole objects, rather than features or the total amount of information to be remembered. Here, for the first time, the influence of surface assignment on object formation for VSTM was investigated. The observers had to memorize the features of four briefly presented (300 ms) two-part objects, followed by a mask and a cue indicating which object to report on. The experiments contrasted whether there were any apparent depth differences between the two parts of each object, and whether observers had to report on only one or both features of the post-cued target object. Depth differences induced with stereoscopic disparity, and with a pictorial depth cue (simple interposition of object features), interfered strongly with performance when both features of an object needed to be memorized, but aided performance when only a single feature needed to be remembered. Furthermore, there was considerable within-feature interference consistent with some previous findings, but contradicting others. The potential implications for conceptions of VSTM are discussed in the light of two hypothesized stages: an early feature-based stage, as well as a higher-level object-based stage where the depth manipulations exert their effects. The results argue for a strong modulatory influence of surface assignment on object formation for a VSTM task.     

Capacity limitation in short-term visual memory for contour curvature

I measured the difference threshold for contour curvature in short-term visual memory (STVM) using a two-interval forced-choice partial discrimination task. In experiments 1 and 2, the study stimulus consisting of 1 to 4 curved contours was briefly presented. It was followed by a single contour stimulus after a retention interval. The subjects judged if the test stimulus had a higher or lower curvature than the corresponding study contour. The results of experiment 1 showed that the Weber fraction increased monotonically with increasing set size. The results of experiment 2 clarified that the set-size effect was not due to a temporal limitation in encoding resulting from the short exposure time. In experiment 3, the study stimuli always consisted of 4 items, but the numbers of memorised items were different in each condition. Nevertheless, the results showed the set-size effect, which indicated that its occurrence depended largely on the capacity limitation in short-term visual memory (STVM) storage. Otherwise, the Weber fraction was not hugely higher for set size 4 compared with set size 1. It was concluded that only 1 object could be retained in STVM with high fidelity, but that at least 4 objects could be retained in STVM with some degree of fidelity.     

Interference with short-term visual memory produced by concurrent central processing

Double-letter memory and test stimuli were used in two experiments on a speek comparison task. Faster decision times were found when memory and test stimuli were physically identical than when they were the same in name only. This finding was true even with retention intervals as long as 12 sec and even when difficult tasks filled the retention intervals. However, the decision-time advantage of physically identical comparisons was greatest when the interval was not filled with a task likely to interfere with rehearsals. High verbal subjects had a smaller advantage for the physically identical comparisons than did low verbal subjects but were affected in the same way as low verbal subjects in terms of which conditions raised the overall correct comparison times, raised the error rates, and reduced the advantage of physically identical comparisons.     

Time manages interference in visual short-term memory

Emerging evidence suggests that age-related declines in memory may reflect a failure in pattern separation, a process that is believed to reduce the encoding overlap between similar stimulus representations during memory encoding. Indeed, behavioural pattern separation may be indexed by a visual continuous recognition task in which items are presented in sequence and observers report for each whether it is novel, previously viewed (old), or whether it shares features with a previously viewed item (similar). In comparison to young adults, older adults show a decreased pattern separation when the number of items between “old” and “similar” items is increased. Yet the mechanisms of forgetting underpinning this type of recognition task are yet to be explored in a cognitively homogenous group, with careful control over the parameters of the task, including elapsing time (a critical variable in models of forgetting). By extending the inter-item intervals, number of intervening items and overall decay interval, we observed in a young adult sample (N?=?35, M_age?=?19.56 years) that the critical factor governing performance was inter-item interval. We argue that tasks using behavioural continuous recognition to index pattern separation in immediate memory will benefit from generous inter-item spacing, offering protection from inter-item interference.