Perceptual completion and object-based representations in short-term visual memory

Object-based representations in visual short-term memory (VSTM) were examined using a change detection memory task. A display comprising two rows of four differently colored elements was followed by a probe display in which only one of the rows reappeared. On same trials, the probed row was identical to the corresponding row in the memory display. On different trials, two of the elements in the probed row had their colors exchanged. In each memory display, a task-irrelevant visual element appeared between the two rows, with the potential to function as an occluder. Performance was enhanced when perceptual completion meant that four, rather than eight, objects were perceived in the memory display and when the probe display revealed that the occluded elements continued behind the occluder. It appears that several forms of representation can co-occur to support VSTM, one of which is object based.     

Binding feature dimensions in visual short-term memory

We explored several possible influences on binding in visual short-term memory (VSTM) performance. The task was to report whether a test object was the same (“old” trials) or different (“new” trials) from any of the sample objects seen a second ago. The objects were composed of two features that varied from continuous to discrete shapes and colors. In “old” trials the test object appeared either in the same or different position. In “new” trials the test object differed along both features, requiring storage of only one feature per object; along one feature, requiring no binding but storage of all features; or it was created by recombining features from the sample, which requires binding. Existing storage hypotheses are unable to explain the similar sensitivity (d′) obtained in the two last conditions when position remained the same and may suggest that links are created between positions and features. Highest sensitivity occurred when the test object remained at the same position, required no binding, and discrete features were used. Object-type × position, and feature combination × position interactions occurred, suggesting different storage modes depending on whether objects change position during retention.     

Fragile visual short-term memory is an object-based and location-specific store

Fragile visual short-term memory (FM) is a recently discovered form of visual short-term memory. Evidence suggests that it provides rich and high-capacity storage, like iconic memory, yet it exists, without interference, almost as long as visual working memory. In the present study, we sought to unveil the functional underpinnings of this memory storage. We found that FM is only completely erased when the new visual scene appears at the same location and consists of the same objects as the to-be-recalled information. This result has two important implications: First, it shows that FM is an object- and location-specific store, and second, it suggests that FM might be used in everyday life when the presentation of visual information is appropriately designed.     

Rapid development of feature binding in visual short-term memory

The binding of object identity (color) and location in visual short-term memory (VSTM) was examined in 6.5- to 12.5-month-old infants (N= 144). Although we previously found that by age 6.5 months, infants can represent both color and location in VSTM, in the present study we observed that 6.5-month-old infants could not remember trivially simple color-location combinations across a 300-ms delay. However, 7.5-month-old infants could bind color and location as effectively as 12.5-month-old infants. Control conditions confirmed that the failure of 6.5-month-old infants was not a result of perceptual or attentional limitations. This rapid development of VSTM binding between 6.5 and 7.5 months occurs during a period of rapid increase in VSTM storage capacity and just after a period of dramatic neuroanatomical changes in parietal cortex. Thus, the ability to bind features and the ability to store multiple objects may both depend on a process that is mediated by posterior parietal cortex and is perhaps related to focused attention.     

Setting and changing feature priorities in visual short-term memory

Many everyday tasks require prioritizing some visual features over competing ones, both during the selection from the rich sensory input and while maintaining information in visual short-term memory (VSTM). Here, we show that observers can change priorities in VSTM when, initially, they attended to a different feature. Observers reported from memory the orientation of one of two spatially interspersed groups of black and white gratings. Using colored pre-cues (presented before stimulus onset) and retro-cues (presented after stimulus offset) predicting the to-be-reported group, we manipulated observers’ feature priorities independently during stimulus encoding and maintenance, respectively. Valid pre-cues reliably increased observers’ performance (reduced guessing, increased report precision) as compared to neutral ones; invalid pre-cues had the opposite effect. Valid retro-cues also consistently improved performance (by reducing random guesses), even if the unexpected group suddenly became relevant (invalid-valid condition). Thus, feature-based attention can reshape priorities in VSTM protecting information that would otherwise be forgotten.     

Stroboscopic visual training improves information encoding in short-term memory

The visual system has developed to transform an undifferentiated and continuous flow of information into discrete and manageable representations, and this ability rests primarily on the uninterrupted nature of the input. Here we explore the impact of altering how visual information is accumulated over time by assessing how intermittent vision influences memory retention. Previous work has shown that intermittent, or stroboscopic, visual training (i.e., practicing while only experiencing snapshots of vision) can enhance visual?Cmotor control and visual cognition, yet many questions remain unanswered about the mechanisms that are altered. In the present study, we used a partial-report memory paradigm to assess the possible changes in visual memory following training under stroboscopic conditions. In Experiment 1, the memory task was completed before and immediately after a training phase, wherein participants engaged in physical activities (e.g., playing catch) while wearing either specialized stroboscopic eyewear or transparent control eyewear. In Experiment 2, an additional group of participants underwent the same stroboscopic protocol but were delayed 24?h between training and assessment, so as to measure retention. In comparison to the control group, both stroboscopic groups (immediate and delayed retest) revealed enhanced retention of information in short-term memory, leading to better recall at longer stimulus-to-cue delays (640?C2,560?ms). These results demonstrate that training under stroboscopic conditions has the capacity to enhance some aspects of visual memory, that these faculties generalize beyond the specific tasks that were trained, and that trained improvements can be maintained for at least a day.     

Updating objects in visual short-term memory is feature selective

The purpose of this study was to examine whether the process of updating information in visual short-term memory (VSTM) is object based. We investigated whether modifying the memory of one feature of an object would automatically promote refreshing the memory of all of its other features. The results showed that the facilitative effect of updating was specific to the updated feature of an object and did not spread to its nonupdated features. This feature-selective effect suggests that updating VSTM is not object based (Experiment 1), even though storage was object based (Experiment 2). Control experiments ruled out strategy-based (Experiment 3) and stimulus-related (Experiments 4–6) accounts. Feature-selective updating may indicate that the mechanism used to modify the contents of memory may have a different basis than that used to encode or store information in memory.     

The bandwidth of consolidation into visual short-term memory depends on the visual feature

We investigated the nature of the bandwidth limit in the consolidation of visual information into visual short-term memory. In the first two experiments, we examined whether previous results showing differential consolidation bandwidth for colour and orientation resulted from methodological differences by testing the consolidation of colour information with methods used in prior orientation experiments. We briefly presented two colour patches with masks, either sequentially or simultaneously, followed by a location cue indicating the target. Participants identified the target colour via buttonpress (Experiment 1) or by clicking a location on a colour wheel (Experiment 2). Although these methods have previously demonstrated that two orientations are consolidated in a strictly serial fashion, here we found equivalent performance in the sequential and simultaneous conditions, suggesting that two colours can be consolidated in parallel. To investigate whether this difference resulted from different consolidation mechanisms or a common mechanism with different features consuming different amounts of bandwidth, Experiment 3 presented a colour patch and an oriented grating either sequentially or simultaneously. We found a lower performance in the simultaneous than the sequential condition, with orientation showing a larger impairment than colour. These results suggest that consolidation of both features share common mechanisms. However, it seems that colour requires less information to be encoded than orientation. As a result, two colours can be consolidated in parallel without exceeding the bandwidth limit, whereas two orientations or an orientation and a colour exceed the bandwidth and appear to be consolidated serially.     

Binding in short-term visual memory

The integration of complex information in working memory, and its effect on capacity, shape the limits of conscious cognition. The literature conflicts on whether short-term visual memory represents information as integrated objects. A change-detection paradigm using objects defined by color with location or shape was used to investigate binding in short-term visual memory. Results showed that features from the same dimension compete for capacity, whereas features from different dimensions can be stored in parallel. Binding between these features can occur, but focused attention is required to create and maintain the binding over time, and this integrated format is vulnerable to interference. In the proposed model, working memory capacity is limited both by the independent capacity of simple feature stores and by demands on attention networks that integrate this distributed information into complex but unified thought objects.     

The role of attention in the maintenance of feature bindings in visual short-term memory

This study examined the role of attention in maintaining feature bindings in visual short-term memory. In a change-detection paradigm, participants attempted to detect changes in the colors and orientations of multiple objects; the changes consisted of new feature values in a feature-memory condition and changes in how existing feature values were combined in a binding-memory condition. In the critical experiment, a demanding visual search task requiring sequential shifts of spatial attention was interposed during the delay interval of the change-detection task. If attention is more important for the maintenance of feature bindings than for the maintenance of unbound feature values, the attention-requiring search task should specifically disrupt performance in the binding-memory task. Contrary to this proposal, it was found that memory for bindings and memory for features were equally impaired by the search task.     

Configural encoding in visual feature binding

The role of configural encoding in feature binding was assessed using the change detection paradigm. Experiment 1 studied the relevance of location in colour–shape binding with study–test intervals ranging from 0 to 4100 ms. Location was rendered irrelevant by randomising it from study to test display or was kept unchanged from study to test. Results revealed differences between these two conditions at 0 and 200 ms, but not at 1500, 2800, and 4100 ms, suggesting that location was important for feature binding in the initial stages, but performance at longer study–test intervals was impervious to change in locations. Experiment 2 studied the effect of increasing the study-display duration by comparing performance with display durations of 200, 900, and 1500 ms, at the study test intervals of 0 and 2000 ms. Although, there was a general increase in the level of performance with increasing display duration, the interaction effect obtained in Experiment 1 was replicated. Experiments 3 and 4 studied the effect of sequential presentation of stimuli, otherwise retaining the design and procedure of Experiment 2. Different levels of performance in Experiments 2, 3, and 4 revealed the role of configural encoding in the binding process.     

Organization of visual short-term memory

The authors examined the organization of visual short-term memory (VSTM). Using a change-detection task, they reported that VSTM stores relational information between individual items. This relational processing is mediated by the organization of items into spatial configurations. The spatial configuration of visual objects is important for VSTM of spatial locations, colors, and shapes. When color VSTM is compared with location VSTM, spatial configuration plays an integral role because configuration is important for color VSTM, whereas color is not important for location VSTM. The authors also examined the role of attention and found that the formation of configuration is modulated by both top-down and bottom-up attentional factors. In summary, the authors proposed that VSTM stores the relational information of individual visual items on the basis of global spatial configuration.     

Characteristics of visual short-term memory

Abstract

It is clear that human beings have the capacity to retain visual information over brief intervals, and that the representation may take the form of active visualisation. However, the characteristics of the cognitive mechanism(s) or system(s) involved in visualisation and temporary storage of visual information are as yet unclear. Of particular interest are the limitations on the operation of such a system. One suggestion is that the system has a capacity of a single pattern (Phillips, 1983). Other studies have suggested that several patterns may be retained. More recent work has suggested a limitation in terms of pattern complexity or the similarity of pattern elements.

Studies of verbal short-term memory have benefited from the exploration of the effects on retention of phonological similarity or word length. Both of these effects constitute limitations on the effective function of verbal “working memory”. This paper will review contrasting views and data on the characteristics of visual short-term memory, in order to assess whether an understanding of this function might benefit from an approach analogous to that used in the theoretical development of verbal short-term memory. It is argued that there are a number of different limitations on visual short-term storage, and that these limitations may be interpreted within the context of a specialised mechanism for short-term visual storage as a component of a working memory system.     

Intensive video gaming improves encoding speed to visual short-term memory in young male adults

The purpose of this study was to measure the effect of action video gaming on central elements of visual attention using Bundesen's (1990) Theory of Visual Attention.To examine the cognitive impact of action video gaming, we tested basic functions of visual attention in 42 young male adults. Participants were divided into three groups depending on the amount of time spent playing action video games: non-players (< 2 h/month, N = 12), casual players (4–8 h/month, N = 10), and experienced players (> 15 h/month, N = 20). All participants were tested in three tasks which tap central functions of visual attention and short-term memory: a test based on the Theory of Visual Attention (TVA), an enumeration test and finally the Attentional Network Test (ANT). The results show that action video gaming does not seem to impact the capacity of visual short-term memory. However, playing action video games does seem to improve the encoding speed of visual information into visual short-term memory and the improvement does seem to depend on the time devoted to gaming. This suggests that intense action video gaming improves basic attentional functioning and that this improvement generalizes into other activities. The implications of these findings for cognitive rehabilitation training are discussed.     

Time-dependent forgetting in visual short-term memory

ABSTRACT

Whether visual short-term memory can be lost over an unfilled delay, in line with time-dependent forgetting, is controversial and prior work has yielded mixed results. The present study explored time-dependent forgetting in visual short-term memory in relation to other factors. In three experiments, participants compared single target and probe objects over a 2 s or 10 s retention interval. The objects across trials were either similar or dissimilar (Experiment 1) and had to be remembered in the presence of an additional distractor (Experiment 2) or under conditions where the amount of time separating trials varied (Experiment 3). In all experiments, the retention interval manipulation made the biggest contribution to performance, with accuracy decreasing as the retention interval was lengthened from 2 s to 10 s. These results pose problems for interference and temporal distinctiveness models of memory but are compatible with temporal forgetting mechanisms such as decay.     

Sequential dynamics in visual short-term memory

Visual short-term memory (VSTM) is thought to help bridge across changes in visual input, and yet many studies of VSTM employ static displays. Here we investigate how VSTM copes with sequential input. In particular, we characterize the temporal dynamics of several different components of VSTM performance, including: storage probability, precision, variability in precision, guessing, and swapping. We used a variant of the continuous-report VSTM task developed for static displays, quantifying the contribution of each component with statistical likelihood estimation, as a function of serial position and set size. In Experiments 1 and 2, storage probability did not vary by serial position for small set sizes, but showed a small primacy effect and a robust recency effect for larger set sizes; precision did not vary by serial position or set size. In Experiment 3, the recency effect was shown to reflect an increased likelihood of swapping out items from earlier serial positions and swapping in later items, rather than an increased rate of guessing for earlier items. Indeed, a model that incorporated responding to non-targets provided a better fit to these data than alternative models that did not allow for swapping or that tried to account for variable precision. These findings suggest that VSTM is updated in a first-in-first-out manner, and they bring VSTM research into closer alignment with classical working memory research that focuses on sequential behavior and interference effects.