Organization of visual short-term memory

The authors examined the organization of visual short-term memory (VSTM). Using a change-detection task, they reported that VSTM stores relational information between individual items. This relational processing is mediated by the organization of items into spatial configurations. The spatial configuration of visual objects is important for VSTM of spatial locations, colors, and shapes. When color VSTM is compared with location VSTM, spatial configuration plays an integral role because configuration is important for color VSTM, whereas color is not important for location VSTM. The authors also examined the role of attention and found that the formation of configuration is modulated by both top-down and bottom-up attentional factors. In summary, the authors proposed that VSTM stores the relational information of individual visual items on the basis of global spatial configuration.     

Does visual short-term memory have a high-capacity stage?

Visual short-term memory (VSTM) has long been considered a durable, limited-capacity system for the brief retention of visual information. However, a recent work by Sligte et al. (Plos One 3:e1699, 2008) reported that, relatively early after the removal of a memory array, a cue allowed participants to access a fragile, high-capacity stage of VSTM that is distinct from iconic memory. In the present study, we examined whether this stage division is warranted by attempting to corroborate the existence of an early, high-capacity form of VSTM. The results of four experiments did not support Sligte et al.’s claim, since we did not obtain evidence for VSTM retention that exceeded traditional estimates of capacity. However, performance approaching that observed in Sligte et al. can be achieved through extensive practice, providing a clear explanation for their findings. Our evidence favors the standard view of VSTM as a limited-capacity system that maintains a few object representations in a relatively durable form.     

Distributing versus focusing attention in visual short-term memory

Visual short-term memory (VSTM) is traditionally considered a robust form of visual memory resistant to interference from subsequent visual input. This study shows that the robustness of VSTM depends on the way attention is allocated in VSTM. When attention is distributed across multiple memory items, VSTM for these items is vulnerable to interference from subsequent input, including passively viewed images and the postchange testing displays. Yet attention can readjust its focus in VSTM on the basis of an attentional orienting cue presented long after encoding. When attention is oriented to a particular memorized item, the memory is resistant to subsequent interference. This effect, however, is eliminated when the subset of items demanding focal attention exceeds one, suggesting that orienting attention in VSTM is less flexible than orienting attention in perception. We propose that the robustness of VSTM is influenced by whether attention is focused or distributed in VSTM.     

Attention effects during visual short-term memory maintenance: protection or prioritization?

Interactions between visual attention and visual short-term memory (VSTM) play a central role in cognitive processing. For example, attention can assist in selectively encoding items into visual memory. Attention appears to be able to influence items already stored in visual memory, as well; cues that appear long after the presentation of an array of objects can affect memory for those objects (Griffin & Nobre, 2003). In five experiments, we distinguished two possible mechanisms for the effects of cues on items currently stored in VSTM. A protection account proposes that attention protects the cued item from becoming degraded during the retention interval. By contrast, aprioritization account suggests that attention increases a cued item's priority during the comparison process that occurs when memory is tested. The results of the experiments were consistent with the first of these possibilities, suggesting that attention can serve to protect VSTM representations while they are being maintained.     

Limited capacity for contour curvature in iconic memory

We measured the difference threshold for contour curvature in iconic memory by using the cued discrimination method. The study stimulus consisting of 2 to 6 curved contours was briefly presented in the fovea, followed by two lines as cues. Subjects discriminated the curvature of two cued curves. The cue delays were 0 msec. and 300 msec. in Exps. 1 and 2, respectively, and 50 msec. before the study offset in Exp. 3. Analysis of data from Exps. 1 and 2 showed that the Weber fraction rose monotonically with the increase in set size. Clear set-size effects indicate that iconic memory has a limited capacity. Moreover, clear set-size effect in Exp. 3 indicates that perception itself has a limited capacity. Larger set-size effects in Exp. 1 than in Exp. 3 suggest that iconic memory after perceptual process has limited capacity. These properties of iconic memory at threshold level are contradictory to the traditional view that iconic memory has a high capacity both at suprathreshold and categorical levels.     

Retrospective cues based on object features improve visual working memory performance in older adults

Research with younger adults has shown that retrospective cues can be used to orient top-down attention toward relevant items in working memory. We examined whether older adults could take advantage of these cues to improve memory performance. Younger and older adults were presented with visual arrays of five colored shapes; during maintenance, participants were presented either with an informative cue based on an object feature (here, object shape or color) that would be probed, or with an uninformative, neutral cue. Although older adults were less accurate overall, both age groups benefited from the presentation of an informative, feature-based cue relative to a neutral cue. Surprisingly, we also observed differences in the effectiveness of shape versus color cues and their effects upon post-cue memory load. These results suggest that older adults can use top-down attention to remove irrelevant items from visual working memory, provided that task-relevant features function as cues.     

Exogenous attention influences visual short-term memory in infants

Two experiments examined the hypothesis that developing visual attentional mechanisms influence infants' Visual Short-Term Memory (VSTM) in the context of multiple items. Five- and 10-month-old infants (N = 76) received a change detection task in which arrays of three differently colored squares appeared and disappeared. On each trial one square changed color and one square was cued; sometimes the cued item was the changing item, and sometimes the changing item was not the cued item. Ten-month-old infants exhibited enhanced memory for the cued item when the cue was a spatial pre-cue (Experiment 1) and 5-month-old infants exhibited enhanced memory for the cued item when the cue was relative motion (Experiment 2). These results demonstrate for the first time that infants younger than 6 months can encode information in VSTM about individual items in multiple-object arrays, and that attention-directing cues influence both perceptual and VSTM encoding of stimuli in infants as in adults.     

Splitting attention across the two visual fields in visual short-term memory

Humans have the ability to attentionally select the most relevant visual information from their extrapersonal world and to retain it in a temporary buffer, known as visual short-term memory (VSTM). Research suggests that at least two non-contiguous items can be selected simultaneously when they are distributed across the two visual hemifields. In two experiments, we show that attention can also be split between the left and right sides of internal representations held in VSTM. Participants were asked to remember several colors, while cues presented during the delay instructed them to orient their attention to a subset of memorized colors. Experiment 1 revealed that orienting attention to one or two colors strengthened equally participants' memory for those colors, but only when they were from separate hemifields. Experiment 2 showed that in the absence of attentional cues the distribution of the items in the visual field per se had no effect on memory. These findings strongly suggest the existence of independent attentional resources in the two hemifields for selecting and/or consolidating information in VSTM.     

The capacity of visual short-term memory within and between hemifields

Visual short-term memory (VSTM) and attention are both thought to have a capacity limit of four items [e.g. Luck, S. J., & Vogel, E. K. (1997). The capacity of visual working memory for features and conjunctions. Nature, 309, 279-281; Pylyshyn, Z. W., & Storm, R. W. (1988). Tracking multiple independent targets: evidence for a parallel tracking mechanism. Spatial Vision, 3, 179-197.]. Using the multiple object visual tracking paradigm (MOT), it has recently been shown that twice as many items can be simultaneously attended when they are separated between two visual fields compared to when they are all presented within the same hemifield [Alvarez, G. A., & Cavanagh, P. (2004). Independent attention resources for the left and right visual hemifields (Abstract). Journal of Vision, 4(8), 29a.]. Does VSTM capacity also increase when the items to be remembered are distributed between the two visual fields? The current paper investigated this central issue in two different tasks, namely a color and spatial location change detection task, in which the items were displayed either in the two visual fields or in the same hemifield. The data revealed that only memory capacity for spatial locations and not colors increased when the items were separated between the two visual fields. These findings support the view of VSTM as a chain of capacity limited operations where the spatial selection of stimuli, which dominates in both spatial location VSTM and MOT, occupies the first place and shows independence between the two fields.     

Improving visual short-term memory by sequencing the stimulus array

When multiple objects are presented briefly and simultaneously in a visual array, visual short-term memory (VSTM) can maintain only a limited number of these items. The present research report reveals that splitting the to-be-remembered items into two sequential arrays significantly increases VSTM performance relative to the simultaneous presentation of the same items. A memory benefit also emerges when the full object array is flashed twice (repeated) rather than being presented continuously for the same duration. Moreover, the sequential and repetition benefits are specifically pronounced for individuals with low performance for simultaneously presented items. Our results suggest that the conventional, simultaneous presentation mode may underestimate VSTM performance due to attentional limitations and/or competition between stimulus representations. In contrast, temporal segregation of the stimulus input may help participants maximize their performance and utilize their full VSTM capacity.     

The illusion of control: Sequential dependencies underlie contingent attentional capture

The degree to which humans have top-down control over which information they process remains a central debate within the attention literature. Most of the evidence supporting the top-down control of visuospatial attention has come from cueing paradigms in which target stimuli are preceded by cues that are similar or dissimilar from the target. These studies find that the cues similar to targets capture attention, but dissimilar cues do not, suggesting the top-down control of attention. Here, we used a modified cueing paradigm to investigate an alternative possibility that the cue type differences are due to sequential dependency effects occurring between cue and target processing rather than the top-down control of attention. When individuals searched for color targets, we replicated contingent capture effects in RTs, which are susceptible to sequential dependencies, but memory performance was always best at the cued locations, regardless of the cue’s identity. When individuals searched for onset targets, we observed contingent capture in both tasks. These results demonstrate the utility of the memory probe paradigm and suggest an asymmetry between how strongly onsets and color defined cues capture attention.     

The benefit of forgetting

Recent research using change-detection tasks has shown that a directed-forgetting cue, indicating that a subset of the information stored in memory can be forgotten, significantly benefits the other information stored in visual working memory. How do these directed-forgetting cues aid the memory representations that are retained? We addressed this question in the present study by using a recall paradigm to measure the nature of the retained memory representations. Our results demonstrated that a directed-forgetting cue leads to higher-fidelity representations of the remaining items and a lower probability of dropping these representations from memory. Next, we showed that this is made possible by the to-be-forgotten item being expelled from visual working memory following the cue, allowing maintenance mechanisms to be focused on only the items that remain in visual working memory. Thus, the present findings show that cues to forget benefit the remaining information in visual working memory by fundamentally improving their quality relative to conditions in which just as many items are encoded but no cue is provided.     

Improving visual spatial working memory in younger and older adults: effects of cross-modal cues

Spatially informative auditory and vibrotactile (cross-modal) cues can facilitate attention but little is known about how similar cues influence visual spatial working memory (WM) across the adult lifespan. We investigated the effects of cues (spatially informative or alerting pre-cues vs. no cues), cue modality (auditory vs. vibrotactile vs. visual), memory array size (four vs. six items), and maintenance delay (900 vs. 1800 ms) on visual spatial location WM recognition accuracy in younger adults (YA) and older adults (OA). We observed a significant interaction between spatially informative pre-cue type, array size, and delay. OA and YA benefitted equally from spatially informative pre-cues, suggesting that attentional orienting prior to WM encoding, regardless of cue modality, is preserved with age. Contrary to predictions, alerting pre-cues generally impaired performance in both age groups, suggesting that maintaining a vigilant state of arousal by facilitating the alerting attention system does not help visual spatial location WM.     

Visual short-term memory load strengthens selective attention

Perceptual load theory accounts for many attentional phenomena; however, its mechanism remains elusive because it invokes underspecified attentional resources. Recent dual-task evidence has revealed that a concurrent visual short-term memory (VSTM) load slows visual search and reduces contrast sensitivity, but it is unknown whether a VSTM load also constricts attention in a canonical perceptual load task. If attentional selection draws upon VSTM resources, then distraction effects—which measure attentional “spill-over”—will be reduced as competition for resources increases. Observers performed a low perceptual load flanker task during the delay period of a VSTM change detection task. We observed a reduction of the flanker effect in the perceptual load task as a function of increasing concurrent VSTM load. These findings were not due to perceptual-level interactions between the physical displays of the two tasks. Our findings suggest that perceptual representations of distractor stimuli compete with the maintenance of visual representations held in memory. We conclude that access to VSTM determines the degree of attentional selectivity; when VSTM is not completely taxed, it is more likely for task-irrelevant items to be consolidated and, consequently, affect responses. The “resources” hypothesized by load theory are at least partly mnemonic in nature, due to the strong correspondence they share with VSTM capacity.     

The role of central attention in retrieval from visual short-term memory

The role of central attention in visual short-term memory (VSTM) encoding and maintenance is well established, yet its role in retrieval has been largely unexplored. This study examined the involvement of central attention in retrieval from VSTM using a dual-task paradigm. Participants performed a color change-detection task. Set size varied between 1 and 3 items, and the memory sample was maintained for either a short or a long delay period. A secondary tone discrimination task was introduced at the end of the delay period, shortly before the appearance of a central probe, and occupied central attention while participants were searching within VSTM representations. Similarly to numerous previous studies, reaction time increased as a function of set size reflecting the occurrence of a capacity-limited memory search. When the color targets were maintained over a short delay, memory was searched for the most part without the involvement of central attention. However, with a longer delay period, the search relied entirely on the operation of central attention. Taken together, this study demonstrates that central attention is involved in retrieval from VSTM, but the extent of its involvement depends on the duration of the delay period. Future studies will determine whether the type of memory search (parallel or serial) carried out during retrieval depends on the nature of the attentional mechanism involved the task.     

Visual cognition influences early vision: the role of visual short-term memory in amodal completion

A partly occluded visual object is perceptually filled in behind the occluding surface, a process known as amodal completion or visual interpolation. Previous research focused on the image-based properties that lead to amodal completion. In the present experiments, we examined the role of a higher-level visual process-visual short-term memory (VSTM)-in amodal completion. We measured the degree of amodal completion by asking participants to perform an object-based attention task on occluded objects while maintaining either zero or four items in visual working memory. When no items were stored in VSTM, participants completed the occluded objects; when four items were stored in VSTM, amodal completion was halted (Experiment 1). These results were not caused by the influence of VSTM on object-based attention per se (Experiment 2) or by the specific location of to-be-remembered items (Experiment 3). Items held in VSTM interfere with amodal completion, which suggests that amodal completion may not be an informationally encapsulated process, but rather can be affected by high-level visual processes.     

Parallel consolidation of simple features into visual short-term memory

Although considerable research has examined the storage limits of visual short-term memory (VSTM), little is known about the initial formation (i.e., the consolidation) of VSTM representations. A few previous studies have estimated the capacity of consolidation to be one item at a time. Here we used a sequential-simultaneous manipulation to reexamine the limits of consolidating items into VSTM. Participants viewed briefly presented and masked color patches (targets), which were shown either sequentially or simultaneously. A probe color followed the targets and participants decided whether it matched one of the targets or was a novel color. In four experiments, we consistently found equal performance for sequential and simultaneous presentations for two targets. Worse performance in the simultaneous than the sequential condition was observed for larger set sizes (three and four). Contrary to previous results, suggesting a severe capacity limit of one item, our results indicate that consolidation into VSTM can occur in parallel and without capacity limits for at least two items.     

The role of relational information in contingent capture

On the contingent capture account, top-down attentional control settings restrict involuntary attentional capture to items that match the features of the search target. Attention capture is involuntary, but contingent on goals and intentions. The observation that only target-similar items can capture attention has usually been taken to show that the content of the attentional control settings consists of specific feature values. In contrast, the present study demonstrates that the top-down target template can include information about the relationship between the target and nontarget features (e.g., redder, darker, larger). Several spatial cuing experiments show that a singleton cue that is less similar to the target but that shares the same relational property that distinguishes targets from nontargets can capture attention to the same extent as cues that are similar to the target. Moreover, less similar cues can even capture attention more than cues that are identical to the target when they are relationally better than identical cues. The implications for current theories of attentional capture and attentional guidance are discussed.     

Reflexive orienting in response to short- and long-duration gaze cues in young,young-old,and old-old adults

Shifting visual focus on the basis of the perceived gaze direction of another person is one form of joint attention. In the present study, we investigated whether this socially relevant form of orienting is reflexive and whether it is influenced by age. Green and Woldorff (Cognition 122:96–101, 2012) argued that rapid cueing effects (i.e., faster responses to validly than to invalidly cued targets) were limited to conditions in which a cue overlapped in time with a target. They attributed slower responses following invalid cues to the time needed to resolve the incongruent spatial information provided by the concurrently presented cue and target. In the present study, we examined the orienting responses of young (18–31 years), young-old (60–74 years), and old-old (75–91 years) adults following uninformative central gaze cues that overlapped in time with the target (Exp. 1) or that were removed prior to target presentation (Exp. 2). When the cue and target overlapped, all three groups localized validly cued targets more quickly than invalidly cued targets, and validity effects emerged earlier for the two younger groups (at 100 ms post-cue-onset) than for the old-old group (at 300 ms post-cue-onset). With a short-duration cue (Exp. 2), validity effects developed rapidly (by 100 ms) for all three groups, suggesting that validity effects resulted from reflexive orienting based on the gaze cue information rather than from cue–target conflict. Thus, although old-old adults may be slow to disengage from persistent gaze cues, attention continues to be reflexively guided by gaze cues late in life.     

There are Multiple Contributors to the Verbal Short-Term Memory Deficit in Children with Developmental Reading Disabilities

Prior research has put forth at least four possible contributors to the verbal short-term memory (VSTM) deficit in children with developmental reading disabilities (RD): poor phonological awareness that affects phonological coding into VSTM, a less effective phonological store, slow articulation rate, and fewer/poorer quality long-term memory (LTM) representations. This project is among the first to test the four suppositions in one study. Participants included 18 children with RD and 18 controls. VSTM was assessed using Baddeley's model of the phonological loop. Findings suggest all four suppositions are correct, depending upon the type of material utilized. Children with RD performed comparably to controls in VSTM for common words but worse for less frequent words and nonwords. Furthermore, only articulation rate predicted VSTM for common words, whereas Verbal IQ and articulation rate predicted VSTM for less frequent words, and phonological awareness and articulation rate predicted VSTM for nonwords. Overall, findings suggest that the mechanism(s) used to code and store items by their meaning is intact in RD, and the deficit in VSTM for less frequent words may be a result of fewer/poorer quality LTM representations for these words. In contrast, phonological awareness and the phonological store are impaired, affecting VSTM for items that are coded phonetically. Slow articulation rate likely affects VSTM for most material when present. When assessing reading performance, VSTM predicted decoding skill but not word identification after controlling Verbal IQ and phonological awareness. Thus, VSTM likely contributes to reading ability when words are novel and must be decoded.