Effects of verbal and nonverbal interference on spatial and object visual working memory

We tested the hypothesis that a verbal coding mechanism is necessarily engaged by object, but not spatial, visual working memory tasks. We employed a dual-task procedure that paired n-back working memory tasks with domain-specific distractor trials inserted into each interstimulus interval of the n-back tasks. In two experiments, object n-back performance demonstrated greater sensitivity to verbal distraction, whereas spatial n-back performance demonstrated greater sensitivity to motion distraction. Visual object and spatial working memory may differ fundamentally in that the mnemonic representation of featural characteristics of objects incorporates a verbal (perhaps semantic) code, whereas the mnemonic representation of the location of objects does not. Thus, the processes supporting working memory for these two types of information may differ in more ways than those dictated by the "what/where" organization of the visual system, a fact more easily reconciled with a component process than a memory systems account of working memory function.     

The plateau in mnemonic resolution across large set sizes indicates discrete resource limits in visual working memory

The precision of visual working memory (WM) representations declines monotonically with increasing storage load. Two distinct models of WM capacity predict different shapes for this precision-by-set-size function. Flexible-resource models, which assert a continuous allocation of resources across an unlimited number of items, predict a monotonic decline in precision across a large range of set sizes. Conversely, discrete-resource models, which assert a relatively small item limit for WM storage, predict that precision will plateau once this item limit is exceeded. Recent work has demonstrated such a plateau in mnemonic precision. Moreover, the set size at which mnemonic precision reached asymptote has been strongly predicted by estimated item limits in WM. In the present work, we extend this evidence in three ways. First, we show that this empirical pattern generalizes beyond orientation memory to color memory. Second, we rule out encoding limits as the source of discrete limits by demonstrating equivalent performance across simultaneous and sequential presentations of the memoranda. Finally, we demonstrate that the analytic approach commonly used to estimate precision yields flawed parameter estimates when the range of stimulus space is narrowed (e.g., a 180o rather than a 360o orientation space) and typical numbers of observations are collected. Such errors in parameter estimation reconcile an apparent conflict between our findings and others based on different stimuli. These findings provide further support for discrete-resource models of WM capacity.     

Perceptual expertise enhances the resolution but not the number of representations in working memory

Despite its central role in cognition, capacity in visual working memory is restricted to about three or four items. Curby and Gauthier (2007) examined whether perceptual expertise can help to overcome this limit by enabling more efficient coding of visual information. In line with this, they observed higher capacity estimates for upright than for inverted faces, suggesting that perceptual expertise enhances visual working memory. In the present work, we examined whether the improved capacity estimates for upright faces indicates an increased number of "slots" in working memory, or improved resolution within the existing slots. Our results suggest that perceptual expertise enhances the resolution but not the number of representations that can be held in working memory. These results clarify the effects of perceptual expertise in working memory and support recent suggestions that number and resolution represent distinct facets of working memory ability.     

Placing the mnemonic model in context: diagnostic, theoretical, and clinical considerations

The mnemonic model of posttraumatic stress disorder (PTSD) proposed by D. C. Rubin, D. Berntsen, and M. K. Bohni presents some provocative and potentially insightful ideas about this mental disorder. D. C. Rubin et al. suggested that PTSD is caused and maintained through a "pathogenic memory" (D. C. Rubin et al., 2008, p. 985) of a negative event rather than by exposure to a traumatic event per se. The present authors examine the mnemonic model in the context of relevant diagnostic, theoretical, and clinical considerations. Specifically, to evaluate the arguments and evidence provided in support of the mnemonic model of PTSD, the present authors focus on 4 issues: (a) problems inherent with comparing a theoretical model (i.e., the mnemonic model) with a diagnostic model (i.e., the DSM-IV-TR model), (b) problems with not comparing the mnemonic model with relevant cognitive and memory models of PTSD, (c) problems with the degree to which the research reviewed provides support for the mnemonic model, and (d) concerns that memory in PTSD is confounded with the basic disorder, rather than causing PTSD. The present authors conclude with suggestions for future theory and research to help differentiate between memory's role in the origins of PTSD and memory's role in the clinical course of the disorder.     

Signal Detection Models with Random Participant and Item Effects

The theory of signal detection is convenient for measuring mnemonic ability in recognition memory paradigms. In these paradigms, randomly selected participants are asked to study randomly selected items. In practice, researchers aggregate data across items or participants or both. The signal detection model is nonlinear; consequently, analysis with aggregated data is not consistent. In fact, mnemonic ability is underestimated, even in the large-sample limit. We present two hierarchical Bayesian models that simultaneously account for participant and item variability. We show how these models provide for accurate estimation of participants’ mnemonic ability as well as the memorability of items. The model is benchmarked with a simulation study and applied to a novel data set. This research is supported by NSF grants SES-0095919 and SES-0351523, NIH grant R01-MH071418, a University of Missouri Research Leave grant and fellowships from the Spanish Ministry of Education and the University of Leuven, Belgium.     

Resources masquerading as slots: Flexible allocation of visual working memory

Whether the capacity of visual working memory is better characterized by an item-based or a resource-based account continues to be keenly debated. Here, we propose that visual working memory is a flexible resource that is sometimes deployed in a slot-like manner. We develop a computational model that can either encode all items in a memory set, or encode only a subset of those items. A fixed-capacity mnemonic resource is divided among the items in memory. When fewer items are encoded, they are each remembered with higher fidelity, but at the cost of having to rely on an explicit guessing process when probed about an item that is not in memory. We use the new model to test the prediction that participants will more often encode the entire set of items when the demands on memory are predictable.     

A bilateral advantage for storage in visual working memory

Various studies have demonstrated enhanced visual processing when information is presented across both visual hemifields rather than in a single hemifield (the bilateral advantage). For example, Alvarez and Cavanagh (2005) reported that observers were able to track twice as many moving visual stimuli when the tracked items were presented bilaterally rather than unilaterally, suggesting that independent resources enable tracking in the two visual fields. Motivated by similarities in the apparent capacity and neural substrates that mediate tracking and visual working memory (WM), the present work examined whether or not a bilateral advantage also arises during storage in visual WM. Using a recall procedure to assess working memory for orientation information, we found a reliable bilateral advantage; recall error was smaller with bilateral sample displays than with unilateral displays. To demonstrate that the bilateral advantage influenced storage per se rather than just encoding efficiency, we replicated the observed bilateral advantage using sequentially presented stimuli. Finally, to further characterize how bilateral presentations enhanced storage in working memory, we measured both the number and the resolution of the stored items and found that bilateral presentations lead to an increased probability of storage, rather than enhanced mnemonic resolution. Thus, the bilateral advantage extends beyond the initial selection and encoding of visual information to influence online maintenance in visual working memory.     

Visual short-term memory always requires general attention

The role of attention in visual memory remains controversial; while some evidence has suggested that memory for binding between features demands no more attention than does memory for the same features, other evidence has indicated cognitive costs or mnemonic benefits for explicitly attending to bindings. We attempted to reconcile these findings by examining how memory for binding, for features, and for features during binding is affected by a concurrent attention-demanding task. We demonstrated that performing a concurrent task impairs memory for as few as two visual objects, regardless of whether each object includes one or more features. We argue that this pattern of results reflects an essential role for domain-general attention in visual memory, regardless of the simplicity of the to-be-remembered stimuli. We then discuss the implications of these findings for theories of visual working memory.     

Self-referencing enhances memory specificity with age

Self-referencing has been identified as an advantageous mnemonic strategy for young and older adults. However, little research has investigated the ways in which self-referencing may influence older adults' memory for details, which is typically impaired with age, beyond memory for the item itself. Experiment 1 assessed the effects of self- and other-referencing on memory for visually detailed pictures of objects in thirty-two young and thirty-two older adults. Results indicate that self- and close other-referencing similarly enhance general (item) and specific (detail) recognition for both young and older adults relative to the distant other condition. Experiment 2 extended these findings to source memory, with young and older adults encoding verbal information in self-referent, semantic, and structural conditions. Findings suggest that self-referencing provides an age-equivalent boost in general memory and specific memory for specific source details. We conclude that the mnemonic benefits of referencing the self extend to specific memory for visual and verbal information across the lifespan.     

Visuo-spatial processing in working memory

This paper reports four experiments designed to develop a simple technique for the study of visuo-spatial processing within the working memory framework (Baddeley and Hitch, 1974). Experiment 1 involved the matching of successively presented random matrix patterns, as a secondary visual suppression task. This was coupled with rote rehearsal or a visual imagery mnemonic for learning lists of concrete words presented auditorily. Although memory performance with matching dropped overall, the visual mnemonic was differentially affected. Experiment 2 removed the matching decision, with visual presentation of unattended patterns. There was no overall effect of the unattended material, but use of the visual mnemonic was significantly affected. Experiment 3 replicated this result with simpler plain coloured squares as the unattended material.

In Experiment 4, for one group, the unattended material consisted of line drawings of common objects. For a second group, the lists of words for recall were presented visually, with or without unattended speech. The results suggested that unattended pictures disrupt use of a visual mnemonic, while unattended speech disrupts rote rehearsal.

These results suggest that unattended visual material has privileged access to the mechanism(s) involved in short-term visuo-spatial processing and storage. They also suggest that use of a concurrent visual matching task or of unattended visual material may provide tractable techniques for investigating this aspect of cognitive function within the context of working memory.     

A cognitive assessment of highly superior autobiographical memory

Highly Superior Autobiographical Memory (HSAM) is characterised as the ability to accurately recall an exceptional number of experiences and their associated dates from events occurring throughout much of one's lifetime. The source of this ability has only begun to be explored. The present study explores whether other enhanced cognitive processes may be critical influences underlying HSAM abilities. We investigated whether enhanced abilities in the domains of verbal fluency, attention/inhibition, executive functioning, mnemonic discrimination, perception, visual working memory, or the processing of and memory for emotional details might contribute critically to HSAM. The results suggest that superior cognitive functioning is an unlikely basis of HSAM, as only modest advantages were found in only a few tests. In addition, we examined HSAM subjects’ memory of the testing episodes. Interestingly, HSAM participants recalled details of their own experiences far better than those experiences that the experimenter shared with them. These findings provide additional evidence that HSAM involves, relatively selectively, recollection of personal, autobiographical material.     

Dissociable contributions within the medial temporal lobe to encoding of object-location associations

The crucial role of the medial temporal lobe (MTL) in episodic memory is well established. Although there is little doubt that its anatomical subregions-the hippocampus, peri-, entorhinal and parahippocampal cortex (PHC)-contribute differentially to mnemonic processes, their specific functions in episodic memory are under debate. Data from animal, human lesion, and neuroimaging studies suggest somewhat contradictory perspectives on this functional specialization: a general participation in declarative memory, an exclusive involvement in associative mnemonic processes, and a specific contribution to spatial memory are reported for the hippocampus, adjacent cortices, and the PHC. A functional lateralization in humans dependent on the verbalizability of the material is also discussed herein. To further elucidate the differential contributions of the various MTL subregions to encoding, we employed an object-location association memory paradigm. The memory for each of the studied associations was tested twice: by the object, and by the location serving as retrieval cue. The memory accuracy in response to both cue types was also assessed parametrically. Brain activity during encoding which leads to different degrees of subsequent memory accuracy under the two retrieval conditions was compared. We found the bilateral posterior PHC to participate in encoding of both the object associated with a location and the location associated with an object. In contrast, activity in an area in the left anterior PHC and the right anterior MTL was only correlated with the memory for the location associated with an object.     

An experimental study of visual imagination and memory

It is shown that an irrelevant visual perception interferes more with verbal learning by means of imagery than does an irrelevant auditory perception. The relative interfering effects of these perceptions were reversed in a verbal learning task involving highly abstract materials. Such results implicate the existence of a true visual component in imaginal mediation. A theoretical model is presented in which a visual system and a verbal-auditory system are distinguished. The visual system controls visual perception and visual imagination. The verbal-auditory system controls auditory perception, auditory imagination, internal verbal representation, and speech. Attention can be more easily divided between the two systems than within either one taken by itself. Furthermore, the visual and verbal-auditory systems are functionally linked by information recoding operations. The application of mnemonic imagery appears to involve a recoding of initially verbal information into visual form, and then the encoding of a primarily visual schema into memory. During recall, the schema is decoded as a visual image, and then recoded once again into the verbal-auditory system. Evidence for such transformations is provided not only by the interference data, but also by an analysis of recall-errors made by Ss using mnemonic imagery.     

Visual short-term memory load strengthens selective attention

Perceptual load theory accounts for many attentional phenomena; however, its mechanism remains elusive because it invokes underspecified attentional resources. Recent dual-task evidence has revealed that a concurrent visual short-term memory (VSTM) load slows visual search and reduces contrast sensitivity, but it is unknown whether a VSTM load also constricts attention in a canonical perceptual load task. If attentional selection draws upon VSTM resources, then distraction effects—which measure attentional “spill-over”—will be reduced as competition for resources increases. Observers performed a low perceptual load flanker task during the delay period of a VSTM change detection task. We observed a reduction of the flanker effect in the perceptual load task as a function of increasing concurrent VSTM load. These findings were not due to perceptual-level interactions between the physical displays of the two tasks. Our findings suggest that perceptual representations of distractor stimuli compete with the maintenance of visual representations held in memory. We conclude that access to VSTM determines the degree of attentional selectivity; when VSTM is not completely taxed, it is more likely for task-irrelevant items to be consolidated and, consequently, affect responses. The “resources” hypothesized by load theory are at least partly mnemonic in nature, due to the strong correspondence they share with VSTM capacity.     

The effects of delay and imagery training on the recall and recognition of object pairs

The present study represents a further investigation of an imagery training procedure previously developed by the authors (Yuille & Catchpole, 1973). Subjects given a brief training session in the use of an interacting imaginal mnemonic showed significantly higher performance than nontrained Ss on tests of immediate, delayed, and second learning set memory. While both recognition and recall were equally affected by the procedure, with recognition showing its usual superiority, the type of immediate memory test did not affect delayed recall. The findings are interpreted as supporting the preference of young children for visual coding.     

Updating memory using mnemonic devices

The process of memory updating enables people to recall information most recently associated with a particular stimulus context and to ignore or forget information previously associated with it. In a series of five experiments utilizing mnemonic devices it was found that when associative interference was maximized, only a limited disruption of updating resulted. In addition, mnemonic recall was not dependent on the utilization of higher-order memory components. However, support was found for the hypothesis that memory can be searched using temporal cues and for the idea that the size of the search set formed in memory is important. It was found that the older the event was to be recalled, the greater were the number of events in the search set and therefore the greater was the magnitude of the recall error. The size of the search set created in memory and the role of temporal-contextual cues in defining this search set may be important factors not only in mnemonic recall but in other types of learning and recall as well.     

On perfect working-memory performance with large numbers of items

Many popular models conceptualize working memory as consisting of three or four discrete slots or bins. This conceptualization, however, has been seemingly refuted by Bays and Husain (2009), who reported perfect performance on a working memory task with a large number of very simple items. We show, however, that this perfect-performance result likely reflects a design flaw rather than mnemonic structure. The flaw is that the test array itself in Bays and Husain’s study provides information about the correct answer without recourse to working memory. We show perfect performance on eight items for 18 participants when this information is present. We show that performance is poorer, however, when this information is removed. Hence, the Bays and Husain result does not threaten models that stipulate that working memory is composed of limited slots.     

Distributed learning enhances relational memory consolidation

It has long been known that distributed learning (DL) provides a mnemonic advantage over massed learning (ML). However, the underlying mechanisms that drive this robust mnemonic effect remain largely unknown. In two experiments, we show that DL across a 24 hr interval does not enhance immediate memory performance but instead slows the rate of forgetting relative to ML. Furthermore, we demonstrate that this savings in forgetting is specific to relational, but not item, memory. In the context of extant theories and knowledge of memory consolidation, these results suggest that an important mechanism underlying the mnemonic benefit of DL is enhanced memory consolidation. We speculate that synaptic strengthening mechanisms supporting long-term memory consolidation may be differentially mediated by the spacing of memory reactivation. These findings have broad implications for the scientific study of episodic memory consolidation and, more generally, for educational curriculum development and policy.     

Distinguishing between attributional and mnemonic sources of familiarity: The case of positive emotion bias

Does familiarity arise from direct access to memory representations (a mnemonic account) or from inferences and diagnostic cues (an attributional account)? These theoretically distinct explanations can be difficult to distinguish in practice, as is shown by thepositivity effect, the increase in feelings of familiarity that accompanies positive emotion. Experiment 1 manipulated mnemonic and attributional sources of positivity via word valence and physical expressions of emotion, respectively. Both sources influenced the tendency to call itemsold, but receiver-operating characteristic analysis revealed a change in accuracy only with the mnemonic source. To further contrast the mnemonic and attributional accounts, Experiment 2 varied the ratio of positive to neutral words. A higher proportion of positive words exaggerated the pattern of increasedold judgments and decreased accuracy for positive words, relative to neutral ones, consistent with the mnemonic account but inconsistent with the attributional account.     

Action relevance induces an attentional weighting of representations in visual working memory

Information maintained in visual working memory (VWM) can be strategically weighted according to its task-relevance. This is typically studied by presenting cues during the maintenance interval, but under natural conditions, the importance of certain aspects of our visual environment is mostly determined by intended actions. We investigated whether representations in VWM are also weighted with respect to their potential action relevance. In a combined memory and movement task, participants memorized a number of items and performed a pointing movement during the maintenance interval. The test item in the memory task was subsequently presented either at the movement goal or at another location. We found that performance was better for test items presented at a location that corresponded to the movement goal than for test items presented at action-irrelevant locations. This effect was sensitive to the number of maintained items, suggesting that preferential maintenance of action relevant information becomes particularly important when the demand on VWM is high. We argue that weighting according to action relevance is mediated by the deployment of spatial attention to action goals, with representations spatially corresponding to the action goal benefitting from this attentional engagement. Performance was also better at locations next to the action goal than at locations farther away, indicating an attentional gradient spreading out from the action goal. We conclude that our actions continue to influence visual processing at the mnemonic level, ensuring preferential maintenance of information that is relevant for current behavioral goals.