Delay of auditory input in “simultaneous” auditory and visual short-term memory

In an attempt to facilitate visual recall when material is presented under bisensory simultaneous conditions (i.e., visual and auditory stimuli are presented together), auditory material was delayed up to 1/4 sec relative to the onset of the visual material. Visual recall, however, remained stable across the auditory delays, suggesting a limitation in the visual system beyond that associated with the simultaneous occurrence of auditory material.     

What limits working memory capacity? Evidence for modality-specific sources to the simultaneous storage of visual and auditory arrays

There is considerable debate on whether working memory (WM) storage is mediated by distinct subsystems for auditory and visual stimuli (Baddeley, 1986) or whether it is constrained by a single, central capacity-limited system (Cowan, 2006). Recent studies have addressed this issue by measuring the dual-task cost during the concurrent storage of auditory and visual arrays (e.g., Cocchini, Logie, Della Sala, MacPherson, & Baddeley, 2002; Fougnie & Marois, 2006; Saults & Cowan, 2007). However, studies have yielded widely different dual-task costs, which have been taken to support both modality-specific and central capacity-limit accounts of WM storage. Here, we demonstrate that the controversies regarding such costs mostly stem from how these costs are measured. Measures that compare combined dual-task capacity with the higher single-task capacity support a single, central WM store when there is a large disparity between the single-task capacities (Experiment 1) but not when the single-task capacities are well equated (Experiment 2). In contrast, measures of the dual-task cost that normalize for differences in single-task capacity reveal evidence for modality-specific stores, regardless of single-task performance. Moreover, these normalized measures indicate that dual-task cost is much smaller if the tasks do not involve maintaining bound feature representations in WM (Experiment 3). Taken together, these experiments not only resolve a discrepancy in the field and clarify how to assess the dual-task cost but also indicate that WM capacity can be constrained both by modality-specific and modality-independent sources of information processing.     

Do two separate speech measures constrain verbal short-term memory in children?

Previous research has indicated that 2 processing rates may constrain verbal short-term memory performance. These have been linked to individual differences in (a) the time taken to articulate spoken words and (b) the duration of pauses that occur between words in the output responses to memory tasks. Two experiments examined whether evidence for these effects on memory can be obtained for measures taken from a single speech sample. Children articulated pairs of words as rapidly as possible. In both experiments, the spoken duration of words and the length of the pauses between them predicted significant variance in verbal short-term memory performance. It is argued that the duration of words is linked to memory performance through the processes underlying time-based forgetting in short-term memory. In contrast, the duration of pauses in speeded articulation may index individual differences in speech planning processes.     

What factors underlie children’s susceptibility to semantic and phonological false memories? Investigating the roles of language skills and auditory short-term memory

Two experiments investigated the cognitive skills that underlie children’s susceptibility to semantic and phonological false memories in the Deese/Roediger–McDermott procedure ( and ). In Experiment 1, performance on the Verbal Similarities subtest of the British Ability Scales (BAS) II (Elliott, Smith, & McCulloch, 1997) predicted correct and false recall of semantic lures. In Experiment 2, performance on the Yopp–Singer Test of Phonemic Segmentation (Yopp, 1988) did not predict correct recall, but inversely predicted the false recall of phonological lures. Auditory short-term memory was a negative predictor of false recall in Experiment 1, but not in Experiment 2. The findings are discussed in terms of the formation of gist and verbatim traces as proposed by fuzzy trace theory (Reyna & Brainerd, 1998) and the increasing automaticity of associations as proposed by associative activation theory (Howe, Wimmer, Gagnon, & Plumpton, 2009).     

Is the interference between memory processing and timing specific to the use of verbal material?

Increasing load in a memory task performed simultaneously with a timing task shortens perceived time, an effect that has been observed previously with memory tasks using verbal material. The present experiments examine whether two similar memory tasks, one in which verbal material is used and another one in which nonverbal material is used, would produce similar interference effects on concurrent time reproduction. In Experiment 1, the number of nonverbal stimuli (pseudo‐random dot patterns) was manipulated in a memory task performed while a temporal interval to be reproduced was encoded. Reproductions shortened proportionally to the duration of memory processing executed during time estimation. Verbal stimuli (consonants) were used in Experiment 2 in otherwise identical experimental conditions. Effects observed in Experiment 2 were comparable to those obtained in Experiment 1. Taken together, these results support the notion that interference from memory tasks on concurrent time estimation is not determined by the specific type of material processed in memory, but instead by the duration of memory processing.     

Is the interference between memory processing and timing specific to the use of verbal material?

Increasing load in a memory task performed simultaneously with a timing task shortens perceived time, an effect that has been observed previously with memory tasks using verbal material. The present experiments examine whether two similar memory tasks, one in which verbal material is used and another one in which nonverbal material is used, would produce similar interference effects on concurrent time reproduction. In Experiment 1, the number of nonverbal stimuli (pseudo-random dot patterns) was manipulated in a memory task performed while a temporal interval to be reproduced was encoded. Reproductions shortened proportionally to the duration of memory processing executed during time estimation. Verbal stimuli (consonants) were used in Experiment 2 in otherwise identical experimental conditions. Effects observed in Experiment 2 were comparable to those obtained in Experiment 1. Taken together, these results support the notion that interference from memory tasks on concurrent time estimation is not determined by the specific type of material processed in memory, but instead by the duration of memory processing.     

Models of verbal working memory capacity: what does it take to make them work?

Theories of working memory (WM) capacity limits will be more useful when we know what aspects of performance are governed by the limits and what aspects are governed by other memory mechanisms. Whereas considerable progress has been made on models of WM capacity limits for visual arrays of separate objects, less progress has been made in understanding verbal materials, especially when words are mentally combined to form multiword units or chunks. Toward a more comprehensive theory of capacity limits, we examined models of forced-choice recognition of words within printed lists, using materials designed to produce multiword chunks in memory (e.g., leather brief case). Several simple models were tested against data from a variety of list lengths and potential chunk sizes, with test conditions that only imperfectly elicited the interword associations. According to the most successful model, participants retained about 3 chunks on average in a capacity-limited region of WM, with some chunks being only subsets of the presented associative information (e.g., leather brief case retained with leather as one chunk and brief case as another). The addition to the model of an activated long-term memory component unlimited in capacity was needed. A fixed-capacity limit appears critical to account for immediate verbal recognition and other forms of WM. We advance a model-based approach that allows capacity to be assessed despite other important processing contributions. Starting with a psychological-process model of WM capacity developed to understand visual arrays, we arrive at a more unified and complete model.     

Does auditory streaming require attention? Evidence from attentional selectivity in short-term memory

R. P. Carlyon, R. Cusack, J. M. Foxton, and I. H. Robertson (2001) have argued that attention is crucial for auditory streaming. The authors review R. P. Carlyon et al.'s (2001) arguments and suggest that a pertinent literature, the irrelevant sound paradigm--demonstrating preattentive auditory streaming--has been overlooked. In illustration of this alternative approach, the authors include a novel single experiment demonstrating the impact of preattentive auditory streaming on short-term serial memory. It is concluded that R. P. Carlyon et al.'s (2001) results do not definitively demonstrate that auditory streaming processes are dependent on attention; indeed, they are compatible with alternative accounts of the relationship between perceptual organization and attention.     

Articulatory suppression and the irrelevantspeech effect in short-term memory: Does the locus of suppression matter?

Immediate serial recall for letter sequences was impaired when irrelevant speech (IS) was presented throughout stimulus input and a subsequent rehearsal interval. This irrelevant-speech effect was eliminated when participants engaged in articulatory suppression (repeated articulation of one or more digits) during stimulus input but not when suppression occurred during the postinput rehearsal period. Also, changing-state suppression (articulation of multiple items) impaired the overall level of performance more than did steady-state suppression (repetition of a single item), whereas both forms of suppression had the same influence on the IS effect. Our results suggest that the locus of suppression (during or after stimulus input) may have contributed to discrepant findings in the prior literature regarding the influence of articulatory suppression on the IS effect. We consider the implications of our findings for three prominent models of immediate memory: the working memory model, the objectoriented episodic record model, and the feature model.     

Coding categorical and coordinate spatial relations in visual–spatial short-term memory

Four experiments explored the coding of categorical and coordinate spatial relations in visual–spatial short-term memory (VSSTM). Participants judged whether two stimuli presented successively on a computer screen were the same or different. On positional change trials the two stimuli differed in the position of one element. Positional changes were of two types, coordinate and categorical. On coordinate trials the position of one element changed by a small amount, but retained the categorical relationships (above, below, left of, right of) to all other elements. On categorical trials one element moved by the same amount but additionally changed its categorical relationship to one of the other elements (e.g., changed from below to above). Participants detected categorical changes more accurately than coordinate changes when the elements were independent locations marked by squares, indicating that the categorical relationships amongst the squares were encoded in memory. Furthermore, this categorical advantage was unmodulated by either the suppression of articulation (Experiment 2) or by the requirement to retain either colour–position associations or positions only (Experiment 3). When the elements to be remembered were the vertices of simple outline polygons (Experiment 4) there was no categorical advantage, establishing the effect as spatial in nature. Contrary to predictions derived from Postma and De Haan (1996) Postma, A. and De Haan, E. H. 1996. What was where? Memory for object locations. Quarterly Journal of Experimental Psychology, 49A: 178–199. [Crossref], [Web of Science ®] , [Google Scholar], the employment of categorical relations appears not to be specifically linked to either verbal coding or to the requirement to associate objects with positions. The results suggest that the categorical relations are an intrinsic property of the representation of spatial configurations.     

Effects of stimulus–stimulus short-term memory associations in a Simon-like task

The Simon effect refers to faster responding when an irrelevant stimulus location corresponds with the response to a relevant stimulus attribute than when it does not. We investigated whether a memory-based Simon-like effect would occur when the irrelevant spatial attribute was associated with the stimulus during a prior task. In a first task, an association between colour and location was formed by requiring participants to count the occurrences of two colour stimuli, each of which was always presented in a left or right location. In a second task, the colour stimuli were presented centrally and mapped to left and right keypresses, with the mapping being inconsistent or consistent with the prior colour-location associations. A Simon-like effect was evident at the start of the second task, with performance being better when the established colour–position associations were consistent with the colour–response mapping than when they were not. This result indicates that stimulus–stimulus short-term memory associations formed during the first task transferred to the second task. For the remainder of the second task, the data showed a more conservative speed–accuracy criterion for the inconsistent condition than for the consistent condition, though a processing efficiency measure suggested that the prior stimulus–stimulus short-term associations may also continue to directly influence performance. Results suggest that simple declarative knowledge, as represented by stimulus–stimulus STM links, exerts less persistent transfer effects than procedural knowledge as provided by stimulus–response STM links.     

What is the relationship between phonological short-term memory and speech processing?

Traditionally, models of speech comprehension and production do not depend on concepts and processes from the phonological short-term memory (pSTM) literature. Likewise, in working memory research, pSTM is considered to be a language-independent system that facilitates language acquisition rather than speech processing per se. We discuss couplings between pSTM, speech perception and speech production, and we propose that pSTM arises from the cycling of information between two phonological buffers, one involved in speech perception and one in speech production. We discuss the specific role of these processes in speech processing, and argue that models of speech perception and production, and our understanding of their neural bases, will benefit from incorporating them.     

Task instructions determine the visuospatial and verbal–spatial nature of number–space associations

Evidence for number–space associations comes from the spatial–numerical association of response codes (SNARC) effect, consisting in faster reaction times to small/large digits with the left/right hand, respectively. Two different proposals are commonly discussed concerning the cognitive origin of the SNARC effect: the visuospatial account and the verbal–spatial account. Recent studies have provided evidence for the relative dominance of verbal–spatial over visuospatial coding mechanisms, when both mechanisms were directly contrasted in a magnitude comparison task. However, in these studies, participants were potentially biased towards verbal–spatial number processing by task instructions based on verbal–spatial labels. To overcome this confound and to investigate whether verbal–spatial coding mechanisms are predominantly activated irrespective of task instructions, we completed the previously used paradigm by adding a spatial instruction condition. In line with earlier findings, we could confirm the predominance of verbal–spatial number coding under verbal task instructions. However, in the spatial instruction condition, both verbal–spatial and visuospatial mechanisms were activated to an equal extent. Hence, these findings clearly indicate that the cognitive origin of number–space associations does not always predominantly rely on verbal–spatial processing mechanisms, but that the spatial code associated with numbers is context dependent.     

Auditory–motor learning influences auditory memory for music

In two experiments, we investigated how auditory–motor learning influences performers’ memory for music. Skilled pianists learned novel melodies in four conditions: auditory only (listening), motor only (performing without sound), strongly coupled auditory–motor (normal performance), and weakly coupled auditory–motor (performing along with auditory recordings). Pianists’ recognition of the learned melodies was better following auditory-only or auditory–motor (weakly coupled and strongly coupled) learning than following motor-only learning, and better following strongly coupled auditory–motor learning than following auditory-only learning. Auditory and motor imagery abilities modulated the learning effects: Pianists with high auditory imagery scores had better recognition following motor-only learning, suggesting that auditory imagery compensated for missing auditory feedback at the learning stage. Experiment 2 replicated the findings of Experiment 1 with melodies that contained greater variation in acoustic features. Melodies that were slower and less variable in tempo and intensity were remembered better following weakly coupled auditory–motor learning. These findings suggest that motor learning can aid performers’ auditory recognition of music beyond auditory learning alone, and that motor learning is influenced by individual abilities in mental imagery and by variation in acoustic features.     

Is phonological short-term memory related to phonological analysis stages in auditory sentence processing?

Despite extensive research, the role of phonological short-term memory (STM) during oral sentence comprehension remains unclear. We tested the hypothesis that phonological STM is involved in phonological analysis stages of the incoming words, but not in sentence comprehension per se. We compared phonological STM capacity and processing times for natural sentences and sentences containing phonetically ambiguous words. The sentences were presented for an auditory sentence anomaly judgement task and processing times for each word were measured. STM was measured via nonword and word immediate serial recall tasks, indexing phonological and lexicosemantic STM capacity, respectively. Significantly increased processing times were observed for phonetically ambiguous words, relative to natural stimuli in same sentence positions. Phonological STM capacity correlated with the size of this phonetic ambiguity effect. However, phonological STM capacity did not correlate with measures of later semantic integration processes while lexicosemantic STM did. This study suggests that phonological STM is associated with phonological analysis processes during sentence processing.     

Influence of auditory and audiovisual stimuli on the right–left prevalence effect

When auditory stimuli are used in two-dimensional spatial compatibility tasks, where the stimulus and response configurations vary along the horizontal and vertical dimensions simultaneously, a right–left prevalence effect occurs in which horizontal compatibility dominates over vertical compatibility. The right–left prevalence effects obtained with auditory stimuli are typically larger than that obtained with visual stimuli even though less attention should be demanded from the horizontal dimension in auditory processing. In the present study, we examined whether auditory or visual dominance occurs when the two-dimensional stimuli are audiovisual, as well as whether there will be cross-modal facilitation of response selection for the horizontal and vertical dimensions. We also examined whether there is an additional benefit of adding a pitch dimension to the auditory stimulus to facilitate vertical coding through use of the spatial-musical association of response codes (SMARC) effect, where pitch is coded in terms of height in space. In Experiment 1, we found a larger right–left prevalence effect for unimodal auditory than visual stimuli. Neutral, non-pitch coded, audiovisual stimuli did not result in cross-modal facilitation, but did show evidence of visual dominance. The right–left prevalence effect was eliminated in the presence of SMARC audiovisual stimuli, but the effect influenced horizontal rather than vertical coding. Experiment 2 showed that the influence of the pitch dimension was not in terms of influencing response selection on a trial-to-trial basis, but in terms of altering the salience of the task environment. Taken together, these findings indicate that in the absence of salient vertical cues, auditory and audiovisual stimuli tend to be coded along the horizontal dimension and vision tends to dominate audition in this two-dimensional spatial stimulus–response task.     

Verbal and spatial short-term memory: common sources of developmental change?

Verbal and spatial span, articulation and tapping rate, and verbal and spatial speed-of-search tasks were administered to sixty 6- to 12-year-olds. A variance-partitioning procedure was then used to identify age-related and age-invariant components of variance in span. Outcomes were very similar for verbal and spatial span, in particular, (i) most of the age-related variance was shared by the speed-of-search and rate predictors, (ii) articulation rate provided an age-independent contribution, (iii) changing-state versions of predictor tasks did not account for variance over steady-state versions, and (iv) predictors of the same modality as the span task did not outperform predictors of the other modality. We conclude that verbal and spatial short-term memory appear to rely on similar processes when serial recall is required and that developments in span are closely tied to increases in processing speed.     

Get the gist? The effects of processing depth on false recognition in short-term and long-term memory

Gist-based processing has been proposed to account for robust false memories in the converging-associates task. The deep-encoding processes known to enhance verbatim memory also strengthen gist memory and increase distortions of long-term memory (LTM). Recent research has demonstrated that compelling false memory illusions are relatively delay-invariant, also occurring under canonical short-term memory (STM) conditions. To investigate the contributions of gist to false memory at short and long delays, processing depth was manipulated as participants encoded lists of four semantically related words and were probed immediately, following a filled 3- to 4-s retention interval, or approximately 20 min later, in a surprise recognition test. In two experiments, the encoding manipulation dissociated STM and LTM on the frequency, but not the phenomenology, of false memory. Deep encoding at STM increases false recognition rates at LTM, but confidence ratings and remember/know judgments are similar across delays and do not differ as a function of processing depth. These results suggest that some shared and some unique processes underlie false memory illusions at short and long delays.     

Familiarity increases the number of remembered Pokémon in visual short-term memory

Long-term memory (LTM) can influence many aspects of short-term memory (STM), including increased STM span. However, it is unclear whether LTM enhances the quantitative or qualitative aspect of STM. That is, do we retain a larger number of representations or more precise representations in STM for familiar stimuli than unfamiliar stimuli? This study took advantage of participants’ prior rich multimedia experience with Pokémon, without investing on laboratory training to examine how prior LTM influenced visual STM. In a Pokémon visual STM change detection task, participants remembered more first-generation Pokémon characters that they were more familiar with than recent-generation Pokémon characters that they were less familiar with. No significant difference in memory quality was found when quantitative and qualitative effects of LTM were isolated using receiver operating characteristic (ROC) analyses. Critically, these effects were absent in participants who were unfamiliar with first-generation Pokémon. Furthermore, several alternative interpretations were ruled out, including general video-gaming experience, subjective Pokémon preference, and verbal encoding. Together, these results demonstrated a strong link between prior stimulus familiarity in LTM and visual STM storage capacity.