Inverting the modality effect in serial recall

Differences in recall ability between immediate serial recall of auditorily and visually presented verbal material have traditionally been considered restricted to the end of to-be-recalled lists, the recency section of the serial position curve (e.g., Crowder & Morton, 1969). Later studies showed that--under certain circumstances--differences in recall between the two modalities can be observed across the whole of the list (Frankish, 1985). However in all these studies the advantage observed is for recall of material presented in the auditorily modality. Six separate conditions across four experiments demonstrate that a visual advantage can be obtained with serial recall if participants are required to recall the list in two distinct sections using serial recall. Judged on a list-wide basis, the visual advantage is of equivalent size to the auditory advantage of the classical modality effect. The results demonstrate that differences in representation of auditory and visual verbal material in short-term memory persist beyond lexical and phonological categorization and are problematic for current theories of the modality effect.     

Semantic similarity dissociates short- from long-term recency effects: Testing a neurocomputational model of list memory

The finding that recency effects can occur not only in immediate free recall (i.e., short-term recency) but also in the continuous-distractor task (ie., long-term recency) has led many theorists to reject the distinction between short- and long-term memory stores. Recently, we have argued that long-term recency effects do not undermine the concept of a short-term store, and we have presented a neurocomputational model that accounts for both short- and long-term recency and for a series of dissociations between these two effects. Here, we present a new dissociation between short- and long-term recency based on semantic similarity, which is predicted by our model. This dissociation is due to the mutual support between associated items in the short-term store, which takes place in immediate free recall and delayed free recall but not in continuous-distractor free recall.     

Maintenance of semantic information in capacity-limited item short-term memory

We report a semantic effect in immediate free recall, which is localized at recency and is preserved under articulatory suppression but is highly reduced when recall is delayed after an intervening distractor task. These results are explained by a neurocomputational model based on a limited-capacity short-term memory (STM) store, consisting ofactivated long-term memory representations. The model makes additional predictions about serial position functions in semantically cued recall, indicating capacity limitations caused by a displacement type mechanism, which are confirmed in a second experiment. This suggests that in addition to the phonological component in verbal STM, there is an activation/ item-limited component with semantically sensitive representations.     

Associative processes in immediate recency

Some theorists have argued that the immediate recency effect observed in free recall reflects the emptying out of the contents of a short-term memory buffer (Davelaar, Goshen-Gottstein, Ashkenazi, Haarmann, & Usher, 2005). Others have argued that immediate recency reflects the properties of temporal context used to cue free recall (Howard & Kahana, 2002). We examined immediate free recall of lists with an item from the middle of the list repeated at or near the end. If associative processes contribute to immediate recency, as predicted by the temporal context account, the neighbors of the initial presentation of the repeated item should show enhanced recall at the initial stages of immediate recall. Recall transitions early in output--and even the initiation of recall itself-showed evidence for temporally defined associations that resemble those observed in recall from long-term memory. These results have strong implications for models of the immediate recency effect in free recall.     

Examining the relationship between free recall and immediate serial recall: the effect of concurrent task performance

In 3 experiments, participants saw lists of 16 words for free recall with or without a 6-digit immediate serial recall (ISR) task after each word. Free recall was performed under standard visual silent and spoken-aloud conditions (Experiment 1), overt rehearsal conditions (Experiment 2), and fixed rehearsal conditions (Experiment 3). The authors found that in each experiment, there was no effect of ISR on the magnitude of the recency effect, but interleaved ISR disrupted free recall of those words that would otherwise be rehearsed. The authors conclude that ISR and recency cannot both be outputs from a unitary limited-capacity short-term memory store and discuss the possibility that the process of rehearsal may be common to both tasks.     

Recency and the modality effect in immediate ordered recall

In immediate ordered recall, recency is the improved recall of the last item of a presentation, and the modality effect is the advantage for an acoustic presentation over a subvocalized visual presentation, primarily occurring at the last serial position. Experiment 1 tested grouped presentations. There was a modality effect for the first item of the last group, even though that item was at the third-to-last or fourth-to-last serial position. In Experiment 2, for vocalized presentations of syllables ending in a, recency was larger for staccato speech than legato speech; for subvocalized presentations, there was a substantial recency for the legato style. In Experiment 3, recency was larger for a set of syllables ending in ATE than for a set of syllables ending in AME. These results suggest that recency cannot be explained by the existence of a fixed-capacity store, auxiliary to the auditory short-term store, that retains only some types of presentations. It is suggested instead that recency might reflect an auxiliary method of using the information in the auditory short-term store.     

Phonological Short-term Memory and the Learning of Novel Words: The Effect of Phonological Similarity and Item Length

The investigation of a patient with a selective impairment of phonological short-term memory has recently provided evidence that this system may be involved in long-term learning of novel words, for which a pre-existing semantic representation is not available (Baddeley, Papagno, & Vallar, 1988). The present series of experiments in normal subjects explored this hypothesis. We assessed the effects of phonological similarity and item length, which reflect the operation of the phonological short-term store and the rehearsal component of verbal memory, upon paired associate long-term learning of auditorily presented words and non-words. Phonological similarity affected the learning of novel words more than known words (Experiment 1); when a delay was interposed between presentation and recall, the disruptive effect was confined to novel words (Experiment 2). Also word length disrupted the learning of novel words, but not of known words (Experiment 3). These results tie in with neuropsychological evidence to suggest a role for phonological short-term memory in the learning of new words, and they have developmental implications for the study of language acquisition.     

Articulatory rehearsal and phonological storage in working memory

The theoretical distinction between an articulatory control process and a short-term phonological store was supported in five experiments on immediate serial recall. In Experiment 1, articulatory suppression during the presentation and recall of auditory material abolished the word length effect but not the phonemic similarity effect. In Experiment 2, the two latter effects were found to be independent with auditory presentation. In Experiment 3, the effects of irrelevant speech and word length were found to be independent with visual presentation. In Experiment 4, articulatory suppression during the presentation and recall of auditory material abolished the phonemic similarity effect with a slow presentation rate. Nevertheless, in Experiment 5, articulatory suppression with a conventional presentation rate did not reduce the effect of phonemic similarity, even when a 10-sec interval was interposed between presentation and recall. These results indicate that the encoding, maintenance, and retrieval of spoken material within the phonological store do not depend on a process of articulatory rehearsal.     

Contextual variability and serial position effects in free recall.

In immediate free recall, words recalled successively tend to come from nearby serial positions. M. J. Kahana (1996) documented this effect and showed that this tendency, which the authors refer to as the lag recency effect, is well described by a variant of the search of associative memory (SAM) model (J. G. W. Raaijmakers & R. M. Shiffrin, 1980, 1981). In 2 experiments, participants performed immediate, delayed, and continuous distractor free recall under conditions designed to minimize rehearsal. The lag recency effect, previously observed in immediate free recall, was also observed in delayed and continuous distractor free recall. Although two-store memory models, such as SAM, readily account for the end-of-list recency effect in immediate free recall, and its attenuation in delayed free recall, these models fail to account for the long-term recency effect. By means of analytic simulations, the authors show that both the end of list recency effect and the lag recency effect, across all distractor conditions, can be explained by a single-store model in which context, retrieved with each recalled item, serves as a cue for subsequent recalls.     

Recency and suffix effects with immediate recall of olfactory stimuli

In contrast to our understanding of the immediate recall of auditory and visual material, little is known about the corresponding characteristics of short-term olfactory memory. The current study investigated the pattern of immediate serial recall and the associated suffix effect using olfactory stimuli. Subjects were trained initially to identify and name correctly nine different odours. Experiment 1 established an immediate correct recall span of approximately six items. In Experiment 2 participants recalled serially span equivalent lists which were followed by a visual, auditory, or olfactory suffix. Primacy was evident in the recall curves for all three suffix conditions. Recency, in contrast, was evident in the auditory and visual suffix conditions only; there was a strong suffix effect in the olfactory suffix condition. Experiment 3 replicated this pattern of effects using seven-item lists, and demonstrated that the magnitude of the recency and suffix effects obtained in the olfactory modality can equate to that obtained in the auditory modality. It is concluded that the pattern of recency and suffix effects in the olfactory modality is reliable, and poses difficulties for those theories that rely on the presence of a primary linguistic code, sound, or changing state as determinants of these effects in serial recall.     

Recency and suffix effects with immediate recall of olfactory stimuli

In contrast to our understanding of the immediate recall of auditory and visual material, little is known about the corresponding characteristics of short-term olfactory memory. The current study investigated the pattern of immediate serial recall and the associated suffix effect using olfactory stimuli. Subjects were trained initially to identify and name correctly nine different odours. Experiment 1 established an immediate correct recall span of approximately six items. In Experiment 2 participants recalled serially span equivalent lists which were followed by a visual, auditory, or olfactory suffix. Primacy was evident in the recall curves for all three suffix conditions. Recency, in contrast, was evident in the auditory and visual suffix conditions only; there was a strong suffix effect in the olfactory suffix condition. Experiment 3 replicated this pattern of effects using seven-item lists, and demonstrated that the magnitude of the recency and suffix effects obtained in the olfactory modality can equate to that obtained in the auditory modality. It is concluded that the pattern of recency and suffix effects in the olfactory modality is reliable, and poses difficulties for those theories that rely on the presence of a primary linguistic code, sound, or changing state as determinants of these effects in serial recall.     

Irrelevant sound disrupts speech production: Exploring the relationship between short-term memory and experimentally induced slips of the tongue

To explore the relationship between short-term memory and speech production, we developed a speech error induction technique. The technique, which was adapted from a Japanese word game, exposed participants to an auditory distractor word immediately before the utterance of a target word. In Experiment 1, the distractor words that were phonologically similar to the target word led to a greater number of errors in speaking the target than did the dissimilar distractor words. Furthermore, the speech error scores were significantly correlated with memory span scores. In Experiment 2, memory span scores were again correlated with the rate of the speech errors that were induced from the task-irrelevant speech sounds. Experiment 3 showed a strong irrelevant-sound effect in the serial recall of nonwords. The magnitude of the irrelevant-sound effects was not affected by phonological similarity between the to-be-remembered nonwords and the irrelevant-sound materials. Analysis of recall errors in Experiment 3 also suggested that there were no essential differences in recall error patterns between the dissimilar and similar irrelevant-sound conditions. Weproposed two different underlying mechanisms in immediate memory, one operating via the phonological short-term memory store and the other via the processes underpinning speech production.     

Individual differences in phonological learning and verbal STM span

A relationship between phonological short-term memory tasks (e.g., nonword repetition, digit span) and vocabulary learning in both experimental and real-life conditions has been reported in numerous studies. A mechanism that would explain this correlation is, however, not known. The present study explores the possibility that it is the quality of phonological representations that affects both short-term recall and long-term learning of novel wordlike items. In Experiment 1, groups with relatively good and poor span for pseudowords were established. The good group was found to perform better at explicit memory tasks tapping the incidental learning of a limited stimulus pool used in an auditory immediate serial pseudoword recall task. In Experiment 2, the results of Experiment 1 were replicated when experience of correct recall was controlled. In Experiment 3, the immediate recall performance of the good group was found to benefit more than that of the poor group from syllable repetition within stimulus pools. It is concluded that the efficiency of a process that creates phonological representations is related both to short-term capacity for verbal items, and to long-term phonological learning of the structure of novel phonological items.     

Immediate and delayed recall of visually presented sentences: evidence for the involvement of phonological information

The lure intrusion effect refers to the observation that lexical priming affects recall of sentences. This effect is taken as evidence against the contribution of surface information, even with immediate sentence recall. Recently, Rummer and Engelkamp (2003a) demonstrated that this effect, which is usually observed under rapid serial visual presentation (RSVP), does not appear under immediate recall of auditorily presented sentences. This finding indicates that surface information (i.e., phonological or acoustic-sensory information) can contribute to immediate sentence recall. So far, however, the findings do not allow for a decision on whether phonological and/or acoustic-sensory information is used in immediate sentence recall. In order to dissociate the two kinds of surface information, an experiment was conducted in which immediate and delayed recall were tested for sentences that were visually presented for a longer period of time than in RSVP. This kind of presentation should support phonological representations, but does not allow for acoustic-sensory representations. The findings showed a smaller intrusion effect for immediate than for delayed recall. This indicates that, if available, phonological information is involved in immediate sentence recall thereby reducing the lure intrusion effect. Furthermore, the findings support the assumption that the phonological trace provided via RSVP reading is weaker than in normal reading.     

Impairment of the visuo-spatial sketch pad

A case study is presented of a female patient, ELD, who has difficulty in the immediate recall of short sequences of visuo-spatial material following a right-hemisphere aneurysm. Despite poor performance on tasks such as the Brooks Matrix and the Corsi Blocks, ELD is good at the immediate serial recall of letters even when presentation modality is visual and shows effects of phonological similarity and articulatory suppression. This pattern of performance represents a double dissociation from that which has been observed with the short-term memory patient PV (Vallar & Baddeley, 1984), who is extremely poor at serial recall of verbal material but shows no visual memory impairment. It is argued that ELD has an impairment to the visuo-spatial component of working memory (Baddeley, 1986) in the absence of any phonological loop deficit. Further investigation reveals that ELD performs poorly on mental rotation tasks and finds it difficult to use imagery mnemonics, but has no difficulty in retrieving visuo-spatial information from long-term memory so long as it was learnt before her illness.     

Memory storage and retrieval within and across modalities in children

Twenty-four kindergarten and fourth grade children were asked to locate a display card which had been visually or verbally presented. A probe, which identified the card to be located, was presented verbally and visually equally often. The children's ability to recall the location of an item did not differ as a function of the modality to which the material was presented. Nor was recall significantly affected when the presentation modality differed from the probe modality, suggesting that children as young as 5 can cross these sensory modalities to retrieve material with no loss in accuracy. Serial position curves suggest that the verbal and visual material is not stored in a common intersensory store. The primacy effect is found to be stronger with visually presented material and the recency effect strongest with auditorily presented material. Probe modality did not influence the serial position curves.     

前分类声音存储器对声调和情绪韵律的加工

采用系列位置回忆任务, 探讨作为声调语言的汉语普通话中声调及情绪信息是否具有近因及后缀效应, 从而揭示同为超音段信息的声调和情绪韵律在前分类声音存储器(Precategorical Acoustic Storage, PAS)中是否具有单独的表征, 及该表征可能受到哪些因素的影响。实验一和二分别考察了声调是否具有近因和后缀效应, 实验三和四分别考察了情绪信息是否具有近因和后缀效应。实验结果发现两者均在PAS存储器中有单独的表征, 但这种表征会受到一些因素的影响, 且受影响的方式不一样。研究结果表明作为超音段信息的声调和情绪信息在表征上的不稳定性和脆弱性, 及在短时记忆加工过程中的特殊性。     

Phonological information in immediate and delayed sentence recall

Potter and Lombardi (1990) state in their conceptual regeneration hypothesis that immediate sentence recall is only based on conceptual and lexical information; phonological information does not contribute. As experimental evidence for this hypothesis, they reported that if a sentence is followed by a word list that included a lure word similar to one of the content words of the sentence (target word), the lure word frequently intrudes into sentence recall. We demonstrated that Potter and Lombardi did not observe any influence of phonological information because list presentation followed sentence presentation, and phonological information was discarded. We observed that phonological information influenced the intrusion rate if recall was not delayed by the subsequent presentation of a word list. With immediate recall, the lure intrusion effect disappeared in auditorily presented sentences. This shows that, if available, phonological information contributes to sentence recall.     

Impairment in processing meaningless verbal material in several modalities: The relationship between short-term memory and phonological skills

Phonological processing abilities were studied in a patient who, following focal brain damage, showed selective impairment in non-word reading, writing, and repetition and also a severe short-term memory (STM) deficit specific for auditorily presented verbal material. The patient could execute tasks involving phonemic manipulation and awareness perfectly. Our data, in contrast with earlier observations in a case of developmental phonological dyslexia, show that acquired impairment in non-word reading, writing, repetition, and immediate memory may occur despite good phonological processing abilities. The role of STM in processing meaningless verbal material is discussed.     

汉语短时序列回忆中的语音相似性和视觉相似性效应

语音相似性效应和视觉相似性效应是短时序列回忆中的两个典型性效应, 但前人很少探讨这两种效应的交互作用。本研究利用汉语字形和语音的属性, 观察汉字短时序列回忆中语音相似性效应、视觉相似性效应及两者的交互作用。研究结果发现当回忆项目在语音或视觉上单纯相似或不相似时, 视觉相似性效应及其与语音相似性的交互作用与混合词表条件下所发现的结果有很大的不同。这个研究结果为丰富和补充相关理论模型提供了进一步实证依据。