Recency and suffix effects in serial recall of musical stimuli

Auditory presentation of verbal items leads to larger recency effects in recall than visual presentation. This enhanced recency can be eliminated if a stimulus suffix (an irrelevant sound) follows the last item. Four experiments tested the hypothesis that recency and suffix effects in serial recall result from a speech-specific process. It was demonstrated that serial recall of musical notes played on a piano exhibited substantial recency effects. These recency effects were reduced when the list items were followed by either a piano chord or the word start. However, a white-noise suffix had no effect on recency. This pattern of data is consistent with current work on auditory perception and places constraints on theories of recency and suffix effects.     

Stimulus suffixes and visual presentation

Seven experiments studied whether irrelevant visual stimuli (stimulus suffixes) would interfere with immediate serial recall of supraspan lists of digits presented visually. Across experiments a wide number of conditions were run, varying in method of presentation (sequential or simultaneous), rate of list presentation, and presence or absence of articulatory suppression. In no condition did a visual suffix have a significant detrimental effect on recall. These results stand in marked contrast to those found when auditory lists and suffixes have been used.     

Serial recall of two-voice lists: Implications for theories of auditory recency and suffix effects

Substantial recency effects are found in immediate serial recall of auditory items. These recency effects are greatly reduced when an irrelevant auditory stimulus (a stimulus suffix) is presented. A number of accounts that have been proposed to explain these phenomena assume that auditory items are susceptible to masking or overwriting in memory. Later items overwrite earlier items, leading to an advantage for the last item, unless it is masked by a suffix. This assumption is called into question by evidence that presenting list items in two voices has no beneficial effect in immediate serial recall. In addition, it is shown that suffix effects on both terminal and preterminal list items are influenced by the physical similarity of the suffix to the terminal item and not by the physical similarity of the suffix to preterminal items.     

Suffix effects and probe modality in probed recall: Implications for readout from sensory memory

The effect of a redundant stimulus suffix was investigated in three experiments using a probed recall task. The probe modality was auditory in the first experiment and visual in the second. In the third experiment, both probe modalities were tested. The presentation rate was varied in all three experiments and was confounded with the delay of the suffix. The suffix was found to have a small and approximately equal effect on the last six serial positions. In contrast to the predictions from Crowder and Morton's (1969) PAS model, presentation rate and suffix delay did not interact with the suffix effect. The results indicate that at least six items can be simultaneously represented in PAS, that there is no appreciable decay of information from PAS during presentation of the last list items, and that readout of PAS information does not occur either during list presentation or between the end of list presentation and the beginning of overt report.     

An “across-the-board” modality effect in immediate serial recall

A serial recall experiment comparing visual and auditory presentation is reported which demonstrates that, under certain conditions, there is an auditory advantage in the pre-recency (1-6) as well as the recency (7-8) serial positions. Presentation modality was combined factorially with five levels of a concurrent writing task, which had to be completed for each to-be-remembered digit during presentation: NC, no concurrent task; XX, writing two crosses; DX, writing each digit followed by a cross; XD, the converse of DX; and DD, writing each digit twice. When presentation was visual, there was a monotonic (non-decreasing) trend in the recall errors going from NC to DD (in above order) for both the pre-recency and recency positions on average. With an auditory presentation, however, the trend was more gradual, though still monotonic. For the pre-recency items, an auditory advantage was obtained with conditions XX, XD and DD, but not for NC and DX. Additionally, with an auditory presentation, there was no evidence of a difference between NC and XX, nor between DX and XD. It is argued that both pre-categorical acoustic storage and residual activation effects, engendered in a logogen system (Morton, 1970) by the repetition “structure” of the concurrent tasks, helped to determine the attentional capacity available for secondary (elaborative) rehearsal and, in turn, set the levels of recall.     

A developmental study of the Prelinguistic Auditory Store (PAS)

Lists of digits 5 and 7 items in length were presented to second graders, sixth graders, and low-IQ sixth graders in either the visual or auditory modality. Half the auditory lists were followed by the redundant nonrecalled, auditorily presented word “recall” which served as a list suffix. The second graders had the most errors in the ordered recall task followed by the low-IQ sixth- and normal sixth-graders in that order. The size of the modality and suffix effects for the various groups seemed to indicate that, for the younger subjects, a larger proportion of the recall after auditory presentation comes from the Prelinguistic Auditory Store than for the older subjects.     

Enumeration produces poor primacy for tactile presentation relative to visual and auditory presentation as the only modality effect

Methodological biases may help explain the modality effect, which is superior recall of auditory recency (end of list) items relative to visual recency items. In 1985 Nairne and McNabb used a counting procedure to reduce methodological biases, and they produced modality-like effects, such that recall of tactile recency items was superior to recall of visual recency items. The present study extended Nairne and McNabb's counting procedure and controlled several variables which may have enhanced recall of tactile end items or disrupted recall of visual end items in their study. Although the results of the present study indicated general serial position effects across tactile, visual, and auditory presentation modalities, the tactile condition showed lower recall for the initial items in the presentation list than the other two conditions. Moreover, recall of the final list item did not differ across the three presentation modalities; modality effects were not found. These results did not replicate the findings of Nairne and McNabb, or much of the past research showing superior recall of auditory recency items. Implications of these findings are discussed.     

Recency and suffix effects with immediate recall of olfactory stimuli

In contrast to our understanding of the immediate recall of auditory and visual material, little is known about the corresponding characteristics of short-term olfactory memory. The current study investigated the pattern of immediate serial recall and the associated suffix effect using olfactory stimuli. Subjects were trained initially to identify and name correctly nine different odours. Experiment 1 established an immediate correct recall span of approximately six items. In Experiment 2 participants recalled serially span equivalent lists which were followed by a visual, auditory, or olfactory suffix. Primacy was evident in the recall curves for all three suffix conditions. Recency, in contrast, was evident in the auditory and visual suffix conditions only; there was a strong suffix effect in the olfactory suffix condition. Experiment 3 replicated this pattern of effects using seven-item lists, and demonstrated that the magnitude of the recency and suffix effects obtained in the olfactory modality can equate to that obtained in the auditory modality. It is concluded that the pattern of recency and suffix effects in the olfactory modality is reliable, and poses difficulties for those theories that rely on the presence of a primary linguistic code, sound, or changing state as determinants of these effects in serial recall.     

Recency and suffix effects with immediate recall of olfactory stimuli

In contrast to our understanding of the immediate recall of auditory and visual material, little is known about the corresponding characteristics of short-term olfactory memory. The current study investigated the pattern of immediate serial recall and the associated suffix effect using olfactory stimuli. Subjects were trained initially to identify and name correctly nine different odours. Experiment 1 established an immediate correct recall span of approximately six items. In Experiment 2 participants recalled serially span equivalent lists which were followed by a visual, auditory, or olfactory suffix. Primacy was evident in the recall curves for all three suffix conditions. Recency, in contrast, was evident in the auditory and visual suffix conditions only; there was a strong suffix effect in the olfactory suffix condition. Experiment 3 replicated this pattern of effects using seven-item lists, and demonstrated that the magnitude of the recency and suffix effects obtained in the olfactory modality can equate to that obtained in the auditory modality. It is concluded that the pattern of recency and suffix effects in the olfactory modality is reliable, and poses difficulties for those theories that rely on the presence of a primary linguistic code, sound, or changing state as determinants of these effects in serial recall.     

Similarities between the irrelevant sound effect and the suffix effect

Although articulatory suppression abolishes the effect of irrelevant sound (ISE) on serial recall when sequences are presented visually, the effect persists with auditory presentation of list items. Two experiments were designed to test the claim that, when articulation is suppressed, the effect of irrelevant sound on the retention of auditory lists resembles a suffix effect. A suffix is a spoken word that immediately follows the final item in a list. Even though participants are told to ignore it, the suffix impairs serial recall of auditory lists. In Experiment 1, the irrelevant sound consisted of instrumental music. The music generated a significant ISE that was abolished by articulatory suppression. It therefore appears that, when articulation is suppressed, irrelevant sound must contain speech for it to have any effect on recall. This is consistent with what is known about the suffix effect. In Experiment 2, the effect of irrelevant sound under articulatory suppression was greater when the irrelevant sound was spoken by the same voice that presented the list items. This outcome is again consistent with the known characteristics of the suffix effect. It therefore appears that, when rehearsal is suppressed, irrelevant sound disrupts the acoustic-perceptual encoding of auditorily presented list items. There is no evidence that the persistence of the ISE under suppression is a result of interference to the representation of list items in a postcategorical phonological store.     

The role of visual interference in producing the long-term modality effect

Typically, recall of the last of a list of auditory items greatly exceeds recall of the last of a list of visual items. This modality effect has been found in serial recall, free recall, and recall using the distractor paradigm in which each to-be-remembered item is preceded and followed by distractor activity. One source of the auditory advantage may be visual interference that reduces recall of visual stimuli. In three experiments, sources of visual interference were minimized. Although this manipulation reduced the modality effect, it did not eliminate the effect.     

Immediate serial recall of mixed-modality lists

Seven experiments are reported in which subjects were tested for immediate serial recall of mixed-modality lists. On mixed auditory-visual lists, there was an advantage for auditory items at all serial positions. This was due to both a facilitation of auditory items and an inhibition of visual items on mixed lists, as compared with single-modality lists. When presented on a list containing items read silently, recall of items that were silently mouthed by the subject demonstrated patterns similar to those found with auditory items. When presented on a list containing items read aloud, recall of mouthed items showed patterns similar to those found with silently read items. The auditory advantage on mixed lists was found even when the list items were acoustically similar or identical and was not reduced by midlist auditory suffixes. The results suggest that modality differences in recall of mixed-modality lists are based on information different from that responsible for modality differences in recall of single-modality lists.     

Manipulations of irrelevant information: Suffix effects with articulatory suppression and irrelevant speech

Numerous studies have demonstrated impaired recall when the to-be-remembered information is accompanied or followed by irrelevant information. However, no current theory of immediate memory explains all three common methods of manipulating irrelevant information: requiring concurrent articulation, presenting irrelevant speech, and adding a stimulus suffix. Five experiments combined these manipulations to determine how they interact and which theoretical framework most accurately and completely accounts for the data. In Experiments 1 and 2, a list of auditory items was followed by an irrelevant speech sound (the suffix) while subjects engaged in articulatory suppression. Although articulatory suppression reduced overall recall compared to a control condition, comparable suffix effects were seen in both conditions. Experiments 3 and 4 found reliable suffix effects when list presentation was accompanied by irrelevant speech. Experiment 5 found a suffix effect even when the irrelevant speech was composed of a set of different items. Implications for working memory, pre-categorical acoustic store, the changing-state hypothesis, and the feature model are discussed.     

“Enacted” auditory images are ambiguous; “pure” auditory images are not

Previous research indicates that visual images are inherently unambiguous. The present study extends this argument to auditory imagery. In Experiment 1, subjects were able to reinterpret an imaged ambiguous auditory figure, but covert subvocalization apparently aided this reinterpretation. When subvocalization was blocked, reinterpretations were eliminated. Experiments 2 and 3 generalize this finding to different procedures and stimuli. Experiment 4 explores further the role of subvocalization, by showing that the likelihood of reinterpreting an imaged stimulus is directly proportional to the degree of enactment allowed. We argue that subvocalization or enactment provides an internal stimulus that is subject to reinterpretation. Without enactment, the “pure” auditory image is as unambiguous as a visual image. Thus, in both visual and auditory modalities, images come into being as representations and so are inherently meaningful.     

The word-length effect in probed and serial recall

The word-length effect in immediate serial recall has been explained as the possible consequence of rehearsal processes or of output processes. In the first experiment adult subjects heard lists of five long or short words while engaging in articulatory suppression during presentation. Full serial recall or probed recall for a single item followed the list either immediately or after a 5-second delay to encourage rehearsal. The word-length effect was not influenced by recall delay, but was much smaller in probed than in serial recall. Examination of the serial position curves suggested that this might be due to a recency component operating in probed recall. Experiment 2 confirmed a word-length-insensitive recency effect in probed recall and showed that this was resistant to an auditory suffix, unlike the small recency effect found in serial recall. Experiment 3 used visual presentation without concurrent articulation. Under these conditions there was no recency effect for either recall method, but the word-length effect was again much smaller in probed than in serial recall. This was confirmed in Experiment 4, in which the presentation of serial and probed recall was randomized across trials, showing that the differences between recall methods could not be due to encoding strategies. We conclude that for visual presentation, at least part of the word-length effect originates in output processes. For auditory presentation the position is less clear, as serial and probed recall appear to draw on different resources. The nature of the output processes that may give rise to word-length effects is discussed.     

The effects of recoding and presentation format on recency and suffix effects

The primary linguistic theory of Shand and Klima (1981) hypothesizes that stimuli that cannot be directly processed without recoding are not in the primary linguistic mode of the subject and thus should lead to lesser recency and associated suffix effects. In three experiments, different normal hearing subjects learned to pair American Sign Language (ASL) stimuli, visual "quasivocables" (QVs), word-like letter strings, and auditory QVs with common English words. In the first experiment, the subjects were given sequences of ASL or QV stimuli and required to recall the associated words in strict serial order. In two other experiments involving auditory and visual presentation, respectively, subjects who had never been given paired associate training were required to recall the English words that had previously been associated with the ASL and QV stimuli, in a standard suffix paradigm. The results showed recency and suffix effects to be present only with auditorily presented QVs and words. Contrary to the predictions of the primary linguistic hypothesis, greater recency and larger suffix effects were present with the auditory QVs than with the auditory words, although the QVs were not primary linguistic and the task involved forced recoding. Previous results showing recency with ASL stimuli in normal subjects were not replicated. It is concluded that recency and suffix effects are not related either to the primary linguistic mode of the subject or to stimulus recoding, as we and Shand and Klima have defined them.     

Abstract versus modality-specific memory representations in processing auditory and visual speech

Serial recall of lip-read, auditory, and audiovisual memory lists with and without a verbal suffix was examined. Recency effects were the same in the three presentation modalities. The disrupting effect of a suffix was largest when it was presented in the same modality as the list items. The results suggest that abstract linguistic as well as modality-specific codes play a role in memory for auditory and visual speech.     

Echoic and retrieval accounts of the long-term modality effect tested using the suffix procedure

The long-term modality effect is the advantage in recall of the last of a list of auditory to-be-remembered (TBR) items compared with the last of a list of visual TBR items when the list is followed by a filled retention interval. If the auditory advantage is due to echoic sensory memory mechanisms, then recall of the last auditory TBR item should be substantially reduced when it is followed by a redundant, not-to-be-recalled auditory suffix. Contrary to this prediction, Experiment 1 demonstrated that a redundant auditory suffix does not significantly reduce recall of the last auditory TBR item. In Experiment 2 a nonredundant auditory suffix produced a large reduction in the last auditory item. Redundancy is not the only factor controlling the effectiveness of a suffix, however. Experiment 3 demonstrated that a nonredundant visual suffix does not reduce recall of the last auditory TBR item. These results are discussed in reference to a retrieval account of the long-term modality effect.     

Can the irrelevant speech effect turn into a stimulus suffix effect?

The irrelevant sound effect (ISE) and the stimulus suffix effect (SSE) are two qualitatively different phenomena, although in both paradigms irrelevant auditory material is played while a verbal serial recall task is being performed. Jones, Macken, and Nicholls (2004) have proposed the effect of irrelevant speech on auditory serial recall to switch from an ISE to an SSE mechanism, if the auditory-perceptive similarity of relevant and irrelevant material is maximized. The experiment reported here (n = 36) tested this hypothesis by exploring auditory serial recall performance both under irrelevant speech and under speech suffix conditions. These speech materials were spoken either by the same voice as the auditory items to be recalled or by a different voice. The experimental conditions were such that the likelihood of obtaining an SSE was maximized. The results, however, show that irrelevant speech—in contrast to speech suffixes—affects auditory serial recall independently of its perceptive similarity to the items to be recalled and thus in terms of an ISE mechanism that crucially extends to recency. The ISE thus cannot turn into an SSE.     

Maintaining recency despite a stimulus suffix

Two processes of information retrieval were considered in the context of the logogen model. The aim was to establish whether information about the final items of an auditory short-term memory list is held exclusively in precategorical acoustic storage at presentation or whether these items are automatically registered in a cognitive store as well. Error data for a final heterogeneous item in alphanumeric lists showed significantly better recall, despite the addition of a stimulus suffix. Although these results demonstrated that coding had proceeded further than a precategorical stage, which maintains only physical features, the possibility remained that the effect was due to a bias in focal attention and selective coding at list presentation. A second experiment increased the difficulty of the retrieval task, and effectively precluded the possibility of a bias in attention. The results confirmed the findings in the first experiment. It was concluded that information about the final item(s) is registered automatically in the cognitive system, and that responses are made available from this source when information about physical features of the item is degraded by a stimulus suffix.