A common basis for auditory sensory storage in perception and immediate memory

Thirty-two subjects participated in three experiments, one assessing auditory short-term memory for word lists with and without a verbal suffix and two assessing discrimination of synthetic vowels at either short or long interstimulus delays. The purpose was to find out whether the same kind of auditory memory supports both short-term memory and speech discrimination. There was a significant correlation between performance in the suffix and A-X speech-discrimination experiments in those conditions likely to depend partly on echoic memory; however, there was no significant correlation between the tasks in conditions in which echoic memory was presumed to have been removed. The results provide a bridge between perception and memory procedures and support a theoretical model that was made to cover both domains.     

The stimulus suffix effect as a memory coding phenomenon

Two short-term memory experiments examined the nature of the stimulus suffix effect on auditory linguistic and nonlinguistic stimulus lists. In Experiment 1, where subjects recalled eight-item digit lists, it was found that a silently articulated digit suffix had the same effect on recall for the last list item as a spoken digit suffix. In Experiment 2, subjects recalled lists of sounds made by inanimate objects either by listing the names of the objects or by ordering a set of drawings of the objects. Auditory suffixes, either another object sound or the spoken name of an object, produced a suffix effect under both recall conditions, but a visually presented picture also produced a suffix effect when subjects recalled using pictures. The results were most adequately explained by a levels-of-processing memory coding hypothesis.     

The role of memory in attenuations of the suffix effect

Various properties attenuate the auditory suffix effect. These properties may improve recall by allowing the suffix to be excluded from the auditory store (or stores) used for immediate ordered recall, or they may improve recall even though the suffix is included in the auditory store. Nine items were presented, with the last item being either a suffix or another item to be recalled. In Experiment 1, the impairment in recall of the previous items produced by presenting a to-be-recalled last item in a different voice was the same as the impairment produced by presenting a suffix in a different voice. The same result was found in Experiment 2 for presenting the last item in a different spatial location and in Experiment 3 for delaying the presentation of the last item. Apparently the attenuating properties improve recall through memorial factors, and not by allowing the suffix to be excluded from the auditory store.     

Recency and suffix effects with immediate recall of olfactory stimuli

In contrast to our understanding of the immediate recall of auditory and visual material, little is known about the corresponding characteristics of short-term olfactory memory. The current study investigated the pattern of immediate serial recall and the associated suffix effect using olfactory stimuli. Subjects were trained initially to identify and name correctly nine different odours. Experiment 1 established an immediate correct recall span of approximately six items. In Experiment 2 participants recalled serially span equivalent lists which were followed by a visual, auditory, or olfactory suffix. Primacy was evident in the recall curves for all three suffix conditions. Recency, in contrast, was evident in the auditory and visual suffix conditions only; there was a strong suffix effect in the olfactory suffix condition. Experiment 3 replicated this pattern of effects using seven-item lists, and demonstrated that the magnitude of the recency and suffix effects obtained in the olfactory modality can equate to that obtained in the auditory modality. It is concluded that the pattern of recency and suffix effects in the olfactory modality is reliable, and poses difficulties for those theories that rely on the presence of a primary linguistic code, sound, or changing state as determinants of these effects in serial recall.     

Recency and suffix effects with immediate recall of olfactory stimuli

In contrast to our understanding of the immediate recall of auditory and visual material, little is known about the corresponding characteristics of short-term olfactory memory. The current study investigated the pattern of immediate serial recall and the associated suffix effect using olfactory stimuli. Subjects were trained initially to identify and name correctly nine different odours. Experiment 1 established an immediate correct recall span of approximately six items. In Experiment 2 participants recalled serially span equivalent lists which were followed by a visual, auditory, or olfactory suffix. Primacy was evident in the recall curves for all three suffix conditions. Recency, in contrast, was evident in the auditory and visual suffix conditions only; there was a strong suffix effect in the olfactory suffix condition. Experiment 3 replicated this pattern of effects using seven-item lists, and demonstrated that the magnitude of the recency and suffix effects obtained in the olfactory modality can equate to that obtained in the auditory modality. It is concluded that the pattern of recency and suffix effects in the olfactory modality is reliable, and poses difficulties for those theories that rely on the presence of a primary linguistic code, sound, or changing state as determinants of these effects in serial recall.     

Auditory memory and the irrelevant sound effect: Further evidence for changing-state disruption

Four experiments investigate the hypothesis that irrelevant sound interferes with serial recall of auditory items in the same fashion as with visually presented items. In Experiment 1 an acoustically changing sequence of 30 irrelevant utterances was more disruptive than 30 repetitions of the same utterance (the changing-state effect; Jones, Madden, & Miles, 1992) whether the to-be-remembered items were visually or auditorily presented. Experiment 2 showed that two different utterances spoken once (a heterogeneous compound suffix; LeCompte & Watkins, 1995) produced less disruption to serial recall than 15 repetitions of the same sequence. Disruption thus depends on the number of sounds in the irrelevant sequence. In Experiments 3a and 3b the number of different sounds, the "token-set" size (Tremblay & Jones, 1998), in an irrelevant sequence also influenced the magnitude of disruption in both irrelevant sound and compound suffix conditions. The results support the view that the disruption of memory for auditory items, like memory for visually presented items, is dependent on the number of different irrelevant sounds presented and the size of the set from which these sounds are taken. Theoretical implications are discussed.     

Modalities of memory: Is reading lips like hearing voices?

Functional similarities in verbal memory performance across presentation modalities (written, heard, lipread) are often taken to point to a common underlying representational form upon which the modalities converge. We show here instead that the pattern of performance depends critically on presentation modality and different mechanisms give rise to superficially similar effects across modalities. Lipread recency is underpinned by different mechanisms to auditory recency, and while the effect of an auditory suffix on an auditory list is due to the perceptual grouping of the suffix with the list, the corresponding effect with lipread speech is due to misidentification of the lexical content of the lipread suffix. Further, while a lipread suffix does not disrupt auditory recency, an auditory suffix does disrupt recency for lipread lists. However, this effect is due to attentional capture ensuing from the presentation of an unexpected auditory event, and is evident both with verbal and nonverbal auditory suffixes. These findings add to a growing body of evidence that short-term verbal memory performance is determined by modality-specific perceptual and motor processes, rather than by the storage and manipulation of phonological representations.     

Echoic and retrieval accounts of the long-term modality effect tested using the suffix procedure

The long-term modality effect is the advantage in recall of the last of a list of auditory to-be-remembered (TBR) items compared with the last of a list of visual TBR items when the list is followed by a filled retention interval. If the auditory advantage is due to echoic sensory memory mechanisms, then recall of the last auditory TBR item should be substantially reduced when it is followed by a redundant, not-to-be-recalled auditory suffix. Contrary to this prediction, Experiment 1 demonstrated that a redundant auditory suffix does not significantly reduce recall of the last auditory TBR item. In Experiment 2 a nonredundant auditory suffix produced a large reduction in the last auditory item. Redundancy is not the only factor controlling the effectiveness of a suffix, however. Experiment 3 demonstrated that a nonredundant visual suffix does not reduce recall of the last auditory TBR item. These results are discussed in reference to a retrieval account of the long-term modality effect.     

Auditory memory and the irrelevant sound effect: Further evidence for changing-state disruption

Four experiments investigate the hypothesis that irrelevant sound interferes with serial recall of auditory items in the same fashion as with visually presented items. In Experiment 1 an acoustically changing sequence of 30 irrelevant utterances was more disruptive than 30 repetitions of the same utterance (the changing-state effect; Jones, Madden, & Miles, 1992) whether the to-be-remembered items were visually or auditorily presented. Experiment 2 showed that two different utterances spoken once (a heterogeneous compound suffix; LeCompte & Watkins, 1995) produced less disruption to serial recall than 15 repetitions of the same sequence. Disruption thus depends on the number of sounds in the irrelevant sequence. In Experiments 3a and 3b the number of different sounds, the "token-set" size (Tremblay & Jones, 1998), in an irrelevant sequence also influenced the magnitude of disruption in both irrelevant sound and compound suffix conditions. The results support the view that the disruption of memory for auditory items, like memory for visually presented items, is dependent on the number of different irrelevant sounds presented and the size of the set from which these sounds are taken. Theoretical implications are discussed.     

The delayed stimulus suffix effect following arhythmic stimulus presentation

In auditory memory span experiments an extra word presented at the end of the list impairs performance on the last few items even though it is completely redundant; delaying this stimulus suffix past the time when an additional memory item would have occurred--so that the rate of presentation is retarded for the suffix--reduces the magnitude of the performance impairment. One account of this pattern of results is that during presentation of the items the subject adjusts periodic bursts of attention to the regular cadence of new information. Since an immediate suffix is in time with this cadence and a delayed suffix not, the larger effect of the former is explained without appeal to any process dependent on real time. In the present study the stimulus items were presented in an arhythmic manner with interstimulus intervals ranging from 100 to 900 ms on a random basis. Under these conditions the same effect of delaying the suffix was observed as is typical of rhythmic stimulus presentation; therefore, the rhythm hypothesis for the effect is not supported.     

Attenuating the visual suffix effect with color

In previous studies using a short-duration visual presentation (200-340 msec), presentation of a different colored suffix did not attenuate the visual suffix effect. In Experiment 1, color attenuated the suffix effect for a longer duration visual presentation (approximately 3-4 sec) during which the subject engaged in articulatory suppression to prevent auditory recoding. Experiments 2 and 3 confirmed that color does not attenuate the suffix effect for the short-duration presentations. In Experiment 4, recall of a long-duration presentation was not improved when the last digit was a different color, suggesting that the different color of the suffix improves recall by allowing the suffix to be excluded from visual short-term memory. The attenuation by color is consistent with the hypothesis that preattentive grouping governs the entry of information into visual short-term memory.     

Stimulus suffix effects with speech and nonspeech sounds

The stimulus suffix effect (SSE) was examined with short sequences of words and meaningful nonspeech sounds. In agreement with previous findings, the SSE for word sequences was obtained with a speech, but not a nonspeech, suffix. The reverse was true for sounds. The results contribute further evidence for a functional distinction between speech and nonspeech processing mechanisms in auditory memory.     

Serial recall of two-voice lists: Implications for theories of auditory recency and suffix effects

Substantial recency effects are found in immediate serial recall of auditory items. These recency effects are greatly reduced when an irrelevant auditory stimulus (a stimulus suffix) is presented. A number of accounts that have been proposed to explain these phenomena assume that auditory items are susceptible to masking or overwriting in memory. Later items overwrite earlier items, leading to an advantage for the last item, unless it is masked by a suffix. This assumption is called into question by evidence that presenting list items in two voices has no beneficial effect in immediate serial recall. In addition, it is shown that suffix effects on both terminal and preterminal list items are influenced by the physical similarity of the suffix to the terminal item and not by the physical similarity of the suffix to preterminal items.     

Absence of a cross-modal “suffix effect” in short-term memory

Three experiments are reported involving the presentation of lists of either letters or digits for immediate serial recall. The main variable was the presence or absence of a suffix-prefix, an item (tick or cross) occurring at the end of the list which had to be copied before recall of the stimulus list. With auditory stimuli and an auditory suffix-prefix there was a large and selective increase in the number of errors on the last few serial positions—the typical “suffix effect”. The suffix effect was not found with auditory stimuli and a visual suffix-prefix nor with a visual stimulus and an auditory suffix-prefix. These results are interpreted as supporting a model for short-term memory proposed by Crowder and Morton (1969) in which it is suggested that with serial recall information concerning the final items following auditory presentation has a different, precategorical, origin from that concerning other items.     

Suffix effects in lists of temporally grouped words

Two groups of university students were presented with auditory lists of temporally grouped words for recall. The lists were immediately followed by either a redundant suffix, a nonredundant suffix or no suffix. One group of subjects was instructed to recall the items in strict serial order; the second group was required to write the last items first, indicating the position of all items in the list. According to Kahneman's (1973) account of the suffix effect, the interfering effect of the suffix should be eliminated when the suffix is segregated in a different group or perceptual unit from the memory items. The results did not support the prediction from Kahneman's hypothesis. An alternative account of the suffix effect was presented.     

Short-lived auditory memory for pitch

The effect of a stimulus suffix on immediate serial recall of lists of tones was assessed with 50- and 350-msec complex tones. Although recency effects were not found under the control conditions, the addition of a stimulus suffix significantly degraded recall at the final serial position for both stimulus durations. The implications of these results for models of auditory memory and speech perception are discussed.     

Manipulations of irrelevant information: Suffix effects with articulatory suppression and irrelevant speech

Numerous studies have demonstrated impaired recall when the to-be-remembered information is accompanied or followed by irrelevant information. However, no current theory of immediate memory explains all three common methods of manipulating irrelevant information: requiring concurrent articulation, presenting irrelevant speech, and adding a stimulus suffix. Five experiments combined these manipulations to determine how they interact and which theoretical framework most accurately and completely accounts for the data. In Experiments 1 and 2, a list of auditory items was followed by an irrelevant speech sound (the suffix) while subjects engaged in articulatory suppression. Although articulatory suppression reduced overall recall compared to a control condition, comparable suffix effects were seen in both conditions. Experiments 3 and 4 found reliable suffix effects when list presentation was accompanied by irrelevant speech. Experiment 5 found a suffix effect even when the irrelevant speech was composed of a set of different items. Implications for working memory, pre-categorical acoustic store, the changing-state hypothesis, and the feature model are discussed.     

A tactile suffix effect

Evidence for a representational tactile memory was obtained from a tactile analogue of the auditory suffix effect. In two experiments, a short sequence of tactile stimuli applied to the fingers was followed by an acoustic (control) or tactile (suffix) recall signal. The serial position curves for the two conditions were compared. They revealed similar and strong primacy effects, but recall of the last few stimuli was higher in the control condition. This terminal control advantage was attributed to the retention of raw tactile information.     

Waiting for the stimulus suffix: Decay, delay, rhythm, and readout in immediate memory

The degree to which a redundant suffix impairs performance on digit lists depends on the delay between the last memory item and the suffix. A set of three experiments is offered, establishing the inadequacy of hypotheses based on simple decay of prelinguistic information, passage of time before recall, and rhythmic periodicities in attention. The delayed suffix effect is consistent with a fourth hypothesis whose emphasis is on access to precategorical auditory information through a “readout” process rather than on the sheer availability of such information.     

Capturing the suffix: cognitive streaming in immediate serial recall

Adding an irrelevant item to the end of an auditory to-be-remembered list increases error on the last list items appreciably, known as the suffix effect. The phenomenon of auditory capture (e.g., Bregman & Rudnicky, 1975), namely, the tendency for a sequence of similar items to form a stream that at the same time isolates perceptually dissimilar members of the sequence, is exploited to explore the suffix effect. Irrelevant items interleaved between to-be-remembered items are used to capture the suffix with the aim of reducing its impact. Four experiments illustrate how the properties of the irrelevant sequence promote capture. The results are problematic for models of the suffix that involve masking of the last list item; instead, models based on grouping are favored.