Enumeration produces poor primacy for tactile presentation relative to visual and auditory presentation as the only modality effect

Methodological biases may help explain the modality effect, which is superior recall of auditory recency (end of list) items relative to visual recency items. In 1985 Nairne and McNabb used a counting procedure to reduce methodological biases, and they produced modality-like effects, such that recall of tactile recency items was superior to recall of visual recency items. The present study extended Nairne and McNabb's counting procedure and controlled several variables which may have enhanced recall of tactile end items or disrupted recall of visual end items in their study. Although the results of the present study indicated general serial position effects across tactile, visual, and auditory presentation modalities, the tactile condition showed lower recall for the initial items in the presentation list than the other two conditions. Moreover, recall of the final list item did not differ across the three presentation modalities; modality effects were not found. These results did not replicate the findings of Nairne and McNabb, or much of the past research showing superior recall of auditory recency items. Implications of these findings are discussed.     

Recency effects in delayed recall of mouthed stimuli

Auditory presentation leads to greater recency effects in recall than does visual presentation. This phenomenon (the modality effect) is found in both free and serial recall and in both immediate and delayed recall. Silent mouthing of visually presented stimuli also leads to enhanced recency effects in immediate serial recall. Two experiments reported here extend the generality of the mouthing effect by demonstrating that enhanced recency effects of mouthed stimuli occur in delayed serial and free recall. These results are inconsistent with theories that attribute the modality effect to a purely auditory sensory memory.     

The separate but related origins of the recency effect and the modality effect in free recall

The recency effect found in free recall can be accounted for almost entirely in terms of the recall of ordered sequences of items. It is such sequences, presented at the end of the stimulus list but recalled at the very beginning of the response protocol, which produce a recency effect. Such sequences are recalled at the beginning of the response protocol equally often following auditory and visual presentation. These same stimulus sequences are also frequently recalled other than initially in the response protocol following auditory presentation. However, such responses are rarely found following visual presentation. The modality effect in free recall, the advantage of auditory over visual presentation, can be substantially accounted for in these terms. Theoretical and procedural implications of these data are discussed.     

Recency and suffix effects in serial recall of musical stimuli

Auditory presentation of verbal items leads to larger recency effects in recall than visual presentation. This enhanced recency can be eliminated if a stimulus suffix (an irrelevant sound) follows the last item. Four experiments tested the hypothesis that recency and suffix effects in serial recall result from a speech-specific process. It was demonstrated that serial recall of musical notes played on a piano exhibited substantial recency effects. These recency effects were reduced when the list items were followed by either a piano chord or the word start. However, a white-noise suffix had no effect on recency. This pattern of data is consistent with current work on auditory perception and places constraints on theories of recency and suffix effects.     

The word-length effect in probed and serial recall

The word-length effect in immediate serial recall has been explained as the possible consequence of rehearsal processes or of output processes. In the first experiment adult subjects heard lists of five long or short words while engaging in articulatory suppression during presentation. Full serial recall or probed recall for a single item followed the list either immediately or after a 5-second delay to encourage rehearsal. The word-length effect was not influenced by recall delay, but was much smaller in probed than in serial recall. Examination of the serial position curves suggested that this might be due to a recency component operating in probed recall. Experiment 2 confirmed a word-length-insensitive recency effect in probed recall and showed that this was resistant to an auditory suffix, unlike the small recency effect found in serial recall. Experiment 3 used visual presentation without concurrent articulation. Under these conditions there was no recency effect for either recall method, but the word-length effect was again much smaller in probed than in serial recall. This was confirmed in Experiment 4, in which the presentation of serial and probed recall was randomized across trials, showing that the differences between recall methods could not be due to encoding strategies. We conclude that for visual presentation, at least part of the word-length effect originates in output processes. For auditory presentation the position is less clear, as serial and probed recall appear to draw on different resources. The nature of the output processes that may give rise to word-length effects is discussed.     

Ineffectiveness of visual distinctiveness in enhancing immediate recall

Glenberg (1984) and others have theorized that greater recency effects are obtained with auditory as opposed to visual presentation because of greater temporal distinctiveness of items in auditory sequences. We tested a number of ways of enhancing visual distinctiveness, including the use of color, spatial location, and minimized visual interference. None of the seven experiments provided any evidence of improved recall from enhanced visual distinctiveness. In particular, no increase in recency effects was obtained with increased distinctiveness. Additional analyses of pairwise dependency in recall across serial positions also failed to show any evidence of the near-independence of recall of the terminal item that characterizes recall of auditory sequences. Visual-perceptual distinctiveness does not get mapped in any simple way onto memorial distinctiveness in an immediate-serial-recall task.     

Hearing by eye

Recent work on integration of auditory and visual information during speech perception has indicated that adults are surprisingly good at, and rely extensively on, lip reading. The conceptual status of lip read information is of interest: such information is at the same time both visual and phonological. Three experiments investigated the nature of short term coding of lip read information in hearing subjects. The first experiment used asynchronous visual and auditory information and showed that a subject's ability to repeat words, when heard speech lagged lip movements, was unaffected by the lag duration, both quantitatively and qualitatively. This suggests that lip read information is immediately recoded into a durable code. An experiment on serial recall of lip read items showed a serial position curve containing a recency effect (characteristic of auditory but not visual input). It was then shown that an auditory suffix diminishes the recency effect obtained with lip read stimuli. These results are consistent with the hypothesis that seen speech, that is not heard, is encoded into a durable code which has some shared properties with heard speech. The results of the serial recall experiments are inconsistent with interpretations of the recency and suffix effects in terms of precategorical acoustic storage, for they demonstrate that recency and suffix effects can be supra-modal.     

Is there a modality effect? Evidence for visual recency and suffix effects

In Experiment 1, four groups of 16 subjects performed ordered recall of six-syllable lists in both suffix and nonsuffix conditions. Sequential presentation of the lists varied for each group. In the auditory presentation, the syllables were delivered from one location only and were read aloud by the subjects. For the visual, spatially nondistributed presentation, the syllables appeared in one location only and were read silently. For visual, spatially distributed presentations, the syllables were spread out either vertically or horizontally and were read silently. Very robust recency and suffix effects were found in the auditory presentation, as well as in visual, spatially distributed presentations. In Experiment 2, 16 subjects performed ordered recall of visually presented lists with the items spread out vertically and conflicting spatial and temporal orders. A reliable recency effect was found for the final block of trials. In Experiment 3, 16 subjects performed ordered recall in the same conditions as in Experiment 2, except that they were instructed to recall the temporal order in which the spatial positions would be filled in. A bow-shaped curve and a strong recency effect were obtained.     

Recency and the modality effect in immediate ordered recall

In immediate ordered recall, recency is the improved recall of the last item of a presentation, and the modality effect is the advantage for an acoustic presentation over a subvocalized visual presentation, primarily occurring at the last serial position. Experiment 1 tested grouped presentations. There was a modality effect for the first item of the last group, even though that item was at the third-to-last or fourth-to-last serial position. In Experiment 2, for vocalized presentations of syllables ending in a, recency was larger for staccato speech than legato speech; for subvocalized presentations, there was a substantial recency for the legato style. In Experiment 3, recency was larger for a set of syllables ending in ATE than for a set of syllables ending in AME. These results suggest that recency cannot be explained by the existence of a fixed-capacity store, auxiliary to the auditory short-term store, that retains only some types of presentations. It is suggested instead that recency might reflect an auxiliary method of using the information in the auditory short-term store.     

An “across-the-board” modality effect in immediate serial recall

A serial recall experiment comparing visual and auditory presentation is reported which demonstrates that, under certain conditions, there is an auditory advantage in the pre-recency (1-6) as well as the recency (7-8) serial positions. Presentation modality was combined factorially with five levels of a concurrent writing task, which had to be completed for each to-be-remembered digit during presentation: NC, no concurrent task; XX, writing two crosses; DX, writing each digit followed by a cross; XD, the converse of DX; and DD, writing each digit twice. When presentation was visual, there was a monotonic (non-decreasing) trend in the recall errors going from NC to DD (in above order) for both the pre-recency and recency positions on average. With an auditory presentation, however, the trend was more gradual, though still monotonic. For the pre-recency items, an auditory advantage was obtained with conditions XX, XD and DD, but not for NC and DX. Additionally, with an auditory presentation, there was no evidence of a difference between NC and XX, nor between DX and XD. It is argued that both pre-categorical acoustic storage and residual activation effects, engendered in a logogen system (Morton, 1970) by the repetition “structure” of the concurrent tasks, helped to determine the attentional capacity available for secondary (elaborative) rehearsal and, in turn, set the levels of recall.     

Phonological short-term store and the nature of the recency effect: Evidence from neuropsychology

The recency effect in immediate recall of lists of unrelated words was investigated in P.V., a left hemisphere-damaged patient, who had a grossly reduced auditory verbal span, attributed to a selective impairment of a phonological short-term store. No recency effect was evident in free recall of auditorily presented material. When the patient was instructed to recall the final items of the list first, the recency performance remained defective, even though P.V. was able to adopt a recall from end order. In the case of visual presentation, P.V.'s free recall performance was within the normal range and a clear recency occurred in the recall from end condition. These results are consistent with the view that the standard recency effect in immediate free recall of auditorily presented material represents the output of a phonological short-term store to which ordinal retrieval strategies, in P.V.'s case unimpaired, are applied. Finally, the contributions of the phonological short-term store and the process of rehearsal to the recency effect and to immediate memory span performance are discussed.     

The effects of recoding and presentation format on recency and suffix effects

The primary linguistic theory of Shand and Klima (1981) hypothesizes that stimuli that cannot be directly processed without recoding are not in the primary linguistic mode of the subject and thus should lead to lesser recency and associated suffix effects. In three experiments, different normal hearing subjects learned to pair American Sign Language (ASL) stimuli, visual "quasivocables" (QVs), word-like letter strings, and auditory QVs with common English words. In the first experiment, the subjects were given sequences of ASL or QV stimuli and required to recall the associated words in strict serial order. In two other experiments involving auditory and visual presentation, respectively, subjects who had never been given paired associate training were required to recall the English words that had previously been associated with the ASL and QV stimuli, in a standard suffix paradigm. The results showed recency and suffix effects to be present only with auditorily presented QVs and words. Contrary to the predictions of the primary linguistic hypothesis, greater recency and larger suffix effects were present with the auditory QVs than with the auditory words, although the QVs were not primary linguistic and the task involved forced recoding. Previous results showing recency with ASL stimuli in normal subjects were not replicated. It is concluded that recency and suffix effects are not related either to the primary linguistic mode of the subject or to stimulus recoding, as we and Shand and Klima have defined them.     

Effects of same-modality interference on immediate serial recall of auditory and visual information.

Two studies investigated the effects of same-modality interference on the immediate serial recall of auditorily and visually presented stimuli. Typically, research in which this task is used has been conducted in quiet rooms, excluding auditory information that is extraneous to the auditorily presented stimuli. However, visual information such as background items clearly within the subject's view have not been excluded during visual presentation. Therefore, in both the present studies, the authors used procedures that eliminated extra-list visual interference and introduced extra-list auditory interference. When same-modality interference was eliminated, weak visual recency effects were found, but they were smaller than those that were generated by auditorily presented items. Further, mid-list and end-of-list recall of visually presented stimuli was unaffected by the amount of interfering visual information. On the other hand, the introduction of auditory interference increased mid-list recall of auditory stimuli. The results of Experiment 2 showed that the mid-list effect occurred with a moderate, but not with a minimal or maximal, level of auditory interference, indicating that moderate amounts of auditory interference had an alerting effect that is not present in typical visual interference.     

Influence of recall procedures on the modality effect with numbers and enumerated stimuli

Experiment 1 extended J. S. Nairne and W. L. McNabb's (1985) counting procedure for presenting numerical stimuli to examine the modality effect. The present authors presented participants with dots and beeps and instructed participants to count the items to derive to-be-remembered numbers. In addition, the authors presented numbers as visual and auditory symbols, and participants recalled items by using free-serial written recall. Experiment 1 demonstrated primacy effects, recency effects, and modality effects for visual and auditory symbols and for counts of dots and beeps. Experiment 2 replicated the procedure in Experiment 1 using strict-serial written recall instead of free-serial written recall. The authors demonstrated primacy and recency effects across all 4 presentation conditions and found a modality effect for numbers that the authors presented as symbols. However, the authors found no modality effect when they presented numbers as counts of beeps and dots. The authors discuss the implications of the results in terms of methods for testing modality effects.     

Mechanisms of aural encoding: VII. Differences in consonant and vowel recall in a Peterson and Peterson short-term memory paradigm

Ss either saw or heard lists of three syllables which differed by their initial consonant phoneme or their final vowel phoneme. After 5 or 15 sec of mental arithmetic, Ss were required to recall the syllables. Following auditory presentation, vowels were recalled more accurately than consonants in all serial positions and at both delays. In addition, spoken consonants and vowels showed primacy and recency effects. Following visual presentation, consonants and vowels were recalled with equal accuracy at both delays, and no recency effects were observed. These data suggest that superior recall of vowels over consonants results from differential decay of these stimuli in an acoustic storage. These data are consistent with previous experiments showing that, during serial recall, the final vowels in a sequence are recalled more accurately than the final consonants.     

Visual and auditory stores in short-term memory

If retrieval in short-term memory can be either from a pre-perceptual sensory store or from a post-perceptual memory then recall should vary as a function of input into sensory store. To test this possibility two experiments with paired associates compared visual and auditory presentation under conditions as comparable as possible. In both experiments modality interacted with retention interval: more recency with auditory but, in Experiment I, more primacy with visual. The interaction was taken as support for the hypothesis. An alternative hypothesis (that storage is post-perceptual but not a-historical) was discussed and weak negative evidence presented.     

Effects of encoding strategy,presentation modality,and scoring method on STM performance with the Peterson and Peterson technique

The Peterson and Peterson (1959) STM experiment was replicated with variation of presentation modality and encoding strategy. The effect of various scoring criteria was also analyzed. The recall data showed that a Peterson and Peterson type forgetting curve was obtained using auditory presentation and instructions to rehearse vocally the trigrams when scoring only completely correct recall within the first 3 sec of the recall interval. With visual presentation and instructions to find meaningful trigram interpretations, the forgetting curve was higher and much more flat, especially when scoring position correct recall within the total 0-10-sec recall interval. In a buildup of PI experiment, no buildup of PI could be detected when visual presentation was used together with instructions to find meaningful trigram interpretations. The importance of the different encoding activities for recall performance was discussed.     

Recency and suffix effects with immediate recall of olfactory stimuli

In contrast to our understanding of the immediate recall of auditory and visual material, little is known about the corresponding characteristics of short-term olfactory memory. The current study investigated the pattern of immediate serial recall and the associated suffix effect using olfactory stimuli. Subjects were trained initially to identify and name correctly nine different odours. Experiment 1 established an immediate correct recall span of approximately six items. In Experiment 2 participants recalled serially span equivalent lists which were followed by a visual, auditory, or olfactory suffix. Primacy was evident in the recall curves for all three suffix conditions. Recency, in contrast, was evident in the auditory and visual suffix conditions only; there was a strong suffix effect in the olfactory suffix condition. Experiment 3 replicated this pattern of effects using seven-item lists, and demonstrated that the magnitude of the recency and suffix effects obtained in the olfactory modality can equate to that obtained in the auditory modality. It is concluded that the pattern of recency and suffix effects in the olfactory modality is reliable, and poses difficulties for those theories that rely on the presence of a primary linguistic code, sound, or changing state as determinants of these effects in serial recall.     

Recency and suffix effects with immediate recall of olfactory stimuli

In contrast to our understanding of the immediate recall of auditory and visual material, little is known about the corresponding characteristics of short-term olfactory memory. The current study investigated the pattern of immediate serial recall and the associated suffix effect using olfactory stimuli. Subjects were trained initially to identify and name correctly nine different odours. Experiment 1 established an immediate correct recall span of approximately six items. In Experiment 2 participants recalled serially span equivalent lists which were followed by a visual, auditory, or olfactory suffix. Primacy was evident in the recall curves for all three suffix conditions. Recency, in contrast, was evident in the auditory and visual suffix conditions only; there was a strong suffix effect in the olfactory suffix condition. Experiment 3 replicated this pattern of effects using seven-item lists, and demonstrated that the magnitude of the recency and suffix effects obtained in the olfactory modality can equate to that obtained in the auditory modality. It is concluded that the pattern of recency and suffix effects in the olfactory modality is reliable, and poses difficulties for those theories that rely on the presence of a primary linguistic code, sound, or changing state as determinants of these effects in serial recall.     

Spatial and temporal processing in the auditory and visual modalities

Three experiments tested the idea that auditory presentation facilitates temporal recall whereas spatial recall is better if the input modality is visual. Lists of words were presented in which the temporal and spatial orders were independent, and instructions to the subjects determined whether recall would be given in a spatial or temporal order. In all three experiments, a significant interaction between the input modality and the type of recall was found, such that visual presentation resulted in superior recall over auditory presentation in the spatial conditions and auditory presentation yielded superior recall to visual in the temporal conditions. The present results contradict an earlier study by Murdock that showed that auditory presentation resulted in better performance than visual presentation in a nominally spatial task. An explanation for the discrepancies between the results of that study and the present one is presented.