Insensitivity of visual short-term memory to irrelevant visual information

Several authors have hypothesized that visuo-spatial working memory is functionally analogous to verbal working memory. Irrelevant background speech impairs verbal short-term memory. We investigated whether irrelevant visual information has an analogous effect on visual short-term memory, using a dynamic visual noise (DVN) technique known to disrupt visual imagery (Quinn & McConnell, 1996b). Experiment 1 replicated the effect of DVN on pegword imagery. Experiments 2 and 3 showed no effect of DVN on recall of static matrix patterns, despite a significant effect of a concurrent spatial tapping task. Experiment 4 showed no effect of DVN on encoding or maintenance of arrays of matrix patterns, despite testing memory by a recognition procedure to encourage visual rather than spatial processing. Serial position curves showed a one-item recency effect typical of visual short-term memory. Experiment 5 showed no effect of DVN on short-term recognition of Chinese characters, despite effects of visual similarity and a concurrent colour memory task that confirmed visual processing of the characters. We conclude that irrelevant visual noise does not impair visual short-term memory. Visual working memory may not be functionally analogous to verbal working memory, and different cognitive processes may underlie visual short-term memory and visual imagery.     

Selective interference with verbal short-term memory for serial order information: A new paradigm and tests of a timing-signal hypothesis

Many recent computational models of verbal short-term memory postulate a separation between processes supporting memory for the identity of items and processes supporting memory for their serial order. Furthermore, some of these models assume that memory for serial order is supported by a timing signal. We report an attempt to find evidence for such a timing signal by comparing an “item probe” task, requiring memory for items, with a “list probe” task, requiring memory for serial order. Four experiments investigated effects of irrelevant speech, articulatory suppression, temporal grouping, and paced finger tapping on these two tasks. In Experiments 1 and 2, irrelevant speech and articulatory suppression had a greater detrimental effect on the list probe task than on the item probe task. Reaction time data indicated that the list probe task, but not the item probe task, induced serial rehearsal of items. Phonological similarity effects confirmed that both probe tasks induced phonological recoding of visual inputs. Experiment 3 showed that temporal grouping of items during list presentation improved performance on the list probe task more than on the item probe task. In Experiment 4, paced tapping had a greater detrimental effect on the list probe task than on the item probe task. However, there was no differential effect of whether tapping was to a simple or a complex rhythm. Overall, the data illustrate the utility of the item probe/list probe paradigm and provide support for models that assume memory for serial order and memory for items involve separate processes. Results are generally consistent with the timing-signal hypothesis but suggest further factors that need to be explored to distinguish it from other accounts.     

Overwriting of phonemic features in serial recall

We tested two explanations of the phonological similarity effect in verbal short-term memory: The confusion hypothesis assumes that serial positions of similar items are confused. The overwriting hypothesis states that similar items share feature representations, which are overwritten. Participants memorised a phonologically dissimilar list of CVC-trigrams (Experiment 1) or words (Experiment 2 and 3) for serial recall. In the retention interval they read aloud other items. The material of the distractor task jointly overlapped one item of the memory list. The recall of this item was impaired, and the effect was not based on intrusions from the distractor task alone. The results provide evidence for feature overwriting as one potential mechanism contributing to the phonological similarity effect.     

Stimulus-specific processing consequences of pattern goodness

Two issues concerning the effects of visual pattern goodness on information processing time were investigated: the role of memory vs. encoding and the role of individual stimulus goodness vs. stimulus similarity. A sequential “same-different” task was used to provide differentiation of target item or memory effects from display item or encoding effects. Experiment 1 used four alternative stimuli in each block of trials. The results showed that good patterns were processed faster than poor patterns for both “same” and “different” responses. Furthermore, the goodness of the target item had a greater effect on reaction time than did the goodness of the display item, indicating that memory is more important than encoding in producing faster processing of good stimuli. Effects of interstimulus similarity on processing time were minimal, although isolation of good stimuli in a similarity space could explain many of the results. Experiment 2 replicated the results of Experiment 1, despite the fact that differences in similarity space had been minimized by using only two alternative stimuli in each block. In addition, the speed of processing a “same” pair was essentially independent of the particular alternative stimulus in a block. These results suggest that in this task, there is a processing advantage for good stimuli that is stimulus specific, with the effect operating primarily in memory.     

Visual and phonological components of working memory in children

Previous studies have shown that young children's immediate memory for a short series of drawings of objects is mediated by a visual component of working memory, whereas older children rely chiefly upon a phonological component. Three experiments investigated the hypothesis that older children rely also, but to a lesser extent, on visual working memory. Experiment 1 confirmed previous evidence that 11-year-olds' memory is disrupted by phonemic similarity of object names, but is unaffected by visual similarity of the objects themselves. However, when articulatory suppression was used to prevent phonological coding, levels of recall were sensitive to visual rather than phonemic similarity. Experiment 2 compared the effects of interpolating an auditory-verbal or a visual postlist task on memory for drawings viewed either with or without suppression. The visual task had a clear disruptive effect only in the suppression condition, where it interfered selectively with recall of the most recent item. Experiment 3 compared the effects of interpolating an auditory-verbal or a mixed-modality (visual-auditory) postlist task when subjects were not required to suppress. There was greater interference from the mixed-modality task, and this effect was confined to the last item presented. These experiments are taken as confirming the presence of a small but reliable contribution from visual memory in 11-year-old children's recall. As in younger children, visual working memory in 11-year-olds is sensitive to visual similarity and is responsible for a final-item visual recency effect. The results also show that older children's use of visual working memory is usually masked by the more pervasive phonological component of recall. Some implications for the structure of working memory and its development are discussed.     

Disruption of order information by irrelevant items: a serial recognition paradigm

Irrelevant speech effect (ISE) is defined as a decrement in visually presented digit-list short-term memory performance due to exposure to irrelevant auditory material. Perhaps the most successful theoretical explanation of the effect is the changing state hypothesis. This hypothesis explains the effect in terms of confusion between amodal serial order cues, and represents a view based on the interference caused by the processing of similar order information of the visual and auditory materials. An alternative view suggests that the interference occurs as a consequence of the similarity between the visual and auditory contents of the stimuli. An important argument for the former view is the observation that ISE is almost exclusively observed in tasks that require memory for serial order. However, most short-term memory tasks require that both item and order information be retained in memory. An ideal task to investigate the sensitivity of maintenance of serial order to irrelevant speech would be one that calls upon order information but not item information. One task that is particularly suited to address this issue is serial recognition. In a typical serial recognition task, a list of items is presented and then probed by the same list in which the order of two adjacent items has been transposed. Due to the re-presentation of the encoding string, serial recognition requires primarily the serial order to be maintained while the content of the presented items is deemphasized. In demonstrating a highly significant ISE of changing versus steady-state auditory items in a serial recognition task, the present finding lends support for and extends previous empirical findings suggesting that irrelevant speech has the potential to interfere with the coding of the order of the items to be memorized.     

Visual memory and stimulus repetition effects

Recent investigations of memory for randomly configured patterns indicate that visual memory can involve distinct short-term and long-term components. The appearance of a visual recency effect that is confined to the last-presented item is believed to result from the active visualization of this item during the retention interval. Studies of the retention of familiar visual information have also suggested that the short-term effects observed are a result of active visualization. In a review of these studies, however, we argue that the effects obtained with familiar visual information are not necessarily a result of active visualization and, indeed, may not involve anything other than long-term visual memory. For example, Rabbitt and Vyas (1979) observed a visual recency effect in a serial choice reaction time task involving familiar information. That this recency effect was confined to the final item accords with the results obtained with unfamiliar visual information. However, this choice reaction time task did not require subjects to remember previous stimuli, so it is unlikely that they actively visualized them. With the case for a distinct short-term visual memory currently resting on the recency effect interpreted as reflecting a process of active visualization, this result is especially important. In the second part of the present paper, we report a series of experiments that provides an understanding of the visual recency effect in the serial choice reaction time task. We conclude from these studies that this effect is not due to visualization or to a visual trace either decaying or being overwritten by a succeeding stimulus.     

Exploring the relationship between new word learning and short-term memory for serial order recall,item recall,and item recognition

We reexplored the relationship between new word learning and verbal short-term memory (STM) capacities, by distinguishing STM for serial order information, item recall, and item recognition. STM capacities for order information were estimated via a serial order reconstruction task. A rhyme probe recognition task assessed STM for item recognition. Item recall capacities were derived from the proportion of item errors in an immediate serial recall task. In Experiment 1, strong correlations were observed between item recall and item recognition, but not between the item STM tasks and the serial order task, supporting recent theoretical positions that consider that STM for item and serial order rely on distinct capacities. Experiment 2 showed that only the serial order reconstruction task predicted independent variance in a paired associate word–nonword learning task. Our results suggest that STM capacities for serial order play a specific and causal role in learning new phonological information.     

Short-term memory in autism spectrum disorder

Three experiments examined verbal short-term memory in comparison and autism spectrum disorder (ASD) participants. Experiment 1 involved forward and backward digit recall. Experiment 2 used a standard immediate serial recall task where, contrary to the digit-span task, items (words) were not repeated from list to list. Hence, this task called more heavily on item memory. Experiment 3 tested short-term order memory with an order recognition test: Each word list was repeated with or without the position of 2 adjacent items swapped. The ASD group showed poorer performance in all 3 experiments. Experiments 1 and 2 showed that group differences were due to memory for the order of the items, not to memory for the items themselves. Confirming these findings, the results of Experiment 3 showed that the ASD group had more difficulty detecting a change in the temporal sequence of the items.     

The phonological neighbourhood effect on short-term memory for order

There is a growing body of literature that suggests that long-term memory (LTM) and short-term memory (STM) structures that were once thought to be distinct are actually co-dependent, and that LTM can aid retrieval from STM. The mechanism behind this effect is commonly argued to act on item memory but not on order memory. The aim of the current study was to examine whether LTM could exert an influence on STM for order by examining an effect attributed to LTM, the phonological neighbourhood effect, in a task that reduced the requirement to retain item information. In Experiment 1, 18 participants completed a serial reconstruction task where neighbourhood density alternated within the lists. In Experiment 2, 22 participants completed a serial reconstruction task using pure lists of dense and sparse neighbourhood words. In Experiment 3, 22 participants completed a reconstruction task with both mixed and pure lists. There was a significant effect of neighbourhood density with better recall for dense than sparse neighbourhood words in pure lists but not in mixed lists. Results suggest that LTM exerts an influence prior to that proposed by many models of memory for order.     

The influence of phoneme position overlap on the phonemic similarity effect in nonword recall

The current research examined the predictions that short-term memory models generate for the phonological similarity effect, when similarity was defined in different ways. Three serial recall experiments with consonant-vowel-consonant (CVC) nonwords are reported, where the position of the phonemes that list items shared was manipulated (i.e., shared vowel and final consonant [_VC; Experiment 1], initial consonant and vowel [CV_; Experiment 2], or the two consonants [C_C; Experiment 3]. The results show that the position of common phonemes in nonwords has differential effects on order and item information. The findings are discussed in relation to previous research into the effect of phonemic similarity on nonword recall, and modifications to current short-term memory models are proposed.     

Visual similarity effects on short-term memory for order: The case of verbally labeled pictorial stimuli

Four experiments examined the effect of visual similarity on immediate memory for order. Experiments 1 and 2 used easily nameable line drawings. Following a sequential presentation in either silent or suppression conditions, participants were presented with the drawings in a new, random order and were required to remember their original serial position. In Experiment 3, participants first learned to associate a verbal label with an abstract matrix pattern. Then they completed an immediate memory task in which they had to name the matrices aloud during presentation. At recall, the task required remembering either the order of the matrices or the order of their names. In Experiment 4, participants learned to associate nonword labels with schematic line drawings of faces; the phonemic similarity of the verbal labels was also manipulated. All four experiments indicate that the representations supporting performance comprise both verbal and visual features. The results are consistent with a multiattribute encoding view.     

Gummed-up memory: chewing gum impairs short-term recall

Several studies have suggested that short-term memory is generally improved by chewing gum. However, we report the first studies to show that chewing gum impairs short-term memory for both item order and item identity. Experiment 1 showed that chewing gum reduces serial recall of letter lists. Experiment 2 indicated that chewing does not simply disrupt vocal-articulatory planning required for order retention: Chewing equally impairs a matched task that required retention of list item identity. Experiment 3 demonstrated that manual tapping produces a similar pattern of impairment to that of chewing gum. These results clearly qualify the assertion that chewing gum improves short-term memory. They also pose a problem for short-term memory theories asserting that forgetting is based on domain-specific interference given that chewing does not interfere with verbal memory any more than tapping. It is suggested that tapping and chewing reduce the general capacity to process sequences.     

Gummed-up memory: Chewing gum impairs short-term recall

Several studies have suggested that short-term memory is generally improved by chewing gum. However, we report the first studies to show that chewing gum impairs short-term memory for both item order and item identity. Experiment 1 showed that chewing gum reduces serial recall of letter lists. Experiment 2 indicated that chewing does not simply disrupt vocal–articulatory planning required for order retention: Chewing equally impairs a matched task that required retention of list item identity. Experiment 3 demonstrated that manual tapping produces a similar pattern of impairment to that of chewing gum. These results clearly qualify the assertion that chewing gum improves short-term memory. They also pose a problem for short-term memory theories asserting that forgetting is based on domain-specific interference given that chewing does not interfere with verbal memory any more than tapping. It is suggested that tapping and chewing reduce the general capacity to process sequences.     

Overwriting of phonemic features in serial recall

We tested two explanations of the phonological similarity effect in verbal short‐term memory: The confusion hypothesis assumes that serial positions of similar items are confused. The overwriting hypothesis states that similar items share feature representations, which are overwritten. Participants memorised a phonologically dissimilar list of CVC‐trigrams (Experiment 1) or words (Experiment 2 and 3) for serial recall. In the retention interval they read aloud other items. The material of the distractor task jointly overlapped one item of the memory list. The recall of this item was impaired, and the effect was not based on intrusions from the distractor task alone. The results provide evidence for feature overwriting as one potential mechanism contributing to the phonological similarity effect.     

A re-evaluation of the phonological similarity effect in adults' short-term memory of words and nonwords

The phonological similarity effect (PSE) was studied in two tasks of serial recall, in one task of serial recognition and one item identification task. PSE occurred only in the former three tasks involving memory of order when study items were words and nonwords with an associative connectedness to long-term memory. Nonwords that, according to a reaction time assessment of associative value, were less well connected to long-term memory mechanisms, were not sensitive to phonological similarity. These results are discussed in relation to contemporary models of short-term memory that explain the PSE as a result of confusions of items that are similarly encoded in a phonological layer. This layer is identified as a higher-level phonological space that is accessed by words and nonwords of high associative value and not by nonwords of low associative value.     

Dissociable lexical and phonological influences on serial recognition and serial recall

The impact of the lexicality of memory items on memory performance was compared in two paradigms, serial recall and serial recognition. Experiments 1 to 3 tested 7- and 8-year-old children. Memory accuracy was only mildly impaired in lists containing nonwords compared with words in a serial recognition task involving judgements of whether the items in two sequences were in the same order (Experiment 1), although a substantial advantage for word over nonword items from the same stimulus pool was found in serial recall (Experiment 2). A stronger influence of lexicality on serial recall than serial recognition was further demonstrated in Experiments 3A and 3B, and in 4A and 4B using adult participants. These experiments also established comparable degrees of sensitivity to the phonological similarity of the memory sequences in the two paradigms. The phonological similarity effect in serial recall was found to arise from increased phoneme order errors, whereas the lexicality effect was due principally to the greater frequency of phoneme identity errors for nonwords. It is proposed that the lexicality effect originates in the redintegration of item information just prior to recall, and that this process is largely bypassed in serial recognition.     

Temporal-spatial memory: retrieval of spatial information does not reduce recency

Factors influencing the shape of serial position curves in non-verbal serial short-term memory were examined, using a task testing memory for the position of dots. Similar recency slopes were found when both position and order were recalled (Experiment 1A) and when order only was required (Experiment 1B). This observation was confirmed and tested further in conditions requiring the same encoding but different amounts of spatial information at retrieval (Experiment 2). However, Experiment 2 also revealed an effect of spatial information retrieval on the overall level of memory for recency items. Overall, the results indicate that spatial items produce bow-shaped serial positions curves in tasks requiring the maintenance of order information and that recency is affected by the demand on spatial information retrieval in terms of the overall level of performance but not in terms of the recency slope. These findings are contrary to what is found in the literature on serial verbal recall when both item and order information are required.     

The influence of phoneme position overlap on the phonemic similarity effect in nonword recall

The current research examined the predictions that short-term memory models generate for the phonological similarity effect, when similarity was defined in different ways. Three serial recall experiments with consonant–vowel–consonant (CVC) nonwords are reported, where the position of the phonemes that list items shared was manipulated (i.e., shared vowel and final consonant [_VC; Experiment 1], initial consonant and vowel [CV_; Experiment 2], or the two consonants [C_C; Experiment 3]. The results show that the position of common phonemes in nonwords has differential effects on order and item information. The findings are discussed in relation to previous research into the effect of phonemic similarity on nonword recall, and modifications to current short-term memory models are proposed.     

Why does the phonological similarity effect reverse with nonwords?

The detrimental phonological similarity effect (PSE), a robust finding in serial recall of words, sometimes reverses with nonwords. The current study tested the hypothesis that nonwords benefit from phonological similarity because they are harder to retrieve. In two experiments serial recall and serial reconstruction of visually presented words and nonwords were compared. Phonological similarity is known to have a positive effect on item memory and a negative effect on position accuracy in serial recall, and the demands on item retrieval were greatly reduced in the latter task. PSE occurred for words in both tasks and was reversed for nonwords in serial recall, but not in serial reconstruction—a new finding in the literature. The following conclusions can be made: (1) the detrimental PSE on order retrieval occurs irrespective of lexicality, in accordance with prominent short-term memory models; and (2), the positive PSE on item retrieval is crucially affected by lexicality, a finding less well explained by the existing models.