Evidence for modality-independent order coding in working memory

The aim of the present study was to investigate the representation of serial order in working memory, more specifically whether serial order is coded by means of a modality-dependent or a modality-independent order code. This was investigated by means of a series of four experiments based on a dual-task methodology in which one short-term memory task was embedded between the presentation and recall of another short-term memory task. Two aspects were varied in these memory tasks—namely, the modality of the stimulus materials (verbal or visuo-spatial) and the presence of an order component in the task (an order or an item memory task). The results of this study showed impaired primary-task recognition performance when both the primary and the embedded task included an order component, irrespective of the modality of the stimulus materials. If one or both of the tasks did not contain an order component, less interference was found. The results of this study support the existence of a modality-independent order code.     

Modality independence of order coding in working memory: Evidence from cross-modal order interference at recall

Working memory researchers do not agree on whether order in serial recall is encoded by dedicated modality-specific systems or by a more general modality-independent system. Although previous research supports the existence of autonomous modality-specific systems, it has been shown that serial recognition memory is prone to cross-modal order interference by concurrent tasks. The present study used a serial recall task, which was performed in a single-task condition and in a dual-task condition with an embedded memory task in the retention interval. The modality of the serial task was either verbal or visuospatial, and the embedded tasks were in the other modality and required either serial or item recall. Care was taken to avoid modality overlaps during presentation and recall. In Experiment 1, visuospatial but not verbal serial recall was more impaired when the embedded task was an order than when it was an item task. Using a more difficult verbal serial recall task, verbal serial recall was also more impaired by another order recall task in Experiment 2. These findings are consistent with the hypothesis of modality-independent order coding. The implications for views on short-term recall and the multicomponent view of working memory are discussed.     

The development of visual and auditory selective attention using the central-incidental paradigm

Analogous auditory and visual central-incidental learning tasks were administered to 24 second-, fourth-, and sixth-grade and college-age subjects to study the effects of modality of presentation on memory for central and incidental stimulus materials. There was no strong evidence to indicate that modality of presentation was an important factor in the development of selective attention. Central task learning increased with age for both auditory and visual presentations; incidental learning declined at the oldest age level for both auditory and visual tasks. The serial position analysis revealed that the observed developmental increase in recall performance was due primarily to differences in the initial serial positions. The use of active strategies for focusing attention on the relevant stimulus materials seemed to be the crucial determinant of level of performance.     

Repetition learning in the immediate serial recall of visual and auditory materials

In 5 experiments, a Hebb repetition effect, that is, improved immediate serial recall of an (unannounced) repeating list, was demonstrated in the immediate serial recall of visual materials, even when use of phonological short-term memory was blocked by concurrent articulation. The learning of a repeatedly presented letter list in one modality (auditory or visual) did not transfer to give improved performance on the same list in the other modality. This result was not replicated for word lists, however, for which asymmetric transfer was observed. Inferences are made about the structure of short-term memory and about the nature of the Hebb repetition effect.     

A spatial modality effect in serial memory

In 2 experiments, the authors tested whether the classical modality effect-that is, the stronger recency effect for auditory items relative to visual items-can be extended to the spatial domain. An order reconstruction task was undertaken with four types of material: visual-spatial, auditory-spatial, visual-verbal, and auditory-verbal. Similar serial position curves were obtained regardless of the nature of the to-be-remembered sequences, with the exception that a modality effect was found with spatial as well as with verbal materials. The results are discussed with regard to a number of models of short-term memory.     

Disruption of order information by irrelevant items: a serial recognition paradigm

Irrelevant speech effect (ISE) is defined as a decrement in visually presented digit-list short-term memory performance due to exposure to irrelevant auditory material. Perhaps the most successful theoretical explanation of the effect is the changing state hypothesis. This hypothesis explains the effect in terms of confusion between amodal serial order cues, and represents a view based on the interference caused by the processing of similar order information of the visual and auditory materials. An alternative view suggests that the interference occurs as a consequence of the similarity between the visual and auditory contents of the stimuli. An important argument for the former view is the observation that ISE is almost exclusively observed in tasks that require memory for serial order. However, most short-term memory tasks require that both item and order information be retained in memory. An ideal task to investigate the sensitivity of maintenance of serial order to irrelevant speech would be one that calls upon order information but not item information. One task that is particularly suited to address this issue is serial recognition. In a typical serial recognition task, a list of items is presented and then probed by the same list in which the order of two adjacent items has been transposed. Due to the re-presentation of the encoding string, serial recognition requires primarily the serial order to be maintained while the content of the presented items is deemphasized. In demonstrating a highly significant ISE of changing versus steady-state auditory items in a serial recognition task, the present finding lends support for and extends previous empirical findings suggesting that irrelevant speech has the potential to interfere with the coding of the order of the items to be memorized.     

Single-probe serial position recall: evidence of modularity for olfactory, visual, and auditory short-term memory

The present study examined and compared order memory for a list of sequentially presented odours, unfamiliar faces, and pure tones. Employing single-probe serial position recall and following a correction for a response bias, qualitatively different serial position functions were observed across stimuli. Participants demonstrated an ability to perform absolute order memory judgments for odours. Furthermore, odours produced an absence of serial position effects, unfamiliar faces produced both primacy and recency, and pure tones produced recency but not primacy. Such a finding is contrary to the proposal by Ward, Avons, and Melling (2005) that the serial position function is task, rather than modality, dependent. In contrast, the observed functions support a modular conceptualization of short-term memory (e.g., Andrade & Donaldson, 2007; Baddeley & Hitch, 1974), whereby separate modality-specific memorial systems operate. An alternative amodal interpretation is also discussed wherein serial position function disparities are accommodated via differences in the psychological distinctiveness of stimuli (Hay, Smyth, Hitch, & Horton, 2007).     

Interactive visual imagery and memory search for words and pictures

In a short-term recognition memory experiment with words, subjects: (1) subvocally rehearsed the words, (2) generated a separate visual image for each word, (3) generated an interactive scene with such images, or (4) composed a covert sentence using the words in the memory set. Contrary to Seamon's (1972) results in a similar study, a serial memory search was found in all conditions, instead of the simultaneous scan which was expected when items were combined in interactive images. In a second study with pictures as stimuli, subjects who generated imaginal interactions between separate pictures, viewed interacting pictures, or viewed separate pictures also showed a serial search, i.e., longer RTs were obtained when more stimuli were held m memory. Since interactive imagery facilitated performance in an unexpected paired-associate task with memory set stimuli, one can argue that subjects actually processed or generated such interactions. It was suggested that memory search might not be simultaneous in tasks where the test stimulus constitutes only part of a memory image.     

Single-probe serial position recall: Evidence of modularity for olfactory,visual, and auditory short-term memory

The present study examined and compared order memory for a list of sequentially presented odours, unfamiliar faces, and pure tones. Employing single-probe serial position recall and following a correction for a response bias, qualitatively different serial position functions were observed across stimuli. Participants demonstrated an ability to perform absolute order memory judgments for odours. Furthermore, odours produced an absence of serial position effects, unfamiliar faces produced both primacy and recency, and pure tones produced recency but not primacy. Such a finding is contrary to the proposal by Ward, Avons, and Melling (2005) that the serial position function is task, rather than modality, dependent. In contrast, the observed functions support a modular conceptualization of short-term memory (e.g., Andrade & Donaldson, 2007; Baddeley & Hitch, 1974), whereby separate modality-specific memorial systems operate. An alternative amodal interpretation is also discussed wherein serial position function disparities are accommodated via differences in the psychological distinctiveness of stimuli (Hay, Smyth, Hitch, & Horton, 2007).     

The effect of articulatory suppression and manual tapping on serial recall

Concurrent tasks, such as articulatory suppression and manual tapping, are used to understand the mechanisms underlying short-term memory by overloading domain-specific resources. The present study addresses the debate regarding the theoretical frameworks accounting for interference in serial recall by comparing the effects of both the modality of concurrent tasks (verbal vs. spatial) as well as the state of the tasks (steady vs. changing) in both verbal and spatial recall. The findings indicate that the verbal changing-state concurrent task significantly impaired digit recall, whereas the spatial changing-state concurrent task significantly impaired block recall. The theoretical implications are discussed in the context of a multimodal working memory model with domain-specific resources and a unitary approach to short-term memory.     

Transitional information in spatial serial memory: path characteristics affect recall performance

This study examined the role of stimulus characteristics in a visuospatial order reconstruction task in which participants were required to recall the order of sequences of spatial locations. The complexity of the to-be-remembered sequences, as measured by path crossing, path length, and angles, was found to affect serial memory, in terms of both recall accuracy and response times. The results demonstrate that not all sequences are remembered equally and that spatial characteristics of the sequences constitute an important variable in the understanding of visuospatial serial memory. More important, the data suggest that spatial path represents transitional information and that, as is the case in verbal serial memory, transitional information is of critical importance in serial memory.     

Short-term recognition memory for serial order and timing

Recent evidence suggests that a common temporal representation underlies memory for serial order of items in a sequence, and the timing of items in a sequence. This stands in contrast to other data suggesting a reliance on only ordinal information in short-term memory tasks. An experiment is reported here in which participants were post cued to perform a comparison between a probe and study list of items irregularly spaced in time, on the basis of order or temporal information.Participants' performance on theserial recognition task was notaffected by the temporal proximity of items, although participants were able to use temporal information to perform a temporal recognition task. Application of a temporal matching model of serial and temporal recognition suggests that although participants were able to remember the timing of items, this memory for timing was unlikely to determine serial recognition performance. The results suggest a dissociation between ordinal and temporal information in short-term memory.     

Serial position effects in implicit memory for multiple-digit numbers

Serial position effects in implicit and explicit memory were investigated in a short-term memory task. A study list composed of four, spatially distributed, two-digit numbers was presented, followed by an item recognition task (explicit test) and an implicit memory task in which participants were asked to verify a simple addition equation where the presented answer was either primed or not primed by one of the number pairs in the study list. Similar serial position effects were observed in explicit and implicit memory, with faster response times for correct decisions on the first than on the later list positions. The presence of a primacy effect but no recency effect is consistent with previous studies of explicit memory with visual presentation. The results suggest that similar principles of temporal information processing govern priming and episodic short-term memory.     

A re-evaluation of the phonological similarity effect in adults' short-term memory of words and nonwords

The phonological similarity effect (PSE) was studied in two tasks of serial recall, in one task of serial recognition and one item identification task. PSE occurred only in the former three tasks involving memory of order when study items were words and nonwords with an associative connectedness to long-term memory. Nonwords that, according to a reaction time assessment of associative value, were less well connected to long-term memory mechanisms, were not sensitive to phonological similarity. These results are discussed in relation to contemporary models of short-term memory that explain the PSE as a result of confusions of items that are similarly encoded in a phonological layer. This layer is identified as a higher-level phonological space that is accessed by words and nonwords of high associative value and not by nonwords of low associative value.     

The phonological neighbourhood effect on short-term memory for order

There is a growing body of literature that suggests that long-term memory (LTM) and short-term memory (STM) structures that were once thought to be distinct are actually co-dependent, and that LTM can aid retrieval from STM. The mechanism behind this effect is commonly argued to act on item memory but not on order memory. The aim of the current study was to examine whether LTM could exert an influence on STM for order by examining an effect attributed to LTM, the phonological neighbourhood effect, in a task that reduced the requirement to retain item information. In Experiment 1, 18 participants completed a serial reconstruction task where neighbourhood density alternated within the lists. In Experiment 2, 22 participants completed a serial reconstruction task using pure lists of dense and sparse neighbourhood words. In Experiment 3, 22 participants completed a reconstruction task with both mixed and pure lists. There was a significant effect of neighbourhood density with better recall for dense than sparse neighbourhood words in pure lists but not in mixed lists. Results suggest that LTM exerts an influence prior to that proposed by many models of memory for order.     

Selective interference with verbal short-term memory for serial order information: A new paradigm and tests of a timing-signal hypothesis

Many recent computational models of verbal short-term memory postulate a separation between processes supporting memory for the identity of items and processes supporting memory for their serial order. Furthermore, some of these models assume that memory for serial order is supported by a timing signal. We report an attempt to find evidence for such a timing signal by comparing an “item probe” task, requiring memory for items, with a “list probe” task, requiring memory for serial order. Four experiments investigated effects of irrelevant speech, articulatory suppression, temporal grouping, and paced finger tapping on these two tasks. In Experiments 1 and 2, irrelevant speech and articulatory suppression had a greater detrimental effect on the list probe task than on the item probe task. Reaction time data indicated that the list probe task, but not the item probe task, induced serial rehearsal of items. Phonological similarity effects confirmed that both probe tasks induced phonological recoding of visual inputs. Experiment 3 showed that temporal grouping of items during list presentation improved performance on the list probe task more than on the item probe task. In Experiment 4, paced tapping had a greater detrimental effect on the list probe task than on the item probe task. However, there was no differential effect of whether tapping was to a simple or a complex rhythm. Overall, the data illustrate the utility of the item probe/list probe paradigm and provide support for models that assume memory for serial order and memory for items involve separate processes. Results are generally consistent with the timing-signal hypothesis but suggest further factors that need to be explored to distinguish it from other accounts.     

Individual differences in phonological learning and verbal STM span

A relationship between phonological short-term memory tasks (e.g., nonword repetition, digit span) and vocabulary learning in both experimental and real-life conditions has been reported in numerous studies. A mechanism that would explain this correlation is, however, not known. The present study explores the possibility that it is the quality of phonological representations that affects both short-term recall and long-term learning of novel wordlike items. In Experiment 1, groups with relatively good and poor span for pseudowords were established. The good group was found to perform better at explicit memory tasks tapping the incidental learning of a limited stimulus pool used in an auditory immediate serial pseudoword recall task. In Experiment 2, the results of Experiment 1 were replicated when experience of correct recall was controlled. In Experiment 3, the immediate recall performance of the good group was found to benefit more than that of the poor group from syllable repetition within stimulus pools. It is concluded that the efficiency of a process that creates phonological representations is related both to short-term capacity for verbal items, and to long-term phonological learning of the structure of novel phonological items.     

Multiple roles for time in short-term memory: evidence from serial recall of order and timing

Three experiments are reported that examine the relationship between short-term memory for time and order information, and the more specific claim that order memory is driven by a timing signal. Participants were presented with digits spaced irregularly in time and postcued (Experiments 1 and 2) or precued (Experiment 3) to recall the order or timing of the digits. The primary results of interest were as follows: (a) Instructing participants to group lists had similar effects on serial and timing recall in inducing a pause in recall between suggested groups; (b) the timing of recall was predicted by the timing of the input lists in both serial recall and timing recall; and (c) when the recall task was precued, there was a tendency for temporally isolated items to be more accurately recalled than temporally crowded items. The results place constraints on models of serial recall that assume a timing signal generates positional representations and suggest an additional role for information about individual durations in short-term memory.     

Asymmetric interference between domains: evidence from the stimulus order effect in complex span tasks

The stimulus order effect refers to the finding that recall in complex span tasks is better when span lists begin with a longer processing task and end with a shorter task than when these processing tasks are presented in the reverse order. This study independently manipulated processing time and processing difficulty between Long-final and Short-final lists. The processing task required participants to solve arithmetic problems with either verbal (Experiment 1) or visuospatial (Experiment 2) materials. The memory items used in the storage task were either digits (verbal material) or dots-in-matrices (visuospatial materials). Storage of both verbal and visuospatial materials was sensitive to the change in processing difficulty, but not processing time. Furthermore, this study provides further evidence for the asymmetry of domain interference in working memory. The similarities and differences between verbal and visuospatial storage in working memory are discussed.