Modality independence of order coding in working memory: Evidence from cross-modal order interference at recall

Working memory researchers do not agree on whether order in serial recall is encoded by dedicated modality-specific systems or by a more general modality-independent system. Although previous research supports the existence of autonomous modality-specific systems, it has been shown that serial recognition memory is prone to cross-modal order interference by concurrent tasks. The present study used a serial recall task, which was performed in a single-task condition and in a dual-task condition with an embedded memory task in the retention interval. The modality of the serial task was either verbal or visuospatial, and the embedded tasks were in the other modality and required either serial or item recall. Care was taken to avoid modality overlaps during presentation and recall. In Experiment 1, visuospatial but not verbal serial recall was more impaired when the embedded task was an order than when it was an item task. Using a more difficult verbal serial recall task, verbal serial recall was also more impaired by another order recall task in Experiment 2. These findings are consistent with the hypothesis of modality-independent order coding. The implications for views on short-term recall and the multicomponent view of working memory are discussed.     

Susceptibility of spatial and verbal working memory to demands of the central executive

We used a dual-task paradigm to examine the degree to which domain-specific spatial and verbal subsystems depend on the domain-general central executive. Forty participants were asked to retain spatial or verbal information while performing a concurrent secondary task related to simple arithmetic. The secondary tasks consisted of three cognitive processes: single-digit addition, a digit-carrying operation, and digit reading. The single-digit addition and carry operation include central executive functioning, while digit reading relies solely on the phonological loop. The single-digit addition caused a performance decrement on the spatial working memory task, while the digit reading impaired performance on the verbal working memory task. The carry operation interfered with recall accuracy on both working memory tasks. The spatial working memory task was significantly correlated with the verbal working memory task only when the secondary task was more demanding on the central executive. Our results suggest that spatial working memory rather than verbal working memory is susceptible to failure of central executive functioning and that the central executive plays an important role in regulating the cognitive demands of different domains.     

Serial recall of rhythms and verbal sequences: Impacts of concurrent tasks and irrelevant sound

Rhythmic grouping enhances verbal serial recall, yet very little is known about memory for rhythmic patterns. The aim of this study was to compare the cognitive processes supporting memory for rhythmic and verbal sequences using a range of concurrent tasks and irrelevant sounds. In Experiment 1, both concurrent articulation and paced finger tapping during presentation and during a retention interval impaired rhythm recall, while letter recall was only impaired by concurrent articulation. In Experiments 2 and 3, irrelevant sound consisted of irrelevant speech or tones, changing-state or steady-state sound, and syncopated or paced sound during presentation and during a retention interval. Irrelevant speech was more damaging to rhythm and letter recall than was irrelevant tone sound, but there was no effect of changing state on rhythm recall, while letter recall accuracy was disrupted by changing-state sound. Pacing of sound did not consistently affect either rhythm or letter recall. There are similarities in the way speech and rhythms are processed that appear to extend beyond reliance on temporal coding mechanisms involved in serial-order recall.     

Serial recall of rhythms and verbal sequences: Impacts of concurrent tasks and irrelevant sound

Rhythmic grouping enhances verbal serial recall, yet very little is known about memory for rhythmic patterns. The aim of this study was to compare the cognitive processes supporting memory for rhythmic and verbal sequences using a range of concurrent tasks and irrelevant sounds. In Experiment 1, both concurrent articulation and paced finger tapping during presentation and during a retention interval impaired rhythm recall, while letter recall was only impaired by concurrent articulation. In Experiments 2 and 3, irrelevant sound consisted of irrelevant speech or tones, changing-state or steady-state sound, and syncopated or paced sound during presentation and during a retention interval. Irrelevant speech was more damaging to rhythm and letter recall than was irrelevant tone sound, but there was no effect of changing state on rhythm recall, while letter recall accuracy was disrupted by changing-state sound. Pacing of sound did not consistently affect either rhythm or letter recall. There are similarities in the way speech and rhythms are processed that appear to extend beyond reliance on temporal coding mechanisms involved in serial-order recall.     

Evidence for modality-independent order coding in working memory

The aim of the present study was to investigate the representation of serial order in working memory, more specifically whether serial order is coded by means of a modality-dependent or a modality-independent order code. This was investigated by means of a series of four experiments based on a dual-task methodology in which one short-term memory task was embedded between the presentation and recall of another short-term memory task. Two aspects were varied in these memory tasks—namely, the modality of the stimulus materials (verbal or visuo-spatial) and the presence of an order component in the task (an order or an item memory task). The results of this study showed impaired primary-task recognition performance when both the primary and the embedded task included an order component, irrespective of the modality of the stimulus materials. If one or both of the tasks did not contain an order component, less interference was found. The results of this study support the existence of a modality-independent order code.     

Visuospatial working memory and mental representation of spatial descriptions

The purpose of the present research is to investigate whether different components of working memory (WM) are involved in processing spatial and nonspatial texts. The interference effects of two concurrent tasks on comprehension and recall of two kinds of text were investigated in two experiments. Each participant listened to a spatial and a nonspatial text, with one of two concurrent tasks: articulatory suppression or spatial tapping. The dependent variables in Experiment 1 were accuracy of recall and verification of information inferred from the texts. In Experiment 2 response times in the verification task were also considered. Results support the hypothesis that verbal and spatial components of working memory are differentially involved in the comprehension and memory of spatial and nonspatial texts, with a selective interference effect of the spatial concurrent task on the spatial text and an interference effect of the verbal concurrent task on both the spatial and nonspatial texts. These effects emerged for recall, sentence verification, and response times. Our findings confirm previous results showing that the verbal component of working memory is involved in the process of text comprehension and memory. In addition, they show that visuospatial working memory is involved, in so far as the text conveys visuospatial information.     

Cross-domain interference costs during concurrent verbal and spatial serial memory tasks are asymmetric

Some evidence suggests that memory for serial order is domain-general. Evidence also points to asymmetries in interference between verbal and visual–spatial tasks. We confirm that concurrently remembering verbal and spatial serial lists provokes substantial interference compared with remembering a single list, but we further investigate the impact of this interference throughout the serial position curve, where asymmetries are indeed apparent. A concurrent verbal order memory task affects spatial memory performance throughout the serial positions of the list, but performing a spatial order task affects memory for the verbal serial list only for early list items; in the verbal task only, the final items are unaffected by a concurrent task. Adding suffixes eliminates this asymmetry, resulting in impairment throughout the list for both tasks. These results suggest that domain-general working memory resources may be supplemented with resources specific to the verbal domain, but perhaps not with equivalent spatial resources.     

Cross-domain interference costs during concurrent verbal and spatial serial memory tasks are asymmetric

Some evidence suggests that memory for serial order is domain-general. Evidence also points to asymmetries in interference between verbal and visual-spatial tasks. We confirm that concurrently remembering verbal and spatial serial lists provokes substantial interference compared with remembering a single list, but we further investigate the impact of this interference throughout the serial position curve, where asymmetries are indeed apparent. A concurrent verbal order memory task affects spatial memory performance throughout the serial positions of the list, but performing a spatial order task affects memory for the verbal serial list only for early list items; in the verbal task only, the final items are unaffected by a concurrent task. Adding suffixes eliminates this asymmetry, resulting in impairment throughout the list for both tasks. These results suggest that domain-general working memory resources may be supplemented with resources specific to the verbal domain, but perhaps not with equivalent spatial resources.     

Differentiating between verbal and spatial encoding using eye-movement recordings

Visual information processing is guided by an active mechanism generating saccadic eye movements to salient stimuli. Here we investigate the specific contribution of saccades to memory encoding of verbal and spatial properties in a serial recall task. In the first experiment, participants moved their eyes freely without specific instruction. We demonstrate the existence of qualitative differences in eye-movement strategies during verbal and spatial memory encoding. While verbal memory encoding was characterized by shifting the gaze to the to-be-encoded stimuli, saccadic activity was suppressed during spatial encoding. In the second experiment, participants were required to suppress saccades by fixating centrally during encoding or to make precise saccades onto the memory items. Active suppression of saccades had no effect on memory performance, but tracking the upcoming stimuli decreased memory performance dramatically in both tasks, indicating a resource bottleneck between display-controlled saccadic control and memory encoding. We conclude that optimized encoding strategies for verbal and spatial features are underlying memory performance in serial recall, but such strategies work on an involuntary level only and do not support memory encoding when they are explicitly required by the task.     

Capture of the gaze does not capture the mind

Sudden visual changes attract our gaze, and related eye movement control requires attentional resources. Attention is a limited resource that is also involved in working memory??for instance, memory encoding. As a consequence, theory suggests that gaze capture could impair the buildup of memory respresentations due to an attentional resource bottleneck. Here we developed an experimental design combining a serial memory task (verbal or spatial) and concurrent gaze capture by a distractor (of high or low similarity to the relevant item). The results cannot be explained by a general resource bottleneck. Specifically, we observed that capture by the low-similar distractor resulted in delayed and reduced saccade rates to relevant items in both memory tasks. However, while spatial memory performance decreased, verbal memory remained unaffected. In contrast, the high-similar distractor led to capture and memory loss for both tasks. Our results lend support to the view that gaze capture leads to activation of irrelevant representations in working memory that compete for selection at recall. Activation of irrelevant spatial representations distracts spatial recall, whereas activation of irrelevant verbal features impairs verbal memory performance.     

The extent of working memory deficits associated with Williams syndrome: exploration of verbal and spatial domains and executively controlled processes

The present study investigated verbal and spatial working memory (WM) functioning in individuals with the neuro-developmental disorder Williams syndrome (WS) using WM component tasks. While there is strong evidence of WM impairments in WS, previous research has focused on short-term memory and has neglected assessment of executive components of WM. There is a particular lack of consensus concerning the profile of verbal WM functioning in WS. Here, WS participants were compared to typically developing participants matched for (1) verbal ability and (2) spatial ability (N = 14 in each of the 3 groups). Individuals with WS were impaired on verbal WM tasks, both those involving short-term maintenance of information and executive manipulation, in comparison to verbal-matched controls. Surprisingly, individuals with WS were not impaired on a spatial task assessing short-term maintenance of information in memory (remembering spatial locations) compared to spatial-matched controls. They were, however, impaired on a spatial executive WM task requiring the manipulation of spatial information in memory. The present study suggests that individuals with WS show WM impairments that extend to both verbal and spatial domains, although spatial deficits are selective to executive aspects of WM function.     

Hebb learning, verbal short-term memory, and the acquisition of phonological forms in children

Recent work using the Hebb effect as a marker for implicit long-term acquisition of serial order has demonstrated a functional equivalence across verbal and visuospatial short-term memory. The current study extends this observation to a sample of five- to six-year-olds using verbal and spatial immediate serial recall and also correlates the magnitude of Hebb learning with explicit measures of word and nonword paired-associate learning. Comparable Hebb effects were observed in both domains, but only nonword learning was significantly related to the magnitude of Hebb learning. Nonword learning was also independently related to individuals' general level of verbal serial recall. This suggests that vocabulary acquisition depends on both a domain-specific short-term memory system and a domain-general process of learning through repetition.     

Effects of language dominance on item and order memory in free recall,serial recall and order reconstruction

Spanish–English bilinguals (N = 144) performed free recall, serial recall and order reconstruction tasks in both English and Spanish. Long-term memory for both item and order information was worse in the less fluent language (L2) than in the more fluent language (L1). Item scores exhibited a stronger disadvantage for the L2 in serial recall than in free recall. Relative order scores were lower in the L2 for all three tasks, but adjusted scores for free and serial recall were equivalent across languages. Performance of English-speaking monolinguals (N = 72) was comparable to bilingual performance in the L1, except that monolinguals had higher adjusted order scores in free recall. Bilingual performance patterns in the L2 were consistent with the established effects of concurrent task performance on these memory tests, suggesting that the cognitive resources required for processing words in the L2 encroach on resources needed to commit item and order information to memory. These findings are also consistent with a model in which item memory is connected to the language system, order information is processed by separate mechanisms and attention can be allocated differentially to these two systems.     

Gummed-up memory: Chewing gum impairs short-term recall

Several studies have suggested that short-term memory is generally improved by chewing gum. However, we report the first studies to show that chewing gum impairs short-term memory for both item order and item identity. Experiment 1 showed that chewing gum reduces serial recall of letter lists. Experiment 2 indicated that chewing does not simply disrupt vocal–articulatory planning required for order retention: Chewing equally impairs a matched task that required retention of list item identity. Experiment 3 demonstrated that manual tapping produces a similar pattern of impairment to that of chewing gum. These results clearly qualify the assertion that chewing gum improves short-term memory. They also pose a problem for short-term memory theories asserting that forgetting is based on domain-specific interference given that chewing does not interfere with verbal memory any more than tapping. It is suggested that tapping and chewing reduce the general capacity to process sequences.     

Using selective interference to investigate spatial memory representations

Two experiments used a selective interference procedure in an attempt to determine whether nonverbal visual stimuli were represented in memory in a verbal or spatial format. A spatial representation was clearly implicated. In both experiments, Ss were required to remember either the positions or the identities of seven target items in a 25-item array. During the retention interval for that information, Ss attempted to recognize schematic face or airplane photograph stimuli in a same-different memory task. Memory performance on one or both tasks was greatly impaired when the recall task involved position or spatial information, but was either much less or not at all affected by an identity or verbal information recall task. Because of the selective nature of the interference and on the basis of certain correlational evidence, the experimental results were also interpreted as providing support for the notion that verbal and spatial information are stored and processed in separate information-processing systems.     

Automatic semantic encoding in verbal short-term memory: Evidence from the concreteness effect

The concreteness effect in verbal short-term memory (STM) tasks is assumed to be a consequence of semantic encoding in STM, with immediate recall of concrete words benefiting from richer semantic representations. We used the concreteness effect to test the hypothesis that semantic encoding in standard verbal STM tasks is a consequence of controlled, attention-demanding mechanisms of strategic semantic retrieval and encoding. Experiment 1 analysed the effect of presentation rate, with slow presentations being assumed to benefit strategic, time-dependent semantic encoding. Experiments 2 and 3 provided a more direct test of the strategic hypothesis by introducing three different concurrent attention-demanding tasks. Although Experiment 1 showed a larger concreteness effect with slow presentations, the following two experiments yielded strong evidence against the strategic hypothesis. Limiting available attention resources by concurrent tasks reduced global memory performance, but the concreteness effect was equivalent to that found in control conditions. We conclude that semantic effects in STM result from automatic semantic encoding and provide tentative explanations for the interaction between the concreteness effect and the presentation rate.     

Visuospatial and verbal memory in mental arithmetic

Working memory allows complex information to be remembered and manipulated over short periods of time. Correlations between working memory and mathematics achievement have been shown across the lifespan. However, only a few studies have examined the potentially distinct contributions of domain-specific visuospatial and verbal working memory resources in mental arithmetic computation. Here we aimed to fill this gap in a series of six experiments pairing addition and subtraction tasks with verbal and visuospatial working memory and interference tasks. In general, we found higher levels of interference between mental arithmetic and visuospatial working memory tasks than between mental arithmetic and verbal working memory tasks. Additionally, we found that interference that matched the working memory domain of the task (e.g., verbal task with verbal interference) lowered working memory performance more than mismatched interference (verbal task with visuospatial interference). Findings suggest that mental arithmetic relies on domain-specific working memory resources.     

A study of retrieval processes in action memory for school-aged children: the impact of recall period and difficulty on action memory

ABSTRACT

Research in action memory for adults has shown that enacted encoding is not only retrieved more frequently but is also faster in comparison to verbal encoding. The aim of this study was to investigate retrieval processes in terms of recall period and recall difficulty for different encoding conditions in school-aged children (8-, 10-, 12-, 14-years old). The participants studied verbal tasks, subject-performed tasks and experimenter-performed tasks, and received immediate and final free-recall tests. The results revealed that older children not only outperformed younger children in terms of accuracy but also outpaced them in all recall periods. Moreover, recalls of subject-performed tasks and experimenter-performed tasks were better and faster compared with verbal encoding on both types of recall test, by increasing throughout the recall periods. These results are discussed in terms of memory strategies and information processing methods. Pedagogic implications for the use of action memory in children's learning are also considered.