Ordered short-term memory differs in signers and speakers: implications for models of short-term memory

Capacity limits in linguistic short-term memory (STM) are typically measured with forward span tasks in which participants are asked to recall lists of words in the order presented. Using such tasks, native signers of American Sign Language (ASL) exhibit smaller spans than native speakers ([Boutla, M., Supalla, T., Newport, E. L., & Bavelier, D. (2004). Short-term memory span: Insights from sign language. Nature Neuroscience, 7(9), 997-1002]). Here, we test the hypothesis that this population difference reflects differences in the way speakers and signers maintain temporal order information in short-term memory. We show that native signers differ from speakers on measures of short-term memory that require maintenance of temporal order of the tested materials, but not on those in which temporal order is not required. In addition, we show that, in a recall task with free order, bilingual subjects are more likely to recall in temporal order when using English than ASL. We conclude that speakers and signers do share common short-term memory processes. However, whereas short-term memory for spoken English is predominantly organized in terms of temporal order, we argue that this dimension does not play as great a role in signers' short-term memory. Other factors that may affect STM processes in signers are discussed.     

Concreteness effects in different tasks: Implications for models of short-term memory

This study investigates concreteness effects in tasks requiring short-term retention. Concreteness effects were assessed in serial recall, matching span, order reconstruction, and free recall. Each task was carried out both in a control condition and under articulatory suppression. Our results show no dissociation between tasks that do and do not require spoken output. This argues against the redintegration hypothesis according to which lexical-semantic effects in short-term memory arise only at the point of production. In contrast, concreteness effects were modulated by task demands that stressed retention of item versus order information. Concreteness effects were stronger in free recall than in serial recall. Suppression, which weakens phonological representations, enhanced the concreteness effect with item scoring. In a matching task, positive effects of concreteness occurred with open sets but not with closed sets of words. Finally, concreteness effects reversed when the task asked only for recall of word positions (as in the matching task), when phonological representations were weak (because of suppression), and when lexical semantic representations overactivated (because of closed sets). We interpret these results as consistent with a model where phonological representations are crucial for the retention of order, while lexical-semantic representations support maintenance of item identity in both input and output buffers.     

Concreteness effects in different tasks: implications for models of short-term memory

This study investigates concreteness effects in tasks requiring short-term retention. Concreteness effects were assessed in serial recall, matching span, order reconstruction, and free recall. Each task was carried out both in a control condition and under articulatory suppression. Our results show no dissociation between tasks that do and do not require spoken output. This argues against the redintegration hypothesis according to which lexical-semantic effects in short-term memory arise only at the point of production. In contrast, concreteness effects were modulated by task demands that stressed retention of item versus order information. Concreteness effects were stronger in free recall than in serial recall. Suppression, which weakens phonological representations, enhanced the concreteness effect with item scoring. In a matching task, positive effects of concreteness occurred with open sets but not with closed sets of words. Finally, concreteness effects reversed when the task asked only for recall of word positions (as in the matching task), when phonological representations were weak (because of suppression), and when lexical semantic representations overactivated (because of closed sets). We interpret these results as consistent with a model where phonological representations are crucial for the retention of order, while lexical-semantic representations support maintenance of item identity in both input and output buffers.     

The effects of word co-occurrence on short-term memory: associative links in long-term memory affect short-term memory performance

In immediate serial recall tasks, high-frequency words are recalled better than low-frequency words. This has been attributed to high-frequency words' being better represented and providing more effective support to a redintegration process at retrieval (C. Hulme et al., 1997). In studies of free recall, there is evidence that frequency of word co-occurrence, rather than word frequency per se, may explain the recall advantage enjoyed by high-frequency words (J. Deese, 1960). The authors present evidence that preexposing pairs of low-frequency words, so as to create associative links between them, has substantial beneficial effects on immediate serial recall performance. These benefits, which are not attributable to simple familiarization with the words per se, do not occur for high-frequency words. These findings indicate that associative links between items in long-term memory have important effects on short-term memory performance and suggest that the effects of word frequency in short-term memory tasks are related to differences in interitem associations in long-term memory.     

Testing effects in visual short-term memory: The case of an object's size

In many daily activities, we need to form and retain temporary representations of an object’s size. Typically, such visual short-term memory (VSTM) representations follow perception and are considered reliable. Here, participants were asked to hold in mind a single simple object for a short duration and to reproduce its size by adjusting the length and width of a test probe. Experiment 1 revealed two powerful findings: First, similar to a recently reported perceptual illusion, participants greatly overestimated the size of open objects – ones with missing boundaries – relative to the same-size fully closed objects. This finding confirms that object boundaries are critical for size perception and memory. Second, and in contrast to perception, even the size of the closed objects was largely overestimated. Both inflation effects were substantial and were replicated and extended in Experiments 2–5. Experiments 6–8 used a different testing procedure to examine whether the overestimation effects are due to inflation of size in VSTM representations or to biases introduced during the reproduction phase. These data showed that while the overestimation of the open objects was repeated, the overestimation of the closed objects was not. Taken together, these findings suggest that similar to perception, only the size representation of open objects is inflated in VSTM. Importantly, they demonstrate the considerable impact of the testing procedure on VSTM tasks and further question the use of reproduction procedures for measuring VSTM.     

The demise of short-term memory

The first wave of modern research on short-term memory was preoccupied with its existence as a valid system of memory. One subsequent development has been the application of the short-term/ long-term distinction to the study of individual and subject-population differences (aging, amnesia, and so on). Another development has been the investigation of how short-term memory articulates with such full-blown cognitive processes as reasoning, perception, and language comprehension. These efforts have now faltered, badly, in response to changing conceptions of human memory and unwelcome data. However, the properties of isolated, short-term memory subsystems continue to be identified. The sorts of evidence that have contributed to the fragmentation, if not the death, of an all-purpose short-term memory system have nonetheless advanced our knowledge of related cognitive processes. The study of such relationships is illustrated in the case of reading.     

Representing time in language and memory: The role of similarity structure

Every day we read about or watch events in the world and can easily understand or remember how long they last. What aspects of an event are retained in memory? And how do we extract temporal information from our memory representations? These issues are central to human cognition, as they underlie a fundamental aspect of our mental life, namely our representation of time. This paper reviews previous language studies and reports a visual learning study indicating that properties of the events encoded in memory shape the representation of their duration. The evidence indicates that for a given event, the extent to which its associated properties or sub-components differ from one another modulates our representation of its duration. These properties include the similarity between sub-events and the similarity between the situational contexts in which an event occurs. We suggest that the diversity of representations that we associate with events in memory plays an important role in remembering and estimating the duration of experienced or described events.     

The distribution of subjective memory strength: List strength and response bias

Models of recognition memory assume that memory decisions are based partially on the subjective strength of the test item. Models agree that the subjective strength of targets increases with additional time for encoding however the origin of the subjective strength of foils remains disputed. Under the fixed strength assumption the distribution of memory strength for foils is invariant across experimental manipulations of encoding. For example, the subjective strength of foils may depend solely on the pre-experimental history of the item, thus encoding manipulations have no impact. In contrast, under the differentiation assumption the subjective strength of foils depends on the nature of the traces stored in episodic memory. If those traces are well encoded, the subjective strength of foils will be lower than the case where noisy traces are stored (e.g., when targets received minimal encoding). The fixed strength and differentiation accounts are tested by measuring direct ratings of memory strength. In Experiments 1 and 2, item strength is varied via repetition and in Experiment 3 response bias is varied via the relative proportion of targets on the test list. For all experiments empirical distributions of memory strength were obtained and compared to the distributions predicted by the two accounts. The differentiation assumption provides the most parsimonious account of the data.     

The distribution of subjective memory strength: List strength and response bias

Models of recognition memory assume that memory decisions are based partially on the subjective strength of the test item. Models agree that the subjective strength of targets increases with additional time for encoding however the origin of the subjective strength of foils remains disputed. Under the fixed strength assumption the distribution of memory strength for foils is invariant across experimental manipulations of encoding. For example, the subjective strength of foils may depend solely on the pre-experimental history of the item, thus encoding manipulations have no impact. In contrast, under the differentiation assumption the subjective strength of foils depends on the nature of the traces stored in episodic memory. If those traces are well encoded, the subjective strength of foils will be lower than the case where noisy traces are stored (e.g., when targets received minimal encoding). The fixed strength and differentiation accounts are tested by measuring direct ratings of memory strength. In Experiments 1 and 2, item strength is varied via repetition and in Experiment 3 response bias is varied via the relative proportion of targets on the test list. For all experiments empirical distributions of memory strength were obtained and compared to the distributions predicted by the two accounts. The differentiation assumption provides the most parsimonious account of the data.     

Specialization of the cerebral hemispheres in scanning for information in short-term memory

Lateral specialization of function in the cerebral hemispheres was investigated in the context of a memory scanning paradigm. The S first memorized a set of letters (the memory set) and then indicated whether or not a subsequent test stimulus, presented in either the right or left visual field, matched any letter in the set. The test stimulus was either a letter or a picture of some common object; for the picture, S’s response was based on the initial letter of the name of that object. Reaction time was recorded and plotted as a function of the number of letters in the memory set. The results support the hypothesis that in a memory scanning task of this type, letter and picture test stimuli are spatially and verbally represented, respectively, and are processed in different cerebral hemispheres.     

Modality effects and the structure of short-term verbal memory

The effects of auditory and visual presentation upon short-term retention of verbal stimuli are reviewed, and a model of the structure of short-term memory is presented. The main assumption of the model is that verbal information presented to the auditory and visual modalities is processed in separate streams that have different properties and capabilities. Auditory items are automatically encoded in both the A (acoustic) code, which, in the absence of subsequent input, can be maintained for some time without deliberate allocation of attention, and a P (phonological) code. Visual items are retained in both the P code and a visual code. Within the auditory stream, successive items are strongly associated; in contrast, in the visual modality, it is simultaneously presented items that are strongly associated. These assumptions about the structure of short-term verbal memory are shown to account for many of the observed effect of presentation modality.     

The analysis of errors in short-term motor memory research using trial profiles

In the past, researchers have debated the problem of selecting the most appropriate error measure (e.g., CE, VE, AE, or E) for use as the dependent variable when analyzing the results of their experiments in short-term motor memory research (Gessaroli & Schutz, 1982; Henry, 1974; Safrit, Spray, & Diewert, 1980; Schutz, 1977; Schutz & Roy, 1973). This paper suggests that the subjects' error scores, recorded over a series of trials, are analyzed individually, using repeated measures (RM) ANOVA. This analysis divides the total error sum of squares into recognizable components that, when identified, adequately explain the subjects' performance. The between-subjects sources of variation will indicate any differences in CE bias between the levels of each factor in the experiment. Similarly, any VE differences between the levels of each factor will be identified by significant trial-by-factor interactions. However, not all significant trial-by-factor interactions will necessarily indicate differences in VE performances. Nevertheless by plotting the group's perceived mean trial profiles for any significant trial-by-factor interactions, valuable insight can be gained into difference performance responses in trial adaptation for each level of the factors in the experimental design.     

The decay of short-term implicit memory: Unpacking lag

McKone (1995) reported a short-lived repetition priming effect, superimposed on long-lived priming. This short-term implicit memory survived a few intervening items and several seconds for words but decayed precipitously for nonwords, producing a lag 3 lexicality interaction. Here, mechanisms of decay are studied by disconfounding the time delay and interference components of lag. In Experiment 1, time delay was varied while number of intervening items was held constant, and vice versa. In Experiment 2, priming was plotted as a function of time delay, with and without intervening items. Using a lexical decision task, both experiments found independent contributions of time and interference to the decay of short-term priming. Further, Experiment 2 attributed the lag 3 lexicality interaction to a particular sensitivity of nonword traces to interference. An illustration of how these effects might arise in the word recognition system is provided.     

The uses of short-term memory: A case study

It has been widely claimed that the systems employed in tasks of immediate memory have a function in the comprehension of speech; these systems, it has been proposed, are used to hold a representation of the speech until a syntactic analysis and interpretation have been completed. Such a holding function is meant to be especially important where the sentences heard are long or complex. It has thus been predicted that subjects with impaired short-term memory performance would show deficits in comprehension of such materials.

In this study, one subject with impaired phonological processing and a severely reduced digit span was tested on a range of tasks requiring the syntactic analysis, memory and comprehension of long and complex material. She was found to be unimpaired on syntactic analysis and comprehension, but not on sentence repetition. The implications for models of short-term memory are discussed.     

Drawing conclusions from choice response time models: A tutorial using the linear ballistic accumulator

Cognitive models of choice and response times can lead to deeper insights into the processes underlying decisions than standard analyses of accuracy and response time data. The application of these models, however, has historically been reserved for the authors of the models, and their associates. Recently, choice response time models have become more accessible through the release of user-friendly software for estimating their parameters. The aim of this tutorial is to provide guidance about the process of using these parameter estimates and associated model fits to make conclusions about experimental data. We use an application of one response time model, the linear ballistic accumulator, as an example to demonstrate the steps required to select an appropriate parametric characterization of a data set. We also discuss how to evaluate the quality of the agreement between model and data, including guidelines for presenting model predictions for group-level data.     

Assessing the validity of multinomial models using extraneous variables: an application to prospective memory

The class of multinomial processing tree (MPT) models has been used extensively in cognitive psychology to model latent cognitive processes. Critical for the usefulness of a MPT model is its psychological validity. Generally, the validity of a MPT model is demonstrated by showing that its parameters are selectively and predictably affected by theoretically meaningful experimental manipulations. Another approach is to test the convergent validity of the model parameters and other extraneous measures intended to measure the same cognitive processes. Here, we advance the concept of construct validity (Cronbach & Meehl, 1955 ) as a criterion for model validity in MPT modelling and show how this approach can be fruitfully utilized using the example of a MPT model of event-based prospective memory. For that purpose, we investigated the convergent validity of the model parameters and established extraneous measures of prospective memory processes over a range of experimental settings, and we found a lack of convergent validity between the two indices. On a conceptual level, these results illustrate the importance of testing convergent validity. Additionally, they have implications for prospective memory research, because they demonstrate that the MPT model of event-based prospective memory is not able to differentiate between different processes contributing to prospective memory performance.     

Verbal short-term memory as an articulatory system: Evidence from an alternative paradigm

In a series of seven experiments, the role of articulatory rehearsal in verbal short-term memory was examined via a shadowing-plus-recall paradigm. In this paradigm, subjects shadowed a word target presented closely after an auditory memory list before they recalled the list. The phonological relationship between the shadowing target and the final item on the memory list was manipulated. Experiments 1 and 2 demonstrated that targets sounding similar to the list-final memory item generally took longer to shadow than unrelated targets. This inhibitory effect of phonological relatedness was more pronounced with tense- than lax-vowel pseudoword recall lists. The interaction between vowel tenseness and phonological relatedness was replicated in Experiment 3 using shorter lists of real words. In Experiment 4, concurrent articulation was applied during list learning to block rehearsal; consequently, neither the phonological relatedness effect nor its interaction with vowel tenseness emerged. Experiments 5 and 6 manipulated the occurrence frequencies and lexicality of the recall items, respectively, instead of vowel tenseness. Unlike vowel tenseness, these non-articulatory memory factors failed to interact with the phonological relatedness effect. Experiment 7 orthogonally manipulated the vowel tenseness and frequencies of the recall items; slowing in shadowing times due to phonological relatedness was modulated by vowel tenseness but not frequency. Taken together, these results suggest that under the present paradigm, the modifying effect of vowel tenseness on the magnitude of slowing in shadowing due to phonological relatedness is indicative of a prominent articulatory component in verbal short-term retention. The shadowing-plus-recall approach avoids confounding overt recall into internal memory processing, which is an inherent problem of the traditional immediate serial recall and span tasks.     

Sharpening the echo: an iterative-resonance model for short-term recognition memory

We present an iterative-resonance model for recognition memory. On successive iterations, the probe is compared against a feature-by-feature profile of the study set. Yes decisions depend on the similarity of the probe to the profile; No decisions depend on a count of elements in the probe that are not in the profile. Successive iterations sharpen the evidence, and response latency is a function of the number of iterations needed to obtain a sufficiently clear result. The model successfully simulates classic data as well as recent data problematic for alternate models.