Similarity and binding in memory: Bound to be detrimental

The process of binding information from different modalities and sources into an object is ubiquitous in cognition and has been a problem for research and modelling efforts in psychology. This process has been considered by most researchers as necessarily always beneficial to memory. In the present study we provide evidence that binding can be detrimental through the propagation of vulnerabilities to interference. Phonologically similar and dissimilar letters were presented sequentially at different locations on a computer monitor. Participants had to recall either the letters in their order of presentation or the spatial locations at which the letters had appeared. Whether binding was encouraged or not—providing prior knowledge of which dimension to remember—phonological similarity had a detrimental effect on recall of locations. Such a finding poses a challenge to the view that binding is the panacea in enhancing memory capacity.     

汉语短时序列回忆中的语音相似性和视觉相似性效应

语音相似性效应和视觉相似性效应是短时序列回忆中的两个典型性效应, 但前人很少探讨这两种效应的交互作用。本研究利用汉语字形和语音的属性, 观察汉字短时序列回忆中语音相似性效应、视觉相似性效应及两者的交互作用。研究结果发现当回忆项目在语音或视觉上单纯相似或不相似时, 视觉相似性效应及其与语音相似性的交互作用与混合词表条件下所发现的结果有很大的不同。这个研究结果为丰富和补充相关理论模型提供了进一步实证依据。     

Similarity and binding in memory: bound to be detrimental

The process of binding information from different modalities and sources into an object is ubiquitous in cognition and has been a problem for research and modelling efforts in psychology. This process has been considered by most researchers as necessarily always beneficial to memory. In the present study we provide evidence that binding can be detrimental through the propagation of vulnerabilities to interference. Phonologically similar and dissimilar letters were presented sequentially at different locations on a computer monitor. Participants had to recall either the letters in their order of presentation or the spatial locations at which the letters had appeared. Whether binding was encouraged or not--providing prior knowledge of which dimension to remember--phonological similarity had a detrimental effect on recall of locations. Such a finding poses a challenge to the view that binding is the panacea in enhancing memory capacity.     

Modulating the phonological similarity effect: The contribution of interlist similarity and lexicality

The classical phonological similarity effect (PSE) was studied with words and nonwords in two immediate serial recall (ISR) tasks. The relative contributions of intralist and interlist interference were compared, and differential effects on item and order memory were observed. PSE occurred with words and was reversed with nonwords. In addition, PSE was modulated by interlist similarity, which enhanced recall of rhyme items and impaired recall of distinct items. Finally, interlist similarity reduced item recall of words, whereas it improved serial recall of nonwords. The latter finding rules out the hypothesis that the reverse PSE for nonwords is due to interlist interference. It is concluded that two opposing effects of phonological intralist similarity cause the interaction between PSE and lexicality in ISR. With words, the positive effect on item recall is usually masked by a much more disruptive effect on position accuracy. With nonwords, however, the positive effect often masks the negative one. These findings are discussed in relation to current models of verbal short-term memory.     

Issues with the SIMPLE model: comment on Brown, Neath, and Chater (2007)

SIMPLE (G. D. A. Brown, I. Neath, & N. Chater, 2007) attempts to explain data from serial recall and free recall in the same theoretical framework. While it can fit the free-recall serial-position curves that are the cornerstone of the 2-store buffer model, it does not address 2 classic issues in short-term memory research: similarity effects and presentation-rate effects. Similarity effects in free recall led to important work on organization in free recall, whereas similarity effects in serial recall led to the phonological basis of short-term memory. Presentation-rate effects operate quite differently in free and serial recall. The model also does not consider recall order effects or interresponse times in free recall, which may be problematic.     

The Influence of Long-term Memory Factors on Immediate Serial Recall: An Item and Order Analysis

In immediate serial recall, an error can occur because the presented item is not recalled (item error) or because it is recalled at the wrong serial position (order error). Even if these two types of information can be selectively influenced, in most current studies, a global performance measure confounding item and order information is used. Here, the issues associated with the measure of memory for item and order information are discussed. First, it is argued that in some circumstances it is very important that item information be controlled for when measuring order retention, by for example, conditionalizing order memory on memory for item information. Second, using such measures, it is shown that long-term memory factors recently investigated in immediate serial recall produce a different pattern of results than what is predicted by most current models: Semantic similarity, word frequency, and lexicality all influence item recall, but only lexicality affects order information. These findings are discussed in the light of a retrieval-based account suggesting that degraded phonological traces must undergo a reconstruction process calling upon long-term knowledge of the to-be-remembered items.     

Semantic Similarity and Immediate Serial Recall: Is There a Detrimental Effect on Order Information?

Four experiments investigated the disruptive effect of semantic similarity on short-term ordered recall. Experiments 1 and 2 contrasted immediate serial recall performance for lists of semantically similar items, drawn from the same semantic category, with performance for lists that contained items from different categories. Experiments 1 and 2 showed the usual similarity advantage for item information recall, but, contrary to expectations, there was no similarity disadvantage for the recall of order information, even when the level of item recall was controlled. Experiments 3 and 4 replicate and extend these findings by using an order reconstruction task or a limited word pool strategy, both of which yield alternate measures of order retention. These findings clearly contradict the widespread belief stating that semantic similarity hinders the short-term recall of order information. Results are discussed in the light of a retrieval-based account where the effects of semantic similarity reflect the processes called upon at recall: It is suggested that long-term knowledge is accessed to support the interpretation of degraded phonological traces.     

Dissociable lexical and phonological influences on serial recognition and serial recall

The impact of the lexicality of memory items on memory performance was compared in two paradigms, serial recall and serial recognition. Experiments 1 to 3 tested 7- and 8-year-old children. Memory accuracy was only mildly impaired in lists containing nonwords compared with words in a serial recognition task involving judgements of whether the items in two sequences were in the same order (Experiment 1), although a substantial advantage for word over nonword items from the same stimulus pool was found in serial recall (Experiment 2). A stronger influence of lexicality on serial recall than serial recognition was further demonstrated in Experiments 3A and 3B, and in 4A and 4B using adult participants. These experiments also established comparable degrees of sensitivity to the phonological similarity of the memory sequences in the two paradigms. The phonological similarity effect in serial recall was found to arise from increased phoneme order errors, whereas the lexicality effect was due principally to the greater frequency of phoneme identity errors for nonwords. It is proposed that the lexicality effect originates in the redintegration of item information just prior to recall, and that this process is largely bypassed in serial recognition.     

Disruption of short-term memory by distractor speech: Does content matter?

Four experiments replicate the finding that auditory distractors that are lexically identical to the visual target items dramatically increase the irrelevant-speech effect on serial recall. This effect was previously attributed to interference of incompatible order cues. The present results suggest that a different interpretation of this effect is required. Experiment 2 replicates the order congruence effect observed by Hughes and Jones (2005), but shows that this effect is most likely due to an attenuation of interference that is caused by strategic attention shifts to the nominally irrelevant material. Experiments 3 and 4 show that the between-stream similarity effect generalizes to a condition in which the distractor items were drawn from the same category as the targets, but were not identical to them. By showing that nonacoustic distractor features can increase interference in serial recall of lists of supposedly “meaningless” items such as digits or consonants, the results are most consistent with models that postulate an integration of short-term and long-term memory such as the embedded-processes model and the feature model and are inconsistent with classical structural accounts of memory.     

An attractor network model of serial recall

We present a neural network model of verbal working memory which attempts to illustrate how a few simple assumptions about neural computation can shed light on cognitive phenomena associated with the serial recall of verbal material. We assume that neural representations are distributed, that neural connectivity is massively recurrent, and that synaptic efficacy is modified based on the correlation between pre- and post-synaptic activity (Hebbian learning). Together these assumptions give rise to emergent computational properties that are relevant to working memory, including short-term maintenance of information, time-based decay, and similarity-based interference. We instantiate these principles in a specific model of serial recall and show how it can both simulate and explain a number of standard cognitive phenomena associated with the task, including the effects of serial position, word length, articulatory suppression (and its interaction with word length), and phonological similarity.     

Modality independence of order coding in working memory: Evidence from cross-modal order interference at recall

Working memory researchers do not agree on whether order in serial recall is encoded by dedicated modality-specific systems or by a more general modality-independent system. Although previous research supports the existence of autonomous modality-specific systems, it has been shown that serial recognition memory is prone to cross-modal order interference by concurrent tasks. The present study used a serial recall task, which was performed in a single-task condition and in a dual-task condition with an embedded memory task in the retention interval. The modality of the serial task was either verbal or visuospatial, and the embedded tasks were in the other modality and required either serial or item recall. Care was taken to avoid modality overlaps during presentation and recall. In Experiment 1, visuospatial but not verbal serial recall was more impaired when the embedded task was an order than when it was an item task. Using a more difficult verbal serial recall task, verbal serial recall was also more impaired by another order recall task in Experiment 2. These findings are consistent with the hypothesis of modality-independent order coding. The implications for views on short-term recall and the multicomponent view of working memory are discussed.     

Effects of language dominance on item and order memory in free recall,serial recall and order reconstruction

Spanish–English bilinguals (N = 144) performed free recall, serial recall and order reconstruction tasks in both English and Spanish. Long-term memory for both item and order information was worse in the less fluent language (L2) than in the more fluent language (L1). Item scores exhibited a stronger disadvantage for the L2 in serial recall than in free recall. Relative order scores were lower in the L2 for all three tasks, but adjusted scores for free and serial recall were equivalent across languages. Performance of English-speaking monolinguals (N = 72) was comparable to bilingual performance in the L1, except that monolinguals had higher adjusted order scores in free recall. Bilingual performance patterns in the L2 were consistent with the established effects of concurrent task performance on these memory tests, suggesting that the cognitive resources required for processing words in the L2 encroach on resources needed to commit item and order information to memory. These findings are also consistent with a model in which item memory is connected to the language system, order information is processed by separate mechanisms and attention can be allocated differentially to these two systems.     

Oscillator-based memory for serial order

A computational model of human memory for serial order is described (OSCillator-based Associative Recall [OSCAR]). In the model, successive list items become associated to successive states of a dynamic learning-context signal. Retrieval involves reinstatement of the learning context, successive states of which cue successive recalls. The model provides an integrated account of both item memory and order memory and allows the hierarchical representation of temporal order information. The model accounts for a wide range of serial order memory data, including differential item and order memory, transposition gradients, item similarity effects, the effects of item lag and separation in judgments of relative and absolute recency, probed serial recall data, distinctiveness effects, grouping effects at various temporal resolutions, longer term memory for serial order, list length effects, and the effects of vocabulary size on serial recall.     

Interference between maintenance and processing in working memory: the effect of item-distractor similarity in complex span

Four experiments examined the effect of phonological similarity between items and distractors on complex span performance. Item-distractor similarity benefited serial recall when distractors followed the items they were similar to, but not when distractors preceded the items they were similar to. These findings are predicted by C-SOB (contextual serial order in a box), a computational model of complex span. The model assumes that distractors are involuntarily encoded into memory, being associated to the preceding item's list position. Distractors interfere with items by superposition of distributed representations that are associated to the same position. Superposition distorts item memory; this distortion is less severe when the distractor is similar to the item. Further support for the assumption that distractors are encoded at the position of the preceding item comes from the finding that intrusions of distractors at recall tended to come from the position of the target item. In addition, intruding distractors tend to replace items to which they are similar, showing that lack of distinctiveness also contributes to interference.     

The impact of order incongruence between a task-irrelevant auditory sequence and a task-relevant visual sequence

A novel effect is reported in which serial recall of visual digits was disrupted to a greater degree by the presence of the same set of digits presented as an irrelevant auditory sequence than by the presence of irrelevant auditory consonants, but only when the order of the irrelevant digits was incongruent with that of the to-be-remembered digits (Experiment 1). Experiment 2 replicated this order-incongruence effect and showed also that disruption was dictated by the number of order-incongruent transitions but not by the number of novel tokens contained within the irrelevant sequence. The results favor an interference-by- process approach to the disruption of serial memory by irrelevant sound over approaches based on notions of interference by content and/or interference by depletion of attentional resources.     

Why does the phonological similarity effect reverse with nonwords?

The detrimental phonological similarity effect (PSE), a robust finding in serial recall of words, sometimes reverses with nonwords. The current study tested the hypothesis that nonwords benefit from phonological similarity because they are harder to retrieve. In two experiments serial recall and serial reconstruction of visually presented words and nonwords were compared. Phonological similarity is known to have a positive effect on item memory and a negative effect on position accuracy in serial recall, and the demands on item retrieval were greatly reduced in the latter task. PSE occurred for words in both tasks and was reversed for nonwords in serial recall, but not in serial reconstruction—a new finding in the literature. The following conclusions can be made: (1) the detrimental PSE on order retrieval occurs irrespective of lexicality, in accordance with prominent short-term memory models; and (2), the positive PSE on item retrieval is crucially affected by lexicality, a finding less well explained by the existing models.     

Disruption of order information by irrelevant items: a serial recognition paradigm

Irrelevant speech effect (ISE) is defined as a decrement in visually presented digit-list short-term memory performance due to exposure to irrelevant auditory material. Perhaps the most successful theoretical explanation of the effect is the changing state hypothesis. This hypothesis explains the effect in terms of confusion between amodal serial order cues, and represents a view based on the interference caused by the processing of similar order information of the visual and auditory materials. An alternative view suggests that the interference occurs as a consequence of the similarity between the visual and auditory contents of the stimuli. An important argument for the former view is the observation that ISE is almost exclusively observed in tasks that require memory for serial order. However, most short-term memory tasks require that both item and order information be retained in memory. An ideal task to investigate the sensitivity of maintenance of serial order to irrelevant speech would be one that calls upon order information but not item information. One task that is particularly suited to address this issue is serial recognition. In a typical serial recognition task, a list of items is presented and then probed by the same list in which the order of two adjacent items has been transposed. Due to the re-presentation of the encoding string, serial recognition requires primarily the serial order to be maintained while the content of the presented items is deemphasized. In demonstrating a highly significant ISE of changing versus steady-state auditory items in a serial recognition task, the present finding lends support for and extends previous empirical findings suggesting that irrelevant speech has the potential to interfere with the coding of the order of the items to be memorized.     

Temporal clustering and sequencing in short-term memory and episodic memory

A model of short-term memory and episodic memory is presented, with the core assumptions that (a) people parse their continuous experience into episodic clusters and (b) items are clustered together in memory as episodes by binding information within an episode to a common temporal context. Along with the additional assumption that information within a cluster is serially ordered, the model accounts for a number of phenomena from short-term memory (with a focus on serial recall) and episodic memory (with a focus on free recall). The model also accounts for the effects of aging on serial and free recall, apparent temporal isolation effects in short- and long-term memory, and the relation between individual differences in working memory and episodic memory performance.     

A temporal ratio model of memory

A model of memory retrieval is described. The model embodies 4 main claims: (a) temporal memory--traces of items are represented in memory partly in terms of their temporal distance from the present; (b) scale-similarity--similar mechanisms govern retrieval from memory over many different timescales; (c) local distinctiveness--performance on a range of memory tasks is determined by interference from near psychological neighbors; and (d) interference-based forgetting--all memory loss is due to interference and not trace decay. The model is applied to data on free recall and serial recall. The account emphasizes qualitative similarity in the retrieval principles involved in memory performance at all timescales, contrary to models that emphasize distinctions between short-term and long-term memory.