A visuospatial “phonological loop” in working memory: Evidence from American Sign Language

In two experiments, the question of whether working memory could support an articulatory rehearsal loop in the visuospatial domain was investigated. Deaf subjects fluent in American Sign Language (ASL) were tested on immediate serial recall. In Experiment 1, using ASL stimuli, evidence for manual motoric coding (worse recall under articulatory suppression) was found, replicating findings of ASL-based phonological coding (worse recall for phonologically similar lists). The two effects did not interact, suggesting separate components which both contribute to performance. Stimuli in Experiment 2 were namable pictures, which had to be recoded for ASL-based rehearsal to occur. Under these conditions, articulatory suppression eliminated the phonological similarity effect. Thus, an articulatory process seems to be used in translating pictures into a phonological code for memory maintenance. These results indicate a configuration of components similar to the phonological loop for speech, suggesting that working memory can develop a language-based rehearsal loop in the visuospatial modality.     

Lexicality and phonological similarity: a challenge for the retrieval-based account of serial recall?

The retrieval-based account of serial recall (Saint-Aubin & Poirier, 2000) attributes lexicality, phonological similarity, and articulatory suppression effects to a process where long-term representations are used to reconstruct degraded phonological traces. Two experiments tested this assumption by manipulating these factors in the recall of four- and five-item lists of words and non-words. Lexicality enhanced item recall (IR), but only affected position accuracy (PA) for five-item lists under suppression. Phonological similarity influenced both words and non-words, and produced impaired PA in silent and suppressed conditions. Consistent with the retrieval-based account, words and non-words of high word-likeness appear subject to redintegration. However, some findings, like suppression not reducing the phonological similarity impairment in suppressed conditions, present challenges for the retrieval-based account and other models of serial recall.     

Lexicality and phonological similarity: A challenge for the retrieval‐based account of serial recall?

The retrieval‐based account of serial recall () attributes lexicality, phonological similarity, and articulatory suppression effects to a process where long‐term representations are used to reconstruct degraded phonological traces. Two experiments tested this assumption by manipulating these factors in the recall of four‐ and five‐item lists of words and non‐words. Lexicality enhanced item recall (IR), but only affected position accuracy (PA) for five‐item lists under suppression. Phonological similarity influenced both words and non‐words, and produced impaired PA in silent and suppressed conditions. Consistent with the retrieval‐based account, words and non‐words of high word‐likeness appear subject to redintegration. However, some findings, like suppression not reducing the phonological similarity impairment in suppressed conditions, present challenges for the retrieval‐based account and other models of serial recall.     

Phonological Similarity and Trace Degradation in the Serial Recall Task: When CAT helps RAT,but not MAN

Phonological similarity is observed to affect serial recall detrimentally when correct-in-position scoring is used. Two experiments investigated the role of item and position accuracy scoring of rhyming, similar nonrhyming, and dissimilar lists under immediate recall conditions; articulatory suppression; or a filled delay. In general, rhyme lists produced the best item recall but position accuracy was highest for dissimilar lists. The results are due to a category cueing effect improving item recall for rhyme lists in conjunction with a detrimental effect of phonological similarity on position accuracy.     

Effects of phonological similarity and concurrent irrelevant articulation on short-term-memory recall of repeated and novel word lists

The extent to which phonological similarity of list words impairs short-term-memory recall was investigated in two experiments. Experiment 1 showed that the phonological-similarity effect occurred both when list words were repeatedly sampled from a small set and when they were new on every trial, both when word-order information was required and when it was not. Furthermore, the adverse effect of phonological similarity on recall was apparent on the initial lists recalled, did not change over trials, and cannot be attributed to increasing levels of proactive inhibition across lists. In Experiment 2, subjects were required to count repeatedly to six during list presentation. Concurrent irrelevant articulation lowered recall and abolished the phonological similarity effect for both repeated and novel word lists.     

Sign-based short-term coding of American Sign Language signs and printed English words by congenitally deaf signers

A short-term serial recall task consisting of lists of five American Sign Language signs and lists of five printed English words was administered to eight congenitally deaf subjects. For both modes of presentation, the stimuli in a given list were (1) high in phonological relatedness, (2) high in cherological relatedness (i.e., they were similar in terms of the formational attributes of their sign-equivalents), or (3) low in both phonological and cherological similarity (control). For both modes of presentation, recall accuracy was significantly lower on cherologically related lists than on both phonologically related lists and control lists. Phonologically related lists did not differ significantly from control lists. These results suggest the possibility that ways of looking at human memory which rely on a preference for phonological coding in short-term memory processes may reflect the audiocentricity of the experimenter rather than the inherent nature of such processes.     

Disruption of verbal STM by irrelevant speech, articulatory suppression, and manual tapping: Do they have a common source?

Under appropriate conditions, immediate serial verbal recall is impaired by irrelevant speech, articulatory suppression, and syncopated tapping. Interpretation of these variables in terms of the phonological loop component of working memory assumes separate phonological storage and articulatory rehearsal processes. In contrast, the Object-Oriented Episodic Record (O-OER) of Jones and the feature theory of Neath interpret these and other phenomena in terms of a unitary multimodal system. Three experiments investigate these disrupting tasks, with each experiment emphasizing one parameter. In each case, recall of phonologically similar and dissimilar letter sequences is compared as a marker of the presence or absence of phonological coding. In Experiment 1, subjects heard or articulated a single item, or tapped a single key at equal intervals. Only articulatory suppression impaired performance; it also abolished the effects of phonological similarity. Experiment 2 was identical, except that items were heard, or generated in a syncopated rhythm. Both suppression and tapping impaired performance to an equivalent extent and obliterated the effect of phonological similarity. Syncopated irrelevant speech caused a modest but significant impairment in performance. Experiment 3 was identical to Experiment 1, except that six tokens were used. Irrelevant speech and tapping had a clear impact on recall, but neither removed the phonological similarity effect. Again articulatory suppression had a major impact on performance and removed the effect of phonological similarity. We conclude that the pattern of results readily fits the phonological loop hypothesis, provided one accepts Saito's proposal that generating syncopated sequences uses common processes with speech production. It is not clear how the results can be explained by either the O-OER or the feature hypothesis.     

The irrelevant sound effect under articulatory suppression is a suffix effect even with five-item lists

The relationship between the suffix effect and the effect of irrelevant sound on serial recall of auditorily presented lists is investigated in this study. Contrary to the predictions of the phonological loop model, Hanley and Hayes (2012) reported that the irrelevant sound effect was abolished under articulatory suppression when a spoken suffix was added at the end of the list. The experiment reported in this paper uses a shorter list length (five items per list) than that employed by Hanley and Hayes. This is because it cannot realistically be argued that participants will abandon the use of phonological codes to retain the list items with sequences as short as this. Results replicated those of Hanley and Hayes (2012). There was a significant effect of irrelevant sound under articulatory suppression when the list items were followed by an auditory tone. Crucially, however, the effect of irrelevant sound under articulatory suppression was abolished when the list items were followed by a spoken suffix.     

Recall of short word lists presented visually at fast rates: Effects of phonological similarity and word length

Phonological similarity of visually presented list items impairs short-term serial recall. Lists of long words are also recalled less accurately than are lists of short words. These results have been attributed to phonological recoding and rehearsal. If subjects articulate irrelevant words during list presentation, both phonological similarity and word length effects are abolished. Experiments 1 and 2 examined effects of phonological similarity and recall instructions on recall of lists shown at fast rates (from one item per 0.114-0.50 sec), which might not permit phonological encoding and rehearsal. In Experiment 3, recall instructions and word length were manipulated using fast presentation rates. Both phonological similarity and word length effects were observed, and they were not dependent on recall instructions. Experiments 4 and 5 investigated the effects of irrelevant concurrent articulation on lists shown at fast rates. Both phonological similarity and word length effects were removed by concurrent articulation, as they were with slow presentation rates.     

Modality and phonological similarity effects in serial recall: Does one’s own voice play a role?

Results of two experiments showed that the modality effect in serial recall of word lists is sharply reduced by high interitem phonological similarity and that the extent of this reduction is much the same irrespective of whether the lists are spoken by the subject or the experimenter. These findings contradict an account of the modality effect recently proposed by Richardson (1979), but the data are entirely consistent with the belief that the effect originates in echoic memory.     

Immediate serial recall of words and nonwords: Tests of the retrieval-based hypothesis

In two experiments, the immediate serial recall of lists of words or nonwords was investigated under quiet and articulatory suppression conditions. The results showed better item recall for words but better order recall for nonwords, as measured with proportion of order errors per item recalled. Articulatory suppression hindered the recall of item information for both types of lists and of order information for words. These results are interpreted in light of a retrieval account in which degraded phonological traces must undergo a reconstruction process calling on long-term knowledge of the tobe-remembered items. The minimal long-term representations for nonwords are thought to be responsible for their lower item recall and their better order recall. Under suppression, phonological representations are thought to be minimal, producing trace interpretation problems responsible for the greater number of item and order errors, relative to quiet conditions. The very low performance for nonwords under suppression is attributed to the combination of degraded phonological information and minimal long-term knowledge.     

Effects of orthographic and phonological word length on memory for lists shown at RSVP and STM rates

This article reports 3 experiments in which effects of orthographic and phonological word length on memory were examined for short lists shown at rapid serial visual presentation (RSVP) and short-term memory (STM) rates. Only visual-orthographic length reduced RSVP serial recall, whereas both orthographic and phonological length lowered recall for STM lists in Experiment 1. Word-length effects may arise from output processes or from the temporal duration of output in recall. In 2 further experiments, output demands were reduced through the use of a recognition test. Recognition accuracy was impaired only by orthographic length for RSVP lists and by phonological length for STM lists in both experiments. The results demonstrate 2 item length effects not simply attributable to increased output time in recall, and implications for theories of STM are considered.     

汉语短时序列回忆中的语音相似性和视觉相似性效应

语音相似性效应和视觉相似性效应是短时序列回忆中的两个典型性效应, 但前人很少探讨这两种效应的交互作用。本研究利用汉语字形和语音的属性, 观察汉字短时序列回忆中语音相似性效应、视觉相似性效应及两者的交互作用。研究结果发现当回忆项目在语音或视觉上单纯相似或不相似时, 视觉相似性效应及其与语音相似性的交互作用与混合词表条件下所发现的结果有很大的不同。这个研究结果为丰富和补充相关理论模型提供了进一步实证依据。     

Irrelevant speech,articulatory suppression,and phonological similarity: A test of the phonological loop model and the feature model

Two experiments tested competing predictions about the nature of the irrelevant speech effect that were derived from Neath's (2000) feature model and from Salamé and Baddeley's (1982) phonological loop model. The first experiment examined the combined effects of irrelevant speech and articulatory suppression when target items were presented auditorily. Contrary to the suggestions of Neath, but consistent with the phonological loop model, the effects of articulatory suppression and irrelevant speech were additive even when the irrelevant speech was presented during the retention interval The second experiment examined the combined effects of irrelevant speech and phonological similarity when target items were presented visually. Consistent with the phonological loop model, the effects of phonological similarity and irrelevant speech were additive when participants were specifically instructed to use articulatory/phonological rehearsal to remember the list items. The results therefore contradicted Neath's claim that irrelevant speech abolishes the phonological similarity effect when list items are presented visually. However, the effect of phonological similarity was abolished in the irrelevant speech conditions when no instructions were given concerning rehearsal. It is argued that the phonological similarity effect disappears in some experiments because participants sometimes employ a semantic rehearsal strategy, consistent with the views of Salamé and Baddeley (1986).     

Irrelevant speech effects and statistical learning

Immediate serial recall of visually presented verbal stimuli is impaired by the presence of irrelevant auditory background speech, the so-called irrelevant speech effect. Two of the three main accounts of this effect place restrictions on when it will be observed, limiting its occurrence either to items processed by the phonological loop (the phonological loop hypothesis) or to items that are not too dissimilar from the irrelevant speech (the feature model). A third, the object-oriented episodic record (O-OER) model, requires only that the memory task involves seriation. The present studies test these three accounts by examining whether irrelevant auditory speech will interfere with a task that does not involve the phonological loop, does not use stimuli that are compatible with those to be remembered, but does require seriation. Two experiments found that irrelevant speech led to lower levels of performance in a visual statistical learning task, offering more support for the O-OER model and posing a challenge for the other two accounts.     

Phonological,visual, and semantic coding strategies and children's short-term picture memory span

Three experiments addressed controversies in the previous literature on the development of phonological and other forms of short-term memory coding in children, using assessments of picture memory span that ruled out potentially confounding effects of verbal input and output. Picture materials were varied in terms of phonological similarity, visual similarity, semantic similarity, and word length. Older children (6/8-year-olds), but not younger children (4/5-year-olds), demonstrated robust and consistent phonological similarity and word length effects, indicating that they were using phonological coding strategies. This confirmed findings initially reported by Conrad (1971), but subsequently questioned by other authors. However, in contrast to some previous research, little evidence was found for a distinct visual coding stage at 4 years, casting doubt on assumptions that this is a developmental stage that consistently precedes phonological coding. There was some evidence for a dual visual and phonological coding stage prior to exclusive use of phonological coding at around 5–6 years. Evidence for semantic similarity effects was limited, suggesting that semantic coding is not a key method by which young children recall lists of pictures.     

Dissociable lexical and phonological influences on serial recognition and serial recall

The impact of the lexicality of memory items on memory performance was compared in two paradigms, serial recall and serial recognition. Experiments 1 to 3 tested 7- and 8-year-old children. Memory accuracy was only mildly impaired in lists containing nonwords compared with words in a serial recognition task involving judgements of whether the items in two sequences were in the same order (Experiment 1), although a substantial advantage for word over nonword items from the same stimulus pool was found in serial recall (Experiment 2). A stronger influence of lexicality on serial recall than serial recognition was further demonstrated in Experiments 3A and 3B, and in 4A and 4B using adult participants. These experiments also established comparable degrees of sensitivity to the phonological similarity of the memory sequences in the two paradigms. The phonological similarity effect in serial recall was found to arise from increased phoneme order errors, whereas the lexicality effect was due principally to the greater frequency of phoneme identity errors for nonwords. It is proposed that the lexicality effect originates in the redintegration of item information just prior to recall, and that this process is largely bypassed in serial recognition.     

Phonological, visual, and semantic coding strategies and children's short-term picture memory span

Three experiments addressed controversies in the previous literature on the development of phonological and other forms of short-term memory coding in children, using assessments of picture memory span that ruled out potentially confounding effects of verbal input and output. Picture materials were varied in terms of phonological similarity, visual similarity, semantic similarity, and word length. Older children (6/8-year-olds), but not younger children (4/5-year-olds), demonstrated robust and consistent phonological similarity and word length effects, indicating that they were using phonological coding strategies. This confirmed findings initially reported by Conrad (1971), but subsequently questioned by other authors. However, in contrast to some previous research, little evidence was found for a distinct visual coding stage at 4 years, casting doubt on assumptions that this is a developmental stage that consistently precedes phonological coding. There was some evidence for a dual visual and phonological coding stage prior to exclusive use of phonological coding at around 5-6 years. Evidence for semantic similarity effects was limited, suggesting that semantic coding is not a key method by which young children recall lists of pictures.     

Reexamining the phonological similarity effect in immediate serial recall: The roles of type of similarity,category cuing,and item recall

Study of the phonological similarity effect (PSE) in immediate serial recall (ISR) has produced a conflicting body of results. Five experiments tested various theoretical ideas that together may help integrate these results. Experiments 1 and 2 tested alternative accounts that explain the effect of phonological similarity on item recall in terms of feature overlap, linguistic structure, or serial order. In each experiment, the participants' ISR was assessed for rhyming, alliterative, and similar nonrhyming/nonalliterative lists. The results were consistent with the predictions of the serial order account, with item recall being higher for rhyming than for alliterative lists and higher for alliterative than for similar nonrhyming/nonalliterative lists. Experiments 3 and 4 showed that these item recall differences are reduced when list items repeat across lists. Experiment 5 employed rhyming and dissimilar one-syllable and two-syllable lists to demonstrate that recall for similar (rhyming) lists can be better than that for dissimilar lists even in a typical ISR task in which words are used, providing a direct reversal of the classic PSE. These and other previously published results are interpreted and integrated within a proposed theoretical framework that offers an account of the PSE.     

Phonological similarity and lexicality effects in children's verbal short-term memory: concerns about the interpretation of probed recall data

Probed recall tasks are often used to assess aspects of children's verbal short-term memory development because they are not subject to potentially confounding output effects. However, the marked recency effects that are observed in probed recall means that these tasks are potentially insensitive to experimental manipulations when later serial positions are probed. This clouds the interpretation of data from probed recall studies in which children of different ages are presented with to-be-remembered lists of different lengths. In two experiments we examined the magnitude of phonological similarity and lexicality effects in both 5- to 6- and 8- to 9-year-old children. In each case performance on probed recall tasks was contrasted with that seen on tests of serial recognition. The results indicated that probed recall tasks are potentially less sensitive to experimental manipulations in younger than older children. However, comparable effects of both phonological similarity and lexicality were seen in both age groups using serial recognition procedures. These findings have implications for the interpretation of other studies that have examined the development of verbal short-term memory using probed recall and for theoretical accounts of the development of phonological similarity and lexicality effects in children.