Serial recall of rhythms and verbal sequences: Impacts of concurrent tasks and irrelevant sound

Rhythmic grouping enhances verbal serial recall, yet very little is known about memory for rhythmic patterns. The aim of this study was to compare the cognitive processes supporting memory for rhythmic and verbal sequences using a range of concurrent tasks and irrelevant sounds. In Experiment 1, both concurrent articulation and paced finger tapping during presentation and during a retention interval impaired rhythm recall, while letter recall was only impaired by concurrent articulation. In Experiments 2 and 3, irrelevant sound consisted of irrelevant speech or tones, changing-state or steady-state sound, and syncopated or paced sound during presentation and during a retention interval. Irrelevant speech was more damaging to rhythm and letter recall than was irrelevant tone sound, but there was no effect of changing state on rhythm recall, while letter recall accuracy was disrupted by changing-state sound. Pacing of sound did not consistently affect either rhythm or letter recall. There are similarities in the way speech and rhythms are processed that appear to extend beyond reliance on temporal coding mechanisms involved in serial-order recall.     

Manipulations of irrelevant information: Suffix effects with articulatory suppression and irrelevant speech

Numerous studies have demonstrated impaired recall when the to-be-remembered information is accompanied or followed by irrelevant information. However, no current theory of immediate memory explains all three common methods of manipulating irrelevant information: requiring concurrent articulation, presenting irrelevant speech, and adding a stimulus suffix. Five experiments combined these manipulations to determine how they interact and which theoretical framework most accurately and completely accounts for the data. In Experiments 1 and 2, a list of auditory items was followed by an irrelevant speech sound (the suffix) while subjects engaged in articulatory suppression. Although articulatory suppression reduced overall recall compared to a control condition, comparable suffix effects were seen in both conditions. Experiments 3 and 4 found reliable suffix effects when list presentation was accompanied by irrelevant speech. Experiment 5 found a suffix effect even when the irrelevant speech was composed of a set of different items. Implications for working memory, pre-categorical acoustic store, the changing-state hypothesis, and the feature model are discussed.     

Articulatory suppression and the irrelevantspeech effect in short-term memory: Does the locus of suppression matter?

Immediate serial recall for letter sequences was impaired when irrelevant speech (IS) was presented throughout stimulus input and a subsequent rehearsal interval. This irrelevant-speech effect was eliminated when participants engaged in articulatory suppression (repeated articulation of one or more digits) during stimulus input but not when suppression occurred during the postinput rehearsal period. Also, changing-state suppression (articulation of multiple items) impaired the overall level of performance more than did steady-state suppression (repetition of a single item), whereas both forms of suppression had the same influence on the IS effect. Our results suggest that the locus of suppression (during or after stimulus input) may have contributed to discrepant findings in the prior literature regarding the influence of articulatory suppression on the IS effect. We consider the implications of our findings for three prominent models of immediate memory: the working memory model, the objectoriented episodic record model, and the feature model.     

Does irrelevant music cause an irrelevant sound effect for auditory items?

The irrelevant sound effect (ISE) describes the significant reduction in verbal serial recall during irrelevant sounds with distinct temporal-spectral variations (changing-state sound). Whereas the ISE is well-documented for the serial recall of visual items accompanied by irrelevant speech and nonspeech sounds, an ISE caused by nonspeech sounds has not been reported for auditory items. Closing this empirical gap, Experiment 1 (n=90) verified that instrumental staccato-music reduces auditory serial recall compared to legato-music and silence. Its detrimental impact was not due to perceptual masking, disturbed encoding, or increased listening effort, as the employed experimental design and methods ensured. The found nonspeech ISE in auditory serial recall is corroborated by Experiment 1b (n=60), which, by using the same experimental design and methods, replicated the well-known ISE during irrelevant changing-state speech compared to steady-state speech, pink noise, and silence.     

Hemispheric asymmetries in auditory distraction

Serial-verbal short-term memory is impaired by irrelevant sound, particularly when the sound changes acoustically (the changing-state effect). In contrast, short-term recall of semantic information is impaired only by the semanticity of irrelevant speech, particularly when it is semantically related to the target memory items (the between-sequence semantic similarity effect). Previous research indicates that the changing-state effect is larger when the sound is presented to the left ear in comparison to the right ear, the left ear disadvantage. In this paper, we report a novel finding whereby the between-sequence semantic similarity effect is larger when the irrelevant speech is presented to the right ear in comparison to the left ear, but this right ear disadvantage is found only when meaning is the basis of recall (Experiments 1 and 3), not when order is the basis of recall (Experiment 2). Our results complement previous research on hemispheric asymmetry effects in cross-modal auditory distraction by demonstrating a role for the left hemisphere in semantic auditory distraction.     

Changing-state disruption of lip-reading by irrelevant sound in perceptual and memory tasks

Three experiments investigated irrelevant sound interference of lip-read lists. In Experiment 1, an acoustically changing sequence of nine irrelevant utterances was more disruptive to spoken immediate identification of lists of nine lip-read digits than nine repetitions of the same utterances (the changing-state effect; Jones, Madden, & Miles, 1992). Experiment 2 replicated this finding when lip-read items were sampled with replacement from the nine digits to form the lip-read lists. In Experiment 3, when the irrelevant sound was confined to the retention interval of a delayed recall task, a changing-state pattern of disruption also occurred. Results confirm a changing-state effect in memory for lip-read items but also point to the possibility that, for lip-reading, changing-state effects may occur at an earlier, perceptual stage.     

The effect of articulatory suppression and manual tapping on serial recall

Concurrent tasks, such as articulatory suppression and manual tapping, are used to understand the mechanisms underlying short-term memory by overloading domain-specific resources. The present study addresses the debate regarding the theoretical frameworks accounting for interference in serial recall by comparing the effects of both the modality of concurrent tasks (verbal vs. spatial) as well as the state of the tasks (steady vs. changing) in both verbal and spatial recall. The findings indicate that the verbal changing-state concurrent task significantly impaired digit recall, whereas the spatial changing-state concurrent task significantly impaired block recall. The theoretical implications are discussed in the context of a multimodal working memory model with domain-specific resources and a unitary approach to short-term memory.     

The impact of broadband noise on serial memory: changes in band-pass frequency increase disruption

Irrelevant sound consisting of bursts of broadband noise, in which centre frequency changes with each burst, markedly impaired short-term memory for order. In contrast, a sequence of irrelevant sound in which the same band-pass noise burst was repeated did not produce significant disruption. Serial recall for both visual-verbal (Experiment 1) and visual-spatial items (Experiment 2) was sensitive to the increased disruption produced by changing irrelevant noise. The results provide evidence that sounds that are largely aperiodic can produce marked disruption of serial recall in a similar manner to periodic sounds (e.g., speech, musical streams, and tones), and thus show a changing-state effect.     

Disruption of short-term memory by changing and deviant sounds: support for a duplex-mechanism account of auditory distraction

The disruption of short-term memory by to-be-ignored auditory sequences (the changing-state effect) has often been characterized as attentional capture by deviant events (deviation effect). However, the present study demonstrates that changing-state and deviation effects are functionally distinct forms of auditory distraction: The disruption of visual-verbal serial recall by changing-state speech was independent of the effect of a single deviant voice embedded within the speech (Experiment 1); a voice-deviation effect, but not a changing-state effect, was found on a missing-item task (Experiment 2); and a deviant voice repetition within the context of an alternating-voice irrelevant speech sequence disrupted serial recall (Experiment 3). The authors conclude that the changing-state effect is the result of a conflict between 2 seriation processes being applied concurrently to relevant and irrelevant material, whereas the deviation effect reflects a more general attention-capture process.     

Modality independence of order coding in working memory: Evidence from cross-modal order interference at recall

Working memory researchers do not agree on whether order in serial recall is encoded by dedicated modality-specific systems or by a more general modality-independent system. Although previous research supports the existence of autonomous modality-specific systems, it has been shown that serial recognition memory is prone to cross-modal order interference by concurrent tasks. The present study used a serial recall task, which was performed in a single-task condition and in a dual-task condition with an embedded memory task in the retention interval. The modality of the serial task was either verbal or visuospatial, and the embedded tasks were in the other modality and required either serial or item recall. Care was taken to avoid modality overlaps during presentation and recall. In Experiment 1, visuospatial but not verbal serial recall was more impaired when the embedded task was an order than when it was an item task. Using a more difficult verbal serial recall task, verbal serial recall was also more impaired by another order recall task in Experiment 2. These findings are consistent with the hypothesis of modality-independent order coding. The implications for views on short-term recall and the multicomponent view of working memory are discussed.     

New considerations for the cognitive locus of impairment in the irrelevant-sound effect

The finding that serial recall performance for visually presented items is impaired by concurrently presented task-irrelevant speech or sounds is referred to as the irrelevant-speech/-sound effect (ISE). Substantial evidence has indicated that the impairment of serial rehearsal can result in an ISE, and this may be explained by several models. The present series of experiments has demonstrated an ISE in surprise nonserial recognition tasks in which participants were unaware of the need to maintain a large number of visual items for a later memory test, suggesting that neither the rehearsal nor maintenance of order information is necessary for observing the ISE. This effect was observed for both steady-state and changing-state irrelevant sounds, suggesting that the present results do not derive from a confusion of order information, but instead provide evidence that identity representations can also be impaired by irrelevant sound.     

Disruption of verbal STM by irrelevant speech, articulatory suppression, and manual tapping: Do they have a common source?

Under appropriate conditions, immediate serial verbal recall is impaired by irrelevant speech, articulatory suppression, and syncopated tapping. Interpretation of these variables in terms of the phonological loop component of working memory assumes separate phonological storage and articulatory rehearsal processes. In contrast, the Object-Oriented Episodic Record (O-OER) of Jones and the feature theory of Neath interpret these and other phenomena in terms of a unitary multimodal system. Three experiments investigate these disrupting tasks, with each experiment emphasizing one parameter. In each case, recall of phonologically similar and dissimilar letter sequences is compared as a marker of the presence or absence of phonological coding. In Experiment 1, subjects heard or articulated a single item, or tapped a single key at equal intervals. Only articulatory suppression impaired performance; it also abolished the effects of phonological similarity. Experiment 2 was identical, except that items were heard, or generated in a syncopated rhythm. Both suppression and tapping impaired performance to an equivalent extent and obliterated the effect of phonological similarity. Syncopated irrelevant speech caused a modest but significant impairment in performance. Experiment 3 was identical to Experiment 1, except that six tokens were used. Irrelevant speech and tapping had a clear impact on recall, but neither removed the phonological similarity effect. Again articulatory suppression had a major impact on performance and removed the effect of phonological similarity. We conclude that the pattern of results readily fits the phonological loop hypothesis, provided one accepts Saito's proposal that generating syncopated sequences uses common processes with speech production. It is not clear how the results can be explained by either the O-OER or the feature hypothesis.     

无关言语对汉字短时记忆系列回忆的影响*

采用视觉呈现字表和听觉呈现无关言语方式,探讨在字表项目保持期间阻止被试复述情况下,不同呈现位置的无关言语对汉字短时记忆系列回忆的影响。在字表保持期间,采用计算任务进行分心作业。实验结果发现：(1)无关言语对汉字短时记忆系列回忆成绩存在显著影响;(2)在字表保持期间阻止被试进行复述消除了字表呈现期间呈现无关言语对回忆成绩产生的干扰效应;(3)汉字短时记忆系列回忆成绩表现出系列位置效应。实验结果没有完全支持客体情节记忆模型。     

Backward recall and benchmark effects of working memory

Working memory was designed to explain four benchmark memory effects: the word length effect, the irrelevant speech effect, the acoustic confusion effect, and the concurrent articulation effect. However, almost all research thus far has used tests that emphasize forward recall. In four experiments, we examine whether each effect is observable when the items are recalled in reverse order. Subjects did not know which recall direction would be required until the time of test, ensuring that encoding processes would be identical for both recall directions. Contrary to predictions of both the primacy model and the feature model, the benchmark memory effect was either absent or greatly attenuated with backward recall, despite being present with forward recall. Direction of recall had no effect on the more difficult conditions (e.g., long words, similar-sounding items, items presented with irrelevant speech, and items studied with concurrent articulation). Several factors not considered by the primacy and feature models are noted, and a possible explanation within the framework of the SIMPLE model is briefly presented.     

Similarities between the irrelevant sound effect and the suffix effect

Although articulatory suppression abolishes the effect of irrelevant sound (ISE) on serial recall when sequences are presented visually, the effect persists with auditory presentation of list items. Two experiments were designed to test the claim that, when articulation is suppressed, the effect of irrelevant sound on the retention of auditory lists resembles a suffix effect. A suffix is a spoken word that immediately follows the final item in a list. Even though participants are told to ignore it, the suffix impairs serial recall of auditory lists. In Experiment 1, the irrelevant sound consisted of instrumental music. The music generated a significant ISE that was abolished by articulatory suppression. It therefore appears that, when articulation is suppressed, irrelevant sound must contain speech for it to have any effect on recall. This is consistent with what is known about the suffix effect. In Experiment 2, the effect of irrelevant sound under articulatory suppression was greater when the irrelevant sound was spoken by the same voice that presented the list items. This outcome is again consistent with the known characteristics of the suffix effect. It therefore appears that, when rehearsal is suppressed, irrelevant sound disrupts the acoustic-perceptual encoding of auditorily presented list items. There is no evidence that the persistence of the ISE under suppression is a result of interference to the representation of list items in a postcategorical phonological store.     

Word Dose in the Disruption of Serial Recall by Irrelevant Speech: Phonological Confusions or Changing State?

Irrelevant background speech disrupts serial recall of visually presented lists of verbal material. Three experiments tested the hypothesis that the degree of disruption is dependent on the number of words heard (i.e. word dose) whilst the task was undertaken. Experiments 1 and 2 showed that more disruption is produced if the word dose is increased, thereby providing evidence to support the experimental hypothesis. It was concluded from the first two experiments that the word-dose effect might be the result of increasing the amount of changing-state information in the speech. The results of Experiment 3 supported this conclusion by showing an interaction between word dose and changing-state information. It was noted however that the results might be explained within the working memory account of the disruptive action of irrelevant speech. A further two experiments cast doubt on this possibility by failing to replicate the finding that the phonological similarity between heard and seen material affects the degree of interference (Salame & Baddeley, 1982). The findings are discussed in relation to the changing state hypothesis of the irrelevant speech effect (e.g. Jones, Madden, & Miles, 1992).     

Duration estimation and the phonological loop: Articulatory suppression and irrelevant sounds

Clock-based theories of time estimation propose that clock pulses are accumulated in working memory. Although these theories do not constrain the form of the memory trace, evidence reported in the literature suggests that active manipulation of a verbal trace may be involved. Four experiments are reported in which participants reproduced or verbally estimated short durations (up to a few seconds) either in a single-task condition or in a condition with a phonological load. Experiments 1, 2 and 4 showed that both interval reproduction and verbal estimation were impaired under concurrent articulatory suppression in comparison to a timing only control condition. Neither irrelevant speech (Experiments 1-3) nor irrelevant tones and music (Experiment 3) impaired timing performance. These findings are taken to show that time estimation is mediated by phonological working memory and the involvement of an active articulatory rehearsal process.     

Auditory attentional capture during serial recall: violations at encoding of an algorithm-based neural model?

A novel attentional capture effect is reported in which visual-verbal serial recall was disrupted if a single deviation in the interstimulus interval occurred within otherwise regularly presented task-irrelevant spoken items. The degree of disruption was the same whether the temporal deviant was embedded in a sequence made up of a repeating item or a sequence of changing items. Moreover, the effect was evident during the presentation of the to-be-remembered sequence but not during rehearsal just prior to recall, suggesting that the encoding of sequences is particularly susceptible. The results suggest that attentional capture is due to a violation of an algorithm rather than an aggregate-based neural model and further undermine an attentional capture-based account of the classical changing-state irrelevant sound effect.     

Interference by process, not content, determines semantic auditory distraction

Distraction by irrelevant background sound of visually-based cognitive tasks illustrates the vulnerability of attentional selectivity across modalities. Four experiments centred on auditory distraction during tests of memory for visually-presented semantic information. Meaningful irrelevant speech disrupted the free recall of semantic category-exemplars more than meaningless irrelevant sound (Experiment 1). This effect was exacerbated when the irrelevant speech was semantically related to the to-be-remembered material (Experiment 2). Importantly, however, these effects of meaningfulness and semantic relatedness were shown to arise only when instructions emphasized recall by category rather than by serial order (Experiments 3 and 4). The results favor a process-oriented, rather than a structural, approach to the breakdown of attentional selectivity and forgetting: performance is impaired by the similarity of process brought to bear on the relevant and irrelevant material, not the similarity in item content.     

Algorithmic modeling of the irrelevant sound effect (ISE) by the hearing sensation fluctuation strength

Background sounds, such as narration, music with prominent staccato passages, and office noise impair verbal short-term memory even when these sounds are irrelevant. This irrelevant sound effect (ISE) is evoked by so-called changing-state sounds that are characterized by a distinct temporal structure with varying successive auditory-perceptive tokens. However, because of the absence of an appropriate psychoacoustically based instrumental measure, the disturbing impact of a given speech or nonspeech sound could not be predicted until now, but necessitated behavioral testing. Our database for parametric modeling of the ISE included approximately 40 background sounds (e.g., speech, music, tone sequences, office noise, traffic noise) and corresponding performance data that was collected from 70 behavioral measurements of verbal short-term memory. The hearing sensation fluctuation strength was chosen to model the ISE and describes the percept of fluctuations when listening to slowly modulated sounds (f(mod) < 20?Hz). On the basis of the fluctuation strength of background sounds, the algorithm estimated behavioral performance data in 63 of 70 cases within the interquartile ranges. In particular, all real-world sounds were modeled adequately, whereas the algorithm overestimated the (non-)disturbance impact of synthetic steady-state sounds that were constituted by a repeated vowel or tone. Implications of the algorithm's strengths and prediction errors are discussed.