Disruption of short-term memory by changing and deviant sounds: support for a duplex-mechanism account of auditory distraction

The disruption of short-term memory by to-be-ignored auditory sequences (the changing-state effect) has often been characterized as attentional capture by deviant events (deviation effect). However, the present study demonstrates that changing-state and deviation effects are functionally distinct forms of auditory distraction: The disruption of visual-verbal serial recall by changing-state speech was independent of the effect of a single deviant voice embedded within the speech (Experiment 1); a voice-deviation effect, but not a changing-state effect, was found on a missing-item task (Experiment 2); and a deviant voice repetition within the context of an alternating-voice irrelevant speech sequence disrupted serial recall (Experiment 3). The authors conclude that the changing-state effect is the result of a conflict between 2 seriation processes being applied concurrently to relevant and irrelevant material, whereas the deviation effect reflects a more general attention-capture process.     

Self-relevance increases the irrelevant sound effect: Attentional disruption by one's own name

Memory performance is severely disrupted when task-irrelevant sound is played during item presentation or in a retention interval. Working memory models make contrasting assumptions on whether the semantic content of the auditory distractors modulates the irrelevant sound effect. In the present study, participants made more errors in serial recall when they had to ignore sentences containing their own name as opposed to that of a yoked-control partner. These results are only consistent with working memory models that allow for attentional processes to play a role in the explanation of the irrelevant sound effect. With repeated presentation the disruptive effect of one's own name decreased, whereas the disruptive effect of the auditory distractors in the control condition remained constant. The latter finding is most consistent with the duplex model of auditory attention, which assumes that the irrelevant sound effect is primarily caused by automatic interference of acoustic distractor features, but at the same time allows for a disruption of encoding due to attentional capture by unexpected deviants. However, to explain the present results, the mechanism responsible for the attentional capture has to be extended to highly (self-)relevant auditory distractors.     

Interference by process, not content, determines semantic auditory distraction

Distraction by irrelevant background sound of visually-based cognitive tasks illustrates the vulnerability of attentional selectivity across modalities. Four experiments centred on auditory distraction during tests of memory for visually-presented semantic information. Meaningful irrelevant speech disrupted the free recall of semantic category-exemplars more than meaningless irrelevant sound (Experiment 1). This effect was exacerbated when the irrelevant speech was semantically related to the to-be-remembered material (Experiment 2). Importantly, however, these effects of meaningfulness and semantic relatedness were shown to arise only when instructions emphasized recall by category rather than by serial order (Experiments 3 and 4). The results favor a process-oriented, rather than a structural, approach to the breakdown of attentional selectivity and forgetting: performance is impaired by the similarity of process brought to bear on the relevant and irrelevant material, not the similarity in item content.     

The impact of order incongruence between a task-irrelevant auditory sequence and a task-relevant visual sequence

A novel effect is reported in which serial recall of visual digits was disrupted to a greater degree by the presence of the same set of digits presented as an irrelevant auditory sequence than by the presence of irrelevant auditory consonants, but only when the order of the irrelevant digits was incongruent with that of the to-be-remembered digits (Experiment 1). Experiment 2 replicated this order-incongruence effect and showed also that disruption was dictated by the number of order-incongruent transitions but not by the number of novel tokens contained within the irrelevant sequence. The results favor an interference-by- process approach to the disruption of serial memory by irrelevant sound over approaches based on notions of interference by content and/or interference by depletion of attentional resources.     

A negative order-repetition priming effect: inhibition of order in unattended auditory sequences?

A novel negative priming (NP) effect is reported in which serial recall for a sequence of visually presented digits was poorer if the same sequence was presented as an irrelevant auditory sequence on the previous trial (Experiments 1 and 2). The effect was enhanced when attention was divided between the to-be-repeated auditory sequence and the concurrent to-be-remembered (TBR) sequence (Experiment 3). When the TBR sequences were also presented auditorily, NP arose only when the repeated TBR sequence was in the same voice as the previous irrelevant sequence; a voice mismatch produced positive priming (Experiment 4). The results suggest that the order of auditory events is registered preattentively and that inhibition may be applied to the acoustic transitions between irrelevant events.     

Maintenance rehearsal: the key to the role attention plays in storage and forgetting

Research with the maintenance-rehearsal paradigm, in which word pairs are rehearsed as distractor material during a series of digit recall trials, has previously indicated that low frequency and new word pairs capture attention to a greater degree than high frequency and old word pairs. This impacts delayed recognition of the pairs and interferes with immediate digit recall. The effect on immediate digit recall may provide the missing converging evidence for the role of attention in memory. In the current study, 3 experiments were conducted to further investigate the role of attention capture and novelty in storage and forgetting. In addition to the previously established effects, the novelty of switching rehearsal between 2 pairs was found to impair both digit recall and memory for the first pair. The attentional effects we obtained were dependent upon participant expectation, and forgetting appears to be due to interference with consolidation rather than decay or traditional associative interference. Finally, the attentional effects we observed in associative recognition were primarily reflected in a lowering of the false alarm rate with increases in the strength of the parent pairs. Although dual-process models can accommodate this finding on the assumption that recollection is invoked at test alongside familiarity, we showed that the level of recall in this paradigm is so small that recollection can be ruled out. Accordingly, our results are challenging for the existing models of associative recognition to accommodate.     

Irrelevant speech does not interfere with serial recall in early blind listeners

Phonological working memory is known be (a) inversely related to the duration of the items to be learned (word-length effect), and (b) impaired by the presence of irrelevant speech-like sounds (irrelevant-speech effect). As it is discussed controversially whether these memory disruptions are subject to attentional control, both effects were studied in sighted participants and in a sample of early blind individuals who are expected to be superior in selectively attending to auditory stimuli. Results show that, while performance depended on word length in both groups, irrelevant speech interfered with recall only in the sighted group, but not in blind participants. This suggests that blind listeners may be able to effectively prevent irrelevant sound from being encoded in the phonological store, presumably due to superior auditory processing. The occurrence of a word-length effect, however, implies that blind and sighted listeners are utilizing the same phonological rehearsal mechanism in order to maintain information in the phonological store.     

An effective attentional set for a specific colour does not prevent capture by infrequently presented motion distractors

An organism's survival depends on the ability to rapidly orient attention to unanticipated events in the world. Yet, the conditions needed to elicit such involuntary capture remain in doubt. Especially puzzling are spatial cueing experiments, which have consistently shown that involuntary shifts of attention to highly salient distractors are not determined by stimulus properties, but instead are contingent on attentional control settings induced by task demands. Do we always need to be set for an event to be captured by it, or is there a class of events that draw attention involuntarily even when unconnected to task goals? Recent results suggest that a task-irrelevant event will capture attention on first presentation, suggesting that salient stimuli that violate contextual expectations might automatically capture attention. Here, we investigated the role of contextual expectation by examining whether an irrelevant motion cue that was presented only rarely (～3–6% of trials) would capture attention when observers had an active set for a specific target colour. The motion cue had no effect when presented frequently, but when rare produced a pattern of interference consistent with attentional capture. The critical dependence on the frequency with which the irrelevant motion singleton was presented is consistent with early theories of involuntary orienting to novel stimuli. We suggest that attention will be captured by salient stimuli that violate expectations, whereas top-down goals appear to modulate capture by stimuli that broadly conform to contextual expectations.     

The irrelevant-speech effect and children: theoretical implications of developmental change

The irrelevant-speech effect refers to the finding of impaired recall performance in the presence of irrelevant auditory stimuli. Two broad classes of theories exist for the effect, both allowing automatic entry of the distracting sounds into the processing system but differing in how attention is involved. As one source of evidence in the discussion of existing theories of the irrelevant-speech effect, the performance of children and adults on a visual serial recall task with irrelevant sounds (speech and tones) was examined. The magnitude of the effects of irrelevant sounds on performance decreased with age. The developmental differences were marked in the conditions with the greatest need for attentional control (words and especially changing words). The findings were interpreted with respect to current models of memory. Theories of the irrelevant-speech effect that include a role for attentional control were better suited to handle the results than those without a specified role for attention.     

Capture of the gaze does not capture the mind

Sudden visual changes attract our gaze, and related eye movement control requires attentional resources. Attention is a limited resource that is also involved in working memory??for instance, memory encoding. As a consequence, theory suggests that gaze capture could impair the buildup of memory respresentations due to an attentional resource bottleneck. Here we developed an experimental design combining a serial memory task (verbal or spatial) and concurrent gaze capture by a distractor (of high or low similarity to the relevant item). The results cannot be explained by a general resource bottleneck. Specifically, we observed that capture by the low-similar distractor resulted in delayed and reduced saccade rates to relevant items in both memory tasks. However, while spatial memory performance decreased, verbal memory remained unaffected. In contrast, the high-similar distractor led to capture and memory loss for both tasks. Our results lend support to the view that gaze capture leads to activation of irrelevant representations in working memory that compete for selection at recall. Activation of irrelevant spatial representations distracts spatial recall, whereas activation of irrelevant verbal features impairs verbal memory performance.     

Hemispheric asymmetries in auditory distraction

Serial-verbal short-term memory is impaired by irrelevant sound, particularly when the sound changes acoustically (the changing-state effect). In contrast, short-term recall of semantic information is impaired only by the semanticity of irrelevant speech, particularly when it is semantically related to the target memory items (the between-sequence semantic similarity effect). Previous research indicates that the changing-state effect is larger when the sound is presented to the left ear in comparison to the right ear, the left ear disadvantage. In this paper, we report a novel finding whereby the between-sequence semantic similarity effect is larger when the irrelevant speech is presented to the right ear in comparison to the left ear, but this right ear disadvantage is found only when meaning is the basis of recall (Experiments 1 and 3), not when order is the basis of recall (Experiment 2). Our results complement previous research on hemispheric asymmetry effects in cross-modal auditory distraction by demonstrating a role for the left hemisphere in semantic auditory distraction.     

Inhibitory control in memory: Evidence for negative priming in free recall

Cognitive control mechanisms-such as inhibition-decrease the likelihood that goal-directed activity is ceded to irrelevant events. Here, we use the action of auditory distraction to show how retrieval from episodic long-term memory is affected by competitor inhibition. Typically, a sequence of to-be-ignored spoken distracters drawn from the same semantic category as a list of visually presented to-be-recalled items impairs free recall performance. In line with competitor inhibition theory (Anderson, 2003), free recall was worse for items on a probe trial if they were a repeat of distracter items presented during the previous, prime, trial (Experiment 1). This effect was produced only when the distracters were dominant members of the same category as the to-be-recalled items on the prime. For prime trials in which distracters were low-dominant members of the to-be-remembered item category or were unrelated to that category-and hence not strong competitors for retrieval-positive priming was found (Experiments 2 and 3). These results are discussed in terms of inhibitory approaches to negative priming and memory retrieval. (PsycINFO Database Record (c) 2012 APA, all rights reserved).     

Similarity as an organising principle in short-term memory

Abstract

The role of stimulus similarity as an organising principle in short-term memory was explored in a series of seven experiments. Each experiment involved the presentation of a short sequence of items that were drawn from two distinct physical classes and arranged such that item class changed after every second item. Following presentation, one item was re-presented as a probe for the ‘target’ item that had directly followed it in the sequence. Memory for the sequence was considered organised by class if probability of recall was higher when the probe and target were from the same class than when they were from different classes. Such organisation was found when one class was auditory and the other was visual (spoken vs. written words, and sounds vs. pictures). It was also found when both classes were auditory (words spoken in a male voice vs. words spoken in a female voice) and when both classes were visual (digits shown in one location vs. digits shown in another). It is concluded that short-term memory can be organised on the basis of sensory modality and on the basis of certain features within both the auditory and visual modalities.     

Value-driven attentional and oculomotor capture during goal-directed, unconstrained viewing

Covert shifts of attention precede and direct overt eye movements to stimuli that are task relevant or physically salient. A growing body of evidence suggests that the learned value of perceptual stimuli strongly influences their attentional priority. For example, previously rewarded but otherwise irrelevant and inconspicuous stimuli capture covert attention involuntarily. It is unknown, however, whether stimuli also draw eye movements involuntarily as a consequence of their reward history. Here, we show that previously rewarded but currently task-irrelevant stimuli capture both attention and the eyes. Value-driven oculomotor capture was observed during unconstrained viewing, when neither eye movements nor fixations were required, and was strongly related to individual differences in visual working memory capacity. The appearance of a reward-associated stimulus came to evoke pupil dilation over the course of training, which provides physiological evidence that the stimuli that elicit value-driven capture come to serve as reward-predictive cues. These findings reveal a close coupling of value-driven attentional capture and eye movements that has broad implications for theories of attention and reward learning.     

Impact of auditory selective attention on verbal short-term memory and vocabulary development

This study investigated the role of auditory selective attention capacities as a possible mediator of the well-established association between verbal short-term memory (STM) and vocabulary development. A total of 47 6- and 7-year-olds were administered verbal immediate serial recall and auditory attention tasks. Both task types probed processing of item and serial order information because recent studies have shown this distinction to be critical when exploring relations between STM and lexical development. Multiple regression and variance partitioning analyses highlighted two variables as determinants of vocabulary development: (a) a serial order processing variable shared by STM order recall and a selective attention task for sequence information and (b) an attentional variable shared by selective attention measures targeting item or sequence information. The current study highlights the need for integrative STM models, accounting for conjoined influences of attentional capacities and serial order processing capacities on STM performance and the establishment of the lexical language network.     

Auditory memory and the irrelevant sound effect: Further evidence for changing-state disruption

Four experiments investigate the hypothesis that irrelevant sound interferes with serial recall of auditory items in the same fashion as with visually presented items. In Experiment 1 an acoustically changing sequence of 30 irrelevant utterances was more disruptive than 30 repetitions of the same utterance (the changing-state effect; Jones, Madden, & Miles, 1992) whether the to-be-remembered items were visually or auditorily presented. Experiment 2 showed that two different utterances spoken once (a heterogeneous compound suffix; LeCompte & Watkins, 1995) produced less disruption to serial recall than 15 repetitions of the same sequence. Disruption thus depends on the number of sounds in the irrelevant sequence. In Experiments 3a and 3b the number of different sounds, the "token-set" size (Tremblay & Jones, 1998), in an irrelevant sequence also influenced the magnitude of disruption in both irrelevant sound and compound suffix conditions. The results support the view that the disruption of memory for auditory items, like memory for visually presented items, is dependent on the number of different irrelevant sounds presented and the size of the set from which these sounds are taken. Theoretical implications are discussed.     

Can the irrelevant speech effect turn into a stimulus suffix effect?

The irrelevant sound effect (ISE) and the stimulus suffix effect (SSE) are two qualitatively different phenomena, although in both paradigms irrelevant auditory material is played while a verbal serial recall task is being performed. Jones, Macken, and Nicholls (2004) have proposed the effect of irrelevant speech on auditory serial recall to switch from an ISE to an SSE mechanism, if the auditory-perceptive similarity of relevant and irrelevant material is maximized. The experiment reported here (n = 36) tested this hypothesis by exploring auditory serial recall performance both under irrelevant speech and under speech suffix conditions. These speech materials were spoken either by the same voice as the auditory items to be recalled or by a different voice. The experimental conditions were such that the likelihood of obtaining an SSE was maximized. The results, however, show that irrelevant speech—in contrast to speech suffixes—affects auditory serial recall independently of its perceptive similarity to the items to be recalled and thus in terms of an ISE mechanism that crucially extends to recency. The ISE thus cannot turn into an SSE.     

Auditory attentional capture during serial recall: violations at encoding of an algorithm-based neural model?

A novel attentional capture effect is reported in which visual-verbal serial recall was disrupted if a single deviation in the interstimulus interval occurred within otherwise regularly presented task-irrelevant spoken items. The degree of disruption was the same whether the temporal deviant was embedded in a sequence made up of a repeating item or a sequence of changing items. Moreover, the effect was evident during the presentation of the to-be-remembered sequence but not during rehearsal just prior to recall, suggesting that the encoding of sequences is particularly susceptible. The results suggest that attentional capture is due to a violation of an algorithm rather than an aggregate-based neural model and further undermine an attentional capture-based account of the classical changing-state irrelevant sound effect.     

Manipulations of irrelevant information: Suffix effects with articulatory suppression and irrelevant speech

Numerous studies have demonstrated impaired recall when the to-be-remembered information is accompanied or followed by irrelevant information. However, no current theory of immediate memory explains all three common methods of manipulating irrelevant information: requiring concurrent articulation, presenting irrelevant speech, and adding a stimulus suffix. Five experiments combined these manipulations to determine how they interact and which theoretical framework most accurately and completely accounts for the data. In Experiments 1 and 2, a list of auditory items was followed by an irrelevant speech sound (the suffix) while subjects engaged in articulatory suppression. Although articulatory suppression reduced overall recall compared to a control condition, comparable suffix effects were seen in both conditions. Experiments 3 and 4 found reliable suffix effects when list presentation was accompanied by irrelevant speech. Experiment 5 found a suffix effect even when the irrelevant speech was composed of a set of different items. Implications for working memory, pre-categorical acoustic store, the changing-state hypothesis, and the feature model are discussed.     

Similarities between the irrelevant sound effect and the suffix effect

Although articulatory suppression abolishes the effect of irrelevant sound (ISE) on serial recall when sequences are presented visually, the effect persists with auditory presentation of list items. Two experiments were designed to test the claim that, when articulation is suppressed, the effect of irrelevant sound on the retention of auditory lists resembles a suffix effect. A suffix is a spoken word that immediately follows the final item in a list. Even though participants are told to ignore it, the suffix impairs serial recall of auditory lists. In Experiment 1, the irrelevant sound consisted of instrumental music. The music generated a significant ISE that was abolished by articulatory suppression. It therefore appears that, when articulation is suppressed, irrelevant sound must contain speech for it to have any effect on recall. This is consistent with what is known about the suffix effect. In Experiment 2, the effect of irrelevant sound under articulatory suppression was greater when the irrelevant sound was spoken by the same voice that presented the list items. This outcome is again consistent with the known characteristics of the suffix effect. It therefore appears that, when rehearsal is suppressed, irrelevant sound disrupts the acoustic-perceptual encoding of auditorily presented list items. There is no evidence that the persistence of the ISE under suppression is a result of interference to the representation of list items in a postcategorical phonological store.