The involuntary capture of attention by novel feature pairings: A study of voice—location integration in auditory sensory memory

Past researchers of the integration of information in memory have typically required participants to attend to and/or commit to memory the stimuli conveying distinct features, rendering difficult the examination of whether the maintenance of the feature pairings can occur involuntarily. To address this issue, the integration of voice and location information in auditory sensory memory was measured using a cross-modal oddball task, in which task-irrelevant auditory deviants are known to capture attention in an involuntary fashion. Participants categorized visual digits presented shortly after to-be-ignored sounds. These sounds consisted in the same phoneme played simultaneously in both ears but in different voices (female in one ear, male in the other). On most trials, the pairing of voice to location was constant (standard sound). On rare and unpredictable trials, the voices swapped locations (deviant sound). In line with past work on attention capture by auditory novelty, the participants were significantly slower to judge the visual digits following the deviant sound, indicating the involuntary encoding of the links between voice and location in auditory memory. These results suggest that voices and locations are integrated in memory and that this binding occurs in conditions in which participants do not intend to commit any information to memory.     

Is there implicit memory without attention? A reexamination of task demands in Eich’s (1984) procedure

The relation between memory and attention has been of long-standing interest. Eich (1984) made an important discovery of implicit but not explicit memory for contextually determined homophones (e.g., taxi-FARE) presented in a channel to be ignored within a selective listening procedure. However, his slow rate of presentation of shadowing task materials may have allowed frequent attention shifts to the allegedly ignored channel. With a direct replication of Eich’s timing parameters, we reproduced his results, but when the attended channel was presented twice as fast as Eich’s, implicit memory for the to-be-ignored words vanished. Our results contradict claims of extensive semantic processing of unattended auditory information in this task.     

事件提示和时间提示对新异干扰的影响—— 来自听视跨通道和听通道的证据

采用Oddball范式考察听视跨感觉通道和听感觉通道中“无关刺激”或“无关属性”的信号提示对新异干扰的影响。实验1和实验2分别比较了听视跨通道和听通道中时间事件提示、时间提示和事件提示三种条件。结果表明：(1)时间提示条件下新异干扰效应消失, 而事件提示条件下新异干扰效应仍存在。无关刺激意外变化引起的靶任务行为受损, 不仅与偏差刺激的小概率和新颖性有关, 而且与干扰刺激与靶子间提示信号关联有关, 这种提示关联中事件发生的提示功能比时间间隔的提示功能更为重要。(2)听通道下新异干扰与视听跨通道结果一致, 无关属性也会起到提示信号作用, 同样事件提示功能比时间提示功能更重要。     

When distractors and to-be-remembered items compete for the control of action: a new perspective on serial memory for spatial information

In serial memory for spatial information, performance is impaired when distractors are interpolated between to-be-remembered (TBR) stimuli (Tremblay, Nicholls, Parmentier, & Jones, 2005). The so-called sandwich effect, combined with the use of eye tracking, served as a tool for examining the role of the oculomotor system in serial memory for spatial information. Participants had to recall the order in which sequences of TBR locations were presented. In some trials, to-be-ignored blue dots were presented after each TBR location. Our results show that response locations shift toward the location of the distractors, and this deviation is related to the eye movement deviation toward the distractor location. These results suggest that TBR and to-be-ignored locations are encoded onto a common map that could lie within the oculomotor system. Interference in memory for spatial information is interpreted in light of a model of oculomotor behavior (Godijn & Theeuwes, 2002b).     

An observation on the spontaneous noticing of prospective memory event-based cues

In event-based prospective memory, current theories make differing predictions as to whether intention-related material can be spontaneously noticed (i.e., noticed without relying on preparatory attentional processes). In 2 experiments, participants formed an intention that was contextually associated to the final phase of the experiment, and lures that overlapped to differing degrees with the features of the intention-related cues were embedded in the initial phase. When participants were outside of the appropriate responding context (i.e., the initial phase), they exhibited slower latencies to lures that exactly matched the features of their intention compared with other types of lures and control words. In addition, on a final remember/know recognition test, participants reported having greater subjective recollection for the occurrence of the exact-match lures. These results suggest that exact-match lures were spontaneously noticed and differentially processed in the absence of any observable preparatory attentional processes. The findings have implications for the theoretical debate over whether preparatory attention must always be relied upon to notice intention-related material.     

Evidence for habituation of the irrelevant-sound effect on serial recall

Working memory theories make opposing predictions as to whether the disruptive effect of task-irrelevant sound on serial recall should be attenuated after repeated exposure to the auditory distractors. Although evidence of habituation has emerged after a passive listening phase, previous attempts to observe habituation to to-be ignored distractors on a trial-by-trial basis have proven to be fruitless. With the present study, we suggest that habituation to auditory distractors occurs, but has often been overlooked because past attempts to measure habituation in the irrelevant-sound paradigm were not sensitive enough. In a series of four experiments, the disruptive effects of to-be-ignored speech and music relative to a quiet control condition were markedly reduced after eight repetitions, regardless of whether trials were presented in blocks (Exp. 1) or in a random order (Exp. 2). The auditory distractor’s playback direction (forward, backward) had no effect (Exp. 3). The same results were obtained when the auditory distractors were only presented in a retention interval after the presentation of the to-be-remembered items (Exp. 4). This pattern is only consistent with theoretical accounts that allow for attentional processes to interfere with the maintenance of information in working memory.     

Disruption of short-term memory by changing and deviant sounds: support for a duplex-mechanism account of auditory distraction

The disruption of short-term memory by to-be-ignored auditory sequences (the changing-state effect) has often been characterized as attentional capture by deviant events (deviation effect). However, the present study demonstrates that changing-state and deviation effects are functionally distinct forms of auditory distraction: The disruption of visual-verbal serial recall by changing-state speech was independent of the effect of a single deviant voice embedded within the speech (Experiment 1); a voice-deviation effect, but not a changing-state effect, was found on a missing-item task (Experiment 2); and a deviant voice repetition within the context of an alternating-voice irrelevant speech sequence disrupted serial recall (Experiment 3). The authors conclude that the changing-state effect is the result of a conflict between 2 seriation processes being applied concurrently to relevant and irrelevant material, whereas the deviation effect reflects a more general attention-capture process.     

Semantic priming by irrelevant speech

To-be-ignored, task-irrelevant speech disrupts serial recall performance relative to a quiet control condition. In most studies, the content of the auditory distractors had no effect on their disruptive potential, one’s own name being one of the few exceptions. There are two possible explanations of this pattern: (1) Semantic features of the irrelevant speech are usually not processed, except for highly relevant auditory distractors, or (2) semantic processing of the irrelevant speech always occurs, but usually does not affect serial recall performance. To test these explanations, we presented to-be-ignored auditory distractor words drawn from different categories while participants memorized visual targets for serial recall. Afterwards, participants were invited to what they believed to be an unrelated norming study, in which they were required to spontaneously produce words from the categories from which the auditory distractor words were drawn. Previously ignored words were produced with a higher probability than words from a parallel, nonpresented set, demonstrating that features of to-be-ignored, task-irrelevant speech that do not interfere with immediate serial recall performance are nevertheless processed semantically and may have substantial effects on subsequent behavior.     

Inhibitory control in memory: Evidence for negative priming in free recall

Cognitive control mechanisms-such as inhibition-decrease the likelihood that goal-directed activity is ceded to irrelevant events. Here, we use the action of auditory distraction to show how retrieval from episodic long-term memory is affected by competitor inhibition. Typically, a sequence of to-be-ignored spoken distracters drawn from the same semantic category as a list of visually presented to-be-recalled items impairs free recall performance. In line with competitor inhibition theory (Anderson, 2003), free recall was worse for items on a probe trial if they were a repeat of distracter items presented during the previous, prime, trial (Experiment 1). This effect was produced only when the distracters were dominant members of the same category as the to-be-recalled items on the prime. For prime trials in which distracters were low-dominant members of the to-be-remembered item category or were unrelated to that category-and hence not strong competitors for retrieval-positive priming was found (Experiments 2 and 3). These results are discussed in terms of inhibitory approaches to negative priming and memory retrieval. (PsycINFO Database Record (c) 2012 APA, all rights reserved).     

Privileged Access by Irrelevant Speech to Short-term Memory: The Role of Changing State

Memory for visually presented items is impaired by speech that is played as an irrelevant background. The paper presents the view that changing state of the auditory material is an important prerequisite for this disruption. Four experiments studied the effects of sounds varying in complexity in an attempt to establish which features of changing state in the auditory signal lead to diminished recall. Simple unvarying or repetitive speech sounds were not sufficient to induce the irrelevant speech effect (Experiment 1): in addition, simple analogues of speech, possessing regular or irregular envelopes and using a range of carriers, failed to imitate the action of speech (Experiment 2). Variability of between-utterance phonology in the irrelevant stream (Experiment 3) emerged as a crucial factor. Moreover, predictability of the syllable sequence did not reduce the degree of disruption (Experiment 4) suggesting that supra-syllabic characteristics of the speech are of little importance. The results broadly support the idea that disruption of short-term memory only occurs when the speech stream changes in state. It is argued that disruption occurs in memory when cues to serial order based on phonological representations of heard material interfere with the phonological codes of visual origin. It is suggested that cues to changing state of the speech input contaminate those associated with items of visual origin, which are already in a phonological store.     

Modality effects and the structure of short-term verbal memory

The effects of auditory and visual presentation upon short-term retention of verbal stimuli are reviewed, and a model of the structure of short-term memory is presented. The main assumption of the model is that verbal information presented to the auditory and visual modalities is processed in separate streams that have different properties and capabilities. Auditory items are automatically encoded in both the A (acoustic) code, which, in the absence of subsequent input, can be maintained for some time without deliberate allocation of attention, and a P (phonological) code. Visual items are retained in both the P code and a visual code. Within the auditory stream, successive items are strongly associated; in contrast, in the visual modality, it is simultaneously presented items that are strongly associated. These assumptions about the structure of short-term verbal memory are shown to account for many of the observed effect of presentation modality.     

The role of attention in the formation of auditory streams

There is controversy over whether stream segregation is an attention-dependent process. Part of the argument is related to the initial formation of auditory streams. It has been suggested that attention is needed only to form the streams, but not to maintain them once they have been segregated. The question of whether covert attention at the beginning of a to-be-ignored set of sounds will be enough to initiate the segregation process remains open. Here, we investigate this question by (1) using a methodology that does not require the participant to make an overt response to assess how the unattended sounds are organized and (2) structuring the test sound sequence to account for the covert attention explanation. The results of four experiments provide evidence to support the view that attention is not always required for the formation of auditory streams.     

Cross-modal selective attention: on the difficulty of ignoring sounds at the locus of visual attention

In three experiments, we investigated whether the ease with which distracting sounds can be ignored depends on their distance from fixation and from attended visual events. In the first experiment, participants shadowed an auditory stream of words presented behind their heads, while simultaneously fixating visual lip-read information consistent with the relevant auditory stream, or meaningless "chewing" lip movements. An irrelevant auditory stream of words, which participants had to ignore, was presented either from the same side as the fixated visual stream or from the opposite side. Selective shadowing was less accurate in the former condition, implying that distracting sounds are harder to ignore when fixated. Furthermore, the impairment when fixating toward distractor sounds was greater when speaking lips were fixated than when chewing lips were fixated, suggesting that people find it particularly difficult to ignore sounds at locations that are actively attended for visual lipreading rather than merely passively fixated. Experiments 2 and 3 tested whether these results are specific to cross-modal links in speech perception by replacing the visual lip movements with a rapidly changing stream of meaningless visual shapes. The auditory task was again shadowing, but the active visual task was now monitoring for a specific visual shape at one location. A decrement in shadowing was again observed when participants passively fixated toward the irrelevant auditory stream. This decrement was larger when participants performed a difficult active visual task there versus fixating, but not for a less demanding visual task versus fixation. The implications for cross-modal links in spatial attention are discussed.     

On the waxing and waning of working memory: action orientation moderates the impact of demanding relationship primes on working memory capacity

The present research examined how action- versus state-oriented individuals (Kuhl & Beckmann, 1994) utilize their working memory capacity under varying situational demands. Participants visualized either a demanding or an accepting person, after which their working memory capacity was assessed. Among action-oriented participants, visualizing a demanding person led to greater operation spans (Study 1) and superior memory for intention-related information (Study 2) than visualizing an accepting person. State-oriented participants displayed the opposite pattern, such that visualizing an accepting person led to greater operation spans (Study 1) and superior memory for intentions (Study 2) than visualizing a demanding person. These findings indicate that action versus state orientation moderates the impact of situational demands on working memory capacity.     

The demands of an ongoing activity influence the success of event-based prospective memory

Four experiments were conducted to evaluate whether event-based prospective memory would be sensitive to the concurrent demands of the ongoing activity in which intention-related cues were embedded. In Experiments 1 and 2, random alternation between two judgments in the ongoing task reduced prospective memory as compared with having a single task throughout. In Experiment 3, participants' making two binary judgments on every trial resulted in worse prospective memory than did their making single four-alternative judgments. In Experiment 4, participants' making two related judgments resulted in better prospective memory than did their making two unrelated judgments. The results are consistent in spirit with a production rule account of the processing resources that are available when intention-related cues are encountered. Therefore, event-based prospective memory can inversely covary with the cognitive demands of the ongoing activity.     

Disruption of order information by irrelevant items: a serial recognition paradigm

Irrelevant speech effect (ISE) is defined as a decrement in visually presented digit-list short-term memory performance due to exposure to irrelevant auditory material. Perhaps the most successful theoretical explanation of the effect is the changing state hypothesis. This hypothesis explains the effect in terms of confusion between amodal serial order cues, and represents a view based on the interference caused by the processing of similar order information of the visual and auditory materials. An alternative view suggests that the interference occurs as a consequence of the similarity between the visual and auditory contents of the stimuli. An important argument for the former view is the observation that ISE is almost exclusively observed in tasks that require memory for serial order. However, most short-term memory tasks require that both item and order information be retained in memory. An ideal task to investigate the sensitivity of maintenance of serial order to irrelevant speech would be one that calls upon order information but not item information. One task that is particularly suited to address this issue is serial recognition. In a typical serial recognition task, a list of items is presented and then probed by the same list in which the order of two adjacent items has been transposed. Due to the re-presentation of the encoding string, serial recognition requires primarily the serial order to be maintained while the content of the presented items is deemphasized. In demonstrating a highly significant ISE of changing versus steady-state auditory items in a serial recognition task, the present finding lends support for and extends previous empirical findings suggesting that irrelevant speech has the potential to interfere with the coding of the order of the items to be memorized.     

Spatial and verbal codes and the capacity of STM

Subjects were required to report an array of consonants presented tachistoscopically for various durations. Concurrently, they held in memory a load of auditory digits, a load of spatial locations or no load. These several forms of information did not seem to compete for a fixed capacity short term store. Consonant report was unaffected by carrying a spatial load and barely affected by carrying the auditory digit load. An auditory-verbal loop cannot play a mandatory role in the coding and storage of visual information. Some criticisms of structural interpretations of immediate memory are suggested.     

The effects of auditory shadowing on recognition of information received visually

When Ss attend to one auditory message, they have no permanent memory for a second auditory message received simultaneously. Generally, it has been argued that a similar effect would occur crossmodally. This hypothesis was tested in the present experiment for messages presented to visual and auditory modalities. All Ss were tested for recognition of information presented either while shadowing or while hearing but not shadowing a passage of prose presented to one ear. One group heard a list of concrete nouns in their other ear. Three other groups received (1) printed words. (2) pictures of objects easily labeled, or (3) pictures of objects difficult to label. The shadowing task produced a decrement m recognition scores for the first three groups but not for the group receiving pictures of objects difficult to label. Further, the shadowing task interfered more with information received auditorily than with any form of visual information. These results suggest that information received visually is stored in a long-term modality-specific memory that may operate independently of the auditory modality.     

Experience and information loss in auditory and visual memory

Recent studies show that recognition memory for sounds is inferior to memory for pictures. Four experiments were conducted to examine the nature of auditory and visual memory. Experiments 1–3 were conducted to evaluate the role of experience in auditory and visual memory. Participants received a study phase with pictures/sounds, followed by a recognition memory test. Participants then completed auditory training with each of the sounds, followed by a second memory test. Despite auditory training in Experiments 1 and 2, visual memory was superior to auditory memory. In Experiment 3, we found that it is possible to improve auditory memory, but only after 3 days of specific auditory training and 3 days of visual memory decay. We examined the time course of information loss in auditory and visual memory in Experiment 4 and found a trade-off between visual and auditory recognition memory: Visual memory appears to have a larger capacity, while auditory memory is more enduring. Our results indicate that visual and auditory memory are inherently different memory systems and that differences in visual and auditory recognition memory performance may be due to the different amounts of experience with visual and auditory information, as well as structurally different neural circuitry specialized for information retention.     

Withdrawal of spatial overt attention following intentional forgetting: evidence from eye movements

Eye movements were measured to examine whether item-method directed forgetting involved a spatial overt attention shift. Experiment 1 showed that participants’ eyes were moved away from the study word following the forget and ignore cues, but not the remember cue. Experiment 2 revealed that the eyes were moved away from the area that covered by the study word even when the study word disappeared upon the presentation of the memory cue. Both the study word and memory cue were presented auditorily in Experiment 3. In all experiments, the to-be-remembered words were recalled better than both to-be-forgotten and to-be-ignored words. More importantly, mental effort, as indexed by the pupil size, increased following the remember, as compared with the forget and ignore cues. These findings are discussed in terms of controlling spatial overt attention after encoding to withdraw attention from irrelevant information and to allocate cognitive resources to relevant information for long-term retention.