Irrelevant Speech,Phonological Similarity,and Presentation Modality

The phonological similarity effect refers to the finding that a list of similarsounding items is recalled less well than a list of dissimilar-sounding items. A strong prediction of the phonological store hypothesis, based on Baddeley's (1986, 1992) working memory framework, is that irrelevant speech should interact with the phonological similarity effect. We report three experiments that demonstrate that irrelevant speech eliminates the phonological similarity effect for visual but not for auditory items. In this respect, irrelevant speech functions much like articulatory suppression. Implications for the phonological store and changing state hypotheses are discussed.     

Modeling the effects of irrelevant speech on memory

The feature model (Nairne, 1990) is extended to account for the effects of irrelevant speech and concomitant interactions in immediate serial recall. In the feature model, both articulatory suppression and irrelevant speech are seen as adding noise to the memory representation, the difference being that articulatory suppression diverts more resources than does irrelevant speech. The addition of noise impairs recall because it reduces the probability of successful redintegration. When a competitor is incorrectly recalled, rather than the correct item, this competitor is recalled out of order, producing an increase in order errors. Six simulations are reported that show that the model accounts for (1) the impairment by both irrelevant speech and articulatory suppression, (2) the irrelevance of the phonological and semantic composition of the irrelevant speech, (3) greater disruption when the irrelevant speech tokens vary, (4) the abolition of the phonological similarity effect for visual, but not for auditory, items, (5) the abolition of the word length effect for both visual and auditory items, and (6) the abolition of the irrelevant speech effect under articulatory suppression for both visual and auditory items. The feature model is compared with the two other major views of irrelevant speech, the phonological store hypothesis and the changing state hypothesis.     

The phonological store of working memory: is it phonological and is it a store?

The phonological store construct of the working memory model is critically evaluated. Three experiments test the prediction that the effect of irrelevant sound and the effect of phonological similarity each survive the action of articulatory suppression but only when presentation of to-be-remembered lists is auditory, not visual. No evidence was found to support the interaction predicted among irrelevant speech, modality, and articulatory suppression. Although evidence for an interaction among modality, phonological similarity, and articulatory suppression was found, its presence could be diminished by a suffix, which is an acoustic, not a phonological factor. Coupled with other evidence--from the irrelevant sound effect and errors in natural speech--the action attributed to the phonological store seems better described in terms of a combination of auditory-perceptual and output planning mechanisms.     

Irrelevant speech eliminates the word length effect

Theword length effect refers to the observation that memory is better for short than for long words. Theirrelevant speech effect refers to the finding that memory is better when items are presented against a quiet background than against one with irrelevant speech. According to Baddeley’s (1986, 1994) working memory, these variables should not interact: The word length effect arises from rehearsal by the articulatory control process, whereas irrelevant speech reduces recall through interference in the phonological store. Four experiments demonstrate that, like articulatory suppression, irrelevant speech eliminates the word length effect for both visual and auditory items. These results (1) provide further evidence against the ability of working memory to explain the word length and irrelevant speech effects and (2) confirm a specific prediction of Nairne’s (1990) feature model.     

The phonological loop model of working memory: An ERP study of irrelevant speech and phonological similarity effects

The phonological loop model for retention of auditory verbal material in working memory, developed by Baddeley, assumes that irrelevant speech and phonological similarity influence only one and the same element of the system—that is, the phonological short-term store. We tested this idea by recording eventrelated potentials (ERPs) to auditorily presented letters that were phonologically similar or dissimilar and were to be memorized in the presence of more or less disturbing irrelevant speech. Irrelevant speech and phonological similarity caused ERP effects with clearly different scalp topographies, indicating that these factors influence different brain systems and hence probably different cognitive elements. Moreover, ERPs indicated that the phonological similarity effect might involve processes at the level of phonological analysis. Our data also support recent suggestions that the irrelevant speech effect is not based on the phonological similarity between relevant and irrelevant material, but on the phonological variability within the irrelevant stream.     

Modeling distributions of immediate memory effects: no strategies needed?

Many models of immediate memory predict the presence or absence of various effects, but none have been tested to see whether they predict an appropriate distribution of effect sizes. The authors show that the feature model (J. S. Nairne, 1990) produces appropriate distributions of effect sizes for both the phonological confusion effect and the word-length effect. The model produces the appropriate number of reversals, when participants are more accurate with similar items or long items, and also correctly predicts that participants performing less well overall demonstrate smaller and less reliable phonological similarity and word-length effects and are more likely to show reversals. These patterns appear within the model without the need to assume a change in encoding or rehearsal strategy or the deployment of a different storage buffer. The implications of these results and the wider applicability of the distributionmodeling approach are discussed.     

Contribution of articulatory rehearsal to short-term memory: evidence from a case of selective disruption.

We describe a brain-damaged patient with disturbed articulatory rehearsal in whom all predictions derived from a working memory model were fulfilled. The patient showed a reduced verbal span, no word-length effect on immediate recall in both the visual or the auditory modalities, no phonological similarity effect in the visual modality, and no effect of articulatory suppression. A slowed overt articulation rate provided independent evidence for disrupted articulatory rehearsal. The other components of working memory, the visuospatial scratch-pad, phonological storage system, and central executive, were functional. The selectivity of the deficit can be taken as evidence for the specific role of articulatory rehearsal in working memory.     

Short-Term Memory and Working Memory in Children with Blindness: Support for a Domain General or Domain Specific System?

The study explored the contribution of two component processes (phonological and executive) to blind children's memory performance. Children with blindness and sight were matched on gender, chronological age, and verbal intelligence and compared on measures of short-term memory (STM) and working memory (WM). Although the measures were highly correlated, the results from two experiments indicated that the blind children were superior to sighted children on measures of STM, but not on measures of WM. The results supported the notion that children with blindness have advantages on memory tasks that draw upon resources from the phonological loop. However, comparable performance between the ability groups on WM measures suggests there are domain specific aspects in the executive system.     

Mental imagery, reasoning, and blindness

Although reasoning seems to be inextricably linked to seeing in the “mind's eye”, the evidence is equivocal. In three experiments, sighted, blindfolded sighted, and congenitally totally blind persons solved deductive inferences based on three sorts of relation: (a) visuo-spatial relations that are easy to envisage either visually or spatially, (b) visual relations that are easy to envisage visually but hard to envisage spatially, and (c) control relations that are hard to envisage both visually and spatially. In absolute terms, congenitally totally blind persons performed less accurately and more slowly than the sighted on all such tasks. In relative terms, however, the visual relations in comparison with control relations impeded the reasoning of sighted and blindfolded participants, whereas congenitally totally blind participants performed the same with the different sorts of relation. We conclude that mental images containing visual details that are irrelevant to an inference can even impede the process of reasoning. Persons who are blind from birth—and who thus do not tend to construct visual mental images—are immune to this visual-impedance effect.     

Mental imagery,reasoning, and blindness

Although reasoning seems to be inextricably linked to seeing in the “mind's eye”, the evidence is equivocal. In three experiments, sighted, blindfolded sighted, and congenitally totally blind persons solved deductive inferences based on three sorts of relation: (a) visuo-spatial relations that are easy to envisage either visually or spatially, (b) visual relations that are easy to envisage visually but hard to envisage spatially, and (c) control relations that are hard to envisage both visually and spatially. In absolute terms, congenitally totally blind persons performed less accurately and more slowly than the sighted on all such tasks. In relative terms, however, the visual relations in comparison with control relations impeded the reasoning of sighted and blindfolded participants, whereas congenitally totally blind participants performed the same with the different sorts of relation. We conclude that mental images containing visual details that are irrelevant to an inference can even impede the process of reasoning. Persons who are blind from birth—and who thus do not tend to construct visual mental images—are immune to this visual-impedance effect.     

Privileged Access by Irrelevant Speech to Short-term Memory: The Role of Changing State

Memory for visually presented items is impaired by speech that is played as an irrelevant background. The paper presents the view that changing state of the auditory material is an important prerequisite for this disruption. Four experiments studied the effects of sounds varying in complexity in an attempt to establish which features of changing state in the auditory signal lead to diminished recall. Simple unvarying or repetitive speech sounds were not sufficient to induce the irrelevant speech effect (Experiment 1): in addition, simple analogues of speech, possessing regular or irregular envelopes and using a range of carriers, failed to imitate the action of speech (Experiment 2). Variability of between-utterance phonology in the irrelevant stream (Experiment 3) emerged as a crucial factor. Moreover, predictability of the syllable sequence did not reduce the degree of disruption (Experiment 4) suggesting that supra-syllabic characteristics of the speech are of little importance. The results broadly support the idea that disruption of short-term memory only occurs when the speech stream changes in state. It is argued that disruption occurs in memory when cues to serial order based on phonological representations of heard material interfere with the phonological codes of visual origin. It is suggested that cues to changing state of the speech input contaminate those associated with items of visual origin, which are already in a phonological store.     

Does visual experience influence the spatial distribution of auditory attention?

Sighted individuals are less accurate and slower to localize sounds coming from the peripheral space than sounds coming from the frontal space. This specific bias in favour of the frontal auditory space seems reduced in early blind individuals, who are particularly better than sighted individuals at localizing sounds coming from the peripheral space. Currently, it is not clear to what extent this bias in the auditory space is a general phenomenon or if it applies only to spatial processing (i.e. sound localization). In our approach we compared the performance of early blind participants with that of sighted subjects during a frequency discrimination task with sounds originating either from frontal or peripheral locations. Results showed that early blind participants discriminated faster than sighted subjects both peripheral and frontal sounds. In addition, sighted subjects were faster at discriminating frontal sounds than peripheral ones, whereas early blind participants showed equal discrimination speed for frontal and peripheral sounds. We conclude that the spatial bias observed in sighted subjects reflects an unbalance in the spatial distribution of auditory attention resources that is induced by visual experience.     

盲生错误记忆和真实记忆研究

错误记忆指的是人们会回忆或再认那些没有出现过的事件。目前,针对错误记忆的研究多集中于视力正常的人群。国外近年来有针对视障人群错误记忆的研究认为,在听觉学习情境中视障成人有更好的真实记忆和更低的错误记忆。目前对于盲生的错误记忆特征尚缺乏研究。而盲文摸读作为视障人群重要的学习方式,其对视障人群的真实记忆和错误记忆的影响尚未有研究者关注。本研究以初中盲生和视力正常学生作为研究对象,采用DRM范式,发现被试采用阅读学习(盲生摸读盲文,视力正常学生阅读屏幕文字)和听觉学习两种学习方式下,都发现被试身上存在稳定的错误记忆;盲生的错误记忆显著低于视力正常学生。在摸读学习方式下,盲生真实记忆好于听觉学习方式。     

Cross-modal, auditory-visual Stroop interference: a reply to Cowan and Barron (1987)

This series of experiments was performed to verify Cowan and Barron's (1987) reported effect of auditory color-word interference on a visual Stroop task. Extant theory predicts effects of irrelevant speech on visual memory tasks involving immediate, ordered recall of the items. Interference between the two sources of information (visual and auditory) is assumed to be located at the phonological store component of the articulatory loop. Perceptual tasks such as the Stroop task, which do not require use of the articulatory loop for rehearsal purposes, should not be similarly susceptible. The present data fail to replicate Cowan and Barron's findings, and are thus consistent with contemporary theory.     

工作记忆中的语音回路对汉语阅读理解的影响

语音回路是工作记忆中一个重要的组成部分,主要负责加工和存储语音信息。采用混合实验设计,以正确数和反应时 为指标,汉语语篇为阅读材料,探讨工作记忆中的语音回路对汉语阅读理解的影响。本研究包括两个实验,实验一采用发音抑制的范式,结合错误干扰考察了语音回路中的发音复述装置对汉语阅读理解的影响;实验二采用无关言语的范式,结合错误干扰考察了语音回路中的语音存储装置对汉语阅读理解的影响。结果表明：(1)通过发音抑制和无关言语的方法证明,语音回路中的发音复述装置和语音存储装置在汉语阅读理解中起着重要作用。(2) 字音和字形都影响汉语的阅读理解,但字形比字音起着更大的作用,而且它们的作用机制也不相同,字音直接进入语音存储装置,而字形要经过字音的转换进入语音存储装置。(3) 词频与语音回路有密切关系,语音回路中的发音复述装置的作用在高频词上有明显的表现。(4) 词频与字形、字音也有密切关系,在低频词的条件下,字形的作用大于字音的作用     

Irrelevant speech effects and statistical learning

Immediate serial recall of visually presented verbal stimuli is impaired by the presence of irrelevant auditory background speech, the so-called irrelevant speech effect. Two of the three main accounts of this effect place restrictions on when it will be observed, limiting its occurrence either to items processed by the phonological loop (the phonological loop hypothesis) or to items that are not too dissimilar from the irrelevant speech (the feature model). A third, the object-oriented episodic record (O-OER) model, requires only that the memory task involves seriation. The present studies test these three accounts by examining whether irrelevant auditory speech will interfere with a task that does not involve the phonological loop, does not use stimuli that are compatible with those to be remembered, but does require seriation. Two experiments found that irrelevant speech led to lower levels of performance in a visual statistical learning task, offering more support for the O-OER model and posing a challenge for the other two accounts.     

Evaluation of the attentional capacities and working memory of early and late blind persons

Although attentional processes and working memory seem to be significantly involved in the daily activities (particularly during navigating) of persons who are blind and who use these abilities to compensate for their lack of vision, few studies have investigated these mechanisms in this population. The aim of this study is to evaluate the selective, sustained and divided attention, attentional inhibition and switching and working memory of blind persons. Early blind, late blind and sighted participants completed neuropsychological tests that were designed or adapted to be achievable in the absence of vision. The results revealed that the early blind participants outperformed the sighted ones in selective, sustained and divided attention and working memory tests, and the late blind participants outperformed the sighted participants in selective, sustained and divided attention. However, no differences were found between the blind groups and the sighted group in the attentional inhibition and switching tests. Furthermore, no differences were found between the early and late blind participants in this set of tests. These results suggest that early and late blind persons can compensate for the lack of vision by an enhancement of the attentional and working memory capacities.     

Voice-based assessments of trustworthiness,competence, and warmth in blind and sighted adults

The study of voice perception in congenitally blind individuals allows researchers rare insight into how a lifetime of visual deprivation affects the development of voice perception. Previous studies have suggested that blind adults outperform their sighted counterparts in low-level auditory tasks testing spatial localization and pitch discrimination, as well as in verbal speech processing; however, blind persons generally show no advantage in nonverbal voice recognition or discrimination tasks. The present study is the first to examine whether visual experience influences the development of social stereotypes that are formed on the basis of nonverbal vocal characteristics (i.e., voice pitch). Groups of 27 congenitally or early-blind adults and 23 sighted controls assessed the trustworthiness, competence, and warmth of men and women speaking a series of vowels, whose voice pitches had been experimentally raised or lowered. Blind and sighted listeners judged both men’s and women’s voices with lowered pitch as being more competent and trustworthy than voices with raised pitch. In contrast, raised-pitch voices were judged as being warmer than were lowered-pitch voices, but only for women’s voices. Crucially, blind and sighted persons did not differ in their voice-based assessments of competence or warmth, or in their certainty of these assessments, whereas the association between low pitch and trustworthiness in women’s voices was weaker among blind than sighted participants. This latter result suggests that blind persons may rely less heavily on nonverbal cues to trustworthiness compared to sighted persons. Ultimately, our findings suggest that robust perceptual associations that systematically link voice pitch to the social and personal dimensions of a speaker can develop without visual input.     

A comparison of auditory monitoring performance in blind subjects with that of sighted subjects in light and dark

Two experiments were performed in which blind Ss, sighted Ss working in the dark, and sighted Ss working in the light were compared as to their efficiency on an auditory watchkeeping task. Absolute and differential auditory thresholds were measured in both experiments, and in the second experiment the groups also underwent a signal detection session under alerted conditions. There was some inconsistency as to relative performance of the sighted groups, but in both experiments the blind Ss were superior on the auditory watchkeeping task as to signals detected and effective sensitivity (d’). 1 This difference was not attributable to a difference in auditory sensitivity or to a criterion adopted for     

Imagery in the congenitally blind: how visual are visual images?

Three experiments compared congenitally blind and sighted adults and children on tasks presumed to involve visual imagery in memory. In all three, the blind subjects' performances were remarkably similar to the sighted. The first two experiments examined Paivio's (1971) modality-specific imagery hypothesis. Experiment 1 used a paired-associate task with words whose referents were high in either visual or auditory imagery. The blind, like the sighted, recalled more high-visual-imagery pairs than any others. Experiment 2 used a free-recall task for words grouped according to modality-specific attributes, such as color and sound. The blind performed as well as the sighted on words grouped by color. In fact, the only consistent deficit in both experiments occurred for the sighted in recall of words whose referents are primarily auditory. These results challenge Paivio's theory and suggest either (a) that the visual imagery used by the sighted is no more facilitating than the abstract semantic representations used by the blind or (b) that the sighted are not using visual imagery. Experiment 3 used Neisser and Kerr's (1973) imaging task. Subjects formed images of scenes in which target objects were described as either visible in the picture plane or concealed by another object and thus not visible. On an incidental recall test for the target objects, the blind, like the sighted, recalled more pictorial than concealed targets. This finding suggests that the haptic images of the blind maintain occlusion just as the visual images of the sighted do.