The sources of visual recency: Movement and language in serial recall

Four experiments examine the importance of movement—the sequential ordering of stimulus features—in producing recency in the ordered serial recall of visual lists. The written recall of handsigns produced more recency when they were seen moving than still (Experiment I). Number lists presented as moving bar figures showed more recency than numbers which were displayed in the normal way with all features displayed simultaneously (Experiment II). The order in which features of abstract shapes are displayed can, itself, determine recency (Experiment III). However, a final experiment showed that still lip pictures of speech sounds generate more recency than letters representing those speech sounds. Therefore movement of stimulus features need not account for the extensive recency advantage in remembering lipread lists. The theoretical implications of these findings are discussed.     

Enhanced recency effects with changing-state and primary-linguistic stimuli

A number of explanations for the modality effect in immediate serial recall have been proposed. The auditory advantage for recall of recency items has been explained in terms of (1) the contributions of precategorical acoustic storage (PAS), (2) an advantage of changing-state over static stimuli, and (3) an advantage of primary-linguistic coding. Four experiments were conducted to evaluate these hypotheses. In the first, subjects viewed seven consecutive rectangles of different colors on a computer monitor. A small recency effect was obtained when the task was to recall the colors of the rectangles in order, with the size of the effect being independent of whether the rectangles remained stationary on the screen or moved in one of four directions. However, when the task was to recall the direction of movement of the rectangles, a larger recency effect was found. This pattern of results was interpreted as suggesting that recency effects are enhanced by changing-state stimulus information, but only when the changing-state information serves to identify the stimulus. Experiments 2 and 3 provided converging evidence by demonstrating an analogous recency advantage for changing-state visual stimuli that were somewhat different from those of Experiment 1. Experiment 4 demonstrated recency effects with synthesized speech stimuli that were substantially greater than were those found with the changing-state visual stimuli of the first three experiments. Implications of the results for the PAS, changing-state, and primary-linguistic hypotheses, as well as temporal-distinctiveness theories of recency, are discussed.     

The role of words and sounds in infants' visual processing: from overshadowing to attentional tuning

Although it is well documented that language plays an important role in cognitive development, there are different views concerning the mechanisms underlying these effects. Some argue that even early in development, effects of words stem from top-down knowledge, whereas others argue that these effects stem from auditory input affecting attention allocated to visual input. Previous research (e.g., Robinson & Sloutsky, 2004a ) demonstrated that non-speech sounds attenuate processing of corresponding visual input at 8, 12, and 16 months of age, whereas the current study demonstrates that words attenuate visual processing at 10 months but not at 16 months (Experiment 1). Furthermore, prefamiliarization with non-speech sounds (Experiment 2) resulted in able processing of visual input by 16-month-olds. These findings suggest that some effects of labels found early in development may stem from familiarity with human speech. The possibility of general-auditory factors underlying the effects of words on cognitive development is discussed.     

Multiple mechanisms for recency with vowels and consonants

Three experiments were conducted to test the hypothesis that the difference in recency effect between vowel-contrasting and stop-contrasting lists of syllables in immediate ordered recall can be explained by item discriminability and regular short-term memory mechanisms, without any recourse to echoic memory or precategorical acoustic storage (PAS). In Experiment 1, the short-term memory mechanisms were manipulated by reducing amount of output interference and length of retention interval. The partial-report technique was used. The most important finding was the usual final-position recency effect (difference in recall between the fifth and sixth serial positions) for the vowel lists but not for the stop lists, regardless of the type of report. Thus the PAS theory could not be rejected. In Experiments 2 and 3, the last item was differentiated from the other items of the list, either by lengthening the interstimulus interval between the last and the next-to-last (Experiment 2) or by increasing the intensity of the last item (Experiment 3). In both cases, an increase of the final-position recency effect was found even for stop lists. Since a drop in recall errors was also obtained for the fourth item when its intensity was increased (von Restorff effect), this final-position recency effect for stop lists is likely to be due to item discriminability, and not to echoic memory for the last item. Item discriminability appeared to be the critical factor.     

An irrelevant speech effect with repeated and continuous background speech

The irrelevant speech effect is the impairment of task performance by the presentation of to-be-ignored speech stimuli. Typically, the irrelevant speech comprises a variety of sounds, but previous research (e.g., Jones, Madden, & Miles, 1992) has suggested that the deleterious effect of background speech is virtually eliminated if the speech comprises repetitions of a sound (e.g., “be, be, be”) or a single continuous sound (e.g., “beeeeeee”). Four experiments are reported that challenge this finding. Experiments 1, 2, and 4 show a substantial impairment in serial recall performance in the presence of a repeated sound, and Experiments 3 and 4 show a similar impairment of serial recall in the presence of a continuous sound. The relevance of these findings to several explanations of the irrelevant speech effect is discussed.     

The sensorimotor contributions to implicit memory, familiarity, and recollection

The sensorimotor contributions to memory for prior occurrence were investigated. Previous research has shown that both implicit memory and familiarity draw on gains in stimulus-related processing fluency for old, compared with novel, stimuli, but recollection does not. Recently, it has been demonstrated that processing fluency itself resides in stimulus-specific motor simulations or reenactment (e.g., covert pronouncing simulations for words as stimuli). Combining these lines of evidence, it was predicted that stimulus-specific motor interference preventing simulations should impair both implicit memory and familiarity but leave recollection unaffected. This was tested for words as verbal stimuli associated to pronouncing simulations in the oral muscle system (but also for tunes as vocal stimuli and their associated vocal system, Experiment 2). It was found that oral (e.g., chewing gum), compared with manual (kneading a ball), motor interference prevented mere exposure effects (Experiments 1-2), substantially reduced repetition priming in word fragment completion (Experiment 3), reduced the familiarity estimates in a remember-know task (Experiment 5) and in receiver-operating characteristics (Experiment 6), and completely neutralized familiarity measured by self-reports (Experiment 4) and skin conductance responses (Experiment 7), while leaving recollection and free recall unaffected (across Experiments 1-7). This pattern establishes a rare memory dissociation in healthy participants, that is, explicit without implicit memory or recognizing without feeling familiar. Implications for embodied memory and neuropsychology are discussed.     

Suprasegmental information affects processing of talking faces at birth

From birth, newborns show a preference for faces talking a native language compared to silent faces. The present study addresses two questions that remained unanswered by previous research: (a) Does the familiarity with the language play a role in this process and (b) Are all the linguistic and paralinguistic cues necessary in this case? Experiment 1 extended newborns’ preference for native speakers to non-native ones. Given that fetuses and newborns are sensitive to the prosodic characteristics of speech, Experiments 2 and 3 presented faces talking native and nonnative languages with the speech stream being low-pass filtered. Results showed that newborns preferred looking at a person who talked to them even when only the prosodic cues were provided for both languages. Nonetheless, a familiarity preference for the previously talking face is observed in the “normal speech” condition (i.e., Experiment 1) and a novelty preference in the “filtered speech” condition (Experiments 2 and 3). This asymmetry reveals that newborns process these two types of stimuli differently and that they may already be sensitive to a mismatch between the articulatory movements of the face and the corresponding speech sounds.     

Serial position effects in short-term visual memory: A SIMPLE explanation?

A version of Sternberg's (1966) short-term visual memory recognition paradigm with pictures of unfamiliar faces as stimuli was used in three experiments to assess the applicability of the distinctiveness-based SIMPLE model proposed by Brown, Neath, and Chater (2002). Initial simulations indicated that the amount of recency predicted increased as the parameter measuring the psychological distinctiveness of the stimulus material (c) increased and that the amount of primacy was dependent on the extent of proactive interference from previously presented stimuli. The data from Experiment 1, in which memory lists of four and five faces varying in visual similarity were used, confirmed the predicted extended recency effect. However, changes in visual similarity were not found to produce changes in c. In Experiments 2 and 3, the conditions that influence the magnitude of c were explored. These revealed that both the familiarity of the stimulus class before testing and changes in familiarity, due to perceptual learning, influenced distinctiveness, as indexed by the parameter c. Overall, the empirical data from all three experiments were well fit by SIMPLE.     

前分类声音存储器对声调和情绪韵律的加工

采用系列位置回忆任务, 探讨作为声调语言的汉语普通话中声调及情绪信息是否具有近因及后缀效应, 从而揭示同为超音段信息的声调和情绪韵律在前分类声音存储器(Precategorical Acoustic Storage, PAS)中是否具有单独的表征, 及该表征可能受到哪些因素的影响。实验一和二分别考察了声调是否具有近因和后缀效应, 实验三和四分别考察了情绪信息是否具有近因和后缀效应。实验结果发现两者均在PAS存储器中有单独的表征, 但这种表征会受到一些因素的影响, 且受影响的方式不一样。研究结果表明作为超音段信息的声调和情绪信息在表征上的不稳定性和脆弱性, 及在短时记忆加工过程中的特殊性。     

In search of a strong visual recency effect

When a sequence of visual stimuli is presented in a fixed location, immediate serial recall of the sequence is characterized by only a small recency effect. According to Battacchi, Pelamatti, and Umiltà (1990), the distribution of visual stimuli over space, as well as time, greatly enhances the recency effect. After an initial failure to find a strong visual recency effect with distributed presentation (Experiment 1), in the remaining experiments an attempt was made to more closely approximate Battacchi et al.'s methodology by eliminating articulatory suppression (Experiments 2-7), using their stimuli (Experiments 3-7), blocking conditions (Experiments 4-7), requiring written rather than typed responses (Experiments 5-7), and using their list length (Experiments 6 and 7). Nevertheless, even when their method was followed as closely as possible (Experiment 7), distributed presentation did not produce a strong visual recency effect. The influence of distributed presentation on the visual recency effect would seem to be, at best, limited.     

Echoic memory and voice quality: Recency recall is not enhanced by varying presentation voice

Three experiments explored the effects on immediate recall of varying voice of presentation. Experiment 1 showed that the free-recall recency effect was not enhanced by presenting list words alternately in a male and a female voice. Experiment 2 replicated this result and also showed that recall of a given recency item from such a list was no more probable when the subjects were informed immediately following presentation that they need not recall the words presented in the other voice. Experiment 3 replicated previous findings of a reduction in the “suffix effect” when presentation voice is changed for the suffix item. The relation of this result to those of Experiments 1 and 2 is discussed.     

Pop-out into memory: a retrieval mechanism that is enhanced with the recall of subject-performed tasks

Subject-performed tasks (SPTs; i.e., carrying out the actions during study) improve free recall of action phrases without enhancing relational information. By this mechanism, items pop into a person's mind without active search, and this process especially extends the recency effect. The authors demonstrated the existence of the extended recency effect and its importance for the SPT recall advantage (Experiments 1 and 2). Carrying out the action and not semantic processing caused the effect (Experiment 3). The extended recency effect was also not a consequence of a deliberate last-in, first-out strategy (Experiment 4), and performing a difficult secondary task (an arithmetic task) during recall reduced memory performances but did not influence the extended recency effect (Experiment 5). These data support the theory that performing actions during study enhances the efficiency of an automatic pop-out mechanism in free recall.     

An auditory analog of the picture superiority effect

Previous research has found that pictures (e.g., a picture of an elephant) are remembered better than words (e.g., the word "elephant"), an empirical finding called the picture superiority effect (Paivio & Csapo. Cognitive Psychology 5(2):176-206, 1973). However, very little research has investigated such memory differences for other types of sensory stimuli (e.g. sounds or odors) and their verbal labels. Four experiments compared recall of environmental sounds (e.g., ringing) and spoken verbal labels of those sounds (e.g., "ringing"). In contrast to earlier studies that have shown no difference in recall of sounds and spoken verbal labels (Philipchalk & Rowe. Journal of Experimental Psychology 91(2):341-343, 1971; Paivio, Philipchalk, & Rowe. Memory & Cognition 3(6):586-590, 1975), the experiments reported here yielded clear evidence for an auditory analog of the picture superiority effect. Experiments 1 and 2 showed that sounds were recalled better than the verbal labels of those sounds. Experiment 2 also showed that verbal labels are recalled as well as sounds when participants imagine the sound that the word labels. Experiments 3 and 4 extended these findings to incidental-processing task paradigms and showed that the advantage of sounds over words is enhanced when participants are induced to label the sounds.     

Predictability as a task demand in single-trial free recall

In a series of five single-trial free recall experiments it was demonstrated how manipulations of predictability in a list learning task caused reliable effects on the recency portions of the nominal serial position curve. Predictability was defined as knowledge of when the next item in the list should appear ( interval predictability) and knowledge of when the list should end and thus when recall could start ( signal predictability). Predictability was manipulated by varying the inter-item intervals within a list according to different "encoding functions", e.g. a successive increase (Condition I ) or decrease (Condition D ) of the inter-item intervals. Predictability was also manipulated by means of post-list recall signals. The data obtained show, that depending on how the interval and the signal predictabilities were manipulated, either Condition I or Condition D lists could be made more beneficial to the recall of recency items than lists with constant inter-item intervals (Condition C ). Previous encoding, storage and retrieval models were found not to give satisfactory accounts of the obtained recency effects. Neither could any traditional rehearsal model explain the data. Instead it is proposed that the predictability of stimuli in a list learning task explains how changes in recall of recency items come about. It was also hypothesized that the temporal demands, afforded to the subjects by the different encoding functions, explained the obtained output order variations.     

非言语声音影响汉语听者言语声音的知觉

采用启动范式, 以汉语听者为被试, 考察了非言语声音是否影响言语声音的知觉。实验1考察了纯音对辅音范畴连续体知觉的影响, 结果发现纯音影响到辅音范畴连续体的知觉, 表现出频谱对比效应。实验2考察了纯音和复合音对元音知觉的影响, 结果发现与元音共振峰频率一致的纯音或复合音加快了元音的识别, 表现出启动效应。两个实验一致发现非言语声音能够影响言语声音的知觉, 表明言语声音知觉也需要一个前言语的频谱特征分析阶段, 这与言语知觉听觉理论的观点一致。     

1- and 2-year-olds’ expectations about third-party communicative actions

Infants expect people to direct actions toward objects, and they respond to actions directed to themselves, but do they have expectations about actions directed to third parties? In two experiments, we used eye tracking to investigate 1- and 2-year-olds’ expectations about communicative actions addressed to a third party. Experiment 1 presented infants with videos where an adult (the Emitter) either uttered a sentence or produced non-speech sounds. The Emitter was either face-to-face with another adult (the Recipient) or the two were back-to-back. The Recipient did not respond to any of the sounds. We found that 2-, but not 1-year-olds looked quicker and longer at the Recipient following speech than non-speech, suggesting that they expected her to respond to speech. These effects were specific to the face-to-face context. Experiment 2 presented 1-year-olds with similar face-to-face exchanges but modified to engage infants and minimize task demands. The infants looked quicker to the Recipient following speech than non-speech, suggesting that they expected a response to speech. The study suggests that by 1 year of age infants expect communicative actions to be directed at a third-party listener.     

Representation and retention of three-event sequences in pigeons

The present experiments studied a three-event delayed sequence-discrimination (DSD) task: one arrangement (order) of two stimuli (red and yellow overhead lights) taken three in succession (e.g., red, yellow, red) was the positive sequence and the remaining seven arrangements were the negative sequences for responding and reward during the subsequent test stimulus. In Experiment 1, the final stimulus (recency) and the order of stimuli in the positive sequence controlled acquisition of discrimination. In Experiment 2, increasing the duration of memory intervals between stimuli reduced the discriminability of those negative sequences identical to the positive sequence after the delay. Three-event DSD performance in Experiments 1 and 2 was similar to two-event DSD performance in comparable published experiments. Models developed to explain pigeon performance in two-event DSD were extended to the three-event task. Results from both two- and three-event versions of the DSD task falsified a noncumulative model and several cumulative integration models (i.e., adding, averging, and some multiplying models), but corroborated one cumulative, multiplying model.     

Adding sound to lipread lists: The effects on serial recall of adding an auditory pulse train and a pure tone to silently lipread lists

These investigations examined subjects’ serial recall of lipread digit lists accompanied by an auditory pulse train. The pulse train indicated the pitch of voiced speech (buzz-speech) of the seen speaker as she was speaking. As a purely auditory signal, it could not support item identification. Such buzz-speech recall was compared with silent lipread list recall and with the recall of buzz-speech lists to which a pure tone had been added (buzz-and-beep lists). No significant difference in overall accuracy of recall emerged for the three types of lipread list; however, there were significant differences in the shape of the serial recall function for the three list types. Recency characterized the silent and the buzz-speech lists, and these lists differed in their varying susceptibilities to a range of speechlike suffixes. By contrast, adding a pure tone to a buzz-speech list (buzz-and-beep) produced little recency and no further recall loss as a function of suffix type. We discuss these effects with reference to the contrast betweensensory-similarity and speechlikeness accounts of auditory recency and suffix effects. Sensory similarity accounts cannot capture the effects reported here, but processing in a speech mode (buzz-and-beep) need not always lead to recency effects like those resulting from clearly heard or lipread lists.     

Speech perception and memory coding in relation to reading ability

Previous work has demonstrated that children who are poor readers have short-term memory deficits in tasks in which the stimuli lend themselves to phonetic coding. The aim of the present study was to explore whether the poor readers' memory dificit may have its origin in perception with the encoding of the stimuli. Three experiments were conducted with third grade good and poor readers. As in earlier experiments, the poor readers were found to perform less well on recall of random word strings and to be less affected by the phonetic characteristics (rhyming or not rhyming) of the items (Experiment 1). In addition, the poor readers produced more errors of transposition (in the nonrhyming strings) than did the good readers, a further indication of the poor readers' problems with memory for order. The subjects were tested on two auditory perception tasks, one employing words (Experiment 2) and the other nonspeech environmental sounds (Experiment 3). Each was presented under two conditions: with a favorable signal-to-noise ratio and with masking. The poor readers made significantly more errors than the good readers when listening to speech in noise, but did not differ in perception of speech without noise or in perception of nonspeech environmental sounds, whether noise-masked or not. Together, the results of the perception studies suggest that poor readers have a perceptual difficulty that is specific to speech. It is suggested that the short-term memory deficits characteristic of poor readers may stem from material-specific problems of perceptual processing.     

Speech, "inner speech," and the development of short-term memory: effects of picture labeling on recall

Three experiments explored the effect of overt speech on children's use of "inner speech' in short-term memory (STM). Experiments 1 and 2 compared recall of a series of pictured objects when 5- and 11-year-olds either labeled stimuli at presentation or remained silent. Use of inner speech was assessed by manipulating word length of the picture names (Experiment 1) or phonemic similarity (Experiment 2). Word length and phonemic similarity had greater effects in the older children and when pictures were labeled at presentation. These tendencies were such that 5-year-olds were sensitive to word length and phonemic similarity only with labeling. Experiment 3 compared labeling by the child with labeling by the experimenter in 5-year-olds. There were no significant differences with respect to overall performance or effects of word length and phonemic similarity. It is suggested that speaking or listening to speech activates and internal "articulatory loop,' and that such activation is especially important when the child's ability to use inner speech in STM has not fully developed.