Hemispheric processing asymmetries: implications for memory

Recent research has demonstrated that memory for words elicits left hemisphere activation, faces right hemisphere activation, and nameable objects bilateral activation. This pattern of results was attributed to dual coding of information, with the left hemisphere employing a verbal code and the right a nonverbal code. Nameable objects can be encoded either verbally or nonverbally and this accounts for their bilateral activation. We investigated this hypothesis in a callosotomy patient. Consistent with dual coding, the left hemisphere was superior to the right in memory for words, whereas the right was superior for faces. Contrary to prediction, performance on nameable pictures was not equivalent in the two hemispheres, but rather resulted in a right hemisphere superiority. In addition, memory for pictures was significantly better than for either words or faces. These findings suggest that the dual code hypothesis is an oversimplification of the processing capabilities of the two hemispheres.     

Storage and retrieval properties of dual codes for pictures and words in recognition memory.

Storage and retrieval properties of pictures and words were studied within a recognition memory paradigm. Storage was manipulated by instructing subjects either to image or to verbalize to both picture and word stimuli during the study sequence. Retrieval was manipulated by representing a proportion of the old picture and word items in their opposite form during the recognition test (i.e., some old pictures were tested with their corresponding words and vice versa). Recognition performance for pictures was identical under the two instructional conditions, whereas recognition performance for words was markedly superior under the imagery instruction condition. It was suggested that subjects may engage in dual coding of simple pictures naturally, regardless of instructions, whereas dual coding of words may occur only under imagery instructions. The form of the test item had no effect on recognition performance for either type of stimulus and under either instructional condition. However, change of form of the test item markedly reduced item-by-item correlations between the two instructional conditions. It is tentatively proposed that retrieval is required in recognition, but that the effect of a form change is simply to make the retrieval process less consistent, not less efficient.     

Visual imagery ability and the recognition of verbal and nonverbal stimuli.

High and low visual imagers, defined as such primarily on the basis of spatial manipulation test performance, were required to identify tachistoscopically-presented pictures, concrete words, and abstract words varying in familiarity. Two recognition paradigms were employed, recognition threshold and recognition latency. High imagers were faster in picture recognition under both paradigms when a nonverbal set or strategy was primed and when pictures were relatively unfamiliar in the threshold paradigm. No relationship was found between imagery ability and word recognition in the visual modality, nor was visual imagery ability related to the auditory recognition of verbal and nonverbal stimuli, such as words and environmental sounds. Commonalities between these findings and others in the imagery ability literature were noted.     

Beneficial Effect of Pictures on False Memory in the DRMRS Procedure

Using the Deese-Roediger-McDermott-Read-Solso (DRMRS) procedure in which list items are shown that are semantically related to a central theme that is not presented, undergraduates (N?=?61) studied either short or long lists in the form of auditory words alone, pictures alone, or pictures accompanied by auditory words. Correct recall and correct recognition scores were similar in all three conditions. However, false memory (reporting the non-presented central theme) was reduced with pictures alone compared to words alone for the recall task, and for the recognition task with short lists. Confidence was higher for correct recall and correct recognition than for false recall and false recognition, but people who were higher or lower in confidence did not differ on any memory measure. Theoretical and practical implications of these results are discussed.     

Lending a hand to signed language acquisition: Enactment and iconicity enhance sign recall in hearing adult American Sign Language learners

Abstract

Evidence over the last 15 years has suggested that dual (imagery and verbal) coding explanations of concreteness effects in memory for word lists do not generalise well to memory for sentences and paragraphs. In contrast, an alternative framework based on relative differences in relational and distinctive processing has been shown to account for the effects of imagery and concreteness in these contexts and others. This paper describes recent research on free and cued recall of word lists and evaluates it with respect to the two models. The evidence suggests that whereas dual processing systems may be involved in the encoding of verbal materials, dual memory codes are insufficient to explain concreteness effects in recall. Better memory for high-as compared to low-imagery words depends on the use of paradigms that facilitate inter-item relational processing, independent of whether or not imagery is involved.     

How are pictures registered in memory?

Three experiments tested the hypothesis that pictorial memory is much less dependent on rehearsal than is verbal memory. Experiment I examined incidental learning since this is assumed to reflect learning with little or no rehearsal. Following a classification task, intentional and incidental learning for pictures and for words was compared. The superiority of pictorial memory was especially marked in incidental learning. Experiment II showed that this result was not due to differences in the amount of processing required to classify pictures and words. RTs to classify words and pictures did not differ, and incidental learning was again superior for pictures. In Experiment III rehearsal opportunity was restricted by a concurrent task during presentation of word and picture lists, and the decrement was very much greater for word learning than for picture learning. It was concluded that manipulation of rehearsal opportunity has relatively little effect on pictorial memory.     

Verbal and nonverbal recognition memory in aphasic and nonaphasic stroke patients

The ability to retain lists of verbal and nonverbalizable items across recurrent recognition tasks was tested in three groups: (1) stroke patients with a left-brain lesion and aphasia, (2) stroke patients with a right-brain lesion and left hemiplegia, and (3) nonneurologically impaired outpatients. As determined with signal detection measures, aphasics were deficient in discriminating words that were to be remembered from those that were not; their recognition of nonverbal visual (geometric art) or auditory (bird calls) patterns, however, was unimpaired. Left hemiplegics showed the opposite pattern. After a long-term interval (<10 min), correct recognition of words was diminished in all groups whereas recognition of visual patterns increased. Both groups of stroke patients adopted material-specific decision criteria which in part accounted for the dissociation of verbal and nonverbal recognition memory by laterality of lesion. Item analysis indicated that aphasics' verbal memory difficulties were affected by acoustic-semantic confusion of list words.     

Verbal imagery and connotation as memory-induced mediators of aggressive behavior.

Three studies investigated the effects of an information-processing variable (imagery-concreteness) on susceptibility to aggressive stimulation. Study 1 (n=83) results indicated that subjects' rating of imagery level and aggressive connotation for words can be manipulated independently. In study 2 (n=64), manipulations of verbal connotation and verbal imagery indicated that imagery level but not aggressive connotation significantly influenced the delayed recall of the verbal material. In Study 3 (n=60), males in a 2 X 2 between-subjects factorial design first learned lists of words varying in imagery (high or low) and verbal connotation (aggressive or neutral). Next, subjects were given the opportunity to shock their partners as part of a sham learning task. To induce arousal, all subjects learning high-imagery-aggressive word lists delivered significantly more intense shock to their partners. The results were interpreted as supporting an information-processing (memory) analysis of the effects of exposure to aggressive material.     

The hippocampus and memory of verbal and pictorial material

Recognition of words and kaleidoscope pictures showed a double dissociation of left and right hippocampal activity using magnetic source imaging (MSI). MSI has advantages over alternative imaging techniques that measure hemodynamic changes for identifying regional changes in brain activity in real time and on an individual subject basis without the need for image subtraction. In this study, lists of words or kaleidoscope pictures were presented for memorization followed by tests of list items and foils during which brain activity was recorded. There was greater activation in the left than the right hippocampus with abstract nouns (e.g., relief) and greater activation in the right than the left hippocampus with kaleidoscope pictures. This dissociation was evident on a case by case basis. This study demonstrates the specialization of the two medial temporal lobe (MTL) regions, including the hippocampi, for mnemonic processing of verbal and pictorial items that are difficult to encode verbally.     

Effects of Word Processing and Short-term Memory Deficits on Verbal Learning: Evidence from Aphasia

We report two experiments that investigate the abilities of aphasic subjects with lexical and short-term memory impairments to learn supraspan lists of 10 words. We examined effects of stimulus factors (characteristics of words and lists to be learned) and subject factors (verbal and nonverbal STM span, nature of language impairment). Learning ability was influenced by the imageability and frequency of the words to be learned (Experiment 1) and by the linguistic relationship among words in a list (Experiment 2). Additionally, learning ability was affected by the nature of a subject's word processing deficit (whether it involved semantic and/or phonological processes). Phonological ability was positively associated with learning in both experiments, and semantic ability was associated with learning when words in a list were high in both frequency and imageability (Experiment 1) or were contextually related to one another (Experiment 2). Finally, verbal STM span was positively related to learning performance, but the effect was more pronounced for word span than digit span. These relationships among word processing ability, verbal STM span, and learning ability are discussed with reference to learning in aphasia and to models of learning more generally.     

The effect of presentation format and encoding strategy on associative memory distortion

IntroductionPrevious studies using semantically related words revealed more accurate memory when the items were encoded visually rather than auditorily and when mental images were created during encoding. However, how the level of memory distortion is affected by the creation of different mental imagery formats or by techniques that should suppress generation of mental images has rarely been investigated.ObjectiveThe aim of the present studies was to investigate the ways in which the encoding strategy affects the accuracy of memory reports for two presentation formats of semantically related words: verbal and pictorial.MethodIn experiment 1, the participants were asked to memorize either pictures or their verbal equivalents (words) from the same category, using one of two encoding strategies: uttering the words or counting backwards. In experiment 2, pictorially or auditory presented material was encoded together with the creation of either visual or auditory mental images of the items. The results of the experimental groups were compared to control groups that received no specific instruction.ResultsHigher levels of false recognition, together with lower rates of correct recognition, were observed for words, presented either visually or auditory, relative to pictures. Moreover, self-generation of additional code during the processing of information favored the reduction of false recognitions.ConclusionEncoding strategies that engaged dual coding reduced false recognition. The results are discussed within the distinctiveness heuristic phenomenon.     

Developmental changes in the semantic processing of pictures and words

Second- and fifth-graders' semantic decision times for pictures and words were analyzed relative to the predictions derived from unitary- and dual-memory models. At both grade levels, word-word response latencies were greater than picture-word latencies which, in turn, were greater than picture-picture latencies. An interaction between Grade and Condition indicated that verbal access times decreased more than pictorial access times. The data fit the predictions of a memory model postulating category storage in a single memory system as opposed to simultaneous representation in verbal and nonverbal memory systems. It was concluded that with increasing experience verbal access to this single semantic system is more rapid.     

Verbal and Nonverbal Emotional Memory Following Unilateral Amygdala Damage

The amygdala is involved in the normal facilitation of memory by emotion, but the separate contributions of the left and right amygdala to memory for verbal or nonverbal emotional material have not been investigated. Fourteen patients with damage to the medial temporal lobe including the amygdala (seven left, seven right), 18 brain-damaged, and 36 normal controls were exposed to emotional and neutral pictures accompanied by verbal narratives. Memory for both narratives and pictures was assessed with a free recall test 24 h later. Subjects with left amygdala damage failed to show the normally robust enhancement of memory for verbal and nonverbal emotional stimuli. The group with right amygdala damage showed the normal pattern of facilitation of memory by emotion for both verbal and nonverbal stimuli despite an overall reduction in memory performance. Furthermore, subjects with left amygdala damage were disproportionately impaired on memory for emotional narratives as compared with memory for emotional pictures. The latter finding offers partial support for a lateralized and material-specific pattern of the amygdala's contribution to emotional memory.     

Age-related changes in verbal and nonverbal memory during early childhood

In the present experiment, age-related changes in verbal and nonverbal memory performance by 2- to 4-year-old children were assessed. All children participated in the same unique event, and their memory of that event was assessed after a 24-hr delay. Overall, children's performance on each memory measure increased as a function of age. Furthermore, children's performance on both the verbal and nonverbal memory tests was related to their language ability; children with more advanced language skills reported more during the verbal interview and exhibited superior nonverbal memory relative to children with less advanced language skills. Finally, children's verbal recall of the event lagged behind both their nonverbal recall and their general verbal skill. It is hypothesized that despite large strides in language acquisition. preschool-age children continue to rely primarily on nonverbal representations of past events. The findings have important implications for the phenomenon of childhood amnesia.     

French norms of imagery for pictures, for concrete and abstract words]

This paper deals with French norms for mental image versus picture agreement for 138 pictures and the imagery value for 138 concrete words and 69 abstract words. The pictures were selected from Snodgrass et Vanderwart's norms (1980). The concrete words correspond to the dominant naming response to the pictorial stimuli. The abstract words were taken from verbal associative norms published by Ferrand (2001). The norms were established according to two variables: 1) mental image vs. picture agreement, and 2) imagery value of words. Three other variables were controlled: 1) picture naming agreement; 2) familiarity of objects referred to in the pictures and the concrete words, and 3) subjective verbal frequency of words. The originality of this work is to provide French imagery norms for the three kinds of stimuli usually compared in research on dual coding. Moreover, these studies focus on figurative and verbal stimuli variations in visual imagery processes.     

Asymmetric interference between domains: evidence from the stimulus order effect in complex span tasks

The stimulus order effect refers to the finding that recall in complex span tasks is better when span lists begin with a longer processing task and end with a shorter task than when these processing tasks are presented in the reverse order. This study independently manipulated processing time and processing difficulty between Long-final and Short-final lists. The processing task required participants to solve arithmetic problems with either verbal (Experiment 1) or visuospatial (Experiment 2) materials. The memory items used in the storage task were either digits (verbal material) or dots-in-matrices (visuospatial materials). Storage of both verbal and visuospatial materials was sensitive to the change in processing difficulty, but not processing time. Furthermore, this study provides further evidence for the asymmetry of domain interference in working memory. The similarities and differences between verbal and visuospatial storage in working memory are discussed.     

Mental comparisons involving abstract attributes

Adult subjects in two experiments were presented pairs of stimuli that differed in varying degree on an abstract semantic attribute, and were required to choose the one with the higher value on the given dimension. Subjects in Experiment 1 chose the more pleasant member of a pair of pictures, concrete nouns, or abstract nouns. Those in Experiment 2, presented a pair of pictures or concrete nouns, chose the one whose referent had the higher monetary value. Theoretical interest centered on the effects of semantic distance, stimulus mode, and individual differences in imagery and verbal ability on choice time. In both experiments, response times (1) decreased with increases in semantic distance, (2) were faster for pictures than words (and for concrete than abstract words in Experiment 1), and (3) were faster for high- than for lowimagery participants. The results are completely consistent with a dual-coding (image vs. verbal) interpretation: Pleasantness and value, though conceptually abstract, are attributes of things rather than words, and they are accordingly represented in and processed by a system specialized for dealing with nonverbal information.     

Picture superiority in free recall: The effects of organization and elaboration

A conception of semantic memory structure is presented in which elaboration is considered to vary both between and within items. Pictures and their verbal labels are suggested to activate common abstract memory representations, but these activations will differ in their degree of within-item elaboration. However, pictures and words should show comparable between-item elaboration properties, such as might be revealed by the category-recall relationship and clustering in free recall. Children were presented pictures and words in either a category-recall situation, where between-item elaboration was emphasized, or in a control situation where between-item elaboration was minimized. No differences between pictures and words in either recall or clustering were found in the category-recall task. However, when the same items were presented in the control situation the typical picture superiority effect in free recall was found. The results are interpreted as consistent with a two-factor theory of semantic elaboration, and indicate that these basic properties of memory encoding hold even for young children.     

Recognition hypermnesia: How to get it

Although recall hypermnesia (enhanced recall) over time with repeated testing has by now become an established empirical fact, its recognition counterpart, recognition hypermnesia, has defied clear-cut laboratory confirmation. In four studies, which relied on the retrieval component of recognition memory, it was shown that recognition memory, indexed by d′, reliably improved over three successive recognition tests. The stimuli consisted of 140 cartoons, each comprising a picture and a verbal caption. Recognition memory was tested on transforms or part-forms (parts) of the original stimulus material (pictures only, verbal paraphrases of the pictures, the latent content of the cartoons, or the combination of paraphrases and latent contents). The strongest effects were obtained when the originally presented cartoons were tested on their latent (deep semantic) contents. Recognition hypermnesia for part-forms or transforms of earlier presented stimuli has potentially wide-ranging implications since real-world recognition—of faces, texts, visual scenes—usually involves recognising stimuli that are variants, not exact copies, of the originally encountered materials.     

Spatial information with pictures and words in visual short-term memory

In a delayed matching task, the influence of spatial congruence between study and test on visual short-term memory for geometric figures and words was investigated. Subjects processed series of pictures which showed three words or three geometric figures arranged as rows or as triangular configurations. At test, the elements were presented in the identical or in the alternative configuration as at study. In the non-matching case, one of the studied elements was exchanged. The delay was 5 s. Subjects judged whether the elements were the same as during study, independent of their configuration. In Exp. 1, pictures of figures and words were mixed within one list. For both modalities, the response times were longer if the configuration at test was incongruent to the one at study. This contradicts the results of Santa, who observed effects of spatial congruency for figures, but not for words. In Exp. 2 we therefore presented the same material as in Exp. 1, but now the lists were modality-pure, as in the experiment of Santa – i.e., words and figures were shown in different lists. This time, spatial incongruency impaired recognition of the figures, but not recognition of the words. These results show that in a non-verbal context, isolated visually presented words are spatially encoded as non-verbal stimuli (figures) are. However, the word stimuli are encoded differently if the task is a pure verbal one. In the latter case, spatial information is discarded. Received: 9 September 1997 / Accepted: 30 March 1998