Semantic priming effects on picture and word processing

The effects of semantic priming on picture and word processing were assessed under conditions in which subjects were required simply to identify stimuli (label pictures or read words) as rapidly as possible. Stimuli were presented in pairs (a prime followed by a target), with half of the pairs containing members of the same semantic category and half containing unrelated concepts. Semantic relatedness was found to facilitate the identification of both pictures (Experiment 1) and words (Experiment 2), and obtained interactions of semantic relatedness and stimulus quality in both experiments suggested that semantic priming affects the initial encoding of both types of stimuli. In Experiment 3, subjects received pairs of pictures, pairs of words, and mixed pairs composed of a picture and a word or of a word and a picture. Significant priming effects were obtained on mixed as well as unmixed pairs, supporting the assumption that pictures and words access semantic information from a common semantic store. Of primary interest was the significantly greater priming obtained in picture-picture pairs than in word-word or mixed pairs. This suggests that, in addition to priming that is mediated by the semantic system, priming may occur in picture-picture pairs that results from the overlap in visual features common to the pictorial representations of objects from the same semantic category.     

Encoding and memory for verbal and pictorial stimuli

Memory for visually presented verbal and pictorial material was compared using stimuli chosen to minimize non-essential differences between the two types of material. Experiment I required retention of a short list; verbal and pictorial stimuli were remembered equally well. Experiment II required recall of single items after 30 s of backwards counting; recall was much superior for pictorial stimuli. The type of task appeared to affect encoding, with verbal encoding reported to be predominant in Experiment I and visual encoding, or imagery, common in Experiment II.     

Comprehension and memory for pictures

The thesis advanced is that people remember nonsensical pictures much better if they comprehend what they are about. Two experiments supported this thesis. In the first, nonsensical "droodles" were studied by subjects with or without an accompanying verbal interpretation of the pictures. Free recall was much better for subjects receiving the interpretation during study. Also, a later recognition test showed that subjects receiving the interpretation rated as more similar to the original picture a distractor which was close to the prototype of the interpreted category. In Experiment II, subjects studied pairs of nonsensical pictures, with or without a linking interpretation provided. Subjects who heard a phrase identifying and interrelating the pictures of a pair showed greater associative recall and matching than subjects who received no interpretation. The results suggest that memory is aided whenever contextual cues arouse appropriate schemata into which the material to be learned can be fitted.     

Recall of common and distinctive features of verbal and pictorial stimuli

Subjects first rated similarity of verbal and of pictorial stimuli. The same pairs of stimuli were presented again, without one common component and one distinctive component. Subjects were asked to recall the missing components and identify them as common or distinctive. The results show that components encoded as common are recalled relatively better than components encoded as distinctive, and the difference in recall is significantly greater in verbal than in pictorial stimuli.     

“Aha” effects in the generation of pictures

An "aha" effect in memory was first reported by Auble, Franks, and Soraci (1979). They demonstrated that recall was greater for sentences that were initially incomprehensible but which were eventually comprehended, as compared with sentences that were understood from the outset. The present studies extend this "aha" effect to memory for pictorial stimuli. In Experiment 1, a recall advantage for pictures encoded by connecting the dots as compared with those encoded by tracing or visual scanning occurred only in the absence of foreknowledge of the picture (i.e., an "aha" effect). In Experiment 2, we replicated this finding and obtained evidence that conceptually based, verbal foreknowledge does not function in a similar manner as does pictorial foreknowledge in suppressing the "aha" recall advantage. These results place important constraints on previous research on generation effects for visual stimuli and attest to the cross-modal generalizability of the "aha" effect.     

Retrieval of Episodic Information From Memory: Comparisons Among 3- and 4-Year-Olds, 7- and 8-Year-Olds,and Adults

Young children's and adults' recall of episodic information was explored in 4 experiments. The task required participants to recall a target noun presented as the last item of a 4-noun string of related (either categorically or thematically) or unrelated words. Providing all 3 preceding nouns or a subset of them cued recall. Experiment 1 found that 7- and 8-year-old children's recall was better with pictures as opposed to text, and children showed performance equal to adults with thematically related pictorial stimuli. Using pictorial stimuli, Experiment 2 showed that the number of cues present at retrieval affected 7- and 8-year-olds' recall. Experiments 3 and 4 tested recall of episodic information in 3- and 4-year-olds using pictorial stimuli. The results suggested that young children also have access to episodic information in memory and the number of cues present at retrieval influenced recall. The findings are discussed in the context of children's memory for events.     

The picture superiority effect in associative recognition

The picture superiority effect has been well documented in tests of item recognition and recall. The present study shows that the picture superiority effect extends to associative recognition. In three experiments, students studied lists consisting of random pairs of concrete words and pairs of line drawings; then they discriminated between intact (old) and rearranged (new) pairs of words and pictures at test. The discrimination advantage for pictures over words was seen in a greater hit rate for intact picture pairs, but there was no difference in the false alarm rates for the two types of stimuli. That is, there was no mirror effect. The same pattern of results was found when the test pairs consisted of the verbal labels of the pictures shown at study (Experiment 4), indicating that the hit rate advantage for picture pairs represents an encoding benefit. The results have implications for theories of the picture superiority effect and models of associative recognition.     

Verbal and pictorial elaborations enhance memory in younger and older adults

Abstract

These studies examined the facilitative role of verbal and pictorial elaborations in younger and older adults' recall of verbal material. During acquisition, subjects studied short sentences under one of several encoding/retrieval conditions where the presence of verbal and pictorial elaborations was systematically varied. Subjects later recalled the target adjectives, given the sentence frames as a prompt. In Experiment 1, explanatory verbal elaborations at study and test enhanced verbal recall for both age groups, but no benefit of pictorial elaborations was observed. In Experiment 2, pictorial elaborations improved recall for both age groups. A significant Age x Encoding Condition interaction effect revealed that the benefit was especially pronounced for the older adults. the implications of these results for understanding the facilitative effects of pictorial illustrations on older adults. recall of verbal material are discussed.     

Learning 10000 pictures

Four experiments are reported which examined memory capacity and retrieval speed for pictures and for words. Single-trial learning tasks were employed throughout, with memory performance assessed by forced-choice recognition, recall measures or choice reaction-time tasks. The main experimental findings were: (1) memory capacity, as a function of the amount of material presented, follows a general power law with a characteristic exponent for each task; (2) pictorial material obeys this power law and shows an overall superiority to verbal material. The capacity of recognition memory for pictures is almost limitless, when measured under appropriate conditions; (3) when the recognition task is made harder by using more alternatives, memory capacity stays constant and the superiority of pictures is maintained; (4) picture memory also exceeds verbal memory in terms of verbal recall; comparable recognition/recall ratios are obtained for pictures, words and nonsense syllables; (5) verbal memory shows a higher retrieval speed than picture memory, as inferred from reaction-time measures. Both types of material obey a power law, when reaction-time is measured for various sizes of learning set, and both show very rapid rates of memory search.

From a consideration of the experimental results and other data it is concluded that the superiority of the pictorial mode in recognition and free recall learning tasks is well established and cannot be attributed to methodological artifact.     

Manipulating cues in involuntary autobiographical memory: Verbal cues are more effective than pictorial cues

In two experiments, pictorial cues were compared with their verbal labels to assess their effectiveness in eliciting involuntary autobiographical memories. Cues were relatively complex in Experiment 1 (e.g., relaxing on a beach) and simple objects in Experiment 2 (e.g., a ball). In both experiments, participants went through a vigilance task in which they were presented with frequent nontarget and rare target visual stimuli. Pictures or their corresponding verbal labels were also displayed on both target and nontarget stimuli, but participants were told that these were irrelevant to the task. They were asked to interrupt the vigilance task whenever they became aware of task-unrelated mental contents and to report them. In both experiments, more involuntary memories were elicited in the verbal cue condition, rather than in the pictorial cue condition. This result is discussed in relation to previous work that highlighted the greater effectiveness of verbal cues in memory tasks.     

Mental comparisons involving abstract attributes

Adult subjects in two experiments were presented pairs of stimuli that differed in varying degree on an abstract semantic attribute, and were required to choose the one with the higher value on the given dimension. Subjects in Experiment 1 chose the more pleasant member of a pair of pictures, concrete nouns, or abstract nouns. Those in Experiment 2, presented a pair of pictures or concrete nouns, chose the one whose referent had the higher monetary value. Theoretical interest centered on the effects of semantic distance, stimulus mode, and individual differences in imagery and verbal ability on choice time. In both experiments, response times (1) decreased with increases in semantic distance, (2) were faster for pictures than words (and for concrete than abstract words in Experiment 1), and (3) were faster for high- than for lowimagery participants. The results are completely consistent with a dual-coding (image vs. verbal) interpretation: Pleasantness and value, though conceptually abstract, are attributes of things rather than words, and they are accordingly represented in and processed by a system specialized for dealing with nonverbal information.     

Semantic and visual memory codes in learning disabled readers

Two experiments investigated whether learning disabled readers' impaired recall is due to multiple coding deficiencies. In Experiment 1, learning disabled and skilled readers viewed nonsense pictures without names or with either relevant or irrelevant names with respect to the distinctive characteristics of the picture. Both types of names improved recall of nondisabled readers, while learning disabled readers exhibited better recall for unnamed pictures. No significant difference in recall was found between name training (relevant, irrelevant) conditions within reading groups. In Experiment 2, both reading groups participated in recall training for complex visual forms labeled with unrelated words, hierarchically related words, or without labels. A subsequent reproduction transfer task showed a facilitation in performance in skilled readers due to labeling, with learning disabled readers exhibiting better reproduction for unnamed pictures. Measures of output organization (clustering) indicated that recall is related to the development of superordinate categories. The results suggest that learning disabled children's reading difficulties are due to an inability to activate a semantic representation that interconnects visual and verbal codes.     

Faster might not be better: Pictures may not elicit a stronger unconscious priming effect than words when modulated by semantic similarity

It has been suggested that unconscious semantic processing is stimulus-dependent, and that pictures might have privileged access to semantic content. Those findings led to the hypothesis that unconscious semantic priming effect for pictorial stimuli would be stronger as compared to verbal stimuli. This effect was tested on pictures and words by manipulating the semantic similarity between the prime and target stimuli. Participants performed a masked priming categorization task for either words or pictures with three semantic similarity conditions: strongly similar, weakly similar, and non-similar. Significant differences in reaction times were only found between strongly similar and non-similar and between weakly similar and non-similar, for both pictures and words, with faster overall responses for pictures as compared to words. Nevertheless, pictures showed no superior priming effect over words. This could suggest the hypothesis that even though semantic processing is faster for pictures, this does not imply a stronger unconscious priming effect.     

Exploring the superadditive effects of scent and pictures on verbal recall: An extension of dual coding theory

This research extends the dual coding theory of memory retrieval (Paivio 1969, 2007) beyond its traditional focus on verbal and pictorial information to olfactory information. We manipulate the presence or absence of olfactory and pictorial stimuli at the time of encoding (study 1) or retrieval (study 2) and measure the impact on verbal recall. After a time delay, scent enhances recall of verbal information, and scent-based retrieval cues potentiate the facilitative effect of pictures on recall. These results cannot be attributed merely to increased elaboration at the time of exposure.     

Event-related potentials and the semantic matching of pictures

Event-related potentials (ERPs) were recorded from one midline and three pairs of lateral electrodes while subjects determined whether pairs of sequentially presented pictures were semantically associated. The ERPs evoked by the second picture of each pair differed as a consequence of whether it was associated with its predecessor, such that ERPs to nonassociated pictures were more negative-going than those to associated items. These differences resulted from the modulation of two ERP components, one frontally distributed and centered on an N300 deflection, the other distributed more widely over the scalp and encompassing an N450 deflection. The modulation of N450 is interpreted as further evidence that the "N400" ERP component is sensitive to semantic relationships between nonverbal stimuli. The earlier N300 effects, which do not appear to occur when ERPs are evoked by semantically primed and unprimed words, could suggest that the semantic processing of pictorial stimuli involves neural systems different from those associated with the semantic processing of words.     

Picture superiority in free recall: The effects of organization and elaboration

A conception of semantic memory structure is presented in which elaboration is considered to vary both between and within items. Pictures and their verbal labels are suggested to activate common abstract memory representations, but these activations will differ in their degree of within-item elaboration. However, pictures and words should show comparable between-item elaboration properties, such as might be revealed by the category-recall relationship and clustering in free recall. Children were presented pictures and words in either a category-recall situation, where between-item elaboration was emphasized, or in a control situation where between-item elaboration was minimized. No differences between pictures and words in either recall or clustering were found in the category-recall task. However, when the same items were presented in the control situation the typical picture superiority effect in free recall was found. The results are interpreted as consistent with a two-factor theory of semantic elaboration, and indicate that these basic properties of memory encoding hold even for young children.     

Memory for modality of presentation: Within-modality discrimination

Two experiments demonstrated that Ss are capable of making within-modality memory discriminations in both visual and auditory modalities. In Experiment I Ss studied mixed lists of pictures and labels representing common objects and were subsequently required to judge whether the original presentation was pictorial or verbal The high level of performance achieved on this task was unaffected by degree of categorical relatedness of items within method of presentation or by instructions to produce visual images when items were presented verbally. In Experiment II Ss demonstrated the ability to remember whether a sentence was originally presented by a male or a female speaker. Some strategies by which within-modality discrimination in memory might be accomplished are discussed.     

Encoding specificity in the recall of pictures and words in children and adults

In this study, the modality of the retrieval cues (pictures or words) was varied in a cued recall task to determine how second and fourth grade children and college adults encode words (Experiment 1) and pictures (Experiment 2). According to the assumptions of the encoding specificity principle, cue modality should affect recall only to the degree to which subjects focus on modality specific (sensory) rather than nonmodality specific (semantic) information in stimuli. In both experiments, the results showed progressively smaller encoding specificity effects with increasing age. To ensure that differences in encoding activity were responsible for these effects, comparisons were made of recall patterns under intentional learn conditions, and under incidental conceptual and sensory orienting conditions. The recall patterns of the children in the conceptual orienting condition were similar to the adult patterns in the learn condition, and the adult recall patterns in the sensory orienting conditions were similar to those of the children in the learn conditions. These results suggest that there are developmental differences in encoding the sensory and semantic information in stimuli that may result from differences in the efficiency with which the semantic information in stimuli is processed. The results suggest that young children typically encode stimuli in a fashion that stresses the sensory aspects of the stimuli, and that recall suffers as a result.