The picture superiority effect in associative recognition

The picture superiority effect has been well documented in tests of item recognition and recall. The present study shows that the picture superiority effect extends to associative recognition. In three experiments, students studied lists consisting of random pairs of concrete words and pairs of line drawings; then they discriminated between intact (old) and rearranged (new) pairs of words and pictures at test. The discrimination advantage for pictures over words was seen in a greater hit rate for intact picture pairs, but there was no difference in the false alarm rates for the two types of stimuli. That is, there was no mirror effect. The same pattern of results was found when the test pairs consisted of the verbal labels of the pictures shown at study (Experiment 4), indicating that the hit rate advantage for picture pairs represents an encoding benefit. The results have implications for theories of the picture superiority effect and models of associative recognition.     

Storage and retrieval properties of dual codes for pictures and words in recognition memory.

Storage and retrieval properties of pictures and words were studied within a recognition memory paradigm. Storage was manipulated by instructing subjects either to image or to verbalize to both picture and word stimuli during the study sequence. Retrieval was manipulated by representing a proportion of the old picture and word items in their opposite form during the recognition test (i.e., some old pictures were tested with their corresponding words and vice versa). Recognition performance for pictures was identical under the two instructional conditions, whereas recognition performance for words was markedly superior under the imagery instruction condition. It was suggested that subjects may engage in dual coding of simple pictures naturally, regardless of instructions, whereas dual coding of words may occur only under imagery instructions. The form of the test item had no effect on recognition performance for either type of stimulus and under either instructional condition. However, change of form of the test item markedly reduced item-by-item correlations between the two instructional conditions. It is tentatively proposed that retrieval is required in recognition, but that the effect of a form change is simply to make the retrieval process less consistent, not less efficient.     

The picture superiority effect in recognition memory: A developmental study using the response signal procedure

Items studied as pictures are better remembered than items studied as words even when test items are presented as words. The present study examined the development of this picture superiority effect in recognition memory. Four groups ranging in age from 7 to 20 years participated. They studied words and pictures, with test stimuli always presented as words, and time to respond to test stimuli was manipulated. The picture superiority effect showed a clear developmental trend. In the condition in which participants had ample response time, a significant picture superiority effect appeared in all but the youngest group. With short response time, a significant picture superiority effect appeared only among 11- and 20-year-old groups, while a significant reverse of the picture superiority effect was detected in the youngest group. These results were interpreted as suggesting that different memory processes (familiarity and recollection) contribute differently to the picture superiority effect at different stages of development.     

The fate of originally presented surface information following recall errors in sentence memory tasks

Pictures are remembered better than their names. This picture superiority effect in episodic memory has been attributed either to the greater sensory distinctiveness of pictures or to their greater conceptual distinctiveness. Weldon and Coyote (1996) tested the conceptual distinctiveness hypothesis by comparing how well pictures as opposed to words primed in two conceptual implicit memory tasks (category production and word association). They found no picture superiority in priming and concluded that the basis of the picture superiority effect must then be pictures' greater sensory distinctiveness. Using the same logic, we compared how well pictures as opposed to words primed in a perceptual implicit memory task (picture and word fragment identification). The sensory distinctiveness theory would predict that pictures should prime picture fragment identification better than words prime word fragment identification, a result we call the picture superiority in within-form priming. Across three experiments which manipulated the encoding task at study, only one showed picture superiority in within-form priming. In contrast, in all three experiments there was robust picture superiority in recall, and exposure to pictures and words at study and test produced independent effects in which both study and test exposure to pictures was more effective for recall than exposure to words. We consider how these results might be reconciled by differences in retrieval demands between recall and fragment identification.     

The picture superiority effect in a cross-modality recognition task

Words and pictures were studied, and recognition tests were given in which each studied object was to be recognized in both word and picture format. The main dependent variable was the latency of the recognition decision. The purpose was to investigate the effects of study modality (word or picture), of congruence between study and test modalities, and of priming resulting from repeated testing. Experiments 1 and 2 used the same basic design, but the latter also varied retention interval. Experiment 3 added a manipulation of instructions to name studied objects, and Experiment 4 deviated from the others by presenting both picture and word referring to the same object together for study. The results showed that congruence between study and test modalities consistently facilitated recognition. Furthermore, items studied as pictures were more rapidly recognized than were items studied as words. With repeated testing, the second instance was affected by its predecessor, but the facilitating effect of picture-to-word priming exceeded that of word-to-picture priming. The findings suggest a two-stage recognition process, in which the first is based on perceptual familiarity and the second uses semantic links for a retrieval search. Common-code theories that grant privileged access to the semantic code for pictures or, alternatively, dual-code theories that assume mnemonic superiority for the image code are supported by the findings. Explanations of the picture superiority effect as resulting from dual encoding of pictures are not supported by the data.     

感知觉加工与概念加工对联结记忆中图片优势效应的影响

本研究采用联结再认范式考察联结记忆中感知觉水平和概念加工程度对图片优势效应的影响。实验1通过呈现清晰或模糊的词语或图片对操纵了感知觉水平,结果发现只有在清晰条件下图片优势效应才会出现;实验2则在模糊条件下通过要求被试想象两个项目之间的关系操纵了概念加工程度,结果发现在有概念加工条件下,出现了图片优势效应。研究结果表明：（1）降低的感知觉水平会导致联结记忆中的图片优势效应消失;（2）对模糊项目对进行概念加工会使联结记忆中出现图片优势效应。     

Picture superiority in conceptual memory: Dissociative effects of encoding and retrieval tasks

We examined the role of encoding processes for picture superiority in explicit and conceptual-implicit memory. The nature of encoding instruction (naming or semantic categorization) yielded dissociative effects on picture and word memory on one explicit test, category-cued recall, and two conceptual-implicit tests, category-cued generation and category-cued verification. Category-cued recall was greater for pictures than for words following naming, but it did not differ for pictures and words following semantic categorization. Category-cued generation priming was greater for pictures than for words following naming, but it was greater for words than for pictures following semantic categorization. In contrast, category-cued verification priming did not differ for pictures and words following either naming or semantic categorization. Thus, picture superiority can be eliminated or reversed depending on the type of conceptual encoding task and conceptual-retrieval test.     

Physical and conceptual priming effects on picture and word identification

In the study phase of these experiments, subjects were asked to think of an item suggested by the omission in an incomplete sentence, and then look at a picture or word describing an item and say whether it was the same as theirs. In the test phase, they were asked to identify studied and nonstudied items presented briefly in either picture or word form. Subjects were then required to recall the words or pictures shown in the study phase. Experiment 1, with a within-subjects design, revealed that the studied pictures were identified more readily than studied words and nonstudied pictures. This indicates a physical priming effect. In word identification, studied words were identified more readily than nonstudied words; however, there was no difference between studied words and studied pictures, and the performance for studied pictures and nonstudied items were largely the same. The physical priming effect on picture identification was also shown in Experiment 2, with a between-subjects design. Different processing mechanisms in picture and word identification are discussed.     

Eye-closure & the retrieval of item-specific information in recognition memory

Two experiments investigated the effect of eye-closure on visual and auditory memory under conditions based on the retrieval of item-specific information. Experiment 1 investigated visual recognition memory for studied, perceptually similar and unrelated items. It was found that intermittent eye-closure increased memory for studied items and decreased memory for related items. This finding was reflected by enhanced item-specific and reduced gist memory. Experiment 2 used the Deese-Roediger-McDermott (DRM) paradigm to assess auditory recognition memory for studied, related and unrelated words that had (vs. had not) been accompanied by pictures during encoding. Pictures but not eye-closure produced a picture superiority effect by enhancing memory for studied items. False memory was reduced by pictures but not eye-closure. Methodological and theoretical considerations are discussed in relation to existing explanations of eye-closure and retrieval strategies.     

The picture-superiority effect in category-association tests

In two experiments we examined the picture-superiority effect in the framework of the transfer-appropriate processing approach recently advocated by Roediger, Weldon, and Challis (1989). For the first time conceptual implicit-memory task is used, i.e., category association. In Experiment 1, subjects study a mixed list of pictures and words and then receive either a category-association test or a category-cued recall test, followed by a recognition test. The results show that performance on category-cued recall, recognition, and category-association tests are better when the material is studied in picture format. In Experiment 2, we show that producing a sentence with the material studied (picture or word) eliminates the picture-superiority effect in the implicit test, but does not eliminate picture superiority in the category-cued recall test. These results suggest that conceptually driven processing plays a critical role in category association and explicit tests of memory. The results are discussed in the framework of the transfer-appropriate processing approach to memory.     

Levels of processing and picture memory: the physical superiority effect

Six experiments studied the effect of physical orienting questions (e.g., "Is this angular?") and semantic orienting questions (e.g., "Is this edible?") on memory for unrelated pictures at stimulus durations ranging from 125-2,000 ms. Results ran contrary to the semantic superiority "rule of thumb," which is based primarily on verbal memory experiments. Physical questions were associated with better free recall and cued recall of a diverse set of visual scenes (Experiments 1, 2, and 4). This occurred both when general and highly specific semantic questions were used (Experiments 1 and 2). Similar results were obtained when more simplistic visual stimuli--photographs of single objects--were used (Experiments 5 and 6). As in the case of the semantic superiority effect with words, the physical superiority effect for pictures was eliminated or reversed when the same physical questions were repeated throughout the session (Experiments 4 and 6). Conflicts with results of previous levels of processing experiments with words and nonverbal stimuli (e.g., faces) are explained in terms of the sensory-semantic model (Nelson, Reed, & McEvoy, 1977). Implications for picture memory research and the levels of processing viewpoint are discussed.     

A comparison of conscious and automatic memory processes for picture and word stimuli: a process dissociation analysis

Four experiments were conducted to evaluate explanations of picture superiority effects previously found for several tasks. In a process dissociation procedure (Jacoby, 1991) with word stem completion, picture fragment completion, and category production tasks, conscious and automatic memory processes were compared for studied pictures and words with an independent retrieval model and a generate-source model. The predictions of a transfer appropriate processing account of picture superiority were tested and validated in "process pure" latent measures of conscious and unconscious, or automatic and source, memory processes. Results from both model fits verified that pictures had a conceptual (conscious/source) processing advantage over words for all tasks. The effects of perceptual (automatic/word generation) compatibility depended on task type, with pictorial tasks favoring pictures and linguistic tasks favoring words. Results show support for an explanation of the picture superiority effect that involves an interaction of encoding and retrieval processes.     

Reversing the picture superiority effect: A speed—accuracy trade-off study of recognition memory

Speed-accuracy trade-off methods have been used to contrast single- and dual-process accounts of recognition memory. With these procedures, subjects are presented with individual test items and required to make recognition decisions under various time constraints. In three experiments, we presented words and pictures to be intentionally learned; test stimuli were always visually presented words. At test, we manipulated the interval between the presentation of each test stimulus and that of a response signal, thus controlling the amount of time available to retrieve target information. The standard picture superiority effect was significant in long response deadline conditions (i.e., > or = 2,000 msec). Conversely, a significant reverse picture superiority effect emerged at short response-signal deadlines (< 200 msec). The results are congruent with views suggesting that both fast familiarity and slower recollection processes contribute to recognition memory. Alternative accounts are also discussed.     

SCALING THE EPISODIC FAMILIARITIES OF PICTURES AND WORDS

Abstract— Most current memory theories assume that judgments of past occurrence are based on a unidimensional familiarity signal In a test of this hypothesis, subjects studied mixed lists of pictures and words that occurred up to three times each They then were given two tests a forced-choice frequency discrimination test including all pairs of conditions (e g., picture seen twice vs word never seen) and a numerical frequency judgment test on individual items Forced-choice proportions for all pairings (picture-picture, word-word, and picture-word) were well fit by a one-dimensional scaling solution, suggesting a common basis of recognition and frequency judgments for both pictures and words Both forced-choice and numerical judgment data indicated that familiarities of pictures started lower than those of words but increased more rapidly with repetition Results are discussed in connection with the distinction between familiarity and recall, and the possible role of rescaling in the mirror effect.     

Learning 10000 pictures

Four experiments are reported which examined memory capacity and retrieval speed for pictures and for words. Single-trial learning tasks were employed throughout, with memory performance assessed by forced-choice recognition, recall measures or choice reaction-time tasks. The main experimental findings were: (1) memory capacity, as a function of the amount of material presented, follows a general power law with a characteristic exponent for each task; (2) pictorial material obeys this power law and shows an overall superiority to verbal material. The capacity of recognition memory for pictures is almost limitless, when measured under appropriate conditions; (3) when the recognition task is made harder by using more alternatives, memory capacity stays constant and the superiority of pictures is maintained; (4) picture memory also exceeds verbal memory in terms of verbal recall; comparable recognition/recall ratios are obtained for pictures, words and nonsense syllables; (5) verbal memory shows a higher retrieval speed than picture memory, as inferred from reaction-time measures. Both types of material obey a power law, when reaction-time is measured for various sizes of learning set, and both show very rapid rates of memory search.

From a consideration of the experimental results and other data it is concluded that the superiority of the pictorial mode in recognition and free recall learning tasks is well established and cannot be attributed to methodological artifact.     

Subjective qualities of memories associated with the picture superiority effect in schizophrenia

Patients with schizophrenia (n = 24) matched with 24 normal subjects were presented with both words and pictures. On a recognition memory task, they were asked to give remember, know, or guess responses to items that were recognized on the basis of conscious recollection, familiarity, or guessing, respectively. Compared with normal subjects, patients exhibited a lower picture superiority effect selectively related to remember responses. Unlike normal subjects, they did not exhibit any word superiority effect in relation to guess responses; this explains why the overall picture superiority effect appeared to be intact. These results emphasize the need to take into account the subjective states of awareness when analyzing memory impairments in schizophrenia.     

Episodic encoding and recognition of pictures and words: role of the human medial temporal lobes

In the present PET study, we examined brain activity related to processing of pictures and printed words in episodic memory. Our goal was to determine how the perceptual format of objects (verbal versus pictorial) is reflected in the neural organization of episodic memory for common objects. We investigated this issue in relation to encoding and recognition with a particular focus on medial temporal-lobe (MTL) structures. At encoding, participants saw pictures of objects or their written names and were asked to make semantic judgments. At recognition, participants made yes-no recognition judgments in four different conditions. In two conditions, target items were pictures of objects; these objects had originally been encoded either in picture or in word format. In two other conditions, target items were words; they also denoted objects originally encoded either as pictures or as words. Our data show that right MTL structures are differentially involved in picture processing during encoding and recognition. A posterior MTL region showed higher activation in response to the presentation of pictures than of words across all conditions. During encoding, this region may be involved in setting up a representation of the perceptual information that comprises the picture. At recognition, it may play a role in guiding retrieval processes based on the perceptual input, i.e. the retrieval cue. Another more anterior right MTL region was found to be differentially involved in recognition of objects that had been encoded as pictures, irrespective of whether the retrieval cue provided was pictorial or verbal in nature; this region may be involved in accessing stored pictorial representations. Our results suggest that left MTL structures contribute to picture processing only during encoding. Some regions in the left MTL showed an involvement in semantic encoding that was picture specific; others showed a task-specific involvement across pictures and words. Together, our results provide evidence that the involvement of some but not all MTL regions in episodic encoding and recognition is format specific.     

Words, pictures, and priming: on semantic activation, conscious identification, and the automaticity of information processing

We investigated the encoding mechanisms involved in the perceptual recognition of words and pictures. Latencies in naming word and picture targets were analyzed as a function of several characteristics of a preceding prime, including whether it was a word or a picture, its duration of exposure, the interval between the prime and target onset, and whether or not the prime was consciously identified and reported by the subject. Results indicated that a common semantic code is available that can represent the meaning of either a word or a picture. This semantic representation, however, appears to be more easily activated by picture primes than by word primes and seems to benefit the naming of picture targets more than the naming of word targets. Despite the advantage for pictures with respect to semantic activation, overall processing in the naming task was slower and more attention demanding for pictures than for words. Comparison of our data with data on classification, in which an opposite pattern occurs (overall processing appears to be slower and more attention demanding for words than for pictures), suggests that, on the average, pictures have faster and more automatic access to their meanings than to their names but that words have faster and more automatic access to their names than to their meanings. This conclusion concerning the relative ability of stimuli to activate different kinds of internal representations has implications for a theory of the basis and development of automaticity.     

Does the generation effect occur for pictures?

The generation effect is the finding that self-generated stimuli are recalled and recognized better than read stimuli. The effect has been demonstrated primarily with words. This article examines the effect for pictures in two experiments: Subjects named complete pictures (name condition) and fragmented pictures (generation condition). In Experiment 1, memory was tested in 3 explicit tasks: free recall, yes/no recognition, and a source-monitoring task on whether each picture was complete or fragmented (the complete/incomplete task). The generation effect was found for all 3 tasks. However, in the recognition and source-monitoring tasks, the generation effect was observed only in the generation condition. We hypothesized that absence of the effect in the name condition was due to the sensory or process match effect between study and test pictures and the superior identification of pictures in the name condition. Therefore, stimuli were changed from pictures to their names in Experiment 2. Memory was tested in the recognition task, complete/incomplete task, and second source-monitoring task (success/failure) on whether each picture had been identified successfully. The generation effect was observed for all 3 tasks. These results suggest that memory of structural and semantic characteristics and of success in identification of generated pictures may contribute to the generation effect.     

Conceptual and perceptual memory: retrieval orientations reflected in event-related potentials

In memory retrieval, search can be guided by mental sets towards different subsets of the available evidence. Such retrieval orientations have been suggested to leave an imprint on event-related potentials (ERPs). The present study aimed at characterizing orientations towards perceptual and conceptual evidence in a recognition task, where pictures and words were studied. In the recognition test, items were presented in either the same format as at study or in the opposite format. A between-subjects manipulation modified the task, instructing an Exclusion group to endorse only items that preserved their format from study, and an Inclusion group to endorse both formats of a studied item. It was hypothesized that exclusion instructions would instill a perceptual and inclusion instructions a conceptual orientation. As a corollary, instructions were expected to dissociate the high end from the low end of the picture-word mirror effect. This expectation was confirmed in a behavioural experiment. In an ERP experiment, retrieval orientations were examined in their effects on correct rejections of new pictures and words. Confirming earlier findings [Hornberger, M., Morcom, A. M., & Rugg, M. D. (2004). Neural correlates of retrieval orientation: effects of study-test similarity. Journal of Cognitive Neuroscience, 16(7), 1196-1210], a perceptual orientation was accompanied by more positive-going amplitudes over widespread areas. The difference was larger for pictures than for words, supporting behavioural evidence that new pictures are more easily rejected on perceptual grounds than are new words. The Exclusion group showed no ERP evidence of cross-format old-new effects, despite reaction times indicative of involuntary conceptual recognition. The results indicate that perceptual and conceptual retrieval orientations imprint distinct signatures on ERPs. They further suggest that the examined old-new effects in ERPs are mainly linked to voluntary aspects of memory, even in a task where involuntary memory exerts effects on reaction times.