How are pictures registered in memory?

Three experiments tested the hypothesis that pictorial memory is much less dependent on rehearsal than is verbal memory. Experiment I examined incidental learning since this is assumed to reflect learning with little or no rehearsal. Following a classification task, intentional and incidental learning for pictures and for words was compared. The superiority of pictorial memory was especially marked in incidental learning. Experiment II showed that this result was not due to differences in the amount of processing required to classify pictures and words. RTs to classify words and pictures did not differ, and incidental learning was again superior for pictures. In Experiment III rehearsal opportunity was restricted by a concurrent task during presentation of word and picture lists, and the decrement was very much greater for word learning than for picture learning. It was concluded that manipulation of rehearsal opportunity has relatively little effect on pictorial memory.     

A comparison of conscious and automatic memory processes for picture and word stimuli: a process dissociation analysis

Four experiments were conducted to evaluate explanations of picture superiority effects previously found for several tasks. In a process dissociation procedure (Jacoby, 1991) with word stem completion, picture fragment completion, and category production tasks, conscious and automatic memory processes were compared for studied pictures and words with an independent retrieval model and a generate-source model. The predictions of a transfer appropriate processing account of picture superiority were tested and validated in "process pure" latent measures of conscious and unconscious, or automatic and source, memory processes. Results from both model fits verified that pictures had a conceptual (conscious/source) processing advantage over words for all tasks. The effects of perceptual (automatic/word generation) compatibility depended on task type, with pictorial tasks favoring pictures and linguistic tasks favoring words. Results show support for an explanation of the picture superiority effect that involves an interaction of encoding and retrieval processes.     

Learning 10000 pictures

Four experiments are reported which examined memory capacity and retrieval speed for pictures and for words. Single-trial learning tasks were employed throughout, with memory performance assessed by forced-choice recognition, recall measures or choice reaction-time tasks. The main experimental findings were: (1) memory capacity, as a function of the amount of material presented, follows a general power law with a characteristic exponent for each task; (2) pictorial material obeys this power law and shows an overall superiority to verbal material. The capacity of recognition memory for pictures is almost limitless, when measured under appropriate conditions; (3) when the recognition task is made harder by using more alternatives, memory capacity stays constant and the superiority of pictures is maintained; (4) picture memory also exceeds verbal memory in terms of verbal recall; comparable recognition/recall ratios are obtained for pictures, words and nonsense syllables; (5) verbal memory shows a higher retrieval speed than picture memory, as inferred from reaction-time measures. Both types of material obey a power law, when reaction-time is measured for various sizes of learning set, and both show very rapid rates of memory search.

From a consideration of the experimental results and other data it is concluded that the superiority of the pictorial mode in recognition and free recall learning tasks is well established and cannot be attributed to methodological artifact.     

The fate of originally presented surface information following recall errors in sentence memory tasks

Pictures are remembered better than their names. This picture superiority effect in episodic memory has been attributed either to the greater sensory distinctiveness of pictures or to their greater conceptual distinctiveness. Weldon and Coyote (1996) tested the conceptual distinctiveness hypothesis by comparing how well pictures as opposed to words primed in two conceptual implicit memory tasks (category production and word association). They found no picture superiority in priming and concluded that the basis of the picture superiority effect must then be pictures' greater sensory distinctiveness. Using the same logic, we compared how well pictures as opposed to words primed in a perceptual implicit memory task (picture and word fragment identification). The sensory distinctiveness theory would predict that pictures should prime picture fragment identification better than words prime word fragment identification, a result we call the picture superiority in within-form priming. Across three experiments which manipulated the encoding task at study, only one showed picture superiority in within-form priming. In contrast, in all three experiments there was robust picture superiority in recall, and exposure to pictures and words at study and test produced independent effects in which both study and test exposure to pictures was more effective for recall than exposure to words. We consider how these results might be reconciled by differences in retrieval demands between recall and fragment identification.     

On the significance of “double encoding” for the superior recall of pictures to names

Ten-year-old children who were shown pictures of objects immediately preceded by the object's name recalled the material no better than those exposed to the names of the stimuli alone. Both conditions yielded significantly poorer retention than those in which pictures alone were presented or pictures followed by their names. A second study replicated this result. In addition this demonstrated, by a picture and name recognition task, that the effects could not be due to subjects in the “name prior to picture” condition ignoring the pictorial component. These results were interpreted as contradicting the “double encoding” explanation of the superiority of pictures to names in free recall. Parallel visual and verbal encoding of a pictured object does not facilitate retention unless the verbal cue is actively elicited from the subject by the stimulus. The implications of this result for other studies which have employed either simultaneous or sequential presentation of pictures and names are briefly discussed.     

Young Children's Knowledge of the Representational Function of Pictorial Symbols: Development Across the Preschool Years in Three Cultures

Three- to 5-year-old children's knowledge that pictures have a representational function for others was investigated using a pictorial false-belief task. In Study 1, children passed the task at around 4 years old, and performance was correlated with standard false-belief and pictorial symbol tasks. In Study 2, the performance of children from two cultural settings who had very little exposure to pictures during the first 3 years (Peru, India) was contrasted with that of children from Canada. Performance was better in the Canadian than Peruvian and Indian samples on the picture false-belief task and drawing tasks but not on the standard false-belief measure. In all settings, children passed drawing and standard false-belief tasks either concurrently with, or prior to, passing the picture false-belief task. The findings suggest that children's explicit knowledge of the representational function of pictorial symbols matures in the late preschool years and develops more rapidly in cultures that strongly promote the symbolic use of pictures early in life.     

Semantic negative priming in picture categorization and naming

Ignoring a particular stimulus can hamper subsequent attended processing of the same stimulus, a phenomenon known as 'negative priming'. Previous research has yielded partial support for the claim that the effect results from the attentional inhibition of central representations, as suggested by the fact that it appears to extend to semantic associates of ignored stimuli. In the current experiment, participants categorized or named pictorial stimuli with superimposed distractor pictures; the effect of unrelated, identical, or categorically related previously ignored pictures was investigated. Furthermore, visual similarity between categorically related picture pairs was manipulated in the naming task. The results indicated negative priming from identical ignored pictures irrespective of task. However, semantic negative priming was observed in the categorization task only. In the naming task, even visual overlap between categorically related picture pairs failed to induce negative priming. These findings argue against a central locus of the negative priming effect.     

The picture superiority effect in recognition memory: A developmental study using the response signal procedure

Items studied as pictures are better remembered than items studied as words even when test items are presented as words. The present study examined the development of this picture superiority effect in recognition memory. Four groups ranging in age from 7 to 20 years participated. They studied words and pictures, with test stimuli always presented as words, and time to respond to test stimuli was manipulated. The picture superiority effect showed a clear developmental trend. In the condition in which participants had ample response time, a significant picture superiority effect appeared in all but the youngest group. With short response time, a significant picture superiority effect appeared only among 11- and 20-year-old groups, while a significant reverse of the picture superiority effect was detected in the youngest group. These results were interpreted as suggesting that different memory processes (familiarity and recollection) contribute differently to the picture superiority effect at different stages of development.     

Subjective qualities of memories associated with the picture superiority effect in schizophrenia

Patients with schizophrenia (n = 24) matched with 24 normal subjects were presented with both words and pictures. On a recognition memory task, they were asked to give remember, know, or guess responses to items that were recognized on the basis of conscious recollection, familiarity, or guessing, respectively. Compared with normal subjects, patients exhibited a lower picture superiority effect selectively related to remember responses. Unlike normal subjects, they did not exhibit any word superiority effect in relation to guess responses; this explains why the overall picture superiority effect appeared to be intact. These results emphasize the need to take into account the subjective states of awareness when analyzing memory impairments in schizophrenia.     

Differential response patterns to disgust-related pictures

ABSTRACT

In the present study, attentional bias was investigated as a potential predisposing mechanism for the contamination-related subtype of obsessive-compulsive disorder (C-OC disorder). Fifty healthy participants with varying degrees of subclinical C-OC symptoms performed a visual search task to measure differential attentional biases elicited by neutral, disgust-, and fear-specific pictorial material. Participants had to find a target picture within five neutral distractor pictures randomly presented on different locations in an array. The task was to decide whether the array contained an unpleasant target picture or not. In randomly-selected emotional trials, participants were further asked about the content of the picture and the confidence of their answer. The results show that the reaction times significantly differed between the emotional and neutral pictures. Participants were significantly more confident in answering questions referring to fear compared to disgust pictures. This effect was marginally amplified in participants with higher C-OC symptoms. We discuss the results within the framework of the cost and benefit hypothesis, which postulates that disgust evolutionarily elicits stronger uncertainty compared to fear, owing to the ambiguous nature of the stimuli. Increased uncertainty might be an important but underestimated factor for pathological disgust experience, such as in obsessive-compulsive disorder.     

Concept of uprightness in baboons: assessment with pictures of realistic scenes

How nonhuman primates process pictures of natural scenes or objects remains a matter of debates. This issue was addressed in the current research by questioning the processing of the canonical orientation of pictures in baboons. Two adult guinea baboons were trained to use an interactive key (IK) on a touch-screen to change the orientation of target pictures showing humans or quadruped mammals until upright. In experiment 1, both baboons successfully learned to use the IK when that key induced a 90 degrees rightward rotation of the picture, but post-training transfer of performance did not occur to novel pictures of natural scenes due to potential motor biases. In Experiment 2, a touch on IK randomly displayed the pictures in any of the four cardinal orientations. Baboons successfully learned the task, but transfer to novel pictures could only be demonstrated after they had been exposed to 360-480 pictures in that condition. Experiment 3 confirmed positive transfers to novel pictures, and showed that both the figure and background information controlled the behavior. Our research on baboons therefore demonstrates the development and use of an "upright" concept, and indicates that picture processing modes strongly depend on the subject's past experience with naturalistic pictorial stimuli.     

Developmental changes in memorial comparisons: the effects of stimulus presentation mode.

First graders, fifth graders, and college students made comparative size judgments of either pictures (line drawings) or names (spoken words) of common objects by designating the "bigger" item in real life. Care was taken to equate the picture and word conditions on a number of critical parameters including method of item-pair presentation and activation of response-time intervals. All groups exhibited a symbolic distance effect. While judgments were faster with pictures than words, the magnitude of the difference did not change with age. Previous research suggesting a marked developmental decline in the magnitude of the "pictorial superiority effect" may have confounded reduced memory demands with stimulus presentation mode for young children. Finally, slopes of the symbolic distance functions were found to decrease with increasing grade level, at least from first to fifth grade. This is the first demonstration of an age-related decline in slopes for magnitude comparisons of concrete objects.     

Pictorial encoding effects and memory confusions in the Deese–Roediger–McDermott paradigm: Evidence for the activation of spontaneous imagery

The purpose of the experiments reported in this paper was to examine the possible role of spontaneous imagery and list-specific cues on pictorial encoding effects induced by the Deese-Roediger-McDermott (DRM) task. After viewing pictures and words referring to thematically related materials, by way of a picture/word source-judgement task, participants were asked to remember the way in which these materials were presented. Participants reported “seeing” pictures of items that were presented as words, an effect predicted by the imaginal activation hypothesis in its suggestion that incidental images experienced during encoding will later be mistaken as memories for pictures. Whether participants made the same picture misattributions on related lures (or non-presented related items) depended on the way in which the lures’ respective thematic lists were experienced during encoding (Experiments 1 and 2), pointing to the effects of list-specific cues in picture/word judgements. These findings have intriguing implications for interpretations of picture-encoding effects induced by the DRM task. The findings also speak to the use of DRM false-memory rates when marshalling evidence against the use of imagery in applied settings.     

Pictorial encoding effects and memory confusions in the Deese-Roediger-McDermott paradigm: evidence for the activation of spontaneous imagery

The purpose of the experiments reported in this paper was to examine the possible role of spontaneous imagery and list-specific cues on pictorial encoding effects induced by the Deese-Roediger-McDermott (DRM) task. After viewing pictures and words referring to thematically related materials, by way of a picture/word source-judgement task, participants were asked to remember the way in which these materials were presented. Participants reported "seeing" pictures of items that were presented as words, an effect predicted by the imaginal activation hypothesis in its suggestion that incidental images experienced during encoding will later be mistaken as memories for pictures. Whether participants made the same picture misattributions on related lures (or non-presented related items) depended on the way in which the lures' respective thematic lists were experienced during encoding (Experiments 1 and 2), pointing to the effects of list-specific cues in picture/word judgements. These findings have intriguing implications for interpretations of picture-encoding effects induced by the DRM task. The findings also speak to the use of DRM false-memory rates when marshalling evidence against the use of imagery in applied settings.     

Text–Picture Integration: How Delayed Testing Moderates Recognition of Pictorial Information in Multimedia Learning

When learning with multimedia, text and pictures are assumed to be integrated with each other. Arndt, Schüler, and Scheiter (Learning & Instruction, 35, 62–72, 2015) confirmed the process of text picture integration for sentence recognition, not, however, for picture recognition. The current paper investigates the underlying reasons for the latter finding. Two experiments are reported, where subjects memorized text–picture stimuli that differed in the specificity of information contained in either sentences or pictures. In a subsequent picture recognition test, subjects showed no integration effect after a 30‐minute delay (Experiments 1 and 2), but only after a 1‐week delay (Experiment 2). Furthermore, eye‐tracking data showed that participants sufficiently processed the pictures during learning (Experiment 1). This data pattern speaks in favor of the assumption that after a short delay participants had available a short‐lived pictorial surface representation, which masked the integration effect for pictorial recognition.Copyright © 2015 John Wiley & Sons, Ltd.     

Cognitive masking in rapid sequential processing: The effect of an emotional picture on preceding and succeeding pictures

This experiment assessed the effect of an emotional pictorial input on the processing of preceding and succeeding pictorial inputs. Thirty-nine individual pictures were successively presented for 165 msec, with a 500-msec dark interval between each item. The 20th input item was either an emotional or a neutral picture; the remaining 38 items were neutral sketches. Postinput recognition data indicated a processing disruption of several pictorial items following the emotional as compared to the neutral input and a possible processing disruption of the item immediately preceding the emotional stimulus. The outcome suggests nonindependence in the processing of separate picture inputs in rapid sequential presentations.     

Picture and pattern perception in the sighted and the blind: the advantage of the late blind

Two experiments are reported on the contribution of visual experience to tactile perception. In the first experiment, sighted, congenitally blind, and late blind individuals made tactual matches to tangible embossed shapes. In the second experiment, the same subjects attempted tactile identification of raised-line drawings. The three groups did not differ in the accuracy of shape matching, but both groups of blind subjects were much faster than the sighted. Late blind observers were far better than the sighted or congenitally blind at tactile picture identification. Four of the twelve pictures were correctly identified by most of the late blind subjects. The sighted and congenitally blind performed at comparable levels in picture naming. There was no evidence that visual experience alone aided the sighted in the tactile task under investigation, since they performed no better than did the early blind. The superiority of the late blind suggests that visual exposure to drawings and the rules of pictorial representation may help tactile picture identification when combined with a history of tactual experience.     

Effects of a concurrent memory task on hemispheric asymmetries in categorization

Recent research on the division of processing between the two cerebral hemispheres has often employed two concurrent tasks to investigate the dynamic nature of hemispheric asymmetries. The experiment reported here explored the effects of two concurrent high-level cognitive tasks (memory retention and semantic categorization) on the direction and magnitude of hemispheric differences in the processing of words and pictures. Subjects were required to categorize words and pictures presented to either the left visual field-right hemisphere (LVF-RH) or the right visual field-left hemisphere (RVF-LH). The categorization could be performed while holding either verbal material in memory (digit span), pictorial material in memory (serial nonsense figure recognition), or with no concurrent memory task. The effects produced hemisphere-specific, material-nonspecific interference. The verbal task removed a RVF-LH advantage at word categorization and enhanced a LVF-RH advantage on picture categorization; the pictorial task interfered with picture categorization in the LVF-RH, while enhancing a RVF-LH advantage at word categorization. The results are discussed in terms of multiple resource models of hemisphere function, capacity limitations, and the functional locus of processing required to produce various dynamic hemispheric effects.     

Picture superiority in conceptual memory: Dissociative effects of encoding and retrieval tasks

We examined the role of encoding processes for picture superiority in explicit and conceptual-implicit memory. The nature of encoding instruction (naming or semantic categorization) yielded dissociative effects on picture and word memory on one explicit test, category-cued recall, and two conceptual-implicit tests, category-cued generation and category-cued verification. Category-cued recall was greater for pictures than for words following naming, but it did not differ for pictures and words following semantic categorization. Category-cued generation priming was greater for pictures than for words following naming, but it was greater for words than for pictures following semantic categorization. In contrast, category-cued verification priming did not differ for pictures and words following either naming or semantic categorization. Thus, picture superiority can be eliminated or reversed depending on the type of conceptual encoding task and conceptual-retrieval test.     

The picture superiority effect in associative recognition

The picture superiority effect has been well documented in tests of item recognition and recall. The present study shows that the picture superiority effect extends to associative recognition. In three experiments, students studied lists consisting of random pairs of concrete words and pairs of line drawings; then they discriminated between intact (old) and rearranged (new) pairs of words and pictures at test. The discrimination advantage for pictures over words was seen in a greater hit rate for intact picture pairs, but there was no difference in the false alarm rates for the two types of stimuli. That is, there was no mirror effect. The same pattern of results was found when the test pairs consisted of the verbal labels of the pictures shown at study (Experiment 4), indicating that the hit rate advantage for picture pairs represents an encoding benefit. The results have implications for theories of the picture superiority effect and models of associative recognition.