Pictorial context and the recall of pronoun sentences

Summary Acting on the assumption that pictures affect the processing of sentences only when providing additional information, the authors used pictures, which in an earlier experiment had failed to influence the retention of noun sentences, as illustrations to semantically undefined pronoun sentences, thus establishing a distinct information gradient between sentence and picture. These pronoun sentences were presented to 48 subjects for recall, in four pictorial conditions: without picture, with unambiguous picture, with subject-ambiguous, and with object-ambiguous picture. As hypothesized, picture-less pronoun sentences were more poorly recalled than picture-enriched pronoun sentences. Moreover, sentences accompanied by subject-ambiguous pictures, in which the grammatical subject could not be clearly identified, scored lower than the same sentences with unambiguous or object-ambiguous pictures. The findings invite a communication-theory analysis of the experimental situation, for which Searle's theory of speech acts is invoked.The authors gratefully acknowledge the assistance of Mr. B. Jankowski in the translation of this paper from an original German version.     

Learning 10000 pictures

Four experiments are reported which examined memory capacity and retrieval speed for pictures and for words. Single-trial learning tasks were employed throughout, with memory performance assessed by forced-choice recognition, recall measures or choice reaction-time tasks. The main experimental findings were: (1) memory capacity, as a function of the amount of material presented, follows a general power law with a characteristic exponent for each task; (2) pictorial material obeys this power law and shows an overall superiority to verbal material. The capacity of recognition memory for pictures is almost limitless, when measured under appropriate conditions; (3) when the recognition task is made harder by using more alternatives, memory capacity stays constant and the superiority of pictures is maintained; (4) picture memory also exceeds verbal memory in terms of verbal recall; comparable recognition/recall ratios are obtained for pictures, words and nonsense syllables; (5) verbal memory shows a higher retrieval speed than picture memory, as inferred from reaction-time measures. Both types of material obey a power law, when reaction-time is measured for various sizes of learning set, and both show very rapid rates of memory search.

From a consideration of the experimental results and other data it is concluded that the superiority of the pictorial mode in recognition and free recall learning tasks is well established and cannot be attributed to methodological artifact.     

Outstanding memories: the positive and negative effects of nudes on memory

A picture of a nude isolated in a series of pictures of clothed models was quite memorable, but when compared with a clothed picture, the nude impaired memory for background picture derails as well as pictures immediately following the nude (anterograde amnesia). Recall of details given picture-gist recall, as well as recognition of person details, were equivalent in the clothed and nude conditions. A clothed picture isolated in a series of nudes did not hurt memory for background information, nor did it produce anterograde amnesia. Apparently, distinctiveness supports good memory for the gist of the nude or clothed pictures. However, distinctiveness is not responsible for the anterograde amnesia and poor memory for background details found with nudes.     

The development of the picture‐superiority effect

When pictures and words are presented serially in an explicit memory task, recall of the pictures is superior. While this effect is well established in the adult population, little is known of the development of this picture‐superiority effect in typical development. This task was administered to 80 participants from middle childhood to adolescence. The magnitude of the picture superiority effect increased with age. This finding is interpreted as supporting the position that pictorial superiority is contingent upon the encoding of pictorial information through two different routes.     

Effect of negative emotional pictures on associative memory for peripheral information

We investigated the influence of negative emotional pictures on associative memory. A visual object was embedded in the periphery of negative emotional or neutral pictures. Memory was assessed for central item (pictorial) information, peripheral (object) information, and the association between item and peripheral information. On tests of item information, negative emotional pictures were remembered better than neutral pictures. However, associative memory between item and peripheral information was less accurate when the pictures were negative compared to neutral. This occurred despite equivalent recall (Experiments 1 and 2) and recognition (Experiment 2) for the peripheral objects themselves. Further experiments confirmed that performance on the associative test was not influenced by testing order (Experiment 3). These findings suggest that negative emotional arousal can particularly disrupt the associative binding of peripheral information to a central emotional event.     

The sufficient conditions for directed forgetting in normal and educable mentally retarded adolescents

A series of studies investigated the conditions under which normal and educable mentally retarded adolescents (13 to 15 years old) would or would not disregard irrelevant information in memory. A directed forgetting task was used in which the person was required to recall short sequences of picture names. In some sequences there was a cue to forget the first few pictures (irrelevant information) and to remember only the subsequent pictures (relevant information). When normal adolescents were given no explanation of the forget cue, there was interference from the irrelevant information. A minimum explanation of the cue, however, was sufficient to eliminate interference for the normal adolescents. The same minimal explanation was not sufficient for mentally retarded adolescents. It was clear that irrelevant information in memory interfered with the performance of retarded adolescents given only a minimal explanation of the forget cue. These results are important since most naturalistic situations do not involve an elaborate explanation of the importance of disregarding irrelevant information previously stored in memory.     

Episodic encoding and recognition of pictures and words: role of the human medial temporal lobes

In the present PET study, we examined brain activity related to processing of pictures and printed words in episodic memory. Our goal was to determine how the perceptual format of objects (verbal versus pictorial) is reflected in the neural organization of episodic memory for common objects. We investigated this issue in relation to encoding and recognition with a particular focus on medial temporal-lobe (MTL) structures. At encoding, participants saw pictures of objects or their written names and were asked to make semantic judgments. At recognition, participants made yes-no recognition judgments in four different conditions. In two conditions, target items were pictures of objects; these objects had originally been encoded either in picture or in word format. In two other conditions, target items were words; they also denoted objects originally encoded either as pictures or as words. Our data show that right MTL structures are differentially involved in picture processing during encoding and recognition. A posterior MTL region showed higher activation in response to the presentation of pictures than of words across all conditions. During encoding, this region may be involved in setting up a representation of the perceptual information that comprises the picture. At recognition, it may play a role in guiding retrieval processes based on the perceptual input, i.e. the retrieval cue. Another more anterior right MTL region was found to be differentially involved in recognition of objects that had been encoded as pictures, irrespective of whether the retrieval cue provided was pictorial or verbal in nature; this region may be involved in accessing stored pictorial representations. Our results suggest that left MTL structures contribute to picture processing only during encoding. Some regions in the left MTL showed an involvement in semantic encoding that was picture specific; others showed a task-specific involvement across pictures and words. Together, our results provide evidence that the involvement of some but not all MTL regions in episodic encoding and recognition is format specific.     

“Aha” effects in the generation of pictures

An "aha" effect in memory was first reported by Auble, Franks, and Soraci (1979). They demonstrated that recall was greater for sentences that were initially incomprehensible but which were eventually comprehended, as compared with sentences that were understood from the outset. The present studies extend this "aha" effect to memory for pictorial stimuli. In Experiment 1, a recall advantage for pictures encoded by connecting the dots as compared with those encoded by tracing or visual scanning occurred only in the absence of foreknowledge of the picture (i.e., an "aha" effect). In Experiment 2, we replicated this finding and obtained evidence that conceptually based, verbal foreknowledge does not function in a similar manner as does pictorial foreknowledge in suppressing the "aha" recall advantage. These results place important constraints on previous research on generation effects for visual stimuli and attest to the cross-modal generalizability of the "aha" effect.     

Tracing the time course of picture--word processing

A number of independent lines of research have suggested that semantic and articulatory information become available differentially from pictures and words. The first of the experiments reported here sought to clarify the time course by which information about pictures and words becomes available by considering the pattern of interference generated when incongruent pictures and words are presented simultaneously in a Stroop-like situation. Previous investigators report that picture naming is easily disrupted by the presence of a distracting word but that word naming is relatively immune to interference from an incongruent picture. Under the assumption that information available from a completed process may disrupt an ongoing process, these results suggest that words access articulatory information more rapidly than do pictures. Experiment 1 extended this paradigm by requiring subjects to verify the category of the target stimulus. In accordance with the hypothesis that picture access the semantic code more rapidly than words, there was a reversal in the interference pattern: Word categorization suffered considerable disruption, whereas picture categorization was minimally affected by the presence of an incongruent word. Experiment 2 sought to further test the hypothesis that access to semantic and articulatory codes is different for pictures and words by examining memory for those items following naming or categorization. Categorized words were better recognized than named words, whereas the reverse was true for pictures, a result which suggests that picture naming involves more extensive processing than picture categorization. Experiment 3 replicated this result under conditions in which viewing time was held constant. The last experiment extended the investigation of memory differences to a situation in which subjects were required to generate the superordinate category name. Here, memory for categorized pictures was as good as memory for named pictures. Category generation also influenced memory for words, memory performance being superior to that following a yes--no verification of category membership. These experiments suggest a model of information access whereby pictures access semantic information were readily than name information, with the reverse being true for words. Memory for both pictures and words was a function of the amount of processing required to access a particular type of information as well as the extent of response differentiation necessitated by the task.     

The stimulus suffix effect as a memory coding phenomenon

Two short-term memory experiments examined the nature of the stimulus suffix effect on auditory linguistic and nonlinguistic stimulus lists. In Experiment 1, where subjects recalled eight-item digit lists, it was found that a silently articulated digit suffix had the same effect on recall for the last list item as a spoken digit suffix. In Experiment 2, subjects recalled lists of sounds made by inanimate objects either by listing the names of the objects or by ordering a set of drawings of the objects. Auditory suffixes, either another object sound or the spoken name of an object, produced a suffix effect under both recall conditions, but a visually presented picture also produced a suffix effect when subjects recalled using pictures. The results were most adequately explained by a levels-of-processing memory coding hypothesis.     

Pictorial priming and cued recall in Alzheimer's and Huntington's disease

A picture fragment test was used to compare the priming and cued recall performances of patients with Huntington's disease (HD), patients with dementia of the Alzheimer type (DAT), and neurologically intact normal control (NC) subjects. On the pictorial priming test, subjects were asked to say "the first thing you think of" when shown incompletely drawn pictures, half of which were previously exposed to the subject during an unrelated naming task. Normal controls and HD patients, but not DAT patients, demonstrated similar increases in their ability to identify fragmented versions of previously seen pictures relative to novel pictures. These results are consistent with the previously observed pattern of preserved and impaired verbal priming ability in HD and DAT patients, respectively. The NC subjects, as expected, also demonstrated better performance on the cued recall than on the priming version of the picture fragment test, whereas the HD patients evidenced the opposite relationship on these two tasks and DAT patients were found to be equally impaired on both tests. This finding provides further support for the notion that HD patients' memory impairment is characterized primarily by an inability to initiate systematic retrieval strategies.     

Integrating pictorial information across eye movements

Six experiments are reported dealing with the types of information integrated across eye movements in picture perception. A line drawing of an object was presented in peripheral vision, and subjects made an eye movement to it. During the saccade, the initially presented picture was replaced by another picture that the subject was instructed to name as quickly as possible. The relation between the stimulus on the first fixation and the stimulus on the second fixation was varied. Across the six experiments, there was about 100-130 ms facilitation when the pictures were identical compared with a control condition in which only the target location was specified on the first fixation. This finding clearly implies that information about the first picture facilitated naming the second picture. Changing the size of the picture from one fixation to the next had little effect on naming time. This result is consistent with work on reading and low-level visual processes in indicating that pictorial information is not integrated in a point-by-point manner in an integrated visual buffer. Moreover, only about 50 ms of the facilitation for identical pictures could be attributed to the pictures having the same name. When the pictures represented the same concept (e.g., two different pictures of a horse), there was a 90-ms facilitation effect that could have been the result of either the visual or conceptual similarity of the pictures. However, when the pictures had different names, only visual similarity produced facilitation. Moreover, when the pictures had different names, there appeared to be inhibition from the competing names. The results of all six experiments are consistent with a model in which the activation of both the visual features and the name of the picture seen on the first fixation survive the saccade and combine with the information extracted on the second fixation to produce identification and naming of the second picture.     

Pictorial superiority effects in oldest-old people

We examined memory for pictures and words in middle-age (45–59 years), young-old (60–74 years), old-old (75–89 years), and the oldest-old adults (90–97 years) in the Louisiana Healthy Aging Study. Stimulus items were presented and retention was tested in a blocked order where half of the participants studied 16 simple line drawings and the other half studied matching words during acquisition. Free recall and recognition followed. In the next acquisition/test block a new set of items was used where the stimulus format was changed relative to the first block. Results yielded pictorial superiority effects in both retention measures for all age groups. Follow-up analyses of clustering in free recall revealed that a greater number of categories were accessed (which reflects participants’ retrieval plan) and more items were recalled per category (which reflects participants’ encoding strategy) when pictures served as stimuli compared to words. Cognitive status and working memory span were correlated with picture and word recall. Regression analyses confirmed that these individual difference variables accounted for significant age-related variance in recall. These data strongly suggest that the oldest-old can utilise nonverbal memory codes to support long-term retention as effectively as do younger adults.     

Pictorial superiority effects in oldest-old people

We examined memory for pictures and words in middle-age (45-59 years), young-old (60-74 years), old-old (75-89 years), and the oldest-old adults (90-97 years) in the Louisiana Healthy Aging Study. Stimulus items were presented and retention was tested in a blocked order where half of the participants studied 16 simple line drawings and the other half studied matching words during acquisition. Free recall and recognition followed. In the next acquisition/test block a new set of items was used where the stimulus format was changed relative to the first block. Results yielded pictorial superiority effects in both retention measures for all age groups. Follow-up analyses of clustering in free recall revealed that a greater number of categories were accessed (which reflects participants' retrieval plan) and more items were recalled per category (which reflects participants' encoding strategy) when pictures served as stimuli compared to words. Cognitive status and working memory span were correlated with picture and word recall. Regression analyses confirmed that these individual difference variables accounted for significant age-related variance in recall. These data strongly suggest that the oldest-old can utilise nonverbal memory codes to support long-term retention as effectively as do younger adults.     

The recall and use of traits and events in social inference processes

Social inference research needs to more closely examine the kinds of information people actually have available for making social judgments. It is assumed here that the observation of behavioral events results in encoding and storage of both a relatively raw event record and of higher level encodings, such as trait inferences. Several specific hypotheses are advanced concerning the effects of higher level encodings on event recall, and the effects of encoding and memory processes on subsequent judgments about a stimulus person. Consistent with hypotheses, results indicate that higher level encodings do affect recall for stimulus information and do affect judgments of the stimulus person. The possibility that higher level encodings affect judgments solely by introducing bias into recall for the episodic record is considered and discarded in favor of the interpretation that higher level encodings are actually recalled and used in inference processes.     

Long-term memory for 400 pictures on a common theme

Long-term memory for large numbers of color photographs with a common motif--doors--was studied using pictures with two levels of informative cues: original photographs, and edited pictures in which extraneous information on details such as vegetation, paint scratches, signs, and lamp posts was removed. In the study phase, subjects viewed 400 pictures and were subsequently tested for memory on two-alternative forced-choice discriminations between studied and distracter pictures from the same picture category, at retention intervals between 0.5 h and 9 days. When tested with the nonedited original photographs immediate memory performance was close to 85% correct; when pictorial details were removed memory performance dropped by 20%. The decay functions were shallow with parallel paths for the categories of pictures. It is concluded that specific details of visual scenes contributed to long-term memory of those scenes.     

How much is an icon worth?

We report a new technique for assessing the amount of information extracted from the icon that follows a briefly presented picture. The problem of how to measure such information was formulated in terms of how much physical exposure of a picture an icon is worth. Consider two types of stimulus presentations, each with a base duration of d ms. The first is a d-ms picture followed by an icon, and the second is a d + a-ms picture not followed by an icon. How large does a have to be so that equivalent amounts of information are extracted in the two cases? To answer this question, we showed people pictures and later tested their memory for the pictures. We found that the physical exposure duration needed to reach a particular level of performance was approximately 100 ms longer when an icon was not permitted versus when the icon was permitted. This value was independent of the base duration and the luminance of the picture. Moreover, the same value was obtained using three different kinds of memory test and four different sets of pictures. We conclude that an icon is worth approximately 100 ms of additional physical exposure duration. A reasonable explanation for this robust equivalence between icon and stimulus is that the same encoding processes are responsible for extracting information from the icon and from the physical stimulus. Therefore, any variable that affects these encoding processes must affect extraction of information from the icon and the physical stimulus in an identical manner. This prediction was confirmed for one such variable, picture luminance.     

Exploring the superadditive effects of scent and pictures on verbal recall: An extension of dual coding theory

This research extends the dual coding theory of memory retrieval (Paivio 1969, 2007) beyond its traditional focus on verbal and pictorial information to olfactory information. We manipulate the presence or absence of olfactory and pictorial stimuli at the time of encoding (study 1) or retrieval (study 2) and measure the impact on verbal recall. After a time delay, scent enhances recall of verbal information, and scent-based retrieval cues potentiate the facilitative effect of pictures on recall. These results cannot be attributed merely to increased elaboration at the time of exposure.