Recognition of concrete and abstract pictures as a function of poststimulus interval

This study examined picture recognition of concrete common objects and abstract random shapes under two presentation conditions: The durations of the unfilled intervals (off-time duration) that followed the presentation of the pictures were varied either randomly or in blocks. The major findings were: recognition of the concrete pictures was better than recognition of random shapes, the off-time duration did not influence recognition of either type of picture under the random presentation condition, and under the block presentation condition, recognition of the concrete pictures increased as a function of off-time duration, whereas the effect of off-time duration was not found for the abstract shapes. The results were interpreted as suggesting that a longer off-time duration is necessary for abstract shapes so that stimulus differentiation, verbal encoding, visual analogizing, and rehearsing may be utilized in processing.     

A developmental study of recognition of pictures and nouns

Children at four age levels (4, 6, 8, and 10 years) were given continuous recognition tasks using concrete noun, abstract noun, and pictorial stimuli in a 4 × 3 factorial design. Pictures were recognized significantly better than concrete and abstract nouns at the 4- and 6-year age levels and significantly better than abstract nouns at the 8- and 10-year age levels. This supported Paivio's contention that pictures are easier to remember than words because of a greater possibility of dual encoding, while Rohwer's contention that there is a shift in recognition memory development received no support. There were no significant differences between recognition of concrete and abstract nouns at any age level, which opposed the findings from adult studies and suggested that Paivio's theoretical orientation would have to be extended in order to account for developmental data. Recognition for both concrete and abstract nouns was found to be linear and increasing significantly with age, but no age trends for picture recognition were found.     

Storage and retrieval properties of dual codes for pictures and words in recognition memory.

Storage and retrieval properties of pictures and words were studied within a recognition memory paradigm. Storage was manipulated by instructing subjects either to image or to verbalize to both picture and word stimuli during the study sequence. Retrieval was manipulated by representing a proportion of the old picture and word items in their opposite form during the recognition test (i.e., some old pictures were tested with their corresponding words and vice versa). Recognition performance for pictures was identical under the two instructional conditions, whereas recognition performance for words was markedly superior under the imagery instruction condition. It was suggested that subjects may engage in dual coding of simple pictures naturally, regardless of instructions, whereas dual coding of words may occur only under imagery instructions. The form of the test item had no effect on recognition performance for either type of stimulus and under either instructional condition. However, change of form of the test item markedly reduced item-by-item correlations between the two instructional conditions. It is tentatively proposed that retrieval is required in recognition, but that the effect of a form change is simply to make the retrieval process less consistent, not less efficient.     

Toward neuroanatomical models of analogy: a positron emission tomography study of analogical mapping

Several brain regions associated with analogical mapping were identified using (15)O-positron emission tomography with 12 normal, high intelligence adults. Each trial presented during scanning consisted of a source picture of colored geometric shapes, a brief delay, and a target picture of colored geometric shapes. Analogous pictures did not share similar geometric shapes but did share the same system of abstract visuospatial relations. Participants judged whether each source-target pairing was analogous (analogy condition) or identical (literal condition). The results of the analogy-literal comparison showed activation in the dorsomedial frontal cortex and in the left hemisphere; the inferior, middle, and medial frontal cortices; the parietal cortex; and the superior occipital cortex. Based on these results as well as evidence from relevant cognitive neuroscience studies of reasoning and of executive working memory, we hypothesize that analogical mapping is mediated by the left prefrontal and inferior parietal cortices.     

French norms of imagery for pictures, for concrete and abstract words]

This paper deals with French norms for mental image versus picture agreement for 138 pictures and the imagery value for 138 concrete words and 69 abstract words. The pictures were selected from Snodgrass et Vanderwart's norms (1980). The concrete words correspond to the dominant naming response to the pictorial stimuli. The abstract words were taken from verbal associative norms published by Ferrand (2001). The norms were established according to two variables: 1) mental image vs. picture agreement, and 2) imagery value of words. Three other variables were controlled: 1) picture naming agreement; 2) familiarity of objects referred to in the pictures and the concrete words, and 3) subjective verbal frequency of words. The originality of this work is to provide French imagery norms for the three kinds of stimuli usually compared in research on dual coding. Moreover, these studies focus on figurative and verbal stimuli variations in visual imagery processes.     

Projective invariance and picture perception

Four experiments test the assumption that, in the visual perception of pictures, observers have reliable and direct access to the equivalence of shapes in projective geometry. The assumption is that perception of projective equivalence is the basis of shape constancy ('the projective thesis'). Observers matched or reproduced abstract planar shapes under conditions of rotation in the picture plane, and pictured rotation in depth. Departure from projective equivalence was assessed in each study by measuring the planar analogue of cross ratio. Projective equivalence was not found to be perceived uniformly where Euclidean equivalence was not judged uniformly, either in recognition tasks or in production tasks. When the projective thesis is put to a suitably general test, confidence in the thesis is undermined.     

Enhanced recognition of memorable pictures in ultra-fast RSVP

Long-term recognition memory for some pictures is consistently better than for others (Isola, Xiao, Parikh, Torralba, & Oliva, IEEE Transaction on Pattern Analysis and Machine Intelligence (PAMI), 36(7), 1469–1482, 2014). Here, we investigated whether pictures found to be memorable in a long-term memory test are also perceived more easily when presented in ultra-rapid RSVP. Participants viewed 6 pictures they had never seen before that were presented for 13 to 360 ms per picture in a rapid serial visual presentation (RSVP) sequence. In half the trials, one of the pictures was a memorable or a nonmemorable picture and perception of this picture was probed by a visual recognition test at the end of the sequence. Recognition for pictures from the memorable set was higher than for those from the nonmemorable set, and this difference increased with increasing duration. Nonmemorable picture recognition was low initially, did not increase until 120 ms, and never caught up with memorable picture recognition performance. Thus, the long-term memorability of an image is associated with initial perceptibility: A picture that is hard to grasp quickly is hard to remember later.     

Developmental differences in the role of detail in picture recognition memory

Two experiments assess the effect of the amount of physical detail in pictures on picture recognition memory. Children and adults were presented simple and complex line drawings. A “same-different” recognition test followed in which the distractor items were original pictures from the presentation phase with the amount of physical detail altered. For second- and fourth-grade subjects, recognition sensitivity, measured in terms of d′, was similar for pictures in the simple and complex presentation conditions. For adults, however, recognition sensitivity was greater for pictures in the simple than complex presentation condition. This finding with adults was replicated in Experiment 2. Interpretations of this age difference in picture memory processing are discussed, as well as the constraints imposed by various dependent measures used in picture memory studies.     

Visual imagery ability and the recognition of verbal and nonverbal stimuli.

High and low visual imagers, defined as such primarily on the basis of spatial manipulation test performance, were required to identify tachistoscopically-presented pictures, concrete words, and abstract words varying in familiarity. Two recognition paradigms were employed, recognition threshold and recognition latency. High imagers were faster in picture recognition under both paradigms when a nonverbal set or strategy was primed and when pictures were relatively unfamiliar in the threshold paradigm. No relationship was found between imagery ability and word recognition in the visual modality, nor was visual imagery ability related to the auditory recognition of verbal and nonverbal stimuli, such as words and environmental sounds. Commonalities between these findings and others in the imagery ability literature were noted.     

The Problem of the Condition of Arousal of the Pure Sensation of Cutaneous Pain

In order to develop scales representing curiosity-arousing components of pictures (slides) of either common objects or random shapes, a total of 56 college student Ss rated both sets of material on nine dimensions. Factor analyses indicated that the nine dimensions could be reduced to two factors. In order to test the ability of these factors to predict memorial performance and exploratory behavior, an additional 80 undergraduates were then tested for recognition or free looking time (FLT) of either object or random shape slides. Separate regression equations, using FLT and recognition performance as criterion measures, were computed. The present results not only indicate stability in visual exploratory scaling plus redundancy among various attributes of visual stimuli, but also suggest that behavior can be considered as elicited by two separate attributes of visual stimuli.     

中性抽象词和具体词情绪信息获得的差异

采用词汇迫选学习范式考察不同类型词汇获得情绪信息的认知机制。结果发现：（1）在迫选过程中与积极图片匹配的具体词汇喜好度显著高于与消极图片匹配的喜好度,而抽象词学习并未表现出这样的效应。（2）积极图片下被选择词汇的喜好度显著高于未被选择词汇的喜好度,而消极图片下被选择词汇与未被选择词汇的喜好度差异不显著。该结果表明具体词相较于抽象词更易获得相应情绪信息,积极情绪比消极情绪信息更易被习得。     

The picture superiority effect in associative recognition

The picture superiority effect has been well documented in tests of item recognition and recall. The present study shows that the picture superiority effect extends to associative recognition. In three experiments, students studied lists consisting of random pairs of concrete words and pairs of line drawings; then they discriminated between intact (old) and rearranged (new) pairs of words and pictures at test. The discrimination advantage for pictures over words was seen in a greater hit rate for intact picture pairs, but there was no difference in the false alarm rates for the two types of stimuli. That is, there was no mirror effect. The same pattern of results was found when the test pairs consisted of the verbal labels of the pictures shown at study (Experiment 4), indicating that the hit rate advantage for picture pairs represents an encoding benefit. The results have implications for theories of the picture superiority effect and models of associative recognition.     

Task difficulty and visual similarity increase a distractor's effects on random shapes

Recognition of random shapes followed by a visual distractor is altered by the type of distractor and whether the distractor needs to be attended. Three experiments tested which characteristics modify a visual distractor's effect on random target shapes presented for 75 to 150 msec. Exp. 1 showed that increasing the number of digits to be remembered (1, 3, or 8) increased the effectiveness of digits as distractors. Exeir effect as visual distractors for random target shapes. Random shapes were highly effective as distractors, while pictures of faces or comples colored pictures had a relatively small effect. In Exp. 3 decreasing the presentation time for novel visual distractors decreased recognition of the distractors but not of random target shapes. However, adding a three-digit distractor after the novel visual distractor did decrease recognition of target shapes. Exps. 2 and 3 showed that the order of the recognition tests of the target and distracting stimuli altered target recognition if and only if subjects did know which was to be reported first. These experiments indicate that the effect of a visual distractor depends on both the extent to which it is allotted attention and its visual similarity to the target stimulus.     

Episodic encoding and recognition of pictures and words: role of the human medial temporal lobes

In the present PET study, we examined brain activity related to processing of pictures and printed words in episodic memory. Our goal was to determine how the perceptual format of objects (verbal versus pictorial) is reflected in the neural organization of episodic memory for common objects. We investigated this issue in relation to encoding and recognition with a particular focus on medial temporal-lobe (MTL) structures. At encoding, participants saw pictures of objects or their written names and were asked to make semantic judgments. At recognition, participants made yes-no recognition judgments in four different conditions. In two conditions, target items were pictures of objects; these objects had originally been encoded either in picture or in word format. In two other conditions, target items were words; they also denoted objects originally encoded either as pictures or as words. Our data show that right MTL structures are differentially involved in picture processing during encoding and recognition. A posterior MTL region showed higher activation in response to the presentation of pictures than of words across all conditions. During encoding, this region may be involved in setting up a representation of the perceptual information that comprises the picture. At recognition, it may play a role in guiding retrieval processes based on the perceptual input, i.e. the retrieval cue. Another more anterior right MTL region was found to be differentially involved in recognition of objects that had been encoded as pictures, irrespective of whether the retrieval cue provided was pictorial or verbal in nature; this region may be involved in accessing stored pictorial representations. Our results suggest that left MTL structures contribute to picture processing only during encoding. Some regions in the left MTL showed an involvement in semantic encoding that was picture specific; others showed a task-specific involvement across pictures and words. Together, our results provide evidence that the involvement of some but not all MTL regions in episodic encoding and recognition is format specific.     

An initial search for visual overshadowing

A consistent, albeit fragile, finding over the last couple of decades has been that verbalization of hard-to-verbalize stimuli, such as faces, interferes with subsequent recognition of the described target stimulus. We sought to elicit a similar phenomenon whereby visualization interferes with verbal recognition—that is, visual overshadowing. We randomly assigned participants (n?=?180) to either concrete (easy to visualize) or abstract (difficult to visualize) sentence conditions. Following presentation, participants were asked to verbalize the sentence, visualize the sentence, or work on a filler task. As predicted, visualization of an abstract verbal stimulus resulted in significantly lower recognition accuracy; unexpectedly, however, so did verbalization. The findings are discussed within the framework of fuzzy-trace theory.     

The perceptual basis of the modality effect in multimedia learning

Various studies have demonstrated an advantage of auditory over visual text modality when learning with texts and pictures. To explain this modality effect, two complementary assumptions are proposed by cognitive theories of multimedia learning: first, the visuospatial load hypothesis, which explains the modality effect in terms of visuospatial working memory overload in the visual text condition; and second, the temporal contiguity assumption, according to which the modality effect occurs because solely auditory texts and pictures can be attended to simultaneously. The latter explanation applies only to simultaneous presentation, the former to both simultaneous and sequential presentation. This paper introduces a third explanation, according to which parts of the modality effect are due to early, sensory processes. This account predicts that-for texts longer than one sentence-the modality effect with sequential presentation is restricted to the information presented most recently. Two multimedia experiments tested the influence of text modality across three different conditions: simultaneous presentation of texts and pictures versus sequential presentation versus presentation of text only. Text comprehension and picture recognition served as dependent variables. An advantage for auditory texts was restricted to the most recent text information and occurred under all presentation conditions. With picture recognition, the modality effect was restricted to the simultaneous condition. These findings clearly support the idea that the modality effect can be attributed to early processes in perception and sensory memory rather than to a working memory bottleneck.     

On the significance of “double encoding” for the superior recall of pictures to names

Ten-year-old children who were shown pictures of objects immediately preceded by the object's name recalled the material no better than those exposed to the names of the stimuli alone. Both conditions yielded significantly poorer retention than those in which pictures alone were presented or pictures followed by their names. A second study replicated this result. In addition this demonstrated, by a picture and name recognition task, that the effects could not be due to subjects in the “name prior to picture” condition ignoring the pictorial component. These results were interpreted as contradicting the “double encoding” explanation of the superiority of pictures to names in free recall. Parallel visual and verbal encoding of a pictured object does not facilitate retention unless the verbal cue is actively elicited from the subject by the stimulus. The implications of this result for other studies which have employed either simultaneous or sequential presentation of pictures and names are briefly discussed.     

News Concreteness and Visual-Verbal Association Do News Pictures Narrow the Recall Gap Between Concrete and Abstract News?

In three experiments with difficult stimuli, it was found that the addition of a representative picture to a news item improves recall of that item. Second, as predicted by dual-coding theory (DCT), concrete news items were recalled better than abstract news items (Experiments 2 and 3). Furthermore, concrete news items benefited more from the addition of a news picture than did abstract news items (Experiment 3). In Experiment 4, it was found that news concreteness was strongly correlated with various picture attributes, including visual-verbal overlap, which might in part explain the differential gain in recall from the addition of pictures to concrete and abstract news. The results are explained using Paivio's DCT.     

Equivalence class formation as a function of preliminary training with pictorial stimuli

The present experiment investigated the effects of preliminary training with pictorial stimuli on the subsequent formation of three 5‐member equivalence classes (A?B?C?D?E) in 84 university students assigned to seven groups of 12. In the Abstract (ABS) group, all stimuli were abstract shapes. In the Picture (PIC) group, the C stimuli were pictures, and the remaining stimuli were the same abstract shapes as in the ABS group. For the remaining five groups, all stimuli were the same abstract shapes as in the ABS group. However, across groups, preliminary training involved either the establishment of conditional relations with simultaneous (SMTS) or delayed (DMTS) matching‐to‐sample with 0 s, 3 s, 6 s, or 9 s between the abstract C stimuli and the meaningful pictures. For the ABS and the PIC groups, 16.7% and 83.3% of participants formed classes, respectively. Preliminary training with SMTS and DMTS with 0 s, 3 s, and 6 s produced a linear increase in the likelihood of equivalence class formation, 41.7%, 50%, and 75%, respectively. Increasing the duration of delay further from 6 s to 9 s produced a substantial decline, 50%. This experiment extends knowledge about how including meaningful pictures enhances equivalence class formation.     

Perceptual comparisons with laterally presented pictures and environmental sounds

Two experiments studied perceptual comparisons with cues that vary in one of four ways (picture, sound, spoken word, or printed word) and with targets that are either pictures or environmental sounds. The basic question probed whether modality or differences in format were factors that would influence picture and sound perception. Also of interest were cue effect differences when targets are presented on either the right or left side. Students responded to a same-different reaction time task that entailed matching cue-target pairs to determine whether the successive stimulus events represented features drawn from the same basic item. Cue type influenced reaction times to pictures and environmental sounds, but the effects were qualified by response type and with picture targets by presentation side. These results provide some additional evidence of processing asymmetry when pictures are directed to either the right or left hemisphere, as well as for some asymmetries in cross-modality cuing. Implications of these findings for theories of multisensory processing and models of object recognition are discussed.