Short-term retention of pictures and words as a function of type of distraction and length of delay interval

Picture and word triads were tested in a Brown-Peterson short-term retention task at varying delay intervals (3, 10, or 30 sec) and under acoustic and simultaneous acoustic and visual distraction. Pictures were superior to words at all delay intervals under single acoustic distraction. Dual distraction consistently reduced picture retention while simultaneously facilitating word retention. The results were interpreted in terms of the dual coding hypothesis with modality-specific interference effects in the visual and acoustic processing systems. The differential effects of dual distraction were related to the introduction of visual interference and differential levels of functional acoustic interference across dual and single distraction tasks. The latter was supported by a constant 2/1 ratio in the backward counting rates of the acoustic vs. dual distraction tasks. The results further suggest that retention may not depend on total processing load of the distraction task, per se, but rather that processing load operates within modalities.     

Storage and retrieval properties of dual codes for pictures and words in recognition memory.

Storage and retrieval properties of pictures and words were studied within a recognition memory paradigm. Storage was manipulated by instructing subjects either to image or to verbalize to both picture and word stimuli during the study sequence. Retrieval was manipulated by representing a proportion of the old picture and word items in their opposite form during the recognition test (i.e., some old pictures were tested with their corresponding words and vice versa). Recognition performance for pictures was identical under the two instructional conditions, whereas recognition performance for words was markedly superior under the imagery instruction condition. It was suggested that subjects may engage in dual coding of simple pictures naturally, regardless of instructions, whereas dual coding of words may occur only under imagery instructions. The form of the test item had no effect on recognition performance for either type of stimulus and under either instructional condition. However, change of form of the test item markedly reduced item-by-item correlations between the two instructional conditions. It is tentatively proposed that retrieval is required in recognition, but that the effect of a form change is simply to make the retrieval process less consistent, not less efficient.     

Recognition memory for words and pictures at short and long retention intervals

In two experiments, subjects studied a long series of words and pictures for recognition. Retention intervals varied from several minutes to a few months. The complicated testing procedures in Experiment I required the use of a traditional correction for guessing to obtain estimates of subjects' memory performance. A comparable, but simpler, design in Experiment II permitted the calculation of sensitivity and bias measures. In both studies, pictorial memory was superior to verbal memory at all retention intervals tested, and this advantage was essentially constant over time. In addition, the experiments identified an increasing tendency to call verbal test items "old" over time. Bias scores in Experiment H revealed that subjects adopted a more lenient criterion in responding to words than to pictures, and increased leniency was noted for both item types over time. Explanations of the results are offered in terms of differences in initial encoding and of a loss of discrimination between experimental and extraexperimental materials.     

The concreteness effect: evidence for dual coding and context availability

The term concreteness effect refers to the observation that concrete nouns are processed faster and more accurately than abstract nouns in a variety of cognitive tasks. Two models have been proposed to explain the neuronal basis of the concreteness effect. The dual-coding theory attributes the advantage to the access of a right hemisphere image based system in addition to a verbal system by concrete words. The context availability theory argues that concrete words activate a broader contextual verbal support, which results in faster processing, but do not access a distinct image based system. We used event-related fMRI to detect the brain regions that subserve to the concreteness effect. We found greater activation in the lower right and left parietal lobes, in the left inferior frontal lobe and in the precuneus during encoding of concrete compared to abstract nouns. This makes a single exclusive theory unlikely and rather suggests a combination of both models. Superior encoding of concrete words in the present study may result from (1) greater verbal context resources reflected by the activation of left parietal and frontal associative areas, and (2) the additional activation of a non-verbal, perhaps spatial imagery-based system, in the right parietal lobe.     

The effect of pictures on the retention of novel words and prose passages

The effect of pictures on the retention of novel words and prose passages was examined for both good and poor readers. The findings suggest that for both groups of subjects the presence of pictures enhances recall of the prose passages but has no effect on the recognition and pronunciation of novel words. Systematic differences in the strategies used by good and poor readers were also observed.     

Short-term retention of visually presented stimuli: some evidence of visual encoding.

Subjects saw two visual stimuli on each trial, separated by an interval ranging from 0 to 8 sec. Each stimulus was composed of a subset of the dots of a 7 × 5 dot matrix. In particular, it was a composite of two patterns, one of which formed a capital English letter and the other of which was an arrangement formed by 8 randomly selected dots. The task was to decide as quickly as possible whether the two stimuli contained the same letter. Under one condition (correlated noise) the same noise pattern was used with both letters; thus the decision as to whether the letters were the same could be based on a test of congruence of the two stimuli, noise and all. Under another condition (uncorrelated noise) the noise patterns differed, assuring that the composite patterns differed, and thus precluding congruence testing as an adequate way to determine whether the two letters were the same. Performance was better (RTs and error rates were smaller) with the correlated noise than with the uncorrelated noise. The result was taken as evidence that visual information was retained in memory, and used to advantage, when the situation clearly warranted the direct comparison of visual patterns.     

Selective disruption of hypermnesia for pictures and words

In this study, we investigated the effects of various interpolated tasks on hypermnesia (improved recall across repeated tests) for pictures and words. In five experiments, subjects studied either pictures or words and then completed two free-recall tests, with varying activities interpolated between the tests. The tasks performed between tests were varied to test several hypotheses concerning the possible factor(s) responsible for disruption of the hypermnesic effect. In each experiment, hypermnesia was obtained in a control condition in which there was no interpolated task between tests. The remaining conditions showed that the effect of the interpolated tasks was related to the overlap of the cognitive processes involved in encoding the target items and performing the interpolated tasks. When pictures were used as the target items, no hypermnesia was obtained when subjects engaged in imaginal processing interpolated tasks, even when these tasks involved materials that were very distinct from the target items. When words were used as the target items, no hypermnesia was obtained when the interpolated tasks required verbal/linguistic processing, even when the items used in these tasks were auditorily presented. The results are discussed in terms of a strength-based model of associative memory.     

Articulatory coding and phonological judgements on written words and pictures: The role of the phonological output buffer

Abstract

The ability of Italian subjects to make phonological judgements was investigated in three experiments. The judgements comprised initial sound similarity and stress assignment on pain of both written words and pictures. Stress assignment on both words and pictures as well as initial sound similarity on pictures required the activation of phonological lexical representations, but this was not necessarily the case for initial sound similarity judgements on word pairs. The first study assessed the effects of concurrent articulatory suppression on the judgements. Experiment 2 used a concomitant task (chewing), which shares with suppression the use of articulatory components but does not involve speech programming and production. The third experiment investigated the effects of unattended speech on the phonological judgements. The results of these three experiments showed that articulatory suppression had a significant disrupting effect on accuracy in all four conditions, while neither articulatory non-speech (chewing) or unattended auditory speech had any effect on the subjects' performance. The results suggest that these phonological judgements involve the operation of an articulatory speech output component, which is not implemented peripherally and does not require the involvement of a non-articulatory input system.     

Classifying pictures and words: Implications for the dual-coding hypothesis

In deciding that two items come from the same category, subjects were delayed if the items were presented as a word and a picture, as compared with two words or two pictures. Subjects were not delayed if the items were not to be compared. Hence, the delay appears to occur during the retrieval and comparison of know ledge about the items, not during their perceptual analysis. The results suggest that there are two distinct codes involved in the categorization of words and pictures, rather than a single code.     

Interhemispheric categorization of pictures and words

Earlier studies suggest that interhemispheric processing increases the processing power of the brain in cognitively complex tasks as it allows the brain to divide the processing load between the hemispheres. We report two experiments suggesting that this finding does not generalize to word-picture pairs: they are processed at least as efficiently when processed by a single hemisphere as compared to processing occurring between the two hemispheres. We examined whether dividing the stimuli between the visual fields/hemispheres would be more advantageous than unilateral stimulus displays in the semantic categorization of simultaneously presented pictures, words, and word-picture pairs. The results revealed that within-domain stimuli (semantically related picture pairs or word pairs) were categorized faster in bilateral than in unilateral displays, whereas cross-domain stimuli (word-picture pairs) were not categorized faster in bilateral than in unilateral displays. It is suggested that interhemispheric sharing of word-picture stimuli is not advantageous as compared to unilateral processing conditions because words and pictures use different access routes, and therefore, it may be possible to process in parallel simultaneously displayed word-picture stimuli within a single hemisphere.     

Hypermnesia for pictures: Incremental memory for pictures but not words in multiple recall trials

Two studies are reported on multiple forced recall following a single visual presentation of a sequence of pictures or words. In both experiments, a hypermnesic memory function (in which performance improved with repeated recall) was obtained for pictures, while a flat, nonincremental function was obtained for words. Interpolation of intervals of thinking between recall trials further enhanced hypermnesia for pictorial items. Retrieval, whether overt (recall trials) or covert (thinking), apparently produces increased net recovery of pictures but not words.     

Semantic classification of pictures and words

We provide new behavioural norms for semantic classification of pictures and words. The picture stimuli are 288 black and white line drawings from the International Picture Naming Project ([Székely, A., Jacobsen, T., D'Amico, S., Devescovi, A., Andonova, E., Herron, D., et al. (2004). A new on-line resource for psycholinguistic studies. Journal of Memory & Language, 51, 247–250]). We presented these pictures for classification in a living/nonliving decision, and in a separate version of the task presented the corresponding word labels for classification. We analyzed behavioural responses to a subset of the stimuli in order to explore questions about semantic processing. We found multiple semantic richness effects for both picture and word classification. Further, while lexical-level factors were related to semantic classification of words, they were not related to semantic classification of pictures. We argue that these results are consistent with privileged semantic access for pictures, and point to ways in which these data could be used to address other questions about picture processing and semantic memory.     

Situation models and retrieval interference: pictures and words

Previous studies have found that interference in long-term memory retrieval occurs when information cannot be integrated into a single situation model, but this interference is greatly reduced or absent when the information can be so integrated. The current study looked at the influence of presentation format-sentences or pictures-on this observed pattern. When sentences were used at memorisation and recognition, a spatial organisation was observed. In contrast, when pictures were used, a different pattern of results was observed. Specifically, there was an overall speed-up in response times, and consistent evidence of interference. Possible explanations for this difference were examined in a third experiment using pictures during learning, but sentences during recognition. The results from Experiment 3 were consistent with the organisation of information into situation models in long-term memory, even from pictures. This suggests that people do create situation models when learning pictures, but their recognition memory may be oriented around more "verbatim", surface-form memories of the pictures.     

Semantic facilitation with pictures and words

The present experiments explored the role of processing level and strategic factors in cross-form (word-picture and picture-word) and within-form (picture-picture and word-word) semantic facilitation. Previous studies have produced mixed results. The findings presented in this article indicate that semantic facilitation depends on the task and on the subjects' strategies. When the task required semantic processing of both picture and word targets (e.g., category verification), equivalent facilitation was obtained across all modality combinations. When the task required name processing (e.g., name verification, naming), facilitation was obtained for the picture targets. In contrast, with word targets, facilitation was obtained only when the situation emphasized semantic processing. The results are consistent with models that propose a common semantic representation for both picture and words but that also include assumptions regarding differential order of access to semantic and phonemic features for these stimulus modalities.     

Depression reduces perceptual sensitivity for positive words and pictures

There is evidence of maladaptive attentional biases for lexical information (e.g., Atchley, Ilardi, & Enloe, 2003; Atchley, Stringer, Mathias, Ilardi, & Minatrea, 2007) and for pictographic stimuli (e.g., Gotlib, Krasnoperova, Yue, & Joormann, 2004) among patients with depression. The current research looks for depressotypic processing biases among depressed out-patients and non-clinical controls, using both verbal and pictorial stimuli. A d′ measure (sensitivity index) was used to examine each participant's perceptual sensitivity threshold. Never-depressed controls evidenced a detection bias for positive picture stimuli, while depressed participants had no such bias. With verbal stimuli, depressed individuals showed specific decrements in the detection of positive person-referent words (WINNER), but not with positive non-person-referent words (SUNSHINE) or with negative words. Never-depressed participants showed no such differences across word types. In the current study, depression is characterised both by an absence of the normal positivistic biases seen in individuals without mood disorders (consistent with McCabe & Gotlib, 1995), and by a specific reduction in sensitivity for person-referent positive information that might be inconsistent with depressotypic self-schemas.     

Sex differences in memory estimates for pictures and words

Memory performance estimates of men and women before and after a recall test were investigated. College students (17 men and 20 women), all juniors, participated in a memory task involving the recall of 80 stimuli (40 pictures and 40 words). Before and after the task they were asked to provide estimates of their pre- and postrecall performance. Although no sex differences were found for total correct recall, recall for pictures, and recall for words, or in the estimates of memory performance before the recall task, there were significant differences after the test: women underestimated their performance on the words and men underestimated their performance on the picture items.     

Exploring the superadditive effects of scent and pictures on verbal recall: An extension of dual coding theory

This research extends the dual coding theory of memory retrieval (Paivio 1969, 2007) beyond its traditional focus on verbal and pictorial information to olfactory information. We manipulate the presence or absence of olfactory and pictorial stimuli at the time of encoding (study 1) or retrieval (study 2) and measure the impact on verbal recall. After a time delay, scent enhances recall of verbal information, and scent-based retrieval cues potentiate the facilitative effect of pictures on recall. These results cannot be attributed merely to increased elaboration at the time of exposure.     

Recalling pictures and words: Reversing the generation effect

Blind and sighted children’s memory for words and raised shape pictures was tested. The investigation compared performance with items when they were studied under neutral conditions (naming words and pictures) and when they were self-generated in response to cues (cue: hot ?: response: cold). The blind children could identify and name the raised shape pictures with the same apparent ease as blind-folded sighted children (as long as a cue was provided). The sighted children showed the generation effect (Slamecka and Graf, 1978) for both words and pictures, namely that self-generated items were far better recalled than neutral ones. The pattern of results for the blind children was markedly different. Although the level of memory performance overall was the same as that of the sighted controls, the congenitally blind children showed areverse generation effect. A stem completion study indicated that these results couldnot be accounted for by a relatively greater reliance on data-driven processing by the blind.     

Recognition latency for pictures and words as a function of encoded-feature similarity.

In separate trials of a same-different recognition task, a single target item presented as either a picture or a word was followed after a 30-sec delay by a single test item, either a picture or a word. Test items were either nominal matches for the target (same) or one of five related distractor items. Distractors were selected to resemble the target item on one of five dimensions: orthographic, acoustic, conceptual (functional or categorical), schematic (similar in shape), or neutral. Same-different reaction times were found to vary systematically as a function of depiction mode of target and/or test items and by distractor type. Verbally related distractors (orthographic and acoustic) produced longer reaction times when target or test items or both were presented as printed words. When target or test items were presented as pictures, schematic and conceptual distractors produced the longest rejection latencies.