Developmental changes in the semantic processing of pictures and words

Second- and fifth-graders' semantic decision times for pictures and words were analyzed relative to the predictions derived from unitary- and dual-memory models. At both grade levels, word-word response latencies were greater than picture-word latencies which, in turn, were greater than picture-picture latencies. An interaction between Grade and Condition indicated that verbal access times decreased more than pictorial access times. The data fit the predictions of a memory model postulating category storage in a single memory system as opposed to simultaneous representation in verbal and nonverbal memory systems. It was concluded that with increasing experience verbal access to this single semantic system is more rapid.     

Electrophysiological differences in the processing of affective information in words and pictures

It is generally assumed that affective picture viewing is related to higher levels of physiological arousal than is the reading of emotional words. However, this assertion is based mainly on studies in which the processing of either words or pictures has been investigated under heterogenic conditions. Positive, negative, relaxing, neutral, and background (stimulus fragments) words and pictures were presented to subjects in two experiments under equivalent experimental conditions. In Experiment 1, neutral words elicited an enhanced late positive component (LPC) that was associated with an increased difficulty in discriminating neutral from background stimuli. In Experiment 2, high-arousing pictures elicited an enhanced early negativity and LPC that were related to a facilitated processing for these stimuli. Thus, it seems that under some circumstances, the processing of affective information captures attention only with more biologically relevant stimuli. Also, these data might be better interpreted on the basis of those models that postulate a different access to affective information for words and pictures.     

Training metric accuracy in distance estimation skill: pictures versus words

Training metric accuracy in distance estimation skill for distances up to 300 m was done using three different feedback methods: Direct verbal feedback in the field, indirect visual feedback consisting of presentation of labelled markers in the field, and indirect visual feedback consisting of presentation of labelled markers in pictorial depictions of the field. Results from Experiment 1 showed that all three feedback methods resulted in rapid acquisition of skill in estimating perceived distance from a stationary viewpoint and that the skill transferred to a new field setting. Results from Experiment 2 replicated these results for the estimation of traversed distance along routes. These findings have important implications for the use of pictorial presentations, including virtual reality technology, to train generalizable spatial skills. Copyright © 2006 John Wiley & Sons, Ltd.     

Interhemispheric categorization of pictures and words

Earlier studies suggest that interhemispheric processing increases the processing power of the brain in cognitively complex tasks as it allows the brain to divide the processing load between the hemispheres. We report two experiments suggesting that this finding does not generalize to word-picture pairs: they are processed at least as efficiently when processed by a single hemisphere as compared to processing occurring between the two hemispheres. We examined whether dividing the stimuli between the visual fields/hemispheres would be more advantageous than unilateral stimulus displays in the semantic categorization of simultaneously presented pictures, words, and word-picture pairs. The results revealed that within-domain stimuli (semantically related picture pairs or word pairs) were categorized faster in bilateral than in unilateral displays, whereas cross-domain stimuli (word-picture pairs) were not categorized faster in bilateral than in unilateral displays. It is suggested that interhemispheric sharing of word-picture stimuli is not advantageous as compared to unilateral processing conditions because words and pictures use different access routes, and therefore, it may be possible to process in parallel simultaneously displayed word-picture stimuli within a single hemisphere.     

Semantic classification of pictures and words

We provide new behavioural norms for semantic classification of pictures and words. The picture stimuli are 288 black and white line drawings from the International Picture Naming Project ([Székely, A., Jacobsen, T., D'Amico, S., Devescovi, A., Andonova, E., Herron, D., et al. (2004). A new on-line resource for psycholinguistic studies. Journal of Memory & Language, 51, 247–250]). We presented these pictures for classification in a living/nonliving decision, and in a separate version of the task presented the corresponding word labels for classification. We analyzed behavioural responses to a subset of the stimuli in order to explore questions about semantic processing. We found multiple semantic richness effects for both picture and word classification. Further, while lexical-level factors were related to semantic classification of words, they were not related to semantic classification of pictures. We argue that these results are consistent with privileged semantic access for pictures, and point to ways in which these data could be used to address other questions about picture processing and semantic memory.     

Parallel processing of whole words and morphemes in visual word recognition

Models of morphological processing make different predictions about whether morphologically complex written words are initially decomposed and recognized on the basis of their morphemic subunits or whether they can directly be accessed as whole words and at what point semantics begin to influence morphological processing. In this study, we used unprimed and masked primed lexical decision to compare truly suffixed (darkest) and pseudosuffixed words (glossary) with within-boundary (d ra kest/g ol ssary) to across-boundary (dar ek st/glos as ry) letter transpositions. Significant transposed-letter similarity effects were found independently of the morphological position of the letter transposition, demonstrating that, in English, morphologically complex whole-word representations can be directly accessed at initial word processing stages. In a third masked primed lexical decision experiment, the same materials were used in the context of stem target priming, and it was found that truly suffixed primes facilitate the recognition of their stem-target (darkest–DARK) to the same extent as pseudosuffixed primes (glossary–GLOSS), which is consistent with theories of early morpho-orthographic decomposition. Taken together, our findings provide evidence for both whole-word access and morphological decomposition at initial stages of visual word recognition and are discussed in the context of a hybrid account.     

Parallel processing of whole words and morphemes in visual word recognition

Models of morphological processing make different predictions about whether morphologically complex written words are initially decomposed and recognized on the basis of their morphemic subunits or whether they can directly be accessed as whole words and at what point semantics begin to influence morphological processing. In this study, we used unprimed and masked primed lexical decision to compare truly suffixed (darkest) and pseudosuffixed words (glossary) with within-boundary (d ra kest/g ol ssary) to across-boundary (dar ek st/glos as ry) letter transpositions. Significant transposed-letter similarity effects were found independently of the morphological position of the letter transposition, demonstrating that, in English, morphologically complex whole-word representations can be directly accessed at initial word processing stages. In a third masked primed lexical decision experiment, the same materials were used in the context of stem target priming, and it was found that truly suffixed primes facilitate the recognition of their stem-target (darkest-DARK) to the same extent as pseudosuffixed primes (glossary-GLOSS), which is consistent with theories of early morpho-orthographic decomposition. Taken together, our findings provide evidence for both whole-word access and morphological decomposition at initial stages of visual word recognition and are discussed in the context of a hybrid account.     

Semantic facilitation with pictures and words

The present experiments explored the role of processing level and strategic factors in cross-form (word-picture and picture-word) and within-form (picture-picture and word-word) semantic facilitation. Previous studies have produced mixed results. The findings presented in this article indicate that semantic facilitation depends on the task and on the subjects' strategies. When the task required semantic processing of both picture and word targets (e.g., category verification), equivalent facilitation was obtained across all modality combinations. When the task required name processing (e.g., name verification, naming), facilitation was obtained for the picture targets. In contrast, with word targets, facilitation was obtained only when the situation emphasized semantic processing. The results are consistent with models that propose a common semantic representation for both picture and words but that also include assumptions regarding differential order of access to semantic and phonemic features for these stimulus modalities.     

Test expectancy and encoding of pictures and words

Undergraduates were shown pictures or corresponding labels and then were tested for recognition either in the same mode or in a cross-over mode. Significantly more items were recognized in the picture-picture condition than in the picture-word and word-picture conditions. Informing subjects in advance of the change in modality significantly improved picture-word performance.     

Selective disruption of hypermnesia for pictures and words

In this study, we investigated the effects of various interpolated tasks on hypermnesia (improved recall across repeated tests) for pictures and words. In five experiments, subjects studied either pictures or words and then completed two free-recall tests, with varying activities interpolated between the tests. The tasks performed between tests were varied to test several hypotheses concerning the possible factor(s) responsible for disruption of the hypermnesic effect. In each experiment, hypermnesia was obtained in a control condition in which there was no interpolated task between tests. The remaining conditions showed that the effect of the interpolated tasks was related to the overlap of the cognitive processes involved in encoding the target items and performing the interpolated tasks. When pictures were used as the target items, no hypermnesia was obtained when subjects engaged in imaginal processing interpolated tasks, even when these tasks involved materials that were very distinct from the target items. When words were used as the target items, no hypermnesia was obtained when the interpolated tasks required verbal/linguistic processing, even when the items used in these tasks were auditorily presented. The results are discussed in terms of a strength-based model of associative memory.     

Hunting for individual differences in cognitive processes: Verbal ability and semantic processing of pictures and words

Semantic category decisions were examined for single picture and word stimuli. Consistent with previous research, pictures yielded faster latencies than words and both showed significant taxonomic frequency effects for positive decisions. The results are interpreted in terms of general models for semantic verification, in which both pictures and words involve access to the same underlying semantic knowledge base. The latter conclusion was supported by correlation-regression analyses on individual item latencies. Variations in processing latency as a function of stimulus mode, taxonomic frequency, and type of decision were analyzed with respect to adult individual differences in verbal ability, The results uniformly failed to show a significant relationship between verbal ability and any processing speed measure. The lack of any significant relationship is discussed in light of previous results on verbal ability and processing speed, suggesting obvious qualifications of past results and possible reinterpretations of the meaning of previously obtained speed differences.     

Developmental differences in frequency judgments of words and pictures

Children in kindergarten, third, and fifth grades were presented a list of either pictures or words (with items presented for varying numbers of times on the study trial). In both picture and word conditions, half of the Ss estimated how many times each item had been presented (absolute judgments) and the other half judged which of two items had occurred more often on the study trial (relative judgments). The primary finding was that while frequency judgment performance improved with age for both pictures and words, there was relatively greater improvement for pictures (i.e., the picture-word difference increased with age). These results lend strong support to the frequency theory of discrimination learning and, in particular, may be useful in accounting for effects associated with age and with age by stimulus mode interactions.     

Item-cued directed forgetting of related words and pictures in children and adults: selective rehearsal versus cognitive inhibition

The main purpose of this study was to compare the relative importance of selective rehearsal and cognitive inhibition in accounting for developmental changes in the directed-forgetting paradigm developed by R. A. Bjork (1972). In two experiments, children in Grades 2 and 5 and college students were asked to remember some words or pictures and to forget others when items were categorically related. Their memory for both items and the associated remember or forget cues was then tested with recall and recognition. Fifth graders recognized more of the forget-cued words than college students did. The pattern of results suggested that age differences in rehearsal and source monitoring (i.e., remembering whether a word had been cued remember or forget) were better explanatory mechanisms for children's forgetting inefficiencies than retrieval inhibition was. The results are discussed in terms of a multiple process view of inhibition.     

Situation models and retrieval interference: pictures and words

Previous studies have found that interference in long-term memory retrieval occurs when information cannot be integrated into a single situation model, but this interference is greatly reduced or absent when the information can be so integrated. The current study looked at the influence of presentation format-sentences or pictures-on this observed pattern. When sentences were used at memorisation and recognition, a spatial organisation was observed. In contrast, when pictures were used, a different pattern of results was observed. Specifically, there was an overall speed-up in response times, and consistent evidence of interference. Possible explanations for this difference were examined in a third experiment using pictures during learning, but sentences during recognition. The results from Experiment 3 were consistent with the organisation of information into situation models in long-term memory, even from pictures. This suggests that people do create situation models when learning pictures, but their recognition memory may be oriented around more "verbatim", surface-form memories of the pictures.     

Dual coding versus relational processing in memory for concrete and abstract words

In two experiments, participants judged whether nouns fitted particular sentence frames and then received an unanticipated recall test with the sentence frames as cues. Concrete nouns were better recalled than abstract nouns, and nouns presented in meaningful sentence frames were better recalled than nouns presented in anomalous sentence frames. In Experiment 2, performance in a test of free recall was positively related to the concreteness of the nouns but unrelated to the meaningfulness of the sentence frames. The increase in performance from free recall to cued recall was positively related to the meaningfulness of the sentence frames but not significantly related to the concreteness of the nouns. The effects of concreteness and meaningfulness showed no sign of any interaction either in their effects on recall performance or in their effects on the advantage of cued recall over free recall. These results are consistent with the dual-coding theory of imagery and verbal processes but are not consistent with either of two different interpretations of the relational-distinctiveness processing theory.     

Imagery ability and the identification of fragmented pictures and words

High and low imagery individuals completed two paper-and-pencil identification tasks involving fragmented pictures and fragmented words. Although a trend was present for spatial measures of imagery ability to correlate more highly with picture than with word identification, high imagers nevertheless surpassed low imagers on both tasks. An interpretation emphasizing the spatial-imaginal demands of both tasks is suggested. Significant correlations between word identification and some verbal measures, as well as self-reported imagery, may have resulted from the differential priming of verbal and imaginal strategies following subtle procedural changes in the two experiments described.