What you say matters: Exploring visual–verbal interactions in visual working memory

The aim of this study was to explore whether the content of a simple concurrent verbal load task determines the extent of its interference on memory for coloured shapes. The task consisted of remembering four visual items while repeating aloud a pair of words that varied in terms of imageability and relatedness to the task set. At test, a cue appeared that was either the colour or the shape of one of the previously seen objects, with participants required to select the object's other feature from a visual array. During encoding and retention, there were four verbal load conditions: (a) a related, shape–colour pair (from outside the experimental set, i.e., “pink square”); (b) a pair of unrelated but visually imageable, concrete, words (i.e., “big elephant”); (c) a pair of unrelated and abstract words (i.e., “critical event”); and (d) no verbal load. Results showed differential effects of these verbal load conditions. In particular, imageable words (concrete and related conditions) interfered to a greater degree than abstract words. Possible implications for how visual working memory interacts with verbal memory and long-term memory are discussed.     

Contrasting cases of Italian agrammatic aphasia without comprehension disorder

This study examined the effects of different concurrent verbal memory loads on a recognition accuracy task using bilaterally presented nouns. Four different memory load conditions were examined. They varied along a size dimension of either three or six words and along a complexity dimension of either easy concrete nouns or difficult highly abstract nouns. In each of the above conditions and in one control group, order or word report was controlled and in a second control group subjects were free to report the lateralized words in any order they wished. There were 20 subjects in each of the six groups. As expected, a significant right visual field superiority for verbal processing was obtained. there were no main effects of size of memory load nor complexity of m emory load on the laterality patterns. More subtle fluctuations in the patterns were found in the form of significant interactions between memory load, order of word report, and visual field. These interaction effects suggest that words reported second in the bilateral task, are more susceptible to the interfering effects of either larger or more complex memory loads. This is particularly true for right visual field words. While these data generally support a structural model of hemispheric organization, the interaction effects suggest that modifications must be made to the basic model to account for such factors as hemispheric capacity limits and order of report in the bilateral task.     

The (lack of) effect of dynamic visual noise on the concreteness effect in short-term memory

It has been suggested that the concreteness effect in short-term memory (STM) is a consequence of concrete words having more distinctive and richer semantic representations. The generation and storage of visual codes in STM could also play a crucial role on the effect because concrete words are more imaginable than abstract words. If this were the case, the introduction of a visual interference task would be expected to disrupt recall of concrete words. A Dynamic Visual Noise (DVN) display, which has been proven to eliminate the concreteness effect on long-term memory (LTM), was presented along encoding of concrete and abstract words in a STM serial recall task. Results showed a main effect of word type, with more item errors in abstract words, a main effect of DVN, which impaired global performance due to more order errors, but no interaction, suggesting that DVN did not have any impact on the concreteness effect. These findings are discussed in terms of LTM participation through redintegration processes and in terms of the language-based models of verbal STM.     

Retrieval of pictures and words from long-term memory: Effects upon short-term memory

On each of a series of Brown-Peterson short-term memory (STM) tests, the presentation of a verbal to-be-remembered (TBR) item (a five-letter quintogram in Experiment 1 and an eight-letter octogram in Experiment 2) was followed immediately by a 10-sec retention interval. During the retention interval, subjects recalled and reproduced previously learned paired associate response triads that consisted of three concrete pictures, concrete words, abstract pictures, or abstract words. Following selective retrieval of one of the four types of response triads from long-term memory (LTM), subjects attempted to recall the TBR items from STM. In both experiments, the intervening retrieval of abstract words resulted in significantly poorer retention of the TBR items than did the intervening retrieval of concrete words; the retrieval of concrete words resulted, in turn, in significantly poorer retention of the TBR items than did the retrieval of concrete or abstract pictures. Retrieval of the latter two types of materials appeared not to interfere with the short-term retention of the TBR verbal material (i.e., the quintograms and octograms). The results reflect the occurrence of selective interference effects, and, except for one discrepant finding, appear to be consistent with Paivio’s 11971) dual-coding hypothesis and Shiffrin and Schneider’s (1977) general theory of memory.     

Effects of concreteness and semantic relatedness on composite imagery ratings and cued recall

Day and Bellezza (1983) rejected a dual coding imagery explanation for the superior recall of concrete words because unrelated concrete pairs were rated lower in composite imagery but were still remembered better than related abstract pairs. We show that dual coding theory explains their results and our new findings using the same paradigm. In Experiment 1, 120 subjects rated imagery or relatedness for 108 pairs that varied in concreteness, pair relatedness, and associative strength. Incidental cued recall followed. Relatedness and strength affected imagery ratings, as did concreteness, and very low relatedness partly accounted for the low composite imagery ratings for unrelated concrete pairs. Concreteness and relatedness also affected recall, and suporior recall for unrelated concrete pairs occurred consistently under imagery but not under relatedness instructions. In Experiment 2, 40 subjects rated imagery value and recalled 24 pairs. Subsequent questioning indicated that composite images were retrieved better given stimuli from unrelated concrete than from related abstract pairs. These findings and Day and Bellezza’s original results are explained in terms of (1) imaginal and verbal associative processes, which jointly influence composite imagery ratings and recall, and (2) the critical role of stimulus concreteness during image retrieval and recall (i.e., the conceptual peg hypothesis).     

When do visual and verbal memories conflict? The importance of working-memory load and retrieval

Examinations of interference between verbal and visual materials in working memory have produced mixed results. If there is a central form of storage (e.g., the focus of attention; N. Cowan, 2001), then cross-domain interference should be obtained. The authors examined this question with a visual-array comparison task (S. J. Luck & E. K. Vogel, 1997) combined with various verbal memory load conditions. Interference between tasks occurred if there was explicit retrieval of the verbal load during maintenance of a visual array. The effect was localized in the maintenance period of the visual task and was not the result of articulation per se. Interference also occurred when especially large silent verbal and visual loads were held concurrently. These results suggest central storage along with code-specific passive storage.     

The distinctiveness of emotion concepts: a comparison between emotion, abstract, and concrete words

Are the concepts represented by emotion words different from abstract words in memory? We examined the distinct characteristics of emotion concepts in 3 separate experiments. The first demonstrated that emotion words are better recalled than both concrete and abstract words in a free recall task. In the second experiment, ratings of abstract, concrete, and emotion words were compared on concreteness, imageability, and context availability scales. Results revealed a difference between all 3 word types on each of the 3 scales. The third experiment investigated priming in a lexical decision task for homogeneous (abstract-abstract and emotion-emotion) and heterogeneous (abstract-emotion and emotion-abstract) associated word pairs. Priming occurred only for the homogeneous and heterogeneous abstract-emotion word pair conditions. Possible explanations for these findings are discussed in terms of the circumplex, hierarchical, and semantic activation models. The results are most consistent with the predictions of the semantic activation model.     

Effects of divided attention and word concreteness on correct recall and false memory reports

Lists of thematically related words were presented to participants with or without a concurrent task. In Experiments 1 and 2, respectively, English or Spanish word lists were either low or high in concreteness (concrete vs abstract words) and were presented, respectively, auditorily or visually for study. The addition of a concurrent visual or auditory task, respectively, substantially reduced correct recall and doubled the frequency of false memory reports (nonstudied critical or theme words). Divided attention was interpreted as having reduced the opportunity for participants to monitor successfully their elicitations of critical associates. Comparisons of concrete and abstract lists revealed significantly more recalls of false memories for abstract than concrete word lists. Comparisons between two levels of attention, two levels of word concreteness, and two presentation modalities failed to support the "more is less" effect by which enhanced correct recall is accompanied by increased frequencies of false memories.     

The Calgary semantic decision project: concrete/abstract decision data for 10,000 English words

Psycholinguistic research has been advanced by the development of word recognition megastudies. For instance, the English Lexicon Project (Balota et al., 2007) provides researchers with access to naming and lexical-decision latencies for over 40,000 words. In the present work, we extended the megastudy approach to a task that emphasizes semantic processing. Using a concrete/abstract semantic decision (i.e., does the word refer to something concrete or abstract?), we collected decision latencies and accuracy rates for 10,000 English words. The stimuli were concrete and abstract words selected from Brysbaert, Warriner, and Kuperman’s (2013) comprehensive list of concreteness ratings. In total, 321 participants provided responses to 1,000 words each. Whereas semantic effects tend to be quite modest in naming and lexical decision studies, analyses of the concrete/abstract semantic decision responses show that a substantial proportion of variance can be explained by semantic variables. The item-level and trial-level data will be useful for other researchers interested in the semantic processing of concrete and abstract words.     

Automatic activation of phonological information in reading: Evidence from the semantic relatedness decision task

A semantic relatedness decision task was used to investigate whether phonological recoding occurs automatically and whether it mediates lexical access in visual word recognition and reading. In this task, subjects read a pair of words and decided whether they were related or unrelated in meaning. In Experiment 1, unrelated word-homophone pairs (e.g., LION-BARE) and their visual controls (e.g., LION-BEAN) as well as related word pairs (e.g., FISH-NET) were presented. Homophone pairs were more likely to be judged as related or more slowly rejected as unrelated than their control pairs, suggesting phonological access of word meanings. In Experiment 2, word-pseudohomophone pairs (e.g., TABLE-CHARE) and their visual controls (e.g., TABLE-CHARK) as well as related and unrelated word pairs were presented. Pseudohomophone pairs were more likely to be judged as related or more slowly rejected as unrelated than their control pairs, again suggesting automatic phonological recoding in reading.     

Visual and verbal working memory loads interfere with scene-viewing

Working memory is thought to be divided into distinct visual and verbal subsystems. Studies of visual working memory frequently use verbal working memory tasks as control conditions and/or use articulatory suppression to ensure that visual load is not transferred to verbal working memory. Using these verbal tasks relies on the assumption that the verbal working memory load will not interfere with the same processes as visual working memory. In the present study, participants maintained a visual or verbal working memory load as they simultaneously viewed scenes while their eye movements were recorded. Because eye movements and visual working memory are closely linked, we anticipated the visual load would interfere with scene-viewing (and vice versa), while the verbal load would not. Surprisingly, both visual and verbal memory loads interfered with scene-viewing behavior, while eye movements during scene-viewing did not significantly interfere with performance on either memory task. These results suggest that a verbal working memory load can interfere with eye movements in a visual task.

     

A reexamination of the role of imagery in learning and memory

Five experiments were conducted to examine whether the superior recall of concrete over abstract words might be better accounted for in terms of relative differences in the processing of relational and distinctive information rather than redundant verbal and imaginal memory codes. Concrete and abstract word pairs were presented in the standard paired-associated learning task or under conditions intended to affect the nature and extent of relational processing between pair members. Concreteness effects were attenuated or eliminated when relational processing was prevented at encoding (Experiments 3, 4, and 5) or when the use of encoded relations within pairs was prevented at recall (Experiments 1, 2, and 3). The results indicated the viability of an account of concreteness effects in paired-associate learning based on the joint functions of distinctive and relational information. They also remove theoretical constraints imposed on imagery theories by the incorrect assumption of a uniform presence of concreteness effects in memory for word lists.     

Interhemispheric inhibition, intrahemispheric activation, and lexical capacities of the right hemisphere: a tachistoscopic, divided visual-field study in normal subjects

This study proposes that the lexical-semantic capacities of the right hemisphere (RH) are underestimated in normal subjects and reexamines them in a "dynamic model" framework. As expected, overloading the left hemisphere by combining a lexical-decision task presented in divided visual field with a concurrent heavy verbal memory load, and activating the RH by combining the lexical-decision task with a concurrent visuo-imaged memory load, lead to enhanced left visual field-RH lexical performance. The RH appears to support a larger lexical-semantic network than suggested in the literature, including representations for long and nonimageable words, and the accessibility threshold for the representations stored therein is modulated by hemispheric activation-inhibition mechanisms.     

Effects of syntactic structure in the memory of concrete and abstract Chinese sentences

Smith (1981) found that concrete English sentences were better recognized than abstract sentences and that this concreteness effect was potent only when the concrete sentence was also affirmative but the effect switched to an opposite end when the concrete sentence was negative. These results were partially replicated in Experiment 1 by using materials from a very different language (i.e., Chinese): concrete-affirmative sentences were better remembered than concrete-negative and abstract sentences, but no reliable difference was found between the latter two types. In Experiment 2, the task was modified by using a visual presentation instead of an oral one as in Experiment 1. Both concrete-affirmative and concrete-negative sentences were better memorized then abstract ones in Experiment 2. The findings in the two experiments are explained by a combination of the dual-coding model and Marschark's (1985) item-specific and relational processing. The differential effects of experience with different language systems on processing verbal materials in memory are also discussed.This research was partially supported by a research grant from the Research Grants Council of Hong Kong to Hsuan-Chih Chen. Connie Suk-Han Ho was supported on an Overseas Research Studentship from the University of Oxford of United Kingdom during the preparation of this article.     

Levels of processing and picture memory: the physical superiority effect

Six experiments studied the effect of physical orienting questions (e.g., "Is this angular?") and semantic orienting questions (e.g., "Is this edible?") on memory for unrelated pictures at stimulus durations ranging from 125-2,000 ms. Results ran contrary to the semantic superiority "rule of thumb," which is based primarily on verbal memory experiments. Physical questions were associated with better free recall and cued recall of a diverse set of visual scenes (Experiments 1, 2, and 4). This occurred both when general and highly specific semantic questions were used (Experiments 1 and 2). Similar results were obtained when more simplistic visual stimuli--photographs of single objects--were used (Experiments 5 and 6). As in the case of the semantic superiority effect with words, the physical superiority effect for pictures was eliminated or reversed when the same physical questions were repeated throughout the session (Experiments 4 and 6). Conflicts with results of previous levels of processing experiments with words and nonverbal stimuli (e.g., faces) are explained in terms of the sensory-semantic model (Nelson, Reed, & McEvoy, 1977). Implications for picture memory research and the levels of processing viewpoint are discussed.     

Aging effects in sequential modulations of poorer-strategy effects during execution of memory strategies

In this study, we asked young adults and older adults to encode pairs of words. For each item, they were told which strategy to use, interactive imagery or rote repetition. Data revealed poorer-strategy effects in both young adults and older adults: Participants obtained better performance when executing better strategies (i.e., interactive-imagery strategy to encode pairs of concrete words; rote-repetition strategy on pairs of abstract words) than with poorer strategies (i.e., interactive-imagery strategy on pairs of abstract words; rote-repetition strategy on pairs of concrete words). Crucially, we showed that sequential modulations of poorer-strategy effects (i.e., poorer-strategy effects being larger when previous items were encoded with better relative to poorer strategies), previously demonstrated in arithmetic, generalise to memory strategies. We also found reduced sequential modulations of poorer-strategy effects in older adults relative to young adults. Finally, sequential modulations of poorer-strategy effects correlated with measures of cognitive control processes, suggesting that these processes underlie efficient trial-to-trial modulations during strategy execution. Differences in correlations with cognitive control processes were also found between older adults and young adults. These findings have important implications regarding mechanisms underlying memory strategy execution and age differences in memory performance.     

Concreteness effects in free recall: The roles of imaginai and relational processing

Two experiments reevaluated the possible role of mental imagery in free recall of concrete and abstract words. In Experiment 1, the number and rate of list presentations were manipulated. Incidental recall following an imagery rating task yielded reliable concreteness effects after two presentations but not after a single presentation, regardless of presentation rate. In Experiment 2, we examined the effects of relational (categorization) and item-specific (imagery rating) processing tasks on memory for categorically related or unrelated concrete and abstract words. Concreteness effects were obtained when unrelated words were sorted into categories but not when they were rated on imagery. Related words failed to yield concreteness effects under any orienting condition. The results support the view that the presence or absence of concreteness effects in free recall depends on the relative salience of distinctive and relational information. This conclusion constrains theoretical explanations of the role of mental imagery in memory and cognition.     

Planning sentences while doing other things at the same time: effects of concurrent verbal and visuospatial working memory load

This study investigated to what extent advance planning during sentence production is affected by a concurrent cognitive load. In two picture–word interference experiments in which participants produced subject–verb–object sentences while ignoring auditory distractor words, we assessed advance planning at a phonological (lexeme) and at an abstract–lexical (lemma) level under visuospatial or verbal working memory (WM) load. At the phonological level, subject and object nouns were found to be activated before speech onset with concurrent visuospatial WM load, but only subject nouns were found to be activated with concurrent verbal WM load, indicating a reduced planning scope as a function of type of WM load (Experiment 1). By contrast, at the abstract–lexical level, subject and object nouns were found to be activated regardless of type of concurrent load (Experiment 2). In both experiments, sentence planning had a more detrimental effect on concurrent verbal WM task performance than on concurrent visuospatial WM task performance. Overall, our results suggest that advance planning at the phonological level is more affected by a concurrently performed verbal WM task than advance planning at the abstract–lexical level. Also, they indicate an overlap of resources allocated to phonological planning in speech production and verbal WM.     

Concreteness effects revisited: The influence of dynamic visual noise on memory for concrete and abstract words

Two experiments are presented that investigate the effects of dynamic visual noise (DVN) on memory for concrete and abstract words. Memory for concrete words is typically superior to that of abstract words and is referred to as the concreteness effect. DVN is a procedure that has been demonstrated to interfere selectively with visual working memory and the generation of images from long-term memory. It was reasoned that if concreteness effects arise because of the ability of the latter to activate visual representations, then DVN should selectively impair memory for concrete words. Experiment 1 found DVN to selectively reduce free recall of concrete words. Experiment 2 investigated recognition memory and found DVN to reduce memory accuracy and remember responses, while increasing know responses to concrete words.     

Verbal, visual, and spatial working memory in written language production

College students wrote definitions of either abstract or concrete nouns in longhand while performing a concurrent working memory (WM) task. They detected either a verbal (syllable), visual (shape), or spatial (location) stimulus and decided whether it matched the last one presented 15-45s earlier. Writing definitions of both noun types elevated the response time to verbal targets above baseline. Such interference was observed for visual targets only when defining concrete nouns and was eliminated entirely with spatial targets. The interference effect for verbal targets was the same whether they were read or heard, implicating phonological storage. The findings suggest that language production requires phonological or verbal WM. Visual WM is selectively engaged when imaging the referents of concrete nouns.