Privileged access to action for objects relative to words

We compared action (pour or twist?) and contextual/semantic (found in kitchen?) decisions made to pictures of objects, nonobjects, and words. Although there was no advantage for objects over words in contextual/semantic decisions, there was an advantage for objects over words and nonobjects in action decisions. For objects, both action and contextual/semantic decisions were faster than naming; for words, the opposite occurred. These results extend the early results of Potter and Faulconer (1975) that there is privileged access to semantic memory for objects relative to that for words and privileged access to phonology for words. Our data suggest that, for objects, there is privileged access to action knowledge rather than to all forms of semantic knowledge and that this is contingent on learned associations between objects and actions.     

The right hemisphere maintains solution-related activation for yet-to-be-solved problems

In five experiments, we examined the time course of hemispheric differences in solution activation for insight-like problems. We propose that solving insight problems requires retrieval of unusual interpretations of problem elements, and that right-hemisphere (RH) coarse semantic coding is more likely than left-hemisphere (LH) fine semantic coding to maintain semantic activation of such interpretations. In four experiments, participants attempted word problems for 7 sec (Experiments 1A and 1B) or 2 sec (Experiments 2A and 2B), and 750 msec later responded to lateralized target words. After 7 sec of solving effort, Experiment 1A participants showed greater solution-related priming (i.e., they named solutions faster than unrelated words) for left visual field-RH (lvf-RH) targets than for right visual field-LH (rvf-LH) targets, and Experiment 1B participants made faster solution decisions on target words presented to the RH, as previously demonstrated following 15 sec of effort. After 2 sec of solving effort in Experiment 2A, women showed symmetric solution-related priming, although men showed a slight lvf-RH advantage in priming; and in Experiment 2B participants made equally quick solution decisions for targets presented to the LH and to the RH. In Experiment 3, participants viewed the problems for 1,250 msec then named lateralized target words; they showed symmetric solution-related priming. These experiments demonstrate solution activation initially in both hemispheres, but maintained solution activation only in the RH.     

Factors modulating the effect of divided attention during retrieval of words

In this study, we examined variables modulating interference effects on episodic memory under divided attention conditions during retrieval for a list of unrelated words. In Experiment 1, we found that distracting tasks that required animacy or syllable decisions to visually presented words, without a memory load, produced large interference on free recall performance. In Experiment 2, a distracting task requiring phonemic decisions about nonsense words produced a far larger interference effect than one that required semantic decisions about pictures. In Experiment 3, we replicated the effect of the nonsense-word distracting task on memory and showed that an equally resource-demanding picture-based task produced significant interference with memory retrieval, although the effect was smaller in magnitude. Taken together, the results suggest that free recall is disrupted by competition for phonological or word-form representations during retrieval and, to a lesser extent, by competition for semantic representations.     

Episodic encoding and recognition of pictures and words: role of the human medial temporal lobes

In the present PET study, we examined brain activity related to processing of pictures and printed words in episodic memory. Our goal was to determine how the perceptual format of objects (verbal versus pictorial) is reflected in the neural organization of episodic memory for common objects. We investigated this issue in relation to encoding and recognition with a particular focus on medial temporal-lobe (MTL) structures. At encoding, participants saw pictures of objects or their written names and were asked to make semantic judgments. At recognition, participants made yes-no recognition judgments in four different conditions. In two conditions, target items were pictures of objects; these objects had originally been encoded either in picture or in word format. In two other conditions, target items were words; they also denoted objects originally encoded either as pictures or as words. Our data show that right MTL structures are differentially involved in picture processing during encoding and recognition. A posterior MTL region showed higher activation in response to the presentation of pictures than of words across all conditions. During encoding, this region may be involved in setting up a representation of the perceptual information that comprises the picture. At recognition, it may play a role in guiding retrieval processes based on the perceptual input, i.e. the retrieval cue. Another more anterior right MTL region was found to be differentially involved in recognition of objects that had been encoded as pictures, irrespective of whether the retrieval cue provided was pictorial or verbal in nature; this region may be involved in accessing stored pictorial representations. Our results suggest that left MTL structures contribute to picture processing only during encoding. Some regions in the left MTL showed an involvement in semantic encoding that was picture specific; others showed a task-specific involvement across pictures and words. Together, our results provide evidence that the involvement of some but not all MTL regions in episodic encoding and recognition is format specific.     

Semantic facilitation across sensory modalities in the processing of individual words and sentences

The effect of semantic priming upon lexical decisions made for words in isolation (Experiment 1) and during sentence comprehension (Experiment 2) was investigated using a cross-modal lexical decision task. In Experiment 1, subjects made lexical decisions to both auditory and visual stimuli. Processing auditorily presented words facilitated subsequent lexical decisions on semantically related visual words. In Experiment 2, subjects comprehended auditorily presented sentences while simultaneously making lexical decisions for visually presented stimuli. Lexical decisions were facilitated when a visual word appeared immediately following a related word in the sentential material. Lexical decisions were also facilitated when the visual word appeared three syllables following closure of the clause containing the related material. Arguments are made for autonomy of semantic priming during sentence comprehension.     

Semantic priming effects on picture and word processing

The effects of semantic priming on picture and word processing were assessed under conditions in which subjects were required simply to identify stimuli (label pictures or read words) as rapidly as possible. Stimuli were presented in pairs (a prime followed by a target), with half of the pairs containing members of the same semantic category and half containing unrelated concepts. Semantic relatedness was found to facilitate the identification of both pictures (Experiment 1) and words (Experiment 2), and obtained interactions of semantic relatedness and stimulus quality in both experiments suggested that semantic priming affects the initial encoding of both types of stimuli. In Experiment 3, subjects received pairs of pictures, pairs of words, and mixed pairs composed of a picture and a word or of a word and a picture. Significant priming effects were obtained on mixed as well as unmixed pairs, supporting the assumption that pictures and words access semantic information from a common semantic store. Of primary interest was the significantly greater priming obtained in picture-picture pairs than in word-word or mixed pairs. This suggests that, in addition to priming that is mediated by the semantic system, priming may occur in picture-picture pairs that results from the overlap in visual features common to the pictorial representations of objects from the same semantic category.     

The properties of retrieval cues constrain the picture superiority effect

In three experiments, we examined why pictures are remembered better than words on explicit memory tests like recall and recognition, whereas words produce more priming than pictures on some implicit tests, such as word-fragment and word-stem completion (e.g., completing -l-ph-nt or ele----- as elephant). One possibility is that pictures are always more accessible than words if subjects are given explicit retrieval instructions. An alternative possibility is that the properties of the retrieval cues themselves constrain the retrieval processes engaged; word fragments might induce data-driven (perceptually based) retrieval, which favors words regardless of the retrieval instructions. Experiment 1 demonstrated that words were remembered better than pictures on both the word-fragment and word-stem completion tasks under both implicit and explicit retrieval conditions. In Experiment 2, pictures were recalled better than words with semantically related extralist cues. In Experiment 3, when semantic cues were combined with word fragments, pictures and words were recalled equally well under explicit retrieval conditions, but words were superior to pictures under implicit instructions. Thus, the inherently data-limited properties of fragmented words limit their use in accessing conceptual codes. Overall, the results indicate that retrieval operations are largely determined by properties of the retrieval cues under both implicit and explicit retrieval conditions.     

Picture-word differences in decision latency: a test of common-coding assumptions

Three experiments examined the processing of pictures and words in two tasks of semantic decision--judgments of conceptual size and judgments of associative relatedness--in order to test the prediction from single-coding models of memory that different semantic decisions produce comparable picture-word latency differences. In Experiment 1 an interaction in decision latency was found such that picture-picture (P-P) pairs were significantly faster than word-word (W-W) pairs in decisions of size but not in decisions of associative relatedness. In Experiment 2 no latency differences were found in decisions of association for pairs presented in P-P, W-W, or mixed (P-W or W-P) forms. Decisions of size, however, were fastest for P-P pairs, intermediate for mixed pairs, and slowest for W-W pairs. In a third experiment, using a speeded inference task, the interaction obtained in the first two experiments was reproduced. In light of these results possible revisions to common-coding assumptions about the processing of pictures and words in semantic decisions are discussed.     

Effects of semantic context in the naming of pictures and words

Two experiments investigated whether lexical retrieval for speaking can be characterized as a competitive process by assessing the effects of semantic context on picture and word naming in German. In Experiment 1 we demonstrated that pictures are named slower in the context of same-category items than in the context of items from various semantic categories, replicating findings by Kroll and Stewart (Journal of Memory and Language, 33 (1994) 149). In Experiment 2 we used words instead of pictures. Participants either named the words in the context of same- or different-category items, or produced the words together with their corresponding determiner. While in the former condition words were named faster in the context of same-category items than of different-category items, the opposite pattern was obtained for the latter condition. These findings confirm the claim that the interfering effect of semantic context reflects competition in the retrieval of lexical entries in speaking.     

Semantic distance effects on object and action naming

Graded interference effects were tested in a naming task, in parallel for objects and actions. Participants named either object or action pictures presented in the context of other pictures (blocks) that were either semantically very similar, or somewhat semantically similar or semantically dissimilar. We found that naming latencies for both object and action words were modulated by the semantic similarity between the exemplars in each block, providing evidence in both domains of graded semantic effects.     

语义相似性与类别大小对图-词干扰范式下语义效应的影响

采用基本水平命名和类别水平命名任务, 通过2个实验, 考察了图-词之间的语义相似性与类别大小对图-词干扰范式下语义效应的影响。实验1发现, 图片命名时间在语义相似性高的干扰词条件下显著快于在语义相似性低的干扰词条件下, 但这种效应只出现在基本水平命名任务中, 未出现在类别水平命名任务中。图-词之间的语义相似性高低对低熟悉图片命名影响大, 对高熟悉图片命名影响小。实验2显示, 语义关联的干扰词对图片的基本水平命名产生了语义干扰效应, 对图片的类别水平命名产生了语义促进效应。类别大小强化了语义效应：类别大, 图片的基本水平命名的语义干扰效应更大, 图片的类别水平命名的语义促进效应更强。整个研究表明, 图-词之间的语义关联的强度影响语义效应的方向, 图-词之间的语义关联的广度影响语义效应的强弱。需要结合多种理论来解释图-词之间的语义相似性和类别大小对图-词干扰范式下语义效应的影响。     

Examining lateralized semantic access using pictures

A divided visual field (DVF) experiment examined the semantic processing strategies employed by the cerebral hemispheres to determine if strategies observed with written word stimuli generalize to other media for communicating semantic information. We employed picture stimuli and vary the degree of semantic relatedness between the picture pairs. Participants made an on-line semantic relatedness judgment in response to sequentially presented pictures. We found that when pictures are presented to the right hemisphere responses are generally more accurate than the left hemisphere for semantic relatedness judgments for picture pairs. Furthermore, consistent with earlier DVF studies employing words, we conclude that the RH is better at accessing or maintaining access to information that has a weak or more remote semantic relationship. We also found evidence of faster access for pictures presented to the LH in the strongly-related condition. Overall, these results are consistent with earlier DVF word studies that argue that the cerebral hemispheres each play an important and separable role during semantic retrieval.     

Semantic and visual relatedness of distractors impairs episodic retrieval of pictures in a divided attention paradigm

We used a divided attention (DA) paradigm to infer the representational codes needed to support episodic retrieval of pictures, by measuring susceptibility to memory interference from different distracting tasks. Participants made recognition memory decisions to semantically categorized sets of pictures while simultaneously making size judgments to a set of visually-presented distractor pictures. Recognition accuracy was worse and response times were slower under DA conditions relative to full attention (FA), regardless of semantic relatedness of distractors to targets (Experiment 1). Similarly, we found no differential memory interference under DA relative to FA when distractor pictures were either visually (but not semantically), semantically (but not visually), or unrelated to the targets (Experiment 2). In Experiment 3, memory interference was significantly larger under DA at retrieval when distractors were both semantically and visually similar to the targets. Findings suggest episodic memory for pictures requires access to either visually- or semantically-based representations for optimal performance.     

空间隐喻和形状变化对物体内隐时间概念加工的影响

通过2个实验, 考察了空间隐喻和形状变化对物体内隐时间概念加工的影响。实验1通过对隐含时间关系的词对的语义相关判断发现, 形状变化物体隐含的“先前/后来”的时间概念与“左/右”的空间概念存在着对应关系, 断裂式变化(形状变化大)的物体比渐进式变化(形状变化小)的物体激发了更加明显的时间变化感, 但物体形状变化类型并未明显地影响对词对语义相关判断的速度和准确性。实验2通过对隐含时间关系的物体图片对的语义相关判断发现, 物体形状变化隐含的“先前/后来”的时间概念与“左/右”的空间概念亦存在着对应关系, 而且物体形状变化类型影响对物体图片对语义相关判断的速度和准确性, 被试对渐进式变化物体的语义相关判断显著快于对断裂式变化物体的语义相关判断, 错误率亦低。整个研究表明, 在物体形状变化内隐时间概念的表征中, 既存在着抽象的符号表征, 又存在着具体的形状知觉表征。研究结果支持概念双加工理论的预言。     

物体的空间关系对语义相关判断的影响

采取快速语义判断任务探讨物体空间关系对语义相关判断的影响。实验1考察词对呈现方式与其指称物空间次序经验的关系对语义相关判断的影响。结果表明,词对呈现位置与其指称物的一般空间次序经验一致时语义判断快。实验2探讨词对呈现方式与其指称物构成方式的关系对语义相关判断的影响。结果表明,词对呈现方式与其指称物的构成方式一致时语义判断快。研究结果支持了知觉符号理论。     

Serial position effects in the recall of picture sequences

Sequences of 10 pictures of familiar objects were presented for immediate recall, and typically bow-shaped serial position curves were obtained. The effects of redundant stimulus suffixes, and of redundant stimulus prefixes, which could be either extra pictures, or written words (the names of similar familiar objects) were examined. In the prefix conditions, extra words produced a general decrement over positions 1-4, as compared with a control condition. Picture prefixes had no effect. In the suffix conditions, redundant words affected positions 9 and 10, whereas the main effect of redundant pictures was at positions 8 and 9. The differential serial position effects are taken to reflect the presence of two memory codes, a verbal one and a visual one, which vary in trace-strength or accessibility at different list positions.     

You’re looking for what? Comparing search for familiar,nameable objects to search for unfamiliar,novel objects

Searching for items in one’s environment often includes considerable reliance on semantic knowledge. The present study examines the importance of semantic information in visual and memory search, especially with respect to whether the items reside in long-term or working memory. In Experiment 1, participants engaged in hybrid visual memory search for items that were either highly familiar or novel. Importantly, the relatively large number of targets in this hybrid search task necessitated that targets be stored in some form of long-term memory. We found that search for familiar objects was more efficient than search for novel objects. In Experiment 2, we investigated search for familiar versus novel objects when the number of targets was low enough to be stored in working memory. We also manipulated how often participants in Experiment 2 were required to update their target (every trial vs. every block) in order to control for target templates that were stored in long-term memory as a result of repeated exposure over trials. We found no differences in search efficiency for familiar versus novel objects when templates were stored in working memory. Our results suggest that while semantic information may provide additional individuating features that are useful for object recognition in hybrid search, this information could be irrelevant or even distracting when searching for targets stored in working memory.     

Action relations, semantic relations, and familiarity of spatial position in Balint’s syndrome: Crossover effects on perceptual report and on localization

We contrasted effects of the action relationship between objects, relative to effects of semantic relation and familiarity of spatial location, in a patient with Balint’s syndrome. We found enhanced perceptual report of objects placed in the correct colocations for action in comparison with when the objects (1) were placed in incorrect locations for action (Experiment 1), (2) were associatively related (Experiment 2), or (3) fell in familiar locations but were not action related (Experiment 4). In contrast, the ability to localize the objects was affected by whether the objects were in familiar as opposed to unfamiliar locations with respect to one another. Action relations between objects facilitate joint attention to both objects but do not facilitate binding to location. Familiar spatial relations facilitate spatial binding, but do not cue joint attention to the stimuli. Effects of action relation on attention and localization can be dissociated from effects of semantic relationship and familiarity of spatial location on attention and localization.     

Grasping objects by their handles: a necessary interaction between cognition and action

Research has illustrated dissociations between "cognitive" and "action" systems, suggesting that different representations may underlie phenomenal experience and visuomotor behavior. However, these systems also interact. The present studies show a necessary interaction when semantic processing of an object is required for an appropriate action. Experiment 1 demonstrated that a semantic task interfered with grasping objects appropriately by their handles, but a visuospatial task did not. Experiment 2 assessed performance on a visuomotor task that had no semantic component and showed a reversal of the effects of the concurrent tasks. In Experiment 3, variations on concurrent word tasks suggested that retrieval of semantic information was necessary for appropriate grasping. In all, without semantic processing, the visuomotor system can direct the effective grasp of an object, but not in a manner that is appropriate for its use.