SEMANTIC NETWORKS IN THE DIVIDED CEREBRAL HEMISPHERES

Abstract— Hemispheric differences in the recognition and manipulation of meaning may be based on distinctions in size, composition, or organization of the right and left semantic networks. The present study describes these features of pictorially based semantic networks in 3 subjects with complete forebrain commissurotomy. Stimuli were presented for prolonged viewing to the left and right visual hemifields. For each trial, the subjects chose from a 20-choice array all pictures that were associated with a target, then indicated the member of each pair of chosen associates that was more closely related to the target. The hemispheres' networks were found to be of similar size and composition, but were organized differently. The right hemisphere more often produced linear rankings of semantic associates to a target than did the left, and rankings by the two hemispheres were not strongly correlated. Hemispheric differences in semantic organization mirror differences in perceptual organization, with the right hemisphere specialized for conventional meaning and the left hemisphere specialized for detecting and processing deviations from standard meaning.     

The effect of colour congruency on shape discriminations of novel objects

Although visual object recognition is primarily shape driven, colour assists the recognition of some objects. It is unclear, however, just how colour information is coded with respect to shape in long-term memory and how the availability of colour in the visual image facilitates object recognition. We examined the role of colour in the recognition of novel, 3-D objects by manipulating the congruency of object colour across the study and test phases, using an old/new shape-identification task. In experiment 1, we found that participants were faster at correctly identifying old objects on the basis of shape information when these objects were presented in their original colour, rather than in a different colour. In experiments 2 and 3, we found that participants were faster at correctly identifying old objects on the basis of shape information when these objects were presented with their original part-colour conjunctions, rather than in different or in reversed part-colour conjunctions. In experiment 4, we found that participants were quite poor at the verbal recall of part-colour conjunctions for correctly identified old objects, presented as grey-scale images at test. In experiment 5, we found that participants were significantly slower at correctly identifying old objects when object colour was incongruent across study and test, than when background colour was incongruent across study and test. The results of these experiments suggest that both shape and colour information are stored as part of the long-term representation of these novel objects. Results are discussed in terms of how colour might be coded with respect to shape in stored object representations.     

Items on the left are better remembered

Neurologically intact individuals show a spatial processing bias in perception tasks, specifically showing a bias towards the left in bisecting lines. We present evidence for a novel finding that a leftwards bias occurs in short-term memory for recently presented arbitrary bindings of visual features. Three experiments are reported, two of which involve a total of over 60,000 participants with a small number of trials for each. Experiment 3 involved a larger number of trials for each of 144 participants. Participants reproduced from immediate memory arrays of shape–colour–location bindings. In all three experiments, significantly more errors were observed in reproduction of items presented on the right of the array than on the left. Results could not be accounted for by perceptual errors, or by order of presentation or order of reproduction. Findings suggest that items presented on the left are better remembered, indicating a spatial asymmetry in forming or retrieving feature bindings in visual short-term memory.     

No sex differences in spatial location memory for abstract designs

Previous research has demonstrated a female advantage, albeit imperfectly, on tests of object location memory where object identity information is readily available. However, spatial and visual elements are often confounded in the experimental tasks used. Here spatial and visual memory performance was compared in 30 men and 30 women by presenting 12 abstract designs in a spatial array for recall and recognition (visual memory) and spatial location ("object" location memory). Object location memory was measured via a sensitive absolute displacement score defined as the distance in mms between the position assigned to the object during recall and the actual position it originally occupied. There were no sex differences in either the visual or spatial location tests. Controlling for age and estimated IQ scores made no impact on the results. These data suggest an absence of a sex difference in purely visual and spatial aspects of object location memory.     

Imagined haptic exploration in judgments of object properties

In Experiment 1, each subject rated a single, named object for its roughness, hardness, temperature, weight, size, or shape. In Experiment 2, each subject compared one pair of objects along the same dimensions. In both studies, a substantial proportion of subjects who judged the first four dimensions imagined a hand making exploratory movements appropriate for the designated information. The proportion of hand-exploration images decreased substantially when judging size or shape, or when judgments could be made readily through general semantic knowledge. The results suggest that the incorporation of haptic exploration into visual imagery provides access to information about haptically accessible object properties.     

The effects of individual differences in test anxiety and type of orienting task on levels of organization in free recall

In Experiment 1, high and low test-anxious subjects recalled a list composed of words that could be organized either by taxonomic categories or first letters. High-anxiety subjects showed less recall and conceptual clustering. There was no anxiety difference in alphabetic clustering, but low-anxiety subjects used alphabetic clusters to bridge transitions between conceptual categories more often than did high-anxiety subjects. An initial orienting task which required semantic processing reduced the recall deficit for high-anxiety subjects but not the clustering deficit. Low-anxiety subjects seemed minimally affected by a nonsemantic-orienting task. Experiment 2 used a list that could be organized by associates or rhymes. High-anxiety subjects recalled less and exhibited less clustering of both types. The nonsemantic-orienting task depressed performance for both anxiety levels, though the effect was somewhat greater for high-anxiety subjects. Overall, these results provide little evidence to support the hypothesis that high-anxiety subjects process differently only for semantic content, but methodological limitations preclude unequivocally rejecting that view.     

Changes in colour and location as cues of generative transmission in perception of causality

Observers viewed modified launching effect displays containing a spatial gap between the final location of the launcher (a black square) and the initial location of the target (a black outline square with a white interior). In some conditions, a set of stationary objects (black outline squares with white interiors) filled the spatial gap, and these objects began changing colour upon contact from the launcher. The colour changes could involve all gap objects turning black, the first gap object turning dark grey and subsequent gap objects turning successively lighter grey, or first gap object turning light grey and subsequent gap objects turning successively darker grey. The colour changes could move from the launcher to the target or from the target to the launcher. The gap objects could also remain unchanged. Participants rated whether the launcher caused subsequent motion of the target and how much force the launcher imparted to the target. The sequence of colour changes, and the sequence of locations in which colour changes occurred, influenced ratings; sequences of colour changes consistent with the idea that influence of the launcher was transmitted across gap objects to the target resulted in higher ratings. Implications for visual perception of causality are discussed.     

Perceptual processing in dichotic listening.

Subjects heard two lists of 4 items each presented simultaneously to the two ears at a rate of four pairs of items per sec. A recall cue presented immediately after the test list signalled report of 4 of the 8 items. In recall by spatial location, the cue indicated whether the items on the right ear on left ear should be recalled. In recall by category name, the cue indicated the superset category (e.g., letters or words) of the items to be recalled. Recall by spatial location was not significantly different than recall by category name. This results argues against the idea of a preperceptual auditory storage that holds information along spatial channels for 1 or 2 sec. The final experiment showed that recall by spatial location is significantly better than recall by category name when the report cue is given before, not after, the list presentation. These results show that spatial location can be used to enhance semantic processing and/or memory of 1 of 2 simultaneous items, but only if the relevant location is known at the time of the item presentation.     

Endogenous shifts of covert attention operate within multiple coordinate frames: evidence from a feature-priming task

The locations of visual objects and events in the world are represented in a number of different coordinate frameworks. For example, a visual transient is known to attract (exogenous) attention and facilitate performance within an egocentric framework. However, when attention is allocated voluntarily to a particular visual feature (ie endogenous attention), the location of that feature appears to be variously encoded either within an allocentric framework or in a spatially invariant manner. In three experiments we investigated the importance of location for the allocation of endogenous attention and whether egocentric and/or allocentric spatial frameworks are involved. Primes and targets were presented in four conditions designed to vary systematically their spatial relationships in egocentric and allocentric coordinates. A reliable effect of egocentric priming was found in all three experiments, which suggests that endogenous shifts of attention towards targets defined by a particular feature operate in an egocentric representation of visual space. In addition, allocentric priming was also found for targets primed by their colour or shape. This suggests that attending to targets primed by nonspatial attributes results in facilitation that is localised in more than one coordinate frame of spatial reference.     

A viewpoint-independent process for spatial reorientation

Reorientation tasks, in which disoriented participants attempt to relocate objects using different visual cues, have previously been understood to depend on representing aspects of the global organisation of the space, for example its major axis for judgements based on geometry. Careful analysis of the visual information available for these tasks shows that successful performance could be based on the much simpler process of storing a visual ‘snapshot’ at the target location, and subsequently moving in order to match it. We tested 4-8-year olds on a new spatial reorientation task that could not be solved based on information directly contained in any retinal projection that they had been exposed to, but required participants to infer how the space is structured. Only 6-8-year olds showed flexible recall from novel viewpoints. Five-year olds were able to recall locations given movement information or a unique proximal landmark, but without these they could not do so, even when they were not disoriented or when the landmark was a familiar object. These results indicate that early developing spatial abilities based on view matching and self motion are supplemented by a later-developing process that takes into account the structure of spatial layouts and so enables flexible recall from arbitrary viewpoints.     

固定位置区域提示下视觉注意范围等级的ERP研究

研究视觉空间注意中注意范围的脑内时程的动态变化。被试为 14名青年人 ,使用固定位置的、3种不同直径的线圈作为注意范围的区域性提示 ,祛除空间定位因素的影响 ,记录反应时和事件相关电位 (ERP)数据。结果显示 :提示范围由小到中等时 ,反应时延长 ,而由中等到大范围时 ,反应时缩短 ;提示物和靶刺激诱发ERP的早成分 (N1、P1)不受提示范围大小的调节 ,而其P2、N2的波幅与潜伏期均明显受到提示范围大小的影响。这些结果说明 :①视觉注意诱发的P1、N1成分 ,主要与空间定位信息的加工相关 ;②提示物诱发的P2、N2成分与注意范围相关 ;③在视觉信息加工过程中 ,空间位置的信息要早于其它信息被加工 ,支持视觉信息串行加工观点     

The representation of objects and their attributes in memory: Evidence concerning memory for location

The general principle is advanced that different attributes of objects (e.g. shape and colour) are more readily associated when they are attributes of the same object than when they are attributes of different objects. Previous studies provide support for the principle, for they have shown that a shape is more readily associated with its own colour than, for example, with the colour of its background. In the present experiments, the principle was applied to the attributes of shape and location. In four experiments it was shown that a shape was more readily associated with its own location than with the location of another object. Differences in contiguity between the presentation of the shape and the location with which the shape was to be associated were controlled for, as were other factors. The results were interpreted as providing support for the general principle stated above. It was suggested that the general principle could be explained by supposing that memory is propositional in format.     

The organization of conceptual knowledge: the evidence from category-specific semantic deficits

Questions about the organization of conceptual knowledge in the human brain can be addressed by studying patients with category-specific semantic deficits: disproportionate and even selective impairment of conceptual knowledge of one category of objects compared with other categories. Recently, consensus has emerged regarding the basic facts of category-specific semantic deficits: (1) the categories that can be disproportionately impaired or spared are 'animals', 'fruit/vegetables', and 'artifacts'; and (2) category-specific semantic deficits are not associated with disproportionate deficits for a type or modality of knowledge. Together with findings in functional neuroimaging, these data indicate a complex organization of conceptual knowledge characterized by several independent dimensions of organization.     

A note on the development of recall of spatial location

Recall of spatial location was studied with 5, 8, 12--13, and 17--18 year old subjects. Pictures of objects were shown one at a time in one of the four quadrants of a projection screen which was either blank (NF) or divided by a cross into four quadrants (F). The presence of the frame (F) did not affect item recall, but facilitated location recall more, the younger the subjects. Intentional learning of location was superior to incidental learning in the youngest but not in older children. The results are in agreement with Bryant's (1974) analysis of perceptual development which emphasizes the use of external spatial frames of reference in the encoding of attributes of visual objects in young children.     

Mental simulation of four visual object properties: similarities and differences as assessed by the sentence–picture verification task

In the sentence–picture verification (SPV) task, people read sentences implying the shape/size/colour/orientation of objects. They then verify whether pictured objects, which either match or mismatch the implied visual information mentioned in the sentence. Faster verification times on matching trials (match advantage) are considered supportive to the notion that readers perform mental simulations during sentence comprehension. This study advances this work by applying a within-subjects design to the SPV-task, enabling us to directly address the strength of and correlation between the match advantages for the properties shape, size, colour, and orientation. Results showed varying match advantages with colour showing the strongest effect, and no match advantage for orientation. Shape, size, and colour were significantly correlated, whereas there were no significant correlations with orientation. These findings suggest that interpretations of match advantages could benefit from a re-evaluation of mental simulation accountsby distinguishing between intrinsic (shape, size, and colour) and extrinsic (orientation) object properties.     

Dorsal stream activation during retrieval of object size and shape

We investigated dorsal visual stream involvement in the retrieval of a variety of visual attributes of common objects, using functional magnetic resonance imaging. Seven subjects made binary decisions about the shape, color, and size of named objects during scanning. Bilateral parietal activity was significantly greater during retrieval of shape and size information than during retrieval of color information. Consistent with a domain-specific distributed model of semantic organization, the finding that dorsal stream activity is associated with size and shape retrieval, as compared with color retrieval, may indicate that both size and shape information are learned partly through dorsally mediated processes, such as visually guided grasping. These results demonstrate that both visual-processing streams (i.e., the ventral “what” pathway and the dorsal “where” pathway) are involved in the storage and/or retrieval of knowledge of object appearance but that, just as in vision, these two pathways may play different roles in conceptual processing.     

Effects of verbal and nonverbal interference on spatial and object visual working memory

We tested the hypothesis that a verbal coding mechanism is necessarily engaged by object, but not spatial, visual working memory tasks. We employed a dual-task procedure that paired n-back working memory tasks with domain-specific distractor trials inserted into each interstimulus interval of the n-back tasks. In two experiments, object n-back performance demonstrated greater sensitivity to verbal distraction, whereas spatial n-back performance demonstrated greater sensitivity to motion distraction. Visual object and spatial working memory may differ fundamentally in that the mnemonic representation of featural characteristics of objects incorporates a verbal (perhaps semantic) code, whereas the mnemonic representation of the location of objects does not. Thus, the processes supporting working memory for these two types of information may differ in more ways than those dictated by the "what/where" organization of the visual system, a fact more easily reconciled with a component process than a memory systems account of working memory function.     

Looking for meaning: Eye movements are sensitive to overlapping semantic features, not association

Theories of semantic memory differ in the extent to which relationships among concepts are captured via associative or via semantic relatedness. We examined the contributions of these two factors, using a visual world paradigm in which participants selected the named object from a four-picture display. We controlled for semantic relatedness while manipulating associative strength by using the visual world paradigm’s analogue to presenting asymmetrically associated pairs in either their forward or backward associative direction (e.g., ham—eggs vs. eggs—ham). Semantically related objects were preferentially fixated regardless of the direction of presentation (and the effect size was unchanged by presentation direction). However, when pairs were associated but not semantically related (e.g., iceberg—lettuce), associated objects were not preferentially fixated in either direction. These findings lend support to theories in which semantic memory is organized according to semantic relatedness (e.g., distributed models) and suggest that association by itself has little effect on this organization.     

Children’s scale errors are a natural consequence of learning to associate objects with actions: A computational model

Young children sometimes attempt an action on an object, which is inappropriate because of the object size—they make scale errors. Existing theories suggest that scale errors may result from immaturities in children's action planning system, which might be overpowered by increased complexity of object representations or developing teleofunctional bias. We used computational modelling to emulate children's learning to associate objects with actions and to select appropriate actions, given object shape and size. A computational Developmental Deep Model of Action and Naming (DDMAN) was built on the dual‐route theory of action selection, in which actions on objects are selected via a direct (nonsemantic or visual) route or an indirect (semantic) route. As in case of children, DDMAN produced scale errors: the number of errors was high at the beginning of training and decreased linearly but did not disappear completely. Inspection of emerging object–action associations revealed that these were coarsely organized by shape, hence leading DDMAN to initially select actions based on shape rather than size. With experience, DDMAN gradually learned to use size in addition to shape when selecting actions. Overall, our simulations demonstrate that children's scale errors are a natural consequence of learning to associate objects with actions.