汉语句子理解中物体隐含颜色心理模拟的ERPs研究

当前研究采用事件相关电位(ERPs)技术,同时沿用经典的句图匹配范式,考察句子理解中物体典型颜色与非典型颜色的心理加工过程在脑电活动上的反映。实验中被试先阅读句子再判断句子后呈现的图片物体是否在句子中出现过,句子中隐含的物体颜色或是关键物体的典型颜色或是非典型颜色。实验结果发现,典型颜色句子版本下句图不匹配条件比句图匹配条件引发了更大的N400效应;而非典型颜色句子版本下两者N400差异不显著。研究结果表明,人们在汉语句子理解过程中会实时对隐含的物体颜色信息进行心理模拟。并且,句子隐含物体颜色的典型性是造成匹配易化或不匹配易化的关键因素之一。     

The role of perceptual and semantic elaboration in high- and low-imagery sentence recall

Sentence imagery effects in recall are predicted by both perceptual and semantic elaboration models. The former attributes superior recall of high-imagery sentences to the addition of perceptual network components to an existing semantic network; the latter claims that additions of semantic components are involved. In order to identify the responsible components, free associates were generated to otherwise similar high- and low-imagery sentences in a short-term memory task. In accordance with the perceptual elaboration model, associates differed in rated imagery, but not in number. In a second study, the causal role of perceptual elaboration in recall was investigated by using high- and low-imagery sentence associates as recall cues. Differential effects of cue imagery were found for high-imagery sentences, indicating that perceptual codes are in part responsible for superior high-imagery sentence recall. Evidence is presented that perceptual and semantic network components are involved in a processing trade-off, and the adequacy of present network models to explain it is discussed.     

Trade-off between memory for verbal items and their visual attributes.

Instructions to attend to the case and color in which words were presented led to improved retention of these visual attributes but depressed recognition performance. This trade-off between item and attribute memory occurred at three presentation rates (1.5, 5.5, and 10.5 sec/item), suggesting that visual attributes of verbal stimuli are rarely stored unless subjects expect that knowledge of physical form will be useful later. Visual attributes of high-imagery words were retained better than visual attributes of low imagery words by subjects instructed to attend to case and color, but not by subjects asked only to attend to word meaning. Implications of these findings for the hypothesis that visually presented verbal stimuli are stored as literal copies are discussed.     

Preschool children's eye‐movements during pictorial recall

We investigated eye‐movements during preschool children's pictorial recall of seen objects. Thirteen 3‐ to 4‐year‐old children completed a perceptual encoding and a pictorial recall task. First, they were exposed to 16 pictorial objects, which were positioned in one of four distinct areas on the computer screen. Subsequently, they had to recall these pictorial objects from memory in order to respond to specific questions about visual details. We found that children spent more time fixating the areas in which the pictorial objects were previously displayed. We conclude that as early as age 3–4 years old, children show specific eye‐movements when they recall pictorial contents of previously seen objects.     

Perceptual components of situation models

These experiments examined the hypothesis that situation model construction involves perceptual processing--specifically, processing that involves visuospatial information. In this research, a dual-task paradigm was used to demonstrate that tasks that engage visuospatial processes interfere more with the generation of a situation model than tasks that are less likely to involve these processes or tasks that are verbal in nature. Using Albrecht and O'Brien's (1993) contradiction effect as evidence of situation model construction, Experiment 1 demonstrated that participants reading short texts while simultaneously holding high-imagery sentences in memory failed to show a significant contradiction effect in comparison with readers holding low-imagery sentences in memory. In Experiment 2, participants reading texts while retaining a difficult visuospatial memory load showed disrupted comprehension in comparison with readers retaining a verbal memory load.     

Support for lateralization of the Whorf effect beyond the realm of color discrimination

Recent work has shown that Whorf effects of language on color discrimination are stronger in the right visual field than in the left. Here we show that this phenomenon is not limited to color: The perception of animal figures (cats and dogs) was more strongly affected by linguistic categories for stimuli presented to the right visual field than those presented to the left. Moreover, the magnitude of the visual field asymmetry was reduced when demands on verbal working memory were increased by a secondary task. This reduction did not occur when the secondary task imposed demands on spatial working memory. Taken together, these results demonstrate that the lateralized Whorf effect may be quite general, reflecting an interaction of linguistic and perceptual codes primarily in the left hemisphere.     

语境与颜色诊断性对句子理解中物体隐含颜色知觉模拟的影响

具身认知理论的代表知觉符号系统认为知识表征具有知觉特点,并假设语言理解中对于所涉及概念及其隐含属性会即时进行知觉模拟。当前研究采用句图匹配范式,通过三个实验探讨句子理解中是否会对物体隐含颜色属性进行知觉模拟及其具体条件。实验1沿用经典范式验证语言理解中对物体隐含颜色存在知觉模拟过程。实验2通过变化句子前语境考察语境是否支持对于物体隐含颜色知觉模拟的影响。实验3进一步考察当颜色属性与其对应物体存在稳定关联时(即具有高颜色诊断性的物体),在不同语境作用下是否会引起知觉表征的变化。研究结果表明,语言理解中知觉模拟过程是灵活的,语境改变会引起读者所激活的物体颜色知觉表征发生变化,并且对于高颜色诊断物体,即使缺乏支持语境,读者仍然会对句中隐含的物体特定颜色进行知觉模拟。     

Impaired drawing from memory in a visual agnosic patient

A case is reported of an associative visual agnosic patient who could not draw from memory objects he could recognize, even though he could copy drawings flawlessly. His ability to generate mental visual images was found to be spared, as was his ability to operate upon mental images. These data suggest that the patient could generate mental images but could not draw from memory because he did not have access to stored knowledge about pictorial attributes of objects. A similar functional impairment can be found in some other visual agnosic patients and in patients affected by optic aphasia. The present case allows a discussion of relationships among drawing from memory, imagery, and copying procedures.     

Episodic encoding and recognition of pictures and words: role of the human medial temporal lobes

In the present PET study, we examined brain activity related to processing of pictures and printed words in episodic memory. Our goal was to determine how the perceptual format of objects (verbal versus pictorial) is reflected in the neural organization of episodic memory for common objects. We investigated this issue in relation to encoding and recognition with a particular focus on medial temporal-lobe (MTL) structures. At encoding, participants saw pictures of objects or their written names and were asked to make semantic judgments. At recognition, participants made yes-no recognition judgments in four different conditions. In two conditions, target items were pictures of objects; these objects had originally been encoded either in picture or in word format. In two other conditions, target items were words; they also denoted objects originally encoded either as pictures or as words. Our data show that right MTL structures are differentially involved in picture processing during encoding and recognition. A posterior MTL region showed higher activation in response to the presentation of pictures than of words across all conditions. During encoding, this region may be involved in setting up a representation of the perceptual information that comprises the picture. At recognition, it may play a role in guiding retrieval processes based on the perceptual input, i.e. the retrieval cue. Another more anterior right MTL region was found to be differentially involved in recognition of objects that had been encoded as pictures, irrespective of whether the retrieval cue provided was pictorial or verbal in nature; this region may be involved in accessing stored pictorial representations. Our results suggest that left MTL structures contribute to picture processing only during encoding. Some regions in the left MTL showed an involvement in semantic encoding that was picture specific; others showed a task-specific involvement across pictures and words. Together, our results provide evidence that the involvement of some but not all MTL regions in episodic encoding and recognition is format specific.     

Denial of visual perception.

An adult with the diagnosis of cortical blindness, complaining of a complete visual loss of 2 years in duration, was found to have a small preserved visual field and remarkably preserved visual abilities. Although denying visual perception, he correctly named objects, colors, and famous faces, recognized facial emotions, and read various types of single words with greater than 50% accuracy when presented in the upper right visual field. Upon confrontation regarding his apparent visual abilities, the patient continued to deny visual perceptual awareness, typically stating "I feel it." CT indicated bioccipital lesions sparing the left inferior occipital area but involving the left parietal lobe. The denial of visual perception evidenced by this patient may be explained by a disconnection of parietal lobe attentional systems from visual perception. The clinical presentation is described as representing "inverse Anton's syndrome."     

Is color “categorical perception” really perceptual?

Roberson and Davidoff (2000) found that color categorical perception (CP; better cross-category than within-category discrimination) was eliminated by verbal, but not by visual, interference presented during the interstimulus interval (ISI) of a discrimination task. On the basis of this finding, Roberson and Davidoff concluded that CP was mediated by verbal labels, and not by perceptual mechanisms, as is generally assumed. Experiment 1 replicated their results. However, it was found that if the interference type was uncertain on each trial (Experiment 2), CP then survived verbal interference. Moreover, it was found that the target color name could be retained across the ISI even with verbal interference (Experiment 3). We therefore conclude that color CP may indeed involve verbal labeling but that verbal interference does not necessarily prevent it.     

Mental number line disruption in a right-neglect patient after a left-hemisphere stroke

A right-neglect patient with focal left-hemisphere damage to the posterior superior parietal lobe was assessed for numerical knowledge and tested on the bisection of numerical intervals and visual lines. The semantic and verbal knowledge of numbers was preserved, whereas the performance in numerical tasks that strongly emphasize the visuo-spatial layout of numbers (e.g. number bisection) was impaired. The behavioral pattern of error in the two bisection tasks mirrored the one previously described in left-neglect patients. In other words, our patient misplaced the subjective midpoint (numerical or visual) to the left as function of the interval size. These data, paired with the patient's lesion site are strictly consistent with the tripartite organization of number-related processes in the parietal lobes as proposed by Dehaene and colleagues. According to these authors, the posterior superior parietal lobe on both hemispheres underpins the attentional orientation on the putative mental number line, the horizontal segment of the intraparietal sulcus is bilaterally related to the semantic of the numerical domain, whereas the left angular gyrus subserves the verbal knowledge of numbers. In summary, our results suggest that the processes involved in the navigation along the mental number line, which are related to the parietal mechanisms for spatial attention, and the processes involved in the semantic and verbal knowledge of numbers, are dissociable.     

Evidence for the Role of Shape in Mental Representations of Similes

People mentally represent the shapes of objects. For instance, the mental representation of an eagle is different when one thinks about a flying or resting eagle. This study examined the role of shape in mental representations of similes (i.e., metaphoric comparisons). We tested the prediction that when people process a simile they will mentally represent the entities of the comparison as having a similar shape. We conducted two experiments in which participants read sentences that either did (experimental sentences) or did not (control sentences) invite comparing two entities. For the experimental sentences, the ground of the comparison was explicit in Experiment 1 (“X has the ability to Z, just like Y”) and implicit in Experiment 2 (“X is like Y”). After having read the sentence, participants were presented with line drawings of the two objects, which were either similarly or dissimilarly shaped. They judged whether both objects were mentioned in the preceding sentence. For the experimental sentences, recognition latencies were shorter for similarly shaped objects than for dissimilarly shaped objects. For the control sentences, we did not find such an effect of similarity in shape. These findings suggest that a perceptual symbol of shape is activated when processing similes.     

Optic aphasia, optic apraxia, and loss of dreaming

A 47-year-old man with a left temporo-occipital infarct in the area of the posterior cerebral artery is presented. The neuropsychological examination did not reveal aphasia or gross mental deficits. The patient presented with alexia without agraphia, color agnosia, but few visual perceptual deficits. The main impairment was in confrontation naming; he was incapable of naming objects and pictures, not from lack of recognition (excluding visual agnosia) but from lack of access to the appropriate word (optic aphasia). The patient also exhibited a deficit in the evocation of gesture from the visual presentation of an object (optic apraxia) and a difficulty in "conjuring up" visual images of objects (impaired visual imagery) and loss of dreams. The fundamental deficit of this patient is tentatively explained in terms of visuoverbal and visuogestural disconnection and a deficit of mental imagery.     

知觉加工中存在颜色类别知觉效应的证据

对于颜色的辨别具有类别知觉效应：类间两种颜色的辨别能力比同等颜色空间距离的类内两种颜色的辨别能力更高。对于类别知觉效应的产生机制存在两种观点：知觉特性假设、语言标签假设。以往的研究范式由于实验任务涉及到工作记忆成分,被试在完成任务时会自动地对颜色命名以利于记忆,因此所得证据大多支持语言标签假设,而对知觉特性假设的支持证据则很少。本文利用目标觉察范式最大限度去掉了工作记忆成分,通过测量被试辨别两种颜色的反应时,得到了类别知觉效应。并通过语言干扰任务进一步证实在该实验范式下类别知觉效应与语言的无关性。从而,为知觉特性假设提供了证据     

The effect of target specification on objects fixated during visual search

When a person searches for a target in a cluttered visual field his eye fixations typically fall on objects. The effect of target specification on the probability of fixating different classes of objects was studied. For fields containing objects differing Widely in size, color, and shape: a high proportion of searchers’ fixations were on objects of a specified color, a moderate proportion of their fixations were on objects of a specified size, and a slight proportion of their fixations were on objects of a specified shape. When two or more target characteristics were specified, fixations were generally based on a single characteristic. It is proposed that the specification of a target creates a perceptual structure which the searcher explores. The study of visual fixations, in effect, is the study of the perceptual structure.     

Eye movements during long-term pictorial recall

We investigated eye movements during long-term pictorial recall. Participants performed a perceptual encoding task, in which they memorized 16 stimuli that were displayed in different areas on a computer screen. After the encoding phase the participants had to recall and visualize the images and answer to specific questions about visual details of the stimuli. One week later the participants repeated the pictorial recall task. Interestingly, not only in the immediate recall task but also 1 week later participants looked longer at the areas where the stimuli were encoded. The major contribution of this study is that memory for pictorial objects, including their spatial location, is stable and robust over time.     

The effect of target specification on objects fixated during visual search

When a person searches for a target in a cluttered visual field his eye fixations typically fall on objects. The effect of target specification on the probability of fixating different classes of objects was studied. For fields containing objects differing widely in size, color, and shape: a high proportion of searchers’ fixations were on objects of a specified color, a moderate proportion of their fixations were on objects of a specified size, and a s light proportion of their fixations were on objects of a specified shape. When two or more target characteristics were specified, fixations were generally based on a single characteristic. It is proposed that the specification of a target creates a perceptual structure which the searcher explores. The study of visual fixations, in effect, is the study of the perceptual structure.     

The verbal nature of representations of the canonical colors of objects

In selecting the canonical colors of color-specific objects, children may use verbal mediation, a cognitive process whereby an object and its color are matched using verbal rather than pictorial representation [British Journal of Developmental Psychology 14 (1996) 339]. To investigate this process, 108 2- to 5-year-old children were asked to identify 11 colors and to choose crayons to color pictures of color-specific objects. Canonical color choice was significantly predicted by color-labeling skill above the variance portion predicted by age alone. Children were also asked to explain their color choices. Children who knew their colors and who colored canonically provided explanations for their color choices consistent with verbal mediation. However, a high proportion of children who did not know a color, and thus could not use verbal mediation, also gave sophisticated explanations for their color choices if they colored the objects canonically. These findings provide modest support for the idea that identification of canonical colors of objects is a verbal process.