汉语主动句、被动句的命题表征项目顺序特点

以中国大学生为被试,采用句子—图画验证任务(sentence-picture verification task )探讨了中国学生理解汉语主动句、被动句所形成的命题表征中项目顺序特点。结果表明,无论是语义水平较高的不可逆句,还是语义水平较低的可逆句,中国学生理解汉语主动句、被动句所建构的命题表征中项目顺序均为“施事→受事”。本研究结果初步表明,中国学生理解汉语主动句和被动句时,能根据它们不同的表层结构（汉语主动句的语言表达顺序为“施事→受事”、汉语被动句的语言表达顺序为“受事→施事”）建构相同的深层结构（语义内容的命题表征项目顺序“施事→受事”）,可能是一个按照“施事→受事”固定方向进行的系列认知心理加工的过程     

汉语句子理解中物体隐含颜色心理模拟的ERPs研究

当前研究采用事件相关电位(ERPs)技术,同时沿用经典的句图匹配范式,考察句子理解中物体典型颜色与非典型颜色的心理加工过程在脑电活动上的反映。实验中被试先阅读句子再判断句子后呈现的图片物体是否在句子中出现过,句子中隐含的物体颜色或是关键物体的典型颜色或是非典型颜色。实验结果发现,典型颜色句子版本下句图不匹配条件比句图匹配条件引发了更大的N400效应;而非典型颜色句子版本下两者N400差异不显著。研究结果表明,人们在汉语句子理解过程中会实时对隐含的物体颜色信息进行心理模拟。并且,句子隐含物体颜色的典型性是造成匹配易化或不匹配易化的关键因素之一。     

汉语句子-图片信息整合的眼动测量

采用眼球追踪-分析法考察了“句子-图片”验证范式下句图信息整合过程中句式和语义关系类型的作用。实验结果表明：（1）汉语句子-图片信息整合过程中,句图继时呈现没有消除语义失配效应,注视次数、总注视时间显著增加,瞳孔直径扩大。语义失配会显著干扰句法难度低的句式的句图信息整合。（2）句式影响句子-图片信息的整合过程,注视次数、总注视时间、瞳孔直径随句法难度增加而增加。（3）汉语句图信息整合过程中,语义失配效应受句式影响,表现出任务的特异性,这说明成分比较模型不具有一般性     

The effect of semantic plausibility on sentence comprehension in aphasia

Tested were 50 aphasic patients (16 Broca's, 15 Wernicke's, 10 global, and 9 amnesic), 13 nonaphasic brain damaged patients, and 13 normal adults to evaluate the effect of semantic plausibility on sentence comprehension in active affirmative declarative sentences with a sentence-picture matching task. A plate of two pictures was provided for each stimulus sentence, and the subject was required to choose the picture corresponding to the sentence presented auditorily. Two types of sentences in terms of plausibility were prepared, i.e., probable sentences (P) describing common events in our daily life and improbable sentences (I) describing rare events. There were four kinds of combinations of a picture with the other to make a correct/(distractor) set, i.e., P/(P), P/(I), I/(P), and I/(I) constructions. The results indicated that probable sentences were more comprehensible than improbable sentences, and that the effect of semantic plausibility did not differ among aphasic types.     

The given-new structure of cleft sentences and their influence on picture viewing

Summary In three experiments the influence of the given-new structure of cleft sentences on picture viewing was examined. Subjects heard cleft sentences and subsequently inspected pictures depicting the agent and the patient of the action mentioned in the sentence. Each sentence-picture pair was preceded by an adequate context sentence and a context picture. It was demonstrated that the delineation of the agent or of the patient in the sentence was looked at longer when it was marked as new information in the sentence that described the picture than when it was marked as old information. We interpret these findings to mean that the new information of a cleft sentence sets up a focus of attention in the cognitive structure and that this prolongs the time spent in the inspection of a delineation of the focal concept.     

Pictures in sentences: understanding without words

To understand a sentence, the meanings of the words in the sentence must be retrieved and combined. Are these meanings represented within the language system (the lexical hypothesis) or are they represented in a general conceptual system that is not restricted to language (the conceptual hypothesis)? To evaluate these hypotheses, sentences were presented in which a pictured object replaced a word (rebus sentences). Previous research has shown that isolated pictures and words are processed equally rapidly in conceptual tasks, but that pictures are markedly slower than words in tasks requiring lexical access. The lexical hypothesis would therefore lead one to expect that rebus sentences will be relatively difficult, whereas the conceptual hypothesis would predict that rebus sentences would be rather easy. Sentences were shown using rapid serial visual presentation (RSVP) at a rate of 10 or 12 words per second. With one set of materials (Experiments 1 and 2), readers took longer to judge the plausibility of rebus sentences than all-word sentences, although the accuracy of judgment and of recall were similar for the two formats. With two new sets of materials (Experiments 3 and 5), rebus and all-word sentences were virtually equivalent except in one circumstance: when a picture replaced the noun in a familiar phrase such as seedless grapes. In contrast, when the task required overt naming of the rebus picture in a sentence context, latency to name the picture was markedly longer than to name the corresponding word, and the appropriateness of the sentence context affected picture naming but not word naming (Experiment 4). The results fail to support theories that place word meanings in a specialized lexical entry. Instead, the results suggest that the lexical representation of a noun or familiar noun phrase provides a pointer to a nonlinguistic conceptual system, and it is in that system that the meaning of a sentence is constructed.     

Inspecting pictures for information to verify a sentence: Eye movements in general encoding and in focused search

When we see combinations of text and graphics, such as photographs and their captions in printed media, how do we compare the information in the two components? Two experiments used a sentence-picture verification task in which statements about photographs of natural scenes were read in order to make a true/false decision about the validity of the sentence, and in which eye movements were recorded. In Experiment 1 the sentence and the picture were presented concurrently, and objects and words could be inspected in any order. In Experiment 2 the two components were presented one after the other, either picture first or sentence first. Fixation durations on pictures were characteristically longer than those on sentences in both experiments, and fixations on sentences varied according to whether they were being encoded as abstract propositions or as coreferents of objects depicted in a previously inspected picture. The decision time data present a difficulty for existing models of sentence verification tasks, with an inconsistent pattern of differences between true and false trials.     

Dissociations and associations of performance in syntactic comprehension in aphasia and their implications for the nature of aphasic deficits

Sixty-one pwa were tested on syntactic comprehension in three tasks: sentence-picture matching, sentence-picture matching with auditory moving window presentation, and object manipulation. There were significant correlations of performances on sentences across tasks. First factors on which all sentence types loaded in unrotated factor analyses accounted for most of the variance in each task. Dissociations in performance between sentence types that differed minimally in their syntactic structures were not consistent across tasks. These results replicate previous results with smaller samples and provide important validation of basic aspects of aphasic performance in this area of language processing. They point to the role of a reduction in processing resources and of the interaction of task demands and parsing and interpretive abilities in the genesis of patient performance.     

Syntactic and semantic contributions to sentence comprehension in agrammatism

Five aphasic subjects, who demonstrated agrammatic speech, and eight control subjects were presented with a sentence-picture matching task in which the factors of syntactic complexity, semantic reversibility, and sentence plausibility were independently varied. A subset of the sentences was patterned after that presented by A. Caramazza and E. Zurif (1976, Brain and Language, 5, 572-583) who concluded that Broca's aphasics rely on semantic constraints instead of syntactic information for sentence comprehension. Our aphasic subjects showed the same pattern of performance on this subset of sentences. However, the results from the full set of sentence materials we tested show that the aphasic subjects could perform some sentence level syntactic analyses, even when syntactic information conflicted with semantic constraints. The aphasic subjects correctly interpreted most active and passive sentences. They failed, however, to assign thematic roles and adjectives in center-embedded relative sentences, and instead relied on nonsyntactic information. These results show that both semantic and syntactic information contributed to sentence comprehension in the aphasic subjects we tested, in contrast to previous claims that syntactic and semantic processes are completely dissociated in this population.     

Generation of a pictorial code

In Experiments I and II direct measures were obtained of the time required to convert a picture or a sentence to a report of visualization or to a simple drawing, latencies were faster for pictures than for sentences and were affected by the surface form of the sentence. In Experiment Ill, Ss matched pictures or sentences against a test picture under conditions of simultaneous or successive presentation. “Yes” and “No” response times were affected by sentence form under both conditions, although the difference between sentence-picture and picture-picture comparisons was virtually eliminated under the successive condition. In Experiment IV, Ss held a sentence or picture in memory over a 1,500-msec interval at the end of which a test picture or an instruction to draw the design was presented. Construction latencies were shorter in response to pictures than sentences, and there were effects of sentence form on verification time. Some implications of these results are discussed.     

Sentence understanding and knowledge of the world: Evidences from a sentence-picture matching task performed by aphasic patients

The abilities of aphasic patients to perform a sentence-picture matching task were investigated on simple declarative reversible sentences. Two factors were found to differentially affect Broca's versus Wernicke's aphasics' performance: sentence plausibility and spatial arrangement. Sentence plausibility, that is to say, the liability of two given nouns in a sentence to act as agent and recipient according to normal subjects' expectancies, had a significant effect on the frequency of correct responses of Broca's aphasics but not on those of Wernicke's. Conversely, the latter were found to be more sensitive to a match or mismatch in the left-to-right spatial arrangement of the grammatical subject and object in a sentence on the one hand, and the order of the corresponding personages in the picture on the other. The results are discussed in terms of “frame selection” and the handling of ordered structure strategies contributing to normal system, but selectively disturbed in the case of brain damage.     

The effect of non-verbal information on the recall of negation

The influence of non-verbal information on storage of different versions of negated sentences was investigated in a one-trial learning experiment. The negation governed either the subject, the object, or the predicate of the sentence. One group was presented with the sentences together with pictures. Another group the sentences only. The picture which was shown with a sentence represented the sentence content with an alternative for the negated concept. It was found that pictorial information had an effect on the recall of the sentences and that this effect is different for the different sentence versions.     

语境与颜色诊断性对句子理解中物体隐含颜色知觉模拟的影响

具身认知理论的代表知觉符号系统认为知识表征具有知觉特点,并假设语言理解中对于所涉及概念及其隐含属性会即时进行知觉模拟。当前研究采用句图匹配范式,通过三个实验探讨句子理解中是否会对物体隐含颜色属性进行知觉模拟及其具体条件。实验1沿用经典范式验证语言理解中对物体隐含颜色存在知觉模拟过程。实验2通过变化句子前语境考察语境是否支持对于物体隐含颜色知觉模拟的影响。实验3进一步考察当颜色属性与其对应物体存在稳定关联时(即具有高颜色诊断性的物体),在不同语境作用下是否会引起知觉表征的变化。研究结果表明,语言理解中知觉模拟过程是灵活的,语境改变会引起读者所激活的物体颜色知觉表征发生变化,并且对于高颜色诊断物体,即使缺乏支持语境,读者仍然会对句中隐含的物体特定颜色进行知觉模拟。     

The Sum and Substance of It: The Appreciation of Mass and Count Quantifiers in Parkinson′s Disease

We performed three experiments in order to determine whether patients with Parkinson′s disease (PD) have a sentence comprehension impairment. In the first experiment, we found that nondemented PD patients were impaired at matching a short sentence containing a mass or count quantifier (e.g., "Point to the jar with many") with one of four pictures. Patients erred by pointing to the incorrect mass or count type of substance, but pointed correctly to the large or small amount of a substance in the picture. In the second experiment, we asked the same PD patients to judge short sentences containing mass or count nouns modified by mass or count adjectives (e.g., *"The glass contains many milk"). PD patients were significantly impaired at detecting errors in the agreement between a noun and a quantifying adjective and errors in the appropriate use of the plural associated with a noun. A sentence completion task was performed in order to determine whether patients impaired on both sentence-picture matching and sentence judgment tasks are also compromised in their expression of quantifiers. Some patients impaired on both tasks also had difficulty expressing quantifiers, and it is these patients who may have difficulty performing grammatical computations. Other patients were selectively impaired in their sentence-picture matching or their sentence judgments, suggesting a performance deficit concerned with a particular task. We conclude that sentence comprehension impairments in PD are multifactorial in nature.     

The sound of motion in spoken language: visual information conveyed by acoustic properties of speech

Language is generally viewed as conveying information through symbols whose form is arbitrarily related to their meaning. This arbitrary relation is often assumed to also characterize the mental representations underlying language comprehension. We explore the idea that visuo-spatial information can be analogically conveyed through acoustic properties of speech and that such information is integrated into an analog perceptual representation as a natural part of comprehension. Listeners heard sentences describing objects, spoken at varying speaking rates. After each sentence, participants saw a picture of an object and judged whether it had been mentioned in the sentence. Participants were faster to recognize the object when motion implied by speaking rate matched the motion implied by the picture. Results suggest that visuo-spatial referential information can be analogically conveyed and represented.     

Partial picture effects on children's memory for sentences containing implicit information

Two experiments were conducted examining the effects of partial picture adjuncts on young children's coding of information that was implied in sentences. In the two most critical conditions of these studies, subjects were presented sentences specifying a subject, an action, and a direct object with the instrument used to carry out the action not specified in the sentence (e.g., The workman dug a hole in the ground). Implicit-sentence-only subjects received only the sentences, whereas the implicit sentence + partial picture subjects also viewed a partial picture depicting the action in the sentence minus the implied instrument. The main hypothesis was that subsequent recall of the sentences given the implied instrument as a cue would be facilitated by the partial pictures provided at study, since they would lead the children to infer the instrument. That occurred with 6- to 7-year-old children, but not with preschool children. Consistent with the conclusion that the partial pictures prompted 6- to 7-year-olds to infer the instruments, implicit sentence + partial picture subjects recalled as much as subjects in two other conditions, one in which subjects were explicitly told the instruments at study and one in which subjects saw the instruments depicted in pictures at study. In contrast, preschool subjects who heard explicit sentences containing the instruments outperformed subjects who heard implicit sentences even when the implicit sentences were accompanied by pictures depicting the instruments. This failure of complete pictures to facilitate preschoolers' recall of information implied in sentences contrasts with the many demonstrations of prose learning facilitation when picture and sentence contents explicitly and completely overlap. In summary, there were developmental differences in whether (a) partial pictures significantly facilitated inferencing (and subsequent cued recall) and (b) complete pictures containing information not explicitly stated in sentences promoted cued recall of the sentences.     

A study of syntactic processing in aphasia I: behavioral (psycholinguistic) aspects

This paper presents the results of a study of syntactically based comprehension in aphasic patients. We studied 42 patients with aphasia secondary to left hemisphere strokes and 25 control participants. We measured off-line, end-of-sentence, performance (accuracy and reaction time) in two tasks that require comprehension--enactment and sentence-picture matching--and in grammaticality judgment, with whole sentence auditory presentation. We also used sentence-picture matching and grammaticality judgment as tasks in two self-paced listening studies with the same patients to measure on-line performance. In each task and presentation format, we presented sentences that tested the ability to assign and interpret three structural contrasts chosen to examine different basic syntactic operations: actives and passives, subject and object extracted relative clauses, and reflexive pronouns and matched sentences without these elements. We examined these behavioral data to determine patterns of impairment in individual patients and in groups of patients, using correlational analyses, factor analyses, and analyses of variance. The results showed that almost no individual patients had stable deficits referable to the ability to interpret individual syntactic structures, that a variety of structural features contributed to sentence processing complexity both on-line and off-line, that correct responses were associated with normal on-line and errors with abnormal performance, and that the major determinant of performance is a factor that affected performance on all sentence types. The results indicate that the major cause of aphasic impairments of syntactically based comprehension are intermittent reductions in the processing capacity available for syntactic, interpretive, and task-related operations.     

Imagery effects and semantic similarity in sentence recognition memory

The idea that subjects often use imagery to discriminate semantically similar sentences was tested in three experiments. In the first experiment, subjects heard subject-verb-object sentences in the context of either a comprehension task or an image-generation task. Their memory for the sentences was tested using a two-alternative forced-choice recognition test in which different types of distractor sentence were used. A sentence semantically similar to the target sentence was one type; a sentence with the same subject and object nouns as the target sentence, but dissimilar in meaning, was another type; and a sentence similar in meaning to one of the stimulus sentences, but not to the target sentence, was a third type. The results showed that the image-generation instructions enhanced later recognition performance, but only for semantically similar test items. A second experiment showed that this finding only holds for high-imagery sentences containing concrete noun concepts. A third experiment demonstrated that the enhanced recognition performance could not be accounted for in terms of a semantic model of test-item discrimination. Collectively, the results were interpreted as providing evidence for the notion that subjects discriminate the semantically similar test items by elaborating the sentence encoding through image processing.     

Task Demands and Sentence Comprehension in Patients with Dementia of the Alzheimer's Type

Patients with dementia of the Alzheimer's type (DAT) and matched normal controls were given three tests of syntactic comprehension in which nonlinguistic visual and memory task demands were varied. In all tasks, subjects were presented spoken semantically reversible sentences with a variety of syntactic structures and required to match the sentence to a picture. In the first experiment, subjects matched the spoken sentence to one of two pictures that appeared either before or immediately following the presentation of the sentence. The target picture depicted the spoken sentence correctly and the foil depicted the reversed thematic roles to those in the sentence (i.e., it was a syntactic foil). The second experiment employed a sentence video-verification task in which subjects were required to determine if the spoken sentence matched a videotaped depiction of the action in the sentence or a syntactic foil. In the third experiment, in different conditions, subjects were required to determine whether the spoken sentence matched a single picture or to choose the picture that matched the sentence from an array of two or three pictures. In this experiment, both lexical and syntactic foils were used. In all tasks, DAT patients were affected by the number of propositions in the presented sentence, but not by the syntactic complexity of the sentence. Control subjects also were unaffected by the syntactic complexity of the sentence; the number-of-proposition effect was present in some experiments in the control population. Comparison of performance across the one-, two-, and three-picture versions of the task showed that the magnitude of the effect of number of propositions increased as the number of pictures in the array increased. In addition, analysis of the data from each of the tasks separately showed that the effect of number of propositions only occurred when subjects were attempting to match the target to a syntactic foil (one-picture version) or to choose between the target and a syntactic foil (two- and three-picture versions). The results support the view that patients with DAT do not have disturbances affecting syntactic processing. In addition, they suggest that the effect of number of propositions arises at a stage of analysis that is partially separate from assigning sentence meaning, such as in holding a representation of the sentence in memory until the pictures can be analyzed and encoded and/or in comparing the results of the picture analysis with a stored representation of the sentence meaning.