语言理解中的预设加工

预设是指以交际双方的共同背景(共享的知识或信念)为前提的、听话者根据特定语言标记(触发标记)及其限定的对象(计算内容)而推理出的非外显意义。例如,“张明又触发标记发表了论文计算内容”引发了“张明之前发表过论文”的预设推论。理解者依赖触发标记通达交际双方的共同背景,并在计算内容上生成完整的预设;随后,理解者连接生成的预设和共同背景,更新两者之间的关系。触发标记范畴、共同背景与预设的关联度、共同背景类型,以及理解者的参与动机会影响不同阶段的预设加工。未来研究可以从三个角度进一步探讨预设加工的认知基础：(1)采用计算建模的方法,量化交际互动中听话者理解预设的过程(如观点采择);(2)采用脑成像技术,揭示预设加工过程的神经基础;(3)以特殊人群为研究对象,检验和修正预设加工的认知模型。     

Syntactic presupposition in sentence comprehension

Two experiments investigated the role of syntactic presupposition in sentence comprehension. In Experiment I subjects verified cleft, pseudocleft and factive complement sentences with respect to preceding context paragraphs, which contradicted either the assertion or the presupposition of the target sentence. Subjects took significantly longer to verify sentences with false presuppositions than sentences with false assertions. In Experiment II subjects verified cleft and pseudocleft sentences with respect to subsequently presented pictures. Once again, verification times for sentences with false presuppositions were significantly longer than verification times for sentences with false assertions. It was argued that these findings are more adequately explained by a “structural” hypothesis, than in terms of strategies designed to locate given and new information.     

Perception of motion affects language processing

Recently developed accounts of language comprehension propose that sentences are understood by constructing a perceptual simulation of the events being described. These simulations involve the re-activation of patterns of brain activation that were formed during the comprehender's interaction with the world. In two experiments we explored the specificity of the processing mechanisms required to construct simulations during language comprehension. Participants listened to (and made judgments on) sentences that described motion in a particular direction (e.g. "The car approached you"). They simultaneously viewed dynamic black-and-white stimuli that produced the perception of movement in the same direction as the action specified in the sentence (i.e. towards you) or in the opposite direction as the action specified in the sentence (i.e. away from you). Responses were faster to sentences presented concurrently with a visual stimulus depicting motion in the opposite direction as the action described in the sentence. This suggests that the processing mechanisms recruited to construct simulations during language comprehension are also used during visual perception, and that these mechanisms can be quite specific.     

Depth of processing in language comprehension: not noticing the evidence

The study of processes underlying the interpretation of language often produces evidence that they are complete and occur incrementally. However, computational linguistics has shown that interpretations are often effective even if they are underspecified. We present evidence that similar underspecified representations are used by humans during comprehension, drawing on a scattered and varied literature. We also show how linguistic properties of focus, subordination and focalization can control depth of processing, leading to underspecified representations. Modulation of degrees of specification might provide a way forward in the development of models of the processing underlying language understanding.     

Pupillometry reveals processing load during spoken language comprehension

This study investigated processing effort by measuring peoples’ pupil diameter as they listened to sentences containing a temporary syntactic ambiguity. In the first experiment, we manipulated prosody. The results showed that when prosodic structure conflicted with syntactic structure, pupil diameter reliably increased. In the second experiment, we manipulated both prosody and visual context. The results showed that when visual context was consistent with the correct interpretation, prosody had very little effect on processing effort. However, when visual context was inconsistent with the correct interpretation, prosody had a large effect on processing effort. The interaction between visual context and prosody shows that visual context has an effect on online processing and that it can modulate the influence of linguistic sources of information, such as prosody. Pupillometry is a sensitive measure of processing effort during spoken language comprehension.     

Perception of auditory motion affects language processing

Previous reports have demonstrated that the comprehension of sentences describing motion in a particular direction (toward, away, up, or down) is affected by concurrently viewing a stimulus that depicts motion in the same or opposite direction. We report 3 experiments that extend our understanding of the relation between perception and language processing in 2 ways. First, whereas most previous studies of the relation between perception and language processing have focused on visual perception, our data show that sentence processing can be affected by the concurrent processing of auditory stimuli. Second, it is shown that the relation between the processing of auditory stimuli and the processing of sentences depends on whether the sentences are presented in the auditory or visual modality.     

On-line processing of social stereotypes during spoken language comprehension

Four experiments investigated stereotype processing during the on-line comprehension of spoken sentences. Participants listened to a critical prime (terrorist) embedded in a sentence and then made lexical decisions to visually presented standard-related (bomb) or stereotype-related targets (Arab) or unrelated controls for both conditions. For Experiments 1A and 1B, the preceding context provided no contextual information about the critical prime. Targets were presented at prime offset (Experiment 1A) or 300 ms after prime offset (Experiment 1B). In Experiments 2A and 2B, the preceding context was biased towards the stereotype meaning of the critical prime. Visual targets were presented at prime offset (Experiment 2A) or 300 ms after prime offset (Experiment 2B). Experiment 1A revealed a priming effect, but only for the standard meaning (i.e., bomb) of the critical prime. This effect was further replicated in Experiments 1B, 2A and 2B; however, for these experiments, unlike Experiment 1A, the results revealed lexical inhibition for the stereotype meaning of the critical prime. That is, lexical decisions to the stereotype-related targets were actually slower than the stereotype-unrelated controls. The results are discussed in terms of current social cognitive models of stereotype processing.     

How valence affects language processing: Negativity bias and mood congruence in narrative comprehension

The present research examined how positive and negative moods affect readers’ understanding of positive and negative story endings. It demonstrated how negativity bias and mood congruence emerge during narrative comprehension. Participants were induced to experience either a positive or a negative mood and then read stories that could have either a positive or a negative ending. In Experiment 1, participants took longer to integrate negative endings than positive endings, independent of their mood. In Experiment 2, participants judged as more surprising those endings that did not match their mood. The present results illustrate that ending valence has strong influence on moment-by-moment reading, but that readers’ moods influence expectations for story outcomes once readers reflect on a complete representation of the story.     

Emotional language processing: how mood affects integration processes during discourse comprehension

This research tests whether mood affects semantic processing during discourse comprehension by facilitating integration of information congruent with moods’ valence. Participants in happy, sad, or neutral moods listened to stories with positive or negative endings during EEG recording. N400 peak amplitudes showed mood congruence for happy and sad participants: endings incongruent with participants’ moods demonstrated larger peaks. Happy and neutral moods exhibited larger peaks for negative endings, thus showing a similarity between negativity bias (neutral mood) and mood congruence (happy mood). Mood congruence resulted in differential processing of negative information: happy mood showed larger amplitudes for negative endings than neutral mood, and sad mood showed smaller amplitudes. N400 peaks were also sensitive to whether ending valence was communicated directly or as a result of inference. This effect was moderately modulated by mood. In conclusion, the notion of context for discourse processing should include comprehenders’ affective states preceding language processing.     

Neural dynamics of animacy processing in language comprehension: ERP evidence from the interpretation of classifier-noun combinations

An event-related potential experiment was conducted to investigate the temporal neural dynamics of animacy processing in the interpretation of classifier-noun combinations. Participants read sentences that had a non-canonical structure, object noun + subject noun + verb + numeral-classifier + adjective. The object noun and its classifier were either (a) congruent, (b) incongruent, but matching in animacy, or (c) incongruent, mismatching in animacy. An N400 effect was observed for both incongruent conditions, but not for additional mismatch in animacy. When only data from participants who accepted the non-canonical structure were analyzed, the animacy mismatch elicited a P600 but still no N400. These findings suggest that animacy information is not used immediately for semantic integration of nouns and their classifiers, but is used in a later analysis reflected by P600. Thus, the temporal neural dynamics of animacy processing in sentence comprehension may be modulated by the relevance of animacy to thematic interpretation.     

Time in language: event duration in language comprehension

This work investigates how we process and represent event duration in on-line language comprehension. Specifically, it examines how events of different duration are processed and what type of knowledge underlies their representations. Studies 1–4 examined verbs and phrases in different contexts. They showed that durative events took longer to process than non-durative events and that the duration attributed to the stimulus events correlated with on-line processing times. Studies 5 and 6 indicated that durative events occur in semantically more diverse contexts and elicit semantically more diverse associations than non-durative events. Semantic and contextual diversity also correlated with attributed durations and processing times. Results indicate that (a) event-specific durations are computed on-line from multiple unfolding cues, (b) processing cost and duration representations emerge from semantic and contextual diversity reflecting our experience, and (c) key components of duration representations may be situation-specific knowledge of causal and contingency relations between events.     

Persistent structural priming from language comprehension to language production

To examine the relationship between syntactic processes in language comprehension and language production, we compared structural persistence from sentence primes that speakers heard to persistence from primes that speakers produced. [Bock, J. K., & Griffin, Z. M. (2000). The persistence of structural priming: transient activation or implicit learning? Journal of Experimental Psychology: General, 129, 177-192.] showed that the production of target priming structures increased the probability of spontaneously using the same structures to describe events in subsequent pictures that were semantically unrelated to the primes. These priming effects persisted across as many as ten intervening filler trials. The present studies replicated these results using auditorily presented primes to which participants only listened. The results indicated persistence of priming across all lags, with relative magnitudes of priming as large as those observed by Bock and Griffin. The implication is that structural priming is persistent regardless of the modality in which language structures are experienced, underscoring the power of priming as an implicit learning mechanism.     

A real-time approach to spoken language processing in aphasia

The study is based on an on-line investigation of spoken language comprehension processes in 25 French-speaking aphasics using a syllable-monitoring task. Nonsense syllables were presented in three different conditions: context-free (embedded in strings of nonsense syllables), lexical context (where the target nonsense syllable is the initial, medial, or final syllable of real three-syllable words), and sentence context. This study builds on an earlier one that explored the relationship between the acoustic-phonetic, lexical, and sentential levels of spoken language processing in French-speaking normals and gave evidence of top-down lexical and sentential influence on syllable recognition. In the present study, aphasic patients from various diagnostic categories were classified as high (N = 13) or low (N = 12) comprehenders. The results show that low comprehending aphasics make no use of sentence information in the syllable-recognition task. As for top-down effect at the single word level that is observed in normal listeners. However, a subgroup analysis shows that the Broca's are the only high comprehending aphasics who perform in the same way as normal listeners; this sets them apart from the anomics and conduction aphasics.     

Recovery from aphasia: Spontaneous speech versus language comprehension

Seventy-four aphasic patients, subdivided into four groups (fluent, mixed, nonfluent, and severely nonfluent), were tested three times in the course of 1 year to assess recovery of spontaneous speech and sentence comprehension. Although 12 of the 28 spontaneous speech variables employed showed significant time changes, some of these changes indicated improvement and others deterioration. There was no overall clinical improvement in spontaneous speech in any group. On the sentence comprehension tests, however, all four groups did show considerable, significant improvement. There were no qualitative or quantitative differences among the groups in the course of recovery, despite the fact that the groups differed in the severity of aphasia as well as on the fluency dimension. In certain patients there was also some improvement in spontaneous speech, but this did not in most cases correlate with an improvement in either fluency or sentence comprehension. Possible reasons why receptive abilities improved more than expressive abilities are discussed.     

Eye movements as a window into real-time spoken language comprehension in natural contexts

When listeners follow spoken instructions to manipulate real objects, their eye movements to the objects are closely time locked to the referring words. We review five experiments showing that this time-locked characteristic of eye movements provides a detailed profile of the processes that underlie real-time spoken language comprehension. Together, the first four experiments showed that listerners immediately integrated lexical, sublexical, and prosodic information in the spoken input with information from the visual context to reduce the set of referents to the intended one. The fifth experiment demonstrated that a visual referential context affected the initial structuring of the linguistic input, eliminating even strong syntactic preferences that result in clear garden paths when the referential context is introduced linguistically. We argue that context affected the earliest moments of language processing because it was highly accessible and relevant to the behavioral goals of the listener.We thank D. Ballard and M. Hayhoe for the use of their laboratory (National Resource Laboratory for the Study of Brain and Behavior). We also thank J. Pelz for his assistance in learning how to use the equipment and K. Kobashi for assisting in the data collection. Finally, we thank Janet Nicol and an anonymous reviewer for their comments and suggestions. The research was supported by NIH resource grant 1-P41-RR09283; NIH HD27206 (M.K.T.); an NSF graduate fellowship (M.J.S.-K.); and a Canadian SSHRC fellowship (J.C.S.).     

Syntactic prediction in language comprehension: evidence from either...or

Readers' eye movements were monitored as they read sentences in which two noun phrases or two independent clauses were connected by the word or (NP-coordination and S-coordination, respectively). The word either could be present or absent earlier in the sentence. When either was present, the material immediately following or was read more quickly, across both sentence types. In addition, there was evidence that readers misanalyzed the S-coordination structure as an NP-coordination structure only when either was absent. The authors interpret the results as indicating that the word either enabled readers to predict the arrival of a coordination structure; this predictive activation facilitated processing of this structure when it ultimately arrived, and in the case of S-coordination sentences, enabled readers to avoid the incorrect NP-coordination analysis. The authors argue that these results support parsing theories according to which the parser can build predictable syntactic structure before encountering the corresponding lexical input.     

Tracking the continuity of language comprehension: computer mouse trajectories suggest parallel syntactic processing

Although several theories of online syntactic processing assume the parallel activation of multiple syntactic representations, evidence supporting simultaneous activation has been inconclusive. Here, the continuous and non-ballistic properties of computer mouse movements are exploited, by recording their streaming x, y coordinates to procure evidence regarding parallel versus serial processing. Participants heard structurally ambiguous sentences while viewing scenes with properties either supporting or not supporting the difficult modifier interpretation. The curvatures of the elicited trajectories revealed both an effect of visual context and graded competition between simultaneously active syntactic representations. The results are discussed in the context of 3 major groups of theories within the domain of sentence processing.     

Dissociation of algorithmic and heuristic processes in language comprehension: Evidence from aphasia

Three groups of aphasic patients, Broca's, Conduction, and Wernicke's, and a nonaphasic patients control group were tested for comprehension of object-relative center-embedded sentences. The sentences were of three types: sentences in which semantic constraints between words allowed the subjects to assign a correct semantic reading of the sentence without decoding the syntax, sentences in which semantic constraints were relaxed and for which a correct reading was only possible with knowledge of syntactic relationships among words, and sentences which described highly improbable events. The subjects' task was to choose which of two pictures captured the meaning expressed in the sentence. Broca's and Conduction aphasics performed near perfectly on sentences where they could use semantic information. Their performance dropped to chance when they had to use syntactic information. These results support a neuropsychological dissociation of heuristic and algorithmic processes based primarily, though not exclusively, on semantic and syntactic information, respectively.     

Social status and language comprehension

Abstract.— Previous research on differences in language use in relation to social status have dealt almost exclusively with language production. The present study investigated the comprehension of connected discourse by 116 adult Danes from two different socio-economic status groups, high status (HSES) and low status (LSES). On a task at the lexical level of comprehension (choosing between alternatives to two words in each of four texts) there appeared no differences between HSES and LSES subjects. At the structural level a difference ( p <0.05) was found in drawing conclusions from the texts, but the groups nevertheless agreed completely ( p <0.05) in underlining important segments of the texts. Thus the symmetry between production and comprehension hypothesized by Bernstein did not appear. The results are interpreted in accordance with a general model of language processing. It is suggested that in the future more attention should be paid to variables other than the purely sociological variable of social status or social class.     

Memory models and language comprehension

Abstract.— A schematic model for storage of meaningful verbal material is outlined. Storage of words and meaningful symbols is assumed to be separate. Accordingly it is argued that transformational grammar may be in error, and that the recent distinction between thinking in words versus thinking in imagery may be spurious. Since symbols carrying meaning must be isomorphs of real states, the distinction between abstract and concrete cognition can scarcely be upheld. Cognition, even in its conceptual forms, is seen to be always concrete. The dimensions of word storage are thought to be phonological. A preliminary analysis proceeding by using phonetical molecules results in regarding the distinction between inflectional and agglutinating languages as a purely phonological feature, and an explanation is offered as to the different probabilities of word-form change within different languages.