汉语隐喻理解时程的ERPs研究

摘 要 本研究使用ERPs技术考察隐喻句与本义句理解时程的异同,以研究汉语隐喻的理解机制。以句尾范式向被试随机呈现本义句、熟悉隐喻句、新奇隐喻句及错误义句各50句,被试的任务为判断每句话是否有意义。结果显示：两种隐喻句诱发的N400波形与头皮分布情况和本义句无明显差异,且两种隐喻句诱发的N400波幅高于本义句。本研究结果证明汉语隐喻义和本义理解的认知机制类似,支持隐喻理解的平行加工假说,且加工隐喻义需要耗费更多的认知资源。     

句子阅读理解过程中句意的建构时间

一般语言学理论认为, 在句子阅读理解过程中, 句子意义建构是基于词汇语义整合的, 其反映在N400之上, 开始于词语呈现后约250 ms。然而, 近年关于语义P600效应的研究却提示句意建构可能存在多通道或方式, 读者甚至可能在N400反映的加工出现之前就已建立了初步句意。为探明在句子阅读理解过程中是否存在比N400反映的加工更早的句意建构, 以及如果存在这样的句意建构, 其是从何时开始的, 本研究开展了四个实验。实验1发现被试在句末双字词呈现200 ms后已将其联系到上文语义表征而建立了句意, 提示句意建构开始于N400反映的加工出现之前。实验2与3进一步发现, 读者开始建立句意的时间约在句末词呈现了150 ms之时。实验4排除了实验1~3效应的其他一些可能解释, 提升了实验1~3结果的可靠性。总体上, 本研究提示：在句子阅读理解过程中, 读者在句末双字词呈现了约150 ms之时就已建立了句意; 可能存在比N400反映的加工更早的句意建构。     

It's the way that you, er, say it: hesitations in speech affect language comprehension

Everyday speech is littered with disfluency, often correlated with the production of less predictable words (e.g., Beattie & Butterworth [Beattie, G., & Butterworth, B. (1979). Contextual probability and word frequency as determinants of pauses in spontaneous speech. Language and Speech, 22, 201-211.]). But what are the effects of disfluency on listeners? In an ERP experiment which compared fluent to disfluent utterances, we established an N400 effect for unpredictable compared to predictable words. This effect, reflecting the difference in ease of integrating words into their contexts, was reduced in cases where the target words were preceded by a hesitation marked by the word er. Moreover, a subsequent recognition memory test showed that words preceded by disfluency were more likely to be remembered. The study demonstrates that hesitation affects the way in which listeners process spoken language, and that these changes are associated with longer-term consequences for the representation of the message.     

Effects of language comprehension on visual processing - MEG dissociates early perceptual and late N400 effects

We investigated whether and when information conveyed by spoken language impacts on the processing of visually presented objects. In contrast to traditional views, grounded-cognition posits direct links between language comprehension and perceptual processing. We used a magnetoencephalographic cross-modal priming paradigm to disentangle these views. In a sentence-picture verification task, pictures (e.g. of a flying duck) were paired with three sentence conditions: A feature-matching sentence about a duck in the air, a feature-mismatching sentence about a duck in a lake, and an unrelated sentence. Brain responses to pictures showed enhanced activity in the N400 time-window for the unrelated compared to both related conditions in the left temporal lobe. The M1 time-window revealed more activation for the feature-matching than for the other two conditions in the occipital cortex. These dissociable effects on early visual processing and semantic integration support models in which language comprehension engages two complementary systems, a perceptual and an abstract one.     

Not all disfluencies are are equal: The effects of disfluent repetitions on language comprehension

Disfluencies can affect language comprehension, but to date, most studies have focused on disfluent pauses such as er. We investigated whether disfluent repetitions in speech have discernible effects on listeners during language comprehension, and whether repetitions affect the linguistic processing of subsequent words in speech in ways which have been previously observed with ers. We used event-related potentials (ERPs) to measure participants’ neural responses to disfluent repetitions of words relative to acoustically identical words in fluent contexts, as well as to unpredictable and predictable words that occurred immediately post-disfluency and in fluent utterances. We additionally measured participants’ recognition memories for the predictable and unpredictable words. Repetitions elicited an early onsetting relative positivity (100–400 ms post-stimulus), clearly demonstrating listeners’ sensitivity to the presence of disfluent repetitions. Unpredictable words elicited an N400 effect. Importantly, there was no evidence that this effect, thought to reflect the difficulty of semantically integrating unpredictable compared to predictable words, differed quantitatively between fluent and disfluent utterances. Furthermore there was no evidence that the memorability of words was affected by the presence of a preceding repetition. These findings contrast with previous research which demonstrated an N400 attenuation of, and an increase in memorability for, words that were preceded by an er. However, in a later (600–900 ms) time window, unpredictable words following a repetition elicited a relative positivity. Reanalysis of previous data confirmed the presence of a similar effect following an er. The effect may reflect difficulties in resuming linguistic processing following any disruption to speech.     

世界知识在句子理解中的整合时程

Hagoort等(2004)应用背离范式发现世界知识和单词意义在句末的整合是同时进行的。本研究将背离信息提前到句首短语中,旨在探讨世界知识在句子阅读过程中被整合的时程特征。实验采用四词句子为材料,其中第二个词（目标词）含有单词意义或世界知识背离信息,记录并比较被试在阅读后三个词时诱发的脑电变化。结果发现：与正确句子比较,无论是单词意义背离还是世界知识背离,背离目标词均引发出经典的N400,二者在峰值时间和始潜时上无显著差异,但世界知识背离信息诱发的N400波幅值相对较小。句中的后继单词不再诱发类似的N400;但到句子结尾,两类含有背离信息句子的句末正常单词又诱发出类似N400的一个负波。结果提示,在句子理解过程中,世界知识的整合与单词意义的整合相似,可能是随着句子理解过程即时进行的,整合的结果不影响后继信息的加工;但到了句末,读者在对整个句子内容作真实性判断时会对先前进行过的整合再进行考察。     

词汇加工初期语义属性的激活程度:来自ERP的证据

运用事件相关脑电位（ERP）技术,采用快速掩蔽启动范式和Go/Nogo范式,探讨汉语重复启动和语义相关启动中语义激活程度的差异和特点。实验中要求被试执行一个额外的语义判断任务,对关键刺激不做明显的行为反应。结果发现,在重复启动条件下获得了稳定的N400效应,语义相关启动条件下没有N400效应;重复启动和语义相关启动条件均未产生N250效应。在较短的SOA条件下,词频对语义的激活和加工不产生影响。     

Evolution of word meanings through metaphorical mapping: Systematicity over the past millennium

One way that languages are able to communicate a potentially infinite set of ideas through a finite lexicon is by compressing emerging meanings into words, such that over time, individual words come to express multiple, related senses of meaning. We propose that overarching communicative and cognitive pressures have created systematic directionality in how new metaphorical senses have developed from existing word senses over the history of English. Given a large set of pairs of semantic domains, we used computational models to test which domains have been more commonly the starting points (source domains) and which the ending points (target domains) of metaphorical mappings over the past millennium. We found that a compact set of variables, including externality, embodiment, and valence, explain directionality in the majority of about 5000 metaphorical mappings recorded over the past 1100 years. These results provide the first large-scale historical evidence that metaphorical mapping is systematic, and driven by measurable communicative and cognitive principles.     

The interplay between semantic and referential aspects of anaphoric noun phrase resolution: Evidence from ERPs

In this event-related brain potential (ERP) study, we examined how semantic and referential aspects of anaphoric noun phrase resolution interact during discourse comprehension. We used a full factorial design that crossed referential ambiguity with semantic incoherence. Ambiguous anaphors elicited a sustained negative shift (Nref effect), and incoherent anaphors elicited an N400 effect. Simultaneously ambiguous and incoherent anaphors elicited an ERP pattern resembling that of the incoherent anaphors. These results suggest that semantic incoherence can preclude readers from engaging in anaphoric inferencing. Furthermore, approximately half of our participants unexpectedly showed common late positive effects to the three types of problematic anaphors. We relate the latter finding to recent accounts of what the P600 might reflect, and to the role of individual differences therein.     

性别刻板印象表征的形式及神经基础

本实验采用ERP技术,考察性别刻板印象的表征。结果发现,无论启动是上位范畴、子范畴、典型样例还是反例,被试对于刻板印象不一致的表征比一致的表征均诱发了波幅更大的N400,反应时更长。并且,被试对于性别刻板印象的表征存在层级差异。研究结果表明：（1）性别刻板印象的表征存在层级结构。（2）语义启动下,性别刻板印象违背诱发N400效应。（3）性别刻板印象表征存在自上而下的由大脑额叶进行的语义分类加工。     

汉字正字法家族效应的ERP研究

以汉字为实验材料,自变量为汉字正字法笔画家族大小,采用延迟反应的同一字判断任务,记录并研究大学生被试对刺激字的脑电(EEG)。本文对笔画家族的定义是,通过改变1~5笔笔画得到刺激字的正字法家族成员,改变的笔画不构成部件。脑电结果显示:大家族刺激字比小家族刺激字诱发更负的N400和N250成分、更低的P200,其中N400的结果与基于交互激活模型的二阶段理论的预期一致。     

Language knowledge and event knowledge in language use

This paper examines how semantic knowledge is used in language comprehension and in making judgments about events in the world. We contrast knowledge gleaned from prior language experience (“language knowledge”) and knowledge coming from prior experience with the world (“world knowledge”). In two corpus analyses, we show that previous research linking verb aspect and event representations have confounded language and world knowledge. Then, using carefully chosen stimuli that remove this confound, we performed four experiments that manipulated the degree to which language knowledge or world knowledge should be salient and relevant to performing a task, finding in each case that participants use the type of knowledge most appropriate to the task. These results provide evidence for a highly context-sensitive and interactionist perspective on how semantic knowledge is represented and used during language processing.     

The influence of spatial representation on valence judgements: An event-related potential study

The present study used event-related potentials (ERPs) to explore the nature of space-valence congruency effects. We presented participants with up or down arrows at the centre of the screen and then asked participants to identify whether the following target words had the emotional valence. The target words included positive emotional words (e.g., “happy” and “delight”), negative emotional words (e.g., “sad” and “depressive”) and neutral words (e.g., “history” and “country”). Behavioural data showed that the positive targets were identified faster when they are primed by up arrows than when primed by down arrows, whereas the negative targets were identified faster when they are primed by down arrows than when primed by up arrows. The ERP analysis showed larger P2 amplitudes were found in the congruent condition (i.e., the positive targets following up arrows or the negative targets following down arrows) than in the incongruent condition (i.e., the positive targets following down arrows or the negative targets following up arrows). Furthermore, larger N400 amplitudes were found in the incongruent condition compared with the congruent condition. Moreover, larger LPC amplitudes were found in the congruent condition compared with the incongruent condition. Therefore, in addition to replicating the space-valence congruency effects in a neutral/emotional judgement task, our study also extended previous studies by showing that spatial information modulates the processing of the emotional words at multiple stages.     

Sublexical ambiguity effect in reading Chinese disyllabic compounds

For Chinese compounds, neighbors can share either both orthographic forms and meanings, or orthographic forms only. In this study, central presentation and visual half-field (VF) presentation methods were used in conjunction with ERP measures to investigate how readers solve the sublexical semantic ambiguity of the first constituent character in reading a disyllabic compound. The sublexical ambiguity of the first character was manipulated while the orthographic neighborhood sizes of the first and second character (NS1, NS2) were controlled. Subjective rating of number of meanings corresponding to a character was used as an index of sublexical ambiguity. Results showed that low sublexical ambiguity words elicited a more negative N400 than high sublexical ambiguity words when words were centrally presented. Similar patterns were found when words were presented to the left VF. Interestingly, different patterns were observed for pseudowords. With left VF presentation, high sublexical ambiguity psudowords showed a more negative N400 than low sublexical ambiguity pseudowords. In contrast, with right VF presentation, low sublexical ambiguity pseudowords showed a more negative N400 than high sublexical ambiguity pseudowords. These findings indicate that a level of morphological representation between form and meaning needs to be established and refined in Chinese. In addition, hemispheric asymmetries in the use of word information in ambiguity resolution should be taken into account, even at sublexical level.     

Violations of information structure: an electrophysiological study of answers to wh-questions

This study investigates brain responses to violations of information structure in wh-question-answer pairs, with particular emphasis on violations of focus assignment in it-clefts (It was the queen that silenced the banker). Two types of ERP responses in answers to wh-questions were found. First, all words in the focus-marking (cleft) position elicited a large positivity (P3b) characteristic of sentence-final constituents, as did the final words of these sentences, which suggests that focused elements may trigger integration effects like those seen at sentence end. Second, the focusing of an inappropriate referent elicited a smaller, N400-like effect. The results show that comprehenders actively use structural focus cues and discourse-level restrictions during online sentence processing. These results, based on visual stimuli, were different from the brain response to auditory focus violations indicated by pitch-accent [Hruska, C., Steinhauer, K., Alter, K., & Steube, A. (2000). ERP effects of sentence accents and violations of the information structure. In Poster presented at the 13th annual CUNY conference on human sentence processing, San Diego, CA.], but similar to brain responses to newly introduced discourse referents [Bornkessel, I., Schlesewsky, M., & Friederici, A. (2003). Contextual information modulated initial processes of syntactic integration: the role of inter- versus intrasentential predictions. Journal of Experimental Psychology: Learning, Memory and Cognition, 29, 871-882.].     

How iconic gestures enhance communication: an ERP study

EEG was recorded as adults watched short segments of spontaneous discourse in which the speaker's gestures and utterances contained complementary information. Videos were followed by one of four types of picture probes: cross-modal related probes were congruent with both speech and gestures; speech-only related probes were congruent with information in the speech, but not the gesture; and two sorts of unrelated probes were created by pairing each related probe with a different discourse prime. Event-related potentials (ERPs) elicited by picture probes were measured within the time windows of the N300 (250-350 ms post-stimulus) and N400 (350-550 ms post-stimulus). Cross-modal related probes elicited smaller N300 and N400 than speech-only related ones, indicating that pictures were easier to interpret when they corresponded with gestures. N300 and N400 effects were not due to differences in the visual complexity of each probe type, since the same cross-modal and speech-only picture probes elicited N300 and N400 with similar amplitudes when they appeared as unrelated items. These findings extend previous research on gesture comprehension by revealing how iconic co-speech gestures modulate conceptualization, enabling listeners to better represent visuo-spatial aspects of the speaker's meaning.     

重读对口语理解中时间选择性注意分配的影响

采用事件相关电位（ERP）技术来研究重读如何影响口语加工中早期的选择性注意分配。并进一步研究重读的这种注意调控作用是否受声调的影响。实验以单个句子为实验材料,结果发现重读比不重读条件下的关键词更早的引起一个早期负波（N1）,并且引起更大的N400。在两个时间窗口重读的效应都不受声调的调控。这些结果表明,在自然的口语理解过程中,重读能够快速的调控早期选择性注意的分配,并影响接下来的语义加工的深度。