Similarity information versus relational information: differences in the time course of retrieval

Two experiments are reported that examine the time course of retrieval in a sentence matching procedure. Subjects learned lists of active and passive sentences and were tested with sentences in active or passive, correct or incorrect versions; for example, if "John hit Bill" was a studied sentence, "Bill hit John" would be an incorrect active test sentence. A response signal procedure was used so that accuracy could be measured as a function of time. The data show that sentences containing words from studied sentences are discriminable early in processing from sentences containing all new words, but discrimination of correct from incorrect versions of studied sentences occurs only later in processing (after 600-700 ms). These results demonstrate that different kinds of information are available at different points during the time course of retrieval and so suggest that modifications are required of models that provide only a unitary value for the amount of match between a test probe and information in memory. Early in processing, the growth of accuracy can be explained by a simple model that assumes independent contributions to total amount of match for each of the content words of a sentence, but this independent processing model cannot account for discrimination later in processing. Several, more general, memory models are examined with respect to their abilities to produce independent item information early in processing and relational information later in processing.     

Not Propositions

Current computational accounts of meaning in the cognitive sciences are based on abstract, amodal symbols (e.g., nodes, links, propositions) that are arbitrarily related to their referents. We argue that such accounts lack convincing empirical support and that they do not provide a satisfactory account for linguistic meaning. One historic set of results supporting the abstract symbol view has come from investigation into comprehension of negated sentences, such as “The buttons are not black.” These sentences are presumed to be understood as two propositions composed of abstract symbols. One proposition corresponds to “the buttons are black,” and it is embedded in another proposition corresponding to “it is not true.” Thus, the propositional account predicts (a) that comprehension of negated sentences should take longer than comprehension of the corresponding positive sentence (because of the time needed to construct the embedding), but (b) that the resulting embedded propositions are informationally equivalent (but of opposite valence) to the simple proposition underlying the positive sentence. Contrary to these predictions, Experiment 1 demonstrates that negated sentences out of context are interpreted as situationally ambiguous, that is, as conveying less specific information than positive sentences. Furthermore, Experiment 2 demonstrates that when negated sentences are used in an appropriate context, readers do not take longer to understand them. Thus, difficulty with negation is demonstrated to be an artifact of presentation out of context. After discussing other serious problems with the use of abstract symbols, we describe the Indexical Hypothesis. This embodied account of meaning does not depend on abstract symbols, and hence it provides a more satisfactory account of meaning.     

Environmental sound priming: Does negation modify N400 cross-modal priming effects?

Human information processing is incredibly fast and flexible. In order to survive, the human brain has to integrate information from various sources and to derive a coherent interpretation, ideally leading to adequate behavior. In experimental setups, such integration phenomena are often investigated in terms of cross-modal association effects. Interestingly, to date, most of these cross-modal association effects using linguistic stimuli have shown that single words can influence the processing of non-linguistic stimuli, and vice versa. In the present study, we were particularly interested in how far linguistic input beyond single words influences the processing of non-linguistic stimuli; in our case, environmental sounds. Participants read sentences either in an affirmative or negated version: for example: “The dog does (not) bark”. Subsequently, participants listened to a sound either matching or mismatching the affirmative version of the sentence (‘woof’ vs. ‘meow’, respectively). In line with previous studies, we found a clear N400-like effect during sound perception following affirmative sentences. Interestingly, this effect was identically present following negated sentences, and the negation operator did not modulate the cross-modal association effect observed between the content words of the sentence and the sound. In summary, these results suggest that negation is not incorporated during information processing in a manner that word–sound association effects would be influenced.     

Experiential simulations of negated text information

We investigated the question of whether comprehenders mentally simulate a described situation even when this situation is explicitly negated in the sentence. In two experiments, participants read negative sentences such as There was no eagle in the sky, and subsequently responded to pictures of mentioned entities in the context of a recognition task. Participants' responses following negative sentences were faster when the depicted entity matched rather than mismatched the negated situation. These results suggest that comprehenders simulate the negated situation when processing a negated sentence. The results thereby provide further support for the experiential-simulations view of language comprehension.     

Experiential simulations of negated text information

We investigated the question of whether comprehenders mentally simulate a described situation even when this situation is explicitly negated in the sentence. In two experiments, participants read negative sentences such as There was no eagle in the sky, and subsequently responded to pictures of mentioned entities in the context of a recognition task. Participants' responses following negative sentences were faster when the depicted entity matched rather than mismatched the negated situation. These results suggest that comprehenders simulate the negated situation when processing a negated sentence. The results thereby provide further support for the experiential-simulations view of language comprehension.     

状态不确定独立否定句的加工机制

采用自定步速阅读方法与图片核证范式(picture verification paradigm)探讨状态不确定独立否定句(如“裙子不是红色的”)的动态表征过程, 包括3个实验。结果发现：(1)在否定加工的初期, 即250 ms间隔时间条件下, 读者表征事件的否定状态; 肯定句已经通达事件的实际状态。(2)在否定加工的中期, 即750 ms间隔时间条件下, 读者仍然表征事件的否定状态, 但已开始对事件的备择选项进行搜索; 肯定句仍然保持对事件实际状态的表征。(3)在否定加工的后期, 即1500 ms间隔时间条件下, 读者表征否定标记与事件的否定状态, 同时完成对备择选项的搜索; 肯定句依旧保持对事件实际状态的表征。据此, 本文提出的锚激活与限制满足模型(anchor-based activation and satisfaction constrained model)得到初步证明。     

Valence specific laterality effects in prosody: expectancy account and the effects of morphed prosody and stimulus lead

The majority of studies have demonstrated a right hemisphere (RH) advantage for the perception of emotions. Other studies have found that the involvement of each hemisphere is valence specific, with the RH better at perceiving negative emotions and the LH better at perceiving positive emotions [Reuter-Lorenz, P., & Davidson, R.J. (1981) Differential contributions of the 2 cerebral hemispheres to the perception of happy and sad faces. Neuropsychologia, 19, 609-613]. To account for valence laterality effects in emotion perception we propose an 'expectancy' hypothesis which suggests that valence effects are obtained when the top-down expectancy to perceive an emotion outweighs the strength of bottom-up perceptual information enabling the discrimination of an emotion. A dichotic listening task was used to examine alternative explanations of valence effects in emotion perception. Emotional sentences (spoken in a happy or sad tone of voice), and morphed-happy and morphed-sad sentences (which blended a neutral version of the sentence with the pitch of the emotion sentence) were paired with neutral versions of each sentence and presented dichotically. A control condition was also used, consisting of two identical neutral sentences presented dichotically, with one channel arriving before the other by 7 ms. In support of the RH hypothesis there was a left ear advantage for the perception of sad and happy emotional sentences. However, morphed sentences showed no ear advantage, suggesting that the RH is specialised for the perception of genuine emotions and that a laterality effect may be a useful tool for the detection of fake emotion. Finally, for the control condition we obtained an interaction between the expected emotion and the effect of ear lead. Participants tended to select the ear that received the sentence first, when they expected a 'sad' sentence, but not when they expected a 'happy' sentence. The results are discussed in relation to the different theoretical explanations of valence laterality effects in emotion perception.     

Differences in Scope Assignments for Child and Adult Speakers of Mandarin

The present study used a Truth Value Judgment Task to investigate whether changes in sentence structure lead to corresponding changes in the assignment of scope relations by Mandarin-speaking children and adults. In one condition, participants were presented with ordinary negative sentences containing disjunction; this condition was designed to verify the existing claim that disjunction is a positive polarity item for adult speakers of Mandarin, but not for child speakers. In a second condition, participants were presented with negative sentences where the disjunction phrase was preposed from object position; this condition was designed to examine the extent to which changes in sentence structure can result in changes in scope assignments to negated disjunctions. The results indicate that the preposed disjunction phrase undergoes reconstruction for children, whereas reconstruction is blocked for adults. This finding also suggests that Mandarin-speaking children and adults exhibit different scope preferences for negated disjunctions, regardless of where the disjunction phrase appears in the surface syntax.     

结果不确定离散型否定句加工机制:锚激活与限制满足模型的修正与补充

3个实验采用图片核证范式探讨结果不确定离散型否定句(如卡通不是米老鼠,米老鼠为锚图片,唐老鸭为锚高相关图片,蓝精灵为锚低相关图片)的动态表征过程。结果发现:(1)被试在初期对锚图片的反应最快,说明仅表征了事件的否定状态。(2)在中期,三类图片的反应时之间没有差异,支持全域搜索假设。(3)在晚期,被试对锚高相关图片的反应时最短,且锚图片与锚低相关图片无差异,结果支持限制接受假设。研究支持并拓展了锚激活与限制满足模型。     

否定句理解中知觉仿真的动态过程

采用移动窗口阅读技术探讨否定句理解中被否定的情境和真实情境在头脑中的具体表征。实验材料包括否定句和图片,根据句子隐含形状与再认图片的匹配关系分为匹配和不匹配两个版本。实验1中句子呈现时间为700ms,结果发现匹配版本中图片再认时间明显短于不匹配版本,证实了否定句理解中被否定情境的知觉仿真。实验2中句子呈现时间延长到1000ms,结果两个版本图片再认时间没有差异,说明读者已经转为对否定句所表达的真实情境进行仿真。实验支持了知觉符号观并进一痔说明否常甸珈解中知带仿直和知慌符号瀚活是一个动杰的“两步击”的加工讨程。     

Pictures,Words, and Sounds: From Which Format Are We Best Able to Reason?

The effect of presentation format on reasoning was studied with a sentence verification task. Background information was presented in single-format and combined conditions that included pictured, printed, or spoken versions of the stimulus items. In Experiment 1, a test sentence appeared together with the background at varied stimulus onset asynchronies, to study how format influences the acquisition of the stimulus information. In Experiments 2 and 3, however, the test sentence followed the presentation of the background, to test the effect of format on memory. Reaction time responses to the test sentences showed a consistent picture advantage. However, when participants responded to materials stored in memory, both pictured and spoken formats provided quicker responses in comparison to printed words, and the format difference was smaller than when materials were readily available on the screen. Multimedia presentations, when compared with single-format conditions, did not provide additional benefits.     

Pictures, words, and sounds: from which format are we best able to reason?

The effect of presentation format on reasoning was studied with a sentence verification task. Background information was presented in single-format and combined conditions that included pictured, printed, or spoken versions of the stimulus items. In Experiment 1, a test sentence appeared together with the background at varied stimulus onset asynchronies, to study how format influences the acquisition of the stimulus information. In Experiments 2 and 3, however, the test sentence followed the presentation of the background, to test the effect of format on memory. Reaction time responses to the test sentences showed a consistent picture advantage. However, when participants responded to materials stored in memory, both pictured and spoken formats provided quicker responses in comparison to printed words, and the format difference was smaller than when materials were readily available on the screen. Multimedia presentations, when compared with single-format conditions, did not provide additional benefits.     

Effects of sentence importance on text recall and recognition: The inferential hypothesis

Abstract

The hypothesis that sentences with important information are more likely to be remembered than less important sentences because the former are inferred to a greater extent than the latter, was explored. In three previous studies, sentence importance in the structure of texts had been established: Main sentences were assigned higher importance ratings, and recalled and recognised better than secondary sentences. In the present experiment, the subjects read two out of six 500-word texts at their own pace and performed a recall or a recognition test 8 min and 7 days later. Different text versions were written; in each version, one main sentence and one secondary sentence were removed from the original texts. me results showed: (1) a higher false alarm rate and intrusion proportion for main sentences compared to secondary sentences; (2) superior net recall scores (after deduction of intrusions) and memory scores (after correction for guessing) for main sentences; but (3) equivalent net recognition scores (after deduction of false alarms) and discrimination (d') scores in the immediate test, and a superior net recognition and discrimination of secondary sentences in the delayed test. It is concluded that the inferential hypothesis is consistent with most of the results, and that the probability of coding and retention does not differ as a function of sentence importance, though main information may be retrieved more easily than less important information.     

晚期汉-英二语者英语被动句句法加工的ERP研究*

选取二语中等熟练者和高熟练者两类中国大学生被试,共40人(27女,13男),年龄为20~29岁,平均年龄23.88岁。采用ERP技术,以直译型英语被动句和意译型英语被动句作为实验材料,通过比较无违例、―句法违例句1‖(动词过去分词形式错误)、―句法违例句2‖(动词过去分词错误用为动词原形而造成的句法违例)以及―句法违例句3‖(动词过去分词误用为动词现在分词形式)条件下的行为数据和ERP多维数据变化的基础上,探讨了二语熟练度和语言间句法结构相似性对汉-英双语者英语被动句句法加工过程的影响。结果表明：高熟练者的反应时和正确率整体上优于中等熟练者;难易度不同的句法错误信息会直接影响被动句的加工,对明显有错误的句法信息的反应速度最快,―正确的局部句法信息‖反应时最长。对明显有错误的句法信息的正确反应率最高,最根本的句法结构的错误信息最低。最根本的句法结构的错误信息引发的P600最大,无违例条件引发的P600最小;高熟练者对最根本的句法结构的错误信息引发最大的P600效应,中等熟练者的P600效应未受不同句法错误信息的影响。行为指标支持句法加工相似性效应——直译句反应快、正确率高;意译句反应慢、正确率低。并且此效应在中等熟练者身上表现更加明显。但是脑神经活动模式未表现出句法结构相似性效应,说明二语熟练度在英语被动句加工中具有更为显著的作用。     

Effects of vowel variety and sample lenght on identification of a speaker in a line-up

Subjects (average age 21 years, recruited by personal contact and through a school) were presented with a spoken sentence on tape and then heard six speakers of the same sex, including the original speaker, say the same sentence. They were required to indicate which was the original speaker. The task was repeated with seven different sentences and sets of speakers. One group of subjects heard short sentences containing an average of 2.14 different vowel sounds and 6.28 syllables, another group heard short sentences containing an average of 6.14 vowel sounds (7.28 syllables) and a third group heard longer sentences containing an average of 6.28 vowel sounds (11.00 syllables). Accuracy of speaker identification improved significantly when more vowel sounds were heard, but increased sentence length had no significant effect on performance. Performance was significantly better when the listener was the same sex as the speaker than when the listener was of the other sex.     

Intonational marking of given and new information: Some consequences for comprehension

The role of intonation in conveying discourse relationships in auditory sentence comprehension was investigated in two experiments. Using the simple comprehension time paradigm, Experiment 1 found that sentences with accented new information were understood faster than sentences with a neutral intonation contour and that the presence of accent in context sentences facilitated comprehension of subsequent targets. Both experiments showed faster comprehension times in conditions in which accent placement was appropriate for the information structure of the sentence. In Experiment I, comprehension times were faster when the accent fell on the information focus than when it fell elsewhere in the sentence. In Experiment 2, faster times resulted when new information was accented and given information was not, compared to conditions in which this accent pattern was reversed. This effect held for both active and passive sentences, and whether the new information occurred in the subject or object position.     

汉语句子可继续性对句子理解加工的即时影响

通过操纵动词与后接词的关系,来产生搭配异常并控制句子的可继续性,研究汉语词汇信息在句子加工中的即时作用。实验一利用跨通道技术,发现动一名词搭配异常对目标名词的加工有即时影响,形容词条件下可继续性对目标形容词的加工有即时影响;实验二采用眼动技术,发现名词条件和形容词条件下可继续性均有显著的即时影响。结果显示,语义等多种词汇信息被通达后立即共同参与了汉语句子加工。     

Immediate and delayed recall of visually presented sentences: evidence for the involvement of phonological information

The lure intrusion effect refers to the observation that lexical priming affects recall of sentences. This effect is taken as evidence against the contribution of surface information, even with immediate sentence recall. Recently, Rummer and Engelkamp (2003a) demonstrated that this effect, which is usually observed under rapid serial visual presentation (RSVP), does not appear under immediate recall of auditorily presented sentences. This finding indicates that surface information (i.e., phonological or acoustic-sensory information) can contribute to immediate sentence recall. So far, however, the findings do not allow for a decision on whether phonological and/or acoustic-sensory information is used in immediate sentence recall. In order to dissociate the two kinds of surface information, an experiment was conducted in which immediate and delayed recall were tested for sentences that were visually presented for a longer period of time than in RSVP. This kind of presentation should support phonological representations, but does not allow for acoustic-sensory representations. The findings showed a smaller intrusion effect for immediate than for delayed recall. This indicates that, if available, phonological information is involved in immediate sentence recall thereby reducing the lure intrusion effect. Furthermore, the findings support the assumption that the phonological trace provided via RSVP reading is weaker than in normal reading.     

汉语确定性无界否定句模拟加工的时间进程

以往关于否定句理解的心理模拟过程是一步完成的还是两步完成的, 结果并不一致, 这与各个研究使用的实验材料类型有关。本研究以汉语确定性无界否定句为研究对象, 采用句-图匹配范式和2(句子类型：汉语确定性无界肯定句和汉语确定性无界否定句) × 2 (图片描绘事物状态与句子描述的事物状态的匹配类型：匹配与不匹配)被试内实验设计, 以对图片判断的反应时和正确率为指标, 探讨其理解的早期(250 ms)、中期(750 ms)和晚期(1500 ms)的心理模拟过程。研究结果表明：确定性无界否定句理解的心理模拟是分两步进行的, 首先模拟的是否定句的被否定状态, 随着加工时间的推进, 完成了对确定性无界否定句的第二步模拟即对实际状态的模拟。但是, 比其他类型否定句的模拟过程所用的时间要短, 即在阅读理解的中期就完成了心理模拟。     

强弱语义语境下的否定句加工机制

2个眼动实验分别探讨强弱语义语境下的否定句加工机制, 以便考察语言理解是命题表征的过程还是经验模拟的过程, 抑或是二者兼具。在实验中, 被试首先听句子(强语义语境：如“胳膊不是弯曲的”的备择选项为“伸直的胳膊”, 其中“弯曲−伸直”为具有反义关系的强语义连接关系; 弱语义语境：如加工“裙子不是蓝色的”的备择选项为“黑色的裙子”, “蓝色−黑色”为弱语义连接关系), 然后会看到4张同时呈现的图片, 被试的任务是按键选择与句子描述匹配的图片。结果发现, 在强语义语境条件下, 被试在早期(201~600 ms时窗)对描述事件否定状态的图片(弯曲的胳膊)与描述事件实际状态的图片(伸直的胳膊)的注视概率没有差别, 晚期(601 ms后)仅对描述事件实际状态的图片的注视概率更高; 弱语义语境条件下, 被试在早期(401~600 ms)仅对描述事件否定状态的图片(蓝裙子)注视概率更高, 晚期(801 ms后)仅对描述事件实际状态的图片(黑色裙子)注视概率更高; 并且, 都对描述事件否定状态的图片的注视概率低于随机水平。结果支持符号依存假设和抑制假设。