Discourse-mediation of the mapping between language and the visual world: Eye movements and mental representation

Two experiments explored the mapping between language and mental representations of visual scenes. In both experiments, participants viewed, for example, a scene depicting a woman, a wine glass and bottle on the floor, an empty table, and various other objects. In Experiment 1, participants concurrently heard either ‘The woman will put the glass on the table’ or ‘The woman is too lazy to put the glass on the table’. Subsequently, with the scene unchanged, participants heard that the woman ‘will pick up the bottle, and pour the wine carefully into the glass.’ Experiment 2 was identical except that the scene was removed before the onset of the spoken language. In both cases, eye movements after ‘pour’ (anticipating the glass) and at ‘glass’ reflected the language-determined position of the glass, as either on the floor, or moved onto the table, even though the concurrent (Experiment 1) or prior (Experiment 2) scene showed the glass in its unmoved position on the floor. Language-mediated eye movements thus reflect the real-time mapping of language onto dynamically updateable event-based representations of concurrently or previously seen objects (and their locations).     

Measuring cognitive factors in speech comprehension: The value of using the Text Reception Threshold test as a visual equivalent of the SRT test

The ability to comprehend speech in noise is influenced by bottom-up auditory and top-down cognitive capacities. Separate examination of these capacities is relevant for various purposes. Speech-Reception-Threshold (SRT) tests measure an individual's ability to comprehend speech. This paper addresses the value of the Text-Reception-Threshold (TRT) test (a visual parallel of the SRT test) to assess the cognitive capacities allocated during speech comprehension. We conducted a secondary data analysis, including 87 normally-hearing adults (aged 18 to 78 years). Correlation coefficients between age, TRT, working memory (Spatial Span) and SRT were examined. The TRT and SRT correlated significantly ( r  =   0.30), supporting the value of TRT in explaining inter-individual differences in SRTs. The relations between age and TRT and between SSP and TRT were non-significant. The results indicate that the current TRT test does not fully cover the cognitive aspects relevant in speech comprehension. Adaptation of the test is required before clinical implementation can be considered.     

视角在时间语言理解中的影响

语言学家在英语的时间语言表达中发现了隐含其中的两种不同运动视角：一种是从过去指向将来的自我运动（自我运动视角moving-ego）;另一种是从将来指向过去的时间运动（时间运动视角moving-time）。心理学家McGlone＆Harding报告了在英语中视角对时问语言理解的作用,并提出人们存在MT视角的偏向。本文报告了两个实验,实验1直接运用和修改McGlone＆Harding的范式在汉语文本探讨视角对时间语言理解的影响。实验2运用信号检测理论来验证了人们存在MT视角偏向。     

不同文章难度条件下文化特征类型熟悉度对阅读理解的影响

该研究考察了非英语专业具有不同英语语言水平学习者在不同难度条件下两种文化特征熟悉度对阅读理解的影响。研究发现：（1）语言水平高,或对材料背景熟悉的学习者可通过调用熟悉的文化背景知识帮助阅读理解,其得分均高于低水平,或对材料不熟悉的学习者;（2）在熟悉的文化背景条件下,当材料难度与学习者语言水平基本一致时,语言水平低的学习者也可较好地运用熟悉的文化背景知识帮助阅读理解。实验结果表明：文化特征的内容熟悉度和英语语言水平（或文章难度）对阅读理解起着重要作用,语言水平越高,作用越大。     

速度、步幅与窗口对引导式中文文本阅读工效的影响

引导式显示是在视觉显示终端(VDT)上呈现动态文本的主要方式之一.本研究考察了显示窗口大小、跳动步幅、显示速度等因素对引导式中文文本的阅读工效的影响.实验中采用了3(跳动步幅,被试内变量)×3(显示速度,被试内变量)×2(显示窗口大小,被试间变量)的混合设计,共有18个被试参加了实验.结果发现(1)跳动步幅、显示速度和窗口大小均影响中文文本的阅读工效;(2)达到最佳阅读工效的实验条件在速度和步幅上分别集中于200～400字/分和1～3字/步.最后本文结合中文阅读的相关眼动研究,对这些结果的成因进行了简要的探讨.     

Spoken Idiom Recognition: Meaning Retrieval and Word Expectancy

This study investigates recognition of spoken idioms occurring in neutral contexts. Experiment 1 showed that both predictable and non-predictable idiom meanings are available at string offset. Yet, only predictable idiom meanings are active halfway through a string and remain active after the string’s literal conclusion. Experiment 2 showed that the initial fragment of a predictable idiom inhibits recognition of a word providing a congruous, but literal, conclusion to the expression. No comparable effects were obtained with non-predictable idioms. These findings are consistent with the view that spoken idiom identification differs from word recognition and occurs word-by-word, just as with other familiar, multi-lexical phrases.The present study was supported by PRIN 2003–2004. We would like to thank Corrado Cavallero, Simona Collina, Melinda Tucker and Francesco Zardon for their valuable help.     

Constituent Length Affects Prosody and Processing for a Dative NP Ambiguity in Korean

Two sentence processing experiments on a dative NP ambiguity in Korean demonstrate effects of phrase length on overt and implicit prosody. Both experiments controlled non-prosodic length factors by using long versus short proper names that occurred before the syntactically critical material. Experiment 1 found that long phrases induce different prosodic phrasing than short phrases in a read-aloud task and change the preferred interpretation of globally ambiguous sentences. It also showed that speakers who have been told of the ambiguity can provide significantly different prosody for the two interpretations, for both lengths. Experiment 2 verified that prosodic patterns found in first-pass pronunciations predict self-paced reading patterns for silent reading. The results extend the coverage of the Implicit Prosody Hypothesis [Fodor, J Psycholinguist Res 27:285–319, 1998; Prosodic disambiguation in silent reading. In M. Hirotani (Ed.), NELS 32 (pp. 113–132). Amherst, MA: GLSA Publications, 2002] to another construction and to Korean. They further indicate that strong syntactic biases can have rapid effects on the formulation of implicit prosody.     

The Time Course of Verb Processing in Dutch Sentences

The verb has traditionally been characterized as the central element in a sentence. Nevertheless, the exact role of the verb during the actual ongoing comprehension of a sentence as it unfolds in time remains largely unknown. This paper reports the results of two Cross-Modal Lexical Priming (CMLP) experiments detailing the pattern of verb priming during on-line processing of Dutch sentences. Results are contrasted with data from a third CMLP experiment on priming of nouns in similar sentences. It is demonstrated that the meaning of a matrix verb remains active throughout the entire matrix clause, while this is not the case for the meaning of a subject head noun. Activation of the meaning of the verb only dissipates upon encountering a clear signal as to the start of a new clause.     

Is it better to be happy or to be proud at school before doing a text comprehension task? First evidence with 10-year-old children

Introduction and objective

An experiment was conducted in a school context to examine whether joy and pride, two positive emotions, can promote children's acquisition of knowledge in a reading comprehension situation.