Overt reanalysis strategies and eye movements during the reading of mild garden path sentences

In an eye movement experiment, we examined the use of reanalysis strategies during the reading of locally ambiguous but globally unambiguous Spanish sentences. Among other measures, we examined regressive eye movements made while readers were recovering in reading mild garden path sentences. The sentences had an adverbial clause that, depending on the mood (indicative vs. subjunctive) of the subordinate clause verb, could attach high (to the main verb of the sentence) or low (to the verb in the subordinate clause). Although Spanish speakers favor low attachment, the high attachment version was quite easy to understand. Readers predominately used two alternative strategies to recover from the mild garden path in our sentences. In the more common reanalysis strategy, their eyes regressed from the last region (disambiguation+ 1) directly to the main verb in the sentence. Following this, they reread the rest of the sentence, fixating the next region and the adverb (the beginning of the ambiguous part of the sentence). Less frequently, readers regressed from the last region (disambiguation+1) directly to the adverb. We argue that both types of strategies are consistent with a selective reanalysis process as described by Frazier and Rayner (1982).     

The effect of plausibility on eye movements in reading

Readers' eye movements were monitored as they read sentences describing events in which an individual performed an action with an implement. The noun phrase arguments of the verbs in the sentences were such that when thematic assignment occurred at the critical target word, the sentence was plausible (likely theme), implausible (unlikely theme), or anomalous (an inappropriate theme). Whereas the target word in the anomalous condition provided evidence of immediate disruption, the effect of the target word in the implausible condition was considerably delayed. The results thus indicate that when a word is anomalous, it has an immediate effect on eye movements, but that the effect of implausibility is not as immediate.     

Looking to understand: the coupling between speakers' and listeners' eye movements and its relationship to discourse comprehension

We investigated the coupling between a speaker's and a listener's eye movements. Some participants talked extemporaneously about a television show whose cast members they were viewing on a screen in front of them. Later, other participants listened to these monologues while viewing the same screen. Eye movements were recorded for all speakers and listeners. According to cross-recurrence analysis, a listener's eye movements most closely matched a speaker's eye movements at a delay of 2 sec. Indeed, the more closely a listener's eye movements were coupled with a speaker's, the better the listener did on a comprehension test. In a second experiment, low-level visual cues were used to manipulate the listeners' eye movements, and these, in turn, influenced their latencies to comprehension questions. Just as eye movements reflect the mental state of an individual, the coupling between a speaker's and a listener's eye movements reflects the success of their communication.     

Motion-Verb Generalizations in English and Spanish: Influences of Language and Syntax

English and Spanish speakers differ in the ways they talk about motion events, but how have these different modes of expression become instantiated as differing generalizations—as syntactic rules, lexical patterns, or both? In two studies, we asked English- and Spanish-speaking adults to interpret novel motion verbs presented in three types of sentence frames. Overall, English speakers expected novel verbs to encode the manner of motion, whereas Spanish speakers expected the verbs to encode the path of motion. The sentence frames also significantly affected how the speakers interpreted the novel verbs. We conclude that speakers of different languages represent their different generalizations about the composition of motion verbs both lexically and syntactically, and discuss how these generalizations might be important for issues of language acquisition and linguistic relativity.     

Attention and eye movements in reading: inhibition of return predicts the size of regressive saccades

A spatial cuing task was used to identify two types of readers, those with a relatively fast and those with a relatively slow buildup of inhibition of return (IOR). Backward-directed eye movements (regressions) during sentence reading were then examined as a function of the two IOR types. The results revealed that readers with fast IOR executed larger regressions than readers with slow IOR, as they directed the eyes away from the most recently attended area of text. Forward-directed eye movements (saccades), by contrast, were not a function of IOR type. Ease of sentence comprehension influenced the size of regressions, but this effect was also independent of IOR type. Multiple mechanisms of spatial attention, including IOR, bias eye movements toward upcoming words in the text during reading.     

Processing of temporal information: Evidence from eye movements

In two experiments, we recorded eye movements to study how readers monitor temporal order information contained in narrative texts. Participants read short texts containing critical temporal information in the sixth sentence, which could be either consistent or inconsistent with temporal order information given in the second sentence. In Experiment 1, inconsistent sentences yielded more regressions to the second sentence and longer refixations of it. In Experiment 2, this pattern of eye movements was shown only by readers who noticed the inconsistency and were able to report it. Theoretical and methodological implications of the results for research on text comprehension are discussed.     

语言产生过程中信息加工的眼动研究(中文)

Researchers have recently turned to eye tracking to study the complex cognitive processes underlying speech production. The present paper provides a brief overview of studies of sentence production and eye movements. A review then follows of research using eye tracking to investigate eye movements during multiple object naming and differences between findings in reading research. The majority of these studies attempt to determine the extent to which object naming can happen in serial or parallel. Lastly, I provide a brief comparison between seriality and parallelism in reading and multiple object naming.     

Eye Movements Reveal the Dynamic Simulation of Speed in Language

This study investigates how speed of motion is processed in language. In three eye‐tracking experiments, participants were presented with visual scenes and spoken sentences describing fast or slow events (e.g., The lion ambled/dashed to the balloon). Results showed that looking time to relevant objects in the visual scene was affected by the speed of verb of the sentence, speaking rate, and configuration of a supporting visual scene. The results provide novel evidence for the mental simulation of speed in language and show that internal dynamic simulations can be played out via eye movements toward a static visual scene.     

Eye movements of highly skilled and average readers: Differential effects of frequency and predictability

This study offers a glimpse of the moment-by-moment processes used by highly skilled and average readers during silent reading. The eye movements of adult readers were monitored while they silently read sentences. Fixation durations and the spatial-temporal patterns of eye movements were examined to see whether the two groups of readers exhibited differential effects of frequency and/or predictability. In Experiment 1, high- and low-frequency target words were embedded in nonconstraining sentence contexts. In Experiment 2, the same participants read high- and low-frequency target words that were either predictable or unpredictable, embedded in highly constraining sentence contexts. Results indicated that when target words appeared in highly constraining sentence contexts, the average readers showed different effects of frequency and predictability from those shown in the highly skilled readers. It appears that reading skill can interact with predictability to affect the word recognition processes used during silent reading.     

Readers' Eye Movements Distinguish Anomalies of Form and Content

Evidence is presented that eye-movement patterns during reading distinguish costs associated with the syntactic processing of sentences from costs associated with relating sentence meaning to real world probabilities. Participants (N = 30) read matching sets of sentences that differed by a single word, making the sentence syntactically anomalous (but understandable), pragmatically anomalous, or non-anomalous. Syntactic and pragmatic anomaly each caused perturbations in eye movements. Subsequent to the anomaly, the patterns diverged. Syntactic anomaly generated many regressions initially, with rapid return to baseline. Pragmatic anomaly resulted in lengthened reading times, followed by a gradual increase in regressions that reached a maximum at the end of the sentence. Evidence of rapid sensitivity to pragmatic information supports the use of timing data in resolving the debate over the autonomy of linguistic processing. The divergent patterns of eye movements support indications from neurocognitive studies of a principled distinction between syntactic and pragmatic processing procedures within the language processing mechanism.     

Eye movements reduce vividness and emotionality of “flashforwards”

Earlier studies have shown that eye movements during retrieval of disturbing images about past events reduce their vividness and emotionality, which may be due to both tasks competing for working memory resources. This study examined whether eye movements reduce vividness and emotionality of visual distressing images about feared future events: “flashforwards”. A non-clinical sample was asked to select two images of feared future events, which were self-rated for vividness and emotionality. These images were retrieved while making eye movements or without a concurrent secondary task, and then vividness and emotionality were rated again. Relative to the no-dual task condition, eye movements while thinking of future-oriented images resulted in decreased ratings of image vividness and emotional intensity. Apparently, eye movements reduce vividness and emotionality of visual images about past and future feared events. This is in line with a working memory account of the beneficial effects of eye movements, which predicts that any task that taxes working memory during retrieval of disturbing mental images will be beneficial.     

句法预测对句子理解影响的眼动实验

实验采用眼动技术实时考察了句子阅读理解过程中的句法预测效应和并列句的结构表征特点。眼动数据分析发现：(1)有无句法预测没有明显影响名词短语区域的加工, 不同眼动指标差异不显著; (2)有无句法预测显著影响被试对包含暂时局部歧义的关键区和具有解歧作用的关键后区域的阅读理解, 首次注视时间、第一遍阅读时间、回视路径时间和第一遍回视率明显减少。眼动研究表明, 暂时局部歧义句子阅读理解过程中表现出明显的句法预测效应, 有句法预测降低了局部歧义区域和解歧区域早期和晚期加工的难度; 和英语的短语并列优先法则不同, 汉语并列句子的结构表征出现分离现象, 即短语并列和句子并列。     

Eye Movements and Lexical Access in Spoken-Language Comprehension: Evaluating a Linking Hypothesis between Fixations and Linguistic Processing

A growing number of researchers in the sentence processing community are using eye movements to address issues in spoken language comprehension. Experiments using this paradigm have shown that visually presented referential information, including properties of referents relevant to specific actions, influences even the earliest moments of syntactic processing. Methodological concerns about task-specific strategies and the linking hypothesis between eye movements and linguistic processing are identified and discussed. These concerns are addressed in a review of recent studies of spoken word recognition which introduce and evaluate a detailed linking hypothesis between eye movements and lexical access. The results provide evidence about the time course of lexical activation that resolves some important theoretical issues in spoken-word recognition. They also demonstrate that fixations are sensitive to properties of the normal language-processing system that cannot be attributed to task-specific strategies.     

The role of verbal memory in regressions during reading is modulated by the target word’s recency in memory

During reading, a number of eye movements are made backward, on words that have already been read. Recent evidence suggests that such eye movements, called regressions, are guided by memory. Several studies point to the role of spatial memory, but evidence for the role of verbal memory is more limited. In the present study, we examined the factors that modulate the role of verbal memory in regressions. Participants were required to make regressions on target words located in sentences displayed on one or two lines. Verbal interference was shown to affect regressions, but only when participants executed a regression on a word located in the first part of the sentence, irrespective of the number of lines on which the sentence was displayed. Experiments 2 and 3 showed that the effect of verbal interference on words located in the first part of the sentence disappeared when participants initiated the regression from the middle of the sentence. Our results suggest that verbal memory is recruited to guide regressions, but only for words read a longer time ago.     

Memory for non-native language: The role of lexical processing in the retention of surface form

Research on memory for native language (L1) has consistently shown that retention of surface form is inferior to that of gist (e.g., Sachs, 1967). This paper investigates whether the same pattern is found in memory for non-native language (L2). We apply a model of bilingual word processing to more complex linguistic structures and predict that memory for L2 sentences ought to contain more surface information than L1 sentences. Native and non-native speakers of English were tested on a set of sentence pairs with different surface forms but the same meaning (e.g., “The bullet hit/struck the bull's eye”). Memory for these sentences was assessed with a cued recall procedure. Responses showed that native and non-native speakers did not differ in the accuracy of gist-based recall but that non-native speakers outperformed native speakers in the retention of surface form. The results suggest that L2 processing involves more intensive encoding of lexical level information than L1 processing.     

Early, Mandatory, Pragmatic Processing

The experiment reported in this paper used a delayed same/different sentence matching task with concurrent measurement of eye movements to investigate three questions: whether pragmatic plausibility effects are restricted to certain phrasal environments; how rapidly such effects are shown in on-line sentence processing; and whether they are a product of optional, high-level, inferential processes. The results clearly show that plausibility effects are not restricted to low–level phrasal units and that they appear to arise as a necessary consequence of the process responsible for deriving basic sentence meaning. The rapid and highly localized nature of the effects supports a view of sentence processing involving incremental interpretation of the earliest available syntactic representations. We argue that the apparently mandatory nature of plausibility effects, coupled with their insensitivity to repetition context, presents difficulties for both modular and interactive views of sentence processing.