What Eye Movements Reveal About Later Comprehension of Long Connected Texts

We know that reading involves coordination between textual characteristics and visual attention, but research linking eye movements during reading and comprehension assessed after reading is surprisingly limited, especially for reading long connected texts. We tested two competing possibilities: (a) the weak association hypothesis: Links between eye movements and comprehension are weak and short-lived, versus (b) the strong association hypothesis: The two are robustly linked, even after a delay. Using a predictive modeling approach, we trained regression models to predict comprehension scores from global eye movement features, using participant-level cross-validation to ensure that the models generalize across participants. We used data from three studies in which readers (Ns = 104, 130, 147) answered multiple-choice comprehension questions ~30 min after reading a 6,500-word text, or after reading up to eight 1,000-word texts. The models generated accurate predictions of participants' text comprehension scores (correlations between observed and predicted comprehension: 0.384, 0.362, 0.372, ps < .001), in line with the strong association hypothesis. We found that making more, but shorter fixations, consistently predicted comprehension across all studies. Furthermore, models trained on one study's data could successfully predict comprehension on the others, suggesting generalizability across studies. Collectively, these findings suggest that there is a robust link between eye movements and subsequent comprehension of a long connected text, thereby connecting theories of low-level eye movements with those of higher order text processing during reading.     

国外儿童词汇识别发展眼动研究的新进展

近年来,国外儿童阅读发展的眼动研究已逐渐成为阅读研究热点领域。本文就国外儿童阅读的眼动研究成果进行概述,从儿童阅读眼动研究的基本问题、字词、句子、篇章和相关理论等方面对儿童的阅读过程进行考察,总结其阅读发展的一般规律和特点。最后,文章从阅读材料、统计方法以及研究设计几个方面对儿童阅读研究的方法性问题进行展望,以期为中文阅读发展的眼动研究提供借鉴     

阅读水平调节儿童阅读眼动注视模式的发展:基于9～11岁儿童的证据

按照3~5年级小学生的语文阅读水平,在各年级中分别选取年龄相同的高、中、低三组儿童作为被试,要求他们阅读适合本年级阅读水平的5篇短文,探讨同一年龄段内读者阅读水平的高低对阅读眼动注视模式的影响是否存在发展上的差异。通过记录其眼动轨迹,结果发现:9岁儿童的阅读眼动注视模式受读者本身阅读水平的影响最大,10岁次之,到11岁,随着儿童基本眼动行为的成熟,这种影响随之消失。表明读者阅读眼动注视模式的发展动力来源于语言操作技能和眼球运动协调性提高的交互作用。     

Eye movements and scene perception.

Research on eye movements and scene perception is reviewed. Following an initial discussion of some basic facts about eye movements and perception, the following topics are discussed: (I) the span of effective vision during scene perception, (2) the role of eye movements in scene perception, (3) integration of information across saccades, (4) scene context, object identification and eye movements, and (5) the control of eye movements. The relationship of eye movements during reading to eye movements during scene perception is considered. A preliminary model of eye movement control in scene perception is described and directions for future research are suggested.     

EVENT-RELATED BRAIN POTENTIALS, EYE MOVEMENTS, AND READING

Abstract— This article compares studies that use event-related brain potential (ERP) and eye movement data to examine changes in reading behavior when a text is read twice. Although the types of information provided by these methodologies are different, both indicate that rereading a text facilitates many aspects of processing. ERPs provide a method for measuring comprehension and memory processes separately, while eye movements provide a continuous record of performance and allow changes in reading behavior to be localized to specific words. The results from these studies are compatible. However, converging evidence is not always found when different paradigms are contrasted, and diverging results can provide important information. To facilitate comparison across experiments, we suggest using a common set of materials for both paradigms. We conclude that comparing the results of research based on more than one paradigm provides a more complete understanding of the processes involved in reading.     

Using E-Z Reader to examine the concurrent development of eye-movement control and reading skill

Compared to skilled adult readers, children typically make more fixations that are longer in duration, shorter saccades, and more regressions, thus reading more slowly (Blythe & Joseph, 2011). Recent attempts to understand the reasons for these differences have discovered some similarities (e.g., children and adults target their saccades similarly; Joseph, Liversedge, Blythe, White, & Rayner, 2009) and some differences (e.g., children’s fixation durations are more affected by lexical variables; Blythe, Liversedge, Joseph, White, & Rayner, 2009) that have yet to be explained. In this article, the E-Z Reader model of eye-movement control in reading (Reichle, 2011 and Reichle et al., 1998) is used to simulate various eye-movement phenomena in adults vs. children in order to evaluate hypotheses about the concurrent development of reading skill and eye-movement behavior. These simulations suggest that the primary difference between children and adults is their rate of lexical processing, and that different rates of (post-lexical) language processing may also contribute to some phenomena (e.g., children’s slower detection of semantic anomalies; Joseph et al., 2008). The theoretical implications of this hypothesis are discussed, including possible alternative accounts of these developmental changes, how reading skill and eye movements change across the entire lifespan (e.g., college-aged vs. older readers), and individual differences in reading ability.     

Eye movements and processing stages in reading: relative contribution of visual,lexical, and contextual factors

The independent and the combined influence of word length, word frequency, and contextual predictability on eye movements in reading was examined across processing stages under two priming-context conditions. Length, frequency, and predictability were used as predictors in multiple regression analyses, with parafoveal, early, late, and spillover eye movement measures as the dependent variables. There were specific effects of: (a) length, both on where to look (how likely a word was fixated and in which location) and how long to fixate, across all processing stages; (b) frequency, on how long to fixate a word, but not on where to look, at an early processing stage; and (c) predictability, both on how likely a word was fixated and for how long, in late processing stages. The source of influence for predictability was related to global rather than to local contextual priming. The contribution of word length was independent of contextual source. These results are relevant to determine both the time course of the influence of visual, lexical, and contextual factors on eye movements in reading, and which main component of eye movements, that is, location or duration, is affected.     

Eye movements and attention in reading,scene perception,and visual search

Eye movements are now widely used to investigate cognitive processes during reading, scene perception, and visual search. In this article, research on the following topics is reviewed with respect to reading: (a) the perceptual span (or span of effective vision), (b) preview benefit, (c) eye movement control, and (d) models of eye movements. Related issues with respect to eye movements during scene perception and visual search are also reviewed. It is argued that research on eye movements during reading has been somewhat advanced over research on eye movements in scene perception and visual search and that some of the paradigms developed to study reading should be more widely adopted in the study of scene perception and visual search. Research dealing with “real-world” tasks and research utilizing the visual-world paradigm are also briefly discussed.     

Eye movements during reading: some current controversies

For many researchers, eye-movement measures have become instrumental in revealing the moment-to-moment activity of the mind during reading. In general, there has been a great deal of consistency across studies within the eye-movement literature, and researchers have discovered and examined many variables involved in the reading process that affect the nature of readers' eye movements. Despite remarkable progress, however, there are still a number of issues to be resolved. In this article, we discuss three controversial issues: (1) the extent to which eye-movement behavior is affected by low-level oculomotor factors versus higher-level cognitive processes; (2) how much information is extracted from the right of fixation; and (3) whether readers process information from more than one word at a time.     

A PROCESS MODEL OF CAUSAL REASONING IN COMPREHENSION

Many readers and reading theorists alike hold a "common sense" intuition that omissions and substitutions made while reading orally are caused by the reader failing to see the omitted or substituted word, or looking at it for too short a time. In this study the eye movements of college age readers were recorded while they read aloud and then analyzed to see if there is a causal relationship between "careless" eye movements and oral reading omissions and substitutions. Results indicate that, contrary to conventional wisdom, most omitted and substituted words are visually examined, and examined thoroughly, prior to being orally omitted or substituted. These findings are discussed in a context that views reading as a perceptual, interactive, and constructive process.     

Moving window generator for reading experiments

An inexpensive PC-based moving window generator with an eye movement recording system is described. The moving window technique, activated by current eye movements, has an advantage over the fixed window technique in measuring the effective visual field size during reading. A variable rectangular window, through which the subject observes the text, is generated on a PC-controlled CRT screen. The system includes a frame buffer memory, an analog-to-digital conversion unit, and an eye movement recording system. The system works well for measuring approximate field size during reading.     

Cognitive engagement in emotional text reading: concurrent recordings of eye movements and head motion

ABSTRACT

The present study examined the effects of emotions on eye movements, head motion, and iPad motion during reading. Thirty-one participants read neutral, emotionally negative texts and emotionally positive texts on a digital tablet and both participants’ eye movements and body movements were recorded using respectively eye-tracking glasses and a motion capture system. The results showed that emotionally positive texts were read faster than neutral texts, and that readers’ movements decreased when reading emotional texts regardless of valence polarity. Recent studies suggested that postural movements may reflect cognitive engagement and especially the engagement in the task to be done. Our findings seem to validate this hypothesis of a bodily engagement in reading emotional contents. The present results suggest that the novel methodology of eye and postural movement recordings is informative in studying the readers’ embodied engagement during reading emotional materials.     

自然阅读的脑成像研究及其与眼动技术结合

以往的研究者主要采用单词系列呈现的实验范式对词、句子和篇章等材料进行阅读脑成像研究。针对近年来使用自然阅读范式的功能磁共振(fMRI)研究进行分析,建议在该范式下使用脑-眼动同步记录的方式,并介绍了基于注视编码的fMRI数据分析原理。新的范式和技术提高了fMRI研究的生态效度,有利于对阅读中眼动加工的脑机制进行探索,是相关研究的新趋势。未来需要在自然阅读fMRI实验中结合实验设计及其他技术以克服时间分辨率低的问题,同时要注意探讨阅读和眼动脑区的关系。     

Ocular motility and cognitive process

This study investigates the amount of ocular motility occuring in response to questions varying the kind of cognitive process required for answer. Fewer eye movements occur in response to questions designed to elicit visuo-spatial as compared to verbal-conceptual processes, a finding consistent with our earlier observation of more ‘stares’ occuring with the former than with the latter questions. The results are inconsistent with the traditional hypothesis that visual imagery involves an increase in scanning eye movements. The findings are interpreted in terms of a model postulating an interaction of the form of visual information processing and the type of cognitive activity subjects engage in.     

‘Random’ saccadic eye movements during verbal-linguistic and visual-imaginal tasks

Previous research has suggested that questions eliciting visual imagery are associated with lower rates of saccadic eye movements as compared to questions eliciting verbal processes. Two experiments reported here examined the roles of external visual stimulation and speech output in this effect. In both experiments, questions designed to elicit verbal-linguistic or visual-imaginal processing, and which required either syntactically complex or simple responses, were administered while eye movements were recorded by electrooculography. In experiment 1, 42 subjects responded while viewing either the interviewer's face or a gray oval on a video monitor. Imaginal questions elicited a lower rate of eye movements than did verbal questions regardless of the display on the monitor. In experiment 2, 17 subjects responded in conditions of light and darkness. Imaginal questions elicited lower rates of eye movements in both light and dark. Neither cognitive mode nor speech output requirements interacted with stimulus conditions in either experiment. The failure of visual conditions to influence the verbal-imaginal difference in eye movement rate is viewed as inconsistent with a visual interference interpretation of the relationship of eye movements to cognitive activity. Alternate interpretations are discussed.     

Masking of foveal and parafoveal vision during eye fixations in reading

A window or visual mask as moved across text in synchrony with the reader's eye movements. The size of the window or mask was varied so that either information in foveal or parafoveal vision was masked on each fixation. In another experiment, the onset of the mask was delayed for a certain amount of time following the end of the saccade. The results of the experiments point out the relative importance of foveal and parafoveal vision for reading and further indicate that most of the visual information necessary for reading can be acquired during the first 50 msec that information is available during an eye fixation.     

Prereaders’ eye movements during shared storybook reading are language-mediated but not predictive

When viewing a visual scene, eye movements are often language-mediated: people look at objects as those objects are named. Eye movements can even reflect predictive language processing, moving to an object before it is named. Children are also capable of making language-mediated eye movements, even predictive ones, and prediction may be involved in language learning. The present study explored whether eye movements are language-mediated in a more naturalistic task – shared storybook reading. Research has shown that children fixate illustrations during shared storybook reading, ignoring text. The present study used high-precision eye-tracking to replicate this finding. Further, prereader participants showed increased likelihood of fixating relevant storybook illustrations as words were read aloud, indicating that their eye movements were language mediated like the adult participants. Language-mediated eye movements to illustrations were reactive, not predictive, in both participant groups.     

Extending the e-z reader model of eye movement control to chinese readers

Chinese readers' eye movements were simulated in the context of the E-Z Reader model, which was developed to account for the eye movements of readers of English. Despite obvious differences between English and Chinese, the model did a fairly good job of simulating the eye movements of Chinese readers. The successful simulation suggests that the control of eye movements in reading Chinese is similar to that in an alphabetic language such as English.     

自然阅读与校对阅读的知觉广度研究

采用经典的移动窗口技术,以Eyelink2000型眼动仪为工具,探讨了自然阅读和校对阅读两种不同的任务对中文阅读知觉广度的影响,结果表明：（1）与校对阅读条件相比,自然阅读条件下的阅读速度更快、眼跳幅度更大。（2）自然阅读条件下被试的知觉广度为注视点右侧2-3个字;校对阅读条件下被试的知觉广度仅为注视点1个字的空间。结果说明,读者在校对阅读和自然阅读条件下采用了不同的阅读策略,阅读知觉广度的大小受任务要求的影响。