Eye movements across viewpoint changes in multiple object tracking

Observers can visually track multiple objects that move independently even if the scene containing the moving objects is rotated in a smooth way. Abrupt scene rotations yield tracking more difficult but not impossible. For nonrotated, stable dynamic displays, the strategy of looking at the targets' centroid has been shown to be of importance for visual tracking. But which factors determine successful visual tracking in a nonstable dynamic display? We report two eye tracking experiments that present evidence for centroid looking. Across abrupt viewpoint changes, gaze on the centroid is more stable than gaze on targets indicating a process of realigning targets as a group. Further, we show that the relative importance of centroid looking increases with object speed.     

Eye movements during the handwriting of words: Individually and within sentences

Handwriting, a complex motor process involves the coordination of both the upper limb and visual system. The gaze behavior that occurs during the handwriting process is an area that has been little studied. This study investigated the eye-movements of adults during writing and reading tasks. Eye and handwriting movements were recorded for six different words over three different tasks. The results compared reading and handwriting the same words, a between condition comparison and a comparison between the two handwriting tasks. Compared to reading, participants produced more fixations during handwriting tasks and the average fixation durations were longer. When reading fixations were found to be mostly around the center of word, whereas fixations when writing appear to be made for each letter in a written word and were located around the base of letters and flowed in a left to right direction. Between the two writing tasks more fixations were made when words were written individually compared to within sentences, yet fixation durations were no different. Correlation of the number of fixations made to kinematic variables revealed that horizontal size and road length held a strong correlation with the number of fixations made by participants.     

Exploring inhibitory deficits in female premutation carriers of fragile X syndrome: Through eye movements

There is evidence which demonstrates that a subset of males with a premutation CGG repeat expansion (between 55 and 200 repeats) of the fragile X mental retardation 1 gene exhibit subtle deficits of executive function that progressively deteriorate with increasing age and CGG repeat length. However, it remains unclear whether similar deficits, which may indicate the onset of more severe degeneration, are evident in female PM-carriers. In the present study we explore whether female PM-carriers exhibit deficits of executive function which parallel those of male PM-carriers. Fourteen female fragile X premutation carriers without fragile X-associated tremor/ataxia syndrome and fourteen age, sex, and IQ matched controls underwent ocular motor and neuropsychological tests of select executive processes, specifically of response inhibition and working memory. Group comparisons revealed poorer inhibitory control for female premutation carriers on ocular motor tasks, in addition to demonstrating some difficulties in behaviour self-regulation, when compared to controls. A negative correlation between CGG repeat length and antisaccade error rates for premutation carriers was also found. Our preliminary findings indicate that impaired inhibitory control may represent a phenotype characteristic which may be a sensitive risk biomarker within this female fragile X premutation population.     

Eye gaze metrics reflect a shared motor representation for action observation and movement imagery

Action observation (AO) and movement imagery (MI) have been reported to share similar neural networks. This study investigated the congruency between AO and MI using the eye gaze metrics, dwell time and fixation number. A simple reach-grasp-place arm movement was observed and, in a second condition, imagined where the movement was presented from the first person perspective (1PP) and the third person perspective (3PP). Dwell time and number of fixations were calculated for whole scene and regions of interest (ROIs). For whole scene, no significant differences were found in the number of fixations for condition (AO, MI) or perspective. Dwell time, however, was significantly longer in AO than MI. For ROIs, the number of fixations was significantly greater in 1PP than 3PP. The data provide support for congruence between motor simulation states but also indicate some functional differences.     

Eye tracking research and technology: Towards objective measurement of data quality

Two methods for objectively measuring eye tracking data quality are explored. The first method works by tricking the eye tracker to detect an abrupt change in the gaze position of an artificial eye that in actuality does not move. Such a device, referred to as an artificial saccade generator, is shown to be extremely useful for measuring the temporal accuracy and precision of eye tracking systems and for validating the latency to display change in gaze contingent display paradigms. The second method involves an artificial pupil that is mounted on a computer controlled moving platform. This device is designed to be able to provide the eye tracker with motion sequences that closely resemble biological eye movements. The main advantage of using artificial motion for testing eye tracking data quality is the fact that the spatiotemporal signal is fully specified in a manner independent of the eye tracker that is being evaluated and that nearly identical motion sequence can be reproduced multiple times with great precision. The results of the present study demonstrate that the equipment described has the potential to become an important tool in the comprehensive evaluation of data quality.     

Effects of movement distance,duration, velocity,and type on action prediction in 12-month-olds

The goal of the present study was to test the influence of the spatial and temporal dynamics of observed manual actions on infants’ action prediction. Twelve-month-old infants were presented with reach-and-transport actions performed by a human agent. Movement distance, duration, and – resulting from the two – movement velocity were systematically varied. Action prediction was measured via the latency of gaze arrival at target in relation to agent’s hand. The results showed a general effect of all parameters on the infants’ perception of goal-directed actions: Infants were more likely to predict the action goal the longer the movement distance was, the longer the movement duration was, and the slower the movement velocity was. In addition, they were more likely to predict the goal of a reaching than a transport action. The present findings extent previous findings by showing that infants are not only sensitive to differences in distances, durations, and velocities at early age but that these factors have a strong impact on the prediction of the goal of observed actions.     

Eye movements in developing readers: A comparison of silent and oral sentence reading

We present sentence reading data from a large-scale study with children (N = 632), focusing on three key research questions. (1) What are the trajectories of reading development in oral as compared to silent reading? (2) How are word frequency effects developing and are changes differentially affected by reading mode? (3) Are there systematic differences between better and weaker comprehenders when reading silently vs. aloud? Results illuminate a number of differences between reading modes, including more and prolonged fixations in oral reading, along with less inter-word regressions and attenuated effects of word frequency. Weaker comprehenders were slower, especially in oral reading and showed less flexibility in the allocation of word processing time. Differences between reading modes can be explained by additional processing demands imposed by concurrent articulation and eye–voice coordination when reading aloud.     

Eye movements reflect and shape strategies in fraction comparison

The comparison of fractions is a difficult task that can often be facilitated by separately comparing components (numerators and denominators) of the fractions—that is, by applying so-called component-based strategies. The usefulness of such strategies depends on the type of fraction pair to be compared. We investigated the temporal organization and the flexibility of strategy deployment in fraction comparison by evaluating sequences of eye movements in 20 young adults. We found that component-based strategies could account for the response times and the overall number of fixations observed for the different fraction pairs. The analysis of eye movement sequences showed that the initial eye movements in a trial were characterized by stereotypical scanning patterns indicative of an exploratory phase that served to establish the kind of fraction pair presented. Eye movements that followed this phase adapted to the particular type of fraction pair and indicated the deployment of specific comparison strategies. These results demonstrate that participants employ eye movements systematically to support strategy use in fraction comparison. Participants showed a remarkable flexibility to adapt to the most efficient strategy on a trial-by-trial basis. Our results confirm the value of eye movement measurements in the exploration of strategic adaptation in complex tasks.     

Emotion effects during reading: Influence of an emotion target word on eye movements and processing

Recently, Scott, O'Donnell and Sereno reported that words of high valence and arousal are processed with greater ease than neutral words during sentence reading. However, this study unsystematically intermixed emotion (label a state of mind, e.g., terrified or happy) and emotion-laden words (refer to a concept that is associated with an emotional state, e.g., debt or marriage). We compared the eye-movement record while participants read sentences that contained a neutral target word (e.g., chair) or an emotion word (no emotion-laden words were included). Readers were able to process both positive (e.g., happy) and negative emotion words (e.g., distressed) faster than neutral words. This was true across a wide range of early (e.g., first fixation durations) and late (e.g., total times on the post-target region) measures. Additional analyses revealed that State Trait Anxiety Inventory scores interacted with the emotion effect and that the emotion effect was not due to arousal alone.     

Eye movements predict driver reaction time to takeover request in automated driving: A real-vehicle study

For automated driving at SAE level 3 or lower, driver performance in responding to takeover requests (TORs) is decisive in providing system safety. A driver state monitoring system that can predict a driver’s performance in a TOR event will facilitate a safer control transition from vehicle to driver. This experimental study investigated whether driver eye-movement measured before a TOR can predict driving performance in a subsequent TOR event. We recruited participants (N = 36) to obtain realistic results in a real-vehicle study. In the experiment, drivers rode in an automated vehicle on a test track for about 32 min, and a critical TOR event occurred at the end of the drive. Eye movements were measured by a camera-based driver monitoring system, and five measures were extracted from the last 2-min epoch prior to the TOR event. The correlations between each eye-movement measure and driver reaction time were examined, and a multiple regression model was built using a stepwise procedure. The results showed that longer reaction time could be significantly predicted by a smaller number of large saccades, a greater number of medium saccades, and lower saccadic velocity. The implications of these relationships are consistent with previous studies. The present real-vehicle study can provide insights to the automotive industry in the search for a safer and more flexible interface between the automated vehicle and the driver.     

Early use of phonetic information in spoken word recognition: Lexical stress drives eye movements immediately

For optimal word recognition listeners should use all relevant acoustic information as soon as it comes available. Using printed-word eye tracking we investigated when during word processing Dutch listeners use suprasegmental lexical stress information to recognize words. Fixations on targets such as “OCtopus” (capitals indicate stress) were more frequent than fixations on segmentally overlapping but differently stressed competitors (“okTOber”) before segmental information could disambiguate the words. Furthermore, prior to segmental disambiguation, initially stressed words were stronger lexical competitors than noninitially stressed words. Listeners recognize words by immediately using all relevant information in the speech signal.     

Eye movements and hazard perception in active and passive driving

ABSTRACT

Differences in eye movement patterns are often found when comparing passive viewing paradigms to actively engaging in everyday tasks. Arguably, investigations into visuomotor control should therefore be most useful when conducted in settings that incorporate the intrinsic link between vision and action. We present a study that compares oculomotor behaviour and hazard reaction times across a simulated driving task and a comparable, but passive, video-based hazard perception task. We found that participants scanned the road less during the active driving task and fixated closer to the front of the vehicle. Participants were also slower to detect the hazards in the driving task. Our results suggest that the interactivity of simulated driving places increased demand upon the visual and attention systems than simply viewing driving movies. We offer insights into why these differences occur and explore the possible implications of such findings within the wider context of driver training and assessment.     

Wandering eyes: Eye movements during mind wandering in video lectures

Video lectures are increasingly prevalent, but they present challenges to learners. Students' minds often wander, yet we know little about how mind wandering affects attention during video lectures. This paper presents two studies that examined eye movement patterns of mind wandering during video lectures. In the studies, mind wandering reports were collected by either self-caught reports or thought probes. Results were similar across the studies: mind wandering was associated with an increased allocation of fixations to the instructor's image. For fixations on the slides, the average duration increased but the dispersion decreased. Moreover, preliminary evidence suggested that fixation duration and dispersion can diminish soon after self-caught reports of mind wandering. Overall, these findings help advance our understanding of how learners' attention is affected during mind wandering and may facilitate efforts in objectively identifying mind wandering. Future research is needed to determine if these findings can extend to other instructional formats.     

Social cognition in simple action coordination: A case for direct perception

In this paper we sketch the outlines of an account of the kind of social cognition involved in simple action coordination that is based on direct social perception (DSP) rather than recursive mindreading. While we recognize the viability of a mindreading-based account such as e.g. Michael Tomasello’s, we present an alternative DSP account that (i) explains simple action coordination in a less cognitively demanding manner, (ii) is better able to explain flexibility and strategy-switching in coordination and crucially (iii) allows for formal modeling. This account of action coordination is based on the notion of an agent’s field of affordances. Coordination ensues, we argue, when, given a shared intention, the actions of and/or affordances for one agent shape the field of affordances for another agent. This a form of social perception since in particular perceiving affordances for another person involves seeing that person as an agent. It is a form of social perception since it involves perceiving affordances for another person and registering how another person’s actions influence one’s own perceived field of affordances.     

Changes in infant visual attention when observing repeated actions

Infants’ early visual preferences for faces, and their observational learning abilities, are well-established in the literature. The current study examines how infants’ attention changes as they become increasingly familiar with a person and the actions that person is demonstrating. The looking patterns of 12- (n = 61) and 16-month-old infants (n = 29) were tracked while they watched videos of an adult presenting novel actions with four different objects three times. A face-to-action ratio in visual attention was calculated for each repetition and summarized as a mean across all videos. The face-to-action ratio increased with each action repetition, indicating that there was an increase in attention to the face relative to the action each additional time the action was demonstrated. Infant’s prior familiarity with the object used was related to face-to-action ratio in 12-month-olds and initial looking behavior was related to face-to-action ratio in the whole sample. Prior familiarity with the presenter, and infant gender and age, were not related to face-to-action ratio. This study has theoretical implications for face preference and action observations in dynamic contexts.     

Eye movements and attention in reading,scene perception,and visual search

Eye movements are now widely used to investigate cognitive processes during reading, scene perception, and visual search. In this article, research on the following topics is reviewed with respect to reading: (a) the perceptual span (or span of effective vision), (b) preview benefit, (c) eye movement control, and (d) models of eye movements. Related issues with respect to eye movements during scene perception and visual search are also reviewed. It is argued that research on eye movements during reading has been somewhat advanced over research on eye movements in scene perception and visual search and that some of the paradigms developed to study reading should be more widely adopted in the study of scene perception and visual search. Research dealing with “real-world” tasks and research utilizing the visual-world paradigm are also briefly discussed.     

Learning From Peers’ Eye Movements in the Absence of Expert Guidance: A Proof of Concept Using Laboratory Stock Trading,Eye Tracking,and Machine Learning

Existing research shows that people can improve their decision skills by learning what experts paid attention to when faced with the same problem. However, in domains like financial education, effective instruction requires frequent, personalized feedback given at the point of decision, which makes it time‐consuming for experts to provide and thus, prohibitively costly. We address this by demonstrating an automated feedback mechanism that allows amateur decision‐makers to learn what information to attend to from one another, rather than from an expert. In the first experiment, eye movements of N = 100 subjects were recorded while they repeatedly performed a standard behavioral finance investment task. Consistent with previous studies, we found that a significant proportion of subjects were affected by decision bias. In the second experiment, a different group of N = 100 subjects faced the same task but, after each choice, they received individual, machine learning‐generated feedback on whether their pre‐decision eye movements resembled those made by Experiment 1 subjects prior to good decisions. As a result, Experiment 2 subjects learned to analyze information similarly to their successful peers, which in turn reduced their decision bias. Furthermore, subjects with low Cognitive Reflection Test scores gained more from the proposed form of process feedback than from standard behavioral feedback based on decision outcomes.