Memory representations guide targeting eye movements in a natural task

The change blindness phenomenon suggests that visual representations retained across saccades are very limited. In this paper we sought to specify the kind of information that is in fact retained. We investigated targeting performance for saccadic eye movements, since one need for visual representations across eye and body positions may be to guide coordinated movements. We examined saccades in the context of an ongoing sensory motor task in order to make stronger generalizations about natural visual functioning and deployment of attention. Human subjects copied random patterns of coloured blocks on a computer display. Their eye movement pattern was consistent from block to block, including a precise saccade to a previously-placed, neighbouring block during each additional block placement. This natural, consistent eye movement allowed the previously-placed, neighbouring block to serve as an implicit target without instructions to the subject. On random trials, we removed the target object from the display during a preceding saccade, so that observers were required to make the targeting saccade without a currently visible target. Targeting performance was excellent, and appeared to be influenced by spatial information that was not visible during the preceding fixation. Subjects were generally unaware of the disappearance and reappearance of the target. We conclude that spatial information about visual targets is retained across eye movements and used to guide subsequent movements.     

Interdependence of Saccadic and Fixational Fluctuations

Recent research suggests that the different components of eye movements (fixations, saccades) are not strictly separate but are interdependent processes. This argument rests on observations that gaze-step sizes yield unimodal distributions and exhibit power-law scaling, indicative of interdependent processes coordinated across timescales. The studies that produced these findings, however, employed complex tasks (visual search, scene perception). Thus, the question is whether the observed interdependence is a fundamental property of eye movements or emerges in the interplay between cognitive processes and complex visual stimuli. In this study, we used a simple eye movement task where participants moved their eyes in a prescribed sequence at several different paces. We outlined diverging predictions for this task for independence versus interdependence of fixational and saccadic fluctuations and tested these predictions by assessing the spectral properties of eye movements. We found no clear peak in the power spectrum attributable exclusively to saccadic fluctuations. Furthermore, changing the pace of the eye movement sequence yielded a global shift in scaling relations evident in the power spectrum, not just a localized shift for saccadic fluctuations. These results support the conclusion that fixations and saccades are interdependent processes.     

刺激的视觉显著性和奖赏价值对眼跳的影响

本研究旨在探索刺激的视觉显著性和奖赏价值分别在协同和竞争的条件下对眼跳过程的影响。实验材料为成对的Gabor图案,要求被试选择具有更高奖赏价值的图案,并记录下其眼动过程。实验分为协同条件和竞争条件。结果发现,在不同实验条件下,奖赏价值对眼跳命中率和潜伏期均存在显著效应;视觉显著性的效应则在不同实验条件下出现了分离。刺激驱动过程和目标驱动过程对眼动行为的影响可能是互相区别的两种不同模式。     

Parallel processing in visual search asymmetry

The difficulty of visual search may depend on assignment of the same visual elements as targets and distractors-search asymmetry. Easy C-in-O searches and difficult O-in-C searches are often associated with parallel and serial search, respectively. Here, the time course of visual search was measured for both tasks with speed-accuracy methods. The time courses of the 2 tasks were similar and independent of display size. New probabilistic parallel and serial search models and sophisticated-guessing variants made predictions about time course and accuracy of visual search. The probabilistic parallel model provided an excellent account of the data, but the serial model did not. Asymptotic search accuracies and display size effects were consistent with a signal-detection analysis, with lower variance encoding of Cs than Os. In the absence of eye movements, asymmetric visual search, long considered an example of serial deployment of covert attention, is qualitatively and quantitatively consistent with parallel search processes.     

Quantifying the performance limits of human saccadic targeting during visual search.

In previous studies of saccadic targeting, the issue how visually guided saccades to unambiguous targets are programmed and executed has been examined. These studies have found different degrees of guidance for saccades depending on the task and task difficulty. In this study, we use ideal-observer analysis to estimate the visual information used for the first saccade during a search for a target disk in noise. We quantitatively compare the performance of the first saccadic decision to that of the ideal observer (ie absolute efficiency of the first saccade) and to that of the associated final perceptual decision at the end of the search (ie relative efficiency of the first saccade). Our results show, first, that at all levels of salience tested, the first saccade is based on visual information from the stimulus display, and its highest absolute efficiency is approximately 20%. Second, the efficiency of the first saccade is lower than that of the final perceptual decision after active search (with eye movements) and has a minimum relative efficiency of 19% at the lowest level of saliency investigated. Third, we found that requiring observers to maintain central fixation (no saccades allowed) decreased the absolute efficiency of their perceptual decision by up to a factor of two, but that the magnitude of this effect depended on target salience. Our results demonstrate that ideal-observer analysis can be extended to measure the visual information mediating saccadic target-selection decisions during visual search, which enables direct comparison of saccadic and perceptual efficiencies.     

Differentiating between verbal and spatial encoding using eye-movement recordings

Visual information processing is guided by an active mechanism generating saccadic eye movements to salient stimuli. Here we investigate the specific contribution of saccades to memory encoding of verbal and spatial properties in a serial recall task. In the first experiment, participants moved their eyes freely without specific instruction. We demonstrate the existence of qualitative differences in eye-movement strategies during verbal and spatial memory encoding. While verbal memory encoding was characterized by shifting the gaze to the to-be-encoded stimuli, saccadic activity was suppressed during spatial encoding. In the second experiment, participants were required to suppress saccades by fixating centrally during encoding or to make precise saccades onto the memory items. Active suppression of saccades had no effect on memory performance, but tracking the upcoming stimuli decreased memory performance dramatically in both tasks, indicating a resource bottleneck between display-controlled saccadic control and memory encoding. We conclude that optimized encoding strategies for verbal and spatial features are underlying memory performance in serial recall, but such strategies work on an involuntary level only and do not support memory encoding when they are explicitly required by the task.     

Saccades predict and synchronize to visual rhythms irrespective of musical beats

ABSTRACT

Music has been shown to entrain movement. One of the body’s most frequent movements, saccades, are arguably subject to a timer that may also be susceptible to musical entrainment. We developed a continuous and highly-controlled visual search task and varied the timing of the search target presentation, it was either gaze-contingent, tap-contingent, or visually-timed. We found: (1) explicit control of saccadic timing is limited to gross duration variations and imprecisely synchronized; (2) saccadic timing does not implicitly entrain to musical beats, even when closely aligned in phase; (3) eye movements predict visual onsets produced by motor-movements (finger-taps) and externally-timed sequences, beginning fixation prior to visual onset; (4) eye movement timing can be rhythmic, synchronizing to both motor-produced and externally timed visual sequences; each unaffected by musical beats. These results provide evidence that saccadic timing is sensitive to the temporal demands of visual tasks and impervious to influence from musical beats.     

Fixation disengagement and eye-movement latency

We examined eye-movement latencies to a target that appeared during visual fixation of a stationary stimulus, a moving stimulus, or an extrafoveal stimulus. The stimulus at fixation was turned off either before target onset (gap condition) or after target onset (overlap condition). Consistent with previous research, saccadic latencies were shorter in gap conditions than they were in overlap conditions (the gap effect). In Experiment 1, a gap effect was observed for vergence eye movements. In Experiment 2, a gap effect was observed for saccades directed at a target that appeared during visual pursuit of a moving stimulus. In Experiment 3, a gap effect was observed for saccades directed at a target that appeared during extrafoveal fixation. The present results extend reports of the gap effect for saccadic shifts during visual fixation to (a) vergence shifts during visual fixation, (b) saccadic shifts during smooth visual pursuit, and (c) saccadic shifts during extrafoveal fixation. The present findings are discussed with respect to the incompatible goals of fixation-locking and fixation-shifting oculomotor responses.     

Guidance of eye movements during conjunctive visual search: the distractor-ratio effect.

The distractor-ratio effect refers to the finding that search performance in a conjunctive visual search task depends on the relative frequency of two types or subsets of distractors when the total number of items in a display is fixed. Previously, Shen, Reingold, and Pomplun (2000) examined participants' patterns of eye movements in a distractor-ratio paradigm and demonstrated that on any given trial saccadic endpoints were biased towards the smaller subset of distractors and participants flexibly switched between different subsets across trials. The current study explored the boundary conditions of this tendency to flexibly search through a smaller subset of distractors by examining the influence of several manipulations known to modulate search efficiency, including stimulus discriminability (Experiment 1), within-dimension versus cross-dimension conjunction search and distractor heterogeneity (Experiment 2). The results indicated that the flexibility of visual guidance and saccadic bias exemplified by the distractor-ratio effect is a robust phenomenon that mediates search efficiency by adapting to changes in the relative informativeness of stimulus dimensions and features.     

Where does attention go when you blink?

Many studies have shown that covert visual attention precedes saccadic eye movements to locations in space. The present research investigated whether the allocation of attention is similarly affected by eye blinks. Subjects completed a partial-report task under blink and no-blink conditions. Experiment 1 showed that blinking facilitated report of the bottom row of the stimulus array: Accuracy for the bottom row increased and mislocation errors decreased under blink, as compared with no-blink, conditions, indicating that blinking influenced the allocation of visual attention. Experiment 2 showed that this was true even when subjects were biased to attend elsewhere. These results indicate that attention moves downward before a blink in an involuntary fashion. The eyes also move downward during blinks, so attention may precede blink-induced eye movements just as it precedes saccades and other types of eye movements.     

Why do we move our eyes while trying to remember? The relationship between non-visual gaze patterns and memory

Non-visual gaze patterns (NVGPs) involve saccades and fixations that spontaneously occur in cognitive activities that are not ostensibly visual. While reasons for their appearance remain obscure, convergent empirical evidence suggests that NVGPs change according to processing requirements of tasks. We examined NVPGs in tasks with long-term memory (LTM) and working memory (WM) requirements. Experiment 1 yielded significantly higher eye movement rate (EMR) in tasks requiring LTM search than in a WM task requiring maintenance of information. Experiment 2 manipulated accessibility of items in study-test episodic tasks using the levels of processing paradigm. EMR was high in episodic recall irrespective of item accessibility. Experiment 3 examined functional significance of saccades in LTM tasks. Voluntary saccadic suppression produced no evidence that saccades contribute to task performance. We discuss the apparent epiphenomenal nature of spontaneous saccades from an evolutionary perspective and outline a neuroanatomical model of the link between the saccadic and memory system.     

Recognition of alphabetic characters during voluntary eye movements

In this paper we reconsider the question of vision during eye movements using a novel display procedure which guarantees that the eye was not stopped at any time during the eye movement. The results of our experiment lead us to conclude that true “saccadic suppression,” is a most elusive phenomenon. Furthermore, a brief analysis of the optics of the eye movement suggests that a substantial amount the elevation of visual threshold during eye movements can be attributed to simple retinal smear if one acknowledges the dominating importance of edge effects in visual threshold measurements.     

Response times and eye movements in feature and conjunction search as a function of target eccentricity

In four experiments, saccadic eye movements, reaction times (RTs), and accuracy were measured as observers searched for feature or conjunction targets presented at several eccentricities. A conjunction search deficit, evidenced by a large eccentricity effect on RTs, accuracy, and number of saccades, was seen in Experiments 1A and 1B. Experiment 2 indicated that, when saccades were precluded, there was an even larger eccentricity effect for conjunction search targets. In Experiment 3, practice in a conjunction search task allowed both RT and number of saccades to become independent of eccentricity. Additionally, there was evidence of feature-based selectivity in that observers were more likely to fixate distractors that had the same contrast as the target. Results are consistent with the view that the oculomotor and attentional systems are functionally linked and provide constraints for models of visual attention and search.     

Area activation: a computational model of saccadic selectivity in visual search

The Area Activation Model (Pomplun, Reingold, Shen, & Williams, 2000) is a computational model predicting the statistical distribution of saccadic endpoints in visual search tasks. Its basic assumption is that saccades in visual search tend to foveate display areas that provide a maximum amount of task‐relevant information for processing during the subsequent fixation. In the present study, a counterintuitive prediction by the model is empirically tested, namely that saccadic selectivity towards stimulus features depends on the spatial arrangement of search items. We find good correspondence between simulated and empirically observed selectivity patterns, providing strong support for the Area Activation Model.     

Is target movement as well as target displacement a stimulus for saccadic eye movements?

The effects of visual movement on saccadic eye movement have been examined. In a classic apparent-movement demonstration with two successively exposed line-segment targets the quality of the movement is dependent on the relative orientation of the line segments. If saccadic eye movements are elicited between the targets in this situation, the configuration leading to optimal apparent movement also leads to the shortest-latency saccades. When a single line segment is succeeded by two line segments flanking it on opposite sides, and if one of these has the same orientation as the initial one and the other a different orientation, then apparent motion is seen between the two lines with the same orientation. However, the direction of saccades elicited in this configuration is not influenced by the relative orientations of the line segments. The two results together suggest that the effect of visual movement on saccadic eye movement is nonspecific.     

自主控制眼跳：实验范式、神经机制和应用

自主控制眼跳是眼跳类型之一。自主控制眼跳实验范式为研究各种脑损伤,神经疾病和精神失调提供了一种新的研究手段,为研究眼跳的神经机制以及反应抑制、空间工作记忆等高级认知功能提供了重要的方法。文章介绍了自主控制眼跳的两种实验范式：反向眼跳和记忆导向眼跳,阐述了自主控制眼跳的神经机制及其实验范式的应用,指出自主控制眼跳实验范式为评定精神分裂症等脑功能失调病人的神经功能状态提供了重要的信息,为研究各种脑功能失调和精神疾病提供了重要的研究方法。今后的研究趋势是眼跳研究与神经成像技术和临床观察相结合     

Eye movement indices of mental workload

Four investigations were carried out to assess the feasibility of using eye movement measures as indices of mental workload. In the first experiment, saccadic extent was measured during free viewing while subjects performed low, moderate and high complexity, auditory tone counting as the workload tasks. The range of saccadic extent decreased significantly as tone counting complexity (workload) was increased. In the second experiment the range of spontaneous saccades was measured under three levels of counting complexity with a visual task that did not require fixation or tracking. The results indicated that the extent of saccadic eye movements was significantly restricted as counting complexity increased. In the third experiment, the effects of practice were examined and decreased saccadic range under high tone counting complexity was observed even when significant increases in performance occurred with practice. Finally, in experiment 4, the first experiment was repeated with additional optokinetic stimulation and the saccadic range was again observed to decrease with tone counting complexity. The results indicated that the extent of spontaneous and elicited eye movements was significantly restricted as counting complexity increased. We conclude that this measure may provide a valuable index of mental workload.     

Driving forces in free visual search: An ethology

Visual search typically involves sequences of eye movements under the constraints of a specific scene and specific goals. Visual search has been used as an experimental paradigm to study the interplay of scene salience and top-down goals, as well as various aspects of vision, attention, and memory, usually by introducing a secondary task or by controlling and manipulating the search environment. An ethology is a study of an animal in its natural environment, and here we examine the fixation patterns of the human animal searching a series of challenging illustrated scenes that are well-known in popular culture. The search was free of secondary tasks, probes, and other distractions. Our goal was to describe saccadic behavior, including patterns of fixation duration, saccade amplitude, and angular direction. In particular, we employed both new and established techniques for identifying top-down strategies, any influences of bottom-up image salience, and the midlevel attentional effects of saccadic momentum and inhibition of return. The visual search dynamics that we observed and quantified demonstrate that saccades are not independently generated and incorporate distinct influences from strategy, salience, and attention. Sequential dependencies consistent with inhibition of return also emerged from our analyses.     

Programming saccadic eye movements

This article addresses questions about the preparatory processes that immediately precede saccadic eye movements. Saccade latencies were measured in a task in which subjects were provided partial advance information about the spatial location of a target fixation. In one experiment, subjects were faster in initiating saccades when they knew either the direction or amplitude of the required movement in advance compared to a condition with equal uncertainty about the number of potential saccade targets but without knowledge of the parameters required to execute the movement. These results suggest that the direction and amplitude for an upcoming saccade were calculated separately, and not in a fixed serial order. In another experiment, subjects appear to have programmed the saccades more holistically--with computations of direction and amplitude parameters occurring simultaneously. The implications of these results for models of eye movement preparation are discussed.     

Attention and saccadic eye movements

Four threshold detection experiments addressed three issues concerning the relationship between movements of spatial attention and saccadic eye movements: (a) the time course of attention shifts wit saccades, (b) the response of the two systems to changes in stimulus parameters, and (c) the relationship of attention to saccadic suppression. These issues bear on the more general question of the degree of independence between the saccadic and attentional movement systems. The results of these experiments support the contention that the mechanisms that shift attention are separate from those that control saccadic eye movements. Relevant events in the visual field periphery, however, will trigger both a saccade and attention shift. The attentional response to such events does not appear to be under subjects' control. The implication of these results for theories of saccadic suppression is discussed.