刺激的视觉显著性和奖赏价值对眼跳的影响

本研究旨在探索刺激的视觉显著性和奖赏价值分别在协同和竞争的条件下对眼跳过程的影响。实验材料为成对的Gabor图案,要求被试选择具有更高奖赏价值的图案,并记录下其眼动过程。实验分为协同条件和竞争条件。结果发现,在不同实验条件下,奖赏价值对眼跳命中率和潜伏期均存在显著效应;视觉显著性的效应则在不同实验条件下出现了分离。刺激驱动过程和目标驱动过程对眼动行为的影响可能是互相区别的两种不同模式。     

The Role of Emotional Content and Perceptual Saliency During the Programming of Saccades Toward Faces

Previous studies have shown that the human visual system can detect a face and elicit a saccadic eye movement toward it very efficiently compared to other categories of visual stimuli. In the first experiment, we tested the influence of facial expressions on fast face detection using a saccadic choice task. Face-vehicle pairs were simultaneously presented and participants were asked to saccade toward the target (the face or the vehicle). We observed that saccades toward faces were initiated faster, and more often in the correct direction, than saccades toward vehicles, regardless of the facial expressions (happy, fearful, or neutral). We also observed that saccade endpoints on face images were lower when the face was happy and higher when it was neutral. In the second experiment, we explicitly tested the detection of facial expressions. We used a saccadic choice task with emotional-neutral pairs of faces and participants were asked to saccade toward the emotional (happy or fearful) or the neutral face. Participants were faster when they were asked to saccade toward the emotional face. They also made fewer errors, especially when the emotional face was happy. Using computational modeling, we showed that this happy face advantage can, at least partly, be explained by perceptual factors. Also, saccade endpoints were lower when the target was happy than when it was fearful. Overall, we suggest that there is no automatic prioritization of emotional faces, at least for saccades with short latencies, but that salient local face features can automatically attract attention.     

A model of saccade generation based on parallel processing and competitive inhibition

During active vision, the eyes continually scan the visual environment using saccadic scanning movements. This target article presents an information processing model for the control of these movements, with some close parallels to established physiological processes in the oculomotor system. Two separate pathways are concerned with the spatial and the temporal programming of the movement. In the temporal pathway there is spatially distributed coding and the saccade target is selected from a "salience map." Both pathways descend through a hierarchy of levels, the lower ones operating automatically. Visual onsets have automatic access to the eye control system via the lower levels. Various centres in each pathway are interconnected via reciprocal inhibition. The model accounts for a number of well-established phenomena in target-elicited saccades: the gap effect, express saccades, the remote distractor effect, and the global effect. High-level control of the pathways in tasks such as visual search and reading is discussed; it operates through spatial selection and search selection, which generally combine in an automated way. The model is examined in relation to data from patients with unilateral neglect.     

Bottom-up effects modulate saccadic latencies in well-known eye movement paradigm

A well-known eye movement paradigm combines saccades (fast eye movements) with a perceptual discrimination task. At a variable time after the onset of a central arrow cue indicating the target direction [the stimulus onset asynchrony (SOA)], discrimination symbols appear briefly at saccade target and non-target locations. A previous study revealed an unexpected effect of SOA on saccadic latencies: latencies were longer in trials with longer SOAs. It was suggested that this effect reflects a top-down process as observers may wait for the discrimination symbol to appear before executing saccades. However, symbol onsets may also modulate saccade latencies from the bottom-up. To clarify the origin of the SOA effect on latencies in this paradigm, we used a simplified version of the original task plus two new symbol onset conditions for comparison. The results indicate that the modulation of saccadic latencies was not due to a top-down strategy, but to a combination of two opposing bottom-up effects: the symbol onsets at the target location shortened saccade latencies, while symbol onsets at non-target locations lengthened saccade latencies.     

Driving forces in free visual search: An ethology

Visual search typically involves sequences of eye movements under the constraints of a specific scene and specific goals. Visual search has been used as an experimental paradigm to study the interplay of scene salience and top-down goals, as well as various aspects of vision, attention, and memory, usually by introducing a secondary task or by controlling and manipulating the search environment. An ethology is a study of an animal in its natural environment, and here we examine the fixation patterns of the human animal searching a series of challenging illustrated scenes that are well-known in popular culture. The search was free of secondary tasks, probes, and other distractions. Our goal was to describe saccadic behavior, including patterns of fixation duration, saccade amplitude, and angular direction. In particular, we employed both new and established techniques for identifying top-down strategies, any influences of bottom-up image salience, and the midlevel attentional effects of saccadic momentum and inhibition of return. The visual search dynamics that we observed and quantified demonstrate that saccades are not independently generated and incorporate distinct influences from strategy, salience, and attention. Sequential dependencies consistent with inhibition of return also emerged from our analyses.     

Early top-down control over saccadic target selection: Evidence from a systematic salience difference manipulation

Previous research on the contribution of top-down control to saccadic target selection has suggested that eye movements, especially short-latency saccades, are primarily salience driven. The present study was designed to systematically examine top-down influences as a function of time and relative salience difference between target and distractor. Observers performed a saccadic selection task, requiring them to make an eye movement to an orientation-defined target, while ignoring a color-defined distractor. The salience of the distractor was varied (five levels), permitting the percentage of target and distractor fixations to be analyzed as a function of the salience difference between the target and distractor. This analysis revealed the same pattern of results for both the overall and the short-latency saccades: When the target and distractor were of comparable salience, the vast majority of saccades went directly to the target; even distractors somewhat more salient than the target led to significantly fewer distractor, as compared with target, fixations. To quantify the amount of top-down control applied, we estimated the point of equal selection probability for the target and distractor. Analyses of these estimates revealed that, to be selected with equal probability to the target, a distractor had to have a considerably greater bottom-up salience, as compared with the target. This difference suggests a strong contribution of top-down control to saccadic target selection—even for the earliest saccades.     

ICAT: a computational model for the adaptive control of fixation durations

Eye movements depend on cognitive processes related to visual information processing. Much has been learned about the spatial selection of fixation locations, while the principles governing the temporal control (fixation durations) are less clear. Here, we review current theories for the control of fixation durations in tasks like visual search, scanning, scene perception, and reading and propose a new model for the control of fixation durations. We distinguish two local principles from one global principle of control. First, an autonomous saccade timer initiates saccades after random time intervals (local-I). Second, foveal inhibition permits immediate prolongation of fixation durations by ongoing processing (local-II). Third, saccade timing is adaptive, so that the mean timer value depends on task requirements and fixation history (Global). We demonstrate by numerical simulations that our model qualitatively reproduces patterns of mean fixation durations and fixation duration distributions observed in typical experiments. When combined with assumptions of saccade target selection and oculomotor control, the model accounts for both temporal and spatial aspects of eye movement control in two versions of a visual search task. We conclude that the model provides a promising framework for the control of fixation durations in saccadic tasks.     

Memory representations guide targeting eye movements in a natural task

The change blindness phenomenon suggests that visual representations retained across saccades are very limited. In this paper we sought to specify the kind of information that is in fact retained. We investigated targeting performance for saccadic eye movements, since one need for visual representations across eye and body positions may be to guide coordinated movements. We examined saccades in the context of an ongoing sensory motor task in order to make stronger generalizations about natural visual functioning and deployment of attention. Human subjects copied random patterns of coloured blocks on a computer display. Their eye movement pattern was consistent from block to block, including a precise saccade to a previously-placed, neighbouring block during each additional block placement. This natural, consistent eye movement allowed the previously-placed, neighbouring block to serve as an implicit target without instructions to the subject. On random trials, we removed the target object from the display during a preceding saccade, so that observers were required to make the targeting saccade without a currently visible target. Targeting performance was excellent, and appeared to be influenced by spatial information that was not visible during the preceding fixation. Subjects were generally unaware of the disappearance and reappearance of the target. We conclude that spatial information about visual targets is retained across eye movements and used to guide subsequent movements.     

The spatial signal for saccadic eye movements emphasizes visual boundaries

By investigating the visual processing involved when saccades are made to newly appearing targets, we show that this processing is significantly nonlinear and that texture boundary information predominates. We used the global, or center-of-gravity, effect whereby a saccadic eye movement directed to a target consisting of a pair of elements has an amplitude intermediate between that of saccades directed to the individual elements. We measured the effect using target elements with different visual characteristics, including phase-reversal checkerboard targets that had the same space-average luminance as the background. The contribution to the center-of-gravity calculation was used to measure relative salience. We found that positive and negative contrast elements contribute almost equal weightings. Thus, salience, assessed in this way, is a highly nonlinear function of luminance. The salience of checkerboard targets was found to decrease as check size was decreased and increase as the overall size of the target was increased. Checkerboards with an empty center were as effective as were full checkerboards, showing the importance of boundaries in the salience signal.     

Control of fixation duration in visual search and memory search: another look

In visual search a variable delay (up to 150 msec) between the beginning of each fixation and the onset of a search stimulus reduces the time (oculomotor latency) between stimulus onset and the subject's next saccadic eye movement. Two hypotheses for this effect of stimulus onset delay (SOD) were compared: first, process monitoring, that SOD simply serves as a warning interval to facilitate saccadic responses; and second, preprogramming, that saccades are preprogrammed at short SODs. In the first experiment SOD produced a decline in oculomotor latency in search similar to that seen in previous studies. In the second and third experiments, the size of the memory set in a Sternberg memory search paradigm was varied, or a mask flanking some of the search stimuli was used, to vary the processing time of each stimulus. Partial preprogramming of saccades at short delays would predict that increasing the processing time of individual stimuli would increase oculomotor latency at only short SODs. However, oculomotor latency increased equally at all SODs. In this search task, then, the SODs appeared to facilitate saccade initiation.     

Characteristic sounds make you look at target objects more quickly

When you are looking for an object, does hearing its characteristic sound make you find it more quickly? Our recent results supported this possibility by demonstrating that when a cat target, for example, was presented among other objects, a simultaneously presented “meow” sound (containing no spatial information) reduced the manual response time for visual localization of the target. To extend these results, we determined how rapidly an object-specific auditory signal can facilitate target detection in visual search. On each trial, participants fixated a specified target object as quickly as possible. The target’s characteristic sound speeded the saccadic search time within 215–220 msec and also guided the initial saccade toward the target, compared with presentation of a distractor’s sound or with no sound. These results suggest that object-based auditory—visual interactions rapidly increase the target object’s salience in visual search.     

The ability of the saccadic system to change motor plans in scanning letter strings

Evidence from recent studies bolsters the idea of preestablished motor plans in scanning isolated items. Thus, refixation saccades are preplanned at the same time as the primary saccade directed to a peripheral item and are completed with fixed amplitudes irrespective of the first fixation position in the item. In order to examine the saccadic system's ability to correct the motor plan during its execution on the basis of new visual information, an experiment was conducted in which 11-letter strings were changed to two 5-letter strings at different times after the primary saccade was directed to the stimulus. The results demonstrate that the saccadic system is able to cancel the preplanned refixation saccade and plan a saccade directed to the next item only when the new visual information is available at least 220 msec before the execution of the saccade.     

The role of attention in the preparation of visually guided eye movements in monkey and man

Summary Neurophysiological data from single cells in the monkey's visual association cortex as well as saccadic reaction time measurements in monkey and man are reported. When a monkey directs his attention to a peripheral light stimulus the visual activation of cortical cells responsive to that stimulus is increased. If visual attention is directed to a particular part of the visual field the saccadic reaction time is long (around 200 ms in monkey and above 200 ms in man). In contrast, if attention is disengaged from any location to which it might have been engaged before, monkeys and men can execute express saccades, that is, saccades after extremely short and stable reaction times (around 75 ms in monkey and 100 ms in man). The results are interpreted in the context of a hypothesis according to which the initiation of voluntary, visually guided saccades includes three premotor mechanisms: the computation of the target location, the decision to make a saccade, and the disengagement of attention.     

Age-group differences in inhibiting an oculomotor response

Age-group differences were examined in the delayed oculomotor response task, which requires that observers delay the execution of a saccade (eye movement) toward an abrupt-onset visual cue. This task differs from antisaccade and attentional capture in that inhibition causes saccades to be postponed, not redirected. Older adults executed more premature saccades than young adults, but there were no age-group differences in latency or accuracy of saccades executed at the proper time. The results suggest that older adults are less capable of inhibiting a prepotent saccadic response, but that other aspects of visual working memory related to the task are preserved.     

Reinstating salience effects over time: the influence of stimulus changes on visual selection behavior over a sequence of eye movements

Recently, we showed that salience affects initial saccades only in a static stimulus environment; subsequent saccades were unaffected by salience but, instead, were directed in line with task requirements (Siebold, van Zoest, & Donk, PLoS ONE 6(9): e23552, 2011). Yet multiple studies have shown that people tend to fixate salient regions more often than nonsalient ones when they are looking at images—in particular, when salience is defined by dynamic changes. The goal of the present study was to investigate how oculomotor selection beyond an initial saccade is affected by salience as derived from changing, as opposed to static, stimuli. Observers were presented with displays containing two fixation dots, one target, one distractor, and multiple background elements. They were instructed to fixate on one of the fixation dots and make a speeded eye movement to the target, either directly or preceded by an initial eye movement to the other fixation dot. In Experiment 1, target and distractor differed in orientation contrast relative to the background, such that one was more salient than the other, whereas in Experiments 2 and 3, the orientation contrast between the two elements was identical. Here, salience was implemented by a continuous luminance flicker or by a difference in luminance contrast, respectively, which was presented either simultaneously with display onset or contingent upon the first saccade. The results showed that in all experiments, initial saccades were strongly guided by salience, whereas second saccades were consistently goal directed if the salience manipulation was present from display onset. However, if the flicker or luminance contrast was presented contingent upon the initial saccade, salience effects were reinstated. We argue that salience effects are short-lived but can be reinstated if new information is presented, even when this occurs during an eye movement.     

Saccadic suppression of displacement: effects of illumination and background manipulation

In contrast to other functions which are suppressed during saccades, saccadic suppression of displacement (SSD--a decrease in sensitivity to visual displacements during saccades) has often been considered to be due to efferent processes rather than to visual masking. The aim of this study was to explicitly assess the importance of visual conditions in SSD. In two experiments, a small computer-generated target made random horizontal jumps. An infrared eye tracker was used to detect the saccade toward the new position, triggering a smaller centripetal displacement of the target. Subjects reported awareness of these intrasaccadic displacements by pressing a key. In the first experiment, the task was performed in both a well-lit environment and in darkness. In the second experiment these conditions were replicated and additional factors such as the contrast of the background and the effect of moving the target spot alone or the target plus the entire background were investigated. Unlike other forms of saccadic suppression, SSD was stronger in the dark, although subjects also had a greater bias to report detections in that condition. Other background manipulations had no effect. The effect of ambient lighting on SSD is small and subtle. Effects of other background manipulations may be overridden by the focusing of attention on a small moving target.     

Perceiving stimulus displacements across saccades

The visual world appears stable despite frequent retinal image movements caused by saccades. Many theories of visual stability assume that extraretinal eye position information is used to spatially adjust perceived locations across saccades, whereas others have proposed that visual stability depends upon coding of the relative positions of objects. McConkie and Currie (1996) proposed a refined combination of these views (called the Saccade Target Object Theory) in which the perception of stability across saccades relies on a local evaluation process centred on the saccade target object rather than on a remapping of the entire scene, with some contribution from memory for the relative positions of objects as well. Three experiments investigated the saccade target object theory, along with an alternative hypothesis that proposes that multiple objects are updated across saccades, but with variable resolution, with the saccade target object (by virtue of being the focus of attention before the saccade and residing near the fovea after the saccade) having priority in the perception of displacement. Although support was found for the saccade target object theory in Experiment 1, the results of Experiments 2 and 3 found that multiple objects are updated across saccades and that their positions are evaluated to determine perceived stability. There is an advantage for detecting displacements of the saccade target, most likely because of visual acuity or attentional focus being better near the fovea, but it is not the saccade target alone that determines the perception of stability and of displacements across saccades. Rather, multiple sources of information appear to contribute.     

Saccades to targets in three-dimensional space: dependence of saccadic latency on target location.

The latency of saccadic movements to targets appearing at various positions in three-dimensional visual space was measured in four experiments. The first experiment confirmed that latencies of saccades to visual targets are greater in the lower visual field and showed that the increase is not influenced by the vertical starting position of the eye in the orbit, nor by a time gap between the fixation offset and the target onset. A hypothesis that this visual field difference was caused by a link between downward saccades and convergence movements was tested by recording saccade latencies when the targets were in a different depth plane from that of the original fixation. We did not find any direct support for the vergence involvement hypothesis, although the lower/upper visual field effect was shown to decrease consistently in monocular viewing. It was also shown that saccades to targets positioned in a different depth plane have longer latencies. In a final experiment, the visual field effect was shown to depend on the egocentric rather than the gravitational vertical.     

Saccades to targets in three-dimensional space: Dependence of saccadic latency on target location

The latency of saccadic movements to targets appearing at various positions in three-dimensional visual space was measured in four experiments. The first experiment confirmed that latencies of saccades to visual targets are greater in the lower visual field and showed that the increase is not influenced by the vertical starting position of the eye in the orbit, nor by a time gap between the fixation offset and the target onset. A hypothesis that this visual field difference was caused by a link between downward saccades and convergence movements was tested by recording saccade latencies when the targets were in a different depth plane from that of the original fixation. We did not find any direct support for the vergence involvement hypothesis, although the lower/upper visual field effect was shown to decrease consistently in monocular viewing. It was also shown that saccades to targets positioned in a different depth plane have longer latencies. In a final experiment, the visual field effect was shown to depend on the egocentric rather than the gravitational vertical.     

The insistence of vision: Why do people look at a salient stimulus when it signals target absence?

Researchers and practitioners across many fields would benefit from the ability to predict human search time in complex visual displays. However, a missing element in our ability to predict search time is our ability to quantify the exogenous attraction of visual objects in terms of their impact on search time. The current work represents an initial step in this direction. We present two experiments using a quadrant search task to investigate how exogenous and endogenous factors influence human visual search. In Experiment 1, we measure the oculomotor capture—or the tendency of a stimulus to elicit a saccade—of a salient quadrant under conditions in which the salient quadrant does not predict target location. Despite the irrelevance of quadrant salience, we find that subjects persist in making saccades towards the salient quadrant at above-chance levels. We then present a Bayesian-based ideal performer model that predicts search time and oculomotor capture when the salient quadrant never contains the search target. Experiment 2 tested the predictions of the ideal performer model and revealed human performance to be in close correspondence with the model. We conclude that, in our speeded search task, the influence of an exogenous attractor on saccades can be quantified in terms of search time costs and, when these costs are considered, both search time and search behaviour reflect a boundedly optimal adaptation to the cost structure of the environment.