Independent allocation of attention to eye and hand targets in coordinated eye-hand movements

When reaching for objects, people frequently look where they reach. This raises the question of whether the targets for the eye and hand in concurrent eye and hand movements are selected by a unitary attentional system or by independent mechanisms. We used the deployment of visual attention as an index of the selection of movement targets and asked observers to reach and look to either the same location or separate locations. Results show that during the preparation of coordinated movements, attention is allocated in parallel to the targets of a saccade and a reaching movement. Attentional allocations for the two movements interact synergistically when both are directed to a common goal. Delaying the eye movement delays the attentional shift to the saccade target while leaving attentional deployment to the reach target unaffected. Our findings demonstrate that attentional resources are allocated independently to the targets of eye and hand movements and suggest that the goals for these effectors are selected by separate attentional mechanisms.     

内源性眼跳前的空间注意转移

采用线运动错觉(illusory line motion)测量的单任务范式,以色块为眼跳提示刺激,用三个实验对内源性眼跳前是否存在空间注意转移进行了探讨。实验一要求被试将眼睛跳往提示刺激处,通过对线运动错觉的分析确定该条件下的空间注意转移规律;实验二要求被试在将视线保持在注视点处的条件下判断目标色块是否出现,以探明线运动错觉是否受对目标色块前注意阶段加工的影响;实验三要求被试将眼睛跳往提示刺激的对侧,分析眼跳位置与提示刺激空间方位的一致性对空间注意转移的影响。获得以下主要结果：(1)内源性眼跳前存在注意转移;(2)在视线保持在注视点处的条件下,注意未受对提示刺激前注意加工的引导;(3)眼跳目标位置与提示目标位置的空间一致性对眼跳前空间注意转移无显著影响。     

The time course of presaccadic attention shifts

The dynamics of the allocation of attention during the preparation of saccadic eye movements was studied in a dual task paradigm. As the primary task, participants had to perform a saccade to letter-like items arranged on a clock face. The secondary task was a 2AFC discrimination task in which a discrimination target (DT) ('E' or '3') was presented among distractors, either at the saccade goal, or at a spatially separate, precued location. In the first experiment, the position of the DT was kept constant within an experimental block, while the saccade target location varied. In the second experiment, the location of the DT was varied while the saccade target remained the same within a block. The data demonstrate that attentional dynamics differs between the experiments--attention can shift to the saccade goal early or late during the saccade preparation period, depending on the task. Immediately before saccade onset, however, discrimination performance at the location of the saccade target is always superior to other locations, arguing for a strict and selective coupling between saccade preparation and attention.     

Perceptual localization of visual stimuli flashed during saccades

Subjects were asked to make a saccade to a visual target flashed in the dark during a prior primary saccade, and to report its apparent position by moving an adjustable light spot to that position. When targets were presented at the beginning of the primary saccade, subjects perceptually mislocated them in the direction of the saccade, whereas when targets were presented immediately before the end of the primary saccade, the flashed targets were mislocated in the opposite direction. The perceptually localized position of the target was primarily determined by its retinal position. However, at all actual and retinal positions of the target, the localized position shifted from the position that would be predicted if the location of the target was determined only by its retinal position to the prior primary saccade direction. The results were discussed in relation to extraretinal eye position signals. Subjects moved their eyes not to the actual position of the target, but to its apparent position. In some trials, there was a discrepancy between perceptual and oculomotor localization, which was interpreted as having been caused by the imprecise localization ability of the oculomotor system.     

刺激的视觉显著性和奖赏价值对眼跳的影响

本研究旨在探索刺激的视觉显著性和奖赏价值分别在协同和竞争的条件下对眼跳过程的影响。实验材料为成对的Gabor图案,要求被试选择具有更高奖赏价值的图案,并记录下其眼动过程。实验分为协同条件和竞争条件。结果发现,在不同实验条件下,奖赏价值对眼跳命中率和潜伏期均存在显著效应;视觉显著性的效应则在不同实验条件下出现了分离。刺激驱动过程和目标驱动过程对眼动行为的影响可能是互相区别的两种不同模式。     

A Simon effect induced by induced motion and location: Evidence for a direct linkage of cognitive and motor maps

It has been argued that two distinct maps of visual space are formed: a cognitive map that is susceptible to illusions, and a motor map that represents the physical world veridically. In the present study, subjects responded to a nonspatial attribute of a visual target stimulus by pressing a left or right key, while an illusory horizontal displacement of the target was induced. A Simon-type effect was obtained to the induced target motion or position shift—that is, responses were faster when the illusory target motion or location corresponded to the response position. Further experiments indicated that the observed effects cannot be accounted for by attentional shifts. These results suggest that the content of the cognitive map does not only influence perceptual judgments but is also responsible for the automatic activation of response codes. In other words, perception and action seem to be fed by a common, cognitively penetrable, spatial representation.     

Target localization after saccades and at fixation: Nontargets both facilitate and bias responses

ABSTRACT

The image on our retina changes every time we make an eye movement. To maintain visual stability after saccades, specifically to locate visual targets, we may use nontarget objects as “landmarks”. In the current study, we compared how the presence of nontargets affects target localization after saccades and during sustained fixation. Participants fixated a target object, which either maintained its location on the screen (sustained-fixation trials), or displaced to trigger a saccade (saccade trials). After the target disappeared, participants reported the most recent target location with a mouse click. We found that the presence of nontargets decreased response error magnitude and variability. However, this nontarget facilitation effect was not larger for saccade trials than sustained-fixation trials, indicating that nontarget facilitation might be a general effect for target localization, rather than of particular importance to post-saccadic stability. Additionally, participants’ responses were biased towards the nontarget locations, particularly when the nontarget-target relationships were preserved in relative coordinates across the saccade. This nontarget bias interacted with biases from other spatial references, e.g., eye movement paths, possibly in a way that emphasized non-redundant information. In summary, the presence of nontargets is one of several sources of reference that combine to influence (both facilitate and bias) target localization.     

Remapping versus short-term memory in visual stability across saccades

Saccadic eye movements cause displacements of the image of the visual world projected on the retina. Despite the ubiquitous nature of saccades, subjective experience of the world is continuous and stable. In five experiments, we addressed the mechanisms that may support visual stability: matching of pre- and postsaccadic locations of the target by an internal copy of the saccade, or retention of the visual attributes of the target in short-term memory across the saccade. Healthy human adults were instructed to make a saccade to a peripheral Gabor patch. While the saccade was in midflight, the patch could change location, orientation, or both. The change occurred either immediately or following a 250-ms blank during which no visual stimuli were available. In separate experiments, subjects had to report either whether the patch stepped to the left or right or whether the orientation rotated clockwise or counterclockwise. Consistent with previous findings, we found that transsaccadic displacement discrimination was enhanced by the addition of the blank. However, contrary to previous findings reported in the literature, the feature change did not improve performance. Transsaccadic orientation change discrimination did not depend on either an irrelevant temporal blank or a simultaneous irrelevant target displacement. Taken together, these findings suggest that orientation is not a relevant visual feature for transsaccadic correspondence.     

Effects of direct and averted gaze on the subsequent saccadic response

The saccadic latency to visual targets is susceptible to the properties of the currently fixated objects. For example, the disappearance of a fixation stimulus prior to presentation of a peripheral target shortens saccadic latencies (the gap effect). In the present study, we investigated the influences of a social signal from a facial fixation stimulus (i.e., gaze direction) on subsequent saccadic responses in the gap paradigm. In Experiment 1, a cartoon face with a direct or averted gaze was used as a fixation stimulus. The pupils of the face were unchanged (overlap), disappeared (gap), or were translated vertically to make or break eye contact (gaze shift). Participants were required to make a saccade toward a target to the left or the right of the fixation stimulus as quickly as possible. The results showed that the gaze direction influenced saccadic latencies only in the gaze shift condition, but not in the gap or overlap condition; the direct-to-averted gaze shift (i.e., breaking eye contact) yielded shorter saccadic latencies than did the averted-to-direct gaze shift (i.e., making eye contact). Further experiments revealed that this effect was eye contact specific (Exp. 2) and that the appearance of an eye gaze immediately before the saccade initiation also influenced the saccadic latency, depending on the gaze direction (Exp. 3). These results suggest that the latency of target-elicited saccades can be modulated not only by physical changes of the fixation stimulus, as has been seen in the conventional gap effect, but also by a social signal from the attended fixation stimulus.     

Averaging saccades are repelled by prior uninformative cues at both short and long intervals

When two spatially proximal stimuli are presented simultaneously, a first saccade is often directed to an intermediate location between the stimuli (averaging saccade). In an earlier study, Watanabe (2001) showed that, at a long cue–target onset asynchrony (CTOA; 600 ms), uninformative cues not only slowed saccadic response times (SRTs) to targets presented at the cued location in single target trials (inhibition of return, IOR), but also biased averaging saccades away from the cue in double target trials. The present study replicated Watanabe's experimental task with a short CTOA (50 ms), as well as with mixed short (50 ms) and long (600 ms) CTOAs. In all conditions on double target trials, uninformative cues robustly biased averaging saccades away from cued locations. Although SRTs on single target trials were delayed at previously cued locations at both CTOAs when they were mixed, this delay was not observed in the blocked, short CTOA condition. We suggest that top-down factors, such as expectation and attentional control settings, may have asymmetric effects on the temporal and spatial dynamics of oculomotor processing.     

Bottom-up effects modulate saccadic latencies in well-known eye movement paradigm

A well-known eye movement paradigm combines saccades (fast eye movements) with a perceptual discrimination task. At a variable time after the onset of a central arrow cue indicating the target direction [the stimulus onset asynchrony (SOA)], discrimination symbols appear briefly at saccade target and non-target locations. A previous study revealed an unexpected effect of SOA on saccadic latencies: latencies were longer in trials with longer SOAs. It was suggested that this effect reflects a top-down process as observers may wait for the discrimination symbol to appear before executing saccades. However, symbol onsets may also modulate saccade latencies from the bottom-up. To clarify the origin of the SOA effect on latencies in this paradigm, we used a simplified version of the original task plus two new symbol onset conditions for comparison. The results indicate that the modulation of saccadic latencies was not due to a top-down strategy, but to a combination of two opposing bottom-up effects: the symbol onsets at the target location shortened saccade latencies, while symbol onsets at non-target locations lengthened saccade latencies.     

Endogenous saccades are preceded by shifts of visual attention: evidence from cross-saccadic priming effects

The present study examines whether endogenous saccades are preceded by shifts of attention. Three experiments are reported in which participants were required to execute a saccadic eye movement to a certain location and to subsequently identify the orientation of a target triangle. Prior to the execution of the saccade a prime was presented, which was compatible or incompatible with the target. A priming effect (faster responses in the compatible condition than in the incompatible condition) occurred only when the prime was presented at the saccade destination, and this effect was larger when the prime was presented during oculomotor programming than when it was presented prior to oculomotor programming. The results indicate that an endogenous shift of attention precedes endogenous saccades, providing further support for theories of visual selection that assume a tight coupling between attention and saccades.     

The role of visual attention in saccadic eye movements

The relationship between saccadic eye movements and covert orienting of visual spatial attention was investigated in two experiments. In the first experiment, subjects were required to make a saccade to a specified location while also detecting a visual target presented just prior to the eye movement. Detection accuracy was highest when the location of the target coincided with the location of the saccade, suggesting that subjects use spatial attention in the programming and/or execution of saccadic eye movements. In the second experiment, subjects were explicitly directed to attend to a particular location and to make a saccade to the same location or to a different one. Superior target detection occurred at the saccade location regardless of attention instructions. This finding shows that subjects cannot move their eyes to one location and attend to a different one. The results of these experiments suggest that visuospatial attention is an important mechanism in generating voluntary saccadic eye movements.     

Grasping of extrafoveal targets: A robotic model

We present a computational model of grasping of non-fixated (extrafoveal) target objects which is implemented on a robot setup, consisting of a robot arm with cameras and gripper. This model is based on the premotor theory of attention (Rizzolatti et al., 1994) which states that spatial attention is a consequence of the preparation of goal-directed, spatially coded movements (especially saccadic eye movements). In our model, we add the hypothesis that saccade planning is accompanied by the prediction of the retinal images after the saccade. The foveal region of these predicted images can be used to determine the orientation and shape of objects at the target location of the attention shift. This information is necessary for precise grasping. Our model consists of a saccade controller for target fixation, a visual forward model for the prediction of retinal images, and an arm controller which generates arm postures for grasping. We compare the precision of the robotic model in different task conditions, among them grasping (1) towards fixated target objects using the actual retinal images, (2) towards non-fixated target objects using visual prediction, and (3) towards non-fixated target objects without visual prediction. The first and second setting result in good grasping performance, while the third setting causes considerable errors of the gripper orientation, demonstrating that visual prediction might be an important component of eye–hand coordination. Finally, based on the present study we argue that the use of robots is a valuable research methodology within psychology.     

Attention modulates saccadic inhibition magnitude

Visual transient events during ongoing eye movement tasks inhibit saccades within a precise temporal window, spanning from around 60–120 ms after the event, having maximum effect at around 90 ms. It is not yet clear to what extent this saccadic inhibition phenomenon can be modulated by attention. We studied the saccadic inhibition induced by a bright flash above or below fixation, during the preparation of a saccade to a lateralized target, under two attentional manipulations. Experiment 1 demonstrated that exogenous precueing of a distractor's location reduced saccadic inhibition, consistent with inhibition of return. Experiment 2 manipulated the relative likelihood that a distractor would be presented above or below fixation. Saccadic inhibition magnitude was relatively reduced for distractors at the more likely location, implying that observers can endogenously suppress interference from specific locations within an oculomotor map. We discuss the implications of these results for models of saccade target selection in the superior colliculus.     

A Simon effect induced by induced moton and location: evidence for a direct linkage of cognitive and motor maps

It has been argued that two distinct maps of visual space are formed: a cognitive map that is susceptible to illusions, and a motor map that represents the physical world veridically. In the present study, subjects responded to a nonspatial attribute of a visual target stimulus by pressing a left or right key, while an illusory horizontal displacement of the target was induced. A Simon-type effect was obtained to the induced target motion or position shift-that is, responses were faster when the illusory target motion or location corresponded to the response position. Further experiments indicated that the observed effects cannot be accounted for by attentional shifts. These results suggest that the content of the cognitive map does not only influence perceptual judgments but is also responsible for the automatic activation of response codes. In other words, perception and action seem to be fed by a common, cognitively penetrable, spatial representation.     

Transsaccadic integration of bystander locations

The present study investigated whether and how the location of bystander objects is encoded, maintained, and integrated across an eye movement. Bystander objects are objects that remain unfixated directly before and after the saccade for which transsaccadic integration is being examined. Three experiments are reported that examine location coding of bystander objects relative to the future saccade target object, relative to the saccade source object, and relative to other bystander objects. Participants were presented with a random‐dot pattern and made a saccade from a central source to a designated saccade target. During this saccade the position of a single bystander was changed on half of the trials and participants had to detect the displacement. Postsaccadically the presence of the target, source, and other bystanders was manipulated. Results indicated that the location of bystander objects could be integrated across a saccade, and that this relied on configurational coding. Furthermore the present data provide evidence for the view that transsaccadic perception of spatial layout is not inevitably tied to the saccade target or the saccade source, that it makes use of objects and object configurations in a flexible manner that is partly governed by the task relevance of the various display items, and that it exploits the incidental configurational structure in the display's layout in order to increase its capacity limits.     

Saccadic localization of visual targets by the very young human infant

The direction, latency, and form of the 1- and 2-month-old human infant’s saccadic eye movements toward peripheral targets were investigated. Infants of both ages reliably executed a directionally appropriate first saccade toward a peripheral target introduced as far as 30 deg from the line of sight along the horizontal and both diagonal axes, but only to 10 deg along the vertical axis. The presence of a second target in the central visual field reduced the probability of peripheral target localization. A significant inverse relation was found between target distance from the line of sight and probability of initiating a directionally appropriate saccade. Electro-oculography revealed that latency to first saccade, although highly variable, was less than 500 msec on a significant proportion of trials. Unlike the adult, the first saccade to target was grossly hypometric and was followed by one or more saccades of approximately equal amplitude to the first.     

Audio-visual integration and saccadic inhibition

Saccades operate a continuous selection between competing targets at different locations. This competition has been mostly investigated in the visual context, and it is well known that a visual distractor can interfere with a saccade toward a visual target. Here, we investigated whether multimodal, audio-visual targets confer stronger resilience against visual distraction. Saccades to audio-visual targets had shorter latencies than saccades to unisensory stimuli. This facilitation exceeded the level that could be explained by simple probability summation, indicating that multisensory integration had occurred. The magnitude of inhibition induced by a visual distractor was comparable for saccades to unisensory and multisensory targets, but the duration of the inhibition was shorter for multimodal targets. We conclude that multisensory integration can allow a saccade plan to be reestablished more rapidly following saccadic inhibition.     

The neural correlates of orienting to walking direction in 6‐month‐old infants: An ERP study

The ability to detect social signals represents a first step to enter our social world. Behavioral evidence has demonstrated that 6‐month‐old infants are able to orient their attention toward the position indicated by walking direction, showing faster orienting responses toward stimuli cued by the direction of motion than toward uncued stimuli. The present study investigated the neural mechanisms underpinning this attentional priming effect by using a spatial cueing paradigm and recording EEG (Geodesic System 128 channels) from 6‐month‐old infants. Infants were presented with a central point‐light walker followed by a single peripheral target. The target appeared randomly at a position either congruent or incongruent with the walking direction of the cue. We examined infants' target‐locked event‐related potential (ERP) responses and we used cortical source analysis to explore which brain regions gave rise to the ERP responses. The P1 component and saccade latencies toward the peripheral target were modulated by the congruency between the walking direction of the cue and the position of the target. Infants' saccade latencies were faster in response to targets appearing at congruent spatial locations. The P1 component was larger in response to congruent than to incongruent targets and a similar congruency effect was found with cortical source analysis in the parahippocampal gyrus and the anterior fusiform gyrus. Overall, these findings suggest that a type of biological motion like the one of a vertebrate walking on the legs can trigger covert orienting of attention in 6‐month‐old infants, enabling enhancement of neural activity related to visual processing of potentially relevant information as well as a facilitation of oculomotor responses to stimuli appearing at the attended location.