Hand, eye, and head coordination while pointing to perturbed targets

Normal human subjects were required to manually point to small visual targets that suddenly changed location upon finger movement initiation. They pointed either as fast or as accurately as possible. Movements of the eyes were measured by electrooculography, and the movements of the unrestrained limb and head were monitored by an optoelectric system (WATSMART), which allowed for the analysis of kinematic parameters in three-dimensional space. The temporal and kinematic reorganization of each body part in response to the target perturbations were variable, which indicated independent control for each part of the system. That is, the timing and nature of the reorganization varied for each body part. In addition, the pattern of reorganization depended upon the speed and accuracy demands of the movement task. As well, the movement termination patterns (eyes finished first, the finger reached the target, then the head stopped moving) were extremely consistent, indicating that movement termination may be a controlled variable. Finally, no evidence was found to suggest that visual information was used to amend arm movements early (before peak velocity) in the trajectory.     

Coordinated control of eye and hand movements in dynamic reaching

In the present study, we integrated two recent, at first sight contradictory findings regarding the question whether saccadic eye movements can be generated to a newly presented target during an ongoing hand movement. Saccades were measured during so-called adaptive and sustained pointing conditions. In the adapted pointing condition, subjects had to direct both their gaze and arm movements to a displaced target location. The results showed that the eyes could fixate the new target during pointing. In addition, a temporal coupling of these corrective saccades was found with changes in arm movement trajectories when reaching to the new target. In the sustained pointing condition, however, the same subjects had to point to the initial target, while trying to deviate their gaze to a new target that appeared during pointing. It was found that the eyes could not fixate the new target before the hand reached the initial target location. Together, the results indicate that ocular gaze is always forced to follow the target intended by a manual arm movement. A neural mechanism is proposed that couples ocular gaze to the target of an arm movement. Specifically, the mechanism includes a reach neuron layer besides the well-known saccadic layer in the primate superior colliculus. Such a tight, sub-cortical coupling of ocular gaze to the target of a reaching movement can explain the contrasting behavior of the eyes in dependency of whether the eye and hand share the same target position or attempt to move to different locations.     

Coupling of Eye,Finger, Elbow,and Shoulder Movements During Manual Aiming

Temporal and spatial coupling of point of gaze (PG) and movements of the finger, elbow, and shoulder during a speeded aiming task were examined. Ten participants completed 40-cm aiming movements with the right arm, in a situation that allowed free movement of the eyes, head, arm, and trunk. On the majority of trials, a large initial saccade undershot the target slightly, and 1 or more smaller corrective saccades brought the eyes to the target position. The finger, elbow, and shoulder exhibited a similar pattern of undershooting their final positions, followed by small corrective movements. Eye movements usually preceded limb movements, and the eyes always arrived at the target well in advance of the finger. There was a clear temporal coupling between primary saccade completion and peak acceleration of the finger, elbow, and shoulder. The initiation of limb-segment movement usually occurred in a proximal-to-distal pattern. Increased variability in elbow and shoulder position as the movement progressed may have served to reduce variability in finger position. The spatial-temporal coupling of PG with the 3 limb segments was optimal for the pick up of visual information about the position of the finger and the target late in the movement.     

Coupling of eye, finger, elbow, and shoulder movements during manual aiming

Temporal and spatial coupling of point of gaze (PG) and movements of the finger, elbow, and shoulder during a speeded aiming task were examined. Ten participants completed 40-cm aiming movements with the right arm, in a situation that allowed free movement of the eyes, head, arm, and trunk. On the majority of trials, a large initial saccade undershot the target slightly, and 1 or more smaller corrective saccades brought the eyes to the target position. The finger, elbow, and shoulder exhibited a similar pattern of undershooting their final positions, followed by small corrective movements. Eye movements usually preceded limb movements, and the eyes always arrived at the target well in advance of the finger. There was a clear temporal coupling between primary saccade completion and peak acceleration of the finger, elbow, and shoulder. The initiation of limb-segment movement usually occurred in a proximal-to-distal pattern. Increased variability in elbow and shoulder position as the movement progressed may have served to reduce variability in finger position. The spatial-temporal coupling of PG with the 3 limb segments was optimal for the pick up of visual information about the position of the finger and the target late in the movement.     

Covert shifts of attention precede involuntary eye movements

There is considerable evidence that covert visual attention precedes voluntary eye movements to an intended location. What happens to covert attention when an involuntary saccadic eye movement is made? In agreement with other researchers, we found that attention and voluntary eye movements are tightly coupled in such a way that attention always shifts to the intended location before the eyes begin to move. However, we found that when an involuntary eye movement is made, attention first precedes the eyes to the unintended location and then switches to the intended location, with the eyes following this pattern a short time later. These results support the notion that attention and saccade programming are tightly coupled.     

Inhibition of return is composed of attentional and oculomotor processes

Response time can be delayed if a target stimulus appears at a location or object that was previously cued. This inhibition of return (IOR) phenomenon has been attributed to a delay in activating attentional or motor processes to a previously cued stimulus. Two experiments required subjects to localize or identify a target stimulus. In Experiment 1, the subjects’ eyes were not monitored. In Experiment 2, the subjects’ eyes were monitored, and the subjects were instructed to either execute or withhold an eye movement to a target stimulus. The results indicated that IOR was always present for location and identification responses, supporting an attentional account of IOR. However, IOR was larger when eye movements were executed, indicating that a motor component can contribute to IOR. Finally, when eye movements were withheld, IOR was larger when a target was presented alone than when it was presented with a distractor, suggesting that IOR is larger for exogenous than for endogenous covert orienting. Together, the data indicate that IOR is composed of both an oculomotor component and an attentional component.     

Inhibition of return is composed of attentional and oculomotor processes.

Response time can be delayed if a target stimulus appears at a location or object that was previously cued. This inhibition of return (IOR) phenomenon has been attributed to a delay in activating attentional or motor processes to a previously cued stimulus. Two experiments required subjects to localize or identify a target stimulus. In Experiment 1, the subjects' eyes were not monitored. In Experiment 2, the subjects' eyes were monitored, and the subjects were instructed to either execute or withhold an eye movement to a target stimulus. The results indicated that IOR was always present for location and identification responses, supporting an attentional account of IOR. However, IOR was larger when eye movements were executed, indicating that a motor component can contribute to IOR. Finally, when eye movements were withheld, IOR was larger when a target was presented alone than when it was presented with a distractor, suggesting that IOR is larger for exogenous than for endogenous covert orienting. Together, the data indicate that IOR is composed of both an oculomotor component and an attentional component.     

Eye-hand coordination: oculomotor control in rapid aimed limb movements

Three experiments are reported in which Ss produced rapid wrist rotations to a target while the position of their eyes was being monitored. In Experiment 1, Ss spontaneously executed a saccadic eye movement to the target around the same time as the wrist began to move. Experiment 2 revealed that wrist-rotation accuracy suffered if Ss were not allowed to move their eyes to the target, even when visual feedback about the moving wrist was unavailable. In Experiment 3, wrist rotations were equally accurate when Ss produced either a saccadic or a smooth-pursuit eye movement to the target. However, differences were observed in the initial-impulse and error-correction phases of the wrist rotations, depending on the type of eye movement involved. The results suggest that aimed limb movements use information from the oculomotor system about both the static position of the eyes and the dynamic characteristics of eye movements. Furthermore, the information that governs the initial impulse is different from that which guides final error corrections.     

Attentional capture and aging: implications for visual search performance and oculomotor control

Two studies examined potential age-related differences in attentional capture. Subjects were instructed to move their eyes as quickly as possible to a color singleton target and to identify a small letter located inside it. On half the trials, a new stimulus (i.e., a sudden onset) appeared simultaneously with the presentation of the color singleton target. The onset was always a task-irrelevant distractor. Response times were lengthened, for both young and old adults, whenever an onset distractor appeared, despite the fact that subjects reported being unaware of the appearance of the abrupt onset. Eye scan strategies were also disrupted by the appearance of the onset distractors. On about 40% of the trials on which an onset appeared, subjects made an eye movement to the task-irrelevant onset before moving their eyes to the target. Fixations close to the onset were brief, suggesting parallel programming of a reflexive eye movement to the onset and goal-directed eye movement to the target. Results are discussed in terms of age-related sparing of the attentional and oculomotor processes that underlie attentional capture.     

How trunk turns affect locomotion when you are not looking where you go

How well do we maintain heading direction during walking while we look at objects beside our path by rotating our eyes, head, or trunk? Common experience indicates that it may be fairly hazardous not to look where you are going. In the present study, 12 young adults walked on a treadmill while they followed a moving dot along a horizontal line with their gaze by rotating primarily either their eyes, head, or trunk for amplitudes of up to 25 degrees . During walking the movement of the center of pressure (COP) was monitored using force transducers under a treadmill. Under normal light conditions, the participants showed little lateral deviation of the COP from the heading direction when they performed the eye or head movement task during walking, even when optic flow information was limited. In contrast, trunk rotations led to a doubling of the COP deviation in the mediolateral direction. Some of this deviation was attributed to foot rotation. Participants tended to point their feet in the gaze direction when making trunk turns. The tendency of the feet to be aligned with the trunk is likely to be due to a preference to have feet and body in the same orientation. Such alignment is weaker for the feet with respect to head position and it is absent with respect to eye position. It is argued that feet and trunk orientation are normally tightly coupled during gait and that it requires special abilities to move both segments independently when walking.     

Visual tracking of active and passive movements of the hand

Two experiments were performed to evaluate the influence of movement frequency and predictability on visual tracking of the actively and the passively moved hand. Four measures of tracking precision were employed: (a) saccades/cycle, (b) percent of pursuit movement, (c) eye amplitude/arm amplitude, (d) asynchrony of eye and hand at reversal. Active and passive limb movements were tracked with nearly identical accuracy and were always vastly superior to tracking an external visual target undergoing comparable motion. Proprioceptive information about target position appears to provide velocity and position information about target location. Its presence permits the development of central eye-movement programmes that move the eyes in patterns that approximate but do not exactly match, temporally or spatially, the motion of the hand.     

面孔识别的眼动研究

采用眼动记录法探讨面孔识别的加工过程。在实验一中,通过记录被试识别面孔图片和非面孔图片时的即时加工过程,考查被试在知觉面孔与一般物体时的眼动差异。在实验二中,考察被试在知觉熟悉面孔与陌生面孔时的眼动差异与时间进程的差异。结果表明:(1)个体在加工面孔时倾向于首先在双眼间平移而后向嘴巴运动,完成面孔识别,而在识别物体图片时则没有固定的运动轨迹。(2)在知觉熟悉面孔时被试倾向于只注视眼睛,而在知觉陌生面孔图片时则与实验一的面孔图片眼动轨迹相似。     

Coordinated flexibility: how initial gaze position modulates eye-hand coordination and reaching

Reaching to targets in space requires the coordination of eye and hand movements. In two experiments, we recorded eye and hand kinematics to examine the role of gaze position at target onset on eye-hand coordination and reaching performance. Experiment 1 showed that with eyes and hand aligned on the same peripheral start location, time lags between eye and hand onsets were small and initiation times were substantially correlated, suggesting simultaneous control and tight eye-hand coupling. With eyes and hand departing from different start locations (gaze aligned with the center of the range of possible target positions), time lags between eye and hand onsets were large and initiation times were largely uncorrelated, suggesting independent control and decoupling of eye and hand movements. Furthermore, initial gaze position strongly mediated manual reaching performance indexed by increments in movement time as a function of target distance. Experiment 2 confirmed the impact of target foveation in modulating the effect of target distance on movement time. Our findings reveal the operation of an overarching, flexible neural control system that tunes the operation and cooperation of saccadic and manual control systems depending on where the eyes look at target onset.     

Central visual persistences: I. Visual and kinesthetic interactions

Phenomena associated with 'central visual persistences' (CPs) are new to both medical and psychological literature. Five subjects have reported similar CPs: positive afterimages following brief fixation of high-contrast objects or drawings and eye closure. CPs duplicate shapes and colors of single objects, lasting for about 15 s. Unlike retinal afterimages, CPs do not move with the eyes but are stable in extrapersonal space during head or body rotations. CPs may reflect sustained neural activity in neurons of association cortex, which mediate object perception. A remarkable finding is that CPs can be moved in any direction by the (unseen) hand holding the original seen object. Moreover, a CP once formed will 'jump' into an extended hand and 'stick' in that hand as it moves about. The apparent size of a CP of a single object is determined by the size of the gap between finger and thumb, even when no object is touched. These CPs can be either magnified or minified via the grip of the extended hand. The felt orientation of the hand-held object will also determine the orientation of the CP seen in that hand. Thus, kinesthetic signals from hand and arm movements can determine perceived location, size, and orientation of CPs. A neural model based on physiological studies of premotor, temporal, parietal, and prefrontal cortices is proposed to account for these novel phenomena.     

On nystagmus,saccades, and fixations

Investigations of the ways in which the eyes move came to prominence in the 19th century, but techniques for measuring them more precisely emerged in the 20th century. When scanning a scene or text the eyes engage in periods of relative stability (fixations) interspersed with ballistic rotations (saccades). The saccade-and-fixate strategy, associated with voluntary eye movements, was first uncovered in the context of involuntary eye movements following body rotation. This pattern of eye movements is now referred to as nystagmus, and involves periods of slow eye movements, during which objects are visible, and rapid returns, when they are not; it is based on a vestibular reflex which attempts to achieve image stabilisation. Post-rotational nystagmus was reported in the late 18th century (by Wells), with afterimages used as a means of retinal stabilisation to distinguish between movement of the eyes and of the environment. Nystagmus was linked to vestibular stimulation in the 19th century, and Mach, Breuer, and Crum Brown all described its fast and slow phases. Wells and Breuer proposed that there was no visual awareness during the ballistic phase (saccadic suppression). The saccade-and-fixate strategy highlighted by studies of nystagmus was shown to apply to tasks like reading by Dodge, who used more sophisticated photographic techniques to examine oculomotor kinematics. The relationship between eye movements and perception, following earlier intuitions by Wells and Breuer, was explored by Dodge, and has been of fundamental importance in the direction of vision research over the last century.     

The visual control of aimed hand movements to stationary and moving targets.

The present study attempted to determine if during short-duration movements visual feedback can be processed in order to make adjustments to changes in the environment. The effect that varying the importance of monitoring target position has on the relative importance of vision of hand and vision of target (Carlton 1981a; Whiting and Cockerill 1974) was also examined. Subjects performed short- (150 ms) and longer-duration (330 ms) aimed hand movements under four visual feedback conditions (lights-on/lights-off by target-on/target-off) to stationary and moving targets. For the lights-off and target-off conditions, the lights and target, respectively, were extinguished 50 ms after movement initiation. For all moving-target conditions, the target started to move as the movement was initiated. Subjects were able to process visual information in 165 ms, as movement endpoints were biased in the direction of target motion for movements of this duration. Removing visual feedback 50 ms after movement initiation did not alter this finding. Subjects performed equally well with target and lights on or off, independent of whether the target remained stationary or moved. Presumably, during the first 50 ms of the movement subjects received sufficient visual information to aid in movement control.     

Direction-specific motion thresholds for abnormal image shifts during saccadic eye movement

Eye movements were monitored and a target circle subtending an angle of 7^o was made to move during and dependent on the eye movements. Thresholds of detection of the resulting abnormal image displacements were obtained. Thresholds were low when both the eyes and the target moved either horizontally or vertically. They were higher by a factor of two or more when the eye movements and the target motions were not in the same plane. In the latter conditions, two processes account for the detection of target motion. One is a compensation process where the extent of that component of the motion of the retinal image of the target which is parallel to the eye movement is compared with the extent of the eye movement. The other process detects an angle between the plane of the target image motion and the plane of the eye movement. Our results indicate that the higher thresholds occurred when detection of this angle was required.     

Our Eyes Do Not Always Go Where We Want Them to Go: Capture of the Eyes by New Objects

Observers make rapid eye movements to examine the world around them. Before an eye movement is made, attention is covertly shifted to the location of the object of interest. The eyes typically will land at the position at which attention is directed. Here we report that a goal-directed eye movement toward a uniquely colored object is disrupted by the appearance of a new but task-irrelevant object, unless subjects have a sufficient amount of time to focus their attention on the location of the target prior to the appearance of the new object. In many instances, the eyes started moving toward the new object before gaze started to shift to the color-singleton target. The eyes often landed for a very short period of time (25–150 ms) near the new object. The results suggest parallel programming of two saccades: one voluntary, goal-directed eye movement toward the color-singleton target and one stimulus-driven eye movement reflexively elicited by the appearance of the new object. Neuroanatomical structures responsible for parallel programming of saccades are discussed.     

The role of visual attention in saccadic eye movements

The relationship between saccadic eye movements and covert orienting of visual spatial attention was investigated in two experiments. In the first experiment, subjects were required to make a saccade to a specified location while also detecting a visual target presented just prior to the eye movement. Detection accuracy was highest when the location of the target coincided with the location of the saccade, suggesting that subjects use spatial attention in the programming and/or execution of saccadic eye movements. In the second experiment, subjects were explicitly directed to attend to a particular location and to make a saccade to the same location or to a different one. Superior target detection occurred at the saccade location regardless of attention instructions. This finding shows that subjects cannot move their eyes to one location and attend to a different one. The results of these experiments suggest that visuospatial attention is an important mechanism in generating voluntary saccadic eye movements.     

阅读障碍儿童与其年龄和能力匹配儿童阅读空格文本的注视位置效应

采用EyeLink II眼动仪, 选取阅读障碍儿童及与其年龄相同、阅读能力水平相同的儿童为被试, 要求他们阅读正常无空格和词间空格句子。结果发现, 在阅读正常无空格和词间空格句子时, 阅读障碍儿童与年龄匹配组和能力匹配组儿童一样, 单次注视时往往将首次注视定位于词的中心, 多次注视时首次注视往往落在词的开头; 当首次注视落在词的开头时再注视该词的概率增加, 而且再注视往往落在词的结尾部分。我们认为, 中国儿童在阅读过程中采用的是“战略-战术”策略。