Coupling of eye, finger, elbow, and shoulder movements during manual aiming

Temporal and spatial coupling of point of gaze (PG) and movements of the finger, elbow, and shoulder during a speeded aiming task were examined. Ten participants completed 40-cm aiming movements with the right arm, in a situation that allowed free movement of the eyes, head, arm, and trunk. On the majority of trials, a large initial saccade undershot the target slightly, and 1 or more smaller corrective saccades brought the eyes to the target position. The finger, elbow, and shoulder exhibited a similar pattern of undershooting their final positions, followed by small corrective movements. Eye movements usually preceded limb movements, and the eyes always arrived at the target well in advance of the finger. There was a clear temporal coupling between primary saccade completion and peak acceleration of the finger, elbow, and shoulder. The initiation of limb-segment movement usually occurred in a proximal-to-distal pattern. Increased variability in elbow and shoulder position as the movement progressed may have served to reduce variability in finger position. The spatial-temporal coupling of PG with the 3 limb segments was optimal for the pick up of visual information about the position of the finger and the target late in the movement.     

Coupling of Eye,Finger, Elbow,and Shoulder Movements During Manual Aiming

Temporal and spatial coupling of point of gaze (PG) and movements of the finger, elbow, and shoulder during a speeded aiming task were examined. Ten participants completed 40-cm aiming movements with the right arm, in a situation that allowed free movement of the eyes, head, arm, and trunk. On the majority of trials, a large initial saccade undershot the target slightly, and 1 or more smaller corrective saccades brought the eyes to the target position. The finger, elbow, and shoulder exhibited a similar pattern of undershooting their final positions, followed by small corrective movements. Eye movements usually preceded limb movements, and the eyes always arrived at the target well in advance of the finger. There was a clear temporal coupling between primary saccade completion and peak acceleration of the finger, elbow, and shoulder. The initiation of limb-segment movement usually occurred in a proximal-to-distal pattern. Increased variability in elbow and shoulder position as the movement progressed may have served to reduce variability in finger position. The spatial-temporal coupling of PG with the 3 limb segments was optimal for the pick up of visual information about the position of the finger and the target late in the movement.     

Rapid aimed limb movements: differential effects of practice on component submovements

Three experiments are reported in which subjects practiced rapid aimed limb movements (arm pointing and wrist rotation) toward a visible target region. Subjects were required to minimize their movement durations while still landing in the target. The movement trajectories were examined to assess the effects of practice on separate component submovements of the limb movements. The results revealed that practice improved primarily temporal, not spatial, aspects of performance. Practice reduced the overall movement durations, but had different effects on the individual submovements. Practice allowed subjects to reduce the amount of time spent performing final corrective submovements, but actually increased slightly the time needed to produce the initial ballistic submovement. The results suggest that practice in the present task primarily enhanced the ability to use feedback information, but there was also some evidence of changes in the ballistic, preprogrammed portion of the movements. The results demonstrate that analysis of submovements can reveal important details of the underlying motor control processes.     

Rapid Aimed Limb Movements: Differential Effects of Practice on Component Submovements

Three experiments are reported in which subjects practiced rapid aimed limb movements (arm pointing and wrist rotation) toward a visible target region. Subjects were required to minimize their movement durations while still landing in the target. The movement trajectories were examined to assess the effects of practice on separate component submovements of the limb movements. The results revealed that practice improved primarily temporal, not spatial, aspects of performance. Practice reduced the overall movement durations, but had different effects on the individual submovements: Practice allowed subjects to reduce the amount of time spent performing final corrective submovements, but actually increased slightly the time needed to produce the initial ballistic submovement. The results suggest that practice in the present task primarily enhanced the ability to use feedback information, but there was also some evidence of changes in the ballistic, preprogrammed portion of the movements. The results demonstrate that analysis of submovements can reveal important details of the underlying motor control processes.     

The effects of temporal-precision and time-minimization constraints on the spatial and temporal accuracy of aimed hand movements

Discrete aimed hand movements, made by subjects given temporal-accuracy and time-minimization task instructions, were compared. Movements in the temporal-accuracy task were made to a point target with a goal movement time of 400 ms. A circular target then was manufactured that incorporated the measured spatial errors from the temporal-accuracy task, and subjects attempted to contact the target with a minimum movement time and without missing the circular target (time-minimization task instructions). This procedure resulted in equal movement amplitude and approximately equal spatial accuracy for the two task instructions. Movements under the time-minimization instructions were completed rapidly (M = 307 ms) without target misses, and tended to be made up of two submovements. In contrast, movements under temporal-accuracy instructions were made more slowly (M = 397 ms), matching the goal movement time, and were typically characterized by a single submovement. These data support the hypothesis that movement times, at a fixed movement amplitude versus target width ratio, decrease as the number of submovements increases, and that movements produced under temporal-accuracy and time-minimization have different control characteristics. These control differences are related to the linear and logarithmic speed-accuracy relations observed for temporal-accuracy and time-minimization tasks, respectively.     

Information entropy analysis of discrete aiming movements

Information entropy and mutual information were investigated in discrete movement aiming tasks over a wide range of spatial (20-160 mm) and temporal (250-1250 ms) constraints. Information entropy was calculated using two distinct analyses: (1) with no assumption on the nature of the data distribution; and (2) assuming the data have a normal distribution. The two analyses showed different results in the estimate of entropy that also changed as a function of task goals, indicating that the movement trajectory data were not from a normal distribution. It was also found that the information entropy of the discrete aiming movements was lower than the task defined indices of difficulty (ID) that were selected for the congruence with Fitts' law. Mutual information between time points of the trajectory was strongly influenced by the average movement velocity and the acceleration/deceleration segments of the movement. The entropy analysis revealed structure to the variability of the movement trajectory and outcome that has been masked by the traditional distributional analyses of discrete aiming movements.     

Movement substructures change as a function of practice in children and adults

An experiment is reported in which participants at 6 (n = 20), 9 (n = 20), and 24 years (n = 20) of age either received or did not receive practice on a rapid aiming task using the arm and hand. The purpose of the experiment was to document the changes in movement substructures (in addition to movement time) as a function of practice. After receiving 10 baseline trials, subjects in the practice groups received 30 practice trials followed by 10 retention trials on each of 5 days, while subjects in the no-practice group had only baseline and retention trials. Retention-only trials were divided into primary (reflecting the ballistic controlled part of the movement) and secondary (reflecting corrective movement adjustments) submovements. In addition, jerk (the 3rd derivative of movement displacement) was calculated as an estimate of the smoothness of the movement. Participants increased the primary submovement as a function of practice; however, the increases were substantially larger in the children (25-30%) than in the adults (10%). Participants also decreased jerk as a function of practice and the decreases were greater in children than in adults. The results suggest that with practice the primary submovement is lengthened so that it ends nearer the target, especially in children. Associated with the primary submovement covering a larger percentage of the movement length and time, movements became smoother.     

Eye-hand coordination in goal-directed aiming.

In a number of studies, we have demonstrated that the spatial-temporal coupling of eye and hand movements is optimal for the pickup of visual information about the position of the hand and the target late in the hand's trajectory. Several experiments designed to examine temporal coupling have shown that the eyes arrive at the target area concurrently with the hand achieving peak acceleration. Between the time the hand reached peak velocity and the end of the movement, increased variability in the position of the shoulder and the elbow was accompanied by a decreased spatial variability in the hand. Presumably, this reduction in variability was due to the use of retinal and extra-retinal information about the relative positions of the eye, hand and target. However, the hand does not appear to be a slave to the eye. For example, we have been able to decouple eye movements and hand movements using Müller-Lyer configurations as targets. Predictable bias, found in primary and corrective saccadic eye movements, was not found for hand movements, if on-line visual information about the target was available during aiming. That is, the hand remained accurate even when the eye had a tendency to undershoot or overshoot the target position. However, biases of the hand were evident, at least in the initial portion of an aiming movement, when vision of the target was removed and vision of the hand remained. These findings accent the versatility of human motor control and have implications for current models of visual processing and limb control.     

Task specificity and the timing of discrete aiming movements

In discrete aiming movements the task criteria of time-minimization to a spatial target (e.g., Fitts, 1954) and time-matching to a spatial-temporal goal (e.g., Schmidt et al., 1979) tend to produce different functions of the speed-accuracy trade-off. Here we examined whether the task-related movement speed-accuracy characteristics were due to differential space-time trade-offs in time-matching, velocity-matching and time-minimizing task goals. Twenty participants performed 100 aiming trials for each of 15 combinations of task-type (3) and space-time condition (5). The prevalence of the primary types of sub-movement (none, pre-peak, post-peak, undershooting and overshooting) was determined from the kinematics of the movement trajectory. There were comparable distributions of trajectory sub-movement profiles and space-time movement outcomes across the three tasks at the short movement duration that became increasingly dissimilar over decreasing movement velocity and increasing movement time conditions. Movement time was the most influential variable in mediating sub-movement characteristics and the spatial/temporal outcome accuracy and variability of discrete aiming tasks – a role that was magnified in the explicit task demands of time-matching. The time-matching and time-minimization task goals in discrete aiming induce qualitatively different control processes that progressively contribute beyond the minimal time conditions to task-specific space-time accuracy and variability characteristics of the respective movement speed-accuracy functions.     

Goal-directed aiming under restricted viewing conditions with confirmatory sensory feedback

A substantial body of research has examined the speed-accuracy tradeoff captured by Fitts’ law, demonstrating increases in movement time that occur as aiming tasks are made more difficult by decreasing target width and/or increasing the distance between targets. Yet, serial aiming movements guided by internal spatial representations, rather than by visual views of targets have not been examined in this manner, and the value of confirmatory feedback via different sensory modalities within this paradigm is unknown. Here we examined goal-directed serial aiming movements (tapping back and forth between two targets), wherein targets were visually unavailable during the task. However, confirmatory feedback (auditory, haptic, visual, and bimodal combinations of each) was delivered upon each target acquisition, in a counterbalanced, within-subjects design. Each participant performed the aiming task with their pointer finger, represented within an immersive virtual environment as a 1 cm white sphere, while wearing a head-mounted display. Despite visual target occlusion, movement times increased in accordance with Fitts’ law. Though Fitts’ law captured performance for each of the sensory feedback conditions, the slopes differed. The effect of increasing difficulty on movement times was least influential in the haptic condition, suggesting more efficient processing of confirmatory haptic feedback during aiming movements guided by internal spatial representations.     

Distribution of Programming in a Rapid Aimed Sequential Movement

Studies indicate that rapid sequential movements are preprogrammed and that preprogramming increases with complexity, but more complex sequences that require on-line programming have seldom been studied. The purpose of this investigation was to determine whether on-line programming occurs in a 7-target sequence in which there is a unique target constraint and if so, to determine how different task constraints affect the distribution of additional programming. Subjects contacted seven targets with a hand-held stylus as quickly as possible while maintaining a 90% hit rate. Initiation- and execution-timing patterns and movement kinematics were measured to determine when the additional programming took place. Results indicated that additional programming occurred before initiation and during movement to the first target when the constraint required more spatial accuracy (small target). A different type of unique target (a triple hit of one target) caused the additional programming to occur on-line one or two segments before its execution. Different positions of the unique target also affected timing patterns. Results were discussed in terms of: (1) capacity of processing; (2) control of movement variance; and (3) mean velocity as a programmed parameter in sequential aiming movements.     

Control of Rapid Arm Movements When Target Position Is Altered During Saccadic Suppression

This experiment examined whether rapid arm movements can be corrected in response to a change in target position that occurs just prior to movement onset, during saccadic suppression of displacement. Because the threshold of retinal input reaches its highest magnitude at that time, displacement of the visual target of a saccade is not perceived. Subjects (N = 6) were instructed to perform very rapid arm movements toward visual targets located 16, 20, and 24 degrees from midline (on average, movement time was 208 ms). On some trials the 20 degrees target was displaced 4 degrees either to the right or to the left during saccadic suppression. For double-step trials, arm movements did not deviate from their original trajectory. Movement endpoints and movement structure (i.e., velocity-and acceleration-time profiles) were similar whether or not target displacements occurred, showing the failure of proprioceptive signals or internal feedback loops to correct the arm trajectory. Following this movement, terminal spatially oriented movements corrected the direction of the initial movement (as compared with the single-step control trials) when the target eccentricity decreased by 4 degrees. Subjects were unaware of these spatial corrections. Therefore, spatial corrections of hand position were driven by the goal level of the task, which was updated by oculomotor corrective responses when a target shift occurred.     

Movement structure in young and elderly adults during goal-directed movements of the left and right arm

Elderly adults often exhibit performance deficits during goal-directed movements of the dominant arm compared with young adults. Recent studies involving hemispheric lateralization have provided evidence that the dominant and non-dominant hemisphere-arm systems are specialized for controlling different movement parameters and that hemispheric specialization may be reduced during normal aging. The purpose was to examine age-related differences in the movement structure for the dominant (right) and non-dominant (left) during goal-directed movements. Young and elderly adults performed 72 aiming movements as fast and as accurately as possible to visual targets with both arms. The findings suggest that previous research utilizing the dominant arm can be generalized to the non-dominant arm because performance was similar for the two arms. However, as expected, the elderly adults showed shorter relative primary submovement lengths and longer relative primary submovement durations, reaction times, movement durations, and normalized jerk scores compared to the young adults.     

Control of velocity and position in single joint movements

Previous research on single joint movements has lead to the development of models of control that propose that movement speed and distance are controlled through an initial pulsatile signal that can be modified in both amplitude and duration. However, the manner in which the amplitude and duration are modulated during the control of movement remains controversial. We now report two studies that were designed to differentiate the mechanisms used to control movement speed from those employed to control final position accuracy. In our first study, participants move at a series of speeds to a single spatial target. In this task, acceleration duration (pulse-width) varied substantially across speeds, and was negatively correlated with peak acceleration (pulse-height). In a second experiment, we removed the spatial target, but required movements at the three speeds similar to those used in the first study. In this task, acceleration amplitude varied extensively across the speed targets, while acceleration duration remained constant. Taken together, our current findings demonstrate that pulse-width measures can be modulated independently from pulse-height measures, and that a positive correlation between such measures is not obligatory, even when sampled across a range of movement speeds. In addition, our findings suggest that pulse-height modulation plays a primary role in controlling movement speed and specifying target distance, whereas pulse-width mechanisms are employed to correct errors in pulse-height control, as required to achieve spatial precision in final limb position.     

Sequential aiming with one and two limbs: Effects of target size

It is well reported that movement times to the first target in a two-target sequence are slower than when a single target response is required. This one-target advantage has been shown to emerge when the two-target sequence is performed with the same limb and when the first and second segments within the sequence are performed with different limbs (i.e., when there is a switch between limbs at the first target). The present study examined the functional dependency between response segments in both single and two limb sequential aiming by varying the accuracy demands at the first and second target. Results revealed that, for both one and two limb conditions, the one-target advantage was present with large first targets but not with small first targets. Additionally, when the first target was large and the second target was small, spatial variability at the first target was significantly less (or constrained more) in both one and two limb conditions compared to conditions requiring only a single target response. These findings suggest that similar principles underlie the one-target advantage in both single and two limb sequential movements.     

A program for parsing mouse movements into component submovements

Most current movement control theories include the idea that movement toward a target can be broken into several submovements. The complexity of analyzing a movement into its constituent submovement structure and the additional complexity imposed by the problem of noise in the data and hand tremor seem to be daunting to researchers. This paper discusses a program that can ameliorate both of these problems and parse movements into their constituent submovements. It also contains a graphing feature that is useful as a visual tool for analyzing submovement structure. The programs are easily modifiable, so that researchers can specify their own parsing rules on the basis of different assumptions about movement control and use the parser for data from different experimental tasks.     

On the role of peripheral visual afferent information for the control of rapid video-aiming movements

It has been shown that, even for very fast and short duration movements, seeing one's hand in peripheral vision, or a cursor representing it on a video screen, resulted in a better direction accuracy of a manual aiming movement than when the task was performed while only the target was visible. However, it is still unclear whether this was caused by on-line or off-line processes. Through a novel series of analyses, the goal of the present study was to shed some light on this issue. We replicated previous results showing that the visual information concerning one's movement, which is available between 40 degrees and 25 degrees of visual angle, is not useful to ensure direction accuracy of video-aiming movements, whereas visual afferent information available between 40 degrees and 15 degrees of visual angle improved direction accuracy over a target-only condition. In addition, endpoint variability on the direction component of the task was scaled to direction variability observed at peak movement velocity. Similar observations were made in a second experiment when the position of the cursor was translated to the left or to the right as soon as it left the starting base. Further, the data showed no evidence of on-line correction to the direction dimension of the task for the translated trials. Taken together, the results of the two experiments strongly suggest that, for fast video-aiming movements, the information concerning one's movement that is available in peripheral vision is used off-line.     

Visual regulation of manual aiming: A comparison of methods

Visual regulation of upper limb movements occurs throughout the trajectory and is not confined to discrete control in the target area. Early control is based on the dynamic relationship between the limb, the target, and the environment. Despite robust outcome differences between protocols involving visual manipulations, it remains difficult to identify the kinematic events that characterize these differences. In this study, participants performed manual aiming movements with and without vision. We compared several traditional approaches to movement analysis with two new methods of quantifying online limb regulation. As expected, participants undershot the target and their movement endpoints were more variable when vision was not available. Although traditional measures such as reaction time, time after peak velocity, and the presence of discontinuities in acceleration were sensitive to the visual manipulation, measures quantifying the trial-to-trial spatial variability throughout the trajectory were the most effective in isolating the time course of online regulation.     

Movement duration does not affect automatic online control

Pisella et al. (2000) have shown that fast aiming movements are automatically modified on-line in response to a change in target position. Specifically, when a movement is less than 300 ms in duration the reach is completed to a target’s new location even when one never intended to respond to the target jump. In contrast, when movements are slower, the reach is completed according to instructions. At present, it is unclear if it is possible for one’s intentions to guide the initial stages of these slow movements. To determine if the intentional control mechanism can guide the initial stages of a slow aiming movement, participants aimed to targets that could jump at movement onset, with a slow and very slow movement time goal. In particular, participants were to point towards (“pro-point”) or away from (“anti-point”) the target jump, with a movement time goal of 500 or 1200 ms. Results showed that in the anti-point condition, movement trajectories first deviated in the same direction as the target jump, followed by a response in the intended (opposite) direction. This suggests that while movement outcome is controlled by the intentional system, even in these slow aiming movements the automatic system is engaged at movement onset.     

A visual representation and the control of manual aiming movements

Three experiments were conducted to determine if a representation of the movement environment is functional in the organization and control of limb movements, when direct visual contact with the environment is prevented. In Experiment 1, a visual rearrangement procedure was employed to show that a representation of the environment that provides inaccurate information about the spatial location of a target can disrupt manual target aiming. In Experiment 2, we demonstrated that spatial information about the position of a target can be destroyed by a visual pattern mask, supporting our claim that the representation is visual. A target-cuing procedure was used in Experiment 3 to show that representation of target position can be useful for premovement organization in a target-aiming task. Together our findings suggest that a short-lived visual representation of the movement environment may serve a useful role in the organization and control of limb movements.