Programming precision in repetitive tapping

The present paper reports an experiment using the Fitts' tapping paradigm. It is concerned with a comparison of movement times and accuracy during blind and visual repetitive tapping. A blind condition was used to investigate rapid aiming movements under motor program control, whilst visual aiming was used to assess the role of visual feedback for control purposes. Subjects in the blind conditions were able to replicate the amplitude specifications of the task, whereas effective target width was constant for a set amplitude and did not reflect specified target width. Subjects, furthermore, responded more rapidly when tapping blind. These results are discussed in terms of the magnitude of forces being attempted as a result of performing a set amplitude, and the role of visual feedback.     

Goal-directed aiming under restricted viewing conditions with confirmatory sensory feedback

A substantial body of research has examined the speed-accuracy tradeoff captured by Fitts’ law, demonstrating increases in movement time that occur as aiming tasks are made more difficult by decreasing target width and/or increasing the distance between targets. Yet, serial aiming movements guided by internal spatial representations, rather than by visual views of targets have not been examined in this manner, and the value of confirmatory feedback via different sensory modalities within this paradigm is unknown. Here we examined goal-directed serial aiming movements (tapping back and forth between two targets), wherein targets were visually unavailable during the task. However, confirmatory feedback (auditory, haptic, visual, and bimodal combinations of each) was delivered upon each target acquisition, in a counterbalanced, within-subjects design. Each participant performed the aiming task with their pointer finger, represented within an immersive virtual environment as a 1 cm white sphere, while wearing a head-mounted display. Despite visual target occlusion, movement times increased in accordance with Fitts’ law. Though Fitts’ law captured performance for each of the sensory feedback conditions, the slopes differed. The effect of increasing difficulty on movement times was least influential in the haptic condition, suggesting more efficient processing of confirmatory haptic feedback during aiming movements guided by internal spatial representations.     

Visual information: The control of aiming movements

The study examined the contribution of various sources of visual information utilised in the control of discrete aiming movements. Subjects produced movements, 15.24 cm in amplitude, to a 1.27 cm target in a movement time of 330 ms. Responses were carried out at five vision-manipulation conditions which allowed the subject complete vision, no vision, vision of only the target or stylus, and a combination of stylus and target. Response accuracy scores indicated that a decrement in performance occurred when movements were completed in the absence of visual information or when only the target was visible during the response. The stylus and the target plus stylus visual conditions led to response accuracy which was comparable to movements produced with complete vision. These results suggest that the critical visual information for aiming accuracy is that of the stylus. These findings are consistent with a control model based on a visual representation of the discrepancy between the position of the hand and the location of the target.     

Combined visual illusion effects on the perceived index of difficulty and movement outcomes in discrete and continuous fitts’ tapping

The speed-accuracy trade-off is a fundamental movement problem that has been extensively investigated. It has been established that the speed at which one can move to tap targets depends on how large the targets are and how far they are apart. These spatial properties of the targets can be quantified by the index of difficulty (ID). Two visual illusions are known to affect the perception of target size and movement amplitude: the Ebbinghaus illusion and Muller-Lyer illusion. We created visual images that combined these two visual illusions to manipulate the perceived ID, and then examined people’s visual perception of the targets in illusory context as well as their performance in tapping those targets in both discrete and continuous manners. The findings revealed that the combined visual illusions affected the perceived ID similarly in both discrete and continuous judgment conditions. However, the movement outcomes were affected by the combined visual illusions according to the tapping mode. In discrete tapping, the combined visual illusions affected both movement accuracy and movement amplitude such that the effective ID resembled the perceived ID. In continuous tapping, none of the movement outcomes were affected by the combined visual illusions. Participants tapped the targets with higher speed and accuracy in all visual conditions. Based on these findings, we concluded that distinct visual-motor control mechanisms were responsible for execution of discrete and continuous Fitts’ tapping. Although discrete tapping relies on allocentric information (object-centered) to plan for action, continuous tapping relies on egocentric information (self-centered) to control for action. The planning-control model for rapid aiming movements is supported.     

Interaction of Perception and Action in Discrete and Continuous Rapid Aiming Tasks

Previously, we have shown that discrete and continuous rapid aiming tasks are governed by distinct visuomotor control mechanisms by assessing the combined visual illusion effects on the perceived and effective index of difficulty (ID). All participants were perceptually biased by the combined visual illusion before they performed the rapid aiming tasks. In the current study, the authors manipulated the order of performing perceptual and motor tasks to examine whether perceptual or motor experience with the illusory visual target would influence the subsequent perceived and effective ID in discrete and continuous tapping tasks. The results supported our hypothesis showing that perceptual experience with the illusory visual target in the discrete condition reduced the effective ID in the subsequent discrete tapping task, and motor experience with the illusory visual target in the continuous condition reduced the illusion effects on the perceived ID in the subsequent perceptual judgment task. The study demonstrates the coinfluence of perception and action, and suggests that perception and action influence one another with different magnitude depending on the spatial frame of reference used to perform the perceptuomotor task.     

The dual role of vision in sequential aiming movements

Previous research has demonstrated that movement times to the first target in sequential aiming movements are influenced by the properties of subsequent segments. Based on this finding, it has been proposed that individual segments are not controlled independently. The purpose of the current study was to investigate the role of visual feedback in the interaction between movement segments. In contrast to past research in which participants were instructed to minimize movement time, participants were set a criterion movement time and the resulting errors and limb trajectory kinematics were examined under vision and no vision conditions. Similar to single target movements, the results indicated that vision was used within each movement segment to correct errors in the limb trajectory. In mediating the transition between segments, visual feedback from the first movement segment was used to adjust the parameters of the second segment. Hence, increases in variability that occurred from the first to the second target in the no vision condition were curtailed when visual feedback was available. These results are discussed along the lines of the movement constraint and movement integration hypotheses.     

Target location effects in tapping tasks

Previous experiments on tracking have shown that target location (measured in terms of the distance of the target from the boundary circumscribing the area of movement) affects the speed and accuracy of movement. The present experiment examined the effects of boundary distance on the speed and accuracy of tapping. Subjects performed on two-, three- and five-position tasks varying in movement amplitude and target width. Results showed that movement time increased, and constant error became more positive as boundary distance increased. These results differed from those found in respect of pursuit tracking in that constant error was affected and not variable error. They increase the generality of the finding that motor performance varies with target location, and they support theories of motor control implicating target location.     

The utilization of visual feedback information during rapid pointing movements

Three experiments were conducted to determine how variables other than movement time influence the speed of visual feedback utilization in a target-pointing task. In Experiment 1, subjects moved a stylus to a target 20 cm away with movement times of approximately 225 msec. Visual feedback was manipulated by leaving the room lights on over the whole course of the movement or extinguishing the lights upon movement initiation, while prior knowledge about feedback availability was manipulated by blocking or randomizing feedback. Subjects exhibited less radial error in the lights-on/blocked condition than in the other three conditions. In Experiment 2, when subjects were forced to use vision by a laterally displacing prism, it was found that they benefited from the presence of visual feedback regardless of feedback uncertainty even when moving very rapidly (e.g. less than 190 msec). In Experiment 3, subjects pointed with and without a prism over a wide variety of movement times. Subjects benefited from vision much earlier in the prism condition. Subjects seem able to use vision rapidly to modify aiming movements but may do so only when the visual information is predictably available and/or yields an error large enough to detect early enough to correct.     

Effects of feedback from active and passive body parts on spatial and temporal parameters in sensorimotor synchronization

Previous research on sensorimotor synchronization has manipulated the somatosensory information received from the tapping finger to investigate how feedback from an active effector affects temporal coordination. The current study explored the role of feedback from passive body parts in the regulation of spatiotemporal motor control parameters by employing a task that required finger tapping on one’s own skin at anatomical locations of varying tactile sensitivity. A motion capture system recorded participants’ movements as they synchronized with an auditory pacing signal by tapping with the right index finger on either their left index fingertip (Finger/Finger) or forearm (Finger/Forearm). Results indicated that tap timing was more variable, and movement amplitude was larger and more variable, when tapping on the finger than when tapping on the less sensitive forearm. Finger/Finger tapping may be impaired relative to Finger/Forearm tapping due to ambiguity arising through overlap in neural activity associated with tactile feedback from the active and the passive limb in the former. To compensate, the control system may strengthen the assignment of tap-related feedback to the active finger by generating correlated noise in movement kinematics and tap dynamics.     

The visual control of aimed hand movements to stationary and moving targets.

The present study attempted to determine if during short-duration movements visual feedback can be processed in order to make adjustments to changes in the environment. The effect that varying the importance of monitoring target position has on the relative importance of vision of hand and vision of target (Carlton 1981a; Whiting and Cockerill 1974) was also examined. Subjects performed short- (150 ms) and longer-duration (330 ms) aimed hand movements under four visual feedback conditions (lights-on/lights-off by target-on/target-off) to stationary and moving targets. For the lights-off and target-off conditions, the lights and target, respectively, were extinguished 50 ms after movement initiation. For all moving-target conditions, the target started to move as the movement was initiated. Subjects were able to process visual information in 165 ms, as movement endpoints were biased in the direction of target motion for movements of this duration. Removing visual feedback 50 ms after movement initiation did not alter this finding. Subjects performed equally well with target and lights on or off, independent of whether the target remained stationary or moved. Presumably, during the first 50 ms of the movement subjects received sufficient visual information to aid in movement control.     

Optimizing the Use of Vision in Manual Aiming: The Role of Practice

The purpose of this study was to determine how subjects learn to adjust the characteristics of their manual aiming movements in order to make optimal use of the visual information and reduce movement error. Subjects practised aiming (120 trials) with visual information available for either 400 msec or 600 msec. Following acquisition, they were transferred to conditions in which visual information was available for either more or less time. Over acquisition, subjects appeared to reduce target-aiming error by moving to the target area more quickly in order to make greater use of vision when in the vicinity of the target. With practice, there was also a reduction in the number of modifications in the movement. After transfer, both performance and kinematic data indicated that the time for which visual information was available was a more important predictor of aiming error than the similarity between training and transfer conditions. These findings are not consistent with a strong “specificity of learning” position. They also suggest that, if some sort of general representation or motor programme develops with practice, that representation includes rules or procedures for the utilization of visual feedback to allow for the on-line adjustment of the goal-directed movement.     

Visual Perception Modifies Goal-directed Movement Control: Supporting Evidence from a Visual Perturbation Paradigm

It is well known that dynamic visual information influences movement control, whereas the role played by background visual information is still largely unknown. Evidence coming mainly from eye movement and manual tracking studies indicates that background visual information modifies motion perception and might influence movement control. The goal of the present study was to test this hypothesis. Subjects had to apply pressure on a strain gauge to displace in a single action a cursor shown on a video display and to immobilize it on a target shown on the same display. In some instances, the visual background against which the cursor moved was unexpectedly perturbed in a direction opposite to (Experiment 1), or in the same direction as (Experiment 2) the cursor controlled by the subject. The results of both experiments indicated that the introduction of a visual perturbation significantly affected aiming accuracy. These results suggest that background visual information is used to evaluate the velocity of the aiming cursor, and that this perceived velocity is fed back to the control system, which uses it for on-line corrections.     

II Sensory feedback influences on keytapping motor tasks

Subjects were trained to tap a key continuously at a specific rate, and with a specific amount of pressure (regularity task). Performance of this task was studied under conditions of: (a) decreased auditory feedback (masking noise through earphones), (b) decreased visual feedback (tapping hand screened from view), (c) vibration (vibrators applied to forearm in order to “mask” proprioceptive feedback), (d) digital block of tapping finger, and (e) combination of all four conditions. Significant changes in rate and intensity of tapping resulted under conditions of decreased auditory feedback, vibration, and the combined condition.

In the second part of the study, the effects of different delayed sensory events on keytapping were examined. The five conditions of delayed sensory feedback were: (a) delayed auditory feedback, (b) delayed visual feedback, (c) delayed tactile feedback, (d) the first three delayed sensory events presented simultaneously, and (e) condition (d) repeated with digital block of the tapping finger.

The conditions of delayed sensory feedback did not markedly alter performance of the regularity task. The same conditions of delayed sensory feedback did, however, produce highly significant changes in the performance of a more complex pattern task. All of these delay conditions produced parallel changes in the pattern task, namely increased intensity and decreased rate of tapping. The fact that the pattern task is more disturbed by delayed sensory feedback than the regularity task suggests that temporal complexity of the task is one determinant of the degree to which it will be disturbed by a delay in sensory feedback.     

Feedback control of hand-movement and Fitts' law

Fitt's empirical result is stated and its information theoretic interpretation briefly discussed. An alternate derivation from a model assuming continous velocity control of hand position is shown to fit the motion time data equally well. Detailed studies of hand motion trajectories in Fitts' reciprocal tapping task have confirmed the exponential target approach predicted by this model but also revealed systematic fluctuations that it cannot explain. A further alternate model is therefore presented, based on intermittent feedback with target approach by a sequence of discrete positional corrective motion “impulses”. The second model also predicts motion times in accord with Fitts' Law.

Detailed studies of target aimed translational hand and rotary wrist motions have shown that the intermittent corrective impulses are of approximately Gaussian integral form, with minimum s.d. on the order of 30 msec. for wrist rotation, and recurrence rate about 10/s. Mechanical and physiological interactions capable of explaining this corrective impulse trajectory are discussed, and a model based on balance of forces between agonist and antagonist muscles is briefly developed. The interaction between external (visual) and internal (proprioceptive or kinaesthetic) feedback channels determining impulse amplitude is discussed in the light of results obtained using force disturbance and with amplified, attenuated or delayed visual feedback. It seems that an internal “secondary positional reference” must be postulated to explain results obtained when S is deprived of visual feedback.     

Adaptation to a Nonlinear Visuomotor Amplitude Transformation With Continuous and Terminal Visual Feedback

The control of a cursor on a computer monitor offers a simple means of exploring the limits of the plasticity of human visuomotor coordination. The authors explored the boundary conditions for adaptation to nonlinear visuomotor amplitude transformations. The authors hypothesized that only with terminal visual feedback during practice, but not with continuous visual feedback, humans might develop an internal model of the nonlinear visuomotor amplitude transformation. Thus, 2 groups were engaged in a sensorimotor adaptation task receiving either continuous or terminal visual feedback during the practice phase. In contrast to expectations, adaptive shifts and aftereffects observed in visual open-loop tests were linearly related to target amplitudes for both groups. Although the 2 feedback groups did not differ with respect to adaptive shifts and aftereffects, terminal visual feedback resulted in stable visual open-loop performance for an extended period, whereas movement errors increased after continuous visual feedback during practice. The benefit of continuous visual feedback, on the other hand, was faster closed-loop performance, indicating an optimization of visual closed-loop control.     

Adaptation to a nonlinear visuomotor amplitude transformation with continuous and terminal visual feedback

The control of a cursor on a computer monitor offers a simple means of exploring the limits of the plasticity of human visuomotor coordination. The authors explored the boundary conditions for adaptation to nonlinear visuomotor amplitude transformations. The authors hypothesized that only with terminal visual feedback during practice, but not with continuous visual feedback, humans might develop an internal model of the nonlinear visuomotor amplitude transformation. Thus, 2 groups were engaged in a sensorimotor adaptation task receiving either continuous or terminal visual feedback during the practice phase. In contrast to expectations, adaptive shifts and aftereffects observed in visual open-loop tests were linearly related to target amplitudes for both groups. Although the 2 feedback groups did not differ with respect to adaptive shifts and aftereffects, terminal visual feedback resulted in stable visual open-loop performance for an extended period, whereas movement errors increased after continuous visual feedback during practice. The benefit of continuous visual feedback, on the other hand, was faster closed-loop performance, indicating an optimization of visual closed-loop control.     

The role of target information on manual-aiming bias

Three experiments were conducted to examine the role of target information in manual aiming. The key manipulations in this experiment were the use of two target contexts (the two forms of the Müller-Lyer illusion) and the visual conditions under which subjects moved. In Experiment 1, we demonstrated that the inward- and outward-pointing arrows biased manual-aiming movements in a manner consistent with their well-known influence on perceptual judgements. The elimination of visual feedback during the aiming movement (Experiment 2), and visual information about the target-aiming layout prior to the movement (Experiment 3) increased the magnitude of the bias. Together, these results demonstrate the strong effect of target information on manual aiming, and specifically, on the movement-planning processes that precede movement.     

The influence of advance information about target location and visual feedback on movement planning and execution.

This study was designed to determine if movement planning strategies incorporating the use of visual feedback during manual aiming are specific to individual movements. Advance information about target location and visual context was manipulated using precues. Participants exhibited a shorter reaction time and a longer movement time when they were certain of the target location and that vision would be available. The longer movement time was associated with greater time after peak velocity. Under conditions of uncertainty, participants prepared for the worst-case scenario. That is, they spent more time organizing their movements and produced trajectories that would be expected from greater open-loop control. Our results are consistent with hierarchical movement planning in which knowledge of the movement goal is an essential ingredient of visual feedback utilization.     

Is voluntary control of natural postural sway possible?

The authors explored whether standing human participants could voluntarily decrease the amplitude of their natural postural sway when presented with explicit visual feedback and a target. Participants (N = 9) stood quietly, without any feedback and with feedback on the center of pressure coordinate or the head orientation. They were unable to decrease sway amplitude when presented with visual feedback and a target. Decreasing target size led to contrasting effects on the 2 fractions of sway: rambling and trembling. The smaller target was associated with a decrease in rambling and an increase in trembling. Those observations suggest that sway represents a superposition of at least 2 independent processes. They also suggest that providing visual feedback on a variable tied to body sway may not be an effective way to decrease postural sway in young healthy people.     

Targets of the memorized position and visual contexts]

The goal of this study was to determine whether a sensorimotor or cognitive encoding is used to encode a target position and save it into iconic memory. The methodology consisted of disrupting a manual aiming movement to a memorized visual target by displacing the visual field containing the target. The nature of the encoding was inferred from the nature and the size of the errors relative to a control. The target was presented either centrally or in the right periphery. Participants moved their hand from the left to the right of fixation. Black and white vertical stripes covered the whole visual field. The visual field was either stationary throughout the trial or was displaced to the right or left at the extinction of the target or at the start of the hand movement. In the latter case, the displacement of the visual field obviously could only be taken into account by the participant during the gesture. In this condition, our hypothesis was that the aiming error would follow the direction of visual field displacement. Results showed three major effects: (1) Vision of the hand during the gesture improved the final accuracy; (2) visual field displacement produced an underestimation of the target distance only when the hand was not visible during the gesture and was always in the same direction displacement; and (3) the effect of the stationary structured visual field on aiming precision when the hand was not visible depended on the distance to the target. These results suggest that a stationary structured visual field is used to support the memory of the target position. The structured visual field is more critical when the hand is not visible and when the target appears in peripheral rather than central vision. This suggests that aiming depends on memory of the relative peripheral position of the target (allocentric reference). However, in the present task, cognitive encoding does not maintain the "position" of the target in memory without reference to the environment. The systematic effect of the visual field displacement on the manual aiming suggests that the role of environmental reference frames in memory for position is not well understood. Some studies, in particular those of Giesbrecht and Dixon (1999) and Glover and Dixon (2001), suggested differing roles of the environment in the retention of the target position and the control of aiming movements toward the target. The present observations contribute to understanding the mechanism involved in locating and grasping objects with the hand.