The utilization of visual feedback information during rapid pointing movements

Three experiments were conducted to determine how variables other than movement time influence the speed of visual feedback utilization in a target-pointing task. In Experiment 1, subjects moved a stylus to a target 20 cm away with movement times of approximately 225 msec. Visual feedback was manipulated by leaving the room lights on over the whole course of the movement or extinguishing the lights upon movement initiation, while prior knowledge about feedback availability was manipulated by blocking or randomizing feedback. Subjects exhibited less radial error in the lights-on/blocked condition than in the other three conditions. In Experiment 2, when subjects were forced to use vision by a laterally displacing prism, it was found that they benefited from the presence of visual feedback regardless of feedback uncertainty even when moving very rapidly (e.g. less than 190 msec). In Experiment 3, subjects pointed with and without a prism over a wide variety of movement times. Subjects benefited from vision much earlier in the prism condition. Subjects seem able to use vision rapidly to modify aiming movements but may do so only when the visual information is predictably available and/or yields an error large enough to detect early enough to correct.     

The utilization of visual information in the control of reciprocal aiming movements

Two experiments examined on-line processing during the execution of reciprocal aiming movements. In Experiment 1, participants used a stylus to make movements between two targets of equal size. Three vision conditions were used: full vision, vision during flight and vision only on contact with the target. Participants had significantly longer movement times and spent more time in contact with the targets when vision was available only on contact with the target. Additionally, the proportion of time to peak velocity revealed that movement trajectories became more symmetric when vision was not available during flight. The data indicate that participants used vision not only to 'home-in' on the current target, but also to prepare subsequent movements. In Experiment 2, liquid crystal goggles provided a single visual sample every 40 ms of a 500 ms duty cycle. Of interest was how participants timed their reciprocal aiming to take advantage of these brief visual samples. Although across participants no particular portion of the movement trajectory was favored, individual performers did time their movements consistently with the onset and offset of vision. Once again, performance and kinematic data indicated that movement segments were not independent of each other.     

Determining the Temporal Limits of a Visual Sample for Visual Regulation

The author examined the minimum amount of time needed for vision to increase aiming accuracy and decrease movement duration. Participants selected when they would receive a visual sample during aiming movements by pressing a switch held with the left hand. The sample was one of the following durations: 40 ms, 30 ms, 20 ms, 10 ms, or 0 ms (no vision). Decreased accuracy in the no-vision condition compared to the vision conditions was observed when the duration of the impending sample was unknown (Experiment 1). Samples 40 ms in duration were sufficient to decrease endpoint variability when the duration of the sample was known before the movement (Experiment 2). These results indicate that short visual samples can be used to decrease movement time and increase accuracy and that knowledge of the impending visual context can impact the individual's subsequent behavior.     

Online versus offline processing of visual feedback in the control of movement amplitude

Researchers have suggested that visual feedback not only plays a role in the correction of errors during movement execution but that visual feedback from a completed movement is processed offline to improve programming on upcoming trials. In the present study, we examined the potential contribution of online and offline processing of visual feedback by analysing spatial variability at various kinematic landmarks in the limb trajectory (peak acceleration, peak velocity, peak negative acceleration and movement end). Participants performed a single degree of freedom video aiming task with and without vision of the cursor under four criterion movement times (225, 300, 375 and 450 ms). For movement times of 225 and 300 ms, the full vision condition was less variable than the no vision condition. However, the form of the variability profiles did not differ between visual conditions suggesting that the contribution of visual feedback was due to offline processes. In the 375 and 450 ms conditions, there was evidence for both online and offline control as the form of the variability profiles differed significantly between visual conditions.     

Visual Feedback of Target Position Affects Accuracy of Sequential Movements at Even Spaces

The role of visual feedback during movement is attributed to its accuracy, but findings regarding the utilization of this information are inconsistent. We developed a novel dot-placing task to investigate the role of vision in arm movements. Participants conducted pointing-like movements between two target stimuli at even spaces. In Experiment 1, visual feedback of targets and response positions was manipulated. Although visual loss of target stimuli hindered accuracy of movements, the absence of the position of previously placed dots had little effect. In Experiment 2, the effect of movement time on accuracy was assessed, as the relationship between these has been traditionally understood as a speed/accuracy trade-off. Results revealed that duration of movement did not impact movement accuracy.     

Monocular and binocular vision in the control of goal-directed movement

In the present research the authors examined the time course of binocular integration in goal-directed aiming and grasping. With liquid-crystal goggles, the authors manipulated vision independently to the right and left eyes of 10 students during movement preparation and movement execution. Contrary to earlier findings reported in catching experiments (I. Olivier, D. J. Weeks, K. L. Ricker, J. Lyons, & D. Elliott, 1998), neither a temporal nor a spatial binocular advantage was obtained in 1 grasping and 2 aiming studies. That result suggests that, at least in some circumstances, monocular vision is sufficient for the precise control of limb movements. In a final aiming experiment involving 3-dimensional spatial variability and no trial-to-trial visual feedback about performance, binocular vision was associated with greater spatial accuracy. Binocular superiority appeared to be most pronounced when participants were unable to adjust their limb control strategy or procedure on the basis of terminal feedback about performance.     

Monocular and Binocular Vision in the Control of Goal-Directed Movement

In the present research the authors examined the time course of binocular integration in goal-directed aiming and grasping. With liquid-crystal goggles, the authors manipulated vision independently to the right and left eyes of 10 students during movement preparation and movement execution. Contrary to earlier findings reported in catching experiments (I. Olivier, D. J. Weeks, K. L. Ricker, J. Lyons, & D. Elliott, 1998), neither a temporal nor a spatial binocular advantage was obtained in 1 grasping and 2 aiming studies. That result suggests that, at least in some circumstances, monocular vision is sufficient for the precise control of limb movements. In a final aiming experiment involving 3-dimen- sional spatial variability and no trial-to-trial visual feedback about performance, binocular vision was associated with greater spatial accuracy. Binocular superiority appeared to be most pronounced when participants were unable to adjust their limb control strategy or procedure on the basis of terminal feedback about performance.     

Goal-Directed Aiming: Correcting a Force-Specification Error With the Right and Left Hands

In 2 experiments, the authors examined manual aiming asymmetries as well as the ability of participants to adjust their aiming trajectories following an unexpected change to the inertial resistance to movement. In Experiment 1, participants (N = 11) were able to rapidly adjust their movement trajectories to conform to the new movement requirements. They were faster and more consistent when aiming with their right hand than with their left hand, regardless of whether or not the movement was perturbed. In Experiment 2, participants' (N = 11) vision of the hand was manipulated so that the role of visual feedback in the corrective process could be examined. Vision had an impact not only on performance but also on the characteristics of the movement trajectories. Manual asymmetries in aiming were associated with a right hand superiority during the final corrective stages of the movement.     

Optimal control strategies under different feedback schedules: kinematic evidence

Two experiments were conducted in which participants (N = 12, Experiment 1; N = 12, Experiment 2) performed rapid aiming movements with and without visual feedback under blocked, random, and alternating feedback schedules. Prior knowledge of whether vision would be available had a significant impact on the strategies that participants adopted. When they knew that vision would be available, less time was spent preparing movements before movement initiation. Participants also reached peak deceleration sooner but spent more time after peak deceleration adjusting limb trajectories. Consistent with those findings, analysis of spatial variability at different points in the trajectory indicated that variability increased up to peak deceleration but then decreased from peak deceleration to the end of the movement.     

Distributed Control in Rapid Sequential Aiming Responses

The preparation and on-line control of short, rapid sequential aiming responses were studied in 3 experiments. Participants (N = 12 in Experiments 1 and 2, and 20 in Experiment 3) produced 3-segment responses (a) within self-initiation, simple reaction time (RT), and choice RT paradigms (Experiment 1); (b) without visual feedback under self-initiation conditions (Experiment 2); and (c) with and without visual feedback under simple RT conditions (Experiment 3). In all conditions in which participants initiated movement in response to an external imperative signal, the 2nd response segment was performed consistently slower than preceding and succeeding response segments. That pattern of segmental movement times was found whether or not visual feedback was available but was not evident when participants self-initiated their responses with or without visual feedback. The findings rule out the possibility that subjects' use of visual feedback is responsible for the slowing of the 2nd response segment under RT conditions and suggest that the programming of rapid sequential aiming responses can be distributed in pre- and postinitiation intervals.     

Kinematic Analyses of Manual Asymmetries in Visual Aiming Movements

The right hand advantage has been thought to arise from the greater efficiency of the right hand/left hemisphere system in processing visual feedback information. This hypothesis was examined using kinematic analyses of aiming performance, focusing particularly on time after peak velocity which has been shown to be sensitive to visual feedback processing demands. Eight right-handed subjects pointed at two targets with their left and right hands with or without vision available and either as accurately or as fast as possible. Pointing errors and movement time were found to be smaller with the right hand. Analyses of the temporal componenets of movement time revealed that the hands differed only in time after peak velocity (in deceleration), with the right hand spending significantly less time. This advantage for the right hand, however, was apparent whether or not vision was available and only when accuracy was emphasized in performance. These findings suggest that the right hand system may be more efficient at processing feedback information whether this be visual or nonvisual (e.g., proprioceptive).     

Coding processes in preselected and constrained movements: effect of vision

Three experiments were conducted in which visual information was manipulated either at the endpoint or during preselected, subject defined and constrained, experimenter-defined movements. In Experiments 1 and 2 the subject's task was to reproduce the movement in the absence of vision. Augmenting the terminal location of the criterion movement with vision had no differential effect on reproduction in Experiment 1, although preselected movement accuracy was significantly superior to constrained. Providing vision throughout the criterion movement in Experiment 2 not only failed to improve the accuracy of constrained movements but decreased reproduction performance in preselected movements. In Experiment 3 procedures were adopted to control the allocation of the subjects' attention during the criterion movement. The subjects reproduced by vision alone, movement alone, or with both visual and movement information available. When subjects were informed of the modality of reproduction prior to criterion presentation, they were able to ignore concurrent input from vision and attend to movement information. In the absence of precues visual information was spontaneously attended. The data were interpreted as contrary to closed-loop assumptions that additional information necessarily enhances the strength of a motor memory representation. Rather, they can be accommodated in terms of Posner, Nissen and Klein's (1976) theoretical account of visual dominance and serve to illustrate the importance of selective attention effects in movement coding.     

The influence of advance information about target location and visual feedback on movement planning and execution.

This study was designed to determine if movement planning strategies incorporating the use of visual feedback during manual aiming are specific to individual movements. Advance information about target location and visual context was manipulated using precues. Participants exhibited a shorter reaction time and a longer movement time when they were certain of the target location and that vision would be available. The longer movement time was associated with greater time after peak velocity. Under conditions of uncertainty, participants prepared for the worst-case scenario. That is, they spent more time organizing their movements and produced trajectories that would be expected from greater open-loop control. Our results are consistent with hierarchical movement planning in which knowledge of the movement goal is an essential ingredient of visual feedback utilization.     

Information entropy and the variability of space-time movement error

The authors investigated the effects of movement time and movement distance on the information entropy and variability of spatial and temporal error in a discrete aiming movement. In Experiment 1, the authors held movement distance (100 mm) constant and manipulated 11 movement times (300-800 ms) of 8 participants. In Experiment 2, the authors tested 6 movement distances at 2 given movement times (15-60 mm at 300 ms; 40-240 mm at 800 ms) in 8 participants. The variability and entropy for spatial error increased with average movement velocity, whereas the variability and entropy for temporal error decreased as a function of average movement velocity. The common variance between variable error and entropy averaged about 84% and 72% for spatial and temporal errors, respectively, suggesting that the probabilistic approach of entropy reveals features that are not present in the standard deviation index of variability. The findings provide further evidence that information entropy may be a useful single-index representation of variability in the movement speed-accuracy relation.     

Online versus offline processing of visual feedback in the production of component submovements

The present authors tested the assumptions in R. S. Woodworth's (1899) 2-component model regarding the specific roles of vision in the production of both the initial impulse and the error-correction phases of movement. Participants (N = 40) practiced a rapid aiming task (1,500 trials), with either no visual feedback, vision of only the 1st 50% of the movement, vision of only the 1st 75% of the movement, or vision of the entire movement. Consistent with previous research, the availability of vision over the 1st half of the movement had no effect on aiming accuracy during acquisition. In contrast, when visual feedback was available over the 1st 75% of the movement and the entire movement, initial impulse endpoints were less variable and the efficiency of the error-correction phase was improved. Analysis of spatial variability at various stages in the movement revealed that participants processed visual feedback offline to improve programming of the initial impulse and processed it online in regulating the deceleration of the initial impulse.     

Visual information: The control of aiming movements

The study examined the contribution of various sources of visual information utilised in the control of discrete aiming movements. Subjects produced movements, 15.24 cm in amplitude, to a 1.27 cm target in a movement time of 330 ms. Responses were carried out at five vision-manipulation conditions which allowed the subject complete vision, no vision, vision of only the target or stylus, and a combination of stylus and target. Response accuracy scores indicated that a decrement in performance occurred when movements were completed in the absence of visual information or when only the target was visible during the response. The stylus and the target plus stylus visual conditions led to response accuracy which was comparable to movements produced with complete vision. These results suggest that the critical visual information for aiming accuracy is that of the stylus. These findings are consistent with a control model based on a visual representation of the discrepancy between the position of the hand and the location of the target.     

The effect of the Müller-Lyer illusion on the planning and control of manual aiming movements

Two experiments used Müller-Lyer stimuli to test the predictions of the planning-control model (S. Glover, 2002) for aiming movements. In Experiment 1, participants aimed to stimuli that either remained the same or changed upon movement initiation. Experiment 2 was identical except that the duration of visual feedback for online control was manipulated. The authors found that the figures visible during movement planning and online control had additive effects on endpoint bias, even when participants had ample time to use visual feedback to modify their movements (Experiment 2). These findings are problematic not only for the planning-control model but also for A. D. Milner and M. A. Goodale's (1995) two visual system explanation of illusory bias. Although our results are consistent with the idea that a single representation is used for perception, movement planning, and online control (e.g., V. H. Franz, 2001), other work from our laboratory and elsewhere suggests that the manner in which space is coded depends on constraints associated with the specific task, such as the visual cues available to the performer.     

Effect of visuomotor calibration and uncertainty on the perception of peripersonal space

Target selection for action depends not only on the egocentric location of objects estimated from retinal and extraretinal variables, but also on the assessment of current action possibilities. In the present study, we investigated the effect of altering sensorimotor anticipation processes on subsequent perceptual estimates of reachability. To do so, we conducted two experiments in which we changed the relation between visual distance and movement amplitude. Experiment 1 showed that iterative visuomotor adaptation to distorted visual feedback (in steps of ±15?mm, up to a total adaptation of ±75?mm) led to a congruent variation of perceived reachable space, although the first introduction of the shifted visual feedback produced a reduction of perceived reachable space whatever the direction of the feedback shift. Experiment 2 showed that increasing uncertainty about visuomotor performances, by providing a visual feedback randomly shifted in depth (±7.5?mm), produced the same reduction of perceived reachable space in the absence of visuomotor adaptation. Taken together, these data suggest that the visual perception of reachable space depends on a motor-related perceptual system, which is affected by both visuomotor recalibration and reliability of the visuomotor system.     

The utilization of visual information in the control of rapid sequential aiming movements.

Two experiments were conducted to examine the role of vision in the execution of a movement sequence. Experiment 1 investigated whether individual components of a sequential movement are controlled together or separately. Participants executed a rapid aiming movement to two targets in sequence. A full vision condition was compared to a condition in which vision was eliminated while in contact with the first target. The size of the first target was constant, while the second target size was varied. Target size had an influence on movement time and peak velocity to the first target. Vision condition and target size did not affect the time spent on the first target. These results suggest that preparation of the second movement is completed before the first movement is terminated. Experiment 2 examined when this preparation occurred. A full vision condition was compared to a condition in which vision was occluded during the flight phase of the first movement. Movement initiation times were shorter when vision was continually available. Total movement time was reduced with vision in two-target condition, but not in a control one-target condition. The time spent on the first target was greater when vision was not available during the first movement component. The results indicate that vision prior to movement onset can be used to formulate a movement plan to both targets in the sequence [Fischman & Reeve (1992).     

Online Versus Offline Processing of Visual Feedback in the Production of Component Submovements

The present authors tested the assumptions in R. S. Woodworth's (1899) 2-component model regarding the specific roles of vision in the production of both the initial impulse and the error-correction phases of movement. Participants (N = 40) practiced a rapid aiming task (1,500 trials), with either no visual feedback, vision of only the 1st 50% of the movement, vision of only the 1st 75% of the movement, or vision of the entire movement. Consistent with previous research, the availability of vision over the 1st half of the movement had no effect on aiming accuracy during acquisition. In contrast, when visual feedback was available over the 1st 75% of the movement and the entire movement, initial impulse endpoints were less variable and the efficiency of the error-correction phase was improved. Analysis of spatial variability at various stages in the movement revealed that participants processed visual feedback offline to improve programming of the initial impulse and processed it online in regulating the deceleration of the initial impulse.