Nonlinear visuomotor transformations: Locus and modularity

Participants in two experiments moved a mouse-like device to the right to move a cursor on a computer screen to a target position. The cursor was invisible during motion but reappeared at the end of each movement. The relationship between the amplitudes of the cursor movement and the mouse movement was exponential in Experiment 1 and logarithmic in Experiment 2 for two groups of participants, while it was linear for the control groups in both experiments. The results of both experiments indicate that participants adjusted well to the external transformation by developing an internal model that approximated the inverse of the external transformation. We introduce a method to determine the locus of the internal model. It indicates that the internal model works at a processing level that either preceded specification of movement amplitude, or had become part of movement amplitude specification. Limited awareness of the nonlinear mouse–cursor relationship and the fact that a working-memory task had little effect on performance suggest that the internal model is modular and not dependent on high-level cognitive processes.     

Colour correspondence effects between controlled objects and targets

It is increasingly popular to use movement trajectories as a measure of mental processes related to task performance. Often this is accomplished by moving a cursor to a target on a computer screen. However, the relation between features of the cursor and the targets is rarely, if at all, considered. In five experiments, we examined whether moving a cursor to a target was affected by the relation between their colours, even when this relation was task irrelevant. In Experiments 1–3, a mouse-controlled cursor was moved to one of two coloured targets. Results showed colour correspondence effects in latency to initiate a response, duration of movement times, and movement trajectories when the relationship between cursor and target colours was task relevant (Experiment 1) and when only the cursor colour was task relevant (Experiment 2), but not when only the target was task relevant (Experiment 3). Follow-up experiments using single targets showed that colour correspondence effects occurred as long as attention was dedicated to the colour of the cursor, even when neither the cursor nor the target colour was relevant to selecting the correct movement (Experiments 4 and 5). Furthermore, when the relation between cursor and target colours is task irrelevant, colour correspondence effects for response initiation times are uncorrelated with those for movement times and movement trajectories. We interpret the observed correspondence effect in terms of response coding, although attention cueing may also play a role, and suggest that greater consideration of cursor features is needed when examining movement trajectories in choice reaction tasks.     

Colour correspondence effects between controlled objects and targets

It is increasingly popular to use movement trajectories as a measure of mental processes related to task performance. Often this is accomplished by moving a cursor to a target on a computer screen. However, the relation between features of the cursor and the targets is rarely, if at all, considered. In five experiments, we examined whether moving a cursor to a target was affected by the relation between their colours, even when this relation was task irrelevant. In Experiments 1-3, a mouse-controlled cursor was moved to one of two coloured targets. Results showed colour correspondence effects in latency to initiate a response, duration of movement times, and movement trajectories when the relationship between cursor and target colours was task relevant (Experiment 1) and when only the cursor colour was task relevant (Experiment 2), but not when only the target was task relevant (Experiment 3). Follow-up experiments using single targets showed that colour correspondence effects occurred as long as attention was dedicated to the colour of the cursor, even when neither the cursor nor the target colour was relevant to selecting the correct movement (Experiments 4 and 5). Furthermore, when the relation between cursor and target colours is task irrelevant, colour correspondence effects for response initiation times are uncorrelated with those for movement times and movement trajectories. We interpret the observed correspondence effect in terms of response coding, although attention cueing may also play a role, and suggest that greater consideration of cursor features is needed when examining movement trajectories in choice reaction tasks.     

Visual Perception Modifies Goal-directed Movement Control: Supporting Evidence from a Visual Perturbation Paradigm

It is well known that dynamic visual information influences movement control, whereas the role played by background visual information is still largely unknown. Evidence coming mainly from eye movement and manual tracking studies indicates that background visual information modifies motion perception and might influence movement control. The goal of the present study was to test this hypothesis. Subjects had to apply pressure on a strain gauge to displace in a single action a cursor shown on a video display and to immobilize it on a target shown on the same display. In some instances, the visual background against which the cursor moved was unexpectedly perturbed in a direction opposite to (Experiment 1), or in the same direction as (Experiment 2) the cursor controlled by the subject. The results of both experiments indicated that the introduction of a visual perturbation significantly affected aiming accuracy. These results suggest that background visual information is used to evaluate the velocity of the aiming cursor, and that this perceived velocity is fed back to the control system, which uses it for on-line corrections.     

The Effects of Screen Refresh Rate on Editing Operations Using a Computer Mouse Pointing Device

Two experiments are described in which subjects attempted to locate a specified target word in a short text using a cursor controlled by a computer mouse pointing device. The task was performed at screen refresh rates of 50 Hz, 75 Hz, and 100 Hz. In Experiment 1, both the timing and accuracy of the cursor movement was influenced by screen pulsation. During the early phase of the movement, performance was worse at 100 Hz, whereas in the later, visually guided phase, performance was worse at 50 Hz. In Experiment 2, eye movements were recorded as the task was performed. The results show that the cursor movement is typically preceded by an eye movement and that subjects do not directly inspect the cursor in the early stages of its movement. In the later phase of the movement the cursor is tracked for considerable periods of time. The data suggest that adverse effects of screen pulsation on the control of cursor movement are inherited from penalties incurred during the process of target computation but may also be influenced by concurrent eye movements.     

Adaptation to a Nonlinear Visuomotor Amplitude Transformation With Continuous and Terminal Visual Feedback

The control of a cursor on a computer monitor offers a simple means of exploring the limits of the plasticity of human visuomotor coordination. The authors explored the boundary conditions for adaptation to nonlinear visuomotor amplitude transformations. The authors hypothesized that only with terminal visual feedback during practice, but not with continuous visual feedback, humans might develop an internal model of the nonlinear visuomotor amplitude transformation. Thus, 2 groups were engaged in a sensorimotor adaptation task receiving either continuous or terminal visual feedback during the practice phase. In contrast to expectations, adaptive shifts and aftereffects observed in visual open-loop tests were linearly related to target amplitudes for both groups. Although the 2 feedback groups did not differ with respect to adaptive shifts and aftereffects, terminal visual feedback resulted in stable visual open-loop performance for an extended period, whereas movement errors increased after continuous visual feedback during practice. The benefit of continuous visual feedback, on the other hand, was faster closed-loop performance, indicating an optimization of visual closed-loop control.     

Adaptation to a nonlinear visuomotor amplitude transformation with continuous and terminal visual feedback

The control of a cursor on a computer monitor offers a simple means of exploring the limits of the plasticity of human visuomotor coordination. The authors explored the boundary conditions for adaptation to nonlinear visuomotor amplitude transformations. The authors hypothesized that only with terminal visual feedback during practice, but not with continuous visual feedback, humans might develop an internal model of the nonlinear visuomotor amplitude transformation. Thus, 2 groups were engaged in a sensorimotor adaptation task receiving either continuous or terminal visual feedback during the practice phase. In contrast to expectations, adaptive shifts and aftereffects observed in visual open-loop tests were linearly related to target amplitudes for both groups. Although the 2 feedback groups did not differ with respect to adaptive shifts and aftereffects, terminal visual feedback resulted in stable visual open-loop performance for an extended period, whereas movement errors increased after continuous visual feedback during practice. The benefit of continuous visual feedback, on the other hand, was faster closed-loop performance, indicating an optimization of visual closed-loop control.     

The effects of mechanical transparency on adjustment to a complex visuomotor transformation at early and late working age

Mechanical tools are transparent in the sense that their input-output relations can be derived from their perceptible characteristics. Modern technology creates more and more tools that lack mechanical transparency, such as in the control of the position of a cursor by means of a computer mouse or some other input device. We inquired whether an enhancement of transparency by means of presenting the shaft of a virtual sliding lever, which governed the transformation of hand position into cursor position, supports performance of aimed cursor movement and the acquisition of an internal model of the transformation in both younger and older adults. Enhanced transparency resulted in an improvement of visual closed-loop control in terms of movement time and curvature of cursor paths. The movement-time improvement was more pronounced at older working age than at younger working age, so that the enhancement of transparency can serve as a means to mitigate age-related declines in performance. Benefits for the acquisition of an internal model of the transformation and of explicit knowledge were absent. Thus, open-loop control in this task did not profit from enhanced mechanical transparency. These findings strongly suggest that environmental support of transparency of the effects of input devices on controlled systems might be a powerful tool to support older users. Enhanced transparency may also improve simulator-based training by increasing motivation, even if training benefits do not transfer to situations without enhanced transparency.     

Evidence for internal representation of a static nonlinearity in a visual tracking task

A group of 24 participants was given over 3 h practice at a visual pursuit tracking task with a pronounced static nonlinearity between movement of the joystick and the resulting deflection of the response cursor. The aim was twofold: (1) to determine whether or not participants compensated for the nonlinearity and (2) to show that any such compensation involved the formation of an internal representation of the nonlinear relationship between movement of the joystick as sensed kinaesthetically and/or visually and movement of the response cursor as sensed visually. Results show that participants introduce partial compensation for the static nonlinearity. Furthermore, partial compensation was present even during open-loop tracking when participants were deprived of visual feedback of the position of the response cursor. This implies that participants are able to form an internal representation of the nonlinear relationship between movement of the joystick and the resulting movement of the response cursor.     

The independence of recall and recognition in motor learning

A basic tenet of both current closed-loop theories of motor learning (Adams, 1971; Schmidt, 1975) is that the generation of response specifications during learning is required for the development of recall memory. Two experiments were performed to test this tenet by attempting to demonstrate the development of recall memory in the absence of response specification production. The task in both experiments required blindfolded subjects to learn to produce a rapid, novel criterion movement on a linear positioning device. Control subjects in both experiments actively produced movements during learning with knowledge of results (KR) while experimental subjects in Experiment 1 experienced only the endpoint locations and in Experiment 2 were passively moved to the endpoint locations. Following initial KR trials, both experimental and control groups attempted to actively produce the criterion movement in the absence of KR. The results of both experiments support closed-loop theory that active practice is required to develop recall memory. There was some suggestion, however, that passive experience with sensory feedback may also aid recall memory development, contrary to the two closed-loop theories.     

Stimulus-response compatibility with wheel-rotation responses: Will an incompatible response coding be used when a compatible coding is possible?

Three experiments were conducted in which subjects responded to left-right tones with clockwise-counterclockwise rotations of a steering wheel using one of two stimulus-response assignments. When the hands were at the bottom of the wheel, where hand movement is opposite to wheel movement, subjects coded responses according to the frame that yielded a compatible mapping when the instructions did not emphasize either hand or wheel movements (Experiment 1). When instructions emphasized hand movements, responses were coded relative to the hand-referenced frame (Experiment 2), and when the wheel controlled a visual cursor, responses were coded relative to a cursor-referenced frame (Experiment 3). Coding with respect to these frames occurred even when the resulting mapping was incompatible.     

An internal focus of attention is optimal when congruent with afferent proprioceptive task information

Whilst benefits of an external focus are shown to govern several characteristics of skill execution, specificity theory indicates that sources of afferent information most useful to performance execution are typically prioritised during processing.ObjectivesWe investigated whether an internal focus facilitates performance when pertinent afferent information is proprioceptive in nature and congruent with attentional focus. We also considered whether the mechanisms behind attentional focus differences are attributable to planning processes or online motor control.DesignExperiments 1 and 2 adopted a randomised design, whilst experiment 3 used a repeated measures approach.MethodIn Experiment 1 we investigated movement variability as a measure of planning and error correction under external and internal focus conditions in an aiming task. Experiment 2 removed visual information to increase pertinence of proprioceptive feedback for movement execution and Experiment 3 adopted a leg-extension task, where proprioceptive salience was enhanced using an ankle weight. We hypothesised that this would increase congruency between internal focus instructions and movement production.ResultsExperiments 1 and 2 revealed reduced amplitude errors under an internal focus whilst Experiment 3 showed similar findings with the addition of lower EMG activity when adopting an internal focus. Movement variability findings were indicative of enhanced planning.ConclusionsWhen pertinence of proprioceptive information was amplified, benefits of an internal focus were more pronounced and performance was higher. Participants were better able to focus on movement characteristics to process proprioceptive feedback: something not afforded under an external focus. This raises doubts regarding the rigidity of the constrained action hypothesis.     

Human movement initiation: specification of arm, direction, and extent

This article presents a method for discovering how the defining values of forthcoming body movements are specified. In experiments using this movement precuing technique, information is given about some, none, or all of the defining values of a movement that will be required when a reaction signal is presented. It is assumed that the reaction time (RT) reflects the time to specify those values that were not precued. With RTs for the same movements in different precue conditions, it is possible to make detailed inferences about the value specification process for each of the movements under study. The present experiments were concerned with the specification of the arm, direction, and extent (or distance) of aimed hand movements. In Experiment 1 it appeared that (a) specification times during RTs were longest for arm, shorter for direction, and shortest for extent, and (b) these values were specified serially but not in an invariant order. Experiment 2 suggested that the precuing effects obtained in Experiment 1 were not attributable to stimulus identification. Experiment 3 suggested that subjects in Experiment 1 did not use precues to prepare sets of possible movements from which the required movement was later selected. The model of value specification supported by the data is consistant with a distinctive-feature view, rather than a hierarchical view, of motor programming.     

Are movements prepared in parts? Not under compatible (naturalized) conditions

This set of experiments is concerned with the specification of movement parameters hypothesized to be involved in the initiation of movement. Experiment 1 incorporated the precuing method developed by Rosenbaum in which a precue provided partial information of the upcoming movement before the stimulus to move. Under conditions in which precues were provided by letter symbols and stimuli were color-coded dots mapped to response keys. Rosenbaum found reaction times to be slower for the specification of arm than for direction, and both to be slower than the specification of extent. In Experiment 1, using precue and stimulus conditions that paralleled those employed by Rosenbaum, we obtained very similar findings. The three follow-up experiments extended these findings to more naturalized stimulus-response compatible conditions. We used a method in which precues and stimuli were directly specified through vision and mapped in a one-to-one manner with responses. In Experiment 2, although reacion times decreased as a function of the number of parameters precued, there were no systematic effects of precuing particular parameters. In Experiments 3 and 4, we incorported an ambiguous precue that, while serving to reduce task uncertainty, failed to provide any specific information as to the arm, direction, or extent of the upcoming movement. Initiation times did not systematically vary as a function of the type of parameter precued nor were there significant differences between specific and ambiguous precue conditions. In sum, only in Experiment 1 in which precues and stimuli involved complex cognitive transformations was there support for Rosenbaum's parameter specification model. When we employed highly compatible conditions, designed to reflect a real-world environment, we failed to obtain any tendency for movement parameters to be serially specified. We discuss grounds for suspecting the generality of parameter specification models and propose an alternative approach that is consonant with the dynamic characteristics of the motor control system.     

Control strategies when intercepting slowly moving targets

In 3 experiments, the authors investigated and described how individuals control manual interceptive movements to slowly moving targets. Participants (N = 8 in each experiment) used a computer mouse and a graphics tablet assembly to manually intercept targets moving across a computer screen toward a marked target zone. They moved the cursor so that it would arrive in the target zone simultaneously with the target. In Experiment 1, there was a range of target velocities, including some very slow targets. In Experiment 2, there were 2 movement distance conditions. Participants moved the cursor either the same distance as the target or twice as far. For both experiments, hand speed was found to be related to target speed, even for the very slowly moving targets and when the target-to-cursor distance ratios were altered, suggesting that participants may have used a strategy similar to tracking. To test that notion, in Experiment 3, the authors added a tracking task in which the participants tracked the target cursor into the target zone. Longer time was spent planning the interception movements; however, there was a longer time in deceleration for the tracking movements, suggesting that more visually guided trajectory updates were made in that condition. Thus, although participants scaled their interception movements to the cursor speed, they were using a different strategy than they used in tracking. It is proposed that during target interception, anticipatory mechanisms are used rather than the visual feedback mechanism used when tracking and when pointing to stationary targets.     

The Blicket Within: Preschoolers' Inferences About Insides and Causes

Four experiments examined children's inferences about the relation between objects' internal parts and their causal properties. In Experiment 1, 4-year-olds recognized that objects with different internal parts had different causal properties, and those causal properties transferred if the internal part moved to another object. In Experiment 2, 4-year-olds made inferences from an object's internal parts to its causal properties without being given verbal labels for objects or being shown that insides and causal properties covaried. Experiment 3 found that 4-year-olds chose an object with the same internal part over one with the same external property when asked which object had the same causal property as the target (which had both the internal part and external property). Finally, Experiment 4 demonstrated that 4-year-olds made similar inferences from causal properties to internal parts, but 3-year-olds relied more on objects' external perceptual appearance. These results suggest that by the age of 4, children have developed an understanding of a relation between an artifact's internal parts and its causal properties.     

Attentional focus on suprapostural tasks affects balance learning

We examined whether the attentional focus induced by a suprapostural task has an influence on the learning of a dynamic balance task. Participants balanced on a stabilometer and were required to hold a tube horizontal with both hands. In Experiment 1, the tube contained a table tennis ball, whereas it was empty in Experiment 2. Participants were instructed to focus on either their hands (internal focus) or the tube (external focus). We measured balance performance as a function of attentional focus on the suprapostural task. Participants practised for 2 days, and on Day 3 they performed a retention test (with tube) and a transfer test (without tube). In both experiments, the external focus groups demonstrated more effective retention and transfer than the internal focus groups (and than the control group in transfer in Experiment 2). In addition, in Experiment 1 the external group was superior in keeping the tube horizontal. This suggests that the performer's attentional focus regarding the suprapostural task affects performance and learning not only of the suprapostural task itself, but also of the postural task.     

EMG activity as a function of the performer's focus of attention

In previous studies of attentional focus effects, investigators have measured performance outcome. Here, however, the authors used electromyography (EMG) to determine whether difference between external and internal foci would also be manifested at the neuromuscular level. In 2 experiments, participants (N=11, Experiment 1; N=12, Experiment 2) performed biceps curls while focusing on the movements of the curl bar (external focus) or on their arms (internal focus). In Experiment 1, movements were performed faster under external than under internal focus conditions. Also, integrated EMG (iEMG) activity was reduced when performers adopted an external focus. In Experiment 2, movement time was controlled through the use of a metronome, and iEMG activity was again reduced under external focus conditions. Those findings are in line with the constrained action hypothesis (G. Wulf, N. McNevin, & C. H. Shea, 2001), according to which an external focus promotes the use of more automatic control processes.     

Timing and accuracy of visually directed movements in children: control of direction and amplitude components

The reaction times (RTs), movement times (MTs), and final accuracy of hand movements directed towards visual goals were measured in 6-, 8-, and 10-year-old children, using tasks in which direction and amplitude components of movement were distinctly required. The tasks were performed with and without visual feedback of the limb. RTs decreased with age, and were shorter in directional than in amplitude task, in all ages. MTs were the longest at age 8 in both tasks, equally short at ages 6 and 10 in the directional task, the shortest at age 10, and intermediate at age 6, when amplitude had to be regulated. In the amplitude task, the target distance generally affected MTs under both visual conditions, but to a lower degree at age 10 than in the two younger groups. Movement accuracy, which was in all cases higher with visual feedback, showed different developmental trends among the two spatial components: directional accuracy was not different among the three groups of age, whereas amplitude accuracy showed a nonmonotonic development in the nonvisual condition, with an increase between age 6 and age 10, and the lowest level at age 8. In the visual condition, amplitude accuracy did not change with age. The specification of direction seems therefore to predominantly load the preparatory stage of the response. Amplitude specification seems to be more dependent on on-going regulations and to undergo a longer and more complex development, with a critical period around age 8 when a greater propensity for a feedback-based control appears on the two components. With increasing age, amplitude tends to be specific to a greater extent by a feedforward process.     

EMG Activity as a Function of the Performer's Focus of Attention

In previous studies of attentional focus effects, investigators have measured performance outcome. Here, however, the authors used electromyography (EMG) to determine whether differences between external and internal foci would also be manifested at the neuromuscular level. In 2 experiments, participants (N = 11, Experiment 1; N = 12, Experiment 2) performed biceps curls while focusing on the movements of the curl bar (external focus) or on their arms (internal focus). In Experiment 1, movements were performed faster under external than under internal focus conditions. Also, integrated EMG (iEMG) activity was reduced when performers adopted an external focus. In Experiment 2, movement time was controlled through the use of a metronome, and iEMG activity was again reduced under external focus conditions. Those findings are in line with the constrained action hypothesis (G. Wulf, N. McNevin, & C. H. Shea, 2001), according to which an external focus promotes the use of more automatic control processes.