Coding of on-line and pre-planned movement sequences

Recent experiments have demonstrated that complex multi-element movement sequences were coded in visual-spatial coordinates even after extensive practice, while relatively simple spatial-temporal movement sequences are coded in motor coordinates after a single practice session. The purpose of the present experiment was to determine if the control process rather than the difficulty of the sequence played a role in determining the pattern of effector transfer. To accomplish this, different concurrent feedback conditions were provided to two groups of participants during practice of the same movement sequence. The results indicated that when concurrent visual feedback was provided during the production of the movement, which was thought to encourage on-line control, the participants performed transfer tests with the contra-lateral limb better when the visual-spatial coordinates were reinstated than when the motor coordinates were reinstated. When concurrent visual feedback was not provided, which was thought to encourage pre-planned control, the opposite was observed. The data are consistent with the hypothesis that the mode of control dictates the coordinate system used to code the movement sequence rather than sequence difficulty or stage of practice as has been proposed.     

Hierarchical control of rapid movement sequences

Are movement sequences executed in a hierarchically controlled fashion? We first state explicitly what such control would entail, and we observe that if a movement sequence is planned hierarchically, that does not imply that its execution is hierarchical. To find evidence for hierarchically controlled execution, we require subjects to perform memorized sequences of finger responses like those used in playing the piano. The error data we obtain are consistent with a hierarchical planning as well as execution model, but the interresponse-time data provide strong support for a hierarchical execution model. We consider three alternatives to the hierarchical execution model and reject them. We also consider the implications of our results for the role of timing in motor programs, the characteristics of motor buffers, and the relations between memory for symbolic and motor information.     

Temporal characteristics in apparent movement: Omega movement vs. PHI movement

A vertical line stimulus was presented alternately at two positions on an oscillo scope face, with no interstimulus interval. Observation of this stimulus produced haphazard alternation between a number of movement percepts, which were divided into four categories: phi, omega and partial movement, and no movement. Attention to one category did not increase the proportion of time movement in that category it was reported. Proportion of time reported for each category varied differentially as a function of alternation frequency. Upper and lower displacement amplitude limits were measured as a function of frequency for phi and omega movement. Both limits for omega movement differed from those for phi movement. The results imply that phi and omega movement involve separate processing stages in the visual system.     

The impact of concurrent visual feedback on coding of on-line and pre-planned movement sequences

The purpose of this study was to determine the extent to which participants could effectively switch from on-line (OL) to pre-planned (PP) control (or vice versa) depending on previous practice conditions and whether concurrent visual feedback was available during transfer testing. The task was to reproduce a 2000 ms spatial–temporal pattern of a sequence of elbow flexions and extensions. Participants were randomly assigned to one of two practice conditions termed OL or PP. In the OL condition the criterion waveform and the cursor were provided during movement production while this information was withheld during movement production for the PP condition. A retention test and two effector transfer tests were administered to half of the participants in each acquisition conditions under OL conditions and the other half under PP conditions. The mirror effector transfer test required the same pattern of muscle activation and limb joint angles as required during acquisition. The non-mirror transfer test required movements to the same visual–spatial locations as experienced during acquisition. The results indicated that when visual information was available during the transfer tests performers could switch from PP to OL. When visual information was withdrawn, they shifted from the OL to the PP-control mode. This finding suggests that performers adopt a mode of control consistent with the feedback conditions provided during testing.     

Distributed planning of movement sequences

Three experiments are reported that examine whether fast finger-tapping sequences are entirely planned before execution starts (advance planning), or if they can be started while planning is still under way (distributed planning). Subjects performed finger tapping sequences of three to eight taps at a high rate, under both simple and 2-choice reaction time (RT) conditions. The sequences differed in the location of an accentuated element within them. The RT to choose between sequences with different accent locations progressively decreased as an inverse function of the time-distance between the initial tap and the first point at which the alternative sequences differed. The shortening in choice reaction time (CRT) was never accompanied by noticeable changes in the inter-response times or force patterns of the tapping sequences. The RT to initiate sequences with accent location known beforehand (SRT condition) showed, in two of three experiments, a weak decreasing trend as the accentuated tap shifted away from the beginning of the sequence. The SRT results suggest a possible predominance of advance planning when the same sequence is repeated over a series of trials. The CRT results are taken as evidence that planning of the sequence beyond the unpredictable tap could be distributed before and after sequence initiation. Several factors are discussed that may influence the balance between planning in advance of, and planning in parallel with, sequence execution.     

Part-whole practice of movement sequences

A 16-element movement sequence was taught under part-whole and whole-practice conditions. Participants (N = 18) produced a right-arm lever movement to sequentially presented target locations. The authors constructed part-whole practice by providing practice on only the 1st 8 elements on the 1st day of practice (100 repetitions of the 8-element sequence) and on all 16 elements on the 2nd day of practice (100 repetitions of the 16-element sequence). The whole-practice group practiced all 16 elements on both days (100 repetitions of the 16-element sequence per day). No differences in sequence structure or in movement duration of the 16-element sequence were noted on the retention test (Day 3). On transfer tests in which the 1st and last 8 elements were tested separately, however, the participants in the part-whole practice group performed more quickly than the participants in the whole-practice group, especially on the last 8 elements. Participants in the whole-practice group appeared to code the sequence so that it was relatively difficult to fully partition it into separate movements. Thus, on the transfer tests, there continued to be residual effects of the 8 elements that did not have to be produced but slowed down the rate of responding for the whole-practice group. That finding was not observed for the part-whole practice group.     

Central and peripheral coordination in movement sequences

Summary Motor coordination has been too poorly defined to be a useful construct in studying the control of movement. In general, motor coordination involves controlling both the timing and the kinematics of movement. Yet the motor behaviors typically used for the study of coordination have required controlling only the timing or the spatial aspects of a movement. To understand better the basis of motor behavior, this study examined movement sequences, a class of movement in which both the timing and the kinematics must be controlled. In one experiment we studied a reaching and grasping movement sequence to characterize the central coordination of movement sequences. In another experiment we studied a throwing movement sequence to characterize the peripheral (kinesthetic) coordination of movement sequences. An heuristic model is presented to explain how central and peripheral mechanisms of coordination might interact to produce accurate movement.     

An automated eye movement laboratory for on-line electrooculography

This paper describes an automated eye movement laboratory that uses electrooculography (EOG) to study people’s eye movements while they read. An on-line minicomputer processes bioelectric potentials that correspond to saccadic eye movements. Horizontal saccades larger than 1.5 deg of visual angle are detected and analyzed in real-time as they occur. The laboratory is designed for prolonged yet unobtrusive observation of human eye movements during sustained reading periods of minutes or hours. All important functions regarding data collection and data reduction are performed automatically, according to simple procedures that can be applied uniformly and without bias to nearly all subjects that we study. Results from three experiments are cited in order to quantify the performance of the laboratory with respect to four criteria: saccade detection accuracy, measurement accuracy, sensitivity, and the uniformity of these measures over different subjects.     

Tracking simple and complex sequences

We address issues of synchronization to rhythms of musical complexity. In two experiments, synchronization to simple and more complex rhythmic sequences was investigated. Experiment 1 examined responses to phase and tempo perturbations within simple, structurally isochronous sequences, presented at different base rates. Experiment 2 investigated responses to similar perturbations embedded within more complex, metrically structured sequences; participants were explicitly instructed to synchronize at different metrical levels (i.e., tap at different rates to the same rhythmic patterns) on different trials. We found evidence that (1) the intrinsic tapping frequency adapts in response to temporal perturbations in both simple (isochronous) and complex (metrically structured) rhythms, (2) people can synchronize with unpredictable, metrically structured rhythms at different metrical levels, with qualitatively different patterns of synchronization seen at higher versus lower levels of metrical structure, and (3) synchronization at each tapping level reflects information from other metrical levels. The latter finding provides evidence for a dynamic and flexible internal representation of the sequence's metrical structure.     

Rhythm and the timing of movement sequences

Summary Many motor skills involve a sequence of movements phased over a period of time. The present study investigated the importance of rhythmic timing structures in the acquisition and control of a serial key-pressing task. Four groups of subjects received extensive practice on 9-element finger sequences varying in the form of the inherent temporal structure. Following a training period, the stability of the various timing patterns was examined by requiring subjects to perform the key-pressing task concurrently with a verbal memory task. The memory task involved reporting back a sequence of visually-presented words with a lag of one word. A comparison was made of performance on the two tasks under dual task and control (single task) conditions. The results suggested that natural rhythmic timing structures require less attention for production than unnatural temporal patterns. A breakdown of the temporal patterns into within-group and between-group intervals showed that patterns containing within-group intervals that related as 1:1 or 1:2 evidenced good stability under dual-task conditions. These results were taken as support for the suggestion by Fraisse (1946) that the perception and production of rhythms can be understood by an internal representation that allows only two distinct durations that relate as 1:2. Furthermore, it was suggested that relative timing may become an invariant property of motor program representation only in those instances in which the timing sequence completely fits the internal timing structure.     

Proportional and nonproportional transfer of movement sequences

Two experiments were designed to determine participants' ability to transfer a learned movement sequence to new spatial locations. A 16-element dynamic arm movement sequence was used in both experiments. The task required participants to move a horizontal lever to sequentially projected targets. Experiment 1 included 2 groups. One group practised a pattern in which targets were located at 20, 40, 60, and 80° from the start position (long sequence). The other group practised a pattern with targets at 20, 26.67, 60, and 80° (mixed sequence). Both groups were tested 24 hours later on the long, mixed, and short sequence. The short sequence was considered a proportional transfer for the long acquisition group because all the amplitudes between targets were reduced by the same proportion. Nonproportional transfer occurred when the amplitudes between targets did not have the same proportions as those for their practice sequence (e.g., long sequence to mixed sequence or vice versa). The results indicated that participants could effectively transfer to new target configurations regardless of whether the transfer required proportional or nonproportional spatial changes to the movement pattern. Experiment 2 assessed the effects of extended practice on proportional and nonproportional spatial transfer. The data indicated that while participants can effectively transfer to both proportional and nonproportional spatial transfer conditions after 1 day of practice, they are only effective at transferring to proportional transfer conditions after 4 days of practice. The results are discussed in terms of the mechanism by which response sequences become increasingly specific over extended practice in an attempt to optimize movement production.     

Proportional and nonproportional transfer of movement sequences

Two experiments were designed to determine participants' ability to transfer a learned movement sequence to new spatial locations. A 16-element dynamic arm movement sequence was used in both experiments. The task required participants to move a horizontal lever to sequentially projected targets. Experiment 1 included 2 groups. One group practised a pattern in which targets were located at 20, 40, 60, and 80° from the start position (long sequence). The other group practised a pattern with targets at 20, 26.67, 60, and 80° (mixed sequence). Both groups were tested 24 hours later on the long, mixed, and short sequence. The short sequence was considered a proportional transfer for the long acquisition group because all the amplitudes between targets were reduced by the same proportion. Nonproportional transfer occurred when the amplitudes between targets did not have the same proportions as those for their practice sequence (e.g., long sequence to mixed sequence or vice versa). The results indicated that participants could effectively transfer to new target configurations regardless of whether the transfer required proportional or nonproportional spatial changes to the movement pattern. Experiment 2 assessed the effects of extended practice on proportional and nonproportional spatial transfer. The data indicated that while participants can effectively transfer to both proportional and nonproportional spatial transfer conditions after 1 day of practice, they are only effective at transferring to proportional transfer conditions after 4 days of practice. The results are discussed in terms of the mechanism by which response sequences become increasingly specific over extended practice in an attempt to optimize movement production.     

Nonhierarchical control of rapid movement sequences: a comment on Rosenbaum, Kenny, and Derr

In a recent article, Rosenbaum, Kenny, and Derr (1983) described a hierarchical storage and execution model for a class of repetitive, discrete response sequences. With a few modifications, this model can match the performance of subjects performing sequences from this class. The authors claimed that this provides an "existence proof" for hierarchical control during movement execution, at least for these sequences. My purpose is to show by counterexample that this claim is too strong. I present a logogen activation model for the rapid execution of stored motor sequences which assumes that (a) logogens corresponding to responses are activated via association and repetition; (b) activation decays; and (c) interresponse time is inversely related to activation of the correct response at each position in the sequence. This model can also fit the results of Rosenbaum et al. A much richer data base, designed to discriminate between competing formulations, will be needed to prove the existence of the hierarchical, tree-traversal control process proposed by Rosenbaum et al.     

Count-based decision-making in mice: numerosity vs. stimulus control

Animal Cognition - Numerical and temporal control of behavior is ubiquitous across many species of animals. Recent studies showed that in the presence of reliable discriminative stimuli, mice...     

Visual illusions affect both movement planning and on-line control: a multiple cue position on bias and goal-directed action

Over the last decade, there has been an interest in the impact of visual illusions on the control of action. Much of this work has been motivated by Milner and Goodale's two visual system model of visual processing. This model is based on a hypothesized dissociation between cognitive judgments and the visual control of action. It holds that action is immune to the visual context that provides the basis for the illusion-induced bias associated with cognitive judgments. Recently, Glover has challenged this position and has suggested that movement planning, but not movement execution is susceptible to visual illusions. Research from our lab is inconsistent with both models of visual-motor processing. With respect to the planning and control model, kinematic evidence shows that the impact of an illusion on manual aiming increases as the limb approaches the target. For the Ebbinghaus illusion, this involved a decrease in the time after peak velocity to accommodate the 'perceived' size of the target. For the Müller-Lyer illusion, the influence of the figure's tails increased from peak velocity to the end of the movement. Although our findings contradict a strong version of the two visual systems hypothesis, we did find dissociations between perception and action in another experiment. In this Müller-Lyer study, perceptual decisions were influenced by misjudgment of extent, while action was influenced by misjudgment of target position. Overall, our findings are consistent with the idea that it is often necessary to use visual context to make adjustments to ongoing movements.     

The programming of structural properties of movement sequences

Summary The present paper investigates the role of abstract structural properties in the programming and execution of movement sequences. Three experiments, using converging methods, demonstrate that the motor system represents the abstract structural properties of movement sequences. The first two experiments show that hierarchical structures over a sequence of tapping movements can be used to prepare the motor program, even if the specific elements of the sequence are still unknown. Experiment 2 also shows that the preliminary programming of structural properties of a movement sequence takes more time than the programming of specific elements ( start elements). Experiment 3 suggests that abstract structural properties can be generalized from a special sequence and that they are transferable to other sequences. Abstract structural properties are assumed to be an important component of generalized motor programs.