Intermittency in human manual tracking tasks

We confirm Craik's (1947) observation that the human manual1y tracking a visual target behaves like an intermittent servo-control1er. Such tracking responses are indicative of "sampled" negative-feedback control but could be the result of other, continuous, mechanisms. Tracking performance therefore was recorded in a task in which visual feedback of the position of the hand-held joystick could be eliminated. Depriving the subjects of visual feedback led to smoother tracking and greatly reduced the signal power of their responses between 0.5-1.8 Hz. Their responses remained intermittent when they used feedback of their own position but not of the target to track a remembered (virtual) target. Hence, intermittency in tracking behavior is not exclusively a signature of visual feedback control but also may be a sign of feedback to memorized waveforms. Craik's (1947) suggestion that the intermittency is due to a refractory period following each movement was also tested. The errors measured at the start of each intermittent response, during tracking of slow waveforms, showed evidence of a small error deadzone (measuring 0.7 cm on the VDU screen or 0.80 degrees at the eye). At higher target speeds, however, the mean size of starting errors increased, and the upper boundary of the distribution of starting error was close to that expected of a refractory delay of approximately 170 ms between responses. We consider a model of the control system that can fit these results by incorporating an error deadzone within a feedback control loop. We therefore propose that the initiation of intermittent tracking responses may be limited by a positional error deadzone and that evidence for a refractory period between successive corrective movements can be satisfied without evoking an explicit timing or sampling mechanism.     

Complex oscillations in a human motor system

Experiments were performed to investigate the oscillations arising in a human motor system with delayed visual feedback. Eight subjects were instructed to maintain a constant finger position relative to a stationary baseline. The finger displacement was measured using a microdisplacement transducer connected to the index finger, and was displayed on an oscilloscope. Time delays between 40 and 1,500 ms were inserted in the visual feedback loop for 100 s. Results show that, as the time delays increase, irregular rhythms appear with short intermittent periods of regular oscillations. These regular low-frequency oscillations have an amplitude that increases with the time delays and a period that is consistently about 2 to 4 times the time delay. Fast Fourier Transforms (FFT) show a peak between 8 and 12 Hz, corresponding to physiological tremor in half the subjects. No systematic variations in the FFT for the 2 to 15 Hz range were observed as time delay increased. In the 0 to 2 Hz range, the FFT show a consistent increase in power with the time delay. These results indicate that, under the conditions of this experiment, tremor is not affected by time delays in the visuomotor system, and time delays in the visuomotor feedback loop give rise to complex oscillatory behaviors.     

Feedback Delays: How Can Decision Makers Learn Not to Buy a New Car Every Time the Garage Is Empty?

Decision makers in dynamic environments (e.g., stock trading, inventory control, and firefighting) learn poorly in experiments where feedback about the outcomes of their actions is delayed. In searching for ways to mitigate these effects, this paper presents two computational models of learning with feedback delays and contrasts them against human decision-makers' performance. The no-memory model hypothesizes that decision makers always perceive feedback as immediate. The with-memory model hypothesizes that, over time, decision makers are able to develop internal representations of the task that help them to perform with delayed feedback. As borne out by human subjects, both models predict that a display of past history improves learning with delay and that increasing delay increasingly degrades performance. Even though the length of training in this task exceeds that used in many laboratory-based dynamic tasks, neither the two models nor the subjects are able to effectively learn without decision aids when faced with feedback delays. When given an amount of training that more closely approximates that provided in functioning dynamic environments, the with-memory model predicts that human decision makers may learn without decision aids over the long term if feedback delays are simple. These results raise several issues for continued theoretical investigation as well as potential suggestions for training and supporting decision makers in dynamic environments with feedback delays. Copyright 2000 Academic Press.     

Response patterns and cardiovascular effects during response sequence acquisition by humans.

The effects of temporal delays imposed between successive responses and of vitamin C administration were examined on the acquisition of response sequences and on cardiovascular reactivity during sequence acquisition. Thirteen adult subjects (6 female, 7 male), in good health, gave written consent prior to participating in 12 weekly 45-min sessions. Points, exchanged for money after each session, were presented when subjects completed 15-response sequences on a touch-sensitive three-response keypad. A position counter increased from 0 to 14 as subjects emitted correct responses in the sequence. Four novel 15-response sequences were presented each session. No delays were imposed between successive responses during the acquisition of one sequence; delays were imposed immediately following each response during the acquisition of a second sequence, thereby delaying response feedback; delays were imposed following feedback during acquisition of a third sequence, resulting in the removal of the stimulus correlated with sequence position; and, as a control condition, delays were imposed following feedback, but stimuli correlated with sequence position were reinstated prior to the next response during acquisition of a fourth sequence. Subjects were exposed to one of two delay durations (0.2 and 0.5 or 0.5 and 1.0 s) each session, and delay durations alternated every session. During Weeks 5 to 8, subjects received 3 grams of vitamin C per day, whereas during Weeks 1 to 4 and 9 to 12, subjects received placebo under single-blind conditions. All subjects acquired the sequences, as evidenced by decreasing percentages of incorrect responses across trials. When temporal delays were imposed between successive responses during sequence acquisition, acquisition efficiency was enhanced. Examination of response latencies suggested that the status of preceding responses (i.e., correct or incorrect) rather than the status of the position counter influenced subsequent responding. Cardiovascular effects were inversely related to the length of the temporal delay. Neither cardiovascular reactivity or sequence acquisition were related to vitamin C administration.     

Periodic change in phase relationship between target and hand motion during visuo-manual tracking task: Behavioral evidence for intermittent control

When one performs visuo-manual tracking tasks, velocity profile of hand movements shows discontinuous patterns even if the target moves smoothly. A crucial factor of this “intermittency” is considerable delay in the sensorimotor feedback loop, and several researchers have suggested that the cause is intermittent correction of motor commands. However, when and how the brain monitors task performance and updates motor commands in a continuous motor task is uncertain. We examined how tracking error was affected by the timing of target disappearance during a tracking task. Results showed that tracking error, defined as the average phase difference between target and hand, varied periodically in all conditions. Hand preceded target at one specific phase but followed it at another, implying that motor control was not performed in a temporally uniform manner. Tracking stability was evaluated by the variance in phase difference, and changed depending on the timing of target-removal. The variability was larger when target disappeared around turning points than that when it disappeared around the center of motion. This shows that visual information at turning points is more effectively exploited for motor control of sinusoidal target tracking, suggesting that our brain controls hand movements with intermittent reference to visual information.     

Effects of delayed visual feedback on motor control performance

The effects of delay of visual feedback on two kinds of sensorimotor tasks were investigated. On the reciprocal tapping task, accuracy of performance decreased for 200, 500, and 767 msec. delay. The number of errors for the 1000-msec. delay is smaller than those for the other three conditions of delay. On the hand-writing task of both Kanji letters and English words, performance showed a large decrement with increasing delay. The most frequent kinds of error were the type of insertion of line elements or letter duplication. It was interesting that the size of written letters increased with lengthening delays of visual feedback.     

Effects of correct and transformed visual feedback on rhythmic visuo-motor tracking: tracking performance and visual search behavior

The effects of correct and transformed visual feedback on rhythmic unimanual visuo-motor tracking were examined, focusing on tracking performance (accuracy and stability) and visual search behavior. Twelve participants (reduced to 9 in the analyses) manually tracked an oscillating visual target signal in phase (by moving the hand in the same direction as the target signal) and in antiphase (by moving the hand in the opposite direction), while the frequency of the target signal was gradually increased to probe pattern stability. Besides a control condition without feedback, correct feedback (representing the actual hand movement) or mirrored feedback (representing the hand movement transformed by 180 degrees) were provided during tracking, resulting in either in-phase or antiphase visual motion of the target and feedback signal, depending on the tracking mode performed. The quality (accuracy and stability) of in-phase tracking was hardly affected by the two forms of feedback, whereas antiphase tracking clearly benefited from mirrored feedback but not from correct feedback. This finding extends previous results indicating that the performance of visuo-motor coordination tasks is aided by visual feedback manipulations resulting in coherently grouped (i.e., in-phase) visual motion structures. Further insights into visuo-motor tracking with and without feedback were garnered from the visual search patterns accompanying task performance. Smooth pursuit eye movements only occurred at lower oscillation frequencies and prevailed during in-phase tracking and when target and feedback signal moved in phase. At higher frequencies, point-of-gaze was fixated at a location that depended on the feedback provided and the resulting visual motion structures. During in-phase tracking the mirrored feedback was ignored, which explains why performance was not affected in this condition. Point-of-gaze fixations at one of the end-points were accompanied by reduced motor variability at this location, reflecting a form of visuo-motor anchoring that may support the pick up of discrete information as well as the control of hand movements to a desired location.     

Visual discrimination of delayed self-generated movement reveals the temporal limit of proprioceptive–visual intermodal integration

This study examined the intermodal integration of visual–proprioceptive feedback via a novel visual discrimination task of delayed self-generated movement. Participants performed a goal-oriented task in which visual feedback was available only via delayed videos displayed on two monitors—each with different delay durations. During task performance, delay duration was varied for one of the videos in the pair relative to a standard delay, which was held constant. Participants were required to identify and use the video with the lesser delay to perform the task. Visual discrimination of the lesser-delayed video was examined under four conditions in which the standard delay was increased for each condition. A temporal limit for proprioceptive–visual intermodal integration of 3–5 s was revealed by subjects’ inability to reliably discriminate video pairs.     

Dissociation of the neural systems for working memory maintenance of verbal and nonspatial visual information

Working memory for names and faces was investigated to ascertain whether verbal and nonspatial visual information is maintained in working memory by separate neural systems. The subjects performed a delayed match-to-sample task for famous or unfamous faces and names and a sensorimotor control task. Several occipital, temporal, parietal, and prefrontal areas were activated during all memory delays, in comparison with the control delays. Greater delay activity for unfamous faces than for names was obtained in the right fusiform gyrus, right inferior frontal gyrus (IFG), right IFG/ precentral gyrus, and right medial superior frontal gyrus, whereas greater delay activity for unfamous names than for faces was observed in the precuneus, left insula/postcentral gyrus, and left IFG/ precentral gyrus. There was no significant difference in the prefrontal activity in the comparison between famous faces and names. Greater delay activity for famous names than for faces was obtained in visual association and parietal areas. The results indicate that there is a functional dissociation based on information type within the neural system that is responsible for working memory maintenance of verbal and nonspatial visual information.     

Studies on sensory feedback: III the effects of display gain on tracking performance

Instrumentation is described which permits study of the effects of different forms of visual feedback display on the patterns of fine movement obtained from the extended human index finger when the subject is attempting to keep his finger at a fixed point in space. The task is a compensatory tracking task in which the only source of input to the system is the subject's own finger movement. The effects of increasing the gain (or amplification) of a proportional error signal on the pattern of finger movement was studied. Gains of 1, 2, 4, 10, 20 and 40 were studied with a group of 24 subjects. Increasing the gain of a proportional error signal resulted in a marked improvement in the ability of subjects to maintain their extended finger at a fixed point in space. As the gain of the error signal was increased, the subject's high-amplitude, low frequency errors were reduced, and there was a progressive appearance of high-frequency activity of low-amplitude, more accurately centred about the reference position in space. A total off-target area measure (integrated absolute error) showed marked decrease in scores as the amplification of the error signal was increased from 1 through 10. Beyond this gain there was no appreciable additional improvement in motor control, however no degradation of control was noted to characterize the group performance.

Exploratory studies were undertaken to permit comparison of the effects of increasing the gain of a proportional visual display with the effects of increasing the gain of non-proportional visual and auditory displays. An increase in the dominant-energy frequency was noted as the error signal gain was increased, independent of whether a proportional visual, or non-proportional visual or auditory display was used. This observation suggests that common mechanisms mediate the processing of the gain parameters of feedback displays, in some measure independent of the display form or the sensory modality used for presentation.     

Effect of knee extensors muscles fatigue on bilateral force accuracy,variability, and coordination

The aim of this study was to test the effect of fatigue of the knee extensors muscles on bilateral force control accuracy, variability, and coordination in the presence and absence of visual feedback. Twenty-two young physically active subjects (18 males, 4 females) were divided into two groups and performed 210 submaximal sustained bilateral isometric contractions of knee extensors muscles with and without visual feedback. One group performed a symmetrical task—both legs were set at identical positions (60° knee flexion)—while the other group performed an asymmetrical task (60° and 30° knee flexion). We used the framework of the uncontrolled manifold hypothesis to quantify two variance components: one of them did not change total force (V_UCM), while the other did (V_ORT). Performance of bilateral isometric contractions reduced voluntary and electrically induced force without changes in bilateral force control variability and accuracy. Bilateral force production stability and accuracy were higher in both tasks with visual feedback. Synergistic (anti-phase) structure of force control between the lower limbs occurred and the values of synergy index were higher only during the performance of the asymmetrical task with visual feedback. In addition, greater bilateral force control accuracy was observed during the performance of the asymmetrical task (with and without visual feedback), despite no differences in within-trial variability of both tasks.     

Decision-making impairments in patients with Parkinson's disease

A high percentage of Parkinson's disease (PD) patients show cognitive impairments in addition to the cardinal motor symptoms. These deficits primarily concern executive functions most probably linked to dysfunctions in prefrontal regions due to decreased dopaminergic transmission in fronto-striatal loops. To investigate possible associations between decision-making and executive functions in PD, we examined 20 non-demented PD patients and 20 healthy control subjects with a neuropsychological test battery and the Game of Dice Task. In this computerised decision-making task, the rules for gains and losses and the winning probabilities are obvious and stable. Thus, strategic components besides feedback processing might influence decision-making in this task. We found that PD patients were impaired in the Game of Dice task performance and that the frequency of disadvantageous choices correlated with both executive functions and feedback processing. We suggest that decision-making deficits of PD patients in explicit gambling situations might be associated with dysfunctions in two different fronto-striatal loops: the limbic-orbitofrontal-striatal loop, involved in feedback processing, and the dorsolateral prefrontal-striatal loop, involved in executive functions.     

Why do the effects of delaying reinforcement in animals and delaying feedback in humans differ? A working-memory analysis

Animal research has shown that reinforcement is substantially less effective when it is delayed, but in studies of human motor learning delays in providing feedback typically have much less effect. One possible explanation is that in human research participants know the response to be learned and can thus focus on it during the delay; that is not the case in experiments on animals. We tested this hypothesis using a task in which participants had minimal information on what movement was correct and found that, as in animal experiments, participants learned only when feedback was immediate. A second experiment confirmed that the effects of the delay depended on how many responses had to be held in working memory: the greater the memory load, the poorer the learning. The results point to the importance of activity during a delay on learning; implications for the teaching of motor skills are discussed.     

Why do the effects of delaying reinforcement in animals and delaying feedback in humans differ? A working-memory analysis

Animal research has shown that reinforcement is substantially less effective when it is delayed, but in studies of human motor learning delays in providing feedback typically have much less effect. One possible explanation is that in human research participants know the response to be learned and can thus focus on it during the delay; that is not the case in experiments on animals. We tested this hypothesis using a task in which participants had minimal information on what movement was correct and found that, as in animal experiments, participants learned only when feedback was immediate. A second experiment confirmed that the effects of the delay depended on how many responses had to be held in working memory: the greater the memory load, the poorer the learning. The results point to the importance of activity during a delay on learning; implications for the teaching of motor skills are discussed.     

Less precise motor control leads to increased agonist-antagonist muscle activation during stick balancing

Human motor control has constraints in terms of its responsiveness, which limit its ability to successfully perform tasks. In a previous study, it was shown that the ability to balance an upright stick became progressively more challenging as the natural frequency (angular velocity without control) of the stick increased. Furthermore, forearm and trunk agonist and antagonist muscle activation increased as the natural frequency of the stick increased, providing evidence that the central nervous system produces agonist-antagonist muscle activation to match task dynamics. In the present study, visual feedback of the stick position was influenced by changing where subject focused on the stick during stick balancing. It was hypothesized that a lower focal height would degrade motor control (more uncertainty in tracking stick position), thus making balancing more challenging. The probability of successfully balancing the stick at four different focal heights was determined along with the average angular velocity of the stick. Electromyographic signals from forearm and trunk muscles were also recorded. As expected, the probability of successfully balancing the stick decreased and the average angular velocity of the stick increased as subjects focused lower on the stick. In addition, changes in the level of agonist and antagonist muscle activation in the forearm and trunk was linearly related to changes in the angular velocity of the stick during balancing. One possible explanation for this is that the central nervous system increases muscle activation to account for less precise motor control, possibly to improve the responsiveness of human motor control.     

Discrimination of vibrotactile frequencies in a delayed pair comparison task

This study quantified human short-term-memory decay functions for delayed vibrotactile frequency discriminations. Subjects indicated which of two successive intervals contained the higher or lower frequency of a pair separated by delay periods of 0.5–30 sec. Performance decreased as a function of length of delay and was higher when delays were unfilled than when they were filled with a backwardscounting task. This interpolated task may have interfered with rehearsal of a coded representation of the remembered vibrotactile frequency. A change in decay rate after 5-sec delays suggests a switch from reliance on sensory memory to the coded frequency representation. Performance and decay rate depended on presentation order of higher or lower frequency within pairs. Reciprocal performance asymmetries seen in high- versus low-frequency ranges did not result from simple response bias.     

The effect of pre-movement delays on pointing accuracy in middle childhood.

In adults, the introduction of a pre-response delay has been shown to affect accuracy in pointing tasks while leaving accuracy in perceptual matching tasks unaffected. Here, we report on the effect of pre-movement delays on pointing accuracy in 6-10-year-old children. Children of this age group are of particular interest as their reliance on visual cues to monitor and correct their reaches appears to change during this period of development. Nineteen children were asked to point to the location of a target light after a delay of 0, 1, 2, or 4 s following target extinction. Performance was measured in two conditions: (i) open-loop, where the child reproduced the target locations in complete darkness, and (ii) with visual feedback, where information about hand position was available. Errors in the direction and in the amplitude of each reaching movement were recorded separately. The results show that temporal delay significantly affects the pointing movements of these children. Accuracy (mean) deteriorated after only 1 s whereas the precision (standard deviation) of the responses deteriorated after 4 s. Errors in amplitude, but not errors in direction, were reduced by the provision of visual feedback. Taken together, the findings suggest that amplitude and directional components of pointing in childhood utilise different sources of information, which differ in the extent to which temporal constraints operate.     

Reactions to objective self-awareness

In order to determine reactions to objective self-awareness, 96 female undergraduates received either positive or negative feedback on a “creativity” task prior to being given an opportunity to write a response to a visual cue. Half of the subjects were made objectively self-aware, via a mirror, during the visual cue task; half were not. In addition, half of the subjects were led to believe that the visual cue task was highly related to creativity, while half learned that the task was low in relevance. A “longer the response, the better” standard of correctness was established for all subjects. As predicted, the results indicated that when made objectively self-aware, subjects who received negative feedback wrote more in response to the visual cue than did those who received positive feedback, a difference which was not obtained for the subjectively self-aware subjects. The task relevance manipulation also produced a significant main effect. A similar pattern of results was obtained on a measure of the time spent on the task. The implications of the results for objective self-awareness theory are considered.     

Arm-tracking performance with and without visual feedback in children and adults: developmental changes

Tracking performance was investigated in children (aged 6-7 and 10-11) and in adult subjects. Target signals, moving unpredictably along a straight line, were tracked with the preferred arm, alternately with and without visual feedback. Qualitative observations indicate that tracking is based on continuous adjustments of the ongoing response to the continuously changing target position. No step-and-hold strategy could be detected in any of the three age groups. Tracking performance was described with four simple parameters, derived from linear systems analysis: (a) the delay between target signal and tracking movement (DL); (b) performance at the low-frequency range (LF), (c) performance at the high-frequency range (HF); and (d) a measure of tracking quality or overall similarity in the shape of target signal and tracking movement (Q). There was a considerable improvement in tracking performance with age, even after the age of 10-11, which was mainly demonstrated by a decrease in DL and increases in HF and Q. Tracking performance decreased only to a small extent when visual feedback was withdrawn. Age-related differences in the contribution of visual feedback to tracking performance could not be demonstrated.     

意向保持间隔对时间性前瞻记忆的影响

通过两个实验来探讨意向保持间隔对时间性前瞻记忆的影响。实验一仅通过嵌入前瞻目标的背景任务来操纵保持间隔,实验二通过在背景任务之前加入不同时长的填充任务来改变意向保持间隔。结果发现,(1)背景任务中的保持间隔越长,前瞻记忆成绩越差;(2)背景任务中的保持间隔和填充任务的时长对前瞻记忆的影响存在交互作用。成绩最好的为15min-2min组,最差的为15min-15min组。结果表明,背景任务和填充任务阶段对于个体保持前瞻意向可能有不同的功能。