A Dynamical Systems Approach to Manual Tracking Performance

Manual tracking performance was investigated from the perspective of dynamical systems theory. The authors manipulated the type of visual display, the control system dynamics, and the frequency of the sinusoidal input signal to examine couplings with various phases between the visual signal and control movements. Analyses of the system output amplitude ratio and relative phase showed that participants (N = 24) performed poorly with 90° relative phase coupling. All the couplings became less stable as the movement frequency increased. The authors developed an adaptive oscillator model with linear damping to describe the coupled system consisting of the human performer, the visual display, and the control system dynamics. A geometric account of the stability of performance at different relative phases is also presented.     

Studies on sensory feedback: III the effects of display gain on tracking performance

Instrumentation is described which permits study of the effects of different forms of visual feedback display on the patterns of fine movement obtained from the extended human index finger when the subject is attempting to keep his finger at a fixed point in space. The task is a compensatory tracking task in which the only source of input to the system is the subject's own finger movement. The effects of increasing the gain (or amplification) of a proportional error signal on the pattern of finger movement was studied. Gains of 1, 2, 4, 10, 20 and 40 were studied with a group of 24 subjects. Increasing the gain of a proportional error signal resulted in a marked improvement in the ability of subjects to maintain their extended finger at a fixed point in space. As the gain of the error signal was increased, the subject's high-amplitude, low frequency errors were reduced, and there was a progressive appearance of high-frequency activity of low-amplitude, more accurately centred about the reference position in space. A total off-target area measure (integrated absolute error) showed marked decrease in scores as the amplification of the error signal was increased from 1 through 10. Beyond this gain there was no appreciable additional improvement in motor control, however no degradation of control was noted to characterize the group performance.

Exploratory studies were undertaken to permit comparison of the effects of increasing the gain of a proportional visual display with the effects of increasing the gain of non-proportional visual and auditory displays. An increase in the dominant-energy frequency was noted as the error signal gain was increased, independent of whether a proportional visual, or non-proportional visual or auditory display was used. This observation suggests that common mechanisms mediate the processing of the gain parameters of feedback displays, in some measure independent of the display form or the sensory modality used for presentation.     

Visual perception of the relative phasing of human limb movements

Studies of bimanual coordination have found that only two stable relative phases (0 degree and 180 degrees) are produced when a participant rhythmically moves two joints in different limbs at the same frequency. Increasing the frequency of oscillation causes an increase in relative phase variability in both of these phase modes. However, relative phasing at 180 degrees is more variable than relative phasing at 0 degree, and when the frequency of oscillation reaches a critical frequency, a transition to 0 degree occurs. These results have been replicated when 2 people have coordinated their respective limb movements using vision. This inspired us to investigate the visual perception of relative phase. In Experiment 1, recordings of human interlimb oscillations exhibiting different frequencies, mean relative phases, and different amounts of phase variability were used to generate computer displays of spheres oscillating either side to side in a frontoparallel plane or in depth. Participants judged the stability of relative phase. Judgments covaried with phase variability only when the mean phase was 0 degree or 180 degrees. Otherwise, judgments covaried with mean relative phase, even after extensive instruction and demonstration. In Experiment 2, mean relative phase and phase variability were manipulated independently via simulations, and participants were trained to perceive phase variability in testing sessions in which mean phase was held constant. The results of Experiment 1 were replicated. The HKB model was fitted to mean judgment standard deviations.     

Block‐wise conflict adaptation of visual selectivity: Role of hemisphere‐dependent and location‐specific mechanisms

Three experiments investigated views on modulation of visual selectivity that involve hemisphere‐dependence and conflict frequency based views for a whole display. In each experiment, 16 participants completed a flanker task with compatible/incompatible stimulus arrays presented in the left, center, or right visual fields. The relative frequency of the compatible stimulus‐arrays within a trial block was varied as a function of the visual field. In Experiment 1, the relative compatibility frequency in the lateral visual fields was varied (75% / 25%) but not in the center visual field (50%). The results showed that in the lateral visual fields, the performance between the compatible and incompatible trials differed more in conditions with few (vs. many) compatibility trials. Experiments 2 and 3 validated these findings. In Experiment 2, the compatibility frequency varied in the center visual field but not in the lateral fields, resulting in performance effects in all three visual fields. Experiment 3 varied the magnitude of the differences between the compatibility and incompatibility frequencies. Together, the findings showed that participants adjusted to the frequencies of compatible stimuli in all visual fields, indicating conflict adaptation that depends on the relative frequencies of compatible stimuli. The results also suggest that this adaptation is associated with hemisphere‐dependent and location‐specific mechanisms.     

Visual and haptic feedback contribute to tuning and online control during object manipulation

The authors employed a virtual environment to investigate how humans use haptic and visual feedback in a simple, rhythmic object-manipulation task. The authors hypothesized that feedback would help participants identify the appropriate resonant frequency and perform online control adjustments. The 1st test was whether sensory feedback is needed at all; the 2nd was whether the motor system combines visual and haptic feedback to improve performance. Task performance was quantified in terms of work performed on the virtual inertia, ability to identify the correct rhythm, and variability of movement. Strict feedforward control was found to be ineffective for this task, even when participants had previous knowledge of the rhythm. Participants (N = 11) performed far better when feedback was available (11 times more work, 2.2 times more precise frequency, 30% less variability; p < .05 for all 3 performance measures). Using sensory feedback, participants were able to rapidly identify 4 different spring-inertia systems without foreknowledge of the corresponding resonant frequencies. They performed over 20% more work with 24% less variability when provided with both visual and haptic feedback than they did with either feedback channel alone (p < .05), providing evidence that they integrated online sensory channels. Whereas feedforward control alone led to poor performance, feedback control led to fast tuning or calibration of control according to the resonant frequency of the object, and to better control of the rhythmic movement itself.     

Adapting relative phase of bimanual isometric force coordination through scaling visual information intermittency

Visual information plays an adaptive role in the relation between bimanual force coupling and error corrective processes of isometric force control. In the present study, the evolving distribution of the relative phase properties of bimanual isometric force coupling was examined by scaling within a trial the temporal feedback rate of visual intermittency (short to long presentation intervals and vice versa). The force error (RMSE) was reduced, and time-dependent irregularity (SampEn) of the force output was increased with greater amounts of visual information (shorter intermittency). Multi-stable coordination patterns of bimanual isometric force control were differentially shifted toward and away from the intrinsic dynamics by the changing the intermittency of visual information. The distribution of Hilbert transformed relative phase values showed progressively a predominantly anti-phase mode under less intermittent visual information to predominantly an in-phase mode with limited (almost no) visual information. Correlation between the hands showed a continuous reduction, rather than abrupt “transition,” with increase in visual information, although no mean negative correlation was realized, despite the tendency towards an anti-phase distribution. Lastly, changes in both the performance outcome and bimanual isometric force coordination occurred at visual feedback rates faster than the minimal visual processing times established from single limb movement and isometric force protocols.     

Effects of correct and transformed visual feedback on rhythmic visuo-motor tracking: tracking performance and visual search behavior

The effects of correct and transformed visual feedback on rhythmic unimanual visuo-motor tracking were examined, focusing on tracking performance (accuracy and stability) and visual search behavior. Twelve participants (reduced to 9 in the analyses) manually tracked an oscillating visual target signal in phase (by moving the hand in the same direction as the target signal) and in antiphase (by moving the hand in the opposite direction), while the frequency of the target signal was gradually increased to probe pattern stability. Besides a control condition without feedback, correct feedback (representing the actual hand movement) or mirrored feedback (representing the hand movement transformed by 180 degrees) were provided during tracking, resulting in either in-phase or antiphase visual motion of the target and feedback signal, depending on the tracking mode performed. The quality (accuracy and stability) of in-phase tracking was hardly affected by the two forms of feedback, whereas antiphase tracking clearly benefited from mirrored feedback but not from correct feedback. This finding extends previous results indicating that the performance of visuo-motor coordination tasks is aided by visual feedback manipulations resulting in coherently grouped (i.e., in-phase) visual motion structures. Further insights into visuo-motor tracking with and without feedback were garnered from the visual search patterns accompanying task performance. Smooth pursuit eye movements only occurred at lower oscillation frequencies and prevailed during in-phase tracking and when target and feedback signal moved in phase. At higher frequencies, point-of-gaze was fixated at a location that depended on the feedback provided and the resulting visual motion structures. During in-phase tracking the mirrored feedback was ignored, which explains why performance was not affected in this condition. Point-of-gaze fixations at one of the end-points were accompanied by reduced motor variability at this location, reflecting a form of visuo-motor anchoring that may support the pick up of discrete information as well as the control of hand movements to a desired location.     

The learning of 90° continuous relative phase with and without Lissajous feedback: external and internally generated bimanual coordination

Results from recent experiments (e.g., Kovacs, Buchanan, & Shea, 2009a–b, 2010a,b) suggest that when salient visual information is presented using Lissajous plots bimanual coordination patterns typically thought to be very difficult to perform without extensive practice can be performed with remarkably low relative phase error and variability with 5 min or less of practice. However, when this feedback is removed, performance deteriorates. The purpose of the present experiment was to determine if reducing the frequency of feedback presentation will decrease the participant's reliance on the feedback and will facilitate the development of an internal representation capable of sustaining performance when the Lissajous feedback is withdrawn. The results demonstrated that reduced frequency Lissajous feedback results in very effective bimanual coordination performance on tests with Lissajous feedback available and when feedback is withdrawn. Taken together the present experiments add to the growing literature that supports the notion that salient perceptual information can override some aspects of the system's intrinsic dynamics typically linked to motor output control. Additionally, the present results suggest that the learning of both externally and internally driven bimanual coordination is facilitated by providing reduced frequency Lissajous feedback.     

Identification of visual stimuli is improved by accompanying auditory stimuli: the role of eye movements and sound location

Can auditory signals influence the processing of visual information? The present study examined the effects of simple auditory signals (clicks and noise bursts) whose onset was simultaneous with that of the visual target, but which provided no information about the target. It was found that such a signal enhances performance in the visual task: the accessory sound reduced response times for target identification with no cost to accuracy. The spatial location of the sound (whether central to the display or at the target location) did not modify this facilitation. Furthermore, the same pattern of facilitation was evident whether the observer fixated centrally or moved their eyes to the target. The results were not altered by changes in the contrast (and therefore visibility) of the visual stimulus or by the perceived utility of the spatial location of the sound. We speculate that the auditory signal may promote attentional 'disengagement' and that, as a result, observers are able to process the visual target sooner when sound accompanies the display relative to when visual information is presented alone.     

Research note: Peak velocity timing invariance

Summary Subjects used arm movements to move a dot on a visual display into a predefined target area. Measures of the peak velocity values and the timing of the peaks were taken for the initial (preplanned) and the immediately subsequent (corrective) phases of movement. In both phases the value of the maximum velocity depended on task parameters such as amplitude. However, the time of the peak of each phase relative to its onset was invariant. Some implications of these observations for the nature of motor programs are discussed.     

Modelling visual detection: Luminance response non-linearity and internal noise

Two experiments that investigate the effect of various display factors on the detectability of a thin line signal in random visual noise are described. Three statistical decision models are described, together with their ability to account for the results. The first is an “ideal detector” model, the second an “energy integrator” model, and the third a model based upon the operation of retinal ganglion cells which incorporates a gain control mechanism. The ideal detector model fails to give a good account of human performance, whereas the other two models provide a good fit to the data. The digital Laplacian with gain control model has the slight advantage over the energy integrating model in being able to account for a small superiority in the detection of dark as opposed to bright signals. Finally, both models require the inclusion of an estimate of the internal noise of the human visual system to account for the pattern of performance observed under changing conditions of display contrast.     

Reaction-anticipation transitions in human perception-action patterns

We investigated the hypothesis that reaction and anticipation in human perceptual-motor performance are two coordinative modes of a single pattern-forming dynamical system, rather than separate behaviors. Subjects coordinated the onset of finger flexions with visual metronome flashes in each of three patterns: reactive, synchronized, or syncopated. The stimulus frequency was progressively increased (0.125–1.375 Hz) or decreased (1.375-0.125 Hz) in small steps (0.125 Hz) every 10 cycles. We observed qualitative transitions in both the time interval between stimulus and corresponding action (Δt) and their relative phase (ø) at critical values of the stimulus frequency, corresponding to changes from ‘reactive-to-anticipatory’ and ‘anticipatory-to-reactive’ performance. Such transitions provide evidence of a single, multifunctional system, which can be adequately described by the dynamics of collective variables characterizing the respective perception-action patterns.     

The effects of background visual roll stimulation on postural and manual control and self-motion perception

The effects of background visual roll stimulation on postural control, manual controlf andselfmotion perception were investigated in this study. In the main experiment, 8 subjects were exposed to wide field-of-view background scenes that were tilted and static, continuously rotating, or sinusoidally rotating at frequencies between 0.03 and 0.50 Hz, as well as a baseline condition. The subjects performed either a postural control task (maintain an upright stance) or a manual control task (keep an unstable central display horizontally level). Root-mean square (RMS) error in both the postural and manual control tasks was low in the static tilt condition and extremely high in response to continuous rotation. Although the phases of the postural and manual responses were highly similar, the power and RMS error generated by the sinusoidal visual background stimulation peaked at a lower frequency in the postural task. Vection ratings recorded at the end of the postural and manual trials somewhat paralleled tbafrequency tuning differences between tasks, which a subsequent experiment showed to be the result of the differential motion of the central display rather than the differential positioning of the subject. In general, these results show that the dynamic characteristics of visual orientation systems vary according to the specific motor and/or perceptual system investigated.     

A microcomputer-based visual stimulator

A microcomputer-based instrument is described that provides visual stimuli for a CRT display and collects and processes response data. The system produces a variety of visual patterns to facilitate the study of the properties of visual neurons of several different animals. The visual patterns include drifting sinusoidal or bar gratings, contrast reversal gratings, and diffuse light. By means of a keypad, the experimenter can select the visual pattern and its parameters, such as depth of modulation, spatial frequency, initial spatial phase, temporal frequency, and rotation angle.     

Effects of salience are short-lived

ABSTRACT— A salient event in the visual field tends to attract attention and the eyes. To account for the effects of salience on visual selection, models generally assume that the human visual system continuously holds information concerning the relative salience of objects in the visual field. Here we show that salience in fact drives vision only during the short time interval immediately following the onset of a visual scene. In a saccadic target-selection task, human performance in making an eye movement to the most salient element in a display was accurate when response latencies were short, but was at chance when response latencies were long. In a manual discrimination task, performance in making a judgment of salience was more accurate with brief than with long display durations. These results suggest that salience is represented in the visual system only briefly after a visual image enters the brain.     

Effects of visual and auditory guidance on bimanual coordination complexity

Perceptual guidance of movement with simple visual or temporal information can facilitate performance of difficult coordination patterns. Guidance may override coordination constraints that usually limit stability of bimanual coordination to only in-phase and anti-phase. Movement dynamics, however, might not have the same characteristics with and without perceptual guidance. Do visual and auditory guidance produce qualitatively different dynamical organization of movement? An anti-phase wrist flexion and extension coordination task was performed under no specific perceptual guidance, under temporal guidance with a metronome, and under visual guidance with a Lissajous plot. For the time series of amplitudes, periods and relative phases, temporal correlations were measured with Detrended Fluctuation Analysis and complexity levels were measured with multiscale entropy. Temporal correlations of amplitudes and relative phases deviated from the typical 1/f variation towards more random variation under visual guidance. The same was observed for the series of periods under temporal guidance. Complexity levels for all time series were lower in visual guidance, but higher for periods under temporal guidance. Perceptual simplification of the task’s goal may produce enhancement of performance, but it is accompanied by changes in the details of movement organization that may be relevant to explain dependence and poor retention after practice under guidance.     

Some evidence in support of a relationship between human auditory signal-detection performance and the phase of the alpha cycle

This study concerned the hypothesis presented by Lindsley in 1961 that human sensorimotor performance should vary with the phase of the alpha cycle. Although there have been a number of studies which have supported this hypothesis, there has been no work from a modality other than the visual modality. Since eye tremor is correlated in phase and frequency with the alpha rhythm, these visual results might be explained by the peripheral eye tremor and not necessarily by the central alpha rhythm. The present study measured human auditory signal-detection performance at four different phases of the temporally (T5-linked mastoids) measured alpha rhythm. These four different phases were defined on an a priori basis by a computer algorithm. Detection performance was significantly better at the negative peak of this alpha cycle than at the positive peak, but there was no significant difference between the positively and negatively going zero cross performances. These results are consistent with the Lindsley hypothesis.     

Eye-Hand Coordination in Rhythmical Pointing

The authors investigated the relation between hand kinematics and eye movements in 2 variants of a rhythmical Fitts's task in which eye movements were necessary or not necessary. P. M. Fitts's (1954) law held in both conditions with similar slope and marginal differences in hand-kinematic patterns and movement continuity. Movement continuity and eye—hand synchronization were more directly related to movement time than to task index of difficulty. When movement time was decreased to fewer than 350 ms, eye—hand synchronization switched from continuous monitoring to intermittent control. The 1:1 frequency ratio with stable π/6 relative phase changed for 1:3 and 1:5 frequency ratios with less stable phase relations. The authors conclude that eye and hand movements in a rhythmical Fitts's task are dynamically synchronized to produce the best behavioral performance.     

The effect of category learning on the representation of shape: dimensions can be biased but not differentiated

Recent studies have suggested a profound influence of category learning on visual perception, resulting in independent processing of previously integral dimensions. The authors reinvestigate this issue for shape dimensions. They first extend previous findings that some shape dimensions (aspect ratio and curvature) are processed in a separable way, whereas others (radial frequency components) are not. They then show that a category-learning phase improved the discrimination of a relevant with respect to an irrelevant dimension, but only for separable dimensions. No similar effect was found on the relative sensitivity for integral shape dimensions. Thus, category learning is capable of biasing separable shape dimensions but does not alter the status of dimensions in the visual system as either separable or integral.     

Adaptation to a Nonlinear Visuomotor Amplitude Transformation With Continuous and Terminal Visual Feedback

The control of a cursor on a computer monitor offers a simple means of exploring the limits of the plasticity of human visuomotor coordination. The authors explored the boundary conditions for adaptation to nonlinear visuomotor amplitude transformations. The authors hypothesized that only with terminal visual feedback during practice, but not with continuous visual feedback, humans might develop an internal model of the nonlinear visuomotor amplitude transformation. Thus, 2 groups were engaged in a sensorimotor adaptation task receiving either continuous or terminal visual feedback during the practice phase. In contrast to expectations, adaptive shifts and aftereffects observed in visual open-loop tests were linearly related to target amplitudes for both groups. Although the 2 feedback groups did not differ with respect to adaptive shifts and aftereffects, terminal visual feedback resulted in stable visual open-loop performance for an extended period, whereas movement errors increased after continuous visual feedback during practice. The benefit of continuous visual feedback, on the other hand, was faster closed-loop performance, indicating an optimization of visual closed-loop control.