Temporal coordination during bimanual reach-to-grasp movements: The role of vision

The performance of bimanual movements involving separate objects presents an obvious challenge to the visuo-motor system: Visual feedback can only be obtained from one target at a time. To overcome this challenge overt shifts in visual attention may occur so that visual feedback from both movements may be used directly (Bingham, Hughes, & Mon-Williams, 2008; Riek, Tresilian, Mon-Williams, Coppard, & Carson, 2003). Alternatively, visual feedback from both movements may be obtained in the absence of eye movements, presumably by covert shifts in attention (Diedrichsen, Nambisan, Kennerley, & Ivry, 2004). Given that the quality of information falls with increasing distance from the fixated point, can we obtain the level of information required to accurately guide each hand for precision grasping of separate objects without moving our eyes to fixate each target separately? The purpose of the current study was to examine how the temporal coordination between the upper limbs is affected by the quality of visual information available during the performance of a bimanual task. A total of 11 participants performed congruent and incongruent movements towards near and/or far objects. Movements were performed in natural, fixate-centre, fixate-left, and fixate-right vision conditions. Analyses revealed that the transport phase of incongruent movements was similar across vision conditions for the temporal aspects of both the transport and grasp, whereas the spatial aspects of grasp formation were influenced by the quality of visual feedback. We suggest that bimanual coordination of the temporal aspects of reach-to-grasp movements are not influenced solely by overt shifts in visual attention but instead are influenced by a combination of factors in a task-constrained way.     

Asynchrony in discrete bimanual aiming: Evidence for visual strategies of coordination

The bimanual coupling literature supposes an inherent drive for synchrony between the upper limbs when making discrete bimanual movements. The level of synchrony is argued to be task dependent, reliant on the visual demands of the two targets, and the result of a complex pattern of hand and eye movements (Bingham, Hughes, & Mon-Williams, 2008 Bingham, G. P., Hughes, K. and Mon-Williams, M. 2008. The coordination patterns observed when two hands reach-to-grasp separate objects. Experimental Brain Research, 184: 283–293. [Crossref], [PubMed], [Web of Science ®] , [Google Scholar]; Riek, Tresilian, Mon-Williams, Coppard, & Carson, 2003 Riek, S., Tresilian, J. R., Mon-Williams, M., Coppard, V. L. and Carson, R. G. 2003. Bimanual aiming and overt attention: One law for two hands. Experimental Brain Research, 153: 59–75. [Crossref], [PubMed], [Web of Science ®] , [Google Scholar]). However, recent work by Bruyn and Mason (2009 Bruyn, J. L. and Mason, A. H. 2009. Temporal coordination during bimanual reach-to-grasp movements: The role of vision. The Quarterly Journal of Experimental Psychology, 62(7): 1328–1342. [Taylor & Francis Online] , [Google Scholar]) suggests that temporal coordination is not solely influenced by visual saccades. In this experimental series, a total of 8 participants performed congruent movements to targets either near or far from the midline. Targets far from the midline, requiring a visual saccade, resulted in greater terminal asynchrony. Initial and terminal asynchrony were not consistent, but linked to the task demands at that stage of the movement. If the asynchrony evident at the end of a bimanual movement is due to a complex pattern of hand and eye movements then the removal of visual feedback should result in an increase in synchrony. Sixteen participants then completed congruent and incongruent bimanual aiming movements to near and/or far targets. Movements were made with or without visual feedback of hands and targets. Analyses revealed that movements made without visual feedback showed increased synchrony between the limbs, yet movements to incongruent targets still showed greater asynchrony. We suggest that visual constraints are not the sole cause of asynchrony in discrete bimanual movements.     

The impact of perceptual, cognitive and motor factors on bimanual coordination

Bimanual coordination is governed by constraints that permit congruent movements to be performed more easily than incongruent movements. Theories concerning the origin of these constraints range from low level motor-muscle explanations to high level perceptual–cognitive ones. To elucidate the processes underlying coordinative constraints, we asked subjects to use a pair of left–right joysticks to acquire corresponding pairs of congruent and incongruent targets presented on a video monitor under task conditions designed to systematically modulate the impact of several perceptual–cognitive processes commonly required for bimanual task performance. These processes included decoding symbolic cues, detecting goal targets, conceptualizing movements in terms of goal target configuration, planning movement trajectories, producing saccades and perceiving visual feedback. Results demonstrate that constraints arise from target detection and trajectory planning processes that can occur prior to movement initiation as well as from inherent muscle properties that emerge during movement execution, and that the manifestation of these constraints can be significantly altered by the ability to visually monitor movement progress.     

Bimanual circling in deafferented patients: Evidence for a role of visual forward models

The present study investigated the role of ideation and visual feedback, and their interaction in movement control in the absence of somatosensory feedback, with the hypothesis that visual imagery and internal visual models may play a crucial role in performance even without feedback. Two chronically deafferented participants, GL and IW, circled bimanually two occluded cranks first without vision and then with hand‐congruent and hand‐incongruent visual feedback provided by visible flags. Without vision, GL was unable to circle the cranks. In contrast, IW performed spontaneously a symmetric pattern. Again without feedback, IW performed an instructed symmetric crank pattern well, but was unable to perform anti‐phase cranking. With hand‐congruent visual feedback, GL and IW were able to perform both symmetric and anti‐phase movements, with symmetry being more accurate. Visual feedback during preceding trials made possible trials without visual feedback in GL and improved anti‐phase trials in IW. Frequency‐transformed incongruent visual feedback resulted in poor performance in part due to unsuitable hand‐related strategies. However, IW improved in the latter task after detailed explanations of the condition. In conclusion, we suggest that both participants use visual imagery and visual forward models to control their hand movements. Visual updating of the forward model also improves performance with no vision. In addition, IW seemed to have been able to move from a focus on hand position to one on the transformed visual feedback to improve movement control in the incongruent feedback/movement condition.     

Performance of unimanual and bimanual multiphased prehensile movements

By manipulating task action demands in 2 experiments, the author investigated whether the context-dependent effects seen in unimanual multiphase movements are also present in bimanual movements. Participants (N = 14) in Experiment 1 either placed or tossed objects into targets. The results indicated that the intention to perform a subsequent action with an object could influence the performance of an earlier movement in a sequence in both unimanual and bimanual tasks. Furthermore, assimilation effects were found when the subsequent tasks being performed by the 2 hands were incongruent. In Experiment 2, the author investigated in 12 participants whether planning in a multiphase movement includes some representation of the accuracy demands of the subsequent task. The accuracy demands of a subsequent task did not appear to influence initial movement planning. Instead, the present results support the notion that it is the action requirements of the subsequent movement that lead to context-dependent effects.     

Eye movements may cause motor contagion effects

When a person executes a movement, the movement is more errorful while observing another person’s actions that are incongruent rather than congruent with the executed action. This effect is known as “motor contagion”. Accounts of this effect are often grounded in simulation mechanisms: increased movement error emerges because the motor codes associated with observed actions compete with motor codes of the goal action. It is also possible, however, that the increased movement error is linked to eye movements that are executed simultaneously with the hand movement because oculomotor and manual-motor systems are highly interconnected. In the present study, participants performed a motor contagion task in which they executed horizontal arm movements while observing a model making either vertical (incongruent) or horizontal (congruent) movements under three conditions: no instruction, maintain central fixation, or track the model’s hand with the eyes. A significant motor contagion-like effect was only found in the ‘track’ condition. Thus, ‘motor contagion’ in the present task may be an artifact of simultaneously executed incongruent eye movements. These data are discussed in the context of stimulation and associative learning theories, and raise eye movements as a critical methodological consideration for future work on motor contagion.     

Probing Representations of Gymnastics Movements: A Visual Priming Study

In this study, we designed a visual short‐term priming paradigm to investigate the mechanisms underlying the priming of movements and to probe movement representations in motor experts and matched controls. We employed static visual stimuli that implied or not human whole‐body movements, that is, gymnastics movements and static positions. Twelve elite female gymnasts and twelve matched controls performed a speeded two‐choice response time task. The participants were presented with congruent and incongruent prime‐target pairs and had to decide whether the target stimulus represented a gymnastics movement or a static position. First, a visual priming effect was observed in the two groups. Second, a stimulus–response rote association could not easily account for our results. Novel primes never presented as targets could also prime the targets. Third, by manipulating three levels of prime‐target relations in moving congruent pairs, we demonstrated that the more similar prime‐target pairs, the greater the facilitation in target. Lastly, gymnastics motor expertise impacted on priming effects.     

The prioritization of visuo-spatial associations during mental imagery

While previous research has shown that during mental imagery participants look back to areas visited during encoding it is unclear what happens when information presented during encoding is incongruent. To investigate this research question, we presented 30 participants with incongruent audio-visual associations (e.g. the image of a car paired with the sound of a cat) and later asked them to create a congruent mental representation based on the auditory cue (e.g. to create a mental representation of a cat while hearing the sound of a cat). The results revealed that participants spent more time in the areas where they previously saw the object and that incongruent audio-visual information during encoding did not appear to interfere with the generation and maintenance of mental images. This finding suggests that eye movements can be flexibly employed during mental imagery depending on the demands of the task.

     

Acquiring a Novel Coordination Skill without Practicing the Correct Motor Commands

There is evidence that experience of the sensory consequences, in the absence of practice of the required motor commands, is sufficient to learn new bimanual coordination patterns. This was shown through improvements of an incongruent group who practiced a desired 30° phase offset between the limbs while 1 limb was weighted such that the desired phase relation was achieved when synchronous motor commands were sent to the limbs (P. Atchy-Delama, P. G. Zanone, C. E. Peper, & P. J. Beek, 2005). In addition to testing a similar incongruent and congruent group (i.e., no weight), the authors extended this experiment by removing visual feedback during practice and by including an auditory modeling and passive guidance group. All groups showed improvement, except for the modeling group. The passive guidance group made more errors in posttests than the congruent and incongruent groups. Only the congruent group increased the amount of time around 30° after practice. Active experience of the sensory consequences combined with practice sending appropriate motor commands is the most effective method for learning, even though strategic improvements can be attained without experience of the latter.     

DISSOCIATION OF SPATIAL AND TEMPORAL COUPLING IN THE BIMANUAL MOVEMENTS OF CALLOSOTOMY PATIENTS

Abstract— The neural mechanisms of limb coordination were investigated by Jesting callosotomy patients and normal control subjects on bimanual movements. Normal subjects produced deviations in the trajectories when spatial demands for the two spatial deviations, although their hands moved with normal temporal synchrony. Normal subjects but not callosotomy patients exhibited large increases in planning and execution time for movements with different spatial demands for the two hands relative to movements with identical spatial demands for the two hands. This neural dissociation indicate that spatial interference in movements results from callosal connections whereas temporal synchrony in movement onset does not rely on the corpus callosum.     

Effects of S-R and R-R compatibility on bimanual movement time

Bimanual asymmetrical movements are generally found to be slower than symmetrical movements but asymmetrical movement normally involves visual separation of targets which might account for the effect. By using a system in which the subject controls two cursors on an oscilloscope screen by moving two levers the S-R relationship on either hand can be reversed, thus providing an asymmetrical movement task without visual separation of targets. Movement times for five right-handed subjects were recorded on four unimanual and six bimanual conditions varying with respect to both S-R and R-R compatibility. In the unimanual conditions, the left hand was found to be as fast as the right when the opposite S-R relationship was used. In the bimanual tasks visual separation of targets was a relatively minor factor movement time being strongly influenced by S-R compatibility and to a lesser degree by R-R compatibility. The results suggest that compatibility, rather than being a property of a single central channel, differs, as between the two cerebral hemispheres.     

Intrinsic and extrinsic contributions to heavy tails in visual foraging

Eyes move over visual scenes to gather visual information. Studies have found heavy-tailed distributions in measures of eye movements during visual search, which raises questions about whether these distributions are pervasive to eye movements, and whether they arise from intrinsic or extrinsic factors. Three different measures of eye movement trajectories were examined during visual foraging of complex images, and all three were found to exhibit heavy tails: Spatial clustering of eye movements followed a power law distribution, saccade length distributions were lognormally distributed, and the speeds of slow, small amplitude movements occurring during fixations followed a 1/f spectral power law relation. Images were varied to test whether the spatial clustering of visual scene information is responsible for heavy tails in eye movements. Spatial clustering of eye movements and saccade length distributions were found to vary with image type and task demands, but no such effects were found for eye movement speeds during fixations. Results showed that heavy-tailed distributions are general and intrinsic to visual foraging, but some of them become aligned with visual stimuli when required by task demands. The potentially adaptive value of heavy-tailed distributions in visual foraging is discussed.     

Control of Rapid Arm Movements When Target Position Is Altered During Saccadic Suppression

This experiment examined whether rapid arm movements can be corrected in response to a change in target position that occurs just prior to movement onset, during saccadic suppression of displacement. Because the threshold of retinal input reaches its highest magnitude at that time, displacement of the visual target of a saccade is not perceived. Subjects (N = 6) were instructed to perform very rapid arm movements toward visual targets located 16, 20, and 24 degrees from midline (on average, movement time was 208 ms). On some trials the 20 degrees target was displaced 4 degrees either to the right or to the left during saccadic suppression. For double-step trials, arm movements did not deviate from their original trajectory. Movement endpoints and movement structure (i.e., velocity-and acceleration-time profiles) were similar whether or not target displacements occurred, showing the failure of proprioceptive signals or internal feedback loops to correct the arm trajectory. Following this movement, terminal spatially oriented movements corrected the direction of the initial movement (as compared with the single-step control trials) when the target eccentricity decreased by 4 degrees. Subjects were unaware of these spatial corrections. Therefore, spatial corrections of hand position were driven by the goal level of the task, which was updated by oculomotor corrective responses when a target shift occurred.     

Visual saliency and semantic incongruency influence eye movements when inspecting pictures

Models of low-level saliency predict that when we first look at a photograph our first few eye movements should be made towards visually conspicuous objects. Two experiments investigated this prediction by recording eye fixations while viewers inspected pictures of room interiors that contained objects with known saliency characteristics. Highly salient objects did attract fixations earlier than less conspicuous objects, but only in a task requiring general encoding of the whole picture. When participants were required to detect the presence of a small target, then the visual saliency of nontarget objects did not influence fixations. These results support modifications of the model that take the cognitive override of saliency into account by allowing task demands to reduce the saliency weights of task-irrelevant objects.

The pictures sometimes contained incongruent objects that were taken from other rooms. These objects were used to test the hypothesis that previous reports of the early fixation of congruent objects have not been consistent because the effect depends upon the visual conspicuity of the incongruent object. There was an effect of incongruency in both experiments, with earlier fixation of objects that violated the gist of the scene, but the effect was only apparent for inconspicuous objects, which argues against the hypothesis.     

Visual saliency and semantic incongruency influence eye movements when inspecting pictures

Models of low-level saliency predict that when we first look at a photograph our first few eye movements should be made towards visually conspicuous objects. Two experiments investigated this prediction by recording eye fixations while viewers inspected pictures of room interiors that contained objects with known saliency characteristics. Highly salient objects did attract fixations earlier than less conspicuous objects, but only in a task requiring general encoding of the whole picture. When participants were required to detect the presence of a small target, then the visual saliency of nontarget objects did not influence fixations. These results support modifications of the model that take the cognitive override of saliency into account by allowing task demands to reduce the saliency weights of task-irrelevant objects.

The pictures sometimes contained incongruent objects that were taken from other rooms. These objects were used to test the hypothesis that previous reports of the early fixation of congruent objects have not been consistent because the effect depends upon the visual conspicuity of the incongruent object. There was an effect of incongruency in both experiments, with earlier fixation of objects that violated the gist of the scene, but the effect was only apparent for inconspicuous objects, which argues against the hypothesis.     

Neural correlates of partial transmission of sensorimotor information in the cerebral cortex

Using single neuron recordings in monkey primary motor (MI) cortex, two series of experiments were conducted in order to know whether response preparation can begin before perceptual processing finishes, thus providing evidence for a temporal overlap of perceptual and motor processes.

In Experiment 1, a “left/right, Go/No-Go” reaction time (RT) task was used. One monkey was trained to perform wrist flexion/extension movements to align a pointer with visual targets. The visual display was organized to provide a two-dimensional stimulus: side (an easy discrimination between left and right targets) which determined movement direction, and distance (a difficult discrimination between distal and proximal targets) which determined whether or not the movement was to be made. Changes in neuronal activity, when they were time-locked to the stimulus, were almost similar in the Go and No-Go trials, and when they were time-locked to movement onset, were markedly reduced in No-Go as compared to Go trials.

In Experiment 2, a stimulus-response compatibility (SRC) task was used. Two monkeys were trained to align a pointer with visual targets, on either left or right. In the spatially “compatible” trials, they had to point at the stimulus position, whereas in the “incompatible” trials, they had to point at the target located in the opposite side. For 12.5% of neurons, changes in activity associated with incompatible trials looked like changes in activity associated with movements performed in the opposite direction during compatible trials, thus suggesting the hypothesis of an automatic activation of the congruent, but incorrect response.

Results of both experiments provide evidence for a partial transmission of information from visual to motor cortical areas: that is, in the No-Go trials of the first task, information about movement direction, before the decision to perform or not this movement was made, and, in the incompatible trials of the SRC task, information about the congruent, but incorrect response, before the incongruent, but correct response was programmed.     

Age-related differences and the role of augmented visual feedback in learning a bimanual coordination pattern

The purpose of this study was to investigate the effects of aging and the role of augmented visual information in the acquisition of a new bimanual coordination pattern, namely a 90° relative phase pattern. In a pilot study, younger and older adults received augmented visual feedback in the form of a real-time orthogonal display of both limb movements after every fifth trial. Younger adults acquired this task over three days of practice and retained the task well over periods of one week and one month of no practice while the older adults showed no improvement at all on the task. It was hypothesized that the amount of augmented information was not sufficient for the older adults to overcome the strong tendency to perform natural, intrinsically stable coordination patterns, which consequently prevented them from learning the task. The present study evaluated the age-related role of augmented visual feedback for learning the new pattern. Participants were randomly assigned within age groups to receive either concurrent or terminal visual feedback after every trial in acquisition. In contrast to the pilot study, all of the older adults learned the pattern, although not to the same level as the younger adults. Both younger and older adults benefitted from concurrent visual feedback, but the older adults gained more from the concurrent feedback than the younger adults, relative to terminal feedback conditions. The results suggest that when learning bimanual coordination patterns, older adults are more sensitive to the structure of the practice conditions, particularly the availability of concurrent visual information. This greater sensitivity to the learning environment may reflect a diminished capacity for inhibitory control and a decreased ability to focus attention on the salient aspects of learning the task.     

Unimanual and bimanual continuous movements benefit from visual instructions in persons with down syndrome

ABSTRACT The authors' aim was to understand how persons with Down syndrome (DS) perform different tasks and to assess if there were any differences in performance based on the type of instructions. This is important because of neurological differences in persons with DS and neurological demands for performing different types of tasks. Twenty right-handed participants with DS, 20 chronological age-matched (CA), and 20 mental age-matched (MA) performed unimanual, bimanual, discrete, and continuous drumming following visual, auditory, and verbal instructions. Overall, discrete drumming was performed with shorter movement times than continuous drumming and unimanual drumming was performed with shorter movement amplitude than bimanual drumming. With respect to instructions, persons with DS performed with smaller amplitudes, thus more efficient movements, following the visual instructions than auditory and verbal instructions for all types of tasks, whereas CA performed similarly with all instructions and MA performed with smaller amplitudes with visual instructions than auditory instructions. These results suggest that visual instruction provides the best information for people with DS to aid in performance of many different types of movements.     

Functional coupling between the limbs during bimanual reach-to-grasp movements

While it is frequently advantageous to be able to use our hands independently, many actions demand that we use our hands co-operatively. In this paper we present two experiments that examine functional binding between the limbs during the execution of bimanual reach-to-grasp movements. The first experiment examines the effect of gaze direction on unimanual and bimanual reaches. Even when subjects' eye movements are restricted during bimanual reaches so that they may only foveate one target object, the limbs remain tightly synchronized to a common movement duration. In contrast, grip aperture is independently scaled to the size of the target for each hand. The second experiment demonstrates however, that the independent scaling of grip aperture is task dependent. If the two target objects are unified so that they appear to be part of a single object, grip apertures become more similar across the hands (i.e., grip aperture to the large target object is reduced in size while peak aperture to the small target item is increased in size). These results suggest that the coupling of the limbs can operate at a functional level.     

Bimanual movement control: Information processing and interaction effects

Three experiments were designed to investigate the underlying processes in bimanual control. With one hand alone, or with both simultaneously, subjects moved styli from the midline of the body to lateral targets as quickly and accurately as possible. The distance moved and the weight of the styli were varied. Results of reaction time, movement time, and kinematic trajectory analyses question the conclusions of Kelso, Southard and Goodman (1979) regarding the synchronicity of movement of the two limbs. Temporal parameters for the two limbs indicated marked departures from synchronicity, and there was evidence for a left-right asymmetry. The dependent variables of movement time and constant error indicated that there was interaction between the two limbs. The results are discussed in terms of three postulated processes underlying bimanual movement: limb selection (one or two), specification of movement locations and the specification of movement intensities.