Object-based processes in the planning of goal-directed hand movements

Theories in motor control suggest that the parameters specified during the planning of goal-directed hand movements to a visual target are defined in spatial parameters like direction and amplitude. Recent findings in the visual attention literature, however, argue widely for early object-based selection processes. The present experiments were designed to examine the contributions of object-based and space-based selection processes to the preparation time of goal-directed pointing movements. Therefore, a cue was presented at a specific location. The question addressed was whether the initiation of responses to uncued target stimuli could benefit from being either within the same object (object based) or presented at the same direction (space based). Experiment 1 replicated earlier findings of object-based benefits for non-goal-directed responses. Experiment 2 confirmed earlier findings of space-based benefits for goal-directed hand pointing movements. In Experiments 3 and 4, space-based and object-based manipulations were combined while requiring goal-directed hand pointing movements. The results clearly favour the notion that the selection processes for goal-directed pointing movements are primarily object based. Implications for theories on selective attention and action planning are discussed.     

Attentional selection during preparation of prehension movements

In two experiments coupling between dorsal attentional selection for action and ventral attentional selection for perception during preparation of prehension movements was examined. In a dual-task paradigm subjects had to grasp an X-shaped object with either the left or the right hand's thumb and index finger. Simultaneously a discrimination task was used to measure visual attention prior to the execution of the prehension movements: Mask items transiently changed into distractors or discrimination targets. There was exactly one discrimination target per trial, which appeared at one of the four branch ends of the object. In Experiment 1 target position varied randomly while in Experiment 2 it was constant and known to subjects in each block of trials. In both experiments discrimination performance was significantly better for discrimination target positions at to-be-grasped branch ends than for not-to-be-grasped branch ends. We conclude that during preparation of prehension movements visual attention is largely confined to those parts of an object that will be grasped.     

Attentional localization prior to simple and directed manual responses

The relationship between attention and the programming of motor responses was investigated, using a paradigm in which the onsets of targets for movements were preceded by peripheral attentional cues. Simple (button release) and reaching manual responses were compared under conditions in which the subjects either made saccades toward the target location or refrained from making eye movements. The timing of the movement onset was used as the dependent measure for both simple and reaching manual responses. Eye movement latencies were also measured. A follow-up experiment measured the effect of the same peripheral cuing procedure on purely visual processes, using signal detection measures of visual sensitivity and response bias. The results of the first experiment showed that reaction time (RT) increased with the distance between the cued and the target locations. Stronger distance effects were observed when goal-directed responses were required, which suggests enhanced attentional localization of target positions under these conditions. The requirement to generate an eye movement response was found to delay simple manual RTs. However, mean reaching RTs were unaffected by the eye movement condition. Distance gradients on eye movement latencies were relatively shallow, as compared with those on goal-directed manual responses. The second experiment showed that the peripheral cue had only a very small effect on visual detection sensitivity in the absence of directed motor responses. It is concluded that cue-target distance effects with peripheral cues are modulated by the motor-programming requirements of the task. The effect of the peripheral cue on eye movement latencies was qualitatively different from that observed on manual RTs, indicating the existence of separate neural representations underlying both response types. At the same time, the interactions between response modalities are consistent with a supramodal representation of attentional space, within which different motor programs may interact.     

Attentional localization prior to simpleand directed manual responses

The relationship between attention and the programming of motor responses was investigated, using a paradigm in which the onsets of targets for movements were preceded by peripheral attentional cues. Simple (button release) and reaching manual responses were compared under conditions in which the subjects either made saccades toward the target location or refrained from making eye movements. The timing of the movement onset was used as the dependent measure for both simple and reaching manual responses. Eye movement latencies were also measured. A follow-up experiment measured the effect of the same peripheral cuing procedure on purely visual processes, using signal detection mea-sures of visual sensitivity and response bias. The results of the first experiment showed that reaction time (RT) increased with the distance between the cued and the target locations. Stronger distance ef-fects were observed when goal-directed responses were required, which suggests enhanced attentional localization of target positions under these conditions. The requirement to generate an eye movement response was found to delay simple manual RTs. However, mean reaching RTs were unaffected by the eye movement condition. Distance gradients on eye movement latencies were relatively shallow, as compared with those on goal-directed manual responses. The second experiment showed that the peripheral cue had only a very small effect on visual detection sensitivity in the absence of directed motor responses. It is concluded that cue-target distance effects with peripheral cues are modulated by the motor-programming requirements of the task. The effect of the peripheral cue on eye movement latencies was qualitatively different from that observed on manual RTs, indicating the existence of separate neural representations underlying both response types. At the same time, the interactions be-tween response modalities are consistent with a supramodal representation of attentional space, within which different motor programs may interact.     

Inhibition of return is composed of attentional and oculomotor processes

Response time can be delayed if a target stimulus appears at a location or object that was previously cued. This inhibition of return (IOR) phenomenon has been attributed to a delay in activating attentional or motor processes to a previously cued stimulus. Two experiments required subjects to localize or identify a target stimulus. In Experiment 1, the subjects’ eyes were not monitored. In Experiment 2, the subjects’ eyes were monitored, and the subjects were instructed to either execute or withhold an eye movement to a target stimulus. The results indicated that IOR was always present for location and identification responses, supporting an attentional account of IOR. However, IOR was larger when eye movements were executed, indicating that a motor component can contribute to IOR. Finally, when eye movements were withheld, IOR was larger when a target was presented alone than when it was presented with a distractor, suggesting that IOR is larger for exogenous than for endogenous covert orienting. Together, the data indicate that IOR is composed of both an oculomotor component and an attentional component.     

Interactions between goal-directed eye and arm movements: arguments for an interdependent motor control

The accuracy of movements of the arm directed toward a point in space was investigated in healthy human subjects. To study the influence of the eye movement itself, on the guidance of the arm in the absence of any visual context, subjects performed the goal-directed arm movements without visual feedback about the arm displacement and the target position. The subjects were asked either to keep their eyes centered or oriented toward a previously flashed target. The analysis of the distribution of the errors in arm final position in the two conditions suggests that the eye movement influences the final position adopted by the arm. It is postulated that an interaction exists between the eye and arm systems during the motor program elaboration phase.     

Inhibition of return is composed of attentional and oculomotor processes.

Response time can be delayed if a target stimulus appears at a location or object that was previously cued. This inhibition of return (IOR) phenomenon has been attributed to a delay in activating attentional or motor processes to a previously cued stimulus. Two experiments required subjects to localize or identify a target stimulus. In Experiment 1, the subjects' eyes were not monitored. In Experiment 2, the subjects' eyes were monitored, and the subjects were instructed to either execute or withhold an eye movement to a target stimulus. The results indicated that IOR was always present for location and identification responses, supporting an attentional account of IOR. However, IOR was larger when eye movements were executed, indicating that a motor component can contribute to IOR. Finally, when eye movements were withheld, IOR was larger when a target was presented alone than when it was presented with a distractor, suggesting that IOR is larger for exogenous than for endogenous covert orienting. Together, the data indicate that IOR is composed of both an oculomotor component and an attentional component.     

Attention and suppression affect tactile perception in reach-to-grasp movements

Reaching with the hand is characterized by a decrease in sensitivity to tactile stimuli presented to the moving hand. Here, we investigated whether tactile suppression can be canceled by attentional orienting. In a first experiment, participants performed a dual-task involving a goal-directed movement paired with the speeded detection of a tactile pulse. The pulse was either delivered to the moving or stationary hand, during movement preparation, execution, or the post-movement phase. Furthermore, stimulation was delivered with equal probability to either hand, or with a higher probability to either the moving or resting hand. The results highlighted faster RTs under conditions of higher probability of stimulation delivery to both moving and resting hands, thus indicating an attentional effect. For the motor preparation period, RTs were faster only at the resting hand under conditions where tactile stimulation was more likely to be delivered there. In a second experiment, a non-speeded perceptual task was used as a secondary task and tactile discrimination thresholds were recorded. Tactile stimulation was delivered concomitantly at both index fingers either in the movement preparation period (both before and after the selection of the movement effector had taken place), in the motor execution period, or, in a control condition, in the time-window of motor execution, but the movement of the hand was restrained. In the preparation period, tactile thresholds were comparable for the two timings of stimulation delivery; i.e., before and after the selection of the movement effector had taken place. These results therefore suggest that shortly prior to, and during, the execution of goal-directed movements, a combined facilitatory and inhibitory influence acts on tactile perception.     

Impact of action planning on spatial perception: Attention matters

Previous research suggested that perception of spatial location is biased towards spatial goals of planned hand movements. In the present study I show that an analogous perceptual distortion can be observed if attention is paid to a spatial location in the absence of planning a hand movement. Participants judged the position of a target during preparation of a mouse movement, the end point of which could deviate from the target by a varying degree in Exp. 1. Judgments of target position were systematically affected by movement characteristics consistent with perceptual assimilation between the target and the planned movement goal. This effect was neither due to an impact of motor execution on judgments (Exp. 2) nor due to characteristics of the movement cues or of certain target positions (Exp. 3, Exp. 5A). When the task included deployment of attention to spatial positions (former movement goals) in preparation for a secondary perceptual task, an effect emerged that was comparable with the bias associated with movement planning (Exp. 4, Exp. 5B). These results indicate that visual distortions accompanying manipulations of variables related to action could be mediated by attentional mechanisms.     

Between-person effects on attention and action: Joe and Fred revisited

Previous study indicates that target–target inhibition of return (IOR) is not restricted to a single nervous system. Specifically, watching another person perform a goal-directed aiming movement engages similar inhibitory processes on a subsequent aiming attempt as if having performed the preceding movement oneself. This between-person effect has been attributed to the mirror neuron system. In the study reported here, we replicated this finding and examined the relative importance of automatic stimulus alerting events and action–observation by dissociating these two influences. This was done by having two people alternately perform sets of two aiming trials to the same equally probable targets. Under some experimental conditions, one or both of the performers moved to a non-illuminated target. In this way, we dissociated the stimulus and observed event under some between-person conditions. Although IOR was greatest when the stimulus and observed events were compatible, both contributed to the between-person inhibitory processes slowing the responses (Experiment 1). The impact of observing another person perform an aiming movement appears to have more to do with realizing a particular spatial goal than seeing the biological motion associated with achieving that goal (Experiment 2). Findings that both the illumination of a visual target signal and the observation of another person’s action engage similar attention–action processes are consistent with action-based accounts of visual selective attention.     

Attentional Capture by Emotional Stimuli: Manipulation of Emotional Valence by the Sample Pre‐rating Method

Eye movements directed at emotional and neutral pictures were investigated. Participants were instructed to fixate on a target and avoid looking at a non‐target. Results of trials consisting of emotional and neutral pictures were analyzed based on participants’ evaluations of the stimuli before the experiment. Results indicated that the number and duration of fixations were larger and longer for targets than for non‐targets. Further, the probability of first fixation was less for neutral targets than for emotional targets. This suggests that unpleasant pictures capture visual attention and that the attentional orienting is subject to automatic response. The possibility that top‐down processes of visual attention may be involved in attentional capture was also discussed.     

Independent allocation of attention to eye and hand targets in coordinated eye-hand movements

When reaching for objects, people frequently look where they reach. This raises the question of whether the targets for the eye and hand in concurrent eye and hand movements are selected by a unitary attentional system or by independent mechanisms. We used the deployment of visual attention as an index of the selection of movement targets and asked observers to reach and look to either the same location or separate locations. Results show that during the preparation of coordinated movements, attention is allocated in parallel to the targets of a saccade and a reaching movement. Attentional allocations for the two movements interact synergistically when both are directed to a common goal. Delaying the eye movement delays the attentional shift to the saccade target while leaving attentional deployment to the reach target unaffected. Our findings demonstrate that attentional resources are allocated independently to the targets of eye and hand movements and suggest that the goals for these effectors are selected by separate attentional mechanisms.     

Coding processes in preselected and constrained movements: effect of vision

Three experiments were conducted in which visual information was manipulated either at the endpoint or during preselected, subject defined and constrained, experimenter-defined movements. In Experiments 1 and 2 the subject's task was to reproduce the movement in the absence of vision. Augmenting the terminal location of the criterion movement with vision had no differential effect on reproduction in Experiment 1, although preselected movement accuracy was significantly superior to constrained. Providing vision throughout the criterion movement in Experiment 2 not only failed to improve the accuracy of constrained movements but decreased reproduction performance in preselected movements. In Experiment 3 procedures were adopted to control the allocation of the subjects' attention during the criterion movement. The subjects reproduced by vision alone, movement alone, or with both visual and movement information available. When subjects were informed of the modality of reproduction prior to criterion presentation, they were able to ignore concurrent input from vision and attend to movement information. In the absence of precues visual information was spontaneously attended. The data were interpreted as contrary to closed-loop assumptions that additional information necessarily enhances the strength of a motor memory representation. Rather, they can be accommodated in terms of Posner, Nissen and Klein's (1976) theoretical account of visual dominance and serve to illustrate the importance of selective attention effects in movement coding.     

Dividing attention between auditory and visual perception

To what extent is simultaneous visual and auditory perception subject to capacity limitations and attentional control? Two experiments addressed this question by asking observers to recognize test tones and test letters under selective and divided attention. In Experiment 1, both stimuli occurred on each trial, but subjects were cued in advance to process just one or both of the stimuli. In Experiment 2, subjects processed one stimulus and then the other or processed both stimuli simultaneously. Processing time was controlled using a backward recognition masking task. A significant, but small, attention effect was found in both experiments. The present positive results weaken the interpretation that previous attentional effects were due to the particular duration judgment task that was employed. The answer to the question addressed by the experiments appears to be that the degree of capacity limitations and attentional control during visual and auditory perception is small but significant.     

Neural correlates of partial transmission of sensorimotor information in the cerebral cortex

Using single neuron recordings in monkey primary motor (MI) cortex, two series of experiments were conducted in order to know whether response preparation can begin before perceptual processing finishes, thus providing evidence for a temporal overlap of perceptual and motor processes.

In Experiment 1, a “left/right, Go/No-Go” reaction time (RT) task was used. One monkey was trained to perform wrist flexion/extension movements to align a pointer with visual targets. The visual display was organized to provide a two-dimensional stimulus: side (an easy discrimination between left and right targets) which determined movement direction, and distance (a difficult discrimination between distal and proximal targets) which determined whether or not the movement was to be made. Changes in neuronal activity, when they were time-locked to the stimulus, were almost similar in the Go and No-Go trials, and when they were time-locked to movement onset, were markedly reduced in No-Go as compared to Go trials.

In Experiment 2, a stimulus-response compatibility (SRC) task was used. Two monkeys were trained to align a pointer with visual targets, on either left or right. In the spatially “compatible” trials, they had to point at the stimulus position, whereas in the “incompatible” trials, they had to point at the target located in the opposite side. For 12.5% of neurons, changes in activity associated with incompatible trials looked like changes in activity associated with movements performed in the opposite direction during compatible trials, thus suggesting the hypothesis of an automatic activation of the congruent, but incorrect response.

Results of both experiments provide evidence for a partial transmission of information from visual to motor cortical areas: that is, in the No-Go trials of the first task, information about movement direction, before the decision to perform or not this movement was made, and, in the incompatible trials of the SRC task, information about the congruent, but incorrect response, before the incongruent, but correct response was programmed.     

Adults with probable developmental coordination disorder selectively process early visual,but not tactile information during action preparation. An electrophysiological study

Developmental coordination disorder (DCD) is a neurodevelopmental condition affecting motor coordination in children and adults. Here, EEG signals elicited by visual and tactile stimuli were recorded while adult participants with and without probable DCD (pDCD) performed a motor task. The task cued reaching movements towards a location in visible peripersonal space as well as an area of unseen personal space. Event-related potentials elicited by visual and tactile stimuli revealed that visual processing was strongly affected by movement preparation in the pDCD group, even more than in controls. However, in contrast to the controls, tactile processing in unseen space was unaffected by movement preparation in the pDCD group. The selective use of sensory information from vision and proprioception is fundamental for the adaptive control of movements, and these findings suggest that this is impaired in DCD. Additionally, the pDCD group showed attenuated motor rhythms (beta: 13–30 Hz) over sensorimotor regions following cues to prepare movements towards unseen personal space. The results reveal that individuals with pDCD exhibit differences in the neural mechanisms of spatial selection and action preparation compared to controls, which may underpin the sustained difficulties they experience. These findings provide new insights into the neural mechanisms potentially disrupted in this highly prevalent disorder.     

The mechanism of priming: episodic retrieval or priming of pop-out?

Previous studies indicate that priming affects attentional processes, facilitating processes of target detection and selection on repetition trials. However, the results are so far compatible with two different attentional views that propose entirely different mechanisms to account for priming. The priming of pop-out hypothesis explains priming by feature weighting processes that lead to more frequent selections of nontarget items on switch trials. According to the episodic retrieval account, switch trials conversely lead to temporal delays in retrieving priority rules that specify the target. The results from two eye tracking experiments clearly favour the priming of pop-out hypothesis: Switching the target and nontarget features leads to more frequent selection of nontargets, without affecting the time-course of saccades to a great extent. The results from two more control experiments demonstrate that the same results can be obtained in a visual search task that allows only covert attention shifts. This indicates that eye movements can reliably indicate covert attention shifts in visual search.     

Attentional capture and aging: implications for visual search performance and oculomotor control

Two studies examined potential age-related differences in attentional capture. Subjects were instructed to move their eyes as quickly as possible to a color singleton target and to identify a small letter located inside it. On half the trials, a new stimulus (i.e., a sudden onset) appeared simultaneously with the presentation of the color singleton target. The onset was always a task-irrelevant distractor. Response times were lengthened, for both young and old adults, whenever an onset distractor appeared, despite the fact that subjects reported being unaware of the appearance of the abrupt onset. Eye scan strategies were also disrupted by the appearance of the onset distractors. On about 40% of the trials on which an onset appeared, subjects made an eye movement to the task-irrelevant onset before moving their eyes to the target. Fixations close to the onset were brief, suggesting parallel programming of a reflexive eye movement to the onset and goal-directed eye movement to the target. Results are discussed in terms of age-related sparing of the attentional and oculomotor processes that underlie attentional capture.     

Hemispheric asymmetries in attentional control: implications for hand preference in sensorimotor tasks

Liepmann (1908) proposed that handedness reflects the greater capacity of one hemisphere to learn the execution of skilled movements. Although asymmetries in motor control are an important basis for hand asymmetries, recent studies have suggested that handedness may be determined by multiple factors. In the present study, we examine how attentional asymmetries may contribute to hand preferences. Right-handed subjects participated in a reaction time task in which they were given preliminary information about where a target stimulus would occur (selective attention) or which hand to use for responding (selective intention). Our findings indicate that these processes influence each other reciprocally and favor a state of optimal attentional and intentional preparation of the right hand. We suggest that these hemispheric asymmetries in attentional control contribute to hand preferences in certain sensorimotor tasks.     

Optimizing the Use of Vision in Manual Aiming: The Role of Practice

The purpose of this study was to determine how subjects learn to adjust the characteristics of their manual aiming movements in order to make optimal use of the visual information and reduce movement error. Subjects practised aiming (120 trials) with visual information available for either 400 msec or 600 msec. Following acquisition, they were transferred to conditions in which visual information was available for either more or less time. Over acquisition, subjects appeared to reduce target-aiming error by moving to the target area more quickly in order to make greater use of vision when in the vicinity of the target. With practice, there was also a reduction in the number of modifications in the movement. After transfer, both performance and kinematic data indicated that the time for which visual information was available was a more important predictor of aiming error than the similarity between training and transfer conditions. These findings are not consistent with a strong “specificity of learning” position. They also suggest that, if some sort of general representation or motor programme develops with practice, that representation includes rules or procedures for the utilization of visual feedback to allow for the on-line adjustment of the goal-directed movement.