Hand path priming in manual obstacle avoidance: evidence for abstract spatiotemporal forms in human motor control

Previous research suggests that motor equivalence is achieved through reliance on effector-independent spatiotemporal forms. Here the authors report a series of experiments investigating the role of such forms in the production of movement sequences. Participants were asked to complete series of arm movements in time with a metronome and, on some trials, with an obstacle between 1 or more of the target pairs. In moves following an obstacle, participants only gradually reduced the peak heights of their manual jumping movements. This hand path priming effect, scaled with obstacle height, was preserved when participants cleared the obstacle with 1 hand and continued with the other, and it was modulated by future task demands. The results are consistent with the hypothesis that the control of movement sequences relies on abstract spatiotemporal forms. The data also support the view that motor programming is largely achieved by changing just those features that distinguish the next movement to be made from the movement that was just made.     

Conditional control in visual selection

Attention and eye movements provide a window into the selective processing of visual information. Evidence suggests that selection is influenced by various factors and is not always under the strategic control of the observer. The aims of this tutorial review are to give a brief introduction to eye movements and attention and to outline the conditions that help determine control. Evidence suggests that the ability to establish control depends on the complexity of the display as well as the point in time at which selection occurs. Stimulus-driven selection is more probable in simple displays than in complex natural scenes, but it critically depends on the timing of the response: Salience determines selection only when responses are triggered quickly following display presentation, and plays no role in longer-latency responses. The time course of selection is also important for the relationship between attention and eye movements. Specifically, attention and eye movements appear to act independently when oculomotor selection is quick, whereas attentional processes are able to influence oculomotor control when saccades are triggered only later in time. This relationship may also be modulated by whether the eye movement is controlled in a voluntary or an involuntary manner. To conclude, we present evidence that shows that visual control is limited in flexibility and that the mechanisms of selection are constrained by context and time. The outcome of visual selection changes with the situational context, and knowing the constraints of control is necessary to understanding when and how visual selection is truly controlled by the observer.     

Obstacle avoidance under automated steering: Impact on driving and gaze behaviours

Within the context of more and more autonomous vehicles, an automatic lateral control device (AS: Automatic Steering) was used to steer the vehicle along the road without drivers’ intervention. The device was not able to detect and avoid obstacles. The experiment aimed to analyse unexpected obstacle avoidance manoeuvres when lateral control was delegated to automation. It was hypothesized that drivers skirting behaviours and eye movement patterns would be modified with automated steering compared with a control situation without automation. Eighteen participants took part in a driving simulator study. Steering behaviours and eye movements were analysed during obstacle avoidance episodes. Compared with driving without automation, skirting around obstacles was found to be less effective when drivers had to return from automatic steering to manual control. Eye movements were modified in the presence of automatic steering, revealing further ahead visual scanning of the driving environment. Resuming manual control is not only a problem of action performance but is also related to the reorganisation of drivers’ visual strategies linked to drivers’ disengagement from the steering task. Assistance designers should pay particular attention to potential changes in drivers’ activity when carrying out development work on highly automated vehicles.     

The role of response selection in sequence learning

We investigated the role of response selection in sequence learning in the serial reaction time (SRT) task, by manipulating stimulus-response compatibility. Under conditions in which other types of learning, like perceptual, response-based, and response-effect learning, were unaffected, sequence learning was better with an incompatible than with a compatible stimulus-response mapping. Stimulus discriminability, on the other hand, had no influence on the amount of sequence learning. This indicates that the compatibility effects cannot be accounted for by a different level of task difficulty. Relating our results to the dimensional overlap model (Kornblum, Hasbroucq, & Osman, 1990), which assumes that incompatible stimulus-response mappings require more controlled response selection than do compatible stimulus-response mapping, we suggest that sequence learning in the SRT task is particularly effective when response selection occurs in a controlled way.     

The role of response selection in sequence learning

We investigated the role of response selection in sequence learning in the serial reaction time (SRT) task, by manipulating stimulus–response compatibility. Under conditions in which other types of learning, like perceptual, response-based, and response-effect learning, were unaffected, sequence learning was better with an incompatible than with a compatible stimulus–response mapping. Stimulus discriminability, on the other hand, had no influence on the amount of sequence learning. This indicates that the compatibility effects cannot be accounted for by a different level of task difficulty. Relating our results to the dimensional overlap model (Kornblum, Hasbroucq, & Osman, 1990), which assumes that incompatible stimulus–response mappings require more controlled response selection than do compatible stimulus–response mapping, we suggest that sequence learning in the SRT task is particularly effective when response selection occurs in a controlled way.     

Action goal selection and motor planning can be dissociated by tool use

The preparation of eye or hand movements enhances visual perception at the upcoming movement end position. The spatial location of this influence of action on perception could be determined either by goal selection or by motor planning. We employed a tool use task to dissociate these two alternatives. The instructed goal location was a visual target to which participants pointed with the tip of a triangular hand-held tool. The motor endpoint was defined by the final fingertip position necessary to bring the tool tip onto the goal. We tested perceptual performance at both locations (tool tip endpoint, motor endpoint) with a visual discrimination task. Discrimination performance was enhanced in parallel at both spatial locations, but not at nearby and intermediate locations, suggesting that both action goal selection and motor planning contribute to visual perception. In addition, our results challenge the widely held view that tools extend the body schema and suggest instead that tool use enhances perception at those precise locations which are most relevant during tool action: the body part used to manipulate the tool, and the active tool tip.     

Response-specific effects of pain observation on motor behavior

How does seeing a painful event happening to someone else influence the observer's own motor system? To address this question, we measured simple reaction times following videos showing noxious or innocuous implements contacting corporeal or noncorporeal objects. Key releases in a go/nogo task were speeded, and key presses slowed, after subjects saw a video of a needle pricking a fingertip. No such effect was seen when the observed hand was replaced by a sponge, nor when the needle was replaced by a cotton bud. These findings demonstrate that pain observation modulates the motor system by speeding withdrawal movements and slowing approach movements of the finger. This illustrates a basic mechanism by which visual information about pain is used to facilitate appropriate behavioral responses.     

Effects of feedback from active and passive body parts on spatial and temporal parameters in sensorimotor synchronization

Previous research on sensorimotor synchronization has manipulated the somatosensory information received from the tapping finger to investigate how feedback from an active effector affects temporal coordination. The current study explored the role of feedback from passive body parts in the regulation of spatiotemporal motor control parameters by employing a task that required finger tapping on one’s own skin at anatomical locations of varying tactile sensitivity. A motion capture system recorded participants’ movements as they synchronized with an auditory pacing signal by tapping with the right index finger on either their left index fingertip (Finger/Finger) or forearm (Finger/Forearm). Results indicated that tap timing was more variable, and movement amplitude was larger and more variable, when tapping on the finger than when tapping on the less sensitive forearm. Finger/Finger tapping may be impaired relative to Finger/Forearm tapping due to ambiguity arising through overlap in neural activity associated with tactile feedback from the active and the passive limb in the former. To compensate, the control system may strengthen the assignment of tap-related feedback to the active finger by generating correlated noise in movement kinematics and tap dynamics.     

The neural basis of cognitive control: Response selection and inhibition

The functional neuroanatomy of tasks that recruit different forms of response selection and inhibition has to our knowledge, never been directly addressed in a single fMRI study using similar stimulus–response paradigms where differences between scanning time and sequence, stimuli, and experimenter instructions were minimized. Twelve right-handed participants were scanned on two standard cognitive control tasks, a stimulus–response incompatibility task, and a response inhibition task. A compound trial design allowed comparison of preparing to inhibit an upcoming automatic response to wholly inhibiting an automatic response. Furthermore, inhibiting an automatic response to perform an alternative task-relevant response was compared to wholly inhibiting an automatic response. No differences were found in prefrontal activity when preparing to inhibit an automatic response was compared to wholly inhibiting an automatic response, suggesting a mostly common network. The left inferior frontal gyrus was found to be commonly recruited during both tasks when controlled responses were required, likely due to its role in response selection. In contrast, the right inferior frontal gyrus was found to be more involved when task demands were stronger for response inhibition. Our results are largely consistent with models of cognitive control that postulate that separate psychological constructs, such as response selection and inhibition, are related processes largely served by a common prefrontal network. This prefrontal network is recruited to a greater or lesser extent depending on specific task demands.     

Exploiting redundancy for flexible behavior: unsupervised learning in a modular sensorimotor control architecture

Autonomously developing organisms face several challenges when learning reaching movements. First, motor control is learned unsupervised or self-supervised. Second, knowledge of sensorimotor contingencies is acquired in contexts in which action consequences unfold in time. Third, motor redundancies must be resolved. To solve all 3 of these problems, the authors propose a sensorimotor, unsupervised, redundancy-resolving control architecture (SURE_REACH), based on the ideomotor principle. Given a 3-degrees-of-freedom arm in a 2-dimensional environment, SURE_REACH encodes 2 spatial arm representations with neural population codes: a hand end-point coordinate space and an angular arm posture space. A posture memory solves the inverse kinematics problem by associating hand end-point neurons with neurons in posture space. An inverse sensorimotor model associates posture neurons with each other action-dependently. Together, population encoding, redundant posture memory, and the inverse sensorimotor model enable SURE_REACH to learn and represent sensorimotor grounded distance measures and to use dynamic programming to reach goals efficiently. The architecture not only solves the redundancy problem but also increases goal reaching flexibility, accounting for additional task constraints or realizing obstacle avoidance. While the spatial population codes resemble neurophysiological structures, the simulations confirm the flexibility and plausibility of the model by mimicking previously published data in arm-reaching tasks.     

Motor planning in Parkinson’s disease patients experiencing freezing of gait: The influence of cognitive load when approaching obstacles

Freezing of gait (FOG) in Parkinson’s disease (PD) is typically assumed to be a pure motor deficit, although it is important to consider how an abrupt loss of gait automaticity might be associated with an overloaded central resource capacity. If resource capacity limits are a factor underlying FOG, then obstacle crossing may be particularly sensitive to dual task effects in eliciting FOG. Participants performed a dual task (auditory digit monitoring) in order to increase cognitive load during obstacle crossing. Forty-two non-demented participants (14 PD patients with FOG, 13 PD who do not freeze, and 14 age-matched healthy control participants) were required to walk and step over a horizontal obstacle set at 15% of the participants’ height. Kinematic data were split into two phases of their approach: early (farthest away from the obstacle), and late (just prior to the obstacle). Interestingly, step length variability and step time variability increased when PD patients with FOG performed the dual task, but only in the late phase prior to the obstacle (i.e. when closest to the obstacle). Additionally, immediately after crossing, freezers landed the lead foot abnormally close to the obstacle regardless of dual task condition, and also contacted the obstacle more frequently (planning errors). Strength of the dual task effect was associated with low general cognitive status, declined executive function, and inappropriate spatial planning, but only in the PD-FOG group. This study is the first to demonstrate that cognitive load differentially impacts planning of the final steps needed to avoid an obstacle in PD patients with freezing, but not non-freezers or healthy controls, suggesting specific neural networks associated with FOG behaviours.     

Effects of aging on whole body and segmental control while obstacle crossing under impaired sensory conditions

The ability to safely negotiate obstacles is an important component of independent mobility, requiring adaptive locomotor responses to maintain dynamic balance. This study examined the effects of aging and visual–vestibular interactions on whole-body and segmental control during obstacle crossing. Twelve young and 15 older adults walked along a straight pathway and stepped over one obstacle placed in their path. The task was completed under 4 conditions which included intact or blurred vision, and intact or perturbed vestibular information using galvanic vestibular stimulation (GVS). Global task performance significantly increased under suboptimal vision conditions. Vision also significantly influenced medial–lateral center of mass displacement, irrespective of age and GVS. Older adults demonstrated significantly greater trunk pitch and head roll angles under suboptimal vision conditions. Similar to whole-body control, no GVS effect was found for any measures of segmental control. The results indicate a significant reliance on visual but not vestibular information for locomotor control during obstacle crossing. The lack of differences in GVS effects suggests that vestibular information is not up-regulated for obstacle avoidance. This is not differentially affected by aging. In older adults, insufficient visual input appears to affect ability to minimize anterior–posterior trunk movement despite a slower obstacle crossing time and walking speed. Combined with larger medial–lateral deviation of the body COM with insufficient visual information, the older adults may be at a greater risk for imbalance or inability to recover from a possible trip when stepping over an obstacle.     

The initial stage of visual selection is controlled by top-down task set: new ERP evidence

Salient visual singleton stimuli produce spatial cueing effects indicative of attentional capture only when they match current task sets, suggesting that capture is subject to top-down control. However, such task-set contingent capture effects could be associated with the top-down controlled disengagement of attention from non-matching stimuli that follows their initial bottom-up salience-driven selection. Using the N2pc component as an event-related potential marker of attentional capture, we demonstrate that top-down task set already controls the initial rapid selection of salient visual singleton stimuli prior to any subsequent attentional disengagement. These findings provide new evidence for the primacy of top-down control over bottom-up salience in attentional capture.     

The influence of environmental context in interpersonal observation–execution

Cyclical upper-limb movements involuntarily deviate from a primary movement direction when the actor concurrently observes incongruent biological motion. We examined whether environmental context influences such motor interference during interpersonal observation–execution. Participants executed continuous horizontal arm movements while observing congruent horizontal or incongruent curvilinear biological movements with or without the presence of an object positioned as an obstacle or distractor. When participants were observing a curvilinear movement, an object located within the movement space became an obstacle, and, thus, the curvilinear trajectory was essential to reach into horizontal space. When acting as a distractor, or with no object, the curvilinear trajectory was no longer essential. For observing horizontal movements, objects were located at the same relative locations as in the curvilinear movement condition. We found greater involuntary movement deviation when observing curvilinear than horizontal movements. Also, there was an influence of context only when observing horizontal movements, with greater deviation exhibited in the presence of a large obstacle. These findings suggest that the influence of environmental context is underpinned by the (mis-)matching of observed and executed actions as incongruent biological motion is primarily coded via bottom-up sensorimotor processes, whilst the congruent condition incorporates surrounding environmental features to modulate the bottom-up sensorimotor processes.     

Visual Exploration When Surrounded by Affordances: Frequency of Head Movements Is Predictive of Response Speed

Little is known about the actions supporting exploration and their relation to subsequent actions in situations when participants are surrounded by opportunities for action. Here, the movements that support visual exploration were related to performance in an enveloping football (soccer) passing task. Head movements of experienced football players were quantified with inertial measurement units. In a simulated football scenario, participants completed a receiving–passing task that required them to indicate pass direction to one of four surrounding targets, as quickly as they could after they gained simulated ball possession. The frequency of head movements before and after gaining ball possession and the pass response times were recorded. We controlled exploration time—the time before gaining simulated ball possession—to be 1, 2, or 3?seconds. Exploration time significantly influenced the frequency of head movements, and a higher frequency of head turns before gaining ball possession resulted in faster pass responses. Exploratory action influenced subsequent performatory action. That is, higher frequencies of head movements resulted in faster decisions. Implications for research and practice are discussed.     

Habit outweighs planning in grasp selection for object manipulation

Object-directed grasping movements are adapted to intended interactions with an object. We address whether adjusting the grasp for object manipulation is controlled habitually, based on past experiences, or by goal-directed planning, based on an evaluation of the expected action outcomes. Therefore, we asked participants to grasp and rotate a dial. In such tasks, participants typically grasp the dial with an excursed, uncomfortable arm posture, which then allows to complete the dial rotation in a comfortable end-state. We extended this task by manipulating the contingency between the orientation of the grasp and the resulting end-state of the arm. A one-step (control) group rotated the dial to a single target. A two-step group rotated the dial to an initial target and then in the opposite direction. A three-step group rotated the dial to the initial target, then in the opposite direction, and then back to the initial target. During practice, the two-step and three-step groups reduced the excursion of their grasps, thus avoiding overly excursed arm postures after the second rotation. When the two-step and three-step groups were asked to execute one-step rotations, their grasps resembled those that were acquired during the two-step and three-step rotations, respectively. However, the carry-over was not complete. This suggests that adjusting grasps for forthcoming object manipulations is controlled by a mixture of habitual and goal-directed processes. In the present experiment, the former contributed approximately twice as much to grasp selection than the latter.     

On the space-time structure of human interlimb co-ordination

In three experiments we show, using behavioural measures of movement outcome, as well as movement trajectory information and resultant kinematic profiles, that there is a strong tendency for the limbs to be co-ordinated as a unitary structure even under conditions where the movements are of disparate difficulty. Environmental constraints (an obstacle placed in the path of one limb, but not in the other) are shown to modulate the space-time behaviour of both limbs (Experiment II). Our results obtain for symmetrical (Experiment I) as well as asymmetrical movements that involve non-homologous muscle groups (Experiment III). These findings suggest that in multi-joint limb movements, the many degrees of freedom are organised to function temporarily as a single coherent unit that is uniquely specific to the task demands placed on it. For movements in general, and two-handed movements in particular, such units are revealed in a partitioning of the relevant force demands for each component (a force scaling characteristic) and a preservation of the internal “topology” of the action, as indexed by the relative timing among components. These features, as well as systematic deviations from perfect synchrony between the limbs can be rationalised by a model that assumes the limbs behave qualitatively like non-linear oscillators.     

Subjective Difficulty of Movements With Ongoing Visual Control

Objective difficulty of a single-component visually controlled movement may be defined by Fitts's (1954) Index of Difficulty, which is a measure of difficulty in the sense that movement time is linearly related to the objective measure. For movements that have multiple components, it becomes difficult to determine an objective measure of task difficulty due to unknown interactions between components of the movement and interactions with other factors. Thus, it may be necessary to use indirect methods for allocating a measure of task difficulty. The purpose of the study was to determine whether participants could validly construct a subjective measure of the movement difficulty and whether this measure was related to the known objective measure of difficulty. Experiments showed that for single-component movements, there was a close relationship between measures of subjective and objective difficulty. With two-component visually controlled movements it was found that subjective difficulty could be related to objective difficulty, but not as simply as for single-component tasks.     

The goal of locomotion: Separating the fundamental task from the mechanisms that accomplish it

Human locomotion has been well described but is still not well understood. This is largely true because the observable aspects of locomotion—neuromuscular activity that generates forces and motions—relate to both the task solution and the problem being solved. Identifying the fundamental task achieved in locomotion makes it possible to critically evaluate the motor control strategy used to accomplish the task goal. We contend that the readily observed movements and activities of locomotion should be considered mechanism(s). Our proposal is that the fundamental task of walking and running is analogous to flight, and should be defined in terms of the interaction of the individual’s mass with the medium in which it moves: a low-density fluid for flight, or the supporting substrate for legged locomotion. A rigorous definition of the fundamental task can help identify the constraints and opportunities that influence its solution and guide the selection of appropriate mechanisms to accomplish the task effectively. The results from robotics-based modeling studies have demonstrated how the interaction of the mass and substrate can be optimized, making the goal of movement a defined trajectory of the individual’s mass. We assessed these concepts by evaluating the ground reaction forces generated by an optimization model that satisfies the task but uses none of the mechanisms that are available to the human leg. Then we compared this model to normal human walking. Although it is obvious that the specific task of locomotion changes with a variety of movement challenges, clearly identifying the fundamental task of locomotion puts all other features in an interpretable context.     

Effect of repetition proportion on language-driven anticipatory eye movements

Previous masked priming research in word recognition has demonstrated that repetition priming is influenced by experiment-wise information structure, such as proportion of target repetition. Research using naturalistic tasks and eye-tracking has shown that people use linguistic knowledge to anticipate upcoming words. We examined whether the proportion of target repetition within an experiment can have a similar effect on anticipatory eye movements. We used a word-to-picture matching task (i.e., the visual world paradigm) with target repetition proportion carefully controlled. Participants' eye movements were tracked starting when the pictures appeared, one second prior to the onset of the target word. Targets repeated from the previous trial were fixated more than other items during this preview period when target repetition proportion was high and less than other items when target repetition proportion was low. These results indicate that linguistic anticipation can be driven by short-term within-experiment trial structure, with implications for the generalization of priming effects, the bases of anticipatory eye movements, and experiment design.