An evaluation of the minimal constraining information during observation for movement reproduction

An important question in the field of imitation is what information is used for movement reproduction. While it is argued that relative motion information is perceived and minimised, direct evidence is lacking. In this experiment relative motion was manipulated to convey a novel kicking action. Twenty-four adults were assigned to one of the three impoverished relative motion display groups showing only the TOE, FOOT or LEG. After practise with partial information, participants watched a full-body display and in a final condition performed the action with an additional context constraint (i.e., a ball). Movement kinematics were collected and difference scores between participants and the model were analysed. The groups did not differ in terms of knee-ankle coordination. For hip-knee, the TOE group performed more like the model than the FOOT and LEG group. When transferred to the full-body display, there were no significant improvements. End-point trajectory information can provide sufficient information to reproduce key characteristics of the movement form.     

Human gaze control during real-world scene perception

In human vision, acuity and color sensitivity are best at the point of fixation, and the visual-cognitive system exploits this fact by actively controlling gaze to direct fixation towards important and informative scene regions in real time as needed. How gaze control operates over complex real-world scenes has recently become of central concern in several core cognitive science disciplines including cognitive psychology, visual neuroscience, and machine vision. This article reviews current approaches and empirical findings in human gaze control during real-world scene perception.     

Motor priming by movement observation with contralateral concurrent action execution

In the present study, the influence of simultaneous action execution on motor priming was investigated during movement observation using a simple-reaction task. Although previous studies have reported various effects of priming on motor performance, it has not yet been clarified how an additional source conveying kinetic information would modulate the priming effects. In the experiment, participants were asked to respond to an auditory cue by flexing their wrist while observing a line movement, which was slowly swinging like an inverted pendulum. In addition to the observation of line movement, the participants executed wrist flexion-extension actions synchronizing with line movement. The hand involved in pre-response wrist action varied with the priming condition: no movement execution (observation only), contralateral hand, and ipsilateral hand. In the contralateral condition, the stimulus-response congruency of movement direction was conflicted depending on the frame of reference (visual vs. anatomical coordinates). We found that all three priming conditions produced the compatibility effect, and the effect size did not differ between them. Importantly, in the contralateral condition, participants responded faster when the direction of line movement was congruent with the response movement in the anatomical coordinates. That is, the reaction time was shorter when pre-response action execution was in the flexion phase, even though the direction of observed movement and the response action were incongruent from the participants’ view. These results suggest that kinetic information has a great contribution to the motor priming system, which can reverse the vision-based compatibility effect.     

Upper-left gaze bias reveals competing search strategies in a reverse Stroop task

Three experiments with a total of 87 human observers revealed an upper-left spatial bias in the initial movement of gaze during visual search. The bias was present whether or not the explicit control of gaze was required for the task. This bias may be part of a search strategy that competed with the fixed-gaze parallel search strategy hypothesized by Durgin [Durgin, F. H. (2003). Translation and competition among internal representations in a reverse Stroop effect. Perception &Psychophysics, 65, 367-378.] for this task. When the spatial probabilities of the search target were manipulated either in accord with or in opposition to the existing upper-left bias, two orthogonal factors of interference in the latency data were differentially affected. The two factors corresponded to two different forms of representation and search. Target probabilities consistent with the gaze bias encouraged opportunistic serial search (including gaze shifts), while symmetrically opposing target probabilities produced latency patterns more consistent with parallel search based on a sensory code.     

Object concepts and action: extracting affordances from objects parts

Two experiments with a part-generation task show that rated salience and production order of parts in artifacts are first predicted by their relevance for canonical actions, but also that they vary, depending on the current situation. In three further experiments participants read sentences describing actions (e.g., 'The woman shares the orange') followed by objects' parts from which it was easy or not to extract affordances (e.g., 'slice' vs. 'pulp'). They had to perform a part verification task or to evaluate whether or not the combination made sense. Parts from which it was easy to derive affordances were processed earlier and the combination was evaluated as the one which made more sense. Overall, results support the view that sensory-motor simulations underlie conceptualization and that concepts are action-based.     

The effects of response priming on the planning and execution of goal-directed movements in the presence of a distracting stimulus

Two models of selective reaching have been proposed to account for deviations in movement trajectories in cluttered environments. The response vector model predicts movement trajectories should deviate towards or away from the location a distractor of little or large salience, respectively. In contrast, the response activation model predicts that a distractor with large salience should cause movement deviations towards it whereas a distractor with little salience should not influence the movement. The precuing technique was combined with the distractor interference paradigm to test these predictions. Results indicate that when the target was presented at the precued (salient) location, movements were unaffected by a distractor. Conversely, when the distractor was presented at the precued location while the target was presented at an uncued (non-salient) location, participants demonstrated increased reaction times and trajectory deviations towards the location of the distractor. These findings are consistent with the model of response activation.     

Attention orienting by eye gaze and arrows reveals flexibility to environmental changes

This study aimed to evaluate the difference in non-predictive cues between gaze and arrows in attention orienting. Attention orienting was investigated with gaze or arrows as separate cues in a simple condition (i.e., block design) in Experiment 1 and in an unpredictable condition (i.e., randomized design) in Experiment 2. Two kinds of sound (voice and tone) stimuli were used as targets. Results showed that gaze and arrow cues induced enhanced attention orienting to a voice versus tone target in the block condition. However, in the randomized condition, enhanced attention orienting to a voice versus tone target was found in gaze but not arrow cues. The congruency of the meaning between a social cue (i.e., gaze) and a social target (i.e., voice) was clear in the randomized but not blocked design, because social gaze and non-social arrow cues were implemented in the same block. Thus, attention orienting might be mediated by the associated relationship of cue–target in a randomized condition, as an enhanced orienting effect was found when the associated relationship of cue–target was strong (i.e., social cue and target). The present study suggests that the difference in attention orienting between gaze and arrows is apparent in a randomized design (the unpredictable condition), and people employ a flexibly strategy of orienting to better respond to environmental changes.     

The performance and observation of action shape future behaviour

The observation of other people’s actions plays an important role in shaping the perceptual, cognitive, and motor processes of the observer. It has been suggested that these social influences occur because the observation of action evokes a representation of that response in the observer and that these codes are subsequently accessed by other cognitive systems to modify future behaviour. In the case of social search and movement tasks, the observation-evoked response code is thought to activate the same mechanisms that are activated following internally-generated response codes. In support of this hypothesis, the present study revealed that the magnitudes of the between-person inhibition of return (IOR) effects were correlated with within-person IOR effects. These findings provide substantial support for the link between observation-evoked response codes and social cognitive effects.     

Eye gaze metrics reflect a shared motor representation for action observation and movement imagery

Action observation (AO) and movement imagery (MI) have been reported to share similar neural networks. This study investigated the congruency between AO and MI using the eye gaze metrics, dwell time and fixation number. A simple reach-grasp-place arm movement was observed and, in a second condition, imagined where the movement was presented from the first person perspective (1PP) and the third person perspective (3PP). Dwell time and number of fixations were calculated for whole scene and regions of interest (ROIs). For whole scene, no significant differences were found in the number of fixations for condition (AO, MI) or perspective. Dwell time, however, was significantly longer in AO than MI. For ROIs, the number of fixations was significantly greater in 1PP than 3PP. The data provide support for congruence between motor simulation states but also indicate some functional differences.     

Attention and gaze shifting in dual-task and go/no-go performance with vocal responding

Evidence from go/no-go performance on the Eriksen flanker task with manual responding suggests that individuals gaze at stimuli just as long as needed to identify them (e.g., Sanders, 1998). In contrast, evidence from dual-task performance with vocal responding suggests that gaze shifts occur after response selection (e.g., Roelofs, 2008a). This difference in results may be due to the nature of the task situation (go/no-go vs. dual task) or the response modality (manual vs. vocal). We examined this by having participants vocally respond to congruent and incongruent flanker stimuli and shift gaze to left- or right-pointing arrows. The arrows required a manual response (dual task) or determined whether the vocal response to the flanker stimuli had to be given or not (go/no-go). Vocal response and gaze shift latencies were longer on incongruent than congruent trials in both dual-task and go/no-go performance. The flanker effect was also present in the manual response latencies in dual-task performance. Ex-Gaussian analyses revealed that the flanker effect on the gaze shifts consisted of a shift of the entire latency distribution. These results suggest that gaze shifts occur after response selection in both dual-task and go/no-go performance with vocal responding.     

The influence of action observation on action execution: Dissociating the contribution of action on perception,perception on action,and resolving conflict

For more than 15 years, motor interference paradigms have been used to investigate the influence of action observation on action execution. Most research on so-called automatic imitation has focused on variables that play a modulating role or investigated potential confounding factors. Interestingly, furthermore, a number of functional magnetic resonance imaging (fMRI) studies have tried to shed light on the functional mechanisms and neural correlates involved in imitation inhibition. However, these fMRI studies, presumably due to poor temporal resolution, have primarily focused on high-level processes and have neglected the potential role of low-level motor and perceptual processes. In the current EEG study, we therefore aimed to disentangle the influence of low-level perceptual and motoric mechanisms from high-level cognitive mechanisms. We focused on potential congruency differences in the visual N190 ? a component related to the processing of biological motion, the Readiness Potential ? a component related to motor preparation, and the high-level P3 component. Interestingly, we detected congruency effects in each of these components, suggesting that the interference effect in an automatic imitation paradigm is not only related to high-level processes such as self-other distinction but also to more low-level influences of perception on action and action on perception. Moreover, we documented relationships of the neural effects with (autistic) behavior.     

Motor execution affects action prediction

Previous studies provided evidence of the claim that the prediction of occluded action involves real-time simulation. We report two experiments that aimed to study how real-time simulation is affected by simultaneous action execution under conditions of full, partial or no overlap between observed and executed actions. This overlap was analysed by comparing the body sides and the movement kinematics involved in the observed and the executed action. While performing actions, participants observed point-light (PL) actions that were interrupted by an occluder, followed by a test pose. The task was to judge whether the test pose depicted a continuation of the occluded action in the same depth angle. Using a paradigm proposed by Graf et al., we independently manipulated the duration of the occluder and the temporal advance of the test pose relative to occlusion onset (occluder time and pose time, respectively). This paradigm allows the assessment of real-time simulation, based on prediction performance across different occluder time/pose time combinations (i.e., improved task performance with decreasing time distance between occluder time and pose time is taken to reflect real-time simulation). The PL actor could be perceived as from the front or back, as indicated by task instructions. In Experiment 1 (front view instructions), evidence of action simulation was obtained for partial overlap (i.e., observed and performed action corresponded either in body side or movement kinematics), but not for full or no overlap conditions. The same pattern was obtained in Experiment 2 (back view instructions), ruling out a spatial compatibility explanation for the real-time pattern observed. Our results suggest that motor processes affect action prediction and real-time simulation. The strength of their impact varies as a function of the overlap between observed and executed actions.     

Transformation of task components into an integrated representation during task switching

We combined task switching with a change paradigm to trace the transformation of the information conveyed by task cues into a readiness to perform the cued task. The tasks were composed of two components that allowed us to determine switch costs as a function of the number of changed task components. With a short stimulus-onset asynchrony (SOA) of 200ms, switch costs grew monotonically as a function of the number of changed components. With a SOA of 400ms, the switch-cost profile exhibited a nonmonotonic characteristic that was previously observed only with switches from an already performed task. Our observations suggest that task preparation can be considered as a process by which an unstructured representation of task components is gradually transformed into an integrated task representation that comprises asymmetrical associations between the task components.     

Confusion and its dynamics during device comprehension with breakdown scenarios

The incidence and dynamics of confusion during complex learning and problem solving were investigated in an experiment where participants first read illustrated texts on everyday devices (e.g., an electric bell) followed by breakdown scenarios reflecting device malfunctions (e.g., “When a person rang the bell there was a short ding and then no sound was heard”). The breakdown scenarios were expected to trigger impasses and put participants in a state of cognitive disequilibrium where they would experience confusion and engage in effortful confusion resolution activities in order to restore equilibrium. The results confirmed that participants reported more confusion when presented with the breakdown scenarios compared to control scenarios that involved focusing on important device components in the absence of malfunctions. A second-by-second analysis of the dynamics of confusion yielded two characteristic trajectories that distinguished participants who partially resolved their confusion from those who remained confused. Participants who were successful in partial confusion resolution while processing the breakdowns outperformed their counterparts on knowledge assessments after controlling for scholastic aptitude, engagement, and frustration. This effect was amplified for those who were highly confused by the breakdowns. There was no direct breakdown vs. control effect on learning, but being actively engaged and partially resolving confusion during breakdown processing were positive predictors of increased learning with the breakdown compared to control scenarios. Implications of our findings for theories that highlight the role of impasses, cognitive disequilibrium, and confusion to learning are discussed.     

A test of motor skill-specific action embodiment in ice-hockey players

To further our understanding of the role of the motor system in comprehending action-related sentences, we compared action experts (athletes) to visual experts (fans) and novices when responding with an action-specific effector (either hand or foot). These conditions allowed inferences about the degree and specificity of embodiment in language comprehension. Ice hockey players, fans and novices made speeded judgments regarding the congruence between an auditorily presented sentence and a subsequently presented picture. Picture stimuli consisted of either hockey or everyday items. Half of these pictures ‘matched’ the action implied in the preceding sentence. Further, the action in these images involved either primarily the hand or the foot. For everyday items, action-matched items were responded to faster than action-mismatched items. However, only the players and fans showed the action-match effect for hockey items. There were no consistent effector-stimuli compatibility effects, nor skill-based interactions with compatibility, suggesting that the action-match effect was not based on motor ability per se, but rather a construction of the action based on knowledge or visual experience with the hockey related sentences.     

Neural correlates of action observation and execution in 14-month-old infants: an event-related EEG desynchronization study

There is increasing interest in neurobiological methods for investigating the shared representation of action perception and production in early development. We explored the extent and regional specificity of EEG desynchronization in the infant alpha frequency range (6-9 Hz) during action observation and execution in 14-month-old infants. Desynchronization during execution was restricted to central electrode sites, while action observation was associated with a broader desynchronization across frontal, central, and parietal regions. The finding of regional specificity in the overlap between EEG responses to action execution and observation suggests that the rhythm seen in the 6-9 Hz range over central sites in infancy shares certain properties with the adult mu rhythm. The magnitude of EEG desynchronization to action perception and production appears to be smaller for infants than for adults and older children, suggesting developmental change in this measure.     

Observing or producing a motor action improves later perception of biological motion: Evidence for a gender effect

Two experiments are presented addressing the issue of whether observing (visual priming) or producing (motor priming) a running activity during a very short period (30 s) facilitates the perception of the direction of a point-light runner embedded in a dense dynamical mask. Experiment 1 showed that perceptual judgements improved and response time increased in the visual priming compared to the neutral priming condition (video of a moving car) in which judgements were at random. Because this effect was observed for male participants only, we performed a second experiment with the aim of evaluating the role of gender congruency in the visual priming condition. Results confirmed the facilitation effect and demonstrated that this effect was strictly dependent on the gender congruency between the perceiver and the priming information. Moreover, we found that actually producing a motor activity similar to the one presented in the video sequence improved to the same extent participants’ judgement of the direction of the point-light runner, without any gender effect. As a whole, these findings argue in favour of common representation for the perception and the production of human movement and showed that the perception of biological motion can be improved by prior motor activity either performed or observed. However, the gender-dependent effect of visual priming suggested that motor repertoire differed in males and females.     

Sequence learning by action,observation and action observation

The serial reaction time (SRT) task was used to compare learning of a complex sequence by action (participants responded to sequential stimuli), by observation (participants watched but did not respond to sequential stimuli), and by action‐observation (participants watched an expert model responding to sequential stimuli). Each of these groups was compared with an untrained control group. Experiment 1 indicated that both observation and action‐observation were sufficient to support learning of a 12‐item second‐order conditional (SOC) sequence. Experiment 2 confirmed these findings, and showed that, as indexed by reaction time (RT), the extent of learning by observation and by action‐observation was comparable to that of action‐based learning. Using a recognition test, Experiment 2 and 3 also provided evidence that, whereas learning by stimulus observation was explicit, learning by action‐observation was implicit. These findings are consistent with a connection between motor systems and implicit learning, but do not support the hypothesis that overt action is necessary for implicit learning.     

Anxiety-induced changes in movement behaviour during the execution of a complex whole-body task.

We investigated the impact of anxiety on movement behaviour during the execution of a complex perceptual-motor task. Masters' (1992) conscious processing hypothesis suggests that under pressure an inward focus of attention occurs, resulting in more conscious control of the movement execution of well-learned skills. The conscious processes interfere with automatic task execution hereby inducing performance decrements. Recent empirical support for the hypothesis has focused on the effects of pressure on end performance. It has not been tested so far whether the changes in performance are also accompanied by changes in movement execution that would be expected following Masters' hypothesis. In the current study we tested the effects of anxiety on climbing movements on a climbing wall. Two identical traverses at different heights on a climbing wall provided different anxiety conditions. In line with the conscious processing hypothesis we found that anxiety had a significant effect on participants' movement behaviour evidenced by increases in climbing time and the number of explorative movements (Experiments 1 and 2) and by longer grasping of the holds and slower movements (Experiment 2). These results provide additional support for the conscious processing hypothesis and insight into the relation between anxiety, performance, and movement behaviour.     

The influence of object identity on obstacle avoidance reaching behaviour

When reaching for target objects, we hardly ever collide with other objects located in our working environment. Behavioural studies have demonstrated that the introduction of non-target objects into the workspace alters both spatial and temporal parameters of reaching trajectories. Previous studies have shown the influence of spatial object features (e.g. size and position) on obstacle avoidance movements. However, obstacle identity may also play a role in the preparation of avoidance responses as this allows prediction of possible negative consequences of collision based on recognition of the obstacle. In this study we test this hypothesis by asking participants to reach towards a target as quickly as possible, in the presence of an empty or full glass of water placed about half way between the target and the starting position, at 8 cm either left or right of the virtual midline. While the spatial features of full and empty glasses of water are the same, the consequences of collision are clearly different. Indeed, when there was a high chance of collision, reaching trajectories veered away more from filled than from empty glasses. This shows that the identity of potential obstacles, which allows for estimating the predicted consequences of collision, is taken into account during obstacle avoidance.