When far becomes near: shared environments activate action simulation

It has been proposed that one means of understanding a person's current behaviour and predicting future actions is by simulating their actions. That is, when another person's actions are observed, similar motor processes are activated in the observer. For example, after observing a reach over an obstacle, a person's subsequent reach trajectory is more curved, reflecting motor priming. Importantly, such motor states are only activated if the observed action is in near (peripersonal) space. However, we demonstrate that when individuals share action environments, simulation of another person's obstacle avoiding reach path takes place even when the action is in far (extrapersonal) space. We propose that action simulation is influenced by factors such as ownership. When an "owned" object is a potential future obstacle, even when it is viewed beyond current action space, simulations are evoked, and these leave a more stable memory capable of influencing future behaviour.     

Priming of reach trajectory when observing actions: Hand-centred effects

When another person's actions are observed it appears that these actions are simulated, such that similar motor processes are triggered in the observer. Much evidence suggests that such simulation concerns the achievement of behavioural goals, such as grasping a particular object, and is less concerned with the specific nature of the action, such as the path the hand takes to reach the goal object. We demonstrate that when observing another person reach around an obstacle, an observer's subsequent reach has an increased curved trajectory, reflecting motor priming of reach path. This priming of reach trajectory via action observation can take place under a variety of circumstances: with or without a shared goal, and when the action is seen from a variety of perspectives. However, of most importance, the reach path priming effect is only evoked if the obstacle avoided by another person is within the action (peripersonal) space of the observer.     

Temporal coordination between performing musicians

Many common behaviours require people to coordinate the timing of their actions with the timing of others' actions. We examined whether representations of musicians' actions are activated in coperformers with whom they must coordinate their actions in time and whether coperformers simulate each other's actions using their own motor systems during temporal coordination. Pianists performed right-hand melodies along with simple or complex left-hand accompaniments produced by themselves or by another pianist. Individual performers' preferred performance rates were measured in solo performance of the right-hand melody. The complexity of the left-hand accompaniment influenced the temporal grouping structure of the right-hand melody in the same way when it was performed by the self or by the duet partner, providing some support for the action corepresentation hypothesis. In contrast, accompaniment complexity had little influence on temporal coordination measures (asynchronies and cross-correlations between parts). Temporal coordination measures were influenced by a priori similarities between partners' preferred rates; partners who had similar preferred rates in solo performance were better synchronized and showed mutual adaptation to each other's timing during duet performances. These findings extend previous findings of action corepresentation and action simulation to a task that requires precise temporal coordination of independent yet simultaneous actions.     

Factors that affect action possibility judgements: Recent experience with the action and the current body state

It has been suggested that action possibility judgements are formed through a covert simulation of the to-be-executed action. We sought to determine whether the motor system (via a common coding mechanism) influences this simulation, by investigating whether action possibility judgements are influenced by experience with the movement task (Experiments 1 and 2) and current body states (Experiment 3). The judgement task in each experiment involved judging whether it was possible for a person's hand to accurately move between two targets at presented speeds. In Experiment 1, participants completed the action judgements before and after executing the movement they were required to judge. Results were that judged movement times after execution were closer to the actual execution time than those prior to execution. The results of Experiment 2 suggest that the effects of execution on judgements were not due to motor activation or perceptual task experience—alternative explanations of the execution-mediated judgement effects. Experiment 3 examined how judged movement times were influenced by participants wearing weights. Results revealed that wearing weights increased judged movement times. These results suggest that the simulation underlying the judgement process is connected to the motor system, and that simulations are dynamically generated, taking into account recent experience and current body state.     

Observed reach trajectory influences executed reach kinematics in prehension

Previous studies have demonstrated that the observation of action can modulate motor performance. This literature has focused on manipulating the observed goal of the action, rather than examining whether action observation effects could be elicited by changing observed kinematics alone. In the study presented here, observed reach trajectory kinematics unrelated to the goal of the action were manipulated in order to examine whether observed movement kinematics alone could influence the action of the observer. Participants observed an experimenter grasp a target object using either a normal or an exaggeratedly high reaching action (as though reaching over an invisible obstacle). When participants observed the experimenter perform actions with a high reach trajectory, their own movements took on aspects of the observed action, showing greater wrist height throughout their reaching trajectory than under conditions in which they observed normal reaching actions. The data are discussed in relation to previous findings which suggest that kinematic aspects of observed movements can prime action through kinematic or intention based matching processes.     

Self produced and observed actions influence emotion: the roles of action fluency and eye gaze

Affective responses to objects can be influenced by cognitive processes such as perceptual fluency. Here we investigated whether the quality of motor interaction with an object influences affective response to the object. Participants grasped and moved objects using either a fluent action or a non-fluent action (avoiding an obstacle). Liking ratings were higher for objects in the fluent condition. Two further studies investigated whether the fluency of another person’s actions influences affective response. Observers watched movie clips of the motor actions described above, in conditions where the observed actor could be seen to be looking towards the grasped object, or where the actor’s head and gaze were not visible. Two results were observed: First, when the actor’s gaze cannot be seen, liking ratings of the objects are reduced. Second, action fluency of observed actions does influence liking ratings, but only when the actor’s gaze towards the object is visible. These findings provide supporting evidence for the important role of observed eye gaze in action simulation, and demonstrate that non-emotive actions can evoke empathic states in observers. This research was supported by Economic and Social Research Council grant RES-000-23-0429 awarded to S. P. Tipper and A. E. Hayes.     

Inferring Learners' Knowledge From Their Actions

Watching another person take actions to complete a goal and making inferences about that person's knowledge is a relatively natural task for people. This ability can be especially important in educational settings, where the inferences can be used for assessment, diagnosing misconceptions, and providing informative feedback. In this paper, we develop a general framework for automatically making such inferences based on observed actions; this framework is particularly relevant for inferring student knowledge in educational games and other interactive virtual environments. Our approach relies on modeling action planning: We formalize the problem as a Markov decision process in which one must choose what actions to take to complete a goal, where choices will be dependent on one's beliefs about how actions affect the environment. We use a variation of inverse reinforcement learning to infer these beliefs. Through two lab experiments, we show that this model can recover people's beliefs in a simple environment, with accuracy comparable to that of human observers. We then demonstrate that the model can be used to provide real‐time feedback and to model data from an existing educational game.     

Know thy sound: Perceiving self and others in musical contexts

This review article provides a summary of the findings from empirical studies that investigated recognition of an action's agent by using music and/or other auditory information. Embodied cognition accounts ground higher cognitive functions in lower level sensorimotor functioning. Action simulation, the recruitment of an observer's motor system and its neural substrates when observing actions, has been proposed to be particularly potent for actions that are self-produced. This review examines evidence for such claims from the music domain. It covers studies in which trained or untrained individuals generated and/or perceived (musical) sounds, and were subsequently asked to identify who was the author of the sounds (e.g., the self or another individual) in immediate (online) or delayed (offline) research designs. The review is structured according to the complexity of auditory–motor information available and includes sections on: 1) simple auditory information (e.g., clapping, piano, drum sounds), 2) complex instrumental sound sequences (e.g., piano/organ performances), and 3) musical information embedded within audiovisual performance contexts, when action sequences are both viewed as movements and/or listened to in synchrony with sounds (e.g., conductors' gestures, dance). This work has proven to be informative in unraveling the links between perceptual–motor processes, supporting embodied accounts of human cognition that address action observation. The reported findings are examined in relation to cues that contribute to agency judgments, and their implications for research concerning action understanding and applied musical practice.     

Attributions and organizational conflict: The mediating role of apparent sincerity

When individuals behave in a provocative, conflict-inducing manner, they often attribute such actions to external causes (e.g., “I'm only following orders”). It was hypothesized that when such statements are perceived as accurate (sincere), they will mitigate negative reactions and reduce subsequent conflict. However, when they are viewed as inaccurate (insincere), opposite effects will result. It was also hyothesized that the impact of such attributional sincerity is greater in the context of high than low pressure to reach an agreement. In Study 1, male and female subjects negotiated with an accomplice who behaved in a conflict-inducing manner and who attributed such actions, either accurately or falsely, to external causes. These negotiations occurred under either high or low pressure to reach an agreement. Results offered support for both hypotheses. Under high but not low pressure to reach agreement, subjects rated the accomplice as less honest and reported stronger preferences for handing future conflicts with him in nonconciliatory ways (e.g., through avoidance or competition) when this person's attributional statements appeared to be false than when they appeared to be accurate. Surprisingly, however, subjects actually made more and larger concessions to an attributionally insincere than attributionally sincere opponent under both pressure conditions. In Study 2, officers of an urban fire department reported on how they would react to conflict with another member of their department under conditions where this person's provocative behavior stemmed from various causes. Results agreed closely with those of the laboratory study. Subjects reported the most negative reactions under conditions where their opponent falsely attributed his conflict-inducing actions to external causes.     

Deactivation in the sensorimotor area during observation of a human agent performing robotic actions

It is well established that several motor areas, called the mirror-neuron system (MNS), are activated when an individual observes other’s actions. However, whether the MNS responds similarly to robotic actions compared with human actions is still controversial. The present study investigated whether and how the motor area activity is influenced by appearance (human vs. robot) and/or kinematics (human vs. robot) of the observed action using near-infrared spectroscopy. The results showed that there was a strong interaction between these factors, revealing strong deactivations in sensorimotor areas when the subject saw a human agent performing robotic actions, which was significantly different from responses when observing the human agent acting in a human way and the robot agent performing robotic actions. These results indicate that MNS activity is sensitive to congruency between the appearance and kinematics of the agent, especially when the agent has a human appearance. We discuss the experience-dependent characteristics of MNS sensitivity to observed actions.     

Limitations of distal effect anticipation when using tools

Modern technologies progressively create workplaces in which the execution of movements and the observation of their consequences are spatially separated. Challenging workplaces in which users act via technical equipment in a distant space include aviation, applied medical engineering and virtual reality. When using a tool, proprioceptive/tactile feedback from the moving hand (proximal action effect) and visual feedback from the moving effect point of the tool, such as the moving cursor on a display (the distal action effect) often do not correspond or are even in conflict. If proximal and distal feedback were equally important for controlling actions with tools, this discrepancy would be a constant source of interference. The human information processing system solves this problem by favoring the intended distal action effects while attenuating or ignoring proximal action effects. The study presents an overview of experiments aiming at the underlying motor and cognitive processes and the limitations of visual predominance in tool actions. The main findings are, that when transformations are in effect the awareness of one's own actions is quite low. This seems to be advantageous when using tools, as it allows for wide range of flexible sensorimotor adaptations and – may be more important – it evokes the feeling of being in control. Thus, the attenuation of perceiving one's own proximal action effects is an important precondition for using tools successfully. However, the ability to integrate discordant perception-action feedback has limits, especially, but not only, with complex transformations. When feature overlap between vision and proprioception is low, and when the existence of a transformation is obvious proximal action effects come to the fore and dominate action control in tool actions. In conclusion action–effect control plays an important role in understanding the constraints of the acquisition and application of tool transformations.     

Does how I look at what you're doing depend on what I'm doing?

Previous studies showed that people proactively gaze at the target of another's action by taking advantage of their own motor representation of that action. But just how selectively is one's own motor representation implicated in another's action processing? If people observe another's action while performing a compatible or an incompatible action themselves, will this impact on their gaze behaviour? We recorded proactive eye movements while participants observed an actor grasping small or large objects. The participants' right hand either freely rested on the table or held with a suitable grip a large or a small object, respectively. Proactivity of gaze behaviour significantly decreased when participants observed the actor reaching her target with a grip that was incompatible with respect to that used by them to hold the object in their own hand. This indicates that effective observation of action may depend on what one is actually doing, being actions observed best when the suitable motor representations may be readily recruited.     

Perceiving by proxy: Effect-based action control with unperceivable effects

Anticipations of future sensory events have the potential of priming motor actions that would typically cause these events. Such effect anticipations are generally assumed to rely on previous physical experiences of the contingency of own actions and their ensuing effects. Here we propose that merely imagined action effects may influence behaviour similarly as physically experienced action effects do. Three experiments in the response–effect compatibility paradigm show that the mere knowledge of action–effect contingencies is indeed sufficient to incorporate these effects into action control even if the effects are never experienced as causally linked to own actions. The experiments further highlight constraints for this mechanism which seems to be rather effortful and to depend on explicit intentions.     

Adolescent development of motor imagery in a visually guided pointing task

The development of action representation during adolescence was investigated using a visually guided pointing motor task (VGPT) to test motor imagery. Forty adolescents (24 males; mean age 13.1 years) and 33 adults (15 males; mean age 27.5 years) were instructed to both execute and imagine hand movements from a starting point to a target of varying size. Reaction time (RT) was measured for both Execution (E) and Imagery (I) conditions. There is typically a close association between time taken to execute and image actions in adults because action execution and action simulation rely on overlapping neural circuitry. Further, representations of actions are governed by the same speed-accuracy trade-off as real actions, as expressed by Fitts’ Law. In the current study, performance on the VGPT in both adolescents and adults conformed to Fitts’ Law in E and I conditions. However, the strength of association between E and I significantly increased with age, reflecting a refinement in action representation between adolescence and adulthood.     

Personal Standards in Professional Relationships: Limiting Interpersonal Harassment

An attempt is made to define abusive actions by offering criteria against which the behaviour of individuals can be considered. These criteria are based on whether the behaviour is avoidable, the appraisal of an objective observer and the impact of the behaviour on the ‘psychological contract’ between employer and employee. Particular abusive actions, identified by these criteria, are described and are contrasted with what are termed ‘reasonable expectations’ of one person's behaviour towards another. It is argued that only by translating these expectations into personal commitments, against which one's own behaviour can be compared, will interpersonal harassment be limited. It is also proposed that the size of consensus about what constitutes abusive actions measures the integrity of an organization's culture. © 1997 John Wiley & Sons, Ltd.     

Sensorimotor intentionality: The origins of intentionality in prospective agent action

Efficient prospective motor control, evident in human activity from birth, reveals an adaptive intentionality of a primary, pre-reflective, and pre-conceptual nature that we identify here as sensorimotor intentionality. We identify a structural continuity between the emergence of this earliest form of prospective movement and the structure of mental states as intentional or content-directed in more advanced forms. We base our proposal on motor control studies, from foetal observations through infancy. These studies reveal movements are guided by anticipations of future effects, even from before birth. This implies that these movements, even if they are simple and discrete, are the actions of an intentional agent. We develop this notion to present a theory of the developing organisation of a core feature of cognition as embodied agent action, from early single actions with proximal prospectivity to the complex serial ordering of actions into projects to reach distal goals. We claim the prospective structural continuity from early and simple actions to later complex projects of serially-ordered actions confirms the existence of an ontogenetically primary form of content–directedness that is a driver for learning and development. Its implications for understanding autism are discussed.     

The predictive mirror: interactions of mirror and affordance processes during action observation

An important question for the study of social interactions is how the motor actions of others are represented. Research has demonstrated that simply watching someone perform an action activates a similar motor representation in oneself. Key issues include (1) the automaticity of such processes, and (2) the role object affordances play in establishing motor representations of others' actions. Participants were asked to move a lever to the left or right to respond to the grip width of a hand moving across a workspace. Stimulus-response compatibility effects were modulated by two task-irrelevant aspects of the visual stimulus: the observed reach direction and the match between hand-grasp and the affordance evoked by an incidentally presented visual object. These findings demonstrate that the observation of another person's actions automatically evokes sophisticated motor representations that reflect the relationship between actions and objects even when an action is not directed towards an object.     

Kinematic cues in perceptual weight judgement and their origins in box lifting

When accepting a parcel from another person, we are able to use information about that person’s movement to estimate in advance the weight of the parcel, that is, to judge its weight from observed action. Perceptual weight judgment provides a powerful method to study our interpretation of other people’s actions, but it is not known what sources of information are used in judging weight. We have manipulated full form videos to obtain precise control of the perceived kinematics of a box lifting action, and use this technique to explore the kinematic cues that affect weight judgment. We find that observers rely most on the duration of the lifting movement to judge weight, and make less use of the durations of the grasp phase, when the box is first gripped, or the place phase, when the box is put down. These findings can be compared to the kinematics of natural box lifting behaviour, where we find that the duration of the grasp component is the best predictor of true box weight. The lack of accord between the optimal cues predicted by the natural behaviour and the cues actually used in the perceptual task has implications for our understanding of action observation in terms of a motor simulation. The differences between perceptual and motor behaviour are evidence against a strong version of the motor simulation hypothesis. A. F. de C. Hamilton and D. W. Joyce have contributed equally to this work.     

Transport and use of common objects: Influence of weight on action planning

Internal knowledge and visual cues about object's weight play an important role in grasping and lifting objects. It has been shown that both visual cues and internal knowledge might influence movement kinematics and force production depending on action goal (use vs. transport). However, there is little evidence about weight's influence on action planning as reflected by initiation time. In the present study we investigated this issue. In Experiment 1, participants had to grasp light and heavy objects (without moving them) to either use or transport them. In Experiment 2 we asked another group of participants to actually use or transport the same objects. We observed that initiation times were faster for heavy objects than for light objects in both the transport and use tasks, but only in Experiment 2. Thus, weight influenced the planning of use and transport actions, only when the end-goal of the action was really achieved. These data are incompatible with the hypothesis that only use actions are supported by stored object's representations. They rather suggest that in some circumstances, depending of the end-goal of the action and the physical constraints the planning of both use and transport actions are based on stored object representation.     

The performance and observation of action shape future behaviour

The observation of other people’s actions plays an important role in shaping the perceptual, cognitive, and motor processes of the observer. It has been suggested that these social influences occur because the observation of action evokes a representation of that response in the observer and that these codes are subsequently accessed by other cognitive systems to modify future behaviour. In the case of social search and movement tasks, the observation-evoked response code is thought to activate the same mechanisms that are activated following internally-generated response codes. In support of this hypothesis, the present study revealed that the magnitudes of the between-person inhibition of return (IOR) effects were correlated with within-person IOR effects. These findings provide substantial support for the link between observation-evoked response codes and social cognitive effects.