Know thy sound: Perceiving self and others in musical contexts

This review article provides a summary of the findings from empirical studies that investigated recognition of an action's agent by using music and/or other auditory information. Embodied cognition accounts ground higher cognitive functions in lower level sensorimotor functioning. Action simulation, the recruitment of an observer's motor system and its neural substrates when observing actions, has been proposed to be particularly potent for actions that are self-produced. This review examines evidence for such claims from the music domain. It covers studies in which trained or untrained individuals generated and/or perceived (musical) sounds, and were subsequently asked to identify who was the author of the sounds (e.g., the self or another individual) in immediate (online) or delayed (offline) research designs. The review is structured according to the complexity of auditory–motor information available and includes sections on: 1) simple auditory information (e.g., clapping, piano, drum sounds), 2) complex instrumental sound sequences (e.g., piano/organ performances), and 3) musical information embedded within audiovisual performance contexts, when action sequences are both viewed as movements and/or listened to in synchrony with sounds (e.g., conductors' gestures, dance). This work has proven to be informative in unraveling the links between perceptual–motor processes, supporting embodied accounts of human cognition that address action observation. The reported findings are examined in relation to cues that contribute to agency judgments, and their implications for research concerning action understanding and applied musical practice.     

Overcoming action crises in personal goals – Longitudinal evidence on a mediating mechanism between action orientation and well-being

An action crisis is defined as an intra-psychic conflict between further goal pursuit and disengagement from the goal and frequently signifies the beginning of disengagement processes. By analyzing dispositional predictors of the development of goal-related action crises over time, we applied a process-based approach to goal disengagement. In two longitudinal studies, we evaluated the effect of action (vs. state) orientation on the development of action crises. Using change-regression models, the hypothesis could be confirmed that action orientation enables individuals to overcome action crises in personal goals. Furthermore, in two cross-sectional studies, previously reported effects of action orientation on health and well-being could be replicated and shown to be partially mediated by a decreased overall prevalence of action crises.     

Captured by motion: dance, action understanding, and social cognition

In this review article, we summarize the main findings from empirical studies that used dance-related forms of rhythmical full body movement as a research tool for investigating action understanding and social cognition. This work has proven to be informative about behavioral and brain mechanisms that mediate links between perceptual and motor processes invoked during the observation and execution of spatially–temporally coordinated action and interpersonal interaction. The review focuses specifically on processes related to (a) motor experience and expertise, (b) learning and memory, (c) action, intention, and emotion understanding, and (d) audio-visual synchrony and timing. Consideration is given to the relationship between research on dance and more general embodied cognition accounts of action understanding and social cognition. Finally, open questions and issues concerning experimental design are discussed with a view to stimulating future research on social-cognitive aspects of dance.     

Adolescent development of motor imagery in a visually guided pointing task

The development of action representation during adolescence was investigated using a visually guided pointing motor task (VGPT) to test motor imagery. Forty adolescents (24 males; mean age 13.1 years) and 33 adults (15 males; mean age 27.5 years) were instructed to both execute and imagine hand movements from a starting point to a target of varying size. Reaction time (RT) was measured for both Execution (E) and Imagery (I) conditions. There is typically a close association between time taken to execute and image actions in adults because action execution and action simulation rely on overlapping neural circuitry. Further, representations of actions are governed by the same speed-accuracy trade-off as real actions, as expressed by Fitts’ Law. In the current study, performance on the VGPT in both adolescents and adults conformed to Fitts’ Law in E and I conditions. However, the strength of association between E and I significantly increased with age, reflecting a refinement in action representation between adolescence and adulthood.     

From intention to action: The role of presence

Recent research in neuroscience has tried to understand human action from two different but converging perspectives: the cognitive and the volitional. On one side, cognitive studies analyze how action is planned and controlled in response to environmental conditions. On the other side, volitional studies analyze how action is planned and controlled by a subject's needs, motives and goals. In this paper we suggest that the notion of presence may be the missing link between these two approaches, explaining how can we differentiate between perception, action and concepts.In particular, a consideration of presence can explain how can we distinguish between a perceived action, a planned or an executed one. We argue that the evolutionary role of presence is the control of agency through the unconscious separation of “internal” and “external” and the enaction/reenaction of intentions.The model makes sense in terms of evolutionary psychology and is beginning to be supported by evidence of the neural and other physical correlates of action, imitation and self-monitoring. Another strength of this model is that it provides testable predictions about how to improve the experience of presence in media: maximal presence in a mediated experience arises from an optimal combination of form and content, able to support the intentions of the user.     

Motor execution affects action prediction

Previous studies provided evidence of the claim that the prediction of occluded action involves real-time simulation. We report two experiments that aimed to study how real-time simulation is affected by simultaneous action execution under conditions of full, partial or no overlap between observed and executed actions. This overlap was analysed by comparing the body sides and the movement kinematics involved in the observed and the executed action. While performing actions, participants observed point-light (PL) actions that were interrupted by an occluder, followed by a test pose. The task was to judge whether the test pose depicted a continuation of the occluded action in the same depth angle. Using a paradigm proposed by Graf et al., we independently manipulated the duration of the occluder and the temporal advance of the test pose relative to occlusion onset (occluder time and pose time, respectively). This paradigm allows the assessment of real-time simulation, based on prediction performance across different occluder time/pose time combinations (i.e., improved task performance with decreasing time distance between occluder time and pose time is taken to reflect real-time simulation). The PL actor could be perceived as from the front or back, as indicated by task instructions. In Experiment 1 (front view instructions), evidence of action simulation was obtained for partial overlap (i.e., observed and performed action corresponded either in body side or movement kinematics), but not for full or no overlap conditions. The same pattern was obtained in Experiment 2 (back view instructions), ruling out a spatial compatibility explanation for the real-time pattern observed. Our results suggest that motor processes affect action prediction and real-time simulation. The strength of their impact varies as a function of the overlap between observed and executed actions.     

Predictable and self-initiated visual motion is judged to be slower than computer generated motion

Self-initiated action effects are often perceived as less intense than identical but externally generated stimuli. It is thought that forward models within the sensorimotor system pre-activate cortical representations of predicted action effects, reducing perceptual sensitivity and attenuating neural responses. As self-agency and predictability are seldom manipulated simultaneously in behavioral experiments, it is unclear if self-other differences depend on predictable action effect contingencies, or if both self- and externally generated stimuli are modulated similarly by predictability. We factorially combined variation in (1) predictability of action effects, (2) spatial congruence, and (3) performance by the self or computer to dissociate these influences on a visual discrimination task. Participants performed 2AFC speed judgments. Self-initiated motion was judged to be slower than computer-initiated motion when action effect contingencies were predictable, while spatial congruence influenced speed judgments only when action effect contingencies were unpredictable. Results are discussed in relation to current theories of sensory attenuation.     

A neuro-cognitive defense of the unified self

The topic of the self remains one of considerable controversy, and many arguments have been put forth suggesting the intuitive concept of self must be in some way mistaken – in part based on results in the cognitive and neural sciences. In this article I offer the alternative positive proposal that “the self” may indeed refer to a physical/computational system within the brain. To do this, I draw on empirical work regarding the neural basis of consciousness and decision-making, and on philosophical work regarding ecological control, unified group perspectives, and functional/mechanistic explanation. The work I review jointly supports the conclusion that a “core-circuit” of interacting cortical regions – the global workspace network – can be understood as a unified system for consciously perceiving and deciding, and thus fulfills many of the roles intuitively assigned to the self. I conclude that this self-concept need not be mistaken given current empirical knowledge.     

When far becomes near: Shared environments activate action simulation

It has been proposed that one means of understanding a person's current behaviour and predicting future actions is by simulating their actions. That is, when another person's actions are observed, similar motor processes are activated in the observer. For example, after observing a reach over an obstacle, a person's subsequent reach trajectory is more curved, reflecting motor priming. Importantly, such motor states are only activated if the observed action is in near (peripersonal) space. However, we demonstrate that when individuals share action environments, simulation of another person's obstacle avoiding reach path takes place even when the action is in far (extrapersonal) space. We propose that action simulation is influenced by factors such as ownership. When an “owned” object is a potential future obstacle, even when it is viewed beyond current action space, simulations are evoked, and these leave a more stable memory capable of influencing future behaviour.     

To point a finger: attentional and motor consequences of observing pointing movements

Recent studies showed that action observation activates neural circuits used in performing the same action and facilitates execution of a similar motor program. This system for direct mapping of observed actions onto observer’s own motor representation is considered critical for human imitation capabilities. The present study shows that observing a pointing action activates a representation of that action in anatomical space, irrespectively of whether the action is shown in allocentric or egocentric perspective. This finding is at odds with the studies on imitation which showed that humans tend to imitate in a spatially compatible (specular) way, as if looking in a mirror. Our results suggest that shared representations for actions are organized in the same spatial coordinates; however, a transformation of this representation might be required for imitation tasks in order to accommodate the goals of imitative action.     

A role of goals for social inhibition of return?

The social inhibition of return (sIOR) effect refers to the finding that response initiation times are longer if a movement is executed to a location where another person has responded to just before. Previous studies have examined the influence of the goal of the action on sIOR. In these studies, however, the movement endpoint and to-be-attained goal (e.g., touching/pressing a response key) were at the same spatial location. In the present two experiments, we disentangled movement endpoint and goal's identity and locations by means of introducing action effects that followed directly from a movement. Similar methods were previously shown powerful enough to clearly show the importance of action goals for other phenomena—a finding consistent with effect-based theories of action control, such as the ideomotor theory. The results of the present study revealed that sIOR was shaped by the movement endpoint location, not the goal's identity or location. That is, in both experiments, an sIOR effect was observed, but the magnitude of the sIOR effect was not modulated by repetitions/switches of goals or their locations. Thus, results indicate that goals play a negligible role in the emergence of the sIOR and, consequently, highlight the importance of action observation for the emergence of the sIOR effect.     

Motor facilitation following action observation: a behavioural study in prehensile action

Previous research has shown that the observation of actions and the execution of actions activate common neural systems. More recently, we have presented data showing that action observation of prehension primes subsequent execution (Castiello, Lusher, Mari, Edwards, & Humphreys, 2002). In the current paper we examined action priming under conditions in which the size of the prime did not predict the size of the target (only 20% of trials were valid). We demonstrated reliable priming under these conditions, consistent with the effect occurring automatically. In addition, we show priming even when observers saw just the object rather than the object and a reaching action on the prime trial. We discuss the findings in relation to the role of mirror neurons and object affordances.     

Neural evidence for the interplay between language, gesture, and action: a review

Co-speech gestures embody a form of manual action that is tightly coupled to the language system. As such, the co-occurrence of speech and co-speech gestures is an excellent example of the interplay between language and action. There are, however, other ways in which language and action can be thought of as closely related. In this paper we will give an overview of studies in cognitive neuroscience that examine the neural underpinnings of links between language and action. Topics include neurocognitive studies of motor representations of speech sounds, action-related language, sign language and co-speech gestures. It will be concluded that there is strong evidence on the interaction between speech and gestures in the brain. This interaction however shares general properties with other domains in which there is interplay between language and action.     

A review of literature on the link between action observation and action language: advancing a shared semantic theory

Understanding each other is a core concept of social cohesion and, consequently, has immense value in human society. Importantly, shared information leading to cohesion can come from two main sources: observed action and/or language (word) processing. In this paper, we propose a theoretical framework for the link between action observation and action verb processing. Based on the activation of common semantic representations of actions through semantic resonance, this model can account for the neurophysiological, behavioral and neuropsychological domains in the link between action observation and language. Semantic resonance is hypothesized to play a role beyond that of the mere observation of others and can benefit future studies trying to connect action production and language.     

Incongruent imagery interferes with action initiation

It has been suggested that representing an action through observation and imagery share neural processes with action execution. In support of this view, motor-priming research has shown that observing an action can influence action initiation. However, there is little motor-priming research showing that imagining an action can modulate action initiation. The current study examined whether action imagery could prime subsequent execution of a reach and grasp action. Across two motion analysis tracking experiments, 40 participants grasped an object following congruent or incongruent action imagery. In Experiment 1, movement initiation was faster following congruent compared to incongruent imagery, demonstrating that imagery can prime the initiation of grasping. In Experiment 2, incongruent imagery resulted in slower movement initiation compared to a no-imagery control. These data show that imagining a different action to that which is performed can interfere with action production. We propose that the most likely neural correlates of this interference effect are brain regions that code imagined and executed actions. Further, we outline a plausible mechanistic account of how priming in these brain regions through imagery could play a role in action cognition.     

Can you see me in the snow? Action simulation aids the detection of visually degraded human motion

Using a novel paradigm, we demonstrate that action simulation can directly facilitate ongoing perception of people's movements. Point-light actors (PLAs) representing common human motions were shown embedded in a visual noise reminiscent of “TV snow”. At first, the PLAs were perceived clearly, then occluded from view for a short duration, during which it was hypothesized that a real-time action simulation was generated tracking the motion's course. The PLA then reappeared in motion at variable visibility against the noise, whilst detection thresholds for the reappearance were measured. In the crucial manipulation, the test motion was either temporally congruent with the motion as it would have continued during occlusion, and thus temporally matching the simulation, or temporally incongruent. Detection thresholds were lower for congruent than for incongruent reappearing motions, suggesting that reappearing motion that temporally matched the internal action simulation was more likely to be detected.     

Factors that affect action possibility judgements: Recent experience with the action and the current body state

It has been suggested that action possibility judgements are formed through a covert simulation of the to-be-executed action. We sought to determine whether the motor system (via a common coding mechanism) influences this simulation, by investigating whether action possibility judgements are influenced by experience with the movement task (Experiments 1 and 2) and current body states (Experiment 3). The judgement task in each experiment involved judging whether it was possible for a person's hand to accurately move between two targets at presented speeds. In Experiment 1, participants completed the action judgements before and after executing the movement they were required to judge. Results were that judged movement times after execution were closer to the actual execution time than those prior to execution. The results of Experiment 2 suggest that the effects of execution on judgements were not due to motor activation or perceptual task experience—alternative explanations of the execution-mediated judgement effects. Experiment 3 examined how judged movement times were influenced by participants wearing weights. Results revealed that wearing weights increased judged movement times. These results suggest that the simulation underlying the judgement process is connected to the motor system, and that simulations are dynamically generated, taking into account recent experience and current body state.     

拖延行为的认知神经模型及干预

拖延是一种普遍存在, 具有跨时间和跨情景稳定性的问题行为, 它会危害到人们的学习、工作和身心健康。然而目前拖延行为的认知神经机制仍不清晰, 且缺乏因果证据, 本项目拟从拖延的时间决策模型和三重神经结构网络模型出发, 构建拖延的认知神经模型, 并利用认知干预和神经调控技术, 检验和完善拖延行为的认知神经模型, 进而试图制定拖延的精准化干预方案。本项目分为3部分：(1)从记录与关联研究的视角出发, 利用多模态神经影像方法系统考察拖延行为的认知神经机制; (2)从因果/近因果研究视角出发, 利用认知干预和神经调控技术, 验证并完善拖延的认知神经模型; (3)从临床应用的视角出发, 建立拖延行为障碍的临床筛查-诊断体系, 并制定精准化治疗方案。本项目的开展对于探明拖延产生的核心认知神经机制具有十分重要的理论贡献, 同时对于拖延行为的有效预防和精准治疗具有重要的现实意义。     

Embodied grounding of memory: Toward the effects of motor execution on memory consolidation

Behavioural and neuroscientific research has provided evidence for a strong functional link between the neural motor system and lexical–semantic processing of action-related language. It remains unclear, however, whether the impact of motor actions is restricted to online language comprehension or whether sensorimotor codes are also important in the formation and consolidation of persisting memory representations of the word's referents. The current study now demonstrates that recognition performance for action words is modulated by motor actions performed during the retention interval. Specifically, participants were required to learn words denoting objects that were associated with either a pressing or a twisting action (e.g., piano, screwdriver) and words that were not associated to actions. During a 6–8-minute retention phase, participants performed an intervening task that required the execution of pressing or twisting responses. A subsequent recognition task revealed a better memory for words that denoted objects for which the functional use was congruent with the action performed during the retention interval (e.g., pepper mill–twisting action, doorbell–pressing action) than for words that denoted objects for which the functional use was incongruent. In further experiments, we were able to generalize this effect of selective memory enhancement of words by performing congruent motor actions to an implicit perceptual (Experiment 2) and implicit semantic memory test (Experiment 3). Our findings suggest that a reactivation of motor codes affects the process of memory consolidation and emphasizes therefore the important role of sensorimotor codes in establishing enduring semantic representations.     

Action verbal fluency normative data for the elderly

An emerging body of literature points to the prominent role of the frontal lobes in the retrieval of verbs, whereas production of common and proper nouns arguably is mediated primarily by posterior and anterior temporal regions, respectively. Although the majority of studies examining the neuroanatomic distinctions between verb and noun retrieval have relied on action naming tasks (naming depicted activities, e.g., running) as indicators of verb retrieval abilities, recent studies have utilized an action (verb) verbal fluency measure, the Action Fluency Test (AFT), to assess verb retrieval. Findings from these studies suggest that action fluency is sensitive to the integrity of fronto-subcortical neural circuitry and that it is a valid measure of executive and language functions. The AFT is an easily administered executive function measure, but no normative data for the AFT or other action fluency tasks has been published. This study was undertaken to provide initial AFT normative data for a sample of 145 healthy elderly subjects. As education is significantly correlated with AFT scores, the normative data are stratified by educational level.