When the self represents the other: a new cognitive neuroscience view on psychological identification

There is converging evidence from developmental and cognitive psychology, as well as from neuroscience, to suggest that the self is both special and social, and that self-other interaction is the driving force behind self-development. We review experimental findings which demonstrate that human infants are motivated for social interactions and suggest that the development of an awareness of other minds is rooted in the implicit notion that others are like the self. We then marshall evidence from functional neuroimaging explorations of the neurophysiological substrate of shared representations between the self and others, using various ecological paradigms such as mentally representing one's own actions versus others' actions, watching the actions executed by others, imitating the others' actions versus being imitated by others. We suggest that within this shared neural network the inferior parietal cortex and the prefrontal cortex in the right hemisphere play a special role in the essential ability to distinguish the self from others, and in the way the self represents the other. Interestingly, the right hemisphere develops its functions earlier than the left.     

The basis of shared intentions in human and robot cognition

There is a fundamental difference between robots that are equipped with sensory, motor and cognitive capabilities, vs. simulations or non-embodied cognitive systems. Via their perceptual and motor capabilities, these robotic systems can interact with humans in an increasingly more “natural” way, physically interacting with shared objects in cooperative action settings. Indeed, such cognitive robotic systems provide a unique opportunity to developmental psychologists for implementing their theories and testing their hypotheses on systems that are becoming increasingly “at home” in the sensory--motor and social worlds, where such hypotheses are relevant. The current research is the result of interaction between research in computational neuroscience and robotics on the one hand, and developmental psychology on the other. One of the key findings in the developmental psychology context is that with respect to other primates, humans appear to have a unique ability and motivation to share goals and intentions with others. This ability is expressed in cooperative behavior very early in life, and appears to be the basis for subsequent development of social cognition. Here we attempt to identify a set of core functional elements of cooperative behavior and the corresponding shared intentional representations. We then begin to specify how these capabilities can be implemented in a robotic system, the Cooperator, and tested in human–robot interaction experiments. Based on the results of these experiments we discuss the mutual benefit for both fields of the interaction between robotics and developmental psychology.     

The Social Nature of Perception and Action

ABSTRACT— Humans engage in a wide range of social activities. Previous research has focused on the role of higher cognitive functions, such as mentalizing (the ability to infer others' mental states) and language processing, in social exchange. This article reviews recent studies on action perception and joint action suggesting that basic perception–action links are crucial for many social interactions. Mapping perceived actions to one's own action repertoire enables direct understanding of others' actions and supports action identification. Joint action relies on shared action representations and involves modeling of others' performance in relation to one's own. Taking the social nature of perception and action seriously not only contributes to the understanding of dedicated social processes but has the potential to create a new perspective on the individual mind and brain.     

Shared representations between self and other: a social cognitive neuroscience view

The abilities to identify with others and to distinguish between self and other play a pivotal role in intersubjective transactions. Here, we marshall evidence from developmental science, social psychology and neuroscience (including clinical neuropsychology) that support the view of a common representation network (both at the computational and neural levels) between self and other. However, sharedness does not mean identicality, otherwise representations of self and others would completely overlap, and lead to confusion. We argue that self-awareness and agency are integral components for navigating within these shared representations. We suggest that within this shared neural network the inferior parietal cortex and the prefrontal cortex in the right hemisphere play a special role in interpersonal awareness.     

Joint action: bodies and minds moving together

The ability to coordinate our actions with those of others is crucial for our success as individuals and as a species. Progress in understanding the cognitive and neural processes involved in joint action has been slow and sparse, because cognitive neuroscientists have predominantly studied individual minds and brains in isolation. However, in recent years, major advances have been made by investigating perception and action in social context. In this article we outline how studies on joint attention, action observation, task sharing, action coordination and agency contribute to the understanding of the cognitive and neural processes supporting joint action. Several mechanisms are proposed that allow individuals to share representations, to predict actions, and to integrate predicted effects of own and others' actions.     

Action simulation in the human brain: Twelve questions

Although the idea of action simulation is nowadays popular in cognitive science, neuroscience and robotics, many aspects of the simulative processes remain unclear from empirical, computational, and neural perspectives. In the first part of the article, we provide a critical review and assessment of action simulation theories advanced so far in the wider literature of embodied and motor cognition. We focus our analysis on twelve key questions, and discuss them in the context of human and (occasionally) primate studies. In the second part of the article, we describe an integrative neuro-computational account of action simulation, which links the neural substrate (as revealed in neuroimaging studies of action simulation) to the components of a computational architecture that includes internal modeling, action monitoring and inhibition mechanisms.     

The predictive mirror: interactions of mirror and affordance processes during action observation

An important question for the study of social interactions is how the motor actions of others are represented. Research has demonstrated that simply watching someone perform an action activates a similar motor representation in oneself. Key issues include (1) the automaticity of such processes, and (2) the role object affordances play in establishing motor representations of others' actions. Participants were asked to move a lever to the left or right to respond to the grip width of a hand moving across a workspace. Stimulus-response compatibility effects were modulated by two task-irrelevant aspects of the visual stimulus: the observed reach direction and the match between hand-grasp and the affordance evoked by an incidentally presented visual object. These findings demonstrate that the observation of another person's actions automatically evokes sophisticated motor representations that reflect the relationship between actions and objects even when an action is not directed towards an object.     

How do spatial representations enhance cognitive numerical processing?

Several philosophical theories attempt to explain how actions performed in the world enhance cognitive processing: internalism, active externalism, and cognitive integration. The aim of this paper is to examine whether the use of spatial representations in arithmetic can shed light on this debate. Relying on philosophical analysis, on a discussion of empirical work in the cognitive neuroscience of number, and on a historical case study, I will show that spatial representations of number indicate an integration between internal and external cognitive processes.     

How do spatial representations enhance cognitive numerical processing?

Several philosophical theories attempt to explain how actions performed in the world enhance cognitive processing: internalism, active externalism, and cognitive integration. The aim of this paper is to examine whether the use of spatial representations in arithmetic can shed light on this debate. Relying on philosophical analysis, on a discussion of empirical work in the cognitive neuroscience of number, and on a historical case study, I will show that spatial representations of number indicate an integration between internal and external cognitive processes.     

Why (and how) should we study the interplay between emotional arousal,Theory of Mind,and inhibitory control to understand moral cognition?

Findings in the field of experimental psychology and cognitive neuroscience have shed new light on our understanding of the psychological and biological bases of morality. Although a lot of attention has been devoted to understanding the processes that underlie complex moral dilemmas, attempts to represent the way in which individuals generate moral judgments when processing basic harmful actions are rare. Here, we will outline a model of morality which proposes that the evaluation of basic harmful actions relies on complex interactions between emotional arousal, Theory of Mind (ToM) capacities, and inhibitory control resources. This model makes clear predictions regarding the cognitive processes underlying the development of and ability to generate moral judgments. We draw on data from developmental and cognitive psychology, cognitive neuroscience, and psychopathology research to evaluate the model and propose several conceptual and methodological improvements that are needed to further advance our understanding of moral cognition and its development.     

Imitation: is cognitive neuroscience solving the correspondence problem?

Imitation poses a unique problem: how does the imitator know what pattern of motor activation will make their action look like that of the model? Specialist theories suggest that this correspondence problem has a unique solution; there are functional and neurological mechanisms dedicated to controlling imitation. Generalist theories propose that the problem is solved by general mechanisms of associative learning and action control. Recent research in cognitive neuroscience, stimulated by the discovery of mirror neurons, supports generalist solutions. Imitation is based on the automatic activation of motor representations by movement observation. These externally triggered motor representations are then used to reproduce the observed behaviour. This imitative capacity depends on learned perceptual-motor links. Finally, mechanisms distinguishing self from other are implicated in the inhibition of imitative behaviour.     

Mental representations of magnitude and order: A dissociation by sensorimotor learning

Numbers and spatially directed actions share cognitive representations. This assertion is derived from studies that have demonstrated that the processing of small- and large-magnitude numbers facilitates motor behaviors that are directed to the left and right, respectively. However, little is known about the role of sensorimotor learning for such number–action associations. In this study, we show that sensorimotor learning in a serial reaction-time task can modify the associations between number magnitudes and spatially directed movements. Experiments 1 and 3 revealed that this effect is present only for the learned sequence and does not transfer to a novel unpracticed sequence. Experiments 2 and 4 showed that the modification of stimulus–action associations by sensorimotor learning does not occur for other sets of ordered stimuli such as letters of the alphabet. These results strongly suggest that numbers and actions share a common magnitude representation that differs from the common order representation shared by letters and spatially directed actions. Only the magnitude representation, but not the order representation, can be modified episodically by sensorimotor learning.     

Cognitive neuroscience of actions: a whole is greater than the sum of its parts

The purpose of the present issue of Brain and Cognition is to demonstrate that the strength of neuroscience is in its multidisciplinary approach to understand events. Here we are concerned with the domain of action recognition and production. Seven articles have been selected as representative studies of actions carried out in different areas of neuroscience such as neuropsychology, neurophysiology, and cognitive science. Although each addresses different questions within the field, the articles share a common neuroscientific knowledge, as can be readily gathered from the references cited in each article.     

Sensory-motor and cognitive functions of the human posterior parietal cortex involved in manual actions

The posterior parietal cortex (PPC) is considered the dominant structure in the dorsal stream of visual processing, defined in the context of systems for perception and action. It is well-established that the human PPC is critical to sensory-motor transformations involved in online manual actions. A related body of literature identifies the PPC as important to cognitive aspects of action representation such as imagery, tool use, and gestures. The goal of the present paper is to review and compare the PPC contribution to representations of both motor control and motor cognition. Relating the sensory-motor and cognitive components of PPC function is important for an understanding of integrative representations of manual actions and the relation between perception, action, and cognition. Proposed theories of multiple dorsal stream systems supporting different action-relevant goals are discussed.     

The motor theory of social cognition: a critique

Recent advances in the cognitive neuroscience of action have considerably enlarged our understanding of human motor cognition. In particular, the activity of the mirror system, first discovered in the brain of non-human primates, provides an observer with the understanding of a perceived action by means of the motor simulation of the agent's observed movements. This discovery has raised the prospects of a motor theory of social cognition. In humans, social cognition includes the ability to mindread, and many motor theorists of social cognition try to bridge the gap between motor cognition and mindreading by endorsing a simulation account of mindreading. Here, we question the motor theory of social cognition and give reasons for our skepticism.     

Understanding and sharing intentions: the origins of cultural cognition

We propose that the crucial difference between human cognition and that of other species is the ability to participate with others in collaborative activities with shared goals and intentions: shared intentionality. Participation in such activities requires not only especially powerful forms of intention reading and cultural learning, but also a unique motivation to share psychological states with others and unique forms of cognitive representation for doing so. The result of participating in these activities is species-unique forms of cultural cognition and evolution, enabling everything from the creation and use of linguistic symbols to the construction of social norms and individual beliefs to the establishment of social institutions. In support of this proposal we argue and present evidence that great apes (and some children with autism) understand the basics of intentional action, but they still do not participate in activities involving joint intentions and attention (shared intentionality). Human children's skills of shared intentionality develop gradually during the first 14 months of life as two ontogenetic pathways intertwine: (1) the general ape line of understanding others as animate, goal-directed, and intentional agents; and (2) a species-unique motivation to share emotions, experience, and activities with other persons. The developmental outcome is children's ability to construct dialogic cognitive representations, which enable them to participate in earnest in the collectivity that is human cognition.     

Non-symbolic arithmetic abilities and mathematics achievement in the first year of formal schooling

We examine the nature of motor representations evoked during comprehension of written sentences describing hand actions. We distinguish between two kinds of hand actions: a functional action, applied when using the object for its intended purpose, and a volumetric action, applied when picking up or holding the object. In Experiment 1, initial activation of both action representations was followed by selection of the functional action, regardless of sentence context. Experiment 2 showed that when the sentence was followed by a picture of the object, clear context-specific effects on evoked action representations were obtained. Experiment 3 established that when a picture of an object was presented alone, the time course of both functional and volumetric actions was the same. These results provide evidence that representations of object-related hand actions are evoked as part of sentence processing. In addition, we discuss the conditions that elicit context-specific evocation of motor representations.     

Individual differences in cognitive representations of action influence the activation of goal concepts

Goal representations play a key role in various psychological processes, including behavioral regulation, self-perception and social understanding. Research on cognitive representations of action has identified individual differences in the general tendency to construe actions in terms of their goal (vs. movement parameters), which can be reliably assessed with the Behavior Identification Form (BIF). The aim of the present study was to examine how individual differences in action identification, as measured by the BIF, affect online processing of action in a laboratory study. The main results showed that the level of action identification predicted participants' performance in a task designed to implicitly assess people's automatic processing of action regarding goal features. We discussed the possible role of impaired goal processing in psychological dysfunctions.     

The Interpenetration of Culture and Biology in Human Development

The central argument of this article is that human development should be viewed as the product of the interpenetration1 of cultural and biological processes. Using developmental system theory, it is argued that our work as investigators of human development is to examine this mutual coregulation: how biology and culture interpenetrate over time in concert with developmental processes. Various findings from developmental research are used to provide evidence on (a) how our biology constrains, gives expression to, mediates, or moderates how culture operates on developmental processes and (b) how culture infiltrates and becomes part of our biology and basic developmental processes. Examples of advances in neuroscience are also used to illustrate this interpenetration and to argue for the pervasiveness of cultural influences on development. To conduct the necessary research, new methodologies are needed. Promise is seen in emerging areas of social cognitive neuroscience.     

Body part representations in verbal semantics

Embodied theories of language propose that word meaning is inextricably tied to—grounded in—mental representations of perceptual, motor, and affective experiences of the world. The four experiments described in this article demonstrate that accessing the meanings of action verbs like smile, punch, and kick requires language understanders to activate modality-specific cognitive representations responsible for performing and perceiving those same actions. The main task used is a word-image matching task, where participants see an action verb and an image depicting an action. Their task is to decide as quickly as possible whether the verb and the image depict the same action. Of critical interest is participants’ behavior when the verb and image do not match, in which case the two actions can use the same effector or different effectors. In Experiment 1, we found that participants took significantly longer to reject a verb-image pair when the actions depicted by the image and denoted by the verb used the same effector than when they used different effectors. Experiment 2 yielded the same result when the order of presentation was reversed, replicating the effect in Cantonese. Experiment 3 replicated the effect in English with a verb-verb near-synonym task, and in Experiment 4, we once again replicated the effect with learners of English as a second language. This robust interference effect, whereby a shared effector slows discrimination, shows that language understanders activate effector-specific neurocognitive representations during both picture perception and action word understanding.