New insights on sensorimotor integration: from hand action to speech perception

In the last two decades the integrative role of the frontal premotor cortex (a mosaic of agranular/disgranular areas lying in front of the primary motor cortex) have been more and more elucidated. Among its various functions, sensorimotor transformation, and action representation storage, also for nonstrictly motor purposes, are the most intriguing properties of this region, as shown by several researches. In this article we will mainly focus on the ventro-rostral part of the monkey premotor cortex (area F5) in which visual information describing objects and others' acting hands are associated with goal-directed motor representations of hand movements. We will describe the main characteristics of F5 premotor neurons and we will provide evidence in favor of a parallelism between monkeys and humans on the basis of new experimental observations. Finally, we will present some data indicating that, both in humans and in monkeys, action-related sensorimotor transformations are not restricted to visual information but concern also acoustic information.     

Discourse, action, rhetoric: from a perception to an action paradigm in social psychology

This article provides a personal account of how discursive social psychology has been used to understand social and political change in South Africa and to reflect on the strengths and limitations of the approach. While celebrating the shift from the perception paradigm to the genuinely social constructionist focus on discursive interaction, the article also argues for an expanded focus on embodied action.     

The interaction of attention and action: From seeing action to acting on perception

We discuss evidence indicating that human visual attention is strongly modulated by the potential of objects for action. The possibility of action between multiple objects enables the objects to be attended as a single group, and the fit between individual objects in a group and the action that can be performed influences responses to group members. In addition, having a goal state to perform a particular action affects the stimuli that are selected along with the features and area of space that is attended. These effects of action may reflect statistical learning between environmental cues that are linked by action and/or the coupling between perception and action systems in the brain. The data support the argument that visual selection is a flexible process that emerges as a need to prioritize objects for action.     

Temporal perception in joint action: This is MY action

Here we investigated the temporal perception of self- and other-generated actions during sequential joint actions. Participants judged the perceived time of two events, the first triggered by the participant and the second by another agent, during a cooperative or competitive interaction, or by an unspecified mechanical cause. Results showed that participants perceived self-generated events as shifted earlier in time (anticipation temporal judgment bias) and non-self-generated events as shifted later in time (repulsion temporal judgment bias). This latter effect was observed independently from the kind of cause (i.e., agentive or mechanical) or interaction (i.e., cooperative or competitive). We suggest that this might represent a mental process which allows discriminating events that cannot plausibly be linked to one’s own action. When an event immediately follows a self-generated one, temporal judgment biases operate as self-serving biases in order to separate self-generated events from events of another physical causality.     

Erratum to: Voluntary action alters the perception of visual illusions

Attention, Perception, & Psychophysics -     

Perceiving while acting: action affects perception

In two experiments we studied how motor responses affect stimulus encoding when stimuli and responses are functionally unrelated and merely overlap in time. Such R-S effects across S-R assignments have been reported by Schubö, Aschersleben, and Prinz (2001), who found that stimulus encoding was affected by concurrent response execution in the sense of a contrast (i.e., emphasizing differences). The present study aimed at elucidating the mechanisms underlying this effect. Experiment 1 studied the time course of the R-S effect. Contrast was only obtained for short intertrial intervals (ITIs). With long ITIs contrast turned into assimilation (i.e., emphasizing similarities). Experiment 2 excluded an interpretation of the assimilation effect in terms of motor repetition. Our findings support the notion of a shared representational domain for perception and action control, and suggest that contrast between stimulus and response codes emerges when two S-R assignments compete with each other in perception. When perceptual competition is over, assimilation emerges in memory.     

Peripersonal perception in action

Philosophy of perception is guilty of focusing on the perception of far space, neglecting the possibility that the perception of the space immediately surrounding the body, which is known as peripersonal space, displays different properties. Peripersonal space is the space in which the world is literally at hand for interaction. It is also the space in which the world can become threatening and dangerous, requiring protective behaviours. Recent research in cognitive neuroscience has yielded a vast array of discoveries on the multisensory and sensorimotor specificities of the processing of peripersonal space. Yet very little has been done on their philosophical implications. Here I will raise the following question: in what manner does the visual experience of a big rock close to my foot differ from the visual experience of the moon in the sky?

     

Letter perception: from pixels to pandemonium

In 1959, Oliver Selfridge proposed a model of letter perception, the Pandemonium model, in which the central hypothesis was that letters are identified via their component features. Although a consensus developed around this general approach over the years, key evidence in its favor remained lacking. Recent research has started to provide important evidence in favor of feature-based letter perception, describing the nature of the features, and the time-course of processes involved in mapping features onto abstract letter identities. There is now hope that future 'pandemonium-like' models will be able to account for the rich empirical database on letter identification that has accumulated over the past 50 years, hence solving one key component of the reading process.     

The influence of action observation on action execution: Dissociating the contribution of action on perception,perception on action,and resolving conflict

For more than 15 years, motor interference paradigms have been used to investigate the influence of action observation on action execution. Most research on so-called automatic imitation has focused on variables that play a modulating role or investigated potential confounding factors. Interestingly, furthermore, a number of functional magnetic resonance imaging (fMRI) studies have tried to shed light on the functional mechanisms and neural correlates involved in imitation inhibition. However, these fMRI studies, presumably due to poor temporal resolution, have primarily focused on high-level processes and have neglected the potential role of low-level motor and perceptual processes. In the current EEG study, we therefore aimed to disentangle the influence of low-level perceptual and motoric mechanisms from high-level cognitive mechanisms. We focused on potential congruency differences in the visual N190 ? a component related to the processing of biological motion, the Readiness Potential ? a component related to motor preparation, and the high-level P3 component. Interestingly, we detected congruency effects in each of these components, suggesting that the interference effect in an automatic imitation paradigm is not only related to high-level processes such as self-other distinction but also to more low-level influences of perception on action and action on perception. Moreover, we documented relationships of the neural effects with (autistic) behavior.     

Visual space perception and action: Introductory remarks

Vision evolved from the vital necessity to act in a dynamic environment. Following this view it is clear that perceptual processes and action planning are much more interlocked than is evident at first sight. This is especially evident in visual space perception; actions are performed in space and are guided and controlled by objects in spatial positions. Here we shortly introduce the three research camps dealing with the relationship between space perception and action: the ecological camp, the two‐visual‐systems camp, and the constructivist camp. We show that these camps emphasize and open different theoretical and empirical perspectives, but that they can be seen to complement each other. We end with an overview of the papers in this special issue.     

Perceiving virtual geographical slant: action influences perception

In 4 experiments, the authors varied the extent and nature of participant movement in a virtual environment to examine the influence of action on estimates of geographical slant. Previous studies showed that people consciously overestimate hill slant but can still accurately guide an action toward the hill (D. R. Proffitt, M. Bhalla, R. Gossweiler, & J. Midgett, 1995). Related studies suggest that one's potential to act may influence perception of slant and that distinct representations may independently inform perceptual and motoric responses. The authors found that in all conditions, perceptual judgments were overestimated and motoric adjustments were more accurate. The virtual environment allowed manipulation of the effort required to walk up simulated hills. Walking with the effort appropriate to the visual slant led to increased perceptual overestimation of slant compared with active walking with the effort appropriate to level ground, while visually guided actions remained accurate.     

Representing serial action and perception

This article presents a review on the representational base of sequence learning in the serial reaction time task. The first part of the article addresses the major questions and challenges that underlie the debate on implicit and explicit learning. In the second part, the informational content that underlies sequence representations is reviewed. The latter issue has produced a rich and equivocal literature. A taxonomy illustrates that substantial support exists for associations between successive stimulus features, between successive response features, and between successive response-to-stimulus compounds. We suggest that sequence learning is not predetermined with respect to one particular type of information but, rather, develops according to an overall principle of activation contingent on task characteristics. Moreover, substantiating such an integrative approach is proposed by a synthesis with the dual-system model (Keele, Ivry, Mayr, Hazeltine, & Heuer, 2003).     

Grasping the diagonal: controlling attention to illusory stimuli for action and perception

Since the pioneering work of [Aglioti, S., DeSouza, J. F., & Goodale, M. A. (1995). Size-contrast illusions deceive the eye but not the hand. Current Biology, 5(6), 679-685] visual illusions have been used to provide evidence for the functional division of labour within the visual system-one system for conscious perception and the other system for unconscious guidance of action. However, these studies were criticised for attentional mismatch between action and perception conditions and for the fact that grip size is not determined by the size of an object but also by surrounding obstacles. Stoettinger and Perner [Stoettinger, E., & Perner, J., (2006). Dissociating size representations for action and for conscious judgment: Grasping visual illusions without apparent obstacles. Consciousness and Cognition, 15, 269-284] used the diagonal illusion controlling for the influence of surrounding features on grip size and bimanual grasping to rule out attentional mismatch. Unfortunately, the latter objective was not fully achieved. In the present study, attentional mismatch was avoided by using only the dominant hand for action and for indicating perceived size. Results support the division of labour: Grip aperture follows actual size independent of illusory effects, while finger-thumb span indications of perceived length are clearly influenced by the illusion.     

Stratification in perception and action

Summary This paper discusses the concept of stratification, in the sense of levels of analysis and levels of control, in relation to human perception and performance. It is contended that functional analysis is the proper level of analysis for the domain of perception and action. This is illustrated by means of models of cognitive energetics and motor control. The functional level of analysis can be situated in between the level of symbolic representations and the level of neurophysiological mechanisms. It is also argued that the concept of levels of control provides a way of integrating or relating ecological and information-processing approaches to psychology, in the sense that ecological psychology is concerned with lower and more peripheral levels of control (coordinative structures). Finally, some remarks are made on the relation between cognition and perception and action, drawing on Piaget, and it is proposed that the concept of schema is more appropriate for the domain of perception and action than is the notion of symbolic representations.     

Grounding words in perception and action: computational insights

We use words to communicate about things and kinds of things, their properties, relations and actions. Researchers are now creating robotic and simulated systems that ground language in machine perception and action, mirroring human abilities. A new kind of computational model is emerging from this work that bridges the symbolic realm of language with the physical realm of real-world referents. It explains aspects of context-dependent shifts of word meaning that cannot easily be explained by purely symbolic models. An exciting implication for cognitive modeling is the use of grounded systems to 'step into the shoes' of humans by directly processing first-person-perspective sensory data, providing a new methodology for testing various hypotheses of situated communication and learning.