Priming and binding in and across perception and action: A correlational analysis of the internal structure of event files

Individual performance was compared across three different tasks that tap into the binding of stimulus features in perception, the binding of action features in action planning, and the emergence of stimulus–response bindings (“event files”). Within a task correlations between the size of binding effects were found within visual perception (e.g., the strength of shape–location binding correlated positively with the strength of shape–colour binding) but not between perception and action planning, suggesting different, domain-specific binding mechanisms. To some degree, binding strength was predicted by priming effects of the respective features, especially if these features varied on a dimension that matched the current attentional set.     

Auditory event files: Integrating auditory perception and action planning

The features of perceived objects are processed in distinct neural pathways, which call for mechanisms that integrate the distributed information into coherent representations (the binding problem). Recent studies of sequential effects have demonstrated feature binding not only in perception, but also across (visual) perception and action planning. We investigated whether comparable effects can be obtained in and across auditory perception and action. The results from two experiments revealed effects indicative of spontaneous integration of auditory features (pitch and loudness, pitch and location), as well as evidence for audio—manual stimulus—response integration. Even though integration takes place spontaneously, features related to task-relevant stimulus or response dimensions are more likely to be integrated. Moreover, integration seems to follow a temporal overlap principle, with features coded close in time being more likely to be bound together. Taken altogether, the findings are consistent with the idea of episodic event files integrating perception and action plans.     

Frequency of the first feature in action sequences influences feature binding

We investigated whether binding among perception and action feature codes is a preliminary step toward creating a more durable memory trace of an action event. If so, increasing the frequency of a particular event (e.g., a stimulus requiring a movement with the left or right hand in an up or down direction) should increase the strength and speed of feature binding for this event. The results from two experiments, using a partial-repetition paradigm, confirmed that feature binding increased in strength and/or occurred earlier for a high-frequency (e.g., left hand moving up) than for a low-frequency (e.g., right hand moving down) event. Moreover, increasing the frequency of the first-specified feature in the action sequence alone (e.g., ??left?? hand) increased the strength and/or speed of action feature binding (e.g., between the ??left?? hand and movement in an ??up?? or ??down?? direction). The latter finding suggests an update to the theory of event coding, as not all features in the action sequence equally determine binding strength. We conclude that action planning involves serial binding of features in the order of action feature execution (i.e., associations among features are not bidirectional but are directional), which can lead to a more durable memory trace. This is consistent with physiological evidence suggesting that serial order is preserved in an action plan executed from memory and that the first feature in the action sequence may be critical in preserving this serial order.     

Infants’ grip strength predicts mu rhythm attenuation during observation of lifting actions with weighted blocks

Research has established that the body is fundamentally involved in perception: bodily experience influences activation of the shared neural system underlying action perception and production during action observation, and bodily characteristics influence perception of the spatial environment. However, whether bodily characteristics influence action perception and its underlying neural system is unknown, particularly in early ontogeny. We measured grip strength in 12‐month‐old infants and investigated relations with mu rhythm attenuation, an electroencephalographic correlate of the neural system underlying action perception, during observation of lifting actions performed with differently weighted blocks. We found that infants with higher grip strength exhibited significant mu attenuation during observation of lifting actions, whereas infants with lower grip strength did not. Moreover, a progressively strong relation between grip strength and mu attenuation during observation of lifts was found with increased block weight. We propose that this relation is attributable to differences in infants’ ability to recognize the effort associated with lifting objects of different weights, as a consequence of their developing strength. Together, our results extend the body's role in perception by demonstrating that bodily characteristics influence action perception by shaping the activation of its underlying neural system.     

Modality-specific interference between action planning and perceptual processing

This paper reports a study which examined an interaction between action planning and processing of perceptual information in two different sensory modalities. In line with the idea that action planning consists in representing the action’s sensory outcomes, it was assumed that different types of actions should be coupled with different modalities. A visual and auditory oddball paradigm was combined with two types of actions: pointing and knocking (unrelated to the perceptual task). Results showed an interactive effect between the action type and the sensory modality of the oddballs, with impaired detection of auditory oddballs for knocking (congruent) action, as compared to a pointing (incongruent) action. These findings reveal that action planning can interact with modality-specific perceptual processing and that preparing an action presumably binds the respective perceptual features with an action plan, thereby making these features less available for other tasks.     

Dynamic effects of the Ebbinghaus illusion in grasping: support for a planning/control model of action

A distinction between planning and control can be used to explain the effects of context-induced illusions on actions. The present study tested the effects of the Ebbinghaus illusion on the planning and control of the grip aperture in grasping a disk. In two experiments, the illusion had an effect on grip aperture that decreased as the hand approached the target, whether or not visual feedback was available. These results are taken as evidence in favor of a planning/control model, in which planning is susceptible to context-induced illusions, whereas control is not. It is argued that many dissociations between perception and action may better be explained as dissociations between perception and on-line control.     

The planning and control model (PCM) of motorvisual priming: reconciling motorvisual impairment and facilitation effects

Previous research on dual-tasks has shown that, under some circumstances, actions impair the perception of action-consistent stimuli, whereas, under other conditions, actions facilitate the perception of action-consistent stimuli. We propose a new model to reconcile these contrasting findings. The planning and control model (PCM) of motorvisual priming proposes that action planning binds categorical representations of action features so that their availability for perceptual processing is inhibited. Thus, the perception of categorically action-consistent stimuli is impaired during action planning. Movement control processes, on the other hand, integrate multi-sensory spatial information about the movement and, therefore, facilitate perceptual processing of spatially movement-consistent stimuli. We show that the PCM is consistent with a wider range of empirical data than previous models on motorvisual priming. Furthermore, the model yields previously untested empirical predictions. We also discuss how the PCM relates to motorvisual research paradigms other than dual-tasks.     

From intentions via planning and behavior to physical exercise habits

ObjectivesIndividuals who enact a health behavior effortlessly with minimal conscious deliberation can be assumed to have formed a healthy habit. This can be reflected by increases in self-reported habit strength of a behavior. We examined whether physical exercise intentions facilitate changes in exercise habit strength by increasing the use of action planning and exercise.DesignTwo field studies investigated the effect of behavioral intentions on changes in habit strength through a sequential path from action planning to exercise.MethodExercise intentions, action planning, habit strength, and exercise were assessed at two measurement points in time in 231 university students (Study 1), and at four points in time in 134 rehabilitation patients (Study 2).ResultsIn multiple-step mediation models in both samples, there were indirect effects of intentions on habit strength through action planning and behavior.ConclusionAction planning and behavior operated as sequential mediators to bridge the gap between intentions and habit strength. Exercise habit strength may increase as a result of conscious action planning and frequent behavior enactment. Including these constructs jointly into behavior change models may improve the understanding of the mechanisms involved in behavior maintenance.     

Temporal Binding,Causation, and Agency: Developing a New Theoretical Framework

In temporal binding, the temporal interval between one event and another, occurring some time later, is subjectively compressed. We discuss two ways in which temporal binding has been conceptualized. In studies showing temporal binding between a voluntary action and its causal consequences, such binding is typically interpreted as providing a measure of an implicit or pre-reflective “sense of agency.” However, temporal binding has also been observed in contexts not involving voluntary action, but only the passive observation of a cause–effect sequence. In those contexts, it has been interpreted as a top-down effect on perception reflecting a belief in causality. These two views need not be in conflict with one another, if one thinks of them as concerning two separate mechanisms through which temporal binding can occur. In this paper, we explore an alternative possibility: that there is a unitary way of explaining temporal binding both within and outside the context of voluntary action as a top-down effect on perception reflecting a belief in causality. Any such explanation needs to account for ways in which agency, and factors connected with agency, has been shown to affect the strength of temporal binding. We show that principles of causal inference and causal selection already familiar from the literature on causal learning have the potential to explain why the strength of people's causal beliefs can be affected by the extent to which they are themselves actively involved in bringing about events, thus in turn affecting binding.     

A computational model of perception and action for cognitive robotics

Robots are increasingly expected to perform tasks in complex environments. To this end, engineers provide them with processing architectures that are based on models of human information processing. In contrast to traditional models, where information processing is typically set up in stages (i.e., from perception to cognition to action), it is increasingly acknowledged by psychologists and robot engineers that perception and action are parts of an interactive and integrated process. In this paper, we present HiTEC, a novel computational (cognitive) model that allows for direct interaction between perception and action as well as for cognitive control, demonstrated by task-related attentional influences. Simulation results show that key behavioral studies can be readily replicated. Three processing aspects of HiTEC are stressed for their importance for cognitive robotics: (1) ideomotor learning of action control, (2) the influence of task context and attention on perception, action planning, and learning, and (3) the interaction between perception and action planning. Implications for the design of cognitive robotics are discussed.     

从视觉知觉与行为的分离看行为的计划-控制模型

知觉与行为的分离现象最早是从临床病例中发现的,以后研究者在正常人身上利用错觉实验范式继续探索该现象,并由此发展了4个模型进行解释。其中,计划-控制模型得到了众多实验事实的支持。该模型认为：行为分为计划和控制两个阶段,每个阶段都有独立的加工模块,每个模块使用不同的视觉表征;错觉影响计划阶段,但是不影响在线控制阶段。本文重点回顾了动态错觉效应对计划-控制模型的实验验证,并进行了评价和展望     

Intentionality and temporal binding: Do causality beliefs increase the perceived temporal attraction between events?

Intentional motor actions and their effects are bound together in temporal perception, resulting in the so-called intentional binding effect. In the current study, we address an alternative explanatory mechanism for the emergence of temporal binding by excluding the role of motor action. Employing a sensory-based Libet clock paradigm, we examined temporal perception of two different auditory stimuli, and tested the influence of beliefs about the causal relationship between the two auditory stimuli, thus simulating a crucial feature of intentional action. In two experiments, we found a robust temporal repulsion effect, indicating that instead of being attracted to each other, the auditory stimuli were shifted away from each other in temporal perception. Interestingly, repulsion was attenuated by causal beliefs, but this effect was fragile. Furthermore, temporal repulsion was unaffected by the intensity of prior learning. Findings are discussed in the context of intentional action awareness research and multisensory integration.     

Initial and concurrent planning in solutions to well-structured problems

Two experiments are reported, which consider planning behaviour in the context of a well-structured problem. One question in the problem-solving literature is to what extent planning a solution to a problem takes place before attempting that problem and whether this takes precedence over planning while solving a problem, hereafter referred to as “concurrent planning”. An additional question is whether the adoption of one mode of planning confers a performance advantage and under what circumstances one strategy is adopted in preference to others. The studies reported here set out to investigate the effects on performance of adopting different modes of planning and whether there is any relationship between the adoption of different strategic approaches and problem-solving performance. The results of these studies suggest that initial planning can enhance problem-solving performance, but only when problems remain relatively simple. As problem complexity increases the effects of initial planning appear to have little or no effect upon performance. In conclusion it is suggested that strategy use depends upon the interactions between individual preference for a given strategy, problem complexity, and the stage that one has reached in the development of a solution to a problem.     

Binocular rivalry and stereoscopic depth perception

An investigation was made of stimulus factors causing retinal rivalry or allowing stereoscopic depth perception, given a requisite positional disparity. It is shown that similar colour information can be “filtered” out from both eyes; that stereopsis is not incompatible with rivalry and suppression of one aspect of the stimulus, and that the strongest cue for perception of stereoscopic depth is intensity difference at the boundaries of the figures in the same direction at each eye. Identity of colour can also act as a cue for stereopsis. The brightness of different monocular figures seen in the stereoscope in different combinations was estimated by a matching technique, and it is suggested that the perceived brightness is a compromise between the monocular brightness difference between figure and ground seen in relation to the binocular fused background, and the mean brightness of the figures. The results are discussed in terms of neurophysiological “on,” “off” and continuous response fibres.     

A double dissociation between action and perception in the context of visual illusions: opposite effects of real and illusory size

The idea that there are two distinct cortical visual pathways, a dorsal action stream and a ventral perception stream, is supported by neuroimaging and neuropsychological evidence. Yet there is an ongoing debate as to whether or not the action system is resistant to pictorial illusions in healthy participants. In the present study, we disentangled the effects of real and illusory object size on action and perception by pitting real size against illusory size. In our task, two objects that differed slightly in length were placed within a version of the Ponzo illusion. Even though participants erroneously perceived the physically longer object as the shorter one (or vice versa), their grasping was remarkably tuned to the real size difference between the objects. These results provide the first demonstration of a double dissociation between action and perception in the context of visual illusions and together with previous findings converge on the idea that visually guided action and visual perception make use of different metrics and frames of reference.     

What do we learn from binding features? Evidence for multilevel feature integration

Four experiments were conducted to investigate the relationship between the binding of visual features (as measured by their aftereffects on subsequent binding) and the learning of feature-conjunction probabilities. Both binding and learning effects were obtained, but they did not interact. Interestingly, (shape-color) binding effects disappeared with increasing practice, presumably because of the fact that only 1 of the features involved was relevant to the task. However, this instability was only observed for arbitrary, not highly overlearned combinations of simple geometric features and not for real objects (colored pictures of a banana and strawberry), where binding effects were strong and resistant to practice. These findings suggest that learning has no direct impact on the strength or resistance of bindings or on speed with which features are bound; however, learning does affect the amount of attention particular feature dimensions attract, which again can influence which features are considered in binding.     

Visual space perception and action: Introductory remarks

Vision evolved from the vital necessity to act in a dynamic environment. Following this view it is clear that perceptual processes and action planning are much more interlocked than is evident at first sight. This is especially evident in visual space perception; actions are performed in space and are guided and controlled by objects in spatial positions. Here we shortly introduce the three research camps dealing with the relationship between space perception and action: the ecological camp, the two‐visual‐systems camp, and the constructivist camp. We show that these camps emphasize and open different theoretical and empirical perspectives, but that they can be seen to complement each other. We end with an overview of the papers in this special issue.     

Close binding of identity and location in visual feature perception

The binding of identity and location information in disjunctive feature search was studied. Ss searched a heterogeneous display for a color or a form target, and reported both target identity and location. To avoid better than chance guessing of target identity (by choosing the target less likely to have been seen), the difficulty of the two targets was equalized adaptively; a mathematical model was used to quantify residual effects. A spatial layout was used that minimized postperceptual errors in reporting location. Results showed strong binding of identity and location perception. After correction for guessing, no perception of identity without location was found. A weak trend was found for accurate perception of target location without identity. We propose that activated features generate attention-calling "interrupt" signals, specifying only location; attention then retrieves the properties at that location.     

Tracking without perceiving: a dissociation between eye movements and motion perception

Can people react to objects in their visual field that they do not consciously perceive? We investigated how visual perception and motor action respond to moving objects whose visibility is reduced, and we found a dissociation between motion processing for perception and for action. We compared motion perception and eye movements evoked by two orthogonally drifting gratings, each presented separately to a different eye. The strength of each monocular grating was manipulated by inducing adaptation to one grating prior to the presentation of both gratings. Reflexive eye movements tracked the vector average of both gratings (pattern motion) even though perceptual responses followed one motion direction exclusively (component motion). Observers almost never perceived pattern motion. This dissociation implies the existence of visual-motion signals that guide eye movements in the absence of a corresponding conscious percept.     

Action,prediction, and temporal awareness

The brain needs to track changes in the relation between action and effect. In two experiments, participants made voluntary keypress actions. In an adaptation phase, these actions were followed after a fixed interval by a tone. During a subsequent test phase, the duration of the interval was unexpectedly changed. We used time perception as an implicit marker of the experience of participants' control over the effect, and confirmed a temporal binding between actions and effects. On test trials, participants perceived tones to occur as shifted towards their time of occurrence in the preceding adaptation phase. Therefore, the perceived time of a tone was partly based on learning of an internal prediction, rather than on the time of actual sensory input. This predictive model is rapidly updated over a few trials (Experiment 1), and requires attention to the tones (Experiment 2). The brain learns action–effect relations. This predictive learning influences the perception of effects, and underlies some temporal illusions associated with action.