The temporal dynamics of the perceptual consequences of action-effect prediction

An essential aspect of voluntary action control is the ability to predict the perceptual effects of our actions. Although the influence of action-effect prediction on humans’ behavior and perception is unequivocal, it remains unclear when action-effect prediction is generated by the brain. The present study investigates the dynamics of action effect anticipation by tracing the time course of its perceptual consequences. Participants completed an acquisition phase during which specific actions (left and right key-presses) were associated with specific visual effects (upward and downward dots motion). In the test phase they performed a 2 AFC identification task in which they were required to indicate whether the dots moved upward or downward. To isolate any effects of action-effect prediction on perception, participants were presented with congruent and incongruent dot motion in which the association participants learned in the previous acquisition phase was respected and violated, respectively. Crucially, to assess the temporal dynamics of action prediction, congruent and incongruent stimuli were presented at different intervals before or after action execution. We observed higher sensitivity (d′) to motion discrimination in congruent vs. incongruent trials only when stimuli were presented from about 220 ms before the action to 280 ms after the action. The temporal dynamics of our effect suggest that action-effect prediction modulates perception at later stages of motor preparation.     

An investigation of the determinants of motor contagion in preschool children

The influence of action perception on action execution has been demonstrated by studies of motor contagion in which the observation of an action interferes with the concurrent execution of a different action. The current study extends prior work on the extent of motor contagion in early childhood, a period of development when the effects of action observation on action execution may be particularly salient. During a classroom story reading, children (mean age 4.8 years) were familiarized with two different-colored bears, one of which was used as a seemingly animate hand puppet while the other bear remained lifeless and inanimate. Children then completed a task in which they were instructed to move a stylus on a graphics tablet in the presence of background videos of each bear making horizontal arm movements which had biological (human-moved) or non-biological (machine-moved) origins. Motor contagion was assessed as the variability of stylus movements in the horizontal axis when children were instructed to produce vertical stylus movements. Significant levels of motor contagion were seen when children observed the previously animate bear in the non-biological motion condition and when they observed the previously inanimate bear in the biological motion condition. For future studies of social perception, this finding points to the potential importance of examining mismatches between prior experience with (or knowledge about) a particular agent and the subsequent behavior of that agent in a different context.     

Rôle des propriétés inertielles segmentaires sur la perception de l’étendue de l’espace péripersonnel

Previous studies have suggested that the perception of peripersonal space can hardly be achieved using only scene-based visual cues and requires combining visual information with motor representations. Motor representation can be viewed as a component of a predictive system, which includes a neural process that simulates through motor imagery the dynamic behaviour of the body in relation to the environment. In this study, we analysed whether modifying the force required to reach a visual target influences the perception of what is reachable. In a visuomotor task, the experimental group (n = 10) adapted to a 1.5 kg weight attached to the right wrist while performing a series of pointing movements. The control group (n = 10) performed the motor task without inertial perturbation. A perceptual judgement task of what is reachable was performed before and after the motor task. Results showed that inertial perturbation produced initially an undershoot of the target suggesting a lack of motor force to overcome the inertial perturbation, but spatial errors receded progressively through movement rehearsal. Perceptual estimates of what is reachable slightly overestimated action capacities but were not affected by motor adaptation. Thus, modifying motor force required to compensate for inertial perturbation had no direct effect on the perception of peripersonal space. When interpreted in regard to previous experimental work, this result suggests that motor representations may provide information about the sensory or spatial consequences of action rather than the sense of effort associated with motor production.     

Target-directed visual attention is a prerequisite for action-specific perception

Witt et al. (2008) have recently shown that golfers who putt with more success perceive the hole to be bigger than golfers who putt with less success. In three experiments, we systematically examined whether this phenomenon, labelled action-specific perception, depends on directing visual attention towards the action target. In Experiment 1 we replicated previously reported action-specific effects on perception in golf putting. In 3 and 4 we directly assessed whether action-specific effects on perception in golf putting are dependent on focusing visual attention on the target. To this end, the participants performed the putting task while visual attention towards the target was either completely withheld (Experiment 2) or divided over the target and other task-relevant objects (Experiment 3). No action-specific effects were found when visual attention towards the action target was occluded or partially diverted from the target. Together, our results provide evidence to suggest that focusing visual attention on the target while performing the action is a prerequisite for the emergence of action-specific perception.     

A comparison of auditory and visual apparent motion presented individually and with crossmodal moving distractors

Unimodal auditory and visual apparent motion (AM) and bimodal audiovisual AM were investigated to determine the effects of crossmodal integration on motion perception and direction-of-motion discrimination in each modality. To determine the optimal stimulus onset asynchrony (SOA) ranges for motion perception and direction discrimination, we initially measured unimodal visual and auditory AMs using one of four durations (50, 100, 200, or 400 ms) and ten SOAs (40-450 ms). In the bimodal conditions, auditory and visual AM were measured in the presence of temporally synchronous, spatially displaced distractors that were either congruent (moving in the same direction) or conflicting (moving in the opposite direction) with respect to target motion. Participants reported whether continuous motion was perceived and its direction. With unimodal auditory and visual AM, motion perception was affected differently by stimulus duration and SOA in the two modalities, while the opposite was observed for direction of motion. In the bimodal audiovisual AM condition, discriminating the direction of motion was affected only in the case of an auditory target. The perceived direction of auditory but not visual AM was reduced to chance levels when the crossmodal distractor direction was conflicting. Conversely, motion perception was unaffected by the distractor direction and, in some cases, the mere presence of a distractor facilitated movement perception.     

Attention to body-parts varies with visual preference and verb–effector associations

Theories of embodied conceptual meaning suggest fundamental relations between others’ actions, language, and our own actions and visual attention processes. Prior studies have found that when people view an image of a neutral body in a scene they first look toward, in order, the head, torso, hands, and legs. Other studies show associations between action verbs and the body-effectors used in performing the action (e.g., “jump” with feet/legs; “talk” with face/head). In the present experiment, the visual attention of participants was recorded with a remote eye-tracking system while they viewed an image of an actor pantomiming an action and heard a concrete action verb. Participants manually responded whether or not the action image was a good example of the verb they heard. The eye-tracking results confirmed that participants looked at the head most, followed by the hands, and the feet least of all; however, visual attention to each of the body-parts also varied as a function of the effector associated with the spoken verb on image/verb congruent trials, particularly for verbs associated with the legs. Overall, these results suggest that language influences some perceptual processes; however, hearing auditory verbs did not alter the previously reported fundamental hierarchical sequence of directed attention, and fixations on specific body-effectors may not be essential for verb comprehension as peripheral visual cues may be sufficient to perform the task.     

Walking perception by walking observers

People frequently analyze the actions of other people for the purpose of action coordination. To understand whether such self-relative action perception differs from other-relative action perception, the authors had observers either compare their own walking speed with that of a point-light walker or compare the walking speeds of 2 point-light walkers. In Experiment 1, observers walked, bicycled, or stood while performing a gait-speed discrimination task. Walking observers demonstrated the poorest sensitivity to walking speed, suggesting that perception and performance of the same action alters visual-motion processes. Experiments 2-6 demonstrated that the processes used during self-relative and other-relative action perception differ significantly in their dependence on observers' previous motor experience, current motor effort, and potential for action coordination. These results suggest that the visual analysis of human motion during traditional laboratory studies can differ substantially from the visual analysis of human movement under more realistic conditions.     

生物运动及其在社会认知障碍研究中的应用

人类对生物运动具有较强的视觉敏感性,即使在视觉线索有限的情况下,仍能提取其中的社会性信息。本研究系统梳理了当前生物运动视知觉实验研究涉及的各类社会性信息,并归纳分析社会认知缺陷与生物运动视知觉加工之间的内在联系,以期促进对生物运动视知觉加工心理机制问题的深入探讨     

Understanding of action-related and abstract verbs in comparison: a behavioral and TMS study

Does the comprehension of both action-related and abstract verbs rely on motor simulation? In a behavioral experiment, in which a semantic task was used, response times to hand-action-related verbs were briefer than those to abstract verbs and both decreased with repetition of presentation. In a transcranial magnetic stimulation (TMS) experiment, single-pulse stimulation was randomly delivered over hand motor area of the left primary motor cortex to measure cortical-spinal excitability at 300 or 500 ms after verb presentation. Two blocks of trials were run. In each block, the same verbs were randomly presented. In the first block, stimulation induced an increase in motor evoked potentials only when TMS was applied 300 ms after action-related verb presentation. In the second block, no modulation of motor cortex was found according to type of verb and stimulation-delay. These results confirm that motor simulation can be used to understand action rather than abstract verbs. Moreover, they suggest that with repetition, the semantic processing for action verbs does not require activation of primary motor cortex anymore.     

Observing or producing a motor action improves later perception of biological motion: Evidence for a gender effect

Two experiments are presented addressing the issue of whether observing (visual priming) or producing (motor priming) a running activity during a very short period (30 s) facilitates the perception of the direction of a point-light runner embedded in a dense dynamical mask. Experiment 1 showed that perceptual judgements improved and response time increased in the visual priming compared to the neutral priming condition (video of a moving car) in which judgements were at random. Because this effect was observed for male participants only, we performed a second experiment with the aim of evaluating the role of gender congruency in the visual priming condition. Results confirmed the facilitation effect and demonstrated that this effect was strictly dependent on the gender congruency between the perceiver and the priming information. Moreover, we found that actually producing a motor activity similar to the one presented in the video sequence improved to the same extent participants’ judgement of the direction of the point-light runner, without any gender effect. As a whole, these findings argue in favour of common representation for the perception and the production of human movement and showed that the perception of biological motion can be improved by prior motor activity either performed or observed. However, the gender-dependent effect of visual priming suggested that motor repertoire differed in males and females.     

Spatial patterns in tactile perception: is there a tactile field?

Previous studies of tactile spatial perception focussed either on a single point of stimulation, on local patterns within a single skin region such as the fingertip, on tactile motion, or on active touch. It remains unclear whether we should speak of a tactile field, analogous to the visual field, and supporting spatial relations between stimulus locations. Here we investigate this question by studying perception of large-scale tactile spatial patterns on the hand, arm and back. Experiment 1 investigated the relation between perception of tactile patterns and the identification of subsets of those patterns. The results suggest that perception of tactile spatial patterns is based on representing the spatial relations between locations of individual stimuli. Experiment 2 investigated the spatial and temporal organising principles underlying these relations. Experiment 3 showed that tactile pattern perception makes reference to structural representations of the body, such as body parts separated by joints. Experiment 4 found that precision of pattern perception is poorer for tactile patterns that extend across the midline, compared to unilateral patterns. Overall, the results suggest that the human sense of touch involves a tactile field, analogous to the visual field. The tactile field supports computation of spatial relations between individual stimulus locations, and thus underlies tactile pattern perception.     

Effects of motor congruence on visual working memory

Grounded-cognition theories suggest that memory shares processing resources with perception and action. The motor system could be used to help memorize visual objects. In two experiments, we tested the hypothesis that people use motor affordances to maintain object representations in working memory. Participants performed a working memory task on photographs of manipulable and nonmanipulable objects. The manipulable objects were objects that required either a precision grip (i.e., small items) or a power grip (i.e., large items) to use. A concurrent motor task that could be congruent or incongruent with the manipulable objects caused no difference in working memory performance relative to nonmanipulable objects. Moreover, the precision- or power-grip motor task did not affect memory performance on small and large items differently. These findings suggest that the motor system plays no part in visual working memory.     

Orthography, phonology, short-term memory and the effects of concurrent articulation on rhyme and homophony judgements

The role of phonological short-term memory (pSTM) in phonological judgement tasks of print has been widely explored using concurrent articulation (CA). A number of studies have examined the effects of CA on written word/nonword rhyme and homophone judgements but the findings have been mixed and few studies have examined both tasks within subjects. Also important is the influence of orthographic similarity on such tasks (i.e., items that share phonology often strongly overlap on orthography). Although there are reports of orthographic similarity effects (e.g., LOAD-TOAD vs. DIAL-MILE) on rhyme judgements, it is unknown whether (a) similar orthographic effects are present with homophone judgements, (b) the degree to which such orthographic effects interact with CA, and (c) the degree to which such orthographic effects interact with lexical status (words vs. nonwords). The present work re-examines these three issues in a within subject design. CA and orthographic similarity yielded subtle differences across tasks. CA impaired accuracy for both homophone and rhyme judgement, but only slowed RTs on the rhyme judgement task, and then only for words. Orthographic similarity yielded an increase in false positives for similar items and vice versa for dissimilar items, suggesting a general impact of an orthographically based ‘bias’ in choosing similar or dissimilar sounding items. This pattern was amplified under CA but only on the homophone judgement task. These results highlight important interactions between phonological and orthographic representations in phonological judgement tasks, and the findings are considered both with reference to earlier studies and several models of pSTM.     

动词理解中空间表征的激活过程

探讨动词理解中空间表征的激活过程。被试听以不同空间轴向动词作谓语的句子后辨认视觉刺激的形状。实验1以肯定句为材料探讨语义理解对视知觉任务的影响。实验2以客观原因否定句为材料排除句子表征的影响。实验3以主观原因否定句为材料探讨动词空间元素的激活机制。总的结果表明,动词理解过程中激活其表征中的空间元素,这种激活是自动的、非策略性的,不受情境中客观原因或主观意愿否定的影响。动词理解空间效应反映了语言表征中的知觉运动特征     

The comprehension of action-related sentences may cause interference rather than facilitation on matching actions

This study used a dual-task paradigm to analyze the time course of motor resonance during the comprehension of action language. In the study, participants read sentences describing a transfer either away from (“I threw the tennis ball to my rival”) or toward themselves (“My rival threw me the tennis ball”). When the transfer verb appeared on the screen, and after a variable stimulus onset asynchrony (SOA), a visual motion cue (Experiment 1) or a static cue (Experiment 2) prompted participants to move their hand either away from or toward themselves to press a button. The results showed meaning–action interference at short SOAs and facilitation at the longest SOA for the matching conditions. These results support the hypothesis that motor processes associated with the comprehension of action-related language interfere with an overlapping motor task, whereas they facilitate a delayed motor task. These effects are discussed in terms of resonance processes in the motor cortex.     

The influence of motor expertise and motor experience on action and actor recognition

Two experiments examined whether different levels of motor and visual experience influence action perception and whether this effect depends on the type of perceptual task. Within an action recognition task (Experiment 1), professional basketball players and novice college students were asked to identify basketball dribbles from point-light displays. Results showed faster reaction times and greater accuracy in experts, but no advantage when observing either own or teammates’ actions compared with unknown expert players. Within an actor recognition task (Experiment 2), the same expert players were asked to identify the model actors. Results showed poor discrimination between teammates and players from another team, but a more accurate assignment of own actions to the own team. When asked to name the actor, experts recognised themselves slightly better than teammates. Results support the hypothesis that motor experience influences action recognition. They also show that the influence of motor experience on the perception of own actions depends on the type of perceptual task.     

Development of motion processing in children with autism

Recent findings suggest that children with autism may be impaired in the perception of biological motion from moving point-light displays. Some children with autism also have abnormally high motion coherence thresholds. In the current study we tested a group of children with autism and a group of typically developing children aged 5 to 12 years of age on several motion perception tasks, in order to establish the specificity of the biological motion deficit in relation to other visual discrimination skills. The first task required the recognition of biological from scrambled motion. Three quasi-psychophysical tasks then established individual thresholds for the detection of biological motion in dynamic noise, of motion coherence and of form-from-motion. Lastly, individual thresholds for a task of static perception--contour integration (Gabor displays)--were also obtained. Compared to controls, children with autism were particularly impaired in processing biological motion in relation to any developmental measure (chronological or mental age). In contrast, there was some developmental overlap in ability to process other types of visual motion between typically developing children and the children with autism, and evidence of developmental change in both groups. Finally, Gabor display thresholds appeared to develop typically in children with autism.     

Attention and gaze shifting in dual-task and go/no-go performance with vocal responding

Evidence from go/no-go performance on the Eriksen flanker task with manual responding suggests that individuals gaze at stimuli just as long as needed to identify them (e.g., Sanders, 1998). In contrast, evidence from dual-task performance with vocal responding suggests that gaze shifts occur after response selection (e.g., Roelofs, 2008a). This difference in results may be due to the nature of the task situation (go/no-go vs. dual task) or the response modality (manual vs. vocal). We examined this by having participants vocally respond to congruent and incongruent flanker stimuli and shift gaze to left- or right-pointing arrows. The arrows required a manual response (dual task) or determined whether the vocal response to the flanker stimuli had to be given or not (go/no-go). Vocal response and gaze shift latencies were longer on incongruent than congruent trials in both dual-task and go/no-go performance. The flanker effect was also present in the manual response latencies in dual-task performance. Ex-Gaussian analyses revealed that the flanker effect on the gaze shifts consisted of a shift of the entire latency distribution. These results suggest that gaze shifts occur after response selection in both dual-task and go/no-go performance with vocal responding.     

Temporal perception is enhanced for goal-directed biological actions

ABSTRACT

Research into the visual perception of goal-directed human action indicates that human action perception makes use of specialized processing systems, similar to those that operate in visual expertise. Against this background, the current research investigated whether perception of temporal information in goal-directed human action is enhanced relative to similar motion stimuli. Experiment 1 compared observers’ sensitivity to speed changes in upright human action to a kinematic control (an animation yoked to the motion of the human hand), and also to inverted human action. Experiment 2 compared human action to a non-human motion control (a tool moved the object). In both experiments observers’ sensitivity to detecting the speed changes was higher for the human stimuli relative to the control stimuli, and inversion in Experiment 1 did not alter observers’ sensitivity. Experiment 3 compared observers’ sensitivity to speed changes in goal-directed human and dog actions, in order to determine if enhanced temporal perception is unique to human actions. Results revealed no difference between human and dog stimuli, indicating that enhanced speed perception may exist for any biological motion. Results are discussed with reference to theories of biological motion perception and perception in visual expertise.     

Response Channel Activation and the Temporoparietal Junction

When we learn to make one motor response to one visual stimulus and a different motor response to another, representations of these stimulus–response associations must be maintained to efficiently transduce perception into action. When an irrelevant distractor is presented adjacent to a target stimulus, interference is observed when the two stimuli are associated with conflicting responses, presumably due to response channel activation by the incompatible information. We have explored the neural bases of these interference effects. In a previous study, patients with hemispatial neglect showed normal interference from contralesional flankers. In another study, patients with lesions of the lateral prefrontal cortex were found not to show interference from distractors presented in the contralesional hemifield. The current study provided a more anatomically detailed investigation of the effects of posterior association cortex lesions on flanker interference. Patients with chronic, unilateral lesions involving the temporoparietal junction (TPJ), two of whom had hemispatial neglect, were compared with patients with lesions of the posterior association cortex not involving the TPJ. All patients performed a color discrimination task at fixation while a congruent or incongruent colored flanker was briefly presented (16.7 ms) in the adjacent contralesional or ipsilesional hemifield. Patients with TPJ lesions showed no interference effects from the contralesional flankers. These results suggest that the TPJ, in combination with the dorsolateral prefrontal cortex, is involved in transducing perception into action.