Language-induced modulation during the prediction of others' actions

Processing of action words has been shown to influence the perception of the actions the words refer to. Specifically, the accuracy with which people predict the future course of actions observed in another individual seems to be affected by verbal primes. Two processes may be involved in action prediction; dynamic simulation (updating) and static matching. The present study examined this issue by testing the impact of action verb processing on action prediction performance using a masked priming paradigm. Evidence of dynamic updating was revealed after prime verbs expressing dynamic actions (e.g., 'to catch') but not those expressing static actions (e.g., 'to lean'). In contrast to previous work, the primes were masked and did not require any response at all. Hence, our results indicate that implicit action-related linguistic processing may trigger action simulation that in turn might affect action prediction (see also Liepelt, Dolk, & Prinz, Psychological Research, 2012, in this issue).     

Motor execution affects action prediction

Previous studies provided evidence of the claim that the prediction of occluded action involves real-time simulation. We report two experiments that aimed to study how real-time simulation is affected by simultaneous action execution under conditions of full, partial or no overlap between observed and executed actions. This overlap was analysed by comparing the body sides and the movement kinematics involved in the observed and the executed action. While performing actions, participants observed point-light (PL) actions that were interrupted by an occluder, followed by a test pose. The task was to judge whether the test pose depicted a continuation of the occluded action in the same depth angle. Using a paradigm proposed by Graf et al., we independently manipulated the duration of the occluder and the temporal advance of the test pose relative to occlusion onset (occluder time and pose time, respectively). This paradigm allows the assessment of real-time simulation, based on prediction performance across different occluder time/pose time combinations (i.e., improved task performance with decreasing time distance between occluder time and pose time is taken to reflect real-time simulation). The PL actor could be perceived as from the front or back, as indicated by task instructions. In Experiment 1 (front view instructions), evidence of action simulation was obtained for partial overlap (i.e., observed and performed action corresponded either in body side or movement kinematics), but not for full or no overlap conditions. The same pattern was obtained in Experiment 2 (back view instructions), ruling out a spatial compatibility explanation for the real-time pattern observed. Our results suggest that motor processes affect action prediction and real-time simulation. The strength of their impact varies as a function of the overlap between observed and executed actions.     

Minimal mimicry: Mere effector matching induces preference

Both mimicking and being mimicked induces preference for a target. The present experiments investigate the minimal sufficient conditions for this mimicry-preference link to occur. We argue that mere effector matching between one’s own and the other person’s movement is sufficient to induce preference, independent of which movement is actually performed. In Experiments 1 and 2, participants moved either their arms or legs, and watched avatars that moved either their arms or legs, respectively, without any instructions to mimic. The executed movements themselves and their pace were completely different between participants (fast circular movements) and targets (slow linear movements). Participants preferred avatars that moved the same body part as they did over avatars that moved a different body part. In Experiment 3, using human targets and differently paced movements, movement similarity was manipulated in addition to effector overlap (moving forward–backward or sideways with arms or legs, respectively). Only effector matching, but not movement matching, influenced preference ratings. These findings suggest that mere effector overlap is sufficient to trigger preference by mimicry.     

Minimal mimicry: Mere effector matching induces preference

Both mimicking and being mimicked induces preference for a target. The present experiments investigate the minimal sufficient conditions for this mimicry-preference link to occur. We argue that mere effector matching between one’s own and the other person’s movement is sufficient to induce preference, independent of which movement is actually performed. In Experiments 1 and 2, participants moved either their arms or legs, and watched avatars that moved either their arms or legs, respectively, without any instructions to mimic. The executed movements themselves and their pace were completely different between participants (fast circular movements) and targets (slow linear movements). Participants preferred avatars that moved the same body part as they did over avatars that moved a different body part. In Experiment 3, using human targets and differently paced movements, movement similarity was manipulated in addition to effector overlap (moving forward–backward or sideways with arms or legs, respectively). Only effector matching, but not movement matching, influenced preference ratings. These findings suggest that mere effector overlap is sufficient to trigger preference by mimicry.     

Viewpoint-dependent Priming Effects in the Perception of Human Actions and Body Postures

The identification of human actions and body postures viewed from different viewpoints was examined in four long-term priming experiments with static pictures of a human model. In Experiments 1 and 2 participants had to name or describe the pictures, and in Experiments 3 and 4 participants had to decide whether the pictures showed a possible or impossible body pose. Reliable priming effects were obtained only when priming and primed action or pose shared the same in-depth orientation (Experiments 1 and 4) and left-right reflection (Experiments 2 and 3). Having seen the same action or pose in a different orientation did not reliably facilitate identification performance later on. Also, there was no priming for poses that are impossible to perform with a human body, not even when an identical same-view prime was used. These findings suggest that the stored representations that mediate the identification of human actions and postures are viewpoint specific.     

Activation of action rules in action observation

Visually perceiving an action may activate corresponding motor programs. This automatic motor activation can occur both for higher level (i.e., the goal of an action) and for lower level (i.e., the specific effector with which it is executed) aspects of an action. The authors used a tool-use action paradigm to experimentally dissociate priming effects for observing the target, the movement, or the target-to-movement mapping of a tool-use action. In 3 experiments, participants took turns in acting, observing the tool-use action of another person in trial n-1, and executing an action in trial n. Trial transitions from n-1 to n were manipulated in 4 conditions with (a) mapping repeated and movement and target changed, (b) target repeated and movement and mapping changed, (c) movement repeated and target and mapping changed, or (d) all components repeated. Results indicate priming effects for repeating the target-to-movement mapping (i.e., the action rule) of a tool-use action and suggest that a rather abstract action schema is activated during action observation.     

Spontaneous transitions and symmetry: Pattern dynamics in human four-limb coordination

Transitions between the coordinative patterns of rhythmically moving human arms and legs were studied to test the predictions of a four-component model (Schöner, Jiang and Kelso, 1990). Based upon results from previous two-component experiments (Kelso and Jeka, 1992), three assumptions were made about the four-limb system: (1) all limb pairs produce stable in-phase and anti-phase patterns; (2) the coupling between homologous limbs (i.e., right and left arms or right and left legs) is appreciably stronger than the coupling between nonhomologous limbs (i.e., arm and leg); and (3) right-left symmetry. An analysis of a four-component model (Jeka, Kelso and Kiemel, 1993) led to the prediction of four attracting invariant circles, each with two stable patterns in the state space of four-limb dynamics. In an experiment to test this prediction, subjects were required to cycle all four limbs in one of the eight patterns to the beat of an auditory metronome whose frequency was systematically increased. All subjects demonstrated spontaneous transitions corresponding to pathways along the invariant circles. Pre-transition relative phase variability increased with required frequency up to the transition, suggesting that loss of pattern stability induced the observed transitions. Thus, despite a large number of potential transitions, differential coupling between limb pairs and symmetry of the pattern dynamics restricts the behavior of the human four-limb system to a limited area of its state space.     

Object-substitution masking degrades the quality of conscious object representations

Object-substitution masking (OSM) is a unique paradigm for the examination of object updating processes. However, existing models of OSM are underspecified with respect to the impact of object updating on the quality of target representations. Using two paradigms of OSM combined with a mixture model analysis we examine the impact of post-perceptual processes on a target’s representational quality within conscious awareness. We conclude that object updating processes responsible for OSM cause degradation in the precision of object representations. These findings contribute to a growing body of research advocating for the application of mixture model analysis to the study of how cognitive processes impact the quality (i.e., precision) of object representations.     

Attention to body-parts varies with visual preference and verb–effector associations

Theories of embodied conceptual meaning suggest fundamental relations between others’ actions, language, and our own actions and visual attention processes. Prior studies have found that when people view an image of a neutral body in a scene they first look toward, in order, the head, torso, hands, and legs. Other studies show associations between action verbs and the body-effectors used in performing the action (e.g., “jump” with feet/legs; “talk” with face/head). In the present experiment, the visual attention of participants was recorded with a remote eye-tracking system while they viewed an image of an actor pantomiming an action and heard a concrete action verb. Participants manually responded whether or not the action image was a good example of the verb they heard. The eye-tracking results confirmed that participants looked at the head most, followed by the hands, and the feet least of all; however, visual attention to each of the body-parts also varied as a function of the effector associated with the spoken verb on image/verb congruent trials, particularly for verbs associated with the legs. Overall, these results suggest that language influences some perceptual processes; however, hearing auditory verbs did not alter the previously reported fundamental hierarchical sequence of directed attention, and fixations on specific body-effectors may not be essential for verb comprehension as peripheral visual cues may be sufficient to perform the task.     

The crucial roles of stimulus matching and stimulus identity in negative priming

Negative priming refers to the situation in which an ignored item on an initial prime trial suffers slowed responding when it becomes the target item on a subsequent probe trial. In this experiment (and a replication), we demonstrate two ways in which stimulus consistency (matching) governs negative priming. First, negative priming for identical words occurred only when the prime distractor changed color when it became the probe target (i.e., constant cue to read the red word); negative priming disappeared when the prime distractor retained its color as the probe target (i.e., cue switches from read the red prime word to read the white probe word). Second, negative priming occurred for identical words, but not for semantically related words, whether related categorically or associatively. This pattern of results is consistent with a memory retrieval account, but not with an inhibition account of negative priming, and casts doubt on whether there is semantic negative priming for words.     

Is Passive Syntax Semantically Constrained? Evidence From Adult Grammaticality Judgment and Comprehension Studies

To explain the phenomenon that certain English verbs resist passivization (e.g., *£5 was cost by the book), Pinker (1989) proposed a semantic constraint on the passive in the adult grammar: The greater the extent to which a verb denotes an action where a patient is affected or acted upon, the greater the extent to which it is compatible with the passive. However, a number of comprehension and production priming studies have cast doubt upon this claim, finding no difference between highly affecting agent‐patient/theme‐experiencer passives (e.g., Wendy was kicked/frightened by Bob) and non‐actional experiencer theme passives (e.g., Wendy was heard by Bob). The present study provides evidence that a semantic constraint is psychologically real, and is readily observed when more fine‐grained independent and dependent measures are used (i.e., participant ratings of verb semantics, graded grammaticality judgments, and reaction time in a forced‐choice picture‐matching comprehension task). We conclude that a semantic constraint on the passive must be incorporated into accounts of the adult grammar.     

Mental rotation of static and dynamic figures

Previous studies comparing performance on standard (i.e., static) and dynamic spatial test items have concluded that the two item types measure different abilities. Such conclusions about the uniqueness of static and dynamic spatial abilities seem premature, however, since only a limited number of dynamic spatial tasks have been utilized in research and these have differed markedly from their static counterparts. In the present studies, tasks were designed to require a common mental operation (mental rotation) under static and dynamic conditions. Correlations between static and dynamic performance ranged from .80 to .90. This appears to suggest that the emergence of a unique dynamic ability factor depends on the utilization of certain specialized tasks (e.g., arrival time tasks) with mental operations much different than those required by conventional spatial tests. In other words, it is apparently the requirement for different cognitive processes and not the processing of stimulus motion per se that distinguishes performance onsome dynamic tasks from performance on some standard static tasks.     

Action compatibility effects are hedonically marked and have incidental consequences on affective judgment

Recent results from Cannon, Hayes, and Tipper (2010) have established that the Action Compatibility Effect (ACE) is hedonically marked and elicits a genuine positive reaction. In this work, we aim to show that the hedonic marking of the ACE has incidental consequences on affective judgment. For this, we used the affective priming paradigm principle (for a review, see Musch & Klauer, 2003): participants have to respond, as quickly as they can, regarding the pleasantness or unpleasantness character of a target word. In the priming phase, we do not present an affective stimulus; however, we present two different graspable objects, one after the other. The handles of the graspable objects are shown either both on the same side (i.e., perceptual action compatibility) or not (i.e., perceptual action incompatibility). In addition, the orientation of the handles of the objects are either compatible (i.e., action compatibility) or not (i.e., action compatibility) with the response hand used for the word evaluation. Consistent with our hypothesis, participants responded faster to positive words after perceptual action compatibility and action compatibility (thus demonstrating the ACE) than after incompatibility conditions.     

Lexical-semantic body knowledge in 5- to 11-year-old children: How spatial body representation influences body semantics

This study addresses the relation between lexico-semantic body knowledge (i.e., body semantics) and spatial body representation (i.e., structural body representation) by analyzing naming performances as a function of body structural topography. One hundred and forty-one children ranging from 5 years 2 months to 10 years 5 months old were asked to provide a lexical label for isolated body part pictures. We compared the children’s naming performances according to the location of the body parts (body parts vs. head features and also upper vs. lower limbs) or to their involvement in motor skills (distal segments, joints, and broader body parts). The results showed that the children’s naming performance was better for facial body parts than for other body parts. Furthermore, it was found that the naming of body parts was better for body parts related to action. These findings suggest that the development of a spatial body representation shapes the elaboration of semantic body representation processing. Moreover, this influence was not limited to younger children. In our discussion of these results, we focus on the important role of action in the development of body representations and semantic organization.     

Learning associations between action and perception: effects of incompatible training on body part and spatial priming

Observation of another person executing an action primes the same action in the observer's motor system. Recent evidence has shown that these priming effects are flexible, where training of new associations, such as making a foot response when viewing a moving hand, can reduce standard action priming effects (Gillmeister, Catmur, Liepelt, Brass, & Heyes, 2008). Previously, these effects were obtained after explicit learning tasks in which the trained action was cued by the content of a visual stimulus. Here we report similar learning processes in an implicit task in which the participant's action is self-selected, and subsequent visual effects are determined by the nature of that action. Importantly, we show that these learning processes are specific to associations between actions and viewed body parts, in that incompatible spatial training did not influence body part or spatial priming effects. Our results are consistent with models of visuomotor learning that place particular emphasis on the repeated experience of watching oneself perform an action.     

Social priming of dyslexia and reduction of the Stroop effect: What component of the Stroop effect is actually reduced?

Recently, Goldfarb, Aisenberg, and Henik (2011) showed that in a manual format of the Stroop task, dyslexia priming eliminates the normal magnitude of the interference-based Stroop-like findings otherwise exhibited by individuals participating in such research. Goldfarb et al. (2011) consequently concluded that the effect of word reading in a Stroop task (i.e., one automatic behavior) can be effectively controlled through an automatic instruction “do not read” (i.e., another automatic behavior). The present study further investigated these ideas by examining when and how dyslexia priming controls different processes involved in a Stroop task. To this end, the original finding was first replicated (Experiment 1) and subsequently extended to the vocal (instead of manual) response modality to examine whether previously reported eliminations of the Stroop effect persist with this response format (i.e., format producing larger Stroop effects). Since past work (e.g., Augustinova & Ferrand, 2012a; Brown, Joneleit et al., 2002; Ferrand & Augustinova, 2013) had suggested that various interventions were likely to reduce (rather than eliminate) the interference-based Stroop-like findings with vocal responses, a further aim of these experiments was to identify the component of these findings that dyslexia priming actually reduces. To this end, the effects of this intervention were examined in a more fine-grained variant of the Stroop task that distinguished between interference resulting from task-irrelevant processes involved in computing the lexical and semantic representations of the word (i.e., a written distractor to ignore) and task-relevant processes involved in the selection of a response (i.e., a color target to name) that are both involved in this task. In line with our past work (e.g., Augustinova & Ferrand, 2012a; Ferrand & Augustinova, 2013), the results of two experiments (Experiments 2 and 3) showed that in the vocal format, dyslexia priming reduces but does not eliminate the normal magnitude of the interference-based Stroop-like findings and that this reduction is solely due to the control of processes involved in the selection of a response (i.e., a color target to name) – processes that are known to be controllable in this format (Ferrand & Augustinova, 2013). Given that in this format, dyslexia priming had no effect on task-irrelevant processes involved in computing the lexical and semantic representations of a written distractor to be ignored – processes that are known to be automatic – further implications for the control of automatic processes via dyslexia priming are considered and an interpretation in terms of a unitary control mechanism for both the manual and vocal formats is proposed.     

Representing and anticipating human actions in vision

Visual perception of human actions was investigated in a long-term priming experiment. On each trial in the priming phase, participants were presented with a pair of short motion animations showing a person performing a particular whole body movement and had to decide whether the actions were the same or different. In the testing block, the same observers had to determine whether static pictures of a human model showed a possible or an impossible body pose. For each test posture, a subject either (1) had seen a priming animation in which the actor would have reached the test posture if the animation had lasted longer, (2) had seen an animation in which the actor would have been in the test posture if the animation had started earlier, or (3) had not seen a related priming animation. Reliable facilitatory priming effects were obtained only when the test posture was preceded by a motion sequence that would have resulted in the test posture if the human model had continued the action. The findings support the hypothesis that, when confronted with a human action, observers anticipate the future posture of the actor and that this anticipation facilitates later identification of the posture.     

A face with a cue: exploring the inevitability of person categorization

Recent research has explored the dynamics of categorical thinking, with debate centering on the putative automaticity of this process. In a further investigation of this topic, the current inquiry assessed the influence of critical category‐cueing facial features on overt (i.e., category identification) and covert (i.e., category priming) measures of sex categorization. The results revealed that when a critical sex‐specifying facial cue (i.e., hairstyle) was present, priming effects emerged even under suboptimal processing conditions (i.e., facial blurring). When this cue was absent, however, priming no longer occurred. Interestingly, category identification was largely unimpeded by feature removal or facial blurring. Taken together, these results underscore the efficiency of categorical thinking and the importance of task objectives and feature‐based processing in person perception. Copyright © 2007 John Wiley & Sons, Ltd.     

Dynamic orientation cues decrease the viewpoint cost of mental rotation

Mental rotation, as a covert simulation of motor rotation, could benefit from spatial updating of object representations. We are interested in what kind of visual cue could trigger spatial updating. Three experiments were conducted to examine the effect of dynamic and static orientation cues on mental rotation, using a sequential matching task with three-dimensional novel objects presented in different views. Experiment 1 showed that a rotating orientation cue with constant speed reduced viewpoint costs in mental rotation. Experiment 2 extended this effect with a varied-speed rotating orientation cue. However, no such benefit was observed with a static orientation cue in Experiment 3. These findings indicated that a visually continuous orientation cue is sufficient to elicit spatial updating in mental rotation. Furthermore, there may be differences in the underlying mechanisms of spatial updating on the basis of constant-speed rotating cues and varied-speed rotating cues.