Representing and anticipating human actions in vision

Visual perception of human actions was investigated in a long-term priming experiment. On each trial in the priming phase, participants were presented with a pair of short motion animations showing a person performing a particular whole body movement and had to decide whether the actions were the same or different. In the testing block, the same observers had to determine whether static pictures of a human model showed a possible or an impossible body pose. For each test posture, a subject either (1) had seen a priming animation in which the actor would have reached the test posture if the animation had lasted longer, (2) had seen an animation in which the actor would have been in the test posture if the animation had started earlier, or (3) had not seen a related priming animation. Reliable facilitatory priming effects were obtained only when the test posture was preceded by a motion sequence that would have resulted in the test posture if the human model had continued the action. The findings support the hypothesis that, when confronted with a human action, observers anticipate the future posture of the actor and that this anticipation facilitates later identification of the posture.     

When do we simulate non-human agents? Dissociating communicative and non-communicative actions

There is strong evidence that we automatically simulate observed behavior in our motor system. Previous research suggests that this simulation process depends on whether we observe a human or a non-human agent. Measuring a motor priming effect, this study investigated the question of whether agent-sensitivity of motor simulation depends on the specific action observed. Participants saw pictures depicting end positions of different actions on a screen. All postures featured either a human or non-human agent. Participants had to produce the matching action with their left or right hand depending on the hand presented on the screen. Three different actions were displayed: a communicative action (emblem), a transitive (goal-directed) action and an intransitive action. We found motor priming effects of similar size for human and non-human agents for transitive and intransitive actions. However, the motor priming effect for communicative actions was present for the human agent, but absent for the non-human agent. These findings suggest that biological tuning of motor simulation is highly action-selective and depends on whether the observed behavior appears to be driven by a reasonable goal.     

Finger posing primes number comprehension

Canonical finger postures, as used in counting, activate number knowledge, but the exact mechanism for this priming effect is unclear. Here we dissociated effects of visual versus motor priming of number concepts. In Experiment 1, participants were exposed either to pictures of canonical finger postures (visual priming) or actively produced the same finger postures (motor priming) and then used foot responses to rapidly classify auditory numbers (targets) as smaller or larger than 5. Classification times revealed that manually adopted but not visually perceived postures primed magnitude classifications. Experiment 2 obtained motor priming of number processing through finger postures also with vocal responses. Priming only occurred through canonical and not through non-canonical finger postures. Together, these results provide clear evidence for motor priming of number knowledge. Relative contributions of vision and action for embodied numerical cognition and the importance of canonicity of postures are discussed.     

Temporal binding during apparent movement of the human body

Alternating between static images of human bodies with an appropriate interstimulus interval (ISI) produces apparent biological motion. Here we investigate links between apparent biological motion and time perception. We presented two pictures of the initial and final positions of a human movement separated by six different ISIs. The shortest movement path between two positions was always biomechanically impossible. Participants performed two tasks: In an explicit task, participants judged whether they saw the longer, feasible movement path between the two postures, or the shorter, biomechanically impossible path. In an implicit task, participants judged the duration of a white square surrounding the picture sequence. At longer ISIs participants were more likely to see a longer, feasible movement path (explicit task) and underestimated the duration of body picture pairs, compared to trials displaying degraded body pictures (implicit task). We argue that perceiving apparent biological motion involves temporal binding of two static pictures into a continuous movement. Such temporal binding may be mediated by a top-down mechanism that produces a percept of biological motion in the absence of any retinal motion.     

Orientation congruency effects on the identification of disoriented shapes

Effects of orientation on identification can be attenuated when other patterns at the same (or a similar) orientation are identified in close temporal contiguity. In Experiments 1 and 2, letters were presented simultaneously in brief masked displays. Identification accuracy was much higher when the letters had consistent orientations than when the letters had different orientations within a display. In Experiment 3, two letters were presented sequentially. Identification accuracy was higher with congruent than with incongruent orientations. The results are unexpected if one assumes that the patterns themselves are rotated until upright prior to their identification, unless pattern rotation processes can be primed, and that priming requires orientation congruence between the priming and primed stimulus. The results are expected if the orientation of a frame of reference can be adjusted to the orientation of the patterns during the identification process.     

Auditory priming: implicit and explicit memory for words and voices.

Five experiments explore priming effects on auditory identification and completion tasks as a function of semantic and nonsemantic encoding tasks and whether speaker's voice is same or different at study and test. Auditory priming was either unaffected by the study task manipulation (Experiments 2, 4, and 5) or was less affected than was explicit memory (Experiments 1 and 3). Study-to-test changes of speaker's voice had nonsignificant effects on priming when white noise masked target items on the identification test (Experiments 1 and 2) or the stem-completion test (Experiment 5). However, significant voice change effects were observed on priming of completion performance when stems were spoken clearly (Experiments 3 and 4). Results are consistent with the idea that a presemantic auditory perceptual representation system plays an important role in the observed priming. Alternative explanations of the presence or absence of voice change effects under different task conditions are considered.     

Size and reflection effects in priming: A test of transfer-appropriate processing

Prior research has suggested that priming on perceptual implicit tests is insensitive to changes in stimulus size and reflection. The present experiments were performed to investigate whether size and reflection effects can be obtained in priming under conditions that encourage the processing of this information at study and at test, as predicted by transfer-appropriate processing. The results indicate that priming was affected by a change in the physical size of an object when study and test tasks required a judgment about the real size of pictorial objects (e.g., deciding whether a zebra presented small or large on the screen was larger or smaller than a typical chair), and when the test task required the identification of fragmented pictures. However, a change in left-right orientation had no effect on priming when study and test tasks required a judgment about the left-right orientation of familiar objects, or when the test task involved the identification of fragmented pictures. This difference between size and reflection effects is discussed in terms of the differential importance of size and reflection information in shape identification.     

In search of perceptual priming in a semantic classification task

Four experiments tested for perceptual priming for written words in a semantic categorization task. Repetition priming was obtained for low-frequency words when unrelated categorizations were performed at study and test (Experiment 1), but it was not orthographically mediated given that written-to-written and spoken-to-written word priming was equivalent (Experiments 2 and 3). Furthermore, no priming was obtained between pictures and words (Experiment 4), suggesting that the nonorthographic priming was largely phonological rather than semantic. These results pose a challenge to standard perceptual theories of priming that should expect orthographic priming when words are presented in a visual format at study and test.     

Dynamic Simulation and Static Matching for Action Prediction: Evidence From Body Part Priming

Accurately predicting other people's actions may involve two processes: internal real‐time simulation (dynamic updating) and matching recently perceived action images (static matching). Using a priming of body parts, this study aimed to differentiate the two processes. Specifically, participants played a motion‐controlled video game with either their arms or legs. They then observed arm movements of a point‐light actor, which were briefly occluded from view, followed by a static test pose. Participants judged whether this test pose depicted a coherent continuation of the previously seen action (i.e., “action prediction task”). Evidence of dynamic updating was obtained after compatible effector priming (i.e., arms), whereas incompatible effector priming (i.e., legs) indicated static matching. Together, the results support action prediction as engaging two distinct processes, dynamic simulation and static matching, and indicate that their relative contributions depend on contextual factors like compatibility of body parts involved in performed and observed action.     

Within- and between-language priming differ: evidence from repetition of pictures in Spanish-English bilinguals

In the current study, the authors used an immediate repetition paradigm with pictures to observe whether repetition enhances word production in bilinguals. In Experiment 1, participants were asked to name pictures that were named previously in the same language (Spanish-Spanish or English-English) or in the opposite language (Spanish-English or English-Spanish). Results revealed a repetition effect both within languages and between languages. Furthermore, there was an asymmetry within language, with repetition priming being larger in Spanish than in English. Experiments 2 and 3 revealed that lag interacted with language for both within- and between-language priming. However, lag resulted in a decrease in the asymmetry for within- but not between-language priming. The results are consistent with the view that within- and between-language repetition priming are mediated by different mechanisms.     

Stand tall,but don't put your feet up: Universal and culturally-specific effects of expansive postures on power

Previous research suggests that there is a fundamental link between expansive body postures and feelings of power. The current research demonstrates that this link is not universal, but depends on people's cultural background (Western versus East Asian) and on the particular type of expansive posture enacted. Three types of expansive postures were examined in the present studies: the expansive-hands-spread-on-desk pose (Carney et al., 2010), the expansive-upright-sitting pose (Huang et al., 2011, Tiedens and Fragale, 2003), and the expansive-feet-on-desk pose (Carney et al., 2010). Of these postures, the expansive-feet-on-desk pose was perceived by both Americans and East Asians as the least consistent with East Asian cultural norms of modesty, humility, and restraint (Study 1). The expansive-hands-spread-on-desk and expansive-upright-sitting postures led to greater sense of power than a constricted posture for both Americans and East Asians (Studies 2a–2b). In contrast, the expansive-feet-on-desk pose led to greater power activation (Study 3) and action orientation (Study 4) for Americans, but not for East Asians. Indeed, East Asians in the expansive-feet-on-desk pose showed less power activation and action orientation than Americans in this pose. Together, these findings support a basic principle of embodiment — the effects of posture depend on: (a) the type of posture, and (b) the symbolic meaning of that posture.     

Altering retrieval demands reverses the picture superiority effect

In Experiment 1 subjects studied a mixed list of pictures and words and then received either a free recall test or a word fragment completion test (e.g.,_yr_mi_forpyramid) on which some fragments corresponded to previously studied items. Free recall of pictures was better than that of words. However, words produced greater priming than did pictures on the fragment completion test, although a small amount of picture priming did occur. Experiments 2 and 3 showed that the picture priming was not due to implicit naming of the pictures during study. In Experiment 4 subjects studied words and pictures and received either the word fragment completion test or a picture fragment identification test in which they had to name degraded pictures. Greater priming was obtained with words in word fragment completion, but greater priming was obtained with pictures on the picture identification test. We conclude that (1) the type of retrieval query determines whether pictures or words will exhibit superior retention, and (2)our results conform to the principle of transfer appropriate processing by which performance on transfer or retention tests benefits to the extent that the tests recapitulate operations used during learning.     

Duck! Scaling the height of a horizontal barrier to body height

Recent research shows that the body is used to scale environmental extents. We question whether the body is used to scale heights as measured by real actions (Experiments 1 and 2) or by judgments about action and extent made from a single viewpoint (Experiments 3 and 4). First, participants walked under barriers naturally, when wearing shoes, or when wearing a helmet. Participants required a larger margin of safety (they ducked at shorter heights) when they were made taller. In follow-up experiments, participants visually matched barrier heights and judged whether they could walk under them when wearing shoes or a helmet. Only the helmet decreased visually matched estimates; action judgments were no different when participants’ eye height increased. The final experiment suggested that the change in matched estimates may have been due to lack of experience wearing the helmet. Overall, the results suggest that perceived height is scaled to the body and that when body height is altered, experience may moderate the rescaling of height.     

The impact of anticipated action effects on action planning

Three experiments with a total of 72 participants investigated the assumption that motor actions are planned in terms of their sensorial effects. Participants had to prepare a certain action A that consistently led to a sensorial effect (a tone of certain pitch). Instead of (in Experiment 1) or before (in Experiments 2 and 3) the execution of the prepared action, another response B had to be carried out, which either resulted in the same or in a different auditory effect (a tone of same or different pitch). It was found that a to-be-executed response B was in general initiated more quickly when it resulted in the same effect as a concurrently prepared response A. The results are considered as evidence for the basic notion that the preparation and initiation even of very simple actions is mediated by an anticipation of their reafferences.     

Visual representations of dynamic actions from static pictures

We investigated how subjects used their knowledge of biomechanical constraints when judging whether different items were in balance or in the process of falling, as a function of their angle of slant. In the first experiment, the stimuli were pictures of postures of a human body, of a wooden mannequin, and of a skeleton. The results show that for these 3 items, fall responses appeared for a smaller slant angle for a backward slant than for a forward one. This difference may reflect the influence of biomechanical constraints. To verify whether the asymmetry of the responses to the mannequin and the skeleton was genuine or due to some semantic context effect, a second experiment was run with only pictures of a wooden mannequin. The same asymmetry was observed. In a third experiment, falling judgments were obtained for pictures of a human body and of a structurally comparable artifactual object. The asymmetry of the fall responses appeared only for the human body.     

Priming and Recognition of Human Motion Patterns

Left-right orientation and size incongruence is known to affect recognition memory for objects but not object priming. In the present study, the effects of study-test changes in left-right orientation and size on old-new recognition decisions and long-term priming of human motion patterns were examined. Experiment 1 showed effects of orientation incongruence on both recognition and priming. Experiment 2 showed an effectof size incongruence on recognition memory but not on priming. It is suggested that the representations of human actions that underlie human motion priming are on a level that preserve orientation, possibly because of the importance of dynamic information for perceiving motion patterns or because encoding of human motion is governed by a body schema (e.g. Reed & Farah, 1995). In contrast, low-level metric information such as size is inconsequential to priming because priming involves identification of shape, which is not affected by size transformations. The effect of size on recognition memory, on the other hand, shows thatexplicitrecognition decisions may draw on any available episodic information, including metric attributes, to make an old new discrimination.     

Factors that affect action possibility judgments: The assumed abilities of other people

Judging what actions are possible and impossible to complete is a skill that is critical for planning and executing movements in both individual and joint actions contexts. The present experiments explored the ability to adapt action possibility judgments to the assumed characteristics of another person. Participants watched alternating pictures of a person's hand moving at different speeds between targets of different indexes of difficulty (according to Fitts' Law) and judged whether or not it was possible for individuals with different characteristics to maintain movement accuracy at the presented speed. Across four studies, the person in the pictures and the background information about the person were manipulated to determine how and under what conditions participants adapted their judgments. Results revealed that participants adjusted their possibility judgments to the assumed motor capabilities of the individual they were judging. However, these adjustments only occurred when participants were instructed to take the other person into consideration suggesting that the adaption process is a voluntary process. Further, it was observed that the slopes of the regression equations relating movement time and index of difficulty did not differ across conditions. All differences between conditions were in the y-intercept of the regression lines. This pattern of findings suggests that participants formed the action possibility judgments by first simulating their own performance, and then adjusted the “possibility” threshold by adding or subtracting a correction factor to determine what is and is not possible for the other person to perform.     

An Item specific Locus of Repetition Priming

Two principal types of account of repetition priming postulate either facilitation of activation of perceptual representations used in stimulus recognition, or retrieval of specific processing episodes as possible mechanisms by which the effect occurs; these make different predictions concerning the priming of two stimuli presented simultaneously. In Experiments 1-3, subjects made same/different decisions about picture-word stimulus pairs. Recombining the pairings of a subset of items between training and test encounters did not significantly reduce the benefit in response time from repetition, as compared to pairs repeated intact. Subjects were able to remember the pairings (Experiment 4), but this did not influence repetition priming. Instead, the memory representations underlying the priming of each item in a pair were independent. No priming was found between pictures seen at training and words at test, and vice versa (Experiment 5), indicating that representations underlying the repetition effect were domain-specific. In Experiment 6, stimuli were all from within the domain of object pictures. Again, recombining the pairings of items between training and test did not significantly reduce the benefit in response time from repetition, as compared to pairs repeated intact. These results reveal an item-specific locus for repetition priming, consistent with priming occurring within pre-semantic perceptual representation systems involved in item recognition. The findings pose problems for theories that argue that repetition effects result only from retrieval of entire processing episodes.     

The role of physical and conceptual properties in preserving object continuity

Six experiments investigated the nature of the object-file representation supporting object continuity. Participants viewed preview displays consisting of 2 stimuli (either line drawings or words) presented within square frames, followed by a target display consisting of a single stimulus (either a word or a picture) presented within 1 of the frames. The relationship between the target and preview stimuli was manipulated. The first 2 experiments found that participants responded more quickly when the target was identical to the preview stimulus in the same frame (object-specific priming). In Experiments 3, 4, 5, and 6, the physical form of the target stimulus (a word or picture in 1 frame) was changed completely from that of either preview stimulus (pictures or words in both frames). Despite this physical change, object-specific priming was observed. It is suggested that object files encode postcategorical information, rather than precise physical information.     

Priming of future States in complex motor skills

The ability to anticipate future states of perceived actions is an important faculty for motor control and the generation of coordinated social interaction. Here, we studied whether the perception of a static posture of a complex movement automatically activates representations of future states of this particular movement event. We did this by using a priming paradigm with photographs of a high-jump movement. Participants judged whether a picture depicted a posture from the approach or flight phase of that movement. To evaluate expertise-dependent effects of priming, non-athletes and athletes were compared. Results revealed faster responding when prime and target pictures were assigned to the same motor response (response priming), and when the temporal order of prime and target matched the temporal order of the depicted postures in a real high jump (temporal-order priming). Whereas experts showed a temporal-order effect even within the same response category, such an effect occurred for novices only between response categories. A second experiment confirmed that these between-group differences are due to domain-specific motor expertise (i.e., high jump) rather than to general motor experiences. Altogether our results suggest that motor expertise results in a more fine-grained posture-based movement representation.