Action observation modulates auditory perception of the consequence of others' actions

We can easily discriminate self-produced from externally generated sensory signals. Recent studies suggest that the prediction of the sensory consequences of one’s own actions made by forward model can be used to attenuate the sensory effects of self-produced movements, thereby enabling a differentiation of the self-produced sensation from the externally generated one. The present study showed that attenuation of sensation occurred both when participants themselves performed a goal-directed action and when they observed experimenter performing the same action, although they clearly reported that the tones were produced by other during action observation and by themselves during their own action. These results suggest that sensory prediction of action modulates ongoing auditory processing irrespective of who produces the sounds and that the explicit judgment of agency does not necessarily rely on the same mechanisms on which implicit perceptual measures such as sensory attenuation rely.     

Action production influences 12-month-old infants' attention to others' actions

Recent work implicates a link between action control systems and action understanding. In this study, we investigated the role of the motor system in the development of visual anticipation of others' actions. Twelve-month-olds engaged in behavioral and observation tasks. Containment activity, infants' spontaneous engagement in producing containment actions; and gaze latency, how quickly they shifted gaze to the goal object of another's containment actions, were measured. Findings revealed a positive relationship: infants who received the behavior task first evidenced a strong correlation between their own actions and their subsequent gaze latency of another's actions. Learning over the course of trials was not evident. These findings demonstrate a direct influence of the motor system on online visual attention to others' actions early in development.     

Learning how actions function: the role of outcomes in infants' representation of events

Action is a fundamental component of object representations. However, little is known about how infants represent actions performed on objects. Across four experiments, we tested the hypothesis that at 10 months of age (N = 80) infants represent the general ability of actions to produce outcomes (sounds). Experiments 1A and 1B showed that infants encode actions and associate actions and object appearances in events in which actions produced no sound outcomes. Experiment 2 showed that infants associate the presence or absence of outcomes with actions. Experiment 3 showed, in contrast, that infants did not associate the presence or absence of outcomes with object appearances. Together, these studies suggest that infants encode the outcome potential of specific actions. We discuss the implications of these findings for our understanding of the development of action representations.     

Visual experience influences 12-month-old infants' perception of goal-directed actions of others

In the present study, we investigated whether infants' own visual experiences affected their perception of the visual status of others engaging in goal-directed actions. In Experiment 1, infants viewed video clips of successful and failed goal-directed actions performed by a blindfolded adult, with half the infants having previously experienced being blindfolded. The results showed that 12-month-old infants who were previously blindfolded preferred to look longer at the demonstrator's successful actions, whereas no such preference was observed in 8-month-old infants. In Experiment 2, infants watched the same 2 actions when the adult demonstrator was not blindfolded. The responses of 12-month-old infants were the opposite of those observed in Experiment 1: they showed a preference for the failed actions. These findings suggest that previous experience influenced the subsequent perception of others' goal-directed actions in the 12-month-old infants. We favor the interpretation that the preference for the successful actions in the 12-months-old infants provided with blindfolded experience demonstrates the influence of perceptual experience on considering the visual status of others engaging in goal-directed actions.     

Young infants' actions reveal their developing knowledge of support variables: converging evidence for violation-of-expectation findings

Violation-of-expectation (VOE) tasks have revealed substantial developments in young infants' knowledge about support events: by 5.5 months, infants expect an object to fall when released against but not on a surface; and by 6.5 months, infants expect an object to fall when released with 15% but not 100% of its bottom on a surface. Here we investigated whether action tasks would reveal the same developmental pattern. Consistent with VOE reports, 5.5- and 6.5-month-old infants were more likely to reach for a toy that rested on as opposed to against a surface; and 6.5- but not 5.5-month-olds were more likely to reach for a toy with 100% as opposed to 15% of its bottom on a surface. Infants at each age thus used their support knowledge to determine whether the toys were likely to be retrievable or to be attached to adjacent surfaces and hence irretrievable. These and control findings extend recent evidence that developmental patterns observed in VOE tasks also hold in action tasks, and as such provide further support for the view that VOE and action tasks tap the same physical knowledge.     

Pulling out the intentional structure of action: the relation between action processing and action production in infancy

Adults and children readily construct action representations organized with respect to an ultimate goal. These representations allow one to predict the consequences of action, interpret and describe actions, and categorize action sequences. In this paper, we explore the ontogeny of hierarchically organized action representations, and its relation to infants' ability to produce similar sequences. To do so, we examine infants' perception and performance of a means-end sequence: pulling a cloth to retrieve a toy. Using a visual habituation paradigm, we demonstrate that 12-month-old infants understand that the initial step of the cloth-pulling sequence is directed toward the ultimate goal of attaining the toy, and use their knowledge of the causal constraints of the sequence to make this goal attribution. Ten-month-olds, however, appear transitional with respect to this understanding: their ability to identify the goal of the cloth-pulling sequence is related to their own ability to planfully solve a similar sequence. These findings are consistent with a burgeoning body of literature suggesting an intimate link between action production and perception, and suggest that this link is in place by at least 10 months of age.     

Young infants' perception of unity and form in occlusion displays

Young infants have been reported to perceive the unity of a center-occluded object when the visible ends of the object are aligned and undergo common motion but not when the edges of the object are misaligned (Johnson & Aslin, 1996). Using a recognition-based paradigm, the authors investigated the possibility that past research failed to provide sufficiently sensitive assessments of infants' perception of the unity of misaligned edges in partial occlusion displays. Positive evidence was obtained in 4-month-olds for veridical perception of the motion and location of a hidden region but not its orientation, whereas 7-month-olds, in contrast to the younger infants, appeared to respond to the orientation of the hidden region. Overall, the results suggest that habituation designs tapping recognition processes may be particularly efficacious in revealing infants' perceptual organization. In addition, the findings provide corroborative evidence for the importance of both motion and orientation in young infants' object segregation and for the difficulty in achieving percepts of the global form of a partly occluded object.     

Precursors to infants'' perception of the causality of a simple event

Three habituation experiments examined the perception of causal and non-causal events by infants at 6 1/4, 5 1/2, and 4 months of age. Experiment 1 replicated previous studies showing that by 6 1/4 months, infants begin to respond to the interaction of simple objects in Michottian type launching events on the basis of causality. In Experiments 2 and 3, however, younger infants exposed to the identical event sequences responded on the basis of simpler perceptual features of the launching events, and not on the basis of causality. 4-month-old infants responded to continuous versus non-continuous movement. 5 1/2-month-old infants also responded somewhat on the basis of continuous movement. However, in addition they responded on the basis of the spatial and temporal perceptual features of the events. This change in the pattern of results over age suggests a multi-step developmental progression.     

Infants' understanding of actions performed by mechanical devices

Recent research suggests that 9-month-old infants tested in a modified version of the A-not-B search task covertly imitate actions performed by the experimenter. The current study examines whether infants also simulate actions performed by mechanical devices, and whether this varies with whether or not they have been familiarized with the devices and their function. In Experiment 1, infants observed hiding and retrieving actions performed by a pair of mechanical claws on the A-trials, and then searched for the hidden toy on the B-trial. In Experiment 2, infants were first familiarized with the experimenter and the claws but not their function. In Experiment 3, infants were familiarized with the function of the claws. The results revealed that search errors were at chance levels in Experiments 1 and 2, but a significant proportion of the infants showed the A-not-B error in Experiment 3. These results suggest that 9-month-old infants are less likely to simulate observed actions performed by mechanical devices than by human agents, unless they are familiarized with the function of the devices so that their actions are perceived as goal-directed.     

Experience matters: 11-month-old infants can learn to use material information to predict the weight of novel objects

In contrast to previous findings, this study demonstrates that 11-month-old infants are able to learn the relationship between object material and object weight when exploring different objects that provided a systematic covariation of both object features. This guides their action in a subsequent preferential-reaching task.     

On the depth reversibility of point-light actions

We investigate the occurrence of perspective reversals for a depth-ambiguous point-light figure. In addition, we exploit the phenomenon of reversibility to search for stimulus features relevant in the process of depth assignment. Experiment 1 shows that perceptual switches indeed occur during prolonged viewing, although the switches occur infrequently. The reversibility is confirmed in Experiment 2, in which the perceptual ambiguity of the point-light action is manipulated as well as observers’ intention to perceive a particular alternative. In addition, the pattern of eye movements reveals local stimulus features specifically associated with the perception of the different alternatives. In Experiment 3, the importance of these features as determining factors of the initial interpretation is investigated by manipulating the location of the first fixation on the stimulus. Implications for a better understanding of biological motion perception are discussed.     

The role of three-dimensional depth cues in infants' perception of partly occluded objects

Newborn infants were familiarized to a three dimensional display consisting of a rod which moved behind a central occluder, so that only the top and bottom of the rod were visible. The infants' eyes were 38 cm from the rod and the occluder was 15 cm in front of the rod, a separation intended to ensure that the gap between the two was detected by the infants. On subsequent test trials the infants looked longer at a complete rod than at two rod pieces, suggesting that the hidden unity, or completeness of the rod had not been perceived. In a study by Johnson and Náñez (in press), using computer. generated stimuli, 4 month olds perceived the hidden unity of a similar display presented on a VDU in the complete absence of three. dimensional depth cues. Taken together, these findings suggest that, for these displays, perception of three. dimensional depth cues is not necessary for the detection of the unity of partially hidden objects. It is suggested that age changes in early infancy in the perception of occluded objects may result either from the emergence of abilities to perceive objects from kinematic information or from the emergence of sensitivity to that information itself.     

Understanding intentions from actions: Direct perception,inference, and the roles of mirror and mentalizing systems

This review asks whether observers can obtain information about others’ intentions from observation of their actions; and if so, whether this process is performed using direct perceptual or inferential processes (prominent examples of each being the intention understanding theory of mirror neuron function, and mentalizing accounts of intention understanding, respectively). I propose four conditions that should be fulfilled in order to support a direct perception account, and suggest that only two of these conditions are supported by the existing data. I then propose and review three further sources of evidence which have the potential to inform this debate, concluding that the data do not support the direct perception account. In particular, mirror neurons may be involved in lower-level processes of action perception, but there is no evidence to support their involvement in the type of higher-level intention understanding that is proposed by the direct perception account.     

Causal perception of action-and-reaction sequences in 8- to 10-month-olds

Four experiments with 202 8- to 10-month-old infants studied their sensitivity to causation-at-a-distance in schematic events seen as goal-directed action and reaction by adults and whether this depends on attributes associated with animate agents. In Experiment 1, a red square moved toward a blue square without making contact; in “reaction” events blue moved away while red was approaching, whereas in “delay” events blue started after red stopped. Infants were habituated to one event and then tested on its reversal. Spatiotemporal features reversed for both events, but causal roles changed only in reversed reactions. Infants dishabituated more to reversed reaction events than to reversed delay events. Squares moved rigidly or in a nonrigid animal-like fashion. Infants discriminated these, but motion pattern did not affect responses to reversal. Infants also discriminated reactions from launching and dishabituated to reversed reactions lacking self-initiated motion. These results suggest that sensitivity to causation-at-a-distance depends on the event structure but not pattern or onset typical of animal motion.     

Performed or observed keyboard actions affect pianists' judgements of relative pitch

Action can affect visual perception if the action's expected sensory effects resemble a concurrent unstable or deviant event. To determine whether action can also change auditory perception, participants were required to play pairs of octave-ambiguous tones by pressing successive keys on a piano or computer keyboard and to judge whether each pitch interval was rising or falling. Both pianists and nonpianist musicians gave significantly more “rising” responses when the order of key presses was left-to-right than when it was right-to-left, in accord with the pitch mapping of the piano. However, the effect was much larger in pianists. Pianists showed a similarly large effect when they passively observed the experimenter pressing keys on a piano keyboard, as long as the keyboard faced the participant. The results suggest that acquired action–effect associations can affect auditory perceptual judgement.     

Risk perception and victim perception: The judgment of HIV cases

There is a vast literature confirming that reactions to different risks are strongly affected by characteristics other than scientific risk estimates; most of this research has concentrated on mapping people's representations of sets of widely varying dangers (e.g. diseases, natural disasters, accidents). This study explored a potentially vital component of risk that cannot be studied by eliciting general reactions to many hazards: the extent to which who is at risk contributes to perceptions and judgments of a risk. While it may be preferable to assume that misfortunes affect the population uniformly, of course the truth is not so egalitarian. Thus, for both theoretical and policy reasons, it is worth exploring psychometrically representations of a particular risk as it affects different people. Using multidimensional scaling and hierarchical cluster analysis, we constructed models of respondents' representations of a disease assumed to be particularly affected by victim perception: Human Immunodeficiency Virus (HIV). Subjects rated the similarity of all possible pairs among 16 scenarios involving HIV infection; the scenarios contained information about both the victim and the method of contraction. A set of attribute scales as well as political/demographic information allowed us both to interpret the structures and to predict individual differences. The results confirmed that reactions to HIV infection are greatly affected by reactions to the victim. In particular, the perceived distastefulness and riskiness of the method of infection loomed larger than did either the overall likability of the victim or the general riskiness of the victim's behavior. Further, the salience of the most statistically influential dimension, ‘deservedness’, depended significantly on demographic and political characteristics of the respondents, suggesting that the relationship between personal values and risk perception is in part mediated by victim perception. Implications for risk perception work and public policy are discussed.     

When knowing can replace seeing in audiovisual integration of actions

The ability to predict the effects of actions is necessary to behave properly in our physical and social world. Here, we describe how the ability to predict the consequence of complex gestures can change the way we integrate sight and sound when relevant visual information is missing. Six drummers and six novices were asked to judge audiovisual synchrony for drumming point-light displays where the visual information was manipulated to eliminate or include the drumstick–drumhead impact point. In the condition with only the arm information novices were unable to detect asynchrony whereas drummers were able to. Additionally, in the conditions that included the impact point drummers perceived the best alignment when the sight preceded the sound, while in the arm only condition they perceived the best alignment when the sound occurred together with or preceded the sight, as it would be expected if they were predicting the beat occurrence. Taken together these findings suggest that humans can acquire, through practice, internal models of action which can be used to replace missing information when integrating multisensory signals from the environment.     

Electrophysiological markers of categorical perception of color in 7-month old infants

The origin of color categories has been debated by psychologists, linguists and cognitive scientists for many decades. Here, we present the first electrophysiological evidence for categorical responding to color before color terms are acquired. Event-related potentials were recorded on a visual oddball task in 7-month old infants. Infants were shown frequent presentations of one color (standard) interspersed with infrequent presentations of a color that was either from the same category (within-category deviant) or from a different category (between-category deviant) to the standard. Differences in the event-related potentials elicited by the stimuli were found that were related to the categorical relationship of the standard and the deviant stimuli. The data are discussed in relation to the processes that underlie categorical responding in infancy, as well as the debate about the origin of color categories in language and cognition.     

Infant's perception of goal-directed actions performed by a mechanical device

The present work investigated whether by the end of the first year, infants interpret actions performed by a mechanical device as goal-directed and why they would do so. Using a modified version of the Woodward (1998) habituation paradigm, 9- and 12-month-old infants were tested in a condition in which they saw a mechanical claw performing an action (Study 1). When infants viewed the claw grasping and transporting objects to the back of a stage, 12-month-old but not 9-month-old infants interpreted the action as goal-directed. In Study 2, 9-month-olds received prior to habituation an information phase showing infants how a human held and operated the claw. This enrichment of infants’ knowledge enabled 9-month-old infants to interpret the action display as goal-directed. The role of the developing means-end understanding and tool-use for infants’ interpretation of actions performed by a mechanical device is discussed.     

A systematic, large-scale study of synaesthesia: implications for the role of early experience in lexical-colour associations

For individuals with synaesthesia, stimuli in one sensory modality elicit anomalous experiences in another modality. For example, the sound of a particular piano note may be 'seen' as a unique colour, or the taste of a familiar food may be 'felt' as a distinct bodily sensation. We report a study of 192 adult synaesthetes, in which we administered a structured questionnaire to determine the relative frequency and characteristics of different types of synaesthetic experience. Our data suggest the prevalence of synaesthesia in the adult population is approximately 1 in 1150 females and 1 in 7150 males. The incidence of left-handedness in our sample was within the normal range, contrary to previous claims. We did, however, find that synaesthetes are more likely to be involved in artistic pursuits, consistent with anecdotal reports. We also examined responses from a subset of 150 synaesthetes for whom letters, digits and words induce colour experiences ('lexical-colour' synaesthesia). There was a striking consistency in the colours induced by certain letters and digits in these individuals. For example, 'R' elicited red for 36% of the sample, 'Y' elicited yellow for 45%, and 'D' elicited brown for 47%. Similar trends were apparent for a group of non-synaesthetic controls who were asked to associate colours with letters and digits. Based on these findings, we suggest that the development of lexical-colour synaesthesia in many cases incorporates early learning experiences common to all individuals. Moreover, many of our synaesthetes experienced colours only for days of the week, letters or digits, suggesting that inducers that are part of a conventional sequence (e.g. Monday, Tuesday, Wednesday...; A, B, C...; 1, 2, 3...) may be particularly important in the development of synaesthetic inducer-colour pairs. We speculate that the learning of such sequences during an early critical period determines the particular pattern of lexical-colour links, and that this pattern then generalises to other words.