The relative importance of spatial versus temporal structure in the perception of biological motion: an event-related potential study

We investigated how the spatiotemporal structure of animations of biological motion (BM) affects brain activity. We measured event-related potentials (ERPs) during the perception of BM under four conditions: normal spatial and temporal structure; scrambled spatial and normal temporal structure; normal spatial and scrambled temporal structure; and scrambled spatial and temporal structure. As in a previous study, we identified two negative components at both occipitotemporal regions: N210 reflected general motion processing while N280 reflected the processing of BM. We analyzed the averaged ERPs in the 200-300 ms response time window and found that spatial structure had a substantial effect on the magnitude of the averaged response amplitude in both hemispheres. This finding suggests that spatial structure of point-lights elicits a stronger response in the occipitotemporal region than temporal structure for the BM perception.     

Common mechanisms in apparent motion perception and visual pattern matching

There are close functional similarities between apparent motion perception and visual pattern matching. In particular, striking functional similarities have been demonstrated between perception of rigid objects in apparent motion and purely mental transformations of visual size and orientation used in comparisons of objects with respect to shape but regardless of size and orientation. In both cases, psychophysical data suggest that differences in visual size are resolved as differences in depth, such that transformation of size is done by translation in depth. Furthermore, the process of perceived or imagined translation appears to be stepwise additive such that a translation over a long distance consists of a sequence of smaller translations, the durations of these steps being additive. Both perceived and imagined rotation also appear to be stepwise additive, and combined transformations of size and orientation appear to be done by alternation of small steps of pure translation and small steps of pure rotation. The functional similarities suggest that common mechanisms underlie perception of apparent motion and purely mental transformations. In line with this suggestion, functional brain imaging has isolated neural structures in motion area MT used in mental transformation of size.     

Peak velocity as a cue in audiovisual synchrony perception of rhythmic stimuli

This study investigated audiovisual synchrony perception in a rhythmic context, where the sound was not consequent upon the observed movement. Participants judged synchrony between a bouncing point-light figure and an auditory rhythm in two experiments. Two questions were of interest: (1) whether the reference in the visual movement, with which the auditory beat should coincide, relies on a position or a velocity cue; (2) whether the figure form and motion profile affect synchrony perception. Experiment 1 required synchrony judgment with regard to the same (lowest) position of the movement in four visual conditions: two figure forms (human or non-human) combined with two motion profiles (human or ball trajectory). Whereas figure form did not affect synchrony perception, the point of subjective simultaneity differed between the two motions, suggesting that participants adopted the peak velocity in each downward trajectory as their visual reference. Experiment 2 further demonstrated that, when judgment was required with regard to the highest position, the maximal synchrony response was considerably low for ball motion, which lacked a peak velocity in the upward trajectory. The finding of peak velocity as a cue parallels results of visuomotor synchronization tasks employing biological stimuli, suggesting that synchrony judgment with rhythmic motions relies on the perceived visual beat.     

Local and global aspects of biological motion perception in children born at very low birth weight

Biological motion perception can be assessed using a variety of tasks. In the present study, 8- to 11-year-old children born prematurely at very low birth weight (<1500 g) and matched, full-term controls completed tasks that required the extraction of local motion cues, the ability to perceptually group these cues to extract information about body structure, and the ability to carry out higher order processes required for action recognition and person identification. Preterm children exhibited difficulties in all 4 aspects of biological motion perception. However, intercorrelations between test scores were weak in both full-term and preterm children—a finding that supports the view that these processes are relatively independent. Preterm children also displayed more autistic-like traits than full-term peers. In preterm (but not full-term) children, these traits were negatively correlated with performance in the task requiring structure-from-motion processing, r(30) = ?.36, p < .05), but positively correlated with the ability to extract identity, r(30) = .45, p < .05). These findings extend previous reports of vulnerability in systems involved in processing dynamic cues in preterm children and suggest that a core deficit in social perception/cognition may contribute to the development of the social and behavioral difficulties even in members of this population who are functioning within the normal range intellectually. The results could inform the development of screening, diagnostic, and intervention tools.     

Neuropsychological dissociations between motion and form perception suggest functional organization in extrastriate cortical regions in the human brain

In this review of neuropsychological case studies, a number of dissociations are shown between different visual abilities including low-level motion perception, static form perception, form-from-motion perception and biological motion perception. These dissociations reveal counter-intuitive results. Specifically, higher level form-from-motion perception can persist despite deficits in low-level motion perception and static form perception. To account for these dissociations, we present a model of functional organization and identify future directions for investigations of higher order form-from-motion perception.     

Literal, fictive and metaphorical motion sentences preserve the motion component of the verb: a TMS study

We used Transcranial Magnetic Stimulation (TMS) to assess whether reading literal, non-literal (i.e., metaphorical, idiomatic) and fictive motion sentences modulates the activity of the motor system. Sentences were divided into three segments visually presented one at a time: the noun phrase, the verb and the final part of the sentence. Single pulse-TMS was delivered at the end of the sentence over the leg motor area in the left hemisphere and motor evoked potentials (MEPs) were recorded from the right gastrocnemius and tibialis anterior muscles. MEPs were larger when participants were presented with literal, fictive and metaphorical motion sentences than with idiomatic motion or mental sentences. These results suggest that the excitability of the motor system is modulated by the motor component of the verb, which is preserved in fictive and metaphorical motion sentences.     

Learning to like it: Aesthetic perception of bodies,movements and choreographic structure

Appreciating human movement can be a powerful aesthetic experience. We have used apparent biological motion to investigate the aesthetic effects of three levels of movement representation: body postures, movement transitions and choreographic structure. Symmetrical (ABCDCBA) and asymmetrical (ABCDBCA) sequences of apparent movement were created from static postures, and were presented in an artificial grammar learning paradigm. Additionally, “good” continuation of apparent movements was manipulated by changing the number of movement path reversals within a sequence. In an initial exposure phase, one group of participants saw only symmetrical sequences, while another group saw only asymmetrical sequences. In a subsequent test phase, both groups rated all sequences on an aesthetic evaluation scale. We found that posture, movement, and choreographic structure all influenced aesthetic ratings. Separate ratings for the static body postures presented individually showed that both groups preferred a posture that maximized spatial symmetry. Ratings for the experimental sequences showed that both groups gave higher ratings to symmetrical sequences with “good” continuation and lower ratings to sequences with many path reversals. Further, participants who had been initially familiarized with asymmetrical sequences showed increased liking for asymmetrical sequences, suggesting a structural mere exposure effect. Aesthetic preferences thus depend on body postures, apparent movement continuation and choreographic structure. We propose a hierarchical model of aesthetic perception of human movement with distinct processing levels for body postures, movements and choreographic structure.     

The perception of biological and mechanical motion in female fragile X premutation carriers

Previous studies reported impaired visual information processing in patients with fragile X syndrome and in premutation carriers. In this study, we assessed the perception of biological motion (a walking point-light character) and mechanical motion (a rotating shape) in 25 female fragile X premutation carriers and in 20 healthy non-carrier controls. Stimuli were moving stimulus dots embedded among a cloud of noise dots. Sensitivity (d′) for motion detection was determined. Emotional symptoms were assessed by Hamilton’s depression and anxiety rating scales. Results revealed that the premutation carriers displayed lower sensitivities for biological and mechanical motion relative to the non-carriers. This deficit was more pronounced in the case of biological stimuli. The premutation carriers displayed higher depression and anxiety scores relative to the non-carriers. Higher depression, but not anxiety, scores were associated with decreased sensitivity for biological, but not mechanical, motion in the carrier group. These results suggest that motion perception deficits are detectable in fragile X premutation carriers, and that the impairment of biological motion perception is associated with depressive symptoms.     

Cerebellar contributions to the perception of temporal cues within the speech and nonspeech domain

A previous study (Ackermann, Gr?ber, Hertrich, & Daum, 1997) reported impaired phoneme identification in cerebellar disorders, provided that categorization depended on temporal cues. In order to further clarify the underlying mechanism of the observed deficit, the present study performed a discrimination and identification task in cerebellar patients using two-tone sequences of variable pause length. Cerebellar dysfunctions were found to compromise the discrimination of time intervals extending in duration from 10 to 150 ms, a range covering the length of acoustic speech segments. In contrast, categorization of the same stimuli as a "short" or "long pause" turned out to be unimpaired. These findings, along with the data of the previous investigation, indicate, first, that the cerebellum participates in the perceptual processing of speech and nonspeech stimuli and, second, that this organ might act as a back-up mechanism, extending the storage capacities of the "auditory analyzer" extracting temporal cues from acoustic signals.     

Neurodynamics of time consciousness: An extensionalist explanation of apparent motion and the specious present via reentrant oscillatory multiplexing

This paper situates an original model of reentrant oscillatory multiplexing within the philosophy of time consciousness to argue for an extensionalist theory of the specious present. I develop a detailed differential latency model of apparent motion to show how the ordinality of experiential content is isomorphic to the ordinality of relevant brain processes. I argue that the theory presented has resources to account for other key features of the specious present, including the representational discreteness between successive conscious moments as well as the phenomenological continuity between them. This work not only shows the plausibility of an extensionalist philosophical theory, it also illustrates the utility of differential latency views in squaring temporal illusions with empirically supported neurodynamics.     

整体运动知觉老化伴随颞中回静息态功能改变

以个体整体运动一致性阈值为指标, 探讨老年人整体运动敏感性(GMS)下降和静息态下兴趣脑区功能活动的关系。发现与阈值负相关且老年人低于青年人的指标主要有：MT/V5区的ReHo和ALFF值, 各网络拓扑属性; 与阈值正相关且老年人显著高于青年人的有：MT/V5区与前运动皮层之间的、各兴趣脑区之间的功能连接。结果用“去分化”等观点进行了解释, 提示老年人GMS的下降可能不仅与安静状态下MT/V5区的功能改变有关, 还可能与全脑更广泛区域的功能改变有关。     

Audiovisual influences on the perception of visual apparent motion: exploring the effect of a single sound

Previous research has shown that irrelevant sounds can facilitate the perception of visual apparent motion. Here the effectiveness of a single sound to facilitate motion perception was investigated in three experiments. Observers were presented with two discrete lights temporally separated by stimulus onset asynchronies from 0 to 350 ms. After each trial, observers classified their impression of the stimuli using a categorisation system. A short sound presented temporally (and spatially) midway between the lights facilitated the impression of motion relative to baseline (lights without sound), whereas a sound presented either before the first or after the second light or simultaneously with the lights did not affect motion impression. The facilitation effect also occurred with sound presented far from the visual display, as well as with continuous-sound that was started with the first light and terminated with the second light. No facilitation of visual motion perception occurred if the sound was part of a tone sequence that allowed for intramodal perceptual grouping of the auditory stimuli prior to the critical audiovisual stimuli. Taken together, the findings are consistent with a low-level audiovisual integration approach in which the perceptual system merges temporally proximate sound and light stimuli, thereby provoking the impression of a single multimodal moving object.     

Evidence for distinct contributions of form and motion information to the recognition of emotions from body gestures

The importance of kinematics in emotion perception from body movement has been widely demonstrated. Evidence also suggests that the perception of biological motion relies to some extent on information about spatial and spatiotemporal form, yet the contribution of such form-related cues to emotion perception remains unclear. This study reports, for the first time, the relative effects on emotion recognition of inverting and motion-reversing patch-light compared to fully illuminated displays of whole-body emotion gestures. Inverting the gesture movies or playing them backwards significantly impaired emotion classification accuracy, but did so more for patch-light displays than for identical but fully illuminated movement sequences. This result suggests that inversion impairs the processing of form information related to the configuration of body parts, and reversal impairs the sequencing of form changes, more than these manipulations impair the processing of kinematic cues. This effect was strongest for inversion, suggesting an important role for configural information in emotion recognition. Nevertheless, even in combination these stimulus manipulations did not abolish above chance recognition of any of the emotions, suggesting that kinematics help distinguish emotions expressed by body gestures. Disproportionate impairments in recognition accuracy were observed for fear and disgust under inversion, and for fear under motion reversal, suggesting a greater role for form-related cues in the perception of these emotions.     

Electrophysiological correlates of the composite face illusion: Disentangling perceptual and decisional components of holistic face processing in the human brain

When the bottom halves of two faces differ, people’s behavioral judgment of the identical top halves of those faces is impaired: they report that the top halves are different, and/or take more time than usual to provide a response. This behavioral measure is known as the composite face effect (CFE) and has traditionally been taken as evidence that faces are perceived holistically. Recently, however, it has been claimed that this effect is driven almost entirely by decisional, rather than perceptual, factors ( Richler, Gauthier, Wenger, & Palmeri, 2008). To disentangle the contribution of perceptual and decisional brain processes, we aimed to obtain an event-related potential (ERP) measure of the CFE at a stage of face encoding ( Jacques & Rossion, 2009) in the absence of a behavioral CFE effect. Sixteen participants performed a go/no-go task in an oddball paradigm, lifting a finger of their right or left hand when the top half of a face changed identity. This change of identity of the top of the face was associated with an increased ERP signal on occipito-temporal electrode sites at the N170 face-sensitive component (∼160 ms), the later decisional P3b component, and the lateralized readiness potential (LRP) starting at ∼350 ms. The N170 effect was observed equally early when only the unattended bottom part of the face changed, indicating that an identity change was perceived across the whole face in this condition. Importantly, there was no behavioral response bias for the bottom change trials, and no evidence of decisional biases from electrophysiological data (no P3b and LRP deflection in no-go trials). These data show that an early CFE can be measured in ERPs in the absence of any decisional response bias, indicating that the CFE reflects primarily the visual perception of the whole face.     

The psychophysics of chasing: A case study in the perception of animacy

Psychologists have long been captivated by the perception of animacy – the fact that even simple moving shapes may appear to engage in animate, intentional, and goal-directed movements. Here we report several new types of studies of a particularly salient form of perceived animacy: chasing, in which one shape (the ‘wolf’) pursues another shape (‘the sheep’). We first demonstrate two new cues to perceived chasing – chasing subtlety (the degree to which the wolf deviates from perfectly ‘heat-seeking’ pursuit) and directionality (whether and how the shapes ‘face’ each other). We then use these cues to show how it is possible to assess the objective accuracy of such percepts, and to distinguish the immediate perception of chasing from those more subtle (but nevertheless real) types of ‘stalking’ that cannot be readily perceived. We also report several methodological advances. Previous studies of the perception of animacy have faced two major challenges: (a) it is difficult to measure perceived animacy with quantitative precision; and (b) task demands make it difficult to distinguish perception from higher-level inferences about animacy. We show how these challenges can be met, at least in our case study of perceived chasing, via tasks based on dynamic visual search (the Find-the-Chase task) and a new type of interactive display (the Don’t-Get-Caught! task).     

Myopic perception of having a deadline in negotiations: An anchoring effect due to question order

In negotiations, people tend to perceive a deadline as more detrimental to themselves than to their opponents. This phenomenon is termed myopic perception. The present research proposes that myopic perception can be understood as a result of an anchoring effect due to the question order used in probing the perception of a deadline. When people estimate deal prices before rating the influence of a deadline, their judgements are anchored on their negotiation outcomes, making their perception egocentric, which leads to myopic perception. As a result, myopic perception was hypothesized to be reduced by reversing the above question order to change the respondents' judgement anchor from negotiation outcomes to negotiation procedures. In Study 1, myopic perception disappeared when participants rated the general influence of a deadline before estimating deal price in a negotiation scenario. In Study 2, pairs of participants negotiated under a tight deadline. Myopic perception of a deadline was manipulated before the negotiation. Dyads without myopic perception had a smaller discrepancy in reservation price. However, myopic perception had no effect on impasse rates or final deal prices. The results are discussed with respect to behavioural forecasting and practical implications of myopic perception.     

Common pathways in mental imagery and pain perception: an fMRI study of a subject with an amputated arm

The present paper reviews data from two previous studies in our laboratory, as well as some additional new data, on the neuronal representation of movement and pain imagery in a subject with an amputated right arm. The subject imagined painful and non-painful finger movements in the amputated stump while being in a MRI scanner, acquiring EPI-images for fMRI analysis. In Study I (Ersland et al., 1996) the Subject alternated tapping with his intact left hand fingers and imagining "tapping" with the fingers of his amputated right arm. The results showed increased neuronal activation in the right motor cortex (precentral gyrus) when tapping with the fingers of the left hand, and a corresponding activation in the left motor cortex when imagining tapping with the fingers of the amputated right arm. Finger tappings of the intact left hand fingers also resulted in a larger activated precentral area than imagery "finger tapping" of the amputated right arm fingers. In Study II (Rosen et al., 2001 in press) the same subject imagining painful and pleasurable finger movements, and still positions of the fingers of the amputated arm. The results showed larger activations over the motor cortex for movement imagining versus imagining the hand being in a still position, and larger activations over the sensory cortex when imagining painful experiences. It can therefore be concluded that not only does imagery activate the same motor areas as real finger movements, but also that adding instructions of pain together with imaging moving the fingers intensified the activation compared with adding instructions about non-painful experiences. From these studies, it is clear that areas activated during actual motor execution to a large extent also are activated during mental imagery of the same motor commands. In this respect the present studies add to studies of visual imagery that have shown a similar correspondence in activation between actual object perception and imagery of the same object.     

The how and why of what went where in apparent motion: modeling solutions to the motion correspondence problem

A model that is capable of maintaining the identities of individuated elements as they move is described. It solves a particular problem of underdetermination, the motion correspondence problem, by simultaneously applying 3 constraints: the nearest neighbor principle, the relative velocity principle, and the element integrity principle. The model generates the same correspondence solutions as does the human visual system for a variety of displays, and many of its properties are consistent with what is known about the physiological mechanisms underlying human motion perception. The model can also be viewed as a proposal of how the identities of attentional tags are maintained by visual cognition, and thus it can be differentiated from a system that serves merely to detect movement.     

The world in black and white: Ostracism enhances the categorical perception of social information

In two experiments, ostracized individuals showed more pronounced categorical perception of inclusion- and exclusion-related stimuli. Specifically, ostracism enhanced the ability to distinguish between-category differences (e.g., between happy and angry faces) relative to within-category differences (e.g., between two happy expressions). Participants were socially included or excluded via Cyberball (a virtual ball-tossing task). In Experiment 1, ostracized participants showed greater perceptual acuity in distinguishing between subtly happy and angry expressions combined with a reduced ability to discriminate expressions within each expression category. Experiment 2 found analogous categorical perception effects for targets varying on the dimension of race. Importantly, this effect was specific to social information; categorical perception of non-social objects was not qualified by social exclusion. These results suggest that ostracism exacerbates categorical perception, attuning perceivers to the differences between various inclusion- and exclusion-related categories relative to within category acuity, making the world appear more ‘black-and-white’ than it might otherwise.