The relative importance of spatial versus temporal structure in the perception of biological motion: an event-related potential study

We investigated how the spatiotemporal structure of animations of biological motion (BM) affects brain activity. We measured event-related potentials (ERPs) during the perception of BM under four conditions: normal spatial and temporal structure; scrambled spatial and normal temporal structure; normal spatial and scrambled temporal structure; and scrambled spatial and temporal structure. As in a previous study, we identified two negative components at both occipitotemporal regions: N210 reflected general motion processing while N280 reflected the processing of BM. We analyzed the averaged ERPs in the 200-300 ms response time window and found that spatial structure had a substantial effect on the magnitude of the averaged response amplitude in both hemispheres. This finding suggests that spatial structure of point-lights elicits a stronger response in the occipitotemporal region than temporal structure for the BM perception.     

Neuropsychological dissociations between motion and form perception suggest functional organization in extrastriate cortical regions in the human brain

In this review of neuropsychological case studies, a number of dissociations are shown between different visual abilities including low-level motion perception, static form perception, form-from-motion perception and biological motion perception. These dissociations reveal counter-intuitive results. Specifically, higher level form-from-motion perception can persist despite deficits in low-level motion perception and static form perception. To account for these dissociations, we present a model of functional organization and identify future directions for investigations of higher order form-from-motion perception.     

Local and global aspects of biological motion perception in children born at very low birth weight

Biological motion perception can be assessed using a variety of tasks. In the present study, 8- to 11-year-old children born prematurely at very low birth weight (<1500 g) and matched, full-term controls completed tasks that required the extraction of local motion cues, the ability to perceptually group these cues to extract information about body structure, and the ability to carry out higher order processes required for action recognition and person identification. Preterm children exhibited difficulties in all 4 aspects of biological motion perception. However, intercorrelations between test scores were weak in both full-term and preterm children—a finding that supports the view that these processes are relatively independent. Preterm children also displayed more autistic-like traits than full-term peers. In preterm (but not full-term) children, these traits were negatively correlated with performance in the task requiring structure-from-motion processing, r(30) = ?.36, p < .05), but positively correlated with the ability to extract identity, r(30) = .45, p < .05). These findings extend previous reports of vulnerability in systems involved in processing dynamic cues in preterm children and suggest that a core deficit in social perception/cognition may contribute to the development of the social and behavioral difficulties even in members of this population who are functioning within the normal range intellectually. The results could inform the development of screening, diagnostic, and intervention tools.     

Peak velocity as a cue in audiovisual synchrony perception of rhythmic stimuli

This study investigated audiovisual synchrony perception in a rhythmic context, where the sound was not consequent upon the observed movement. Participants judged synchrony between a bouncing point-light figure and an auditory rhythm in two experiments. Two questions were of interest: (1) whether the reference in the visual movement, with which the auditory beat should coincide, relies on a position or a velocity cue; (2) whether the figure form and motion profile affect synchrony perception. Experiment 1 required synchrony judgment with regard to the same (lowest) position of the movement in four visual conditions: two figure forms (human or non-human) combined with two motion profiles (human or ball trajectory). Whereas figure form did not affect synchrony perception, the point of subjective simultaneity differed between the two motions, suggesting that participants adopted the peak velocity in each downward trajectory as their visual reference. Experiment 2 further demonstrated that, when judgment was required with regard to the highest position, the maximal synchrony response was considerably low for ball motion, which lacked a peak velocity in the upward trajectory. The finding of peak velocity as a cue parallels results of visuomotor synchronization tasks employing biological stimuli, suggesting that synchrony judgment with rhythmic motions relies on the perceived visual beat.     

Visual perception of biological motion in newly hatched chicks as revealed by an imprinting procedure

Day-old chicks were exposed to point-light animation sequences depicting either a walking hen or a rotating cylinder. On a subsequent free-choice test (experiment 1) the chicks approached the novel stimulus, irrespective of this being the hen or the cylinder. In order to obtain equivalent local motion vectors, in experiments 2 and 3 newly hatched chicks were exposed either to a point-light animation sequence depicting a walking hen, or to a positionally scrambled walking hen (i.e. an animation in which exactly the same set of dots in motion as that employed for the walking hen was presented, but with spatially randomized starting positions). Chicks tested on day 1 (experiment 2) or on day 2 (i.e. after a period in the dark following exposure on day 1 (experiment 3)) proved able to discriminate the two animation sequences: males preferentially approached the novel stimulus, females the familiar one. These results indicate that discrimination was not based on local motion vectors, but rather on the temporally integrated motion sequence. Received: 18 August 1999 / Accepted after revision: 14 March 2000     

The perception of biological and mechanical motion in female fragile X premutation carriers

Previous studies reported impaired visual information processing in patients with fragile X syndrome and in premutation carriers. In this study, we assessed the perception of biological motion (a walking point-light character) and mechanical motion (a rotating shape) in 25 female fragile X premutation carriers and in 20 healthy non-carrier controls. Stimuli were moving stimulus dots embedded among a cloud of noise dots. Sensitivity (d′) for motion detection was determined. Emotional symptoms were assessed by Hamilton’s depression and anxiety rating scales. Results revealed that the premutation carriers displayed lower sensitivities for biological and mechanical motion relative to the non-carriers. This deficit was more pronounced in the case of biological stimuli. The premutation carriers displayed higher depression and anxiety scores relative to the non-carriers. Higher depression, but not anxiety, scores were associated with decreased sensitivity for biological, but not mechanical, motion in the carrier group. These results suggest that motion perception deficits are detectable in fragile X premutation carriers, and that the impairment of biological motion perception is associated with depressive symptoms.     

He throws like a girl (but only when he's sad): emotion affects sex-decoding of biological motion displays

Gender stereotypes have been implicated in sex-typed perceptions of facial emotion. Such interpretations were recently called into question because facial cues of emotion are confounded with sexually dimorphic facial cues. Here we examine the role of visual cues and gender stereotypes in perceptions of biological motion displays, thus overcoming the morphological confounding inherent in facial displays. In four studies, participants’ judgments revealed gender stereotyping. Observers accurately perceived emotion from biological motion displays (Study 1), and this affected sex categorizations. Angry displays were overwhelmingly judged to be men; sad displays were judged to be women (Studies 2–4). Moreover, this pattern remained strong when stimuli were equated for velocity (Study 3). We argue that these results were obtained because perceivers applied gender stereotypes of emotion to infer sex category (Study 4). Implications for both vision sciences and social psychology are discussed.     

Simulating biological and non-biological motion

It is widely accepted that the brain processes biological and non-biological movements in distinct neural circuits. Biological motion, in contrast to non-biological motion, refers to active movements of living beings. Aim of our experiment was to investigate the mechanisms underlying mental simulation of these two movement types. Subjects had to either simulate mentally or to overtly reproduce previously executed or observed movements. Healthy subjects showed a very high timing precision when simulating biological and a strong distortion when simulating non-biological movements. Schizophrenic subjects, however, showed the opposite. Since overt reproduction was precise in any case, this double dissociation shows that processes underlying mental simulation of biological and non-biological movements are separate from each other and from perceptual and motor-control processes.     

The limits of visual mass perception

The theory of direct perception suggests that observers can accurately judge the mass of a box picked up by a lifter shown in a point-light display. However, accurate perceptual performance may be limited to specific circumstances. The purpose of the present study was to systematically examine the factors that determine perception of mass, including display type, lifting speed, response type, and lifter's strength. In contrast to previous research, a wider range of viewing manipulations of point-light display conditions was investigated. In Experiment 1, we first created a circumstance where observers could accurately judge lifts of five box masses performed by a lifter of average strength. In Experiments 2–5, we manipulated the spatial and temporal aspects of the lift, the judgement type, and lifter's strength, respectively. Results showed that mass judgement gets worse whenever the context deviates from ideal conditions, such as when only the lifted object was shown, when video play speed was changed, or when lifters of different strength performed the same task. In conclusion, observers' perception of kinetic properties is compromised whenever viewing conditions are not ideal.     

Learning to like it: Aesthetic perception of bodies,movements and choreographic structure

Appreciating human movement can be a powerful aesthetic experience. We have used apparent biological motion to investigate the aesthetic effects of three levels of movement representation: body postures, movement transitions and choreographic structure. Symmetrical (ABCDCBA) and asymmetrical (ABCDBCA) sequences of apparent movement were created from static postures, and were presented in an artificial grammar learning paradigm. Additionally, “good” continuation of apparent movements was manipulated by changing the number of movement path reversals within a sequence. In an initial exposure phase, one group of participants saw only symmetrical sequences, while another group saw only asymmetrical sequences. In a subsequent test phase, both groups rated all sequences on an aesthetic evaluation scale. We found that posture, movement, and choreographic structure all influenced aesthetic ratings. Separate ratings for the static body postures presented individually showed that both groups preferred a posture that maximized spatial symmetry. Ratings for the experimental sequences showed that both groups gave higher ratings to symmetrical sequences with “good” continuation and lower ratings to sequences with many path reversals. Further, participants who had been initially familiarized with asymmetrical sequences showed increased liking for asymmetrical sequences, suggesting a structural mere exposure effect. Aesthetic preferences thus depend on body postures, apparent movement continuation and choreographic structure. We propose a hierarchical model of aesthetic perception of human movement with distinct processing levels for body postures, movements and choreographic structure.     

The relationship between social anxiety and the perception of depth-ambiguous biological motion stimuli is mediated by inhibitory ability

Orthographically projected biological motion stimuli are depth-ambiguous. Consequently, their projection when oriented towards the viewer is the same as when oriented away. Despite this, observers tend to interpret such stimuli as facing the viewer more often. Some have speculated that this facing-the-viewer bias may exist for sociobiological reasons: Mistaking another human as retreating when they are actually approaching could have more severe consequences than the opposite error. An implication of this theory is that the facing-towards percept may be perceived as more threatening than the facing-away percept. Given this, as well as the finding that anxious individuals have been found to display an attentional bias towards threatening stimuli, we reasoned that more anxious individuals might have stronger facing-the-viewer biases. Furthermore, since anxious individuals have been found to perform poorer on inhibition tasks, we hypothesized that inhibitory ability would mediate the relationship between anxiety and the facing-the-viewer bias (i.e., difficulty inhibiting the threatening percept). Exploring individual differences, we asked participants to complete anxiety questionnaires, to perform a Go/No-Go task, and then to complete a perceptual task that allowed us to assess their facing-the-viewer biases. As hypothesized, we found that both greater anxiety and weaker inhibitory ability were associated with greater facing-the-viewer biases. In addition, we found that inhibitory ability significantly mediated the relationship between anxiety and facing-the-viewer biases. Our results provide further support that the facing-the-viewer bias is sensitive to the sociobiological relevance of biological motion stimuli, and that the threat bias for ambiguous visual stimuli is mediated by inhibitory ability.     

Implied motion produces real depth

Static images taken from an animation of continuous motion, such as a photograph of a figure in a running pose, contain no real motion (RM) information. Interestingly, while imaging studies have shown that passively viewing these implied motion (IM) stimuli activate the same brain regions as RM, the perceptual effects of adding IM to RM are not fully understood. Given that IM appears to recruit the same neural mechanisms as RM, it should be possible to capitalize on this functional overlap and use IM in addition to, or in place of, RM to influence the perception of depth from motion parallax (MP). In the current study, we found that IM influenced depth-sign judgments as expected based on the geometry of MP with RM. These results bolster our understanding of the neural mechanisms of both IM and MP by demonstrating that IM coupled with pursuit eye movements generates unambiguous depth from MP.     

Perceptual and decisional contributions to audiovisual interactions in the perception of apparent motion: a signal detection study

Motion information available to different sensory modalities can interact at both perceptual and post-perceptual (i.e., decisional) stages of processing. However, to date, researchers have only been able to demonstrate the influence of one of these components at any given time, hence the relationship between them remains uncertain. We addressed the interplay between the perceptual and post-perceptual components of information processing by assessing their influence on performance within the same experimental paradigm. We used signal detection theory to discriminate changes in perceptual sensitivity (d') from shifts in response criterion (c) in performance on a detection (Experiment 1) and a classification (Experiment 2) task regarding the direction of auditory apparent motion streams presented in noise. In the critical conditions, a visual motion distractor moving either leftward or rightward was presented together with the auditory motion. The results demonstrated a significant decrease in sensitivity to the direction of the auditory targets in the crossmodal conditions as compared to the unimodal baseline conditions that was independent of the relative direction of the visual distractor. In addition, we also observed significant shifts in response criterion, which were dependent on the relative direction of the distractor apparent motion. These results support the view that the perceptual and decisional components involved in audiovisual interactions in motion processing can coexist but are largely independent of one another.     

Aging and the perception of biological motion

Two experiments examined how observers' ability to perceive biological motion changes with increasing age. The observers discriminated among kinetic figures, depicting walking, jogging, and skipping. The direction, duration, and temporal correspondence of the motions were manipulated. Quantitative differences occurred between the recognition performances of younger and older observers, but these differences were often modest. The older and younger observers' performances were comparable for most conditions at stimulus durations of 400 ms. The older observers also performed well above chance at shorter durations of 240 and 120 ms. Unlike their performance on other 2- or 3-dimensional motion tasks, older observers' ability to perceive biological motion is relatively well preserved.     

Revisiting the metacontrast dissociation: Comparing sensitivity across different measures and tasks

In the metacontrast dissociation procedure, presenting a masked shape prime prior to a visible shape target leads to reaction-time effects of the prime in an indirect measure, although participants cannot consciously detect prime shapes in a direct measure (Klotz & Neumann, 1999 Klotz, W. and Neumann, O. 1999. Motor activation without conscious discrimination in metacontrast masking. Journal of Experimental Psychology: Human Perception and Performance, 25: 976–992.  [Google Scholar]). This has been taken as evidence for the processing of unconscious input. The results of the present metacontrast dissociation study indicate that although participants are unable to consciously report the shape of the prime, they can consciously perceive motion between masked primes and visible targets in a hybrid direct/indirect measure (Experiments 1 and 3). This indicates that former tests did not provide an exhaustive measure for residual conscious perception of the prime in the metacontrast dissociation procedure. Further tests, however, reveal that residual motion perception cannot account for performance in the indirect measure (Experiments 2 and 3). Although the results thus leave the conception of processing of unconscious input intact, they may prompt a revision of its criteria.     

The efficiency of biological motion perception

Humans can readily perceive biological motion from point-light (PL) animations, which create an image of a moving human figure by tracing the trajectories of a small number of light points affixed to a moving human body. We have applied ideal observer analysis to a standard biological motion discrimination task involving either full-figure or PL displays. Contrary to current dogma, we find that PL animations can be rich inpotential stimulus information but that human observers are remarkably inefficient at exploiting this information. Although our findings do not discount the utility of PL animation, they do provide a realistic measure of the computational challenge posed by biological motion perception.     

Dynamic object perception by pigeons: discrimination of action in video presentations

Two experiments examined the discrimination by pigeons of relative motion using computer-generated video stimuli. Using a go/no-go procedure, pigeons were tested with video stimuli in which the camera's perspective went either "around" or "through" an approaching object in a semi-realistic context. Experiment 1 found that pigeons could learn this discrimination and transfer it to videos composed from novel objects. Experiment 2 found that the order of the video's frames was critical to the discrimination of the videos. We hypothesize that the pigeons perceived a three-dimensional representation of the objects and the camera's relative motion and used this as the primary basis for discrimination. It is proposed that the pigeons might be able to form generalized natural categories for the different kinds of motions portrayed in the videos. Accepted after revision: 23 March 2001 Electronic Publication     

The relationship between object files and conscious perception

Object files (OFs) are hypothesized mid-level representations which mediate our conscious perception of persisting objects-e.g. telling us 'which went where'. Despite the appeal of the OF framework, not previous research has directly explored whether OFs do indeed correspond to conscious percepts. Here we present at least one case wherein conscious percepts of 'which went where' in dynamic ambiguous displays diverge from the analogous correspondence computed by the OF system. Observers viewed a 'bouncing/streaming' display in which two identical objects moved such that they could have either bounced off or streamed past each other. We measured two dependent variables: (1) an explicit report of perceived bouncing or streaming; and (2) an implicit 'object-specific preview benefit' (OSPB), wherein a 'preview' of information on a specific object speeds the recognition of that information at a later point when it appears again on the same object (compared to when it reappears on a different object), beyond display-wide priming. When the displays were manipulated such that observers had a strong bias to perceive streaming (on over 95% of the trials), there was nevertheless a strong OSPB in the opposite direction-such that the object files appeared to have 'bounced' even though the percept 'streamed'. Given that OSPBs have been taken as a hallmark of the operation of object files, the five experiments reported here suggest that in at least some specialized (and perhaps ecologically invalid) cases, conscious percepts of 'which went where' in dynamic ambiguous displays can diverge from the mapping computed by the object-file system.     

The effect of scene structure on time perception

The current experiments examined the hypothesis that scene structure affects time perception. In three experiments, participants judged the duration of realistic scenes that were presented in a normal or jumbled (i.e., incoherent) format. Experiment 1 demonstrated that the subjective duration of normal scenes was greater than subjective duration of jumbled scenes. In Experiment 2, gridlines were added to both normal and jumbled scenes to control for the number of line terminators, and scene structure had no effect. In Experiment 3, participants performed a secondary task that required paying attention to scene structure, and scene structure's effect on duration judgements reemerged. These findings are consistent with the idea that perceived duration can depend on visual–cognitive processing, which in turn depends on both the nature of the stimulus and the goals of the observer.     

Similar effects of visual perception and imagery on simple reaction time

A longstanding issue is whether perception and mental imagery share similar cognitive and neural mechanisms. To cast further light on this problem, we compared the effects of real and mentally generated visual stimuli on simple reaction time (RT). In five experiments, we tested the effects of difference in luminance, contrast, spatial frequency, motion, and orientation. With the intriguing exception of spatial frequency, in all other tasks perception and imagery showed qualitatively similar effects. An increase in luminance, contrast, and visual motion yielded a decrease in RT for both visually presented and imagined stimuli. In contrast, gratings of low spatial frequency were responded to more quickly than those of higher spatial frequency only for visually presented stimuli. Thus, the present study shows that basic dependent variables exert similar effects on visual RT either when retinally presented or when imagined. Of course, this evidence does not necessarily imply analogous mechanisms for perception and imagery, and a note of caution in such respect is suggested by the large difference in RT between the two operations. However, the present results undoubtedly provide support for some overlap between the structural representation of perception and imagery.