TIMING AND APPARENT MOTION PATH CHOICE WITH HUMAN BODY PHOTOGRAPHS

Abstract— In demonstrations of apparent motion, observers typically report seeing motion along the shortest possible path between two sequentially presented objects. Recent work has demonstrated that violations of this shortest path rule occur with realistic photographs of a human body displayed for sufficiently long temporal intervals when a longer path is more anatomically plausible than the shortest path. The current set of experiments investigated the mechanisms by which information about biomechanical motion constrains apparent motion perception. In Experiment 1, we demonstrated, first, that the availability of extra processing time does not simply—in and of itself—result in the perception of longer paths of apparent motion. Second, we rejected the hypothesis that the perception of biomechanically correct paths of apparent motion depends on biologically appropriate velocities. In Experiment 2, we discovered that the longer the motion path required to satisfy the biomechanical movement limitations of the stimulus, the longer the time needed to construct and therefore perceive that path. These findings together suggest that additional processing time is necessary, but not sufficient, for interpolations of longer paths.     

Temporal binding during apparent movement of the human body

Alternating between static images of human bodies with an appropriate interstimulus interval (ISI) produces apparent biological motion. Here we investigate links between apparent biological motion and time perception. We presented two pictures of the initial and final positions of a human movement separated by six different ISIs. The shortest movement path between two positions was always biomechanically impossible. Participants performed two tasks: In an explicit task, participants judged whether they saw the longer, feasible movement path between the two postures, or the shorter, biomechanically impossible path. In an implicit task, participants judged the duration of a white square surrounding the picture sequence. At longer ISIs participants were more likely to see a longer, feasible movement path (explicit task) and underestimated the duration of body picture pairs, compared to trials displaying degraded body pictures (implicit task). We argue that perceiving apparent biological motion involves temporal binding of two static pictures into a continuous movement. Such temporal binding may be mediated by a top-down mechanism that produces a percept of biological motion in the absence of any retinal motion.     

On the relation between time and space in the visual discrimination of velocity.

Is the perception of velocity determined by the prior discrimination of spatial and temporal distances? Two experiments sought to answer this question by comparing the discriminabilities of moving stimuli varied in spatial extent, temporal duration, or in redundant combinations of both variables. The subject's task was to identify which of two alternative stimuli was presented on each trial. A set of four stimuli was constructed from two values of spatial extent and two values of temporal duration. Separate conditions required discrimination of each of the six possible pairs of these stimuli. Experiment 1 examined continuous motion and Experiment 2 examined apparent motion for stimuli with short (50 versus 65 msec) and with long (500 versus 650 msec) interstimulus intervals. With continuous motion and with good apparent motion (short intervals), the discrimination between the different-velocity bivariate pairs was too accurate to be attributed only to discriminations of the spatial and temporal extents of the motion. This did not occur with poor apparent motion. Evidently, time and space are perceptually related.     

Position uncertainty and the perception of apparent movement

Two experiments compared the perception of apparent movement when the second of two successive stimuli always appeared in the same position and when it varied randomly between two spatial positions. The results of both experiments showed that foreknowledge of the position of the second stimulus does not facilitate the perception of apparent movement. Experiment 2 also clearly showed that the space-time relationships of Korte’s third law of apparent movement does not depend on foreknowledge of the position of the second stimulus. These findings imply that apparent movement in real time occurs after the second stimulus has been registered by the visual system. It suggests that apparent movement involves a delayed decision mechanism that stores the first stimulus, the interstimulus temporal interval, and the second stimulus, and then impletes a motion compatible with the stimulus information.     

Haptic perception of linear extent.

The perception of linear extent in haptic touch appears to be anisotropic, in that haptically perceived extents can depend on the spatial orientation and location of the object and, thus, on the direction of exploratory motion. Experiments 1 and 2 quantified how the haptic perception of linear extent depended on the type of motion (radial or tangential to the body) when subjects explored different stimulus objects (raised lines or solid blocks) varying in length and in relative spatial location. Relatively narrow, shallow, raised lines were judged to be longer, by magnitude estimation, than solid blocks. Consistent with earlier reports, stimuli explored with radial arm motions were judged to be longer than identical stimuli explored with tangential motions; this difference did not depend consistently on the lateral position of the stimulus object, the direction of movement (toward or away from the body), or the distance of the hand from the body but did depend slightly on the angular position of the shoulder. Experiment 3 showed that the radial-tangential effect could be explained by temporal differences in exploratory movements, implying that the apparent anisotropy is not intrinsic to the structure of haptic space.     

Haptic perception of linear extent

The perception of linear extent in haptic touch appears to be anisotropic, in that haptically perceived extents can depend on the spatial orientation and location of the object and, thus, on the direction of exploratory motion. Experiments 1 and 2 quantified how the haptic perception of linear extent depended on the type of motion (radial or tangential to the body) when subjects explored different stimulus objects (raised lines or solid blocks) varying in length and in relative spatial location. Relatively narrow, shallow, raised lines were judged to be longer, by magnitude estimation, than solid blocks. Consistent with earlier reports, stimuli explored with radial arm motions were judged to be longer than identical stimuli explored with tangential motions; this difference did not depend consistently on the lateral position of the stimulus object, the direction of movement (toward or away from the body), or the distance of the hand from the body but did depend slightly on the angular position of the shoulder. Experiment 3 showed that the radial-tangential effect could be explained by temporal differences in exploratory movements, implying that the apparent anisotropy is not intrinsic to the structure of haptic space.     

Recognition of dance-like actions: Memory for static posture or dynamic movement?

Dance-like actions are complex visual stimuli involving multiple changes in body posture across time and space. Visual perception research has demonstrated a difference between the processing of dynamic body movement and the processing of static body posture. Yet, it is unclear whether this processing dissociation continues during the retention of body movement and body form in visual working memory (VWM). When observing a dance-like action, it is likely that static snapshot images of body posture will be retained alongside dynamic images of the complete motion. Therefore, we hypothesized that, as in perception, posture and movement would differ in VWM. Additionally, if body posture and body movement are separable in VWM, as form- and motion-based items, respectively, then differential interference from intervening form and motion tasks should occur during recognition. In two experiments, we examined these hypotheses. In Experiment 1, the recognition of postures and movements was tested in conditions in which the formats of the study and test stimuli matched (movement–study to movement–test, posture–study to posture–test) or mismatched (movement–study to posture–test, posture–study to movement–test). In Experiment 2, the recognition of postures and movements was compared after intervening form and motion tasks. These results indicated that (1) the recognition of body movement based only on posture is possible, but it is significantly poorer than recognition based on the entire movement stimulus, and (2) form-based interference does not impair memory for movements, although motion-based interference does. We concluded that, whereas static posture information is encoded during the observation of dance-like actions, body movement and body posture differ in VWM.     

Perceptual grouping in space and time: Evidence from the Ternus display

We report three experiments investigating the effect of perceptual grouping on the appearance of a bistable apparent-motion (Ternus) display. Subjects viewed a Ternus display embedded in an array of context elements that could potentially group with the Ternus elements. In contrast to several previous findings, we found that grouping influenced apparent motion perception. In Experiment 1, apparent motion perception was significantly affected via grouping by shape similarity, even when the visible persistence of the elements was controlled. In Experiment 2, elements perceived as moving without context were perceived as stationary when grouped with stationary context elements. In Experiment 3, elements perceived as stationary without context were perceived as moving when grouped with moving context elements. We argue that grouping in the spatial and temporal domains interact to yield perceptual experience of apparent-motion displays.     

Monocular stereopsis with and without head movement

Random dots moving with various velocity gradients were presented to observers; the motion was yoked to head movement in one condition and to no head movement in another. In Experiment 1, 12 observers were shown motion gradients with sine, triangle, sawtooth, and square waveforms with amplitudes (equivalent disparities) of 12' and 1 degrees 53'. In Experiment 2, 48 observers were shown only the sinewave or square-wave gradient of 1 degrees 53' disparity either with or without head movement so that the observers' expectation to see depth in one condition did not transfer to another. The main findings were: (1) with 12' disparity, the head-movement condition produced perceived depth but almost no perceived motion, whereas the no-head-movement condition produced both perceived depth and perceived motion; (2) with 1 degrees 53' disparity, both conditions produced perceived depth and perceived motion; and (3) when the expectation to see depth was removed, the no-head-movement condition with the square-wave gradient produced no perceived depth, only motion. We suggest that monocular stereopsis with head movement can be achieved without perception of motion but monocular stereopsis without head movement requires perception of motion.     

Monocular without stereopsis with and head movement

Random dots moving with various velocity gradients were presented to observers; the motion was yoked to head movement in one condition and to no head movement in another. In Experiment 1, 12 observers were shown motion gradients with sine, triangle, sawtooth, and square waveforms with amplitudes (equivalent disparities) of 12′ and 1° 53′. In Experiment 2, 48 observers were shown only the sinewave or square-wave gradient of 1° 53′ disparity either with or without head movement so that the observers’ expectation to see depth in one condition did not transfer to another. The main findings were: (1) with 12′ disparity, the head-movement condition produced perceived depth but almost no perceived motion, whereas the no-head-movement condition produced both perceived depth and perceived motion; (2) with 1° 53′ disparity, both conditions produced perceived depth and perceived motion; and (3) when the expectation to see depth was removed, the no-head-movement condition with the square-wave gradient produced no perceived depth, only motion. We suggest that monocular stereopsis with head movement can be achieved without perception of motion but monocular stereopsis without head movement requires perception of motion.     

Learning to like it: Aesthetic perception of bodies,movements and choreographic structure

Appreciating human movement can be a powerful aesthetic experience. We have used apparent biological motion to investigate the aesthetic effects of three levels of movement representation: body postures, movement transitions and choreographic structure. Symmetrical (ABCDCBA) and asymmetrical (ABCDBCA) sequences of apparent movement were created from static postures, and were presented in an artificial grammar learning paradigm. Additionally, “good” continuation of apparent movements was manipulated by changing the number of movement path reversals within a sequence. In an initial exposure phase, one group of participants saw only symmetrical sequences, while another group saw only asymmetrical sequences. In a subsequent test phase, both groups rated all sequences on an aesthetic evaluation scale. We found that posture, movement, and choreographic structure all influenced aesthetic ratings. Separate ratings for the static body postures presented individually showed that both groups preferred a posture that maximized spatial symmetry. Ratings for the experimental sequences showed that both groups gave higher ratings to symmetrical sequences with “good” continuation and lower ratings to sequences with many path reversals. Further, participants who had been initially familiarized with asymmetrical sequences showed increased liking for asymmetrical sequences, suggesting a structural mere exposure effect. Aesthetic preferences thus depend on body postures, apparent movement continuation and choreographic structure. We propose a hierarchical model of aesthetic perception of human movement with distinct processing levels for body postures, movements and choreographic structure.     

Cognitive empathy modulates the visual perception of human-like body postures without imitation

To examine the mechanism of visual perception of human-like body postures, we conducted a posture recognition task, a questionnaire survey, and the Interpersonal Reactivity Index (IRI). The majority of participants perceived the pseudo-posture as a human posture in the early stage (78%), but only approximately half of them reported the imagination of bodily movement (66%). These results suggest that the majority of observers perceive pseudo-postures as human postures in the early stage of perception, but this human posture perception does not necessarily lead to the visualisation of bodily movement. In a group of who received the pseudo posture as a human-posture regardless of the perception stages, the participants who imagined bodily movement (64%) showed significantly higher scores than those who did not on the Fantasy subscale of the IRI. Highly empathic participants are more likely to detect a kinematic relation between the pseudo-postures.     

Task-irrelevant sounds influence both temporal order and apparent-motion judgments about tactile stimuli applied to crossed and uncrossed hands

It has been suggested that judgments about the temporal–spatial order of successive tactile stimuli depend on the perceived direction of apparent motion between them. Here we manipulated tactile apparent-motion percepts by presenting a brief, task-irrelevant auditory stimulus temporally in-between pairs of tactile stimuli. The tactile stimuli were applied one to each hand, with varying stimulus onset asynchronies (SOAs). Participants reported the location of the first stimulus (temporal order judgments: TOJs) while adopting both crossed and uncrossed hand postures, so we could scrutinize skin-based, anatomical, and external reference frames. With crossed hands, the sound improved TOJ performance at short (≤300 ms) and at long (>300 ms) SOAs. When the hands were uncrossed, the sound induced a decrease in TOJ performance, but only at short SOAs. A second experiment confirmed that the auditory stimulus indeed modulated tactile apparent motion perception under these conditions. Perceived apparent motion directions were more ambiguous with crossed than with uncrossed hands, probably indicating competing spatial codes in the crossed posture. However, irrespective of posture, the additional sound tended to impair potentially anatomically coded motion direction discrimination at a short SOA of 80 ms, but it significantly enhanced externally coded apparent motion perception at a long SOA of 500 ms. Anatomically coded motion signals imply incorrect TOJ responses with crossed hands, but correct responses when the hands are uncrossed; externally coded motion signals always point toward the correct TOJ response. Thus, taken together, these results suggest that apparent-motion signals are likely taken into account when tactile temporal–spatial information is reconstructed.

     

A comparison of the effects of spatial separation on apparent motion in the auditory and visual modalities

In the present investigation, the effects of spatial separation on the interstimulus onset intervals (ISOIs) that produce auditory and visual apparent motion were compared. In Experiment 1, subjects were tested on auditory apparent motion. They listened to 50-msec broadband noise pulses that were presented through two speakers separated by one of six different values between 0 degrees and 160 degrees. On each trial, the sounds were temporally separated by 1 of 12 ISOIs from 0 to 500 msec. The subjects were instructed to categorize their perception of the sounds as "single," "simultaneous," "continuous motion," "broken motion," or "succession." They also indicated the proper temporal sequence of each sound pair. In Experiments 2 and 3, subjects were tested on visual apparent motion. Experiment 2 included a range of spatial separations from 6 degrees to 80 degrees; Experiment 3 included separations from .5 degrees to 10 degrees. The same ISOIs were used as in Experiment 1. When the separations were equal, the ISOIs at which auditory apparent motion was perceived were smaller than the values that produced the same experience in vision. Spatial separation affected only visual apparent motion. For separations less than 2 degrees, the ISOIs that produced visual continuous motion were nearly equal to those which produced auditory continuous motion. For larger separations, the ISOIs that produced visual apparent motion increased.     

Peak velocity as a cue in audiovisual synchrony perception of rhythmic stimuli

This study investigated audiovisual synchrony perception in a rhythmic context, where the sound was not consequent upon the observed movement. Participants judged synchrony between a bouncing point-light figure and an auditory rhythm in two experiments. Two questions were of interest: (1) whether the reference in the visual movement, with which the auditory beat should coincide, relies on a position or a velocity cue; (2) whether the figure form and motion profile affect synchrony perception. Experiment 1 required synchrony judgment with regard to the same (lowest) position of the movement in four visual conditions: two figure forms (human or non-human) combined with two motion profiles (human or ball trajectory). Whereas figure form did not affect synchrony perception, the point of subjective simultaneity differed between the two motions, suggesting that participants adopted the peak velocity in each downward trajectory as their visual reference. Experiment 2 further demonstrated that, when judgment was required with regard to the highest position, the maximal synchrony response was considerably low for ball motion, which lacked a peak velocity in the upward trajectory. The finding of peak velocity as a cue parallels results of visuomotor synchronization tasks employing biological stimuli, suggesting that synchrony judgment with rhythmic motions relies on the perceived visual beat.     

知觉组织对时序知觉的双重影响:同时判断任务的证据

本研究探讨知觉组织对时序知觉的双重影响。实验采用三条线段构成的C形为实验材料,操纵图形朝向和SOA水平(实验1和实验2)、图形颜色(实验3)以及反应限制(实验4),要求被试完成同时判断任务。结果发现,在不同的SOA条件下,图形对向条件的同时判断频率均显著高于图形反向条件(实验1),即使在知觉组织线索弱化时这种现象仍然存在(实验2和实验3),而且知觉组织对时序知觉的影响不是由于被试的反应偏向导致的(实验4)。结果说明知觉组织对时序知觉存在双重影响:当两个刺激同时出现时,知觉组织能够提高时序知觉表现; 而当两个刺激非同时出现时,知觉组织显著降低时序知觉表现。     

反应选项对时序知觉重复启动效应的影响

先前研究采用两项反应任务发现了时序知觉重复启动效应, 这可能是反应选项导致的虚假效应, 本研究采用三项反应任务对此进行了检验。实验1运用三项判断任务以消除缺乏中间选项所致的反应偏向, 结果发现重复启动显著影响“哪个图形先出现”和“两个图形同时出现”的时序判断; 实验2在实验1的基础上对“同时出现”反应选项进行两种指导语操作, 实验结果不仅与实验1一致, 而且“有把握时判断为同时出现”和“有无把握都判断为同时出现”之间没有显著差异, 说明被试能够识别时序加以判断, 不支持反应偏向的前提条件。因此, 时序知觉重复启动效应不是反应选项产生的反应偏向引发的虚假效应, 重复启动对“系列性”和“同时性”时序知觉都存在显著影响。     

Crossmodal duration perception involves perceptual grouping, temporal ventriloquism, and variable internal clock rates

Here, we investigate how audiovisual context affects perceived event duration with experiments in which observers reported which of two stimuli they perceived as longer. Target events were visual and/or auditory and could be accompanied by nontargets in the other modality. Our results demonstrate that the temporal information conveyed by irrelevant sounds is automatically used when the brain estimates visual durations but that irrelevant visual information does not affect perceived auditory duration (Experiment 1). We further show that auditory influences on subjective visual durations occur only when the temporal characteristics of the stimuli promote perceptual grouping (Experiments 1 and 2). Placed in the context of scalar expectancy theory of time perception, our third and fourth experiments have the implication that audiovisual context can lead both to changes in the rate of an internal clock and to temporal ventriloquism-like effects on perceived on- and offsets. Finally, intramodal grouping of auditory stimuli diminished any crossmodal effects, suggesting a strong preference for intramodal over crossmodal perceptual grouping (Experiment 5).     

Time,change, and motion: The effects of stimulus movement on temporal perception

The effects of stimulus motion on time perception were examined in five experiments. Subjects judged the durations (6–18 sec) of a series of computer-generated visual displays comprised of varying numbers of simple geometrical forms. In Experiment 1, subjects reproduced the duration of displays consisting of stationary or moving (at 20 cm/sec) stimulus figures. In Experiment 2, subjects reproduced the durations of stimuli that were either stationary, moving slowly (at 10 cm/sec), or moving fast (at 30 cm/sec). In Experiment 3, subjects used the production method to generate specified durations for stationary, slow, and fast displays. In Experiments 4 and 5, subjects reproduced the duration of stimuli that moved at speeds ranging from 0 to 45 cm/sec. Each experiment showed that stimulus motion lengthened perceived time. In general, faster speeds lengthened perceived time to a greater degree than slower speeds. Varying the number of stimuli appearing in the displays had only limited effects on time judgments. Other findings indicated that shorter intervals tended to be overestimated and longer intervals underestimated (Vierordt’s law), an effect which applied to both stationary and moving stimuli. The results support a change model of perceived time, which maintains that intervals associated with more changes are perceived to be longer than intervals with fewer changes.     

Temporal reproductions are influenced by an internal reference: Explaining the Vierordt effect

Several findings from duration perception literature suggest that when making decisions about time, participants rely on an internal reference memory for time rather than merely on the current physical stimuli. According to a recent account, such an internal reference is formed by a continuous dynamic updating process that integrates duration information from previous trials and the current trial. In the present work, we show how such a dynamic mechanism can account for the classical yet unresolved Vierordt effect, which refers to the overestimation of relatively short and the underestimation of relatively long temporal intervals. We conducted an experiment to examine this and related predictions by means of a temporal reproduction task. Specifically, participants were presented with two successive time intervals — a standard s with constant duration and a comparison c with variable duration. Instead of performing a comparison judgment, however, the participants were subsequently cued to reproduce one of the two presented stimuli. Reproductions were affected not only by the temporal position of the to-be-reproduced stimulus, but also by the stimuli presented on earlier trials. These results support the notion of a dynamically updated internal reference underlying our judgments about the time elapsed, which might also be the basis of the Vierordt effect.