Movement perception in computer-driven visual displays

Computer-driven visual displays (CDVDs), like television and movies, produce stroboscopic rather than continuous physical movement. The success with which the perception of motion is produced depends or. factors such as the fineness of the raster and the temporal and spatiai reiationships of the stimulus points. For a given velocity, the more points there are on the movement trajectory, and the closer their spacing, the better is the perceived movement. Moderately slow retinal velocities (on the order of .4 to .8 deg/sec) produce the highest quality of perceived movement. One can discriminate among possible subclasses of movement detectors by presenting a complex sequence of intensities at two or more points and varying their cross correlation. Motion between two areas can be perceived even when there is zero correlation between the spatial patterns in each location. Perceived motion can be of rotation, as well as of translation. The two-dimensional shadow of a rotating three-dimensional wire figure is perceived as a rotating, rigid, three-dimensional wire figure (the kinetic depth effect). A three-dimensional “shadow” of a hypothetical four-dimensional wire figure also has been produced; it was not seen as rigid.     

Rapid adaptation of the vestibulo-ocular reflex and induced self-motion perception

When a rigid object moves toward the eye, it is usually perceived as being rigid. However, in the case of motion away from the eye, the motion and structure of the object are perceived nonveridically, with the percept tending to reflect the nonrigid transformations that are present in the retinal image. This difference in response to motion to and from the observer was quantified in an experiment using wire-frame computer-generated boxes which moved toward and away from the eye. Two theoretical systems are developed by which uniform three-dimensional velocity can be recovered from an expansion pattern of nonuniform velocity vectors. It is proposed that the human visual system uses two similar systems for processing motion in depth. The mechanism used for motion away from the eye produces perceptual errors because it is not suited to objects with a depth component.     

Three-dimensional structure from long-range apparent motion

Experiments are reported which show that three-dimensional structure can be perceived from two-dimensional image motions carried by objects defined solely by the differences in binocular and/or temporal correlation (ie disparity or motion discontinuities). This demonstrates that the kinetic depth effect is independent of motion detection in the luminance domain and that its relevant input comes from detectors based on some form of identity preservation of objects or features over time, ie the long-range processes of apparent motion.     

Specificity and variability of trunk kinematics on a mechanical horse

As perturbation training is gaining popularity, it is important to better understand postural control during complex three-dimensional stimuli. One clinically relevant and commonly used three-dimensional stimulus is found in hippotherapy and simulated hippotherapy on a mechanical horse. We tested nine healthy participants on a horse simulator, measured head and trunk kinematics, and characterized data in time (root-mean-square and variability) and frequency (amplitude spectra, gains, and phases) domains. We addressed three fundamental questions: 1) What is the specificity of postural responses to the simulator? 2) Which plane of motion is associated with the most and least variability (repeatable movements across repeated stimuli and across participants)? 3) To what extent are postural responses influenced by different degrees of stability (addition of pelvis straps and trunk support)? We found head and trunk responses were highly specific to the three-dimensional simulator perturbation direction and frequency. Frontal plane responses had the least variability across repetitions and participants whereas transverse motion was most variable. Head motion was more variable than the trunk at low frequencies and exhibited a marked decrease in tilt in the sagittal plane. Finally, the inclusion of pelvis straps had minimal effect on kinematics at low frequencies but altered higher frequencies; whereas added trunk support reduced head and trunk responses to perturbations and altered timing characteristics in all three planes. In conclusion, the present study suggests that frontal plane motion was under a high level of control, and results support the idea that specific head and trunk postural responses can be elicited from a complex three-dimensional stimuli, such as those found in hippotherapy. Researchers and clinicians can use results from this study to help interpret variability, implement mechanical adjustments to stability, and assess responses in pathological populations.     

Stored representations of three-dimensional objects in the absence of two-dimensional cues

Object recognition was studied in human subjects to determine whether the storage of the visual objects was in a two-dimensional or a three-dimensional representation. Novel motion-based and disparity-based stimuli were generated in which three-dimensional and two-dimensional form cues could be manipulated independently. Subjects were required to generate internal representations from motion stimuli that lacked explicit two-dimensional cues. These stored internal representations were then matched against internal three-dimensional representations constructed from disparity stimuli. These new stimuli were used to confirm prior studies that indicated the primacy of two-dimensional cues for view-based object storage. However, under tightly controlled conditions for which only three-dimensional cues were available, human subjects were also able to match an internal representation derived from motion of that of disparity. This last finding suggests that there is an internal storage of an object's representations in three dimensions, a tenet that has been rejected by view-based theories. Thus, any complete theory of object recognition that is based on primate vision must incorporate three-dimensional stored representations.     

The importance of pattern information for the resolution of depth-ambiguous apparent motion

A single apparent motion display can result in the perception of a rigid three-dimensional motion or a plastic, two-dimensional motion. Previous studies have found that the principal determinant of the perceptual outcome is the temporal properties of the apparent motion stimulus. Here it is shown that the form properties of the stimulus are another determinant and that, in some situations, they may become a more powerful determinant than the temporal properties.     

Static depth cues do affect the perceived direction of motion

Models of motion perception usually assume that the visual system references spatial displacements to retinal coordinates, and not to three-dimensional coordinates recovered by a parallel process. The present studies investigated whether moving elements viewed in the context of a static random-dot stereogram could lead to the appearance of motion in depth. Observers judged the velocity of a monocular element translating horizontally in the stereo context as 'same as' or 'different to' that of a standard. Based on velocity constancy, if there was apparent motion in depth, the relative velocity judgments would yield a predictable pattern of errors. The first experiment compared two stereo contexts: a sloped surface versus a fronto-parallel plane at zero disparity. The results indicated an overall increase in the perceived velocity of the element moving in the sloped surface context. A similar pattern of results was found when surfaces differing in incline were compared. Experiment 2 explored the case of fronto-parallel planes at crossed and uncrossed disparities. Here depth differences did not systematically affect observers' judgments. It was concluded that in some cases motion analysis can be affected by three-dimensional disparity information and not by angular displacement alone.     

Voluntary head movement and allocentric perception of space

Although visual input is egocentric, at least some visual perceptions and representations are allocentric, that is, independent of the observer's vantage point or motion. Three experiments investigated the visual perception of three-dimensional object motion during voluntary and involuntary motion in human subjects. The results show that the motor command contributes to the objective perception of space: Observers are more likely to apply, consciously and unconsciously, spatial criteria relative to an allocentric frame of reference when they are executing voluntary head movements than while they are undergoing similar involuntary displacements (which lead to a more egocentric bias). Furthermore, details of the motor command are crucial to spatial vision, as allocentric bias decreases or disappears when self-motion and motor command do not match.     

Accuracy and precision of the PEAK Performance Technologies Motion Measurement System

This study evaluated the accuracy and precision of the PEAK Performance Technologies, lnc.'s motion analysis system for three-dimensional angle reconstruction. Pendular motion of a bar, on which 18 retroreflective markers were mounted, was videotaped at three different orientations (parallel, and rotated 30 degrees right and left) to a plane at which two standard video cameras were aimed. The videotaped motion was digitized off-line, and 32 angles between the 18 markers were calculated. intraclass correlation coefficients (ICCs) were calculated between trials within each pendulum orientation and across orientations to determine system precision, and between randomly selected trials and actual angles to determine accuracy. lCCs were in all cases greater than.99. Within-trial standard deviations ranged between 0.05-0.8 degrees for the different angles. Deviations from the actual angle averaged 0.0-0.8 degrees across all angles and orientations. The results indicate that accurate and reliable angular measurements can be made with this motion analysis system.     

Differential effects of shared attention on perception of heading and 3-D object motion

When a person moves in a straight line through a stationary environment, the images of object surfaces move in a radial pattern away from a single point. This point, known as the focus of expansion (FOE), corresponds to the person's direction of motion. People judge their heading from image motion quite well in this situation. They perform most accurately when they can see the region around the FOE, which contains the most useful information for this task. Furthermore, a large moving object in the scene has no effect on observer heading judgments unless it obscures the FOE. Therefore, observers may obtain the most accurate heading judgments by focusing their attention on the region around the FOE. However, in many situations (e.g., driving), the observer must pay attention to other moving objects in the scene (e.g., cars and pedestrians) to avoid collisions. These objects may be located far from the FOE in the visual field. We tested whether people can accurately judge their heading and the three-dimensional (3-D) motion of objects while paying attention to one or the other task. The results show that differential allocation of attention affects people's ability to judge 3-D object motion much more than it affects their ability to judge heading. This suggests that heading judgments are computed globally, whereas judgments about object motion may require more focused attention.     

Aligning the eye to the actively or passively positioned hand

Observations were made of the reversal rate of a three-dimensional skeletal cube as a function of observing condition and state of rest or motion of the cube. Perspective reversal rate of the stationary three-dimensional cube is greater than direction reversal rate of the same cube set in motion. Reversal rate of the rotating cube drops with rest, replicating a similar finding with the Necker cube. Comparisons are made with the rotating trapezoidal window illusion. nt]mis|The author is most grateful to Marshall P. Smith, Chairman of the Psychology Department of Trenton State College, for his aid in securing space and college students, and to David L. Hoats, of the Johnstone Research Department, for wiring the apparatus.     

Determinants of the perception of sagittal motion.

This study examines the change in the perceived distance of an object in three-dimensional space when the object and/or the observer's head is moved along the line of sight (sagittal motion) as a function of the perceived absolute (egocentric) distance of the object and the perceived motion of the head. To analyze the processes involved, two situations, labeled A and B, were used in four experiments. In Situation A, the observer was stationary and the perceived motion of the object was measured as the object was moved toward and away from the observer. In Situation B, the same visual information regarding the changing perceived egocentric distance between the observer and object was provided as in Situation A, but part or all of the change in visual egocentric distance was produced by the sagittal motion of the observer's head. A comparison of the perceived motion of the object in the two situations was used to measure the compensation in the perception of the motion of the object as a result of the head motion. Compensation was often clearly incomplete, and errors were often made in the perception of the motion of the stimulus object. A theory is proposed, which identifies the relation between the changes in the perceived egocentric distance of the object and the tandem motion of the object resulting from the perceived motion of the head to be the significant factor in the perception of the sagittal motion of the stimulus object in Situation B.     

Determinants ofthe perception of sagittal motion

This study examines the change in the perceived distance of an object in three-dimensional space when the object andlor the observer’s head is moved along the line of sight (sagittal motion) as a function of the perceived absolute (egocentric) distance of the object and the perceived motion of the head. To analyze the processes involved, two situations, labeled A and B, were used in four experiments. In Situation A, the observer was stationary and the perceived motion of the object was measured as the object was moved toward and away from the observer. In Situation B, the same visual information regarding the changing perceived egocentric distance between the observer and object was provided as in Situation A, but part or all of the change in visual egocentric distance was produced by the sagittal motion of the observer’s head. A comparison of the perceived motion of the object in the two situations was used to measure the compensation in the perception of the motion of the object as a result of the headmotion. Compensation was often clearly incomplete, and errors were often made in the perception of the motion of the stimulus object. A theory is proposed, which identifies the relation between the changes in the perceived egocentric distance of the object and the tandem motion of the object resulting from the perceived motion of the head to be the significant factor in the perception of the sagittal motion of the stimulus object in Situation B.     

Mom’s shadow: structure-from-motion in newly hatched chicks as revealed by an imprinting procedure

The ability to recognize three-dimensional objects from two-dimensional (2-D) displays was investigated in domestic chicks, focusing on the role of the object’s motion. In Experiment 1 newly hatched chicks, imprinted on a three-dimensional (3-D) object, were allowed to choose between the shadows of the familiar object and of an object never seen before. In Experiments 2 and 3 random-dot displays were used to produce the perception of a solid shape only when set in motion. Overall, the results showed that domestic chicks were able to recognize familiar shapes from 2-D motion stimuli. It is likely that similar general mechanisms underlying the perception of structure-from-motion and the extraction of 3-D information are shared by humans and animals. The present data shows that they occur similarly in birds as known for mammals, two separate vertebrate classes; this possibly indicates a common phylogenetic origin of these processes.     

Differential effects of shared attention on perception of heading and 3-D object motion

When a person moves in a straight line through a stationary environment, the images of object surfaces move in a radial pattern away from a single point. This point, known as thefocus of expansion (FOE), corresponds to the person’s direction of motion. People judge their heading from image motion quite well in this situation. They perform most accurately when they can see the region around the FOE, which contains the most useful information for this task. Furthermore, a large moving object in the scene has no effect on observer heading judgments unless it obscures the FOE. Therefore, observers may obtain the most accurate heading judgments by focusing their attention on the region around the FOE. However, in many situations (e.g., driving), the observer must pay attention to other moving objects in the scene (e.g., cars and pedestrians) to avoid collisions. These objects may be located far from the FOE in the visual field. We tested whether people can accurately judge their heading and the three-dimensional (3-D) motion of objects while paying attention to one or the other task. The results show that differential allocation of attention affects people’s ability to judge 3-D object motion much more than it affects their ability to judge heading. This suggests that heading judgments are computed globally, whereas judgments about object motion may require more focused attention.     

Bias to experience approaching motion in a three-dimensional virtual environment

We used two-frame apparent motion in a three-dimensional virtual environment to test whether observers had biases to experience approaching or receding motion in depth. Observers viewed a tunnel of tiles receding in depth, that moved ambiguously either toward or away from them. We found that observers exhibited biases to experience approaching motion. The strengths of the biases were decreased when stimuli pointed away, but size of the display screen had no effect. Tests with diamond-shaped tiles that varied in the degree of pointing asymmetry resulted in a linear trend in which the bias was strongest for stimuli pointing toward the viewer, and weakest for stimuli pointing away. We show that the overall bias to experience approaching motion is consistent with a computational strategy of matching corresponding features between adjacent foreshortened stimuli in consecutive visual frames. We conclude that there are both adaptational and geometric reasons to favor the experience of approaching motion.     

Human pelvis motions when walking and when riding a therapeutic horse

A prevailing rationale for equine assisted therapies is that the motion of a horse can provide sensory stimulus and movement patterns that mimic those of natural human activities such as walking. The purpose of this study was to quantitatively measure and compare human pelvis motions when walking to those when riding a horse. Six able-bodied children (inexperienced riders, 8–12 years old) participated in over-ground trials of self-paced walking and leader-paced riding on four different horses. Five kinematic measures were extracted from three-dimensional pelvis motion data: anteroposterior, superoinferior, and mediolateral translations, list angle about the anteroposterior axis, and twist angle about the superoinferior axis. There was generally as much or more variability in motion range observed between riding on the different horses as between riding and walking. Pelvis trajectories exhibited many similar features between walking and riding, including distorted lemniscate patterns in the transverse and frontal planes. In the sagittal plane the pelvis trajectory during walking exhibited a somewhat circular pattern whereas during riding it exhibited a more diagonal pattern. This study shows that riding on a horse can generate movement patterns in the human pelvis that emulate many, but not all, characteristics of those during natural walking.     

The importance of velocity gradients in the perception of three-dimensional rigidity

Sequential presentation of a number of random-dot patterns which when super-imposed yield an expanding flow field leads to the perception of a coherent motion towards the observer. The motion vectors in this type of flow field all radiate from the origin. This percept of a global coherent expanding flow results only when the local speeds (magnitude of the local motion vectors) are zero at the centre and increase linearly towards the periphery. If all the dots radiate outwards but have the same speed, a clear percept of three-dimensional nonrigidity arises.     

Early motion processes and the kinetic depth effect

It has been known for over 30 years that motion information alone is sufficient to yield a vivid impression of three-dimensional object structure. For example, a computer simulation of a transparent sphere, the surface of which is randomly speckled with dots, gives no impression of depth when presented as a stationary pattern on a visual display. As soon as the sphere is made to rotate in a series of discrete steps or frames, its 3-D structure becomes apparent. Three experiments are described which use this stimulus, and find that depth perception in these conditions depends crucially on the spatial and temporal properties of the display:

1. Depth is seen reliably only for between-frame rotations of less than 15°, using two-frame and four-frame sequences.

2. Parametric observations using a wide range of frame durations and inter-frame intervals reveal that depth is seen only for inter-frame intervals below 80 msec and is optimal when the stimulus can be sampled at intervals of about 40-60 msec.

3. Monoptic presentation of two frames of the stimulus is sufficient to yield depth, but the impression is destroyed by dichoptic presentation.

These data are in close agreement with the observed limits of direction perception in experiments using “short-range” stimuli. It is concluded that depth perception in the motion display used in these experiments depends on the outputs of low-level or “short-range” motion detectors.     

The representation of uniform motion in vision

For veridical detection of object motion any moving detecting system must allocate motion appropriately between itself and objects in space. A model for such allocation is developed for simplified situations (points of light in uniform motion in a frontoparallel plane). It is proposed that motion of objects is registered and represented successively at four levels within frames of reference that are defined by the detectors themselves or by their movements. The four levels are referred to as retinocentric, orbitocentric, egocentric, and geocentric. Thus the retinocentric signal is combined with that for eye rotation to give an orbitocentric signal, and the left and right orbitocentric signals are combined to give an egocentric representation. Up to the egocentric level, motion representation is angular rather than three-dimensional. The egocentric signal is combined with signals for head and body movement and for egocentric distance to give a geocentric representation. It is argued that although motion perception is always geocentric, relevant registrations also occur at the three earlier levels. The model is applied to various veridical and nonveridical motion phenomena.