Visual perception of motion in depth: Application of a vector model to three-dot motion patterns

The aim of the present study was to identify spatial properties of three-dot motion patterns yielding perceived motion in depth. A proposed vector model analyzed each pattern in terms of common and relative motion components of the moving parts. The dots moved in straight paths in a frontoparallel plane. The Ss reported verbally what they perceived. The common motion did not affect the kénd of perceived event (translation or rotation in depth). Relative motions toward or away from a common point, i.e. concurrent motions, yielded perceived translatory motion in depth. Parallel relative motions toward or away from a common line generally yielded perceived rotation in depth. Complex motion patterns, consisting of concurrent and parallel relative motion components combined, evoked simultaneously perceived translation and rotation in depth under certain phase conditions of the components. Some limitations of the model were discussed and suggestions made to widen its generality.     

Depth motion sensitivity functions

Functions reliably describing perception of motion in depth have been established experimentally by using psychophysical methods of size and distance estimations and threshold measurements. The stimuli were generated with a new hybrid technique yielding an image refresh rate of 1667 Hz. In this way it was possible to generate rapid expansions and contractions of the moving checkerboard pattern constituting the stimulus for depth motion perception. The results showed that perceived size constancy as well as depth impression varied with oscillation frequency. Under the conditions of slow motions (oscillation frequencies around 2 Hz), perfect size constancy was obtained. Above that limit, size constancy systematically decreased, and with oscillation frequencies of about 5 Hz the perceived size constancy was close to zero when small-sized patterns were used. Under the conditions of wide field stimulation (when the pattern subtended 66 degrees of visual angle), the cut-off limit increased to 16 Hz. Since the perception of depth motion amplitudes as well as perceived velocities of the visual object are related to perceived size constancy, the findings have certain implications for theoretical explanations of depth motion perception. Received: 15 December 1997 / Accepted: 21 December 1998     

Motion structure in five-dot patterns as a determinant of perceptual grouping

The effect of basic motion structures on perceptual grouping was studied with five-dot motion patterns. Four basic motion structures were identified in terms of proximal common and relative motion vectors. In a forced-choice situation, the observers had to decide to which of two pairs of dots a fifth critical dot seemed to belong. Thus, one of two possible three-dot units was chosen by the observers. The two possible three-dot units defined different motion structures, and the chosen motion structure was considered to have stronger grouping power than the alternative structure had. It was found that parallel common motions (perceived translation in the plane) had the strongest grouping power; these were followed by circular common motions (perceived rotation in the plane), concurrent relative motions (perceived translation in depth), and, finally, parallel relative motions (perceived rotation in depth). The results also suggested effects of proximity and orientation of axis of rotation. It is further argued that the relative grouping power of the motion structures could not solely be interpreted in terms of changes of directions and distances between the dots. Instead it is suggested that vector analysis is a fundamental perceptual activity and that basic motion structures determine grouping power.     

Effects of different motion characteristics on perceived motion in depth

Abstract.— The effect of different velocity characteristics on type of perceived motion were tested with three different stimulus patterns, each representing a certain case of relative motion vectors derived from a vector model for perceived motion in space. The oscilloscope generated patterns, displayed onto a translucent screen, consisted of two dots moving back and forth in their motion paths. The subjects described the perceived motion verbally. The reports were classified into four response categories, i.e. perceived translation in depth, rotation in depth, translation and rotation in depth, and finally, perceived motion in a frontoparallel plane. It was found, first, that no type of relative motion vectors consistently yielded the same distribution of responses for the different velocity conditions. Second, there were no main effects of type of velocity functions (sinusoidal, hyperbolical, and constant) on perceived motion. Third, the position of maximum velocity of the dots affected perceived motion, maximum velocity at the center of the motion path favoring perceived rotation in depth and maximum velocity at the end points of the paths favoring perceived translation in depth. Finally, patterns with continuously repeated motion cycles favored perceived rotation in depth. When the continuity was broken down by pauses at the center and the end points of the motion paths and a small spatial gap at the center of the path, perceived translation in depth was favored.     

Properties of the recombination of one-dimensional motion signals into a pattern motion signal.

We have examined the human ability to determine the direction of movement of a variety of plaid patterns. The plaids were composed of two orthogonal sine-wave gratings. When the plaid components are of unequal spatial frequency or sometimes of unequal contrast, observers judge the direction of movement incorrectly. In terms of the two-stage model of Adelson and Movshon (1982), these errors may result from either a misjudgment in the perceived speeds of each of the components or a failure in the combination of one-dimensional component movements into a coherent direction of motion of the two-dimensional plaid pattern, or both. A comparison of the perceived direction of motion of plaids with the relative perceived speeds of the plaid component gratings suggest that both failures occur, but in different circumstances. The relative perceived speed of the plaid components was measured with a spatial and a temporal forced-choice technique, the former leading to larger differences. Our results support the notion that the visual system decomposes a moving plaid into oriented components and subsequently recombines the component motions.     

Visually perceived motion in depth resulting from proximal changes. II

According to a model for motion and form perception proposed by Johansson (1964). every two-dimensional change in a changing proximal stimulation is projected out as a motion in depth The model assumes that the amount of perceivedrelative motion (the fraction between the perceived amount of motion of the object and the perceived initial distance to the object) is determined only by the amount ofrelative change (the fraction between the absolute amount of change and the initial size). The aim of the present study was to test this hypothesis by studying the effect of some other variables on perceived relative motion in depth. As stimuli, continuously shrinking and growing squares were used. No effects were found when varying the absolute amount of change. Neither did the rate of change influence the perceived relative motion in any important way. The only variable that gave rise to strong and systematic effects on perceived relative motion was the initial distance to the perceived object. The greater the initial distance, the less relative motion was perceived.     

Properties of the recombination of one-dimensional motion signals into a pattern motion signal

We have examined the human ability to determine the direction of movement of a variety of plaid patterns. The plaids were composed of two orthogonal sine-wave gratings. When the plaid components are of unequal spatial frequency or sometimes of unequal contrast, observers judge the direction of movement incorrectly. In terms of the two-stage model of Adelson and Movshon (1982), these errors may result from either a misjudgment in the perceived speeds of each of the components or a failure in the combination of one-dimensional-component movements into a coherent direction of motion of the two-dimensional plaid pattern, or both. A comparison of the perceived direction of motion of plaids with the relative perceived-speeds of the plaid component gratings suggests that both failures occur, but in different circumstances The relative perceived speed of the plaid components was measured with a spatial and a temporal forced-choice technique, the former leading to larger differences. Our results support the notion that the visual system decomposes a moving plaid into oriented components and subsequently recombines the component motions.     

Relative Distance Perception Through Expanding and Contracting Motion and the Role of Propiospecific Information in Walking

Two experiments using a new device that correlates simulated optic flow with forward and backward head motions are reported. The first experiment tested the effectiveness of the rate of optical expansion/contraction as a cue for relative distance perception; the second experiment examined the role of propriospecific information in determining whether or not a simulated wall was perceived to moving relative to the ground. In walking along the line of sight in a stationary environment, the image of a nearer object expands/contracts more than the image of objects farther away. In Experiment 1, observers' abilities to judge which of two walls was nearer, according to expanding/contracting patterns, were tested. The results show that both walking and stationary observers can detect the order of depth from expansion patterns but not from the contraction patterns. Experiment 2 assessed the role of propriospecific information for specifying the motion or nonmotion of simulated 'wall' relative to the ground. The results show the importance of synchrony between expansion/contraction patterns and head motion. Whether or not an observer is obtaining information actively does not seem to matter for perceiving relative distance but it does matter in perceiving object motion.     

Concurrent motion in infant event perception

Infant sensitivity to motion relationships specifying certain complex events, such as a person walking, has recently been demonstrated, but the perceptual principles underlying early event perception are not well understood. Retinal motion toward a common point (concurrent motion) specifies translation in depth to adult perceivers in the absence of conflicting information (Börjesson & von Hofsten, 1973). We tested this principle of event perception with 28 16-week-old infants. One group was habituated in a dark room to a concurrent motion: three points of light moving in a frontoparallel plane toward and away from a central point (not seen). After habituation, the room was illuminated, and looking time was tested to alternate presentations of two displays. In one display (depth motion), three lights were attached to a triangle actually moving in depth; in the other display (surface motion), the three lights moved visibly along the surface of a fronto-parallel stationary triangle. If concurrent motion, in the absence of conflicting information, specifies motion in depth to infants, they were expected to look longer after habituation at the surface motion display. A control group tested infants' relative interest in the two test displays with no prior habituation period.Control-group infants marginally preferred the depth movement display. The habituation group responded three times as much to the surface motion display, suggesting that motion in depth had been perceived during habituation. Specification of motion in depth by concurrency of relative proximal stimulus motions seems to be an operative principle in infants' perception; moreover, at least some principles of early event perception are unrelated to person perception or biological motion. The relation of these results to recent findings in infant object perception is discussed.     

The sensing of retinal motion

The apparent relative motion of physically stationary objects that frequently occurs as the head is moved in a frontoparallel plane is almost always in the direction expected from the projection into the distal world of the relative motion of the images on the eye. It is hypothesized that this is the result of the perceptual underestimation of the depth between the objects. If a perceptual overestimation of the depth were produced, it was predicted that the apparent relative motion would be in a direction opposite to that expected from the projection of the retinal motions. This prediction was tested using the binocular disparity cue to produce perceptual overestimation of the slant (depth) of a luminous line. In this case, perceived slant was the indicator of perceived depth, and perceived rotation concomitant with the motion of the head was the indicator of perceived relative motion. The results support the prediction and also provide some support for a theoretically derived equation specifying the relation between these two perceptual variables.     

The perception of object versus objectless motion

Wertheimer, M. (Zeitschrift für Psychologie und Physiologie der Sinnesorgane, 61:161–265, 1912) classical distinction between beta (object) and phi (objectless) motion is elaborated here in a series of experiments concerning competition between two qualitatively different motion percepts, induced by sequential changes in luminance for two-dimensional geometric objects composed of rectangular surfaces. One of these percepts is of spreading-luminance motion that continuously sweeps across the entire object; it exhibits shape invariance and is perceived most strongly for fast speeds. Significantly for the characterization of phi as objectless motion, the spreading luminance does not involve surface boundaries or any other feature; the percept is driven solely by spatiotemporal changes in luminance. Alternatively, and for relatively slow speeds, a discrete series of edge motions can be perceived in the direction opposite to spreading-luminance motion. Akin to beta motion, the edges appear to move through intermediate positions within the object’s changing surfaces. Significantly for the characterization of beta as object motion, edge motion exhibits shape dependence and is based on the detection of oppositely signed changes in contrast (i.e., counterchange) for features essential to the determination of an object’s shape, the boundaries separating its surfaces. These results are consistent with area MT neurons that differ with respect to speed preference Newsome et al (Journal of Neurophysiology, 55:1340–1351, 1986) and shape dependence Zeki (Journal of Physiology, 236:549–573, 1974).     

How do object reference frames and motion vector decomposition emerge in laminar cortical circuits?

How do spatially disjoint and ambiguous local motion signals in multiple directions generate coherent and unambiguous representations of object motion? Various motion percepts, starting with those of Duncker (Induced motion, 1929/1938) and Johansson (Configurations in event perception, 1950), obey a rule of vector decomposition, in which global motion appears to be subtracted from the true motion path of localized stimulus components, so that objects and their parts are seen as moving relative to a common reference frame. A neural model predicts how vector decomposition results from multiple-scale and multiple-depth interactions within and between the form- and motion-processing streams in V1–V2 and V1–MST, which include form grouping, form-to-motion capture, figure–ground separation, and object motion capture mechanisms. Particular advantages of the model are that these mechanisms solve the aperture problem, group spatially disjoint moving objects via illusory contours, capture object motion direction signals on real and illusory contours, and use interdepth directional inhibition to cause a vector decomposition, whereby the motion directions of a moving frame at a nearer depth suppress those directions at a farther depth, and thereby cause a peak shift in the perceived directions of object parts moving with respect to the frame.     

Consciousness mediated by neural transition states: How invisibly rapid motions can become visible

When observers view a rapidly moving stimulus they may see only a static streak. We report that there can be a transient percept of motion if such a moving stimulus is preceded or followed by a stationary image of that stimulus. A ring of dots was rotated so rapidly observers only saw a continuous outline circle and could not report its rotation direction. When an objectively stationary ring of dots preceded or followed this rotating ring, the stationary ring appeared to visibly launch into motion from a standstill or visibly rotate to a halt, principally in the same direction as the actual rapid rotation. Thus, motions too rapid to be consciously perceived as motion can nonetheless be processed by the visual system, and generate neural transition states that are consciously experienced as motion percepts. We suggest such transition states might serve a unifying function by bridging discontinuous motion states.     

Apparent depth with retinal image motion of expansion and contraction yoked to head movement

The two main questions addressed in this study were (a) what effect does yoking the relative expansion and contraction (EC) of retinal images to forward and backward head movements have on the resultant magnitude and stability of perceived depth, and (b) how does this relative EC image motion interact with the depth cues of motion parallax? Relative EC image motion was produced by moving a small CCD camera toward and away from the stimulus, two random-dot surfaces separated in depth, in synchrony with the observers' forward and backward head movements. Observers viewed the stimuli monocularly, on a helmet-mounted display, while moving their heads at various velocities, including zero velocity. The results showed that (a) the magnitude of perceived depth was smaller with smaller head velocities (< 10 cm s-1), including the zero-head-velocity condition, than with a larger velocity (10 cm s-1), and (b) perceived depth, when motion parallax and the EC image motion cues were simultaneously presented, is equal to the greater of the two possible perceived depths produced from either of these two cues alone. The results suggested the role of nonvisual information of self-motion on perceiving depth.     

Proximal velocity change as a determinant of space perception

How and to what degree does proximal velocity change determine perceived translatory motion in depth? This question was studied with a stimulus consisting of a single dot, moving in a straight horizontal path in a frontoparallel plane. Its motion corresponded to distai depth motion with constant speed. Ss reported verbally what they perceived. The results show that proximal velocity changes of this kind are, within certain limits, utilized by the visual system for the perception of translatory motion in depth. The limits were found to be determined by the absolute rate of change in proximal velocity. Further, it was found that the perceived motion track was usually bent, although all stimuli simulated depth motions along straight paths.     

What is the speed to transparent and kinetic-boundary displays?

To compare transparent motion and kinetic boundaries with unidirectional motion, in many studies the relative motion is generated by superimposing or adjoining unidirectional motions oriented in opposite directions. The presumption, tacitly underlying this comparison, is that the two oppositely directed velocities are independent of one another as far as their speed is concerned, i.e. the speed of the relative motion is presumed to be equivalent to the speed of the unidirectional components. Here we report that the relative motion between dots moving in opposite directions augments perceived speed. A constant-stimuli procedure was used to pair transparent-motion or kinetic-boundary displays with unidirectional motion, and human observers were asked to match the speed of the relative and unidirectional motions. The results show that transparency and kinetic boundaries increase the perceived visual speed by about 50%, compared with the speed of the individual components.     

Attentional modulation of self-motion perception

Attentional effects on self-motion perception (vection) were examined by using a large display in which vertical stripes containing upward or downward moving dots were interleaved to balance the total motion energy for the two directions. The dots moving in the same direction had the same colour, and subjects were asked to attend to one of the two colours. Vection was perceived in the direction opposite to that of non-attended motion. This indicates that non-attended visual motion dominates vection. The attentional effect was then compared with effects of relative depth. Clear attentional effects were again found when there was no relative depth between dots moving in opposite directions, but the effect of depth was much stronger for stimuli with a relative depth. Vection was mainly determined by motion in the far depth plane, although some attentional effects were evident even in this case. These results indicate that attentional modulation for vection exists, but that it is overridden when there is a relative depth between the two motion components.     

Dynamic, state-dependent thresholds for the perception of single-element apparent motion: Bistability from local cooperativity

Previous studies have indicated that the formation of coherent patterns for multielement motion displays depends onglobal cooperative interactions among large ensembles of spatially distributed motion detectors. These interactions enhance certain motion directions and suppress others. It is reported here that perceiving one element moving between two nearby locations likewise is subject to cooperative influences (possibly facilitating and inhibiting interactions within alocal ensemble of overlapping detectors). Thresholds depending on luminance contrast were measured for a generalized singleelement apparent-motion stimulus, and evidence for spontaneous switching and hysteresis effects indicated that motion perception near the 50% threshold was bistable. That is, for conditions in which motion and nonmotion were perceived half the time, the two percepts were distinct; when one was perceived, it clearly was discriminable from the other. These results indicated that (1) single-element apparent-motion thresholds depended on the immediately preceding state of the ensemble of motion detectors responding to the stimulus, and (2) the stimulus activation of individual motion detectors always might be influenced by recurrent, cooperative interactions resulting from the detectors’ being embedded within interconnected ensembles.     

Evocation and characterization of percepts of apparent motion on the face

The percepts evoked by sequential stimulation of sites in close spatial proximity (<2.5 cm) on the face were studied. Both method-of-limits and magnitude-estimation procedures were used to identify and characterize alterations in the percepts produced by systematic changes in the temporal and spatial parameters of the sequence. Each site was stimulated by a vertically oriented row of miniature vibrating probes. Apparent motion was consistently perceived when the delay between the onsets of sequentially activated rows (interstimulus onset interval, or ISOI) fell within a relatively narrow range of values, the lower limit of which approximated 5 msec. Both the upper limit and the perceived smoothness and continuity of the motion percepts (goodness of motion) increased with the duration for which each row stimulated the skin over the range evaluated, 15–185 msec. For the successive activation of only two rows, goodness of motion was not influenced by changes in their separation from 0.4 to 2.5 cm. The ISOI values at which magnitude estimates of goodness of motion were highest increased with the duration for which each row stimulated the skin. As such, maximum goodness of motion decreased with increases in the apparent velocity of motion. When the number of sequentially activated rows was increased from two to four or more, the quality of the motion percepts improved. For the successive activation of multiple closely spaced rows, values of ISOI at which numerical estimates of goodness of motion were highest approximated integral fractions of the duration for which each row stimulated the skin. In this situation, the probes rose and fell in a regular, step-locked rhythm to simulate an edge-like or rectangular object moving across the skin. The goodness of motion so attained was relatively independent of the apparent velocity of motion.     

Apparent extended body motions in depth.

Five experiments were designed to investigate the influence of three-dimensional (3-D) orientation change on apparent motion. Projections of an orientation-specific 3-D object were sequentially flashed in different locations and at different orientations. Such an occurrence could be resolved by perceiving a rotational motion in depth around an axis external to the object. Consistent with this proposal, it was found that observers perceived curved paths in depth. Although the magnitude of perceived trajectory curvature often fell short of that required for rotational motions in depth (3-D circularity), judgments of the slant of the virtual plane on which apparent motions occurred were quite close to the predictions of a model that proposes circular paths in depth.