Motion parallax judgements of depth as a function of the direction and type of head movement

We compared the relative effectiveness of rotating or translating the head, either horizontally or vertically, on the perception of depth resulting from motion parallax. Using Rogers and Graham's (1979) paradigm, we yoked the movement of random dots on a screen to movements of the head, simulating a corrugated surface. In two experiments, subjects nulled the apparent depth or motion seen in the display. Horizontal head movements yielded the most precise depth judgements, irrespective of whether the head translated or rotated. Motion thresholds were higher than those for depth and were independent of direction of head movement. In a third experiment, suprathreshold stimuli that simulated differing amounts of depth were used, and the subjects' perception of depth was virtually the same for all types and directions of head movement. In our stimulus situation, rotating or translating the head either vertically or horizontally produced motion parallax cues for depth that were equally effective. Our results also showed that, within a range, retinal image motion from head movement is converted into a depth signal and that above that range location constancy breaks down and motion is seen.     

Simulated angular head oscillation enhances vection in depth

Research has shown that adding simulated linear head oscillation to radial optic flow displays enhances the illusion of self-motion in depth (ie linear vection). We examined whether this oscillation advantage for vection was due to either the added motion parallax or retinal slip generated by insufficient compensatory eye movement during display oscillation. We constructed radial flow displays which simulated 1 Hz horizontal linear head oscillation (generates motion parallax) or angular head oscillation in yaw (generates no motion parallax). We found that adding simulated angular or linear head oscillation to radial flow increased the strength of linear vection in depth. Neither type of simulated head oscillation significantly reduced vection onset latencies relative to pure radial flow. Simultaneous eye-movement recordings showed that slow-phase ocular following responses (OFRs) were induced in both linear and angular viewpoint oscillation conditions. Vection strength was significantly reduced by active central fixation when viewing displays which simulated angular, but not linear, head oscillation. When these displays with angular oscillation were viewed without stable fixation, vection strength was found to increase with the velocity and regularity of the OFR. We conclude that vection improvements observed during central viewing of displays with angular viewpoint oscillation depend on the generation of eye movements.     

Motion parallax driven by head movements: conditions for visual stability, perceived depth, and perceived concomitant motion

Yoking the movement of the stimulus on the screen to the movement of the head, we examined visual stability and depth perception as a function of head-movement velocity and parallax. In experiment 1, for different head velocities, observers adjusted the parallax to find (a) the depth threshold and (b) the concomitant-motion threshold. Between these thresholds, depth was seen with no perceived motion. In experiment 2, for different head velocities, observers adjusted the parallax to produce the same perceived depth. A slower head movement required a greater parallax to produce the same perceived depth as faster head movements. In experiment 3, observers reported the perceived depth for different parallax magnitudes. Perceived depth covaried with smaller parallax without motion perception, but began to decrease with larger parallax and concomitant motion was seen. Only motion was seen with the larger parallax.     

Absolute motion parallax and the specific distance tendency

In the absence of definitive cues’to distance, the perceived distance of an object will be in error in the direction of the object appearing at a distance of about 2 m from O. This tendency to perceive an object at a relatively near distance is termed the specific distance tendency (Gogel. 1969). Also, it has been found that an error in perceiving the distance of an object will result in an apparent movement of the object when the head is moved (Hay & Sawyer. 1969; Wallach, Yablick. & Smith. 1972). From these two results, it was expected that the direction of trie apparent movement of a stationary point of light resulting from head movement would vary predictably as a function of the physical distance of the point of light from O. This expectation was confirmed in an experiment in which both the perceived motion and perceived distance of the point of light were measured. The consequences of the study for the role of motion parallax in the perception of distance and for the reafference principle in the perception of object motion with head motion are discussed     

Additivity of retinal and pursuit velocity in the perceptions of depth and rigidity from object-produced motion parallax

Two psychophysical experiments were conducted to investigate the mechanism that generates stable depth structure from retinal motion combined with extraretinal signals from pursuit eye movements. Stimuli consisted of random dots that moved horizontally in one direction (ie stimuli had common motion on the retina), but at different speeds between adjacent rows. The stimuli were presented with different speeds of pursuit eye movements whose direction was opposite to that of the common retinal motion. Experiment 1 showed that the rows moving faster on the retina appeared closer when viewed without eye movements; however, they appeared farther when pursuit speed exceeded the speed of common retinal motion. The 'transition' speed of the pursuit eye movement was slightly, but consistently, larger than the speed of common retinal motion. Experiment 2 showed that parallax thresholds for perceiving relative motion between adjacent rows were minimum at the transition speed found in experiment 1. These results suggest that the visual system calculates head-centric velocity, by adding retinal velocity and pursuit velocity, to obtain a stable depth structure.     

Constancy and illusion of apparent direction of rotary motion in depth: Tests of a theory

An explanation of apparent direction of rotary motion in depth derived from a general theory of perceptual constancy and illusion is proposed with experimental data in its support. Apparent direction of movement is conceived of as exhibiting-perceptual constancy or illusion as a function of apparent direction of orientation m depth for plane objects and apparent relative depth for three-dimensional objects. Apparent reversals of movement direction represent either regular fluctuations between constancy and illusion of direction as a function of valid and invalid stimuli for orientation, or irregular and random fluctuations in their absence. In three preliminary experiments, the apparent movement direction of plane ellipses was investigated as a function of surface pattern information for orientation, and in Experiment I apparent reversals during 20-revolution trials were studied. In Experiment II, apparent movement direction of 3D elliptical V shapes as a function of surface pattern information for relative depth was investigated. In addition to supporting the explanation proposed, the data offer a resolution of a conflict between different theories of apparent reversal of motion in depth.     

An acceleration illusion caused by underestimation of stimulus velocity during pursuit eye movements: Aubert-Fleischl revisited

When the eyes pursue a fixation point that sweeps across a moving background pattern, and the fixation point is suddenly made to stop, the ongoing motion of the background pattern seems to accelerate to a higher velocity. Experiment I showed that this acceleration illusion is not caused by the sudden change in (i) the relative velocity between background and fixation point, (ii) the velocity of the retinal image of the background pattern, or (iii) the motion of the retinal image of the rims of the CRT screen on which the experiment was carried out. In experiment II the magnitude of the illusion was quantified. It is strongest when background and eyes move in the same direction. When they move in opposite directions it becomes less pronounced (and may disappear) with higher background velocities. The findings are explained in terms of a model proposed by the first author, in which the perception of object motion and velocity derives from the interaction between retinal slip velocity information and the brain's 'estimate' of eye velocity in space. They illustrate that the classic Aubert-Fleischl phenomenon (a stimulus seems to be moving slower when pursued with the eyes than when moving in front of stationary eyes) is a special case of a more general phenomenon: whenever we make a pursuit eye movement we underestimate the velocity of all stimuli in our visual field which happen to move in the same direction as our eyes, or which move slowly in the direction opposite to our eyes.     

Depth perception as a function of motion parallax and absolute-distance information

The results of three experiments demonstrated that the visual system calibrates motion parallax according to absolute-distance information in processing depth. The parallax was created by yoking the relative movement of random dots displayed on a cathode-ray tube to the movements of the head. In Experiment 1, at viewing distances of 40 cm and 80 cm, observers reported the apparent depth produced by motion parallax equivalent to a binocular disparity of 0.47 degree. The mean apparent depth at 80 cm was 2.6 times larger than at 40 cm. In Experiment 2, again at viewing distances of 40 cm and 80 cm, observers adjusted the extent of parallax so that the apparent depth was 7.0 cm. The mean extent of parallax at 80 cm was 31% of that at 40 cm. In Experiment 3, distances ranged from 40 cm to 320 cm, and a wide range of parallax was used. As distance and parallax increased, the perception of a rigid three-dimensional surface was accompanied by rocking motion; perception of depth was replaced by perception of motion in some trials at 320 cm. Moreover, the mean apparent depths were proportional to the viewing distance at 40 cm and 80 cm but not at 160 cm and 320 cm.     

Apparent depth with retinal image motion of expansion and contraction yoked to head movement

The two main questions addressed in this study were (a) what effect does yoking the relative expansion and contraction (EC) of retinal images to forward and backward head movements have on the resultant magnitude and stability of perceived depth, and (b) how does this relative EC image motion interact with the depth cues of motion parallax? Relative EC image motion was produced by moving a small CCD camera toward and away from the stimulus, two random-dot surfaces separated in depth, in synchrony with the observers' forward and backward head movements. Observers viewed the stimuli monocularly, on a helmet-mounted display, while moving their heads at various velocities, including zero velocity. The results showed that (a) the magnitude of perceived depth was smaller with smaller head velocities (< 10 cm s-1), including the zero-head-velocity condition, than with a larger velocity (10 cm s-1), and (b) perceived depth, when motion parallax and the EC image motion cues were simultaneously presented, is equal to the greater of the two possible perceived depths produced from either of these two cues alone. The results suggested the role of nonvisual information of self-motion on perceiving depth.     

Disruption of eye movements by ethanol intoxication affects perception of depth from motion parallax

Motion parallax, the ability to recover depth from retinal motion generated by observer translation, is important for visual depth perception. Recent work indicates that the perception of depth from motion parallax relies on the slow eye movement system. It is well known that ethanol intoxication reduces the gain of this system, and this produces the horizontal gaze nystagmus that law enforcement's field sobriety test is intended to reveal. The current study demonstrates that because of its influence on the slow eye movement system, ethanol intoxication impairs the perception of depth from motion parallax. Thresholds in a motion parallax task were significantly increased by acute ethanol intoxication, whereas thresholds for an identical test relying on binocular disparity were unaffected. Perhaps a failure of motion parallax plays a role in alcohol-related driving accidents; because of the effects of alcohol on eye movements, intoxicated drivers may have inaccurate or inadequate information for judging the relative depth of obstacles from motion parallax.     

Performance and presence with head-movement produced motion parallax in simulated driving

Driving simulator studies can reveal relevant and valid aspects of driving behavior, but underestimation of distance and speed can negatively affect the driver’s performance, such as in performance of overtaking. One possible explanation for the underestimation of distance and speed is that two-dimensional projection of the visual scene disrupts the monocular-based illusory depth because of conflicting binocular and monocular information of depth. A possible solution might involve the strengthening of the monocular information so that the binocular information becomes less potent. In the present study, we used an advanced high-fidelity driving simulator to investigate whether adding the visual depth information of motion parallax from head movement affects sense of presence, judgment of distance and speed, and performance measures coupled with overtaking. The simulations included two types of driving scenario in which one was urban and the other was rural. The main results show no effect of this head-movement produced motion parallax on sense of presence, head movement, time to collision, distance judgment, or speed judgment. However, the results show an effect on lateral positioning. When initiating the overtaking maneuver there is a lateral positioning farther away from the road center as effect of the motion parallax in both types of scenario, which can be interpreted as indicating use of naturally occurring information that change behavior at overtaking. Nevertheless, only showing tendencies of effects, absent is any clear additional impact of this motion parallax in the simulated driving.     

Motion aftereffects and retinal motion

Two experiments are described in which it was investigated whether the adaptation on which motion aftereffects (MAEs) are based is a response to retinal image motion alone or to the motion signal derived from the process which combines the image motion signal with information about eye movement (corollary discharge). In both experiments observers either fixated a stationary point or tracked a vertically moving point while a pattern (in experiment 1, a grating; in experiment 2, a random-dot pattern) drifted horizontally across the field. In the tracking condition the adapting retinal motion was oblique. In the fixation condition it was horizontal. In every case in both conditions the MAE was horizontal, in the direction opposite to that of pattern motion. These results are consistent with the hypothesis that the adaptation is a response to the motion signal derived from the comparison of eye and image motion rather than to retinal motion per se. An alternative explanation is discussed.     

Detectability of motion as a factor in depth perception by monocular movement parallax

A display of two objects at different distances was presented to 10 observers, who were requested in two experiments to match the width of the more distant (comparison) object to the width of the nearer (standard) one under conditions permitting monocular observation and lateral head motion. The matched width of the comparison object was considered a measure of the effectiveness of movement parallax. The effectiveness of movement parallax decreases with increasing angular separation of the objects and with increasing background distance. A background without visible texture leads to a better perception of depth between two objects than a textured background The results can be explained by postulating that, whenever the detectability of motion is enhanced, i.e., the threshold for the detection of motion is lowered, the effectiveness of movement parallax as a cue to depth is increased.     

Effect of visual surrounding motion on body sway in a three-dimensional environment

Unidirectional motion of a uniplanar background induces a codirectional postural sway. It has been shown recently that fixation of a stationary foreground object induces a sway response in the opposite direction (Bronstein & Buckwell, 1997) when the background moves transiently. The present study investigated factors determining this contradirectional postural response. In the experiments presented, center of foot pressure and head displacements were recorded from normal subjects. The subjects faced a visual background of 2 x 3 m, at a distance of 1.5 m, which could be moved parallel to the interaural axis. Results showed that when the visual scene consisted solely of a moving background, the conventional codirectional postural response was elicited. When subjects were asked to fixate an earth-fixed foreground (window frame) placed between them and the moving background, a consistent postural response in the opposite direction to background motion was observed. In addition, we showed that this contradirectional postural response was not transient but was sustained for the 11 sec of background motion. We investigated whether this contradirectional postural response was the consequence of the induced movement of the foreground by background motion. Although induced movement was verbally reported by subjects when viewing an earth-fixed target projected onto the moving background, the contradirectional sway did not occur. These results indicate that foreground-background separation in depth was necessary for the contradirectional postural response to occur rather than induced movement. Another experiment showed that, when the fixated foreground was attached to the head of the observer, the contradirectional sway was not observed and was therefore unrelated to vergence. Finally, results showed that the contradirectional postural response was, in the main, monocularly mediated. We conclude that the direction of the postural sway produced by a moving background in a three-dimensional environment is determined primarily by motion parallax.     

The sensing of retinal motion

The apparent relative motion of physically stationary objects that frequently occurs as the head is moved in a frontoparallel plane is almost always in the direction expected from the projection into the distal world of the relative motion of the images on the eye. It is hypothesized that this is the result of the perceptual underestimation of the depth between the objects. If a perceptual overestimation of the depth were produced, it was predicted that the apparent relative motion would be in a direction opposite to that expected from the projection of the retinal motions. This prediction was tested using the binocular disparity cue to produce perceptual overestimation of the slant (depth) of a luminous line. In this case, perceived slant was the indicator of perceived depth, and perceived rotation concomitant with the motion of the head was the indicator of perceived relative motion. The results support the prediction and also provide some support for a theoretically derived equation specifying the relation between these two perceptual variables.     

Perceptual depth synthesis in the visual system as revealed by selective adaptation

Selective adaptations was used to determine the degree of interactions between channels processing relative depth from stereopsis, motion parallax, and texture. Monocular adaptations with motion parallax or binocular stationary adaptation caused test surfaces, viewed either stationary binocularly or monocularly with motion parallax, to appear to slant in the opposite direction compared with the slant initially adapted to. Monocular adaptations on frontoparallel surfaces covered with a pattern of texture gradients caused a subsequently viewed test surface, viewed either monocularly with motion parallax or stationary binocularly, to appear to slant in the opposite direction as the slant indicated by the texture in the adaptation condition. No aftereffect emerged in the monocular stationary test condition. A mechanism of independent channels for relative depth perception is dismissed in favor of a view of an asymmetrical interactive processing of different information sources. The results suggest asymmetrical inhibitory interactions among habituating slant detector units receiving inputs from static disparity, dynamic disparity, and texture gradients.     

The observer-relative velocity field as the basis for effective motion parallax

Earlier studies of motion parallax found unambiguous relative depth perception when random dot patterns were systematically translated in accordance with either motion of the observer's head or motion of the display scope. The need for such relative motion between an observer and a flow field was examined by placing a flow field in a limited area (window) in a large scope and translating the window relative to the observer. Accuracy in judging surface orientation and quantitative depth estimates were determined by the velocity field relative to the observer and were not measurably affected by whether this field was produced with a stationary or a moving window. Accuracy was consistently higher for smaller ratios of maximum to minimum projected velocities, reaching 100% in one experiment with a 1.12:1 ratio. We conclude that fully effective motion parallax does not require relative motion between the observer's head and the contours of a flow field.     

Surface discontinuity is critical in a moving observer's perception of objects' depth order and relative motion from retinal image motion.

The visual system perceptually decomposes retinal image motion into three basic components that are ecologically significant for the human observer: object depth, object motion, and self motion. Using this conceptual framework, we explored the relationship between them by examining perception of objects' depth order and relative motion during self motion. We found that the visual system obeyed what we call the parallax-sign constraint, but in different ways depending on whether the retinal image motion contained velocity discontinuity or not. When velocity discontinuity existed (e.g. in dynamic occlusion, transparent motion), the subject perceptually interpreted image motion as relative motion between surfaces with stable depth order. When velocity discontinuity did not exist, he/she perceived depth-order reversal but no relative motion. The results suggest that the existence of surface discontinuity or of multiple surfaces indexed by velocity discontinuity inhibits the reversal of global depth order.     

Retinal flow is sufficient for steering during observer rotation

How do people control locomotion while their eyes are simultaneously rotating? A previous study found that during simulated rotation, they can perceive a straight path of self-motion from the retinal flow pattern, despite conflicting extraretinal information, on the basis of dense motion parallax and reference objects. Here we report that the same information is sufficient for active control ofjoystick steering. Participants steered toward a target in displays that simulated a pursuit eye movement. Steering was highly inaccurate with a textured ground plane (motion parallax alone), but quite accurate when an array of posts was added (motion parallax plus reference objects). This result is consistent with the theory that instantaneous heading is determined from motion parallax, and the path of self-motion is determined by updating heading relative to environmental objects. Retinal flow is thus sufficient for both perceiving self-motion and controlling self-motion with a joystick; extraretinal and positional information can also contribute, but are not necessary.