The importance of velocity gradients in the perception of three-dimensional rigidity

Sequential presentation of a number of random-dot patterns which when super-imposed yield an expanding flow field leads to the perception of a coherent motion towards the observer. The motion vectors in this type of flow field all radiate from the origin. This percept of a global coherent expanding flow results only when the local speeds (magnitude of the local motion vectors) are zero at the centre and increase linearly towards the periphery. If all the dots radiate outwards but have the same speed, a clear percept of three-dimensional nonrigidity arises.     

The observer-relative velocity field as the basis for effective motion parallax

Earlier studies of motion parallax found unambiguous relative depth perception when random dot patterns were systematically translated in accordance with either motion of the observer's head or motion of the display scope. The need for such relative motion between an observer and a flow field was examined by placing a flow field in a limited area (window) in a large scope and translating the window relative to the observer. Accuracy in judging surface orientation and quantitative depth estimates were determined by the velocity field relative to the observer and were not measurably affected by whether this field was produced with a stationary or a moving window. Accuracy was consistently higher for smaller ratios of maximum to minimum projected velocities, reaching 100% in one experiment with a 1.12:1 ratio. We conclude that fully effective motion parallax does not require relative motion between the observer's head and the contours of a flow field.     

The utility of motion parallax information for the perception and control of heading

Two experiments in which participants were given control over the direction of computer-simulated self-motion were conducted. Environments were designed to evaluate the functionality of simple and multiple motion parallax as well as a separation ratio (sigma; indexing the separation of 2 objects in depth) for the perception and control of heading. Results provide a 1st indication of optimizing performance in the top end of the global optical flow velocity range available during human bipedal self-motion. The introduction of sigma, developed to explain performance improvements with decreasing distance to the target, was able to account for most of the performance differences among all simulated environments. The rate of change in horizontal optical separation between at least 2 discontinuities was identified as a likely candidate for the optical foundation of the perception and control of heading during target approach.     

The role of central and peripheral vision in perceiving the direction of self-motion.

Three experiments were performed to examine the role that central and peripheral vision play in the perception of the direction of translational self-motion, or heading, from optical flow. When the focus of radial outflow was in central vision, heading accuracy was slightly higher with central circular displays (10 degrees-25 degrees diameter) than with peripheral annular displays (40 degrees diameter), indicating that central vision is somewhat more sensitive to this information. Performance dropped rapidly as the eccentricity of the focus of outflow increased, indicating that the periphery does not accurately extract radial flow patterns. Together with recent research on vection and postural adjustments, these results contradict the peripheral dominance hypothesis that peripheral vision is specialized for perception of self-motion. We propose a functional sensitivity hypothesis--that self-motion is perceived on the basis of optical information rather than the retinal locus of stimulation, but that central and peripheral vision are differentially sensitive to the information characteristic of each retinal region.     

Necessity of spatial pooling for the perception of heading in nonrigid environments

This study examined whether the perception of heading is determined by spatially pooling velocity information. Observers were presented displays simulating observer motion through a volume of 3-D objects. To test the importance of spatial pooling, the authors systematically varied the nonrigidity of the flow field using two types of object motion: adding a unique rotation or translation to each object. Calculations of the signal-to-noise (observer velocity-to-object motion) ratio indicated no decrements in performance when the ratio was .39 for object rotation and .45 for object translation. Performance also increased with the number of objects in the scene. These results suggest that heading is determined by mechanisms that use spatial pooling over large regions.     

Disruption of eye movements by ethanol intoxication affects perception of depth from motion parallax

Motion parallax, the ability to recover depth from retinal motion generated by observer translation, is important for visual depth perception. Recent work indicates that the perception of depth from motion parallax relies on the slow eye movement system. It is well known that ethanol intoxication reduces the gain of this system, and this produces the horizontal gaze nystagmus that law enforcement's field sobriety test is intended to reveal. The current study demonstrates that because of its influence on the slow eye movement system, ethanol intoxication impairs the perception of depth from motion parallax. Thresholds in a motion parallax task were significantly increased by acute ethanol intoxication, whereas thresholds for an identical test relying on binocular disparity were unaffected. Perhaps a failure of motion parallax plays a role in alcohol-related driving accidents; because of the effects of alcohol on eye movements, intoxicated drivers may have inaccurate or inadequate information for judging the relative depth of obstacles from motion parallax.     

Retinal flow is sufficient for steering during observer rotation

How do people control locomotion while their eyes are simultaneously rotating? A previous study found that during simulated rotation, they can perceive a straight path of self-motion from the retinal flow pattern, despite conflicting extraretinal information, on the basis of dense motion parallax and reference objects. Here we report that the same information is sufficient for active control ofjoystick steering. Participants steered toward a target in displays that simulated a pursuit eye movement. Steering was highly inaccurate with a textured ground plane (motion parallax alone), but quite accurate when an array of posts was added (motion parallax plus reference objects). This result is consistent with the theory that instantaneous heading is determined from motion parallax, and the path of self-motion is determined by updating heading relative to environmental objects. Retinal flow is thus sufficient for both perceiving self-motion and controlling self-motion with a joystick; extraretinal and positional information can also contribute, but are not necessary.     

Perception of circular heading from optical flow

Observers viewed random-dot optical flow displays that simulated self-motion on a circular path and judged whether they would pass to the right or left of a target at 16 m. Two dots in two frames are theoretically sufficient to specify circular heading if the orientation of the rotation axis is known. Heading accuracies were better than 1.5 degrees with a ground surface, wall surface, and 3D cloud of dots, and were constant over densities down to 2 dots, consistent with the theory. However, there was an inverse relation between the radius of the observer's path and constant heading error, such that at small radii observers reported heading 3 degrees to the outside of the actual path with the ground and to the inside with the wall and cloud. This may be an artifact of a small display screen.     

Dynamic occlusion and motion parallax in depth perception

Random-dot techniques were used to examine the interactions between the depth cues of dynamic occlusion and motion parallax in the perception of three-dimensional (3-D) structures, in two different situations: (a) when an observer moved laterally with respect to a rigid 3-D structure, and (b) when surfaces at different distances moved with respect to a stationary observer. In condition (a), the extent of accretion/deletion (dynamic occlusion) and the amount of relative motion (motion parallax) were both linked to the motion of the observer. When the two cues specified opposite, and therefore contradictory, depth orders, the perceived order in depth of the simulated surfaces was dependent on the magnitude of the depth separation. For small depth separations, motion parallax determined the perceived order, whereas for large separations it was determined by dynamic occlusion. In condition (b), where the motion parallax cues for depth order were inherently ambiguous, depth order was determined principally by the unambiguous occlusion information.     

Perceiving curvilinear heading in the presence of moving objects

Four experiments were directed at understanding the influence of multiple moving objects on curvilinear (i.e., circular and elliptical) heading perception. Displays simulated observer movement over a ground plane in the presence of moving objects depicted as transparent, opaque, or black cubes. Objects either moved parallel to or intersected the observer's path and either retreated from or approached the moving observer. Heading judgments were accurate and consistent across all conditions. The significance of these results for computational models of heading perception and for information in the global optic flow field about observer and object motion is discussed.     

Dynamic Occlusion and Optical Flow From Corrugated Surfaces

Dynamic occlusion (i.e., accretion and deletion of optical texture at the occluding edge) can occur under many different environmental conditions, for example, objects hidden behind other objects when viewed by a moving observer, objects moving in front of other objects, or an observer approaching a brink. Because each of these conditions may require the actor to respond differently, the actor may need to be able to differentiate these situations reliably. This study was directed at the optical pattern induced by dynamic occlusion that occurs when one locomotes over a rolling terrain (i.e., a corrugated surface). Two experiments were conducted for this purpose. Participants viewed displays simulating their translation along a corrugated surface in which surface corrugation, texture type, and texture density varied as part of experimental control. Results demonstrated that the visual system reliably extracts the global flow pattern for accurate perception of heading direction despite the presence of optical disturbances in optical flow. However, performance nearly failed in the unstructured texture displays wherein optical disturbances were less salient. Still, the results provide strong evidence that human observers are sufficiently sensitive to dynamic occlusion to extract information about heading direction.     

Software for the generation and display of random-dot cinematograms on the Macintosh computer

The software packageDotMovie 1.3.8 was designed to create and display dynamic random-dot cinematograms for studies of motion perception on Macintosh II microcomputers. In each frame of the cinematogram, some dots move in random uncorrelated directions, while other dots move with constant speed in one direction. As the relative number of dots moving in a correlated direction increases, the observer sees flow in the direction of the movement. The software described facilitates the creation of random-dot cinematograms, their presentation, and collection of data from subjects’ responses.     

Heading backward: Perceived direction of movement in contracting and expanding optical flow fields

Two goals were pursued in an investigation of possible visual sources for directionality judgments of ego-motion. First, J. J. Gibson’s (1950) global radial outflow hypothesis was contrasted with a simple extrapolation strategy. Second, backing-direction judgments capitalizing on the informational equivalence of global radial outflow created during forward ego-motion and global radial inflow during backward ego-motion were explored. In comparing the accuracy of heading and backing judgments, new insights about global flow and extrapolation strategies were found. Consistent with the hypothesis of an extrapolation strategy, Experiment 1 demonstrated that backing judgments were more accurate than heading judgments when linear observer motion was simulated by means of a point-light flow field. In this case, accuracy was higher with two-point-light displays (extrapolation) than with more complex displays (global flow). Experiment 2 showed that in cases where extrapolation was not possible, such as circular motion, no advantage of backing judgments could be found and judgments were generally less accurate. We conclude that, whenever possible, observers use extrapolation to determine their heading/backing. Only when global flow is the only good source of information do they rely on it.     

Active heading control in simulated flight based on vertically extended contours

In two experiments, we manipulated the properties of 3-D objects and terrain texture in order to investigate their effects on active heading control during simulated flight. Simulated crosswinds were used to introduce a rotational component into the retinal flow field that presumably provided the visual cues used for heading control An active control task was used so that the results could be generalized to real-world applications such as flight simulation. In Experiment 1, we examined the effects of three types of terrain, each of which was presented with and without 3-D objects (trees), and found that the presence of 3-D objects was more important than terrain texture for precise heading control In Experiment 2, we investigated the effects of varying the height and density of 3-D objects and found that increasing 3-D object density improved heading control, but that 3-D object height had only a small effect. On the basis of these results, we conclude that the vertical contours improved active heading control by enhancing the motion parallax information contained in the retinal flow.     

The role of central and peripheral vision in perceiving the direction of self-motion

Three experiments were performed to examine the role that central and peripheral vision play in the perception of the direction of translational self-motion, or heading, from optical flow. When the focus of radial outflow was in central vision, heading accuracy was slightly higher with central circular displays (10°–25° diameter) than with peripheral annular displays (40° diameter), indicating that central vision is somewhat more sensitive to this information. Performance dropped rapidly as the eccentricity of the focus of outflow increased, indicating that the periphery does not accurately extract radial flow patterns. Together with recent research on vection and postural adjustments, these results contradict theperipheral dominance hypothesis that peripheral vision is specialized for perception of self-motion. We propose afunctional sensitivity hypothesis—that. self-motion is perceived on the basis of optical information rather than the retinal locus of stimulation, but that central and peripheral vision are differentially sensitive to the information characteristic of each retinal region.     

Induced self-motion in central vision

Previous research on visually induced self-motion found that stimulation of the central visual field (up to 30 degrees in diameter) results in perceived object motion while self-motion requires peripheral stimulation. In the present study, perceived self-motion was induced with a radially expanding pattern simulating observer motion through a space filled with dots, with visual angles of 7.5 degrees, 10.6 degrees, 15 degrees, and 21.2 degrees. Speed and texture density were also varied. The duration of reported self-motion (a) decreased with increased speed, (b) failed to increase with increased visual angle, and (c) decreased with visual angle at the highest speed level. In a second experiment, subjects rated the perceived depth of the displays. The speed and speed/area interaction effects on judged depth matched those found for induced self-motion. These results suggest an extension of the focal/ambient theory: In addition to a more primitive ambient processing mode that requires peripheral vision, there is a higher level system concerned with ambient processing that functions in the central visual field and uses more complex stimulus information, such as internal depth represented in a radially expanding pattern.     

Depth perception as a function of motion parallax and absolute-distance information

The results of three experiments demonstrated that the visual system calibrates motion parallax according to absolute-distance information in processing depth. The parallax was created by yoking the relative movement of random dots displayed on a cathode-ray tube to the movements of the head. In Experiment 1, at viewing distances of 40 cm and 80 cm, observers reported the apparent depth produced by motion parallax equivalent to a binocular disparity of 0.47 degree. The mean apparent depth at 80 cm was 2.6 times larger than at 40 cm. In Experiment 2, again at viewing distances of 40 cm and 80 cm, observers adjusted the extent of parallax so that the apparent depth was 7.0 cm. The mean extent of parallax at 80 cm was 31% of that at 40 cm. In Experiment 3, distances ranged from 40 cm to 320 cm, and a wide range of parallax was used. As distance and parallax increased, the perception of a rigid three-dimensional surface was accompanied by rocking motion; perception of depth was replaced by perception of motion in some trials at 320 cm. Moreover, the mean apparent depths were proportional to the viewing distance at 40 cm and 80 cm but not at 160 cm and 320 cm.     

Role of optical flow field asymmetry in the perception of heading during linear motion

During linear translation through a stationary environment, the pattern of optical flow generated on each retina is symmetrical when the head is aligned with the heading, but during lateral gaze the optical flow is asymmetric. We assessed whether human subjects could use the magnitude of this asymmetry to determine the direction of heading during passive translation through a 3-D environment. When allowed to move their heads in order to look in the direction of self-motion, subjects indicated their heading precisely and accurately. When the head was locked in alignment with the misaligned body, and gaze adjustments were not allowed, responses were quite precise, but showed a large bias which increased with increasing heading angle.     

Perceiving heading with different retinal regions and types of optic flow

We examined the ability to use optic flow to judge heading when different parts of the retina are stimulated and when the specified heading is in different directions relative to the display. To do so, we manipulated retinal eccentricity (the angle between the fovea and the center of the stimulus) and heading eccentricity (the angle between the specified heading and the center of the stimulus) independently. Observers viewed two sequences of moving dots that simulated translation through a random cloud of dots. They reported whether the direction of translation—the heading—in the second sequence was to the left or right of the direction in the first sequence. The results revealed a large and consistent effect of heading eccentricity: Judgments were much more accurate with radial flow fields (small heading eccentricities) than with lamellar fields (large heading eccentricities), regardless of the part of the retina being stimulated. The results also revealeda smaller and less consistent effect of retinal eccentricity: With radial flow (small heading eccentricities), judgments were more accurate when the stimulus was presented near the fovea. The variation of heading thresholds from radial to lamellar flow fields is predicted by a simple model of two-dimensional motion discrimination. The fact that the predictions are accurate implies that the human visual system is equally efficient at processing radial and lamellar flow fields. In addition, efficiency is reasonably constant no matter what part of the retina is being stimulated.     

Perceiving circular heading in noncanonical flow fields

Five experiments examined circular heading perception with optical flows that departed from the canonical form. Noncanonicity was achieved through nonrigidity of the environment (Experiments 1 and 2), oscillations of the point of observation (Experiment 3), and the bending of light (Experiments 4 and 5). In Experiments 1 and 2, perception was impaired more by nonrigidity of the ground plane than by nonrigidity of the medium. In Experiment 3, perception was unimpaired by noncanonical flows induced by the bounce and sway of observer locomotion. In Experiments 4 and 5, perception was not impaired when light paths were distorted by a spherical projection, but perception was impaired when they were distorted by a sine function. Results are discussed in relation to the hypothesis that the information for perceiving heading is the ordinal pattern of optical flow.