Optical motions as information for unsigned depth

Optical motions and gradients of retinal flow have been assumed to be an important source of information for the perception of spatial layout. In the case of lateral parallax, however, the complicating effects of smooth eye movements on retinal flow fields and the known insensitivity of the visual system to absolute motion suggest that optical motions alone cannot provide the basis for accurate perception of the direction (sign) of depth relations. At most they can provide information for "unsigned" depth. Results of two experiments support the view that differential optical motions result in a strong impression of separation of objects in depth, but that the determination of near/far relations normally depends on other sources of information.     

The minimum principle and the perception of absolute,common, and relative motions

Wheel-generated motions have served as a touchstone for discussion of the perception of wholes and parts since the beginning of Gestalt psychology. The reason is that perceived common motions of the whole and the perceived relative motions of the parts are not obviously found in the absolute motion paths of points on a rolling wheel. In general, two types of theories have been proposed as to how common and relative motions are derived from absolute motions: one is that the common motions are extracted from the display first, leaving relative motions as the residual; the other is that relative motions are extracted first leaving common motions as the residual. A minimum principle can be used to defend both positions, but application of the principle seems contingent on the particular class of stimuli chosen. We propose a third view. It seems that there are at least two simultaneous processes—one for common motions and one for relative motions—involved in the perception of these and other stimuli and that a minimum principle is involved in both. However, for stimuli in many domains the minimization of relative motion dominates the perception. In general, we propose that any given stimulus can be organized to minimize the complexity of either its common motions or its relative motions; that which component is minimized depends on which of two processes reaches completion first (that for common or that for relative motions); and that the similarity of any two displays depends on whether common or relative motions are minimized.     

Apparent motion of stimuli presented stroboscopically during pursuit movement of the eye

This paper reports the first phase of a research program on visual perception of motion patterns characteristic of living organisms in locomotion. Such motion patterns in animals and men are termed here as biological motion. They are characterized by a far higher degree of complexity than the patterns of simple mechanical motions usually studied in our laboratories. In everyday perceptions, the visual information from biological motion and from the corresponding figurative contour patterns (the shape of the body) are intermingled. A method for studying information from the motion pattern per se without interference with the form aspect was devised. In short, the motion of the living body was represented by a few bright spots describing the motions of the main joints. It is found that 10–12 such elements in adequate motion combinations in proximal stimulus evoke a compelling impression of human walking, running, dancing, etc. The kinetic-geometric model for visual vector analysis originally developed in the study of perception of motion combinations of the mechanical type was applied to these biological motion patterns. The validity of this model in the present context was experimentally tested and the results turned out to be highly positive.     

生物运动信息加工模型

人类可以从生物体的各种运动行为中获得丰富的社会信息,以满足社会交往的需求。视觉系统对生物运动信息的加工是一个复杂的过程,不同于对其他普通客体的加工能力。研究者们采用不同的方法,分别从各自的角度来研究这一过程,同时也建立了一系列模型。其中早期模型关注视觉系统加工生物运动信息的过程和方法;近期模型则采用脑成像手段构建生物运动信息加工的神经网络。这些模型包含了很多有价值的研究成果,但是也存在需要进一步完善的地方。     

An oscillatory correlation model of visual motion analysis

We describe and evaluate a model of motion perception based on the integration of information from two parallel pathways: a motion pathway and a luminance pathway. The motion pathway has two stages. The first stage measures and pools local motion across the input animation sequence and assigns reliability indices to these pooled measurements. The second stage groups locations on the basis of these measurements. In the luminance pathway, the input scene is segmented into regions on the basis of similarities in luminance. In a subsequent integration stage, motion and luminance segments are combined to obtain the final estimates of object motion. The neural network architecture we employ is based on LEGION (locally excitatory globally inhibitory oscillator networks), a scheme for feature binding and region labeling based on oscillatory correlation. Many aspects of the model are implemented at the neural network level, whereas others are implemented at a more abstract level. We apply this model to the computation of moving, uniformly illuminated, two-dimensional surfaces that are either opaque or transparent. Model performance replicates a number of distinctive features of human motion perception.     

The experience of force: the role of haptic experience of forces in visual perception of object motion and interactions, mental simulation, and motion-related judgments

Forces are experienced in actions on objects. The mechanoreceptor system is stimulated by proximal forces in interactions with objects, and experiences of force occur in a context of information yielded by other sensory modalities, principally vision. These experiences are registered and stored as episodic traces in the brain. These stored representations are involved in generating visual impressions of forces and causality in object motion and interactions. Kinematic information provided by vision is matched to kinematic features of stored representations, and the information about forces and causality in those representations then forms part of the perceptual interpretation. I apply this account to the perception of interactions between objects and to motions of objects that do not have perceived external causes, in which motion tends to be perceptually interpreted as biological or internally caused. I also apply it to internal simulations of events involving mental imagery, such as mental rotation, trajectory extrapolation and judgment, visual memory for the location of moving objects, and the learning of perceptual judgments and motor skills. Simulations support more accurate judgments when they represent the underlying dynamics of the event simulated. Mechanoreception gives us whatever limited ability we have to perceive interactions and object motions in terms of forces and resistances; it supports our practical interventions on objects by enabling us to generate simulations that are guided by inferences about forces and resistances, and it helps us learn novel, visually based judgments about object behavior.     

Infants' haptic perception of object unity in rotating displays

Four-month-old infants were allowed to manipulate, without vision, two rings attached to a bar that permitted each ring to undergo rotary motion against a fixed surface. In different conditions, the relative motions of the rings were rigid, independent, or opposite, and they circled either the same fixed point outside the zone of manipulation or spatially separated points. Infants' perception of the ring assemblies were affected by the nature of the rotary motion in two ways. First, infants perceived a unitary object when the felt ends of the object underwent a common, rigid rotary motion; perception of object unity was stronger in this condition than when the ends underwent either independent or opposite rotary motions. Second, infants perceived two distinct objects when the felt ends of the objects underwent independent rotary motions that centred on distinct fixed points. Perception of the distinctness of the objects was less clear when the ends underwent opposite or independent rotary motions that centred on a common fixed point. These findings provide the first evidence that infants are sensitive to rotary motion patterns and can extrapolate a global pattern of rigid motion from the distinct, local velocities that they produce and experience at their two hands.     

Principles of Object Perception

Research on human infants has begun to shed light on early-developing processes for segmenting perceptual arrays into objects. Infants appear to perceive objects by analyzing three-dimensional surface arrangements and motions. Their perception does not accord with a general tendency to maximize figural goodness or to attend to nonaccidental geometric relations in visual arrays. Object perception does accord with principles governing the motions of material bodies: Infants divide perceptual arrays into units that move as connected wholes, that move separately from one another, that tend to maintain their size and shape over motion, and that tend to act upon each other only on contact. These findings suggest that o general representation of object unity and boundaries is interposed between representations of surfaces and representations of objects of familiar kinds. The processes that construct this representation may be related to processes of physical reasoning.     

Frequency, phase, and colour coding in apparent motion.

We present some results which indicate that the known spatiotemporal limits for apparent motion are consistent with the motion being sinusoidal or a result of filtering. Given this we investigated how two such motions interact as a function of their relative temporal phase differences. This was accomplished by inducing two independent motions from complementary coloured event pairs. Results indicated critical phase limits for perceiving the two motions (red and green) which were consistent with the frequency specificity of the effect. The results are discussed within the framework of a filtering process for the perception of apparent motion.     

Differential activation solution to the motion correspondence problem

The correspondence problem arises in motion perception when more than one motion path is possible for discontinuously presented visual elements. Ullman's (1979) "minimal mapping" solution to the correspondence problem, for which costs are assigned to competing motion paths on the basis of element affinities (e.g., greater affinity for elements that are closer together), is distinguished from a solution based on the differential activation of directionally selective motion detectors. The differential activation account was supported by evidence that path length affects detector activation in a paradignm for which motion correspondence is not a factor. Effects on detector activation in this paradigm also were the basis for the successful prediction of path luminance effects on solutions to the motion correspondence problem. Finally, the differential activation account was distinguished from minimal mapping theory by an experiment showing that the perception of an element moving simultaneously in two directions does not depend on whether the two motions are matched in path-length determined affinity; it is sufficient that the activation of detectors responding to each of the two motion directions is above the threshold level required for the motions to be perceived. Implications of the differential activation solution are discussed for the stability of perceived motions once they are established, and the adaptation of perceived and unperceived motions.     

Differential activation solution to the

The correspondence problem arises in motion perception when more than one motion path is possible for discontinuously presented visual elements. Ullman’s (1979) “minimal mapping” solution to the correspondence problem, for which costs are assigned to competing motion paths on the basis of element affinities (e.g., greater affinity for elements that are closer together), is distinguished from a solution based on the differential activation of directionally selective motion detectors. The differential activation account was supported by evidence that path length affects detector activation in a paradigm for which motion correspondence is not a factor. Effects on detector activation in this paradigm also were the basis for the successful prediction of path luminance effects on solutions to the motion correspondence problem. Finally, the differential activation account was distinguished from minimal mapping theory by an experiment showing that the perception of an element moving simultaneously in two directions does not depend on whether the two motions are matched in path-length determined affinity; it is sufficient that the activation of detectors responding to each of the two motion directions is above the threshold level required for the motions to be perceived. Implications of the differential activation solution are discussed for the stability of perceived motions once they are established, and the adaptation of perceived andunperceived motions.     

The influence of structure from motion on motion correspondence

The visual system has a remarkable ability to reconstruct 3-D structure from moving 2-D features. The processing of structure from motion is generally thought to consist of two stages. First, the direction and speed of features is measured (2-D velocity measurement) and, second, 3-D structure is reconstructed from the measured 2-D velocities (3-D structure recovery). Most models have assumed that these stages occur in a bottom-up fashion. Here, however, we present evidence that the 3-D structure-recovery stage influences the 2-D velocity-measurement stage. We developed a stimulus in which two perceptual modes of motion correspondence (one-way translation versus oscillation), and two perceptual modes of 3-D surface structure (flat surface versus cylinder) could be achieved. We found that the likelihood of perceiving both one-way motion and cylindrical structure increased in similar ways with increasing frame duration. In subsequent experiments we found, first, that a higher likelihood of perceiving one-way motion did not affect the likelihood of perceiving cylindrical structure; and, second, that a higher likelihood of perceiving cylindrical structure increased the likelihood of perceiving one-way motion. These results suggest that the higher, 3-D structure-recovery stage may influence the lower, 2-D motion-correspondence stage. This result is not in accordance with most computational models that assume that there is only one-way, feedforward information processing from the 2-D velocity (energy)-measurement stage to the 3-D structure-recovery stage. Perhaps, one of the roles of feedback processing is to seek consensus of the information processed in different stages.     

Can you see me in the snow? Action simulation aids the detection of visually degraded human motion

Using a novel paradigm, we demonstrate that action simulation can directly facilitate ongoing perception of people's movements. Point-light actors (PLAs) representing common human motions were shown embedded in a visual noise reminiscent of "TV snow". At first, the PLAs were perceived clearly, then occluded from view for a short duration, during which it was hypothesized that a real-time action simulation was generated tracking the motion's course. The PLA then reappeared in motion at variable visibility against the noise, whilst detection thresholds for the reappearance were measured. In the crucial manipulation, the test motion was either temporally congruent with the motion as it would have continued during occlusion, and thus temporally matching the simulation, or temporally incongruent. Detection thresholds were lower for congruent than for incongruent reappearing motions, suggesting that reappearing motion that temporally matched the internal action simulation was more likely to be detected.     

Implied motion language can influence visual spatial memory

How do language and vision interact? Specifically, what impact can language have on visual processing, especially related to spatial memory? What are typically considered errors in visual processing, such as remembering the location of an object to be farther along its motion trajectory than it actually is, can be explained as perceptual achievements that are driven by our ability to anticipate future events. In two experiments, we tested whether the prior presentation of motion language influences visual spatial memory in ways that afford greater perceptual prediction. Experiment 1 showed that motion language influenced judgments for the spatial memory of an object beyond the known effects of implied motion present in the image itself. Experiment 2 replicated this finding. Our findings support a theory of perception as prediction.     

Audiovisual phenomenal causality

We report three experiments in which visual or audiovisual displays depicted a surface (target) set into motion shortly after one or more events occurred. A visual motion was used as an initial event, followed directly either by the target motion or by one of three marker events: a collision sound, a blink of the target stimulus, or the blink together with the sound. The delay between the initial event and the onset of the target motion was varied systematically. The subjects had to rate the degree of perceived causality between these events. The results of the first experiment showed a systematic decline of causality judgments with an increasing time delay. Causality judgments increased when additional auditory or visual information marked the onset of the target motion. Visual blinks of the target and auditory clacks produced similar causality judgments. The second experiment tested several models of audiovisual causal processing by varying the position of the sound within the visual delay period. No systematic effect of the sound position occurred. The third experiment showed a subjective shortening of delays filled by a clack sound, as compared with unfilled delays. However, this shortening cannot fully explain the increased tolerance for delays containing the clack sound. Taken together, the results are consistent with the interpretation that the main source of the causality judgments in our experiments is the impression of a plausible unitary event and that perfect synchrony is not necessary in this case.     

A study of kinematic cues and anticipatory performance in tennis using computational manipulation and computer graphics

Computer graphics of digital human models can be used to display human motions as visual stimuli. This study presents our technique for manipulating human motion with a forward kinematics calculation without violating anatomical constraints. A motion modulation of the upper extremity was conducted by proportionally modulating the anatomical joint angular velocity calculated by motion analysis. The effect of this manipulation was examined in a tennis situation--that is, the receiver's performance of predicting ball direction when viewing a digital model of the server's motion derived by modulating the angular velocities of the forearm or that of the elbow during the forward swing. The results showed that the faster the server's forearm pronated, the more the receiver's anticipation of the ball direction tended to the left side of the serve box. In contrast, the faster the server's elbow extended, the more the receiver's anticipation of the ball direction tended to the right. This suggests that tennis players are sensitive to the motion modulation of their opponent's racket-arm.     

What is the speed to transparent and kinetic-boundary displays?

To compare transparent motion and kinetic boundaries with unidirectional motion, in many studies the relative motion is generated by superimposing or adjoining unidirectional motions oriented in opposite directions. The presumption, tacitly underlying this comparison, is that the two oppositely directed velocities are independent of one another as far as their speed is concerned, i.e. the speed of the relative motion is presumed to be equivalent to the speed of the unidirectional components. Here we report that the relative motion between dots moving in opposite directions augments perceived speed. A constant-stimuli procedure was used to pair transparent-motion or kinetic-boundary displays with unidirectional motion, and human observers were asked to match the speed of the relative and unidirectional motions. The results show that transparency and kinetic boundaries increase the perceived visual speed by about 50%, compared with the speed of the individual components.     

Stream/bounce perception and the effect of depth cues in chimpanzees (Pan troglodytes)

The stream/bounce display represents an ambiguous motion event in which two identical visual objects move toward one another and the objects overlap completely before they pass each another. In our perception, they can be interpreted as either streaming past one another or bouncing off each other. Previous studies have shown that the streaming percept of the display is generic for humans, suggesting the inertial nature of the motion integration process. In this study, chimpanzees took part in behavioral experiments using an object-tracking task to reveal the characteristics of their stream/bounce perception. Chimpanzees did not show a tendency toward a dominant "stream" perception of the stream/bounce stimulus. However, depth cues, such as X-junctions and local motion coherence, did promote the stream percept in chimpanzees. These results suggest both similarities and differences between chimpanzees and humans with respect to motion integration and object individuation processes.     

Can you see me in the snow? Action simulation aids the detection of visually degraded human motion

Using a novel paradigm, we demonstrate that action simulation can directly facilitate ongoing perception of people's movements. Point-light actors (PLAs) representing common human motions were shown embedded in a visual noise reminiscent of “TV snow”. At first, the PLAs were perceived clearly, then occluded from view for a short duration, during which it was hypothesized that a real-time action simulation was generated tracking the motion's course. The PLA then reappeared in motion at variable visibility against the noise, whilst detection thresholds for the reappearance were measured. In the crucial manipulation, the test motion was either temporally congruent with the motion as it would have continued during occlusion, and thus temporally matching the simulation, or temporally incongruent. Detection thresholds were lower for congruent than for incongruent reappearing motions, suggesting that reappearing motion that temporally matched the internal action simulation was more likely to be detected.     

Visually guided capture of a moving stimulus by the pigeon (Columba livia)

Although the pigeon is a popular model for studying visual perception, relatively little is known about its perception of motion. Three experiments examined the pigeons’ ability to capture a moving stimulus. In Experiment 1, the effect of manipulating stimulus speed and the length of the stimulus was examined using a simple rightward linear motion. This revealed a clear effect of length on capture and speed on errors. Errors were mostly anticipatory and there appeared to be two processes contributing to response locations: anticipatory peck bias and lag time. Using the same birds as Experiment 1, Experiment 2 assessed transfer of tracking and capture to novel linear motions. The birds were able to capture other motion directions, but they displayed a strong rightward peck bias, indicating that they had learned to peck to the right of the stimulus in Experiment 1. Experiment 3 used the same task as Experiment 2 but with naïve birds. These birds did not show the rightward bias in pecking and instead pecked more evenly around the stimulus. The combined results indicate that the pigeon can engage in anticipatory tracking and capture of a moving stimulus, and that motion properties and training experience influence capture.