Visual representation of malleable and rigid objects that deform as they rotate

Most studies and theories of object recognition have addressed the perception of rigid objects. Yet, physical objects may also move in a nonrigid manner. A series of priming studies examined the conditions under which observers can recognize novel views of objects moving nonrigidly. Observers were primed with 2 views of a rotating object that were linked by apparent motion or presented statically. The apparent malleability of the rotating prime object varied such that the object appeared to be either malleable or rigid. Novel deformed views of malleable objects were primed when falling within the object's motion path. Priming patterns were significantly more restricted for deformed views of rigid objects. These results suggest that moving malleable objects may be represented as continuous events, whereas rigid objects may not. That is, object representations may be "dynamically remapped" during the analysis of the object's motion.     

The perception of 3-dimensional affine structure from minimal apparent motion sequences

The research described in the present article was designed to identify the minimal conditions for the visual perception of 3-dimensional structure from motion by comparing the theoretical limitations of ideal observers with the perceptual performance of actual human subjects on a variety of psychophysical tasks. The research began with a mathematical analysis, which showed that 2-frame apparent motion sequences are theoretically sufficient to distinguish between rigid and nonrigid motion and to identify structural properties of an object that remain invariant under affine transformations, but that 3 or more distinct frames are theoretically necessary to adequately specify properties of euclidean structure such as the relative 3-dimensional lengths or angles between nonparallel line segments. A series of four experiments was then performed to verify the psychological validity of this analysis. The results demonstrated that the determination of structure from motion in actual human observers may be restricted to the use of first order temporal relations, which are available within 2-frame apparent motion sequences. That is to say, the accuracy of observers' judgments did not improve in any of these experiments as the number of distinct frames in an apparent motion sequence was increased from 2 to 8, and performance on tasks involving affine structure was of an order of magnitude greater than performance on similar tasks involving euclidean structure.     

Discriminating rigid from nonrigid motion: minimum points and views

Theoretical investigations of structure from motion have demonstrated that an ideal observer can discriminate rigid from nonrigid motion from two views of as few as four points. We report three experiments that demonstrate similar abilities in human observers: In one experiment, 4 of 6 subjects made this discrimination from two views of four points; the remaining subjects required five points. Accuracy in discriminating rigid from nonrigid motion depended on the amount of nonrigidity (variance of the interpoint distances over views) in the nonrigid structure. The ability to detect a rigid group dropped sharply as noise points (points not part of the rigid group) were added to the display. We conclude that human observers do extremely well in discriminating between nonrigid and fully rigid motion, but that they do quite poorly at segregating points in a display on the basis of rigidity.     

Monocular discrimination of rigidly and nonrigidly moving objects

Wemeasured thresholds for the monocular discrimination of rigidly and nonrigidly moving objects defined by motion parallax. The retinal projections of rigidly moving objects are subject to certain constraints. By applying smooth 2-D transformations to the projections of rigidly moving objects, we created stimuli in which these constraints were affected. Thresholds for (generic) nonrigid transformations that in theory can be detected from rigid ones by processing pairs of views depended not only on the extent to which the rigidity constraints were affected, but also on the structure and the movement of the simulated object. Nonrigid transformations under which every three successive views had a rigid interpretation were not discriminable from rigid transformations, except in cases where the distortions were very large. Under the rigidity assumption, this would mean that a large class of nonrigidly moving objects is erroneously perceived as rigidly moving.     

Structural similarity and spatiotemporal noise effects on learning dynamic novel objects

The spatiotemporal pattern projected by a moving object is specific to that object, as it depends on both the shape and the dynamics of the object. Previous research has shown that observers learn to make use of this spatiotemporal signature to recognize dynamic faces and objects. In two experiments, we assessed the extent to which the structural similarity of the objects and the presence of spatiotemporal noise affect how these signatures are learned and subsequently used in recognition. Observers first learned to identify novel, structurally distinctive or structurally similar objects that rotated with a particular motion. At test, each learned object moved with its studied motion or with a non-studied motion. In the non-studied motion condition we manipulated either dynamic information alone (experiment 1) or both static and dynamic information (experiment 2). Across both experiments we found that changing the learned motion of an object impaired recognition performance when 3-D shape was similar or when the visual input was noisy during learning. These results are consistent with the hypothesis that observers use learned spatiotemporal signatures and that such information becomes progressively more important as shape information becomes less reliable.     

Rapid adaptation of the vestibulo-ocular reflex and induced self-motion perception

When a rigid object moves toward the eye, it is usually perceived as being rigid. However, in the case of motion away from the eye, the motion and structure of the object are perceived nonveridically, with the percept tending to reflect the nonrigid transformations that are present in the retinal image. This difference in response to motion to and from the observer was quantified in an experiment using wire-frame computer-generated boxes which moved toward and away from the eye. Two theoretical systems are developed by which uniform three-dimensional velocity can be recovered from an expansion pattern of nonuniform velocity vectors. It is proposed that the human visual system uses two similar systems for processing motion in depth. The mechanism used for motion away from the eye produces perceptual errors because it is not suited to objects with a depth component.     

Rotational and translational components of motion parallax: observers' sensitivity and implications for three-dimensional computer graphics

The motion of objects during motion parallax can be decomposed into 2 observer-relative components: translation and rotation. The depth ratio of objects in the visual field is specified by the inverse ratio of their angular displacement (from translation) or equivalently by the inverse ratio of their rotations. Despite the equal mathematical status of these 2 information sources, it was predicted that observers would be far more sensitive to the translational than rotational component. Such a differential sensitivity is implicitly assumed by the computer graphics technique billboarding, in which 3-dimensional (3-D) objects are drawn as planar forms (i.e., billboards) maintained normal to the line of sight. In 3 experiments, observers were found to be consistently less sensitive to rotational anomalies. The implications of these findings for kinetic depth effect displays and billboarding techniques are discussed.     

The role of motion in learning new faces

Four experiments are reported that investigate the usefulness of rigid (head nodding, shaking) and nonrigid (talking, expressions) motion for establishing new face representations of previously unfamiliar faces. Results show that viewing a face in motion leads to more accurate face learning, compared with viewing a single static image (Experiment 1). The advantage for viewing the face moving rigidly seems to be due to the different angles of view contained in these sequences (Experiment 2). However, the advantage for nonrigid motion is not simply due to multiple images (Experiment 3) and is not specifically linked to forwards motion but extends to reversed sequences (Experiment 4). Thus, although we have demonstrated beneficial effects of motion for face learning, they do not seem to be due to the specific dynamic properties of the sequences shown. Instead, the advantage for nonrigid motion may reflect increased attention to faces moving in a socially important manner.     

Multielement visual tracking: attention and perceptual organization.

Two types of theories have been advanced to account for how attention is allocated in performing goal-directed visual tasks. According to location-based theories, visual attention is allocated to spatial locations in the image; according to object-based theories, attention is allocated to perceptual objects. Evidence for the latter view comes from experiments demonstrating the importance of perceptual grouping in selective-attention tasks. This article provides further evidence concerning the importance of perceptual organization in attending to objects. In seven experiments, observers tracked multiple randomly moving visual elements under a variety of conditions. Ten elements moved continuously about the display for several seconds; one to five of them were designated as targets before movement initiation. At the end of movement, one element was highlighted, and subjects indicated whether or not it was a target. The ease with which the elements in the target set could be perceptually grouped was systematically manipulated. In Experiments 1-3, factors that influenced the initial formation of a perceptual group were manipulated; this affected performance, but only early in practice. In Experiments 4-7, factors that influenced the maintenance of a perceptual group during motion were manipulated; this affected performance throughout practice. The results suggest that observers spontaneously grouped the target elements and directed attention toward this coherent but nonrigid virtual object. This supports object-based theories of attention and demonstrates that perceptual grouping, which is usually conceived of as a purely stimulus-driven process, can also be governed by goal-directed mechanisms.     

Perceptual information and attentional constraints in visual search of collision events

This study examined the detection of collision events when multiple moving objects were present in the scene. Observers were presented with displays simulating a 3-D environment with multiple moving objects. The authors examined the ability of observers to detect collisions using a signal-detection paradigm and a visual search paradigm. The results indicated that, overall, observers were quite accurate at detecting collisions. Observers used both expansion information and static position to detect collisions, with expansion information being the more important source. Singleton search conditions were not processed in parallel, and conjunction search conditions had poorer performance than singleton search conditions. In addition, reaction times were greater for target-present trials as compared with target-absent trials. The results are interpreted in terms of 4 visual search hypotheses for collision detection when multiple moving objects are present.     

动、静态视觉信息在真实世界视觉搜索中的作用

真实环境中的视觉搜索是人和动物赖以生存的重要能力。目前的视觉搜索研究多使用静态的观察者和静止的二维搜索对象, 侧重于探究注意在搜索中的作用; 现有的视觉搜索理论模型主要概括了影响搜索的自上而下的注意因素, 而将自下而上影响因素简单归结为影像显著性, 然而在真实环境中, 观察者或搜索对象是可以运动的, 搜索时可利用的视觉信息包括动态光流和静态影像结构信息。已有的视觉识别研究发现这两种信息相结合可以使观察者准确持久地识别场景、事件和三维结构。在现有视觉搜索理论模型中引入两种视觉信息可以较好还原真实环境中的搜索任务。我们提出研究构想和实验方案,探究利用动、静态视觉信息的视觉搜索过程, 从而完善现有的视觉搜索模型。我们认为充分利用环境信息可以提高搜索效率, 且在视觉搜索训练和智能搜索设计等方面有重要的应用价值。     

Object and observer motion in the perception of objects by infants

Sixteen-week-old human infants distinguish optical displacements given by their own motion from displacements given by moving objects, and they use only the latter to perceive the unity of partly occluded objects. Optical changes produced by moving the observer around a stationary object produced attentional levels characteristic of stationary observers viewing stationary displays and much lower than those shown by stationary observers viewing moving displays. Real displacements of an object with no subject-relative displacement, produced by moving an object so as to maintain a constant relation to the moving observer, evoked attentional levels that were higher than with stationary displays and more characteristic of attention to moving displays, a finding suggesting detection of the real motion. Previously reported abilities of infants to perceive the unity of partly occluded objects from motion information were found to depend on real object motion rather than on optical displacements in general. The results suggest that object perception depends on registration of the motions of surfaces in the three-dimensional layout.     

Aging and the detection of observer and moving object collisions

The authors examined age-related differences in the detection of collision events. Older and younger observers were presented with displays simulating approaching objects that would either collide or pass by the observer. In 4 experiments, the authors found that older observers, as compared with younger observers, had less sensitivity in detecting collisions with an increase in speed, at shorter display durations, and with longer time-to-contact conditions. Older observers also had greater difficulty when the scenario simulated observer motion, suggesting that older observers have difficulty discriminating object motion expansion from background expansion from observer motion. The results of these studies support the expansion sensitivity hypothesis-that age-related decrements in detecting collision events involving moving objects are the result of a decreased sensitivity to recover expansion information.     

Attentive tracking of objects versus substances

Recent research in vision science, infant cognition, and word learning suggests a special role for the processing of discrete objects. But what counts as an object? Answers to this question often depend on contrasting object-based processing with the processing of spatial areas or unbound visual features. In infant cognition and word learning, though, another salient contrast has been between rigid cohesive objects and nonsolid substances. Whereas objects may move from one location to another, a nonsolid substance must pour from one location to another. In the study reported here, we explored whether attentive tracking processes are sensitive to dynamic information of this type. Using a multiple-object tracking task, we found that subjects could easily track four items in a display of eight identical unpredictably moving entities that moved as discrete objects from one location to another, but could not track similar entities that noncohesively "poured" from one location to another-even when the items in both conditions followed the same trajectories at the same speeds. Other conditions revealed that this inability to track multiple "substances" stemmed not from violations of rigidity or cohesiveness per se, because subjects were able to track multiple noncohesive collections and multiple nonrigid deforming objects. Rather, the impairment was due to the dynamic extension and contraction during the substancelike motion, which rendered the location of the entity ambiguous. These results demonstrate a convergence between processes of midlevel adult vision and infant cognition, and in general help to clarify what can count as a persisting dynamic object of attention.     

On the limits of perceptual complementarity in the kinetic depth effect

In a series of experiments, we have investigated the abilities of human observers to perceive geometric properties of moving three-dimensional objects as a function of their perspective and rotational complexities. The results indicate a decreasing ability of observers to extract metric, angular, and rigid motion as the perspectives and rotations depart from parallel projections and one-parameter central rotations. In this way, quantitative limits are suggested for the principle of perceptual complementarity suggested by Shepard (1981).     

客体运动方向的视觉工作记忆容量

记忆动态场景中多客体的特征和时空信息是人类重要的认知活动。目前有关视觉工作记忆的研究虽然广泛探讨了对视觉信息的存储容量及机制,然而所采用的刺激材料均呈现于静态场景中,且不包含运动信息。而有关多客体追踪的研究只关注动态场景中多客体信息的实时更新,而不涉及一段时间内对客体信息的保持。本研究结合视觉工作记忆领域的变化觉察范式和多客体追踪范式,以独立运动的客体为刺激材料,探讨多个客体的运动方向信息在工作记忆中的存储容量问题。结果表明,在工作记忆中能够存储大约3个客体的运动方向信息。     

Rigidity in cinema seen from the front row, side aisle

Pictures and cinema seen at a slant present the optics of virtual objects that are distorted and inconsistent with their real counterparts. In particular, it should not be possible for moving objects on slanted film and television screens to be seen as rigid, at least according to rules of linear perspective. Previous approaches to this problem have suggested that some process (perhaps cognitive) rectifies the optics of objects in slanted pictures to derive true shape and preserve shape constancy. The means for this rectification is usually thought to be based on recovery of true screen slant. In three experiments I show that this account is unnecessary and insufficient to explain the perception of rotating, rectangular objects in slanted cinema. I present data in favor of an alternate view, one in which the information is sufficient for perceivers to determine rigidity in an object on slanted screens, at least for parallel projections. In the human visual system, local measurements of objects are apparently made according to projective geometry; in those measurements, small amounts of certain distortions in projection are tolerated. Stimuli that appear nonrigid are ones that violate certain local principles, known as Perkins's laws, of projections of rectangular solids.     

The bar-cross-ellipse illusion: alternating percepts of rigid and nonrigid motion based on contour ownership and trackable feature assignment

We present a new multistable stimulus generated by continuously rotating an ellipse behind four fixed occluders. Despite the stimulus remaining constant, observers can alternate between one of four percepts: (1) a continuously morphing cross; (2) two independent perpendicular bars oscillating in depth; (3) a rigidly rotating ellipse observed behind the occluders; (4) a fixed cross observed through a continuously rotating, elliptical aperture. Interestingly, the initial percept naive observers tend to see is percept 1, which is the only nonrigid motion percept. This appears to be a violation of the hypothesized 'rigidity heuristic' in which rigid motion percepts tend to be perceived over retinally equivalent nonrigid ones. Here, we describe the relationships between each of the percepts and the assignment of contour ownership and figure/ground segmentation.     

Coherence determines speed discrimination

The visual system must determine which elements in a scene to regard as parts of a single object and which to regard as different objects. We can create stimuli that are ambiguous, ie consistent with more than one interpretation, and ask in what situations the stimulus elements are interpreted as part of a single object and when they are interpreted as multiple objects. The ambiguous stimuli in this study were moving plaid patterns--the sum of two drifting gratings with different orientations. Observers may see a rigid coherent plaid object moving in one direction, or may see two gratings moving in different directions sliding over one another. When the gratings have similar contrasts they appear to cohere and only the plaid speed is perceptually available; when the gratings have different contrasts they appear to slide and only the speeds of the gratings are perceived. Coherence thus determines what speed information is passed to higher stages of motion processing. A two-stage model of plaid motion perception is presented which agrees with the model proposed by Adelson and Movshon and extends it, detailing the relationship between coherence and speed discrimination.     

The role of location and motion information in the tracking and recovery of moving objects

Observers in a multiple object tracking task can track about four to five independently moving targets among several moving distractors, even if all of the stimuli disappear for a 300-msec gap. How observers reacquire targets following such a gap reveals what kind of information they can maintain for targets. Previous research has suggested that participants maintain minimal information about a set of moving objects--namely, just their present spatial locations. We report five new experiments that demonstrate retention of location information for at least four objects, and extrapolated motion information for around two objects.