Retinal flow is sufficient for steering during observer rotation

How do people control locomotion while their eyes are simultaneously rotating? A previous study found that during simulated rotation, they can perceive a straight path of self-motion from the retinal flow pattern, despite conflicting extraretinal information, on the basis of dense motion parallax and reference objects. Here we report that the same information is sufficient for active control ofjoystick steering. Participants steered toward a target in displays that simulated a pursuit eye movement. Steering was highly inaccurate with a textured ground plane (motion parallax alone), but quite accurate when an array of posts was added (motion parallax plus reference objects). This result is consistent with the theory that instantaneous heading is determined from motion parallax, and the path of self-motion is determined by updating heading relative to environmental objects. Retinal flow is thus sufficient for both perceiving self-motion and controlling self-motion with a joystick; extraretinal and positional information can also contribute, but are not necessary.     

How do humans group non-rigid objects in multiple object tracking?: Evidence from grouping by self-rotation

Previous studies on perceptual grouping found that people can use spatiotemporal and featural information to group spatially separated rigid objects into a unit while tracking moving objects. However, few studies have tested the role of objects’ self-motion information in perceptual grouping, although it is of great significance to the motion perception in the three-dimensional space. In natural environments, objects always move in translation and rotation at the same time. The self-rotation of the objects seriously destroys objects’ rigidity and topology, creates conflicting movement signals and results in crowding effects. Thus, this study sought to examine the specific role played by self-rotation information on grouping spatially separated non-rigid objects through a modified multiple object tracking (MOT) paradigm with self-rotating objects. Experiment 1 found that people could use self-rotation information to group spatially separated non-rigid objects, even though this information was deleterious for attentive tracking and irrelevant to the task requirements, and people seemed to use it strategically rather than automatically. Experiment 2 provided stronger evidence that this grouping advantage did come from the self-rotation per se rather than surface-level cues arising from self-rotation (e.g. similar 2D motion signals and common shapes). Experiment 3 changed the stimuli to more natural 3D cubes to strengthen the impression of self-rotation and again found that self-rotation improved grouping. Finally, Experiment 4 demonstrated that grouping by self-rotation and grouping by changing shape were statistically comparable but additive, suggesting that they were two different sources of the object information. Thus, grouping by self-rotation mainly benefited from the perceptual differences in motion flow fields rather than in deformation. Overall, this study is the first attempt to identify self-motion as a new feature that people can use to group objects in dynamic scenes and shed light on debates about what entities/units we group and what kinds of information about a target we process while tracking objects.     

When Walking Makes Perception Better

ABSTRACT— When we move, the visual world moves toward us. That is, self-motion normally produces visual signals (flow) that tell us about our own motion. But these signals are distorted by our motion: Visual flow actually appears slower while we are moving than it does when we are stationary and our surroundings move past us. Although for many years these kinds of distortions have been interpreted as a suppression of flow to promote the perception of a stable world, current research has shown that these shifts in perceived visual speed may have an important function in measuring our own self-motion. Specifically, by slowing down the apparent rate of visual flow during self-motion, our visual system is able to perceive differences between actual and expected flow more precisely. This is useful in the control of action.     

The impact of subjective recognition experiences on recognition heuristic use: A multinomial processing tree approach

The recognition heuristic (RH) theory states that, in comparative judgments (e.g., Which of two cities has more inhabitants?), individuals infer that recognized objects score higher on the criterion (e.g., population) than unrecognized objects. Indeed, it has often been shown that recognized options are judged to outscore unrecognized ones (e.g., recognized cities are judged as larger than unrecognized ones), although different accounts of this general finding have been proposed. According to the RH theory, this pattern occurs because the binary recognition judgment determines the inference and no other information will reverse this. An alternative account posits that recognized objects are chosen because knowledge beyond mere recognition typically points to the recognized object. A third account can be derived from the memory-state heuristic framework. According to this framework, underlying memory states of objects (rather than recognition judgments) determine the extent of RH use: When two objects are compared, the one associated with a “higher” memory state is preferred, and reliance on recognition increases with the “distance” between their memory states. The three accounts make different predictions about the impact of subjective recognition experiences—whether an object is merely recognized or recognized with further knowledge—on RH use. We estimated RH use for different recognition experiences across 16 published data sets, using a multinomial processing tree model. Results supported the memory-state heuristic in showing that RH use increases when recognition is accompanied by further knowledge.     

Perception of self-motion from visual flow

Accurate and efficient control of self-motion is an important requirement for our daily behavior. Visual feedback about self-motion is provided by optic flow. Optic flow can be used to estimate the direction of self-motion (‘heading’) rapidly and efficiently. Analysis of oculomotor behavior reveals that eye movements usually accompany self-motion. Such eye movements introduce additional retinal image motion so that the flow pattern on the retina usually consists of a combination of self-movement and eye movement components. The question of whether this ‘retinal flow’ alone allows the brain to estimate heading, or whether an additional ‘extraretinal’ eye movement signal is needed, has been controversial. This article reviews recent studies that suggest that heading can be estimated visually but extraretinal signals are used to disambiguate problematic situations. The dorsal stream of primate cortex contains motion processing areas that are selective for optic flow and self-motion. Models that link the properties of neurons in these areas to the properties of heading perception suggest possible underlying mechanisms of the visual perception of self-motion.     

Size-arrival effects: The potential roles of conflicts between monocular and binocular time-to-contact information, and of computer aliasing

With computer simulations of self-motion, participants approached a floating object and tried to “jump” over it without collision. Participants “jumped” significantly later over small objects than they did over larger objects. This occurred when the displays were viewed monocularly or binocularly, a finding that suggests that such size-arrival effects (DeLucia & Warren, 1994) were not due to a conflict between monocular and binocular cues to time-to-contact (TTC) information (Tresilian, 1994,1995). Moreover, the results further suggest that size-arrival effects are not due to irregularities in TTC information that can occur from computer abasing and that the latter does not always affect TTC estimation; visual information used in such judgments does not seem to be extracted on a frame-by-frame basis.     

Size-arrival effects: the potential roles of conflicts between monocular and binocular time-to-contact information, and of computer aliasing.

With computer simulations of self-motion, participants approached a floating object and tried to "jump" over it without collision. Participants "jumped" significantly later over small objects than they did over larger objects. This occurred when the displays were viewed monocularly or binocularly, a finding that suggests that such size-arrival effects (DeLucia & Warren, 1994) were not due to a conflict between monocular and binocular cues to time-to-contact (TTC) information (Tresilian, 1994, 1995). Moreover, the results further suggest that size-arrival effects are not due to irregularities in TTC information that can occur from computer aliasing and that the latter does not always affect TTC estimation; visual information used in such judgments does not seem to be extracted on a frame-by-frame basis.     

Orientational manoeuvres in the dark: dissociating allocentric and egocentric influences on spatial memory

Subjects in a darkroom saw an array of five phosphorescent objects on a circular table and, after a short delay, indicated which object had been moved. During the delay the subject, the table or a phosphorescent landmark external to the array was moved (a rotation about the centre of the table) either alone or together. The subject then had to indicate which one of the five objects had been moved. A fully factorial design was used to detect the use of three types of representations of object location: (i) visual snapshots; (ii) egocentric representations updated by self-motion; and (iii) representations relative to the external cue. Improved performance was seen whenever the test array was oriented consistently with any of these stored representations. The influence of representations (i) and (ii) replicates previous work. The influence of representation (iii) is a novel finding which implies that allocentric representations play a role in spatial memory, even over short distances and times. The effect of the external cue was greater when initially experienced as stable. Females out-performed males except when the array was consistent with self-motion but not visual snapshots. These results enable a simple egocentric model of spatial memory to be extended to address large-scale navigation, including the effects of allocentric knowledge, landmark stability and gender.     

Jitter and size effects on vection are immune to experimental instructions and demands

Both coherent perspective jitter and explicit changing-size cues have been shown to improve the vection induced by radially expanding optic flow. We examined whether these stimulus-based vection advantages could be modified by altering cognitions and/or expectations about both the likelihood of self-motion perception and the purpose of the experiment. In the main experiment, participants were randomly assigned into two groups-one where the cognitive conditions biased participants towards self-motion perception and another where the cognitive conditions biased them towards object-motion perception. Contrary to earlier findings by Lepecq et al (1995 Perception 24 435-449), we found that identical visual displays were less likely to induce vection in 'object-motion-bias' conditions than in 'self-motion bias' conditions. However, significant jitter and size advantages for vection were still found in both cognitive conditions (cognitive bias effects were greatest for non-jittering same-size control displays). The current results suggest that if a sufficiently large vection advantage can be produced when participants are expecting to experience self-motion, it is likely to persist in object-motion-bias conditions.     

The utility of motion parallax information for the perception and control of heading

Two experiments in which participants were given control over the direction of computer-simulated self-motion were conducted. Environments were designed to evaluate the functionality of simple and multiple motion parallax as well as a separation ratio (sigma; indexing the separation of 2 objects in depth) for the perception and control of heading. Results provide a 1st indication of optimizing performance in the top end of the global optical flow velocity range available during human bipedal self-motion. The introduction of sigma, developed to explain performance improvements with decreasing distance to the target, was able to account for most of the performance differences among all simulated environments. The rate of change in horizontal optical separation between at least 2 discontinuities was identified as a likely candidate for the optical foundation of the perception and control of heading during target approach.     

Perceiving self-motion in depth: The role of stereoscopic motion and changing-size cues

During self-motions, different patterns of optic flow are presented to the left and right eyes. Previous research has, however, focused mainly on the self-motion information contained in a single pattern of optic flow. The present experiments investigated the role that binocular disparity plays in the visual perception of self-motion, showing that the addition of stereoscopic cues to optic flow significantly improves forward linear vection in central vision. Improvements were also achieved by adding changingsize cues to sparse (but not dense) flow patterns. These findings showed that assumptions in the heading literature that stereoscopic cues facilitate self-motion only when the optic flow has ambiguous depth ordering do not apply to vection. Rather, it was concluded that both stereoscopic and changingsize cues provide additional motion-in-depth information that is used in perceiving self-motion.     

Bias in self-motion perceived speed can enhance episodic memory

Prior experiences of a stimulus facilitate reprocessing of that stimulus on a subsequent occasion. This relative ease and speed with which information is processed is defined as fluency and can constitute a basis for memory judgment. Fluency can also be manipulated on line by perceptual bias (e.g., levels of noise), leading to an increase in recognition for items processed more fluently (e.g., items with less noise). Previous experiments using Remember-Know paradigm have shown an impact of perceptual fluency only on familiarity and not on recollection. Recent episodic memory models have postulated a strong link between episodic memory and spatial processes, especially with egocentric updating (Gomez et al. in Acta Psychol 132(3):221-227, 2009). The present experiment was conducted to determine whether self-motion fluency affects recognition performance and particularly has an impact on "Remember" responses. Thirty participants learned a 4-min path movie and then had to recognize among short paths if they were part of the learned path, followed by a Remember-Know procedure for recognized items. Self-motion fluency was manipulated with the presence of nimble acceleration applied on a small part of the recognition paths. Results show that the presence of a self-motion fluency increases significantly the proportion of remember responses solely on learned paths. This study spotlights for the first time a specific fluency effect on recollection and indicates an implication of egocentric-updating processing in episodic memory retrieval.     

Self-motion perception influences number processing: evidence from a parity task

We investigated the role of horizontal body motion on the processing of numbers. We hypothesized that leftward self-motion leads to shifts in spatial attention and therefore facilitates the processing of small numbers, and vice versa, we expected that rightward self-motion facilitates the processing of large numbers. Participants were displaced by means of a motion platform during a parity judgment task. We found a systematic influence of self-motion direction on number processing, suggesting that the processing of numbers is intertwined with the processing of self-motion perception. The results differed from known spatial numerical compatibility effects in that self-motion exerted a differential influence on inner and outer numbers of the given interval. The results highlight the involvement of sensory body motion information in higher-order spatial cognition.     

Self-motion impairs multiple-object tracking

Investigations of multiple-object tracking aim to further our understanding of how people perform common activities such as driving in traffic. However, tracking tasks in the laboratory have overlooked a crucial component of much real-world object tracking: self-motion. We investigated the hypothesis that keeping track of one’s own movement impairs the ability to keep track of other moving objects. Participants attempted to track multiple targets while either moving around the tracking area or remaining in a fixed location. Participants’ tracking performance was impaired when they moved to a new location during tracking, even when they were passively moved and when they did not see a shift in viewpoint. Self-motion impaired multiple-object tracking in both an immersive virtual environment and a real-world analog, but did not interfere with a difficult non-spatial tracking task. These results suggest that people use a common mechanism to track changes both to the location of moving objects around them and to keep track of their own location.     

Recognition times of different views of 56 depth-rotated objects: A note concerning Verfaillie and Boutsen (1995)

The present study examines the effect of thegoodness of view on the minimal exposure time required to recognize depth-rotated objects. In a previous study, Verfaillie and Boutsen (1995) derived scales of goodness of view, using a new corpus of images of depth-rotated objects. In the present experiment, a subset of this corpus (five views of 56 objects) is used to determine the recognition exposure time for each view, by increasing exposure time across successive presentations until the object is recognized. The results indicate that, for two thirds of the objects,good views are recognized more frequently and have lower recognition exposure times thanbad views.     

Narcissistic people cannot be moved easily by visual stimulation

We examined the relationship between personality and visually induced self-motion perception (latency, duration, and magnitude). A psychological experiment with radially expanding patterns that induced self-motion perception along the fore and aft axis was conducted, followed by personality assessments. We found that all the measures of self-motion perception we examined correlated negatively with the degree of narcissistic traits.     

Pursuit compensation during self-motion

The pattern of motion in the retinal image during self-motion contains information about the person's movement. Pursuit eye movements perturb the pattern of retinal-image motion, complicating the problem of self-motion perception. A question of considerable current interest is the relative importance of retinal and extra-retinal signals in compensating for these effects of pursuit on the retinal image. We addressed this question by examining the effect of prior motion stimuli on self-motion judgments during pursuit. Observers viewed 300 ms random-dot displays simulating forward self-motion during pursuit to the right or to the left; at the end of each display a probe appeared and observers judged whether they would pass left or right of it. The display was preceded by a 300 ms dot pattern that was either stationary or moved in the same direction as, or opposite to, the eye movement. This prior motion stimulus had a large effect on self-motion judgments when the simulated scene was a frontoparallel wall (experiment 1), but not when it was a three-dimensional (3-D) scene (experiment 2). Corresponding simulated-pursuit conditions controlled for purely retinal motion aftereffects, implying that the effect in experiment 1 is mediated by an interaction between retinal and extra-retinal signals. In experiment 3, we examined self-motion judgments with respect to a 3-D scene with mixtures of real and simulated pursuit. When real and simulated pursuits were in opposite directions, performance was determined by the total amount of pursuit-related retinal motion, consistent with an extra-retinal 'trigger' signal that facilitates the action of a retinally based pursuit-compensation mechanism. However, results of experiment 1 without a prior motion stimulus imply that extra-retinal signals are more informative when retinal information is lacking. We conclude that the relative importance of retinal and extra-retinal signals for pursuit compensation varies with the informativeness of the retinal motion pattern, at least for short durations. Our results provide partial explanations for a number of findings in the literature on perception of self-motion and motion in the frontal plane.     

Perception of visual speed while moving

During self-motion, the world normally appears stationary. In part, this may be due to reductions in visual motion signals during self-motion. In 8 experiments, the authors used magnitude estimation to characterize changes in visual speed perception as a result of biomechanical self-motion alone (treadmill walking), physical translation alone (passive transport), and both biomechanical self-motion and physical translation together (walking). Their results show that each factor alone produces subtractive reductions in visual speed but that subtraction is greatest with both factors together, approximating the sum of the 2 separately. The similarity of results for biomechanical and passive self-motion support H. B. Barlow's (1990) inhibition theory of sensory correlation as a mechanism for implementing H. Wallach's (1987) compensation for self-motion.     

Bias in self-motion perceived speed can enhance episodic memory

Prior experiences of a stimulus facilitate reprocessing of that stimulus on a subsequent occasion. This relative ease and speed with which information is processed is defined as fluency and can constitute a basis for memory judgment. Fluency can also be manipulated on line by perceptual bias (e.g., levels of noise), leading to an increase in recognition for items processed more fluently (e.g., items with less noise). Previous experiments using Remember–Know paradigm have shown an impact of perceptual fluency only on familiarity and not on recollection. Recent episodic memory models have postulated a strong link between episodic memory and spatial processes, especially with egocentric updating (Gomez et al. in Acta Psychol 132(3):221–227, 2009). The present experiment was conducted to determine whether self-motion fluency affects recognition performance and particularly has an impact on “Remember” responses. Thirty participants learned a 4-min path movie and then had to recognize among short paths if they were part of the learned path, followed by a Remember–Know procedure for recognized items. Self-motion fluency was manipulated with the presence of nimble acceleration applied on a small part of the recognition paths. Results show that the presence of a self-motion fluency increases significantly the proportion of remember responses solely on learned paths. This study spotlights for the first time a specific fluency effect on recollection and indicates an implication of egocentric-updating processing in episodic memory retrieval.     

Accelerating self-motion displays produce more compelling vection in depth

We examined the vection in depth induced when simulated random self-accelerations (jitter) and periodic self-accelerations (oscillation) were added to radial expanding optic flow (simulating constant-velocity forward self-motion). Contrary to the predictions of sensory-conflict theory frontal-plane jitter and oscillation were both found to significantly decrease the onsets and increase the speeds of vection in depth. Depth jitter and oscillation had lesser, but still significant, effects on the speed of vection in depth. A control experiment demonstrated that adding global perspective motion which simulated a constant-velocity frontal-plane self-motion had no significant effect on vection in depth induced by the radial component of the optic flow. These results are incompatible with the notion that constant-velocity displays produce optimal vection. Rather, they indicate that displays simulating self-acceleration can often produce more compelling experiences of self-motion in depth.