Fictive motion as cognitive simulation

Sentences such as The road runs through the valley and The mountain range goes from Canada to Mexico include a motion verb but express no explicit motion or state change. It is argued that these sentences involve fictive motion, an implicit type of motion. But do people trying to understand these sentences mentally simulate motion? This question was addressed in four experiments. In each, participants read a story about travel—for instance, fast versus slow, short versus long distance, and easy versus difficult terrain—and then made a timed decision about a fictive motion sentence. Overall, latencies were shorter after they had read about fast travel, short distances, and easy terrains. Critically, the effect did not arise with nonfictive motion target sentences (e.g., The road is in the valley), as was demonstrated in three control studies. The results suggest that the processing of fictive motion includes mental simulation.     

被试自身人手初始状态对心理旋转加工的影响：眼动研

利用眼动追踪技术,探讨在左右手判断任务条件下人手心理旋转加工是否受到被试自身人手初始状态的影响。两个实验的反应时数据和眼动数据均发现：（1）心理旋转加工受被试自身人手初始状态的影响,表现出一致性效应;（2）显著的内旋效应;（3）被试心理旋转加工时注视点取样存在着不均衡性。这些结果表明：在左右手判断任务中,心理旋转加工的对象是被试自身人手的表象,是自我参照的心理旋转,并且内旋效应是由被试对自身人手表象进行旋转时受到人手生理机制约束所致,而不是被试旋转刺激图片的表象由“生理机制约束知识”影响所致     

Eye Movements Reveal the Dynamic Simulation of Speed in Language

This study investigates how speed of motion is processed in language. In three eye‐tracking experiments, participants were presented with visual scenes and spoken sentences describing fast or slow events (e.g., The lion ambled/dashed to the balloon). Results showed that looking time to relevant objects in the visual scene was affected by the speed of verb of the sentence, speaking rate, and configuration of a supporting visual scene. The results provide novel evidence for the mental simulation of speed in language and show that internal dynamic simulations can be played out via eye movements toward a static visual scene.     

任务信息通达对视觉表象眼动的影响

通过两个实验探讨了视觉表象任务信息的通达对表象加工眼动的影响。结果表明, 在低通达条件下, 表象任务的眼动复制了知觉任务的眼动; 随着表象任务信息通达水平的提高, 眼动的注视点平均持续时间、平均眼跳距离和平均眼跳时间会发生规律性变化; 眼动控制与任务信息通达水平对表象眼动的影响存在不同的机制。实验结果佐证了眼动在视觉表象中起机能性作用的观点。     

Is gaze behaviour in a laboratory context similar to that in real-life? A study in bicyclists

Numerous laboratory-based studies recorded eye movements in participants with varying expertise when watching video projections in the lab. Although research in the lab offers the advantage of internal validity, reliability and ethical considerations, ecological validity is often questionable. Therefore the current study compared visual search in 13 adult cyclists, when cycling a real bicycle path and while watching a film clip of the same road. Dwell time towards five Areas of Interest (AOIs) is analysed. Dwell time (%) in the lab and real-life was comparable only for the low quality bicycle path. Both in real-life and the lab, gaze is predominantly driven towards the road. Since gaze behaviour in the lab and real-life tends to be comparable with increasing task-complexity (road quality), it is concluded that under certain task constraints laboratory experiments making use of video clips might provide valuable information regarding gaze behaviour in real-life.     

Detecting eye movements in dynamic environments

To take advantage of the increasing number of in-vehicle devices, automobile drivers must divide their attention between primary (driving) and secondary (operating in-vehicle device) tasks. In dynamic environments such as driving, however, it is not easy to identify and quantify how a driver focuses on the various tasks he/she is simultaneously engaged in, including the distracting tasks. Measures derived from the driver’s scan path have been used as correlates of driver attention. This article presents a methodology for analyzing eye positions, which are discrete samples of a subject’s scan path, in order to categorize driver eye movements. Previous methods of analyzing eye positions recorded in a dynamic environment have relied completely on the manual identification of the focus of visual attention from a point of regard superimposed on a video of a recorded scene, failing to utilize information regarding movement structure in the raw recorded eye positions. Although effective, these methods are too time consuming to be easily used when the large data sets that would be required to identify subtle differences between drivers, under different road conditions, and with different levels of distraction are processed. The aim of the methods presented in this article are to extend the degree of automation in the processing of eye movement data by proposing a methodology for eye movement analysis that extends automated fixation identification to include smooth and saccadic movements. By identifying eye movements in the recorded eye positions, a method of reducing the analysis of scene video to a finite search space is presented. The implementation of a software tool for the eye movement analysis is described, including an example from an on-road test-driving sample.     

Colour and spatial cueing in low-prevalence visual search

People are able to judge the current position of occluded moving objects. This operation is known as motion extrapolation. It has previously been suggested that motion extrapolation is independent of the oculomotor system. Here we revisited this question by measuring eye position while participants completed two types of motion extrapolation task. In one task, a moving visual target travelled rightwards, disappeared, then reappeared further along its trajectory. Participants discriminated correct reappearance times from incorrect (too early or too late) with a two-alternative forced-choice button press. In the second task, the target travelled rightwards behind a visible, rectangular occluder, and participants pressed a button at the time when they judged it should reappear. In both tasks, performance was significantly different under fixation as compared to free eye movement conditions. When eye movements were permitted, eye movements during occlusion were related to participants' judgements. Finally, even when participants were required to fixate, small changes in eye position around fixation (<2°) were influenced by occluded target motion. These results all indicate that overlapping systems control eye movements and judgements on motion extrapolation tasks. This has implications for understanding the mechanism underlying motion extrapolation.     

Gesturing during mental problem solving reduces eye movements,especially for individuals with lower visual working memory capacity

Non-communicative hand gestures have been found to benefit problem-solving performance. These gestures seem to compensate for limited internal cognitive capacities, such as visual working memory capacity. Yet, it is not clear how gestures might perform this cognitive function. One hypothesis is that gesturing is a means to spatially index mental simulations, thereby reducing the need for visually projecting the mental simulation onto the visual presentation of the task. If that hypothesis is correct, less eye movements should be made when participants gesture during problem solving than when they do not gesture. We therefore used mobile eye tracking to investigate the effect of co-thought gesturing and visual working memory capacity on eye movements during mental solving of the Tower of Hanoi problem. Results revealed that gesturing indeed reduced the number of eye movements (lower saccade counts), especially for participants with a relatively lower visual working memory capacity. Subsequent problem-solving performance was not affected by having (not) gestured during the mental solving phase. The current findings suggest that our understanding of gestures in problem solving could be improved by taking into account eye movements during gesturing.     

When is the ball going to hit the ground? Duration estimates, eye movements, and mental imagery of object motion

Performance in 2 versions of a computer-animated task was compared. Participants either indicated the time of arrival of a target that rolled off a horizontal surface and fell--hidden from view--onto a landing point (production task) or judged flight time on a rating scale (judgment task). As predicted, performance was significantly better in the production task (Experiment 1), in which imagery of object motion probably replaced reasoning processes. Participants who exhibited eye movements suggesting mental tracking performed particularly well in the production task (Experiment 2). There was, however, no decrement in performance when participants were asked to fixate the point where the target disappeared. For motion duration estimations, eye movements seem to be only a by-product of mental tracking.     

Efference,perceived movement,and illusory displacement

Implications of the efferent signal associated with voluntary eye movements as a mechanism of perceived motion are reviewed. This signal normally subserves motion perception during pursuit eye movements and is also present when the pursuit is activated to prevent loss of fixation. Such efferent signals are the basis of a number of illusory motion and displacement phenomena. The contribution of efferent motion mechanisms to the oculogyral and apparent concomitant motion illusions is discussed. The phenomenon of roll-induced tilt is analysed in terms of illusory motion and displacement associated with voluntary cyclotorsional eye movements.     

Temporal binding during apparent movement of the human body

Alternating between static images of human bodies with an appropriate interstimulus interval (ISI) produces apparent biological motion. Here we investigate links between apparent biological motion and time perception. We presented two pictures of the initial and final positions of a human movement separated by six different ISIs. The shortest movement path between two positions was always biomechanically impossible. Participants performed two tasks: In an explicit task, participants judged whether they saw the longer, feasible movement path between the two postures, or the shorter, biomechanically impossible path. In an implicit task, participants judged the duration of a white square surrounding the picture sequence. At longer ISIs participants were more likely to see a longer, feasible movement path (explicit task) and underestimated the duration of body picture pairs, compared to trials displaying degraded body pictures (implicit task). We argue that perceiving apparent biological motion involves temporal binding of two static pictures into a continuous movement. Such temporal binding may be mediated by a top-down mechanism that produces a percept of biological motion in the absence of any retinal motion.     

视觉表象操作加工的眼动实验研究

本研究通过视觉表象旋转和扫描的眼动实验探讨表象的心理表征方式。实验一结果表明,眼动指标具有与反应时相类似的旋转角度效应。实验二结果显示,表象扫描的反应时和眼动指标都具有与知觉扫描加工一样的距离效应。由此可以认为,表象眼动与知觉眼动模式具有相似性;表象具有相对独立的心理表征方式并有其特殊的加工过程;表象的心理表征可以是形象表征,而非一定是抽象的命题或符号表征     

The interaction of perceived distance with the perceived direction of visual motion during movements of the eyes and the head.

A horizontally moving target was followed by rotation of the eyes alone or by a lateral movement of the head. These movements resulted in the retinal displacement of a vertically moving target from its perceived path, the amplitude of which was determined by the phase and amplitude of the object motion and of the eye or head movements. In two experiments, we tested the prediction from our model of spatial motion (Swanston, Wade, & Day, 1987) that perceived distance interacts with compensation for head movements, but not with compensation for eye movements with respect to a stationary head. In both experiments, when the vertically moving target was seen at a distance different from its physical distance, its perceived path was displaced relative to that seen when there was no error in perceived distance, or when it was pursued by eye movements alone. In a third experiment, simultaneous measurements of eye and head position during lateral head movements showed that errors in fixation were not sufficient to require modification of the retinal paths determined by the geometry of the observation conditions in Experiments 1 and 2.