Perceiving stimulus displacements across saccades

The visual world appears stable despite frequent retinal image movements caused by saccades. Many theories of visual stability assume that extraretinal eye position information is used to spatially adjust perceived locations across saccades, whereas others have proposed that visual stability depends upon coding of the relative positions of objects. McConkie and Currie (1996) proposed a refined combination of these views (called the Saccade Target Object Theory) in which the perception of stability across saccades relies on a local evaluation process centred on the saccade target object rather than on a remapping of the entire scene, with some contribution from memory for the relative positions of objects as well. Three experiments investigated the saccade target object theory, along with an alternative hypothesis that proposes that multiple objects are updated across saccades, but with variable resolution, with the saccade target object (by virtue of being the focus of attention before the saccade and residing near the fovea after the saccade) having priority in the perception of displacement. Although support was found for the saccade target object theory in Experiment 1, the results of Experiments 2 and 3 found that multiple objects are updated across saccades and that their positions are evaluated to determine perceived stability. There is an advantage for detecting displacements of the saccade target, most likely because of visual acuity or attentional focus being better near the fovea, but it is not the saccade target alone that determines the perception of stability and of displacements across saccades. Rather, multiple sources of information appear to contribute.     

Characterising the visual buffer: real-world evidence for overwriting early in each fixation

What happens to the pictorial content of fixations when we move our eyes? Previous studies demonstrate that observers are very poor at detecting changes in natural scenes that occur across saccades, blinks, and artificial interruptions ('change blindness'). They suggest that the visual 'snapshots' of what is on the retina during a fixation are not retained and fused over successive fixations. I find similar results when volunteers are performing the complex real-life task of making a cup of tea. Volunteers can access the snapshot of the current fixation but not those of previous fixations. I suggest that volunteers are reporting the content of a low-level visual store that holds a veridical snapshot of the current fixation, rather than the retina itself. The snapshots are not 'wiped' by the saccade and remain in the buffer until they are overwritten by a new snapshot. The overwrite occurs in an all-or-none manner and can be at any time within the first 400 ms of each new fixation, with 50% of overwrites being within the first 100 ms.     

Evidence against visual integration across saccadic eye movements

One of the classic problems in perception concerns how we perceive a stable, continuous visual world even though we view it via a temporally discontinuous series of eye movements. Previous investigators have suggested that our perception of a stable visual environment is due to anintegrative visual buffer, a special memory store capable of fusing the visual contents of successive fixations according to their environmental coordinates. In this paper, three experiments are reported that attempted to demonstrate the existence of an integrative visual buffer. The experimental procedure required subjects to mentally fuse two halves of a dot matrix presented in the same spatial region of a display, but separated by an eye movement so that each half was viewed only during one fixation. Thus, subjects had to integrate packets of visual information that had the same environmental coordinates, but different retinal coordinates. No evidence was found in any experiment for the fusion of visual information from successive fixations in memory, leaving the status of the integrative visual buffer in serious doubt.     

Spatial But Not Oculomotor Information Biases Perceptual Memory: Evidence From Face Perception and Cognitive Modeling

Recent research put forward the hypothesis that eye movements are integrated in memory representations and are reactivated when later recalled. However, “looking back to nothing” during recall might be a consequence of spatial memory retrieval. Here, we aimed at distinguishing between the effect of spatial and oculomotor information on perceptual memory. Participants’ task was to judge whether a morph looked rather like the first or second previously presented face. Crucially, faces and morphs were presented in a way that the morph reactivated oculomotor and/or spatial information associated with one of the previously encoded faces. Perceptual face memory was largely influenced by these manipulations. We considered a simple computational model with an excellent match (4.3% error) that expresses these biases as a linear combination of recency, saccade, and location. Surprisingly, saccades did not play a role. The results suggest that spatial and temporal rather than oculomotor information biases perceptual face memory.     

Information integration across saccadic eye movements

The visual world contains more information than can be perceived in a single glance. Consequently, one's perceptual representation of the environment is built up via the integration of information across saccadic eye movements. The properties of transsaccadic integration were investigated in six experiments. Subjects viewed a random-dot pattern in one fixation, then judged whether a second dot pattern viewed in a subsequent fixation was identical to or different from the first. Interpattern interval, pattern complexity, and pattern displacement were varied in order to determined the duration, capacity, and representational format of transsaccadic memory. The experimental results indicated that transsaccadic memory is an undetailed, limited-capacity, long-lasting memory that is not strictly tied to absolute spatial position. In all these respects it is similar to, and perhaps identical with, visual short-term memory. The implication of these results for theories of perceptual stability across saccades are discussed.     

Object files across eye movements: Previous fixations affect the latencies of corrective saccades

One of the factors contributing to a seamless visual experience is object correspondence—that is, the integration of pre- and postsaccadic visual object information into one representation. Previous research had suggested that before the execution of a saccade, a target object is loaded into visual working memory and subsequently is used to locate the target object after the saccade. Until now, studies on object correspondence have not taken previous fixations into account. In the present study, we investigated the influence of previously fixated information on object correspondence. To this end, we adapted a gaze correction paradigm in which a saccade was executed toward either a previously fixated or a novel target. During the saccade, the stimuli were displaced such that the participant’s gaze landed between the target stimulus and a distractor. Participants then executed a corrective saccade to the target. The results indicated that these corrective saccades had lower latencies toward previously fixated than toward nonfixated targets, indicating object-specific facilitation. In two follow-up experiments, we showed that presaccadic spatial and object (surface feature) information can contribute separately to the execution of a corrective saccade, as well as in conjunction. Whereas the execution of a corrective saccade to a previously fixated target object at a previously fixated location is slowed down (i.e., inhibition of return), corrective saccades toward either a previously fixated target object or a previously fixated location are facilitated. We concluded that corrective saccades are executed on the basis of object files rather than of unintegrated feature information.     

Information processing during saccadic eye movements

Saccadic eye movements are made at least 100,000 times each day. It is well known that sensitivity to visual input is suppressed during saccades; recent evidence suggests that some kinds of information processing are suppressed as well. Suppression during saccades implies that processing occurs discretely (during eye fixations only), rather than continuously (during both fixations and saccades). We examined this issue in the context of the Posner and Snyder (1975) primed letter-matching task. We found that a prime viewed in one fixation had a larger influence on targets viewed in a second fixation when a long rather than a short saccade separated the two fixations. This result demonstrates that at least some information processing occurs during saccades.     

Integration of form across saccadic eye movements.

To perceive a stable world, one must somehow be able to relate visual information from successive fixations. Little is known, however, about the nature of the integrative process. By using a task which requires the integration of spatial position information from different fixations, it is demonstrated that visual information from previous fixations is preserved in a world-centered representation which is precise enough to support judgements of geometric shape. It is also shown that successive views are aligned with respect to common visual features, indicating that visual stability may be normally accomplished by a visual matching strategy in combination with cancellation by an eye-position signal.     

Memory representations guide targeting eye movements in a natural task

The change blindness phenomenon suggests that visual representations retained across saccades are very limited. In this paper we sought to specify the kind of information that is in fact retained. We investigated targeting performance for saccadic eye movements, since one need for visual representations across eye and body positions may be to guide coordinated movements. We examined saccades in the context of an ongoing sensory motor task in order to make stronger generalizations about natural visual functioning and deployment of attention. Human subjects copied random patterns of coloured blocks on a computer display. Their eye movement pattern was consistent from block to block, including a precise saccade to a previously-placed, neighbouring block during each additional block placement. This natural, consistent eye movement allowed the previously-placed, neighbouring block to serve as an implicit target without instructions to the subject. On random trials, we removed the target object from the display during a preceding saccade, so that observers were required to make the targeting saccade without a currently visible target. Targeting performance was excellent, and appeared to be influenced by spatial information that was not visible during the preceding fixation. Subjects were generally unaware of the disappearance and reappearance of the target. We conclude that spatial information about visual targets is retained across eye movements and used to guide subsequent movements.     

Remapping versus short-term memory in visual stability across saccades

Saccadic eye movements cause displacements of the image of the visual world projected on the retina. Despite the ubiquitous nature of saccades, subjective experience of the world is continuous and stable. In five experiments, we addressed the mechanisms that may support visual stability: matching of pre- and postsaccadic locations of the target by an internal copy of the saccade, or retention of the visual attributes of the target in short-term memory across the saccade. Healthy human adults were instructed to make a saccade to a peripheral Gabor patch. While the saccade was in midflight, the patch could change location, orientation, or both. The change occurred either immediately or following a 250-ms blank during which no visual stimuli were available. In separate experiments, subjects had to report either whether the patch stepped to the left or right or whether the orientation rotated clockwise or counterclockwise. Consistent with previous findings, we found that transsaccadic displacement discrimination was enhanced by the addition of the blank. However, contrary to previous findings reported in the literature, the feature change did not improve performance. Transsaccadic orientation change discrimination did not depend on either an irrelevant temporal blank or a simultaneous irrelevant target displacement. Taken together, these findings suggest that orientation is not a relevant visual feature for transsaccadic correspondence.     

TAM: Explaining off-object fixations and central fixation tendencies as effects of population averaging during search

Understanding how patterns are selected for both recognition and action, in the form of an eye movement, is essential to understanding the mechanisms of visual search. It is argued that selecting a pattern for fixation is time consuming-requiring the pruning of a population of possible saccade vectors to isolate the specific movement to the potential target. To support this position, two experiments are reported showing evidence for off-object fixations, where fixations land between objects rather than directly on objects, and central fixations, where initial saccades land near the center of scenes. Both behaviors were modeled successfully using TAM (Target Acquisition Model; Zelinsky, 2008). TAM interprets these behaviors as expressions of population averaging occurring at different times during saccade target selection. A large population early during search results in the averaging of the entire scene and a central fixation; a smaller population later during search results in averaging between groups of objects and off-object fixations.     

Expedited suppression signal in ocular go/no-go decision

When scrutinizing the visual world, complex and unexpected stimuli often lead to prolonged eye fixations to enhance cognitive processing, likely by temporarily suppressing a planned saccade. The present study examined whether the suppression signal is tightly linked to a specific planned saccade and if it conforms to the viewer's intention. A novel Go/No-go task was devised where participants made consecutive saccades to fixate a stimulus appearing across the screen horizontal meridian in 4° steps. At times, the features of the stimulus (colour and/or shape) were altered when it reappeared at a new location. Participants had to suppress the saccade that would otherwise leave the stimulus if its features matched instructed criteria. Saccade suppression was determined by the reduced probability for saccades towards and away from a target stimulus. Results show both correct suppression to saccades leaving the target and erroneous suppression to saccades towards it. The erroneous suppression was initially observed for any change in features but later lifted. The suppression shortened the length of saccades leaving a target but not those towards it. The initial suppression during previewing the target appears to be based on expedited but incomplete evaluation of visual stimulus, and is not linked to any specific saccade. These properties might reflect the stage of ocular decision based on which the suppression signal is generated. They also account for the phenomenon of “peripheral-to-foveal” effect on eye movements in reading.     

Localization of targets across saccades: Role of landmark objects

Saccadic eye movements are required to bring different parts of the visual world into the foveal region of the retina. With each saccade, the images of the objects drastically change their retinal positions—nevertheless, the visual world appears continuous and does not seem to jump. How does the visual system achieve this continuous and stable percept of the visual world, despite the gross changes of its retinal projection that occur with each saccade? The present paper argues that an important factor of this type of space constancy is formed by the reafferent information, i.e., the visual display that is found when the eyes land. Three experiments demonstrate that objects present across the saccade can serve as landmarks for postsaccadic relocalization. The basic experimental manipulation consisted of a systematic displacement of these landmark objects during the saccade. The effectiveness of the landmarks was determined by analysing to what degree they modify the perceived shift of a small saccade target that was blanked for 200 ms during and after the saccade. A first experiment studied the spatial range where objects become effective as landmarks. The data show that landmarks close to the saccade target and horizontally aligned with the target are specifically effective. The second experiment demonstrates that postsaccadic localization is normally based on relational information about relative stimulus positions transferred across the saccade. A third experiment studied the effect of a prominent background frame on transsaccadic localization; the results suggest that background structures contribute only little to transsaccadic localization.     

Visual span in expert chess players: evidence from eye movements

The reported research extends classic findings that after briefly viewing structured, but not random, chess positions, chess masters reproduce these positions much more accurately than less-skilled players. Using a combination of the gaze-contingent window paradigm and the change blindness flicker paradigm, we documented dramatically larger visual spans for experts while processing structured, but not random, chess positions. In addition, in a check-detection task, a minimized 3 × 3 chessboard containing a King and potentially checking pieces was displayed. In this task, experts made fewer fixations per trial than less-skilled players, and had a greater proportion of fixations between individual pieces, rather than on pieces. Our results provide strong evidence for a perceptual encoding advantage for experts attributable to chess experience, rather than to a general perceptual or memory superiority.     

Saccade programming during short duration fixations: an examination of copy typing, letter detection, and reading.

Three experiments examined saccade programming during short duration fixations between 50 ms and 150 ms. In experiment 1, subjects copy typed text, in experiment 2, subjects read and executed a letter detection task, and in experiment 3, subjects read for comprehension only. Fixation duration had no effect on the size of the departing saccade in the copy typing task; however, saccades leaving short duration fixations were larger than saccades leaving all other fixation durations in the letter detection task and smaller than saccades leaving long fixation durations in the standard reading task. Within Morrison's (1984) model, these results imply, first, that consecutive shifts of attention during a fixation can take different directions and, second, that successive shifts of attention during a fixation support different purposes. Within Fischer's (1986, in press) model, the results imply that the engagement/disengagement of attention and saccade programming do not constitute independent events.     

Target localization after saccades and at fixation: Nontargets both facilitate and bias responses

ABSTRACT

The image on our retina changes every time we make an eye movement. To maintain visual stability after saccades, specifically to locate visual targets, we may use nontarget objects as “landmarks”. In the current study, we compared how the presence of nontargets affects target localization after saccades and during sustained fixation. Participants fixated a target object, which either maintained its location on the screen (sustained-fixation trials), or displaced to trigger a saccade (saccade trials). After the target disappeared, participants reported the most recent target location with a mouse click. We found that the presence of nontargets decreased response error magnitude and variability. However, this nontarget facilitation effect was not larger for saccade trials than sustained-fixation trials, indicating that nontarget facilitation might be a general effect for target localization, rather than of particular importance to post-saccadic stability. Additionally, participants’ responses were biased towards the nontarget locations, particularly when the nontarget-target relationships were preserved in relative coordinates across the saccade. This nontarget bias interacted with biases from other spatial references, e.g., eye movement paths, possibly in a way that emphasized non-redundant information. In summary, the presence of nontargets is one of several sources of reference that combine to influence (both facilitate and bias) target localization.     

Saccades to targets in three-dimensional space: dependence of saccadic latency on target location.

The latency of saccadic movements to targets appearing at various positions in three-dimensional visual space was measured in four experiments. The first experiment confirmed that latencies of saccades to visual targets are greater in the lower visual field and showed that the increase is not influenced by the vertical starting position of the eye in the orbit, nor by a time gap between the fixation offset and the target onset. A hypothesis that this visual field difference was caused by a link between downward saccades and convergence movements was tested by recording saccade latencies when the targets were in a different depth plane from that of the original fixation. We did not find any direct support for the vergence involvement hypothesis, although the lower/upper visual field effect was shown to decrease consistently in monocular viewing. It was also shown that saccades to targets positioned in a different depth plane have longer latencies. In a final experiment, the visual field effect was shown to depend on the egocentric rather than the gravitational vertical.     

Saccades to targets in three-dimensional space: Dependence of saccadic latency on target location

The latency of saccadic movements to targets appearing at various positions in three-dimensional visual space was measured in four experiments. The first experiment confirmed that latencies of saccades to visual targets are greater in the lower visual field and showed that the increase is not influenced by the vertical starting position of the eye in the orbit, nor by a time gap between the fixation offset and the target onset. A hypothesis that this visual field difference was caused by a link between downward saccades and convergence movements was tested by recording saccade latencies when the targets were in a different depth plane from that of the original fixation. We did not find any direct support for the vergence involvement hypothesis, although the lower/upper visual field effect was shown to decrease consistently in monocular viewing. It was also shown that saccades to targets positioned in a different depth plane have longer latencies. In a final experiment, the visual field effect was shown to depend on the egocentric rather than the gravitational vertical.     

高中二年级学生中文阅读知觉广度的眼动研究

采用“呈现随眼动变化技术”对高中二年级学生中文阅读的知觉广度进行了眼动研究。结果发现,高中二年级学生的阅读知觉广度具有不对称性,大约为注视点左侧一个或两个汉字到注视点右侧三个或四个汉字的空间;高中二年级学生在正常阅读中的眼跳距离约为三个汉字的空间,在连续注视的过程中知觉广度有较小范围的重叠。     

Presaccadic attention allocation and express saccades

Express saccades are visually-guided saccades that are characterized by an extremely short latency of about 100 ms. The present experiments tested the hypothesis that a disengagement of visual attention is necessary for the generation of express saccades. All subjects produced large numbers of express saccades in the gap paradigm, in which the fixation stimulus is removed 200 ms before target onset (Exp. 1), but not in the overlap paradigm, in which the fixation stimulus remains on during the entire trial (Exp. 2). By means of peripheral cues (Exps. 3–5) and central cues (Exps. 6–7), visual attention was directed at the target location for the saccade before the actual appearance of the saccade target. In all experiments, the location cues facilitated rather than abolished express saccades. The generation of express saccades was facilitated even when the currently fixated visual stimulus was not removed before target onset (fixation-overlap; Exps. 5–7). The results are explained by the hypothesis that a disengagement of a separate fixation system is necessary for the generation of express saccades, a hypothesis that is in line with current neurobiological findings.