Localization of targets across saccades: Role of landmark objects

Saccadic eye movements are required to bring different parts of the visual world into the foveal region of the retina. With each saccade, the images of the objects drastically change their retinal positions—nevertheless, the visual world appears continuous and does not seem to jump. How does the visual system achieve this continuous and stable percept of the visual world, despite the gross changes of its retinal projection that occur with each saccade? The present paper argues that an important factor of this type of space constancy is formed by the reafferent information, i.e., the visual display that is found when the eyes land. Three experiments demonstrate that objects present across the saccade can serve as landmarks for postsaccadic relocalization. The basic experimental manipulation consisted of a systematic displacement of these landmark objects during the saccade. The effectiveness of the landmarks was determined by analysing to what degree they modify the perceived shift of a small saccade target that was blanked for 200 ms during and after the saccade. A first experiment studied the spatial range where objects become effective as landmarks. The data show that landmarks close to the saccade target and horizontally aligned with the target are specifically effective. The second experiment demonstrates that postsaccadic localization is normally based on relational information about relative stimulus positions transferred across the saccade. A third experiment studied the effect of a prominent background frame on transsaccadic localization; the results suggest that background structures contribute only little to transsaccadic localization.     

Transsaccadic memory for position and orientation of saccade source and target

Participants made a saccade from one biological-motion figure to another and had to detect saccadecontingent changes in either the walker to which the eyes were sent (the target) or the walker that served as launch site (the source). Intrasaccadic displacements in both source and target were relatively hard to detect, whereas changes in the walkers' depth orientation were readily noticed, indicating that previous findings on within-object saccades generalize to between-objects saccades. Contrary to predictions derived from theories that assign a privileged status to the saccade target, transsaccadic memory for the target's position and orientation was not more accurate than memory for the source. Displacements or rotations of one object toward the other object were more detectable than the same changes away from each other, suggesting that relational coding plays a prominent role in the integration of information across saccades.     

Feature-based attention across saccades: Pop-out in color search is spatiotopic

Our perception of the world remains stable despite the retinal shifts that occur with each saccade. The role of spatial attention in matching pre- to postsaccadic visual information has been well established, but the role of feature-based attention remains unclear. In this study, we examined the transsaccadic processing of a color pop-out target. Participants made a saccade towards a neutral target and performed a search task on a peripheral array presented once the saccade landed. A similar array was presented just before the saccade and we analyzed what aspect of this preview benefitted the postsaccadic search task. We assessed the preview effect in the spatiotopic and retinotopic reference frames, and the potential transfer of feature selectivity across the saccade. In the first experiment, the target and distractor colors remained identical for the preview and the postsaccadic array and performance improved. The largest benefit was observed at the spatiotopic location. In the second experiment, the target and distractor colors were swapped across the saccade. All responses were slowed but the cost was least at the spatiotopic location. Our results show that the preview attracted spatial attention to the target location, which was then remapped, and suggest that previewed features, specifically colors, were transferred across the saccade. Furthermore, the preview induced a spatiotopic advantage regardless of whether the target switched color or not, suggesting that spatiotopy was established independently of feature processing. Our results support independent priming effects of features versus location and underline the role of feature-based selection in visual stability.     

Types and tokens in transsaccadic object identification: effects of spatial position and left-right orientation

What types of representations support our ability to integrate information acquired during one eye fixation with information acquired during the next fixation? In Experiment 1, transsaccadic integration was explored by manipulating whether or not the relative position of a picture of an object was maintained across a saccade. In Experiment 2, the degree to which visual details of a picture are coded in a position-specific representational system was explored by manipulating whether or not both the relative position and the left-right orientation of the picture were maintained across a saccade. Position-specific and nonspecific preview benefits were observed in both experiments. Only the position-specific benefits were influenced by the number of task-relevant pictures presented in the preview display (Experiment 1) and the left-right orientation of the picture presented in the preview display (Experiment 2). The results support a model of transsaccadic integration based on two independent representational systems. One system codes abstract, prestored object types, and the other codes episodic tokens consisting of stimulus properties linked to scene- or configuration-based position markers.     

How visual spatial attention alters perception

Visual attention is essential for visual perception. Spatial attention allows us to grant priority in processing and selectively process information at a given location. In this paper, I explain how two kinds of spatial attention: covert (allocated to the target location, without accompanying eye movements) and presaccadic (allocated to the location of the upcoming saccade’s target) affect performance and alter appearance. First, I highlight some behavioral and neuroimaging research on covert attention, which alters performance and appearance in many basic visual tasks. Second, I review studies showing that presaccadic attention improves performance and alters appearance at the saccade target location. Further, these modulations change the processing of feature information automatically, even when it is detrimental to the task at hand. We propose that saccade preparation may support transsaccadic integration. Systematically investigating the common and differential characteristics of covert attention and presaccadic attention will continue to further our understanding of the pervasive selective processing of information, which enables us to make sense of our complex visual world.     

Transsaccadic integration of bystander locations

The present study investigated whether and how the location of bystander objects is encoded, maintained, and integrated across an eye movement. Bystander objects are objects that remain unfixated directly before and after the saccade for which transsaccadic integration is being examined. Three experiments are reported that examine location coding of bystander objects relative to the future saccade target object, relative to the saccade source object, and relative to other bystander objects. Participants were presented with a random‐dot pattern and made a saccade from a central source to a designated saccade target. During this saccade the position of a single bystander was changed on half of the trials and participants had to detect the displacement. Postsaccadically the presence of the target, source, and other bystanders was manipulated. Results indicated that the location of bystander objects could be integrated across a saccade, and that this relied on configurational coding. Furthermore the present data provide evidence for the view that transsaccadic perception of spatial layout is not inevitably tied to the saccade target or the saccade source, that it makes use of objects and object configurations in a flexible manner that is partly governed by the task relevance of the various display items, and that it exploits the incidental configurational structure in the display's layout in order to increase its capacity limits.     

Eye movements can cause item-specific visual recognition advantages

Prior research suggests that spontaneous saccades localized towards blank regions of space during memory storage and recall improve memory for items at the saccade locations. In the present study, we examined whether a recognition advantage can be observed when a single, exogenously directed saccade occurs during memory maintenance. We manipulated whether participants made a saccade to an item’s previous location or maintained fixation, as well as whether tested items reappeared in their original location or not. The results of three experiments showed that visual recognition was better after a saccade to the location of a probed object than after no saccade or after a saccade to the location of a non-probed object, so long as saccades went to the to-be-tested location more often than chance. Taken together, our findings demonstrate that eye movements can elicit an item-specific recognition advantage in visual working memory.     

Investigating the parameters of transsaccadic memory: inhibition of return impedes information acquisition near a saccade target

A limited amount of visual information is retained between saccades, which is subsequently stored into a memory system, such as transsaccadic memory. Since the capacity of transsaccadic memory is limited, selection of information is crucial. Selection of relevant information is modulated by attentional processes such as the presaccadic shift of attention. This involuntary shift of attention occurs prior to execution of the saccade and leads to information acquisition at an intended saccade target. The aim of the present study was to investigate the influence that another attentional effect, inhibition of return (IOR), has on the information that gets stored into transsaccadic memory. IOR is the phenomenon where participants are slower to respond to a cue at a previously attended location. To this end, we used a transsaccadic memory paradigm in which stimuli, oriented on a horizontal axis relative to saccade direction, are only visible to the participant before executing a saccade. Previous research showed that items in close proximity to a saccade target are likely to be reported more accurately. In our current study, participants were cued to fixate one of the stimulus locations and subsequently refixated the centre fixation point before executing the transsaccadic memory task. Results indicate that information at a location near a saccade landing point is less likely to be acquired into transsaccadic memory when this location was previously associated with IOR. Furthermore, we found evidence which implicates a reduction of the overall amount of elements retained in transsaccadic memory when a location near a saccade target is associated with IOR. These results suggest that the presaccadic shift of attention may be modulated by IOR and thereby reduces information acquisition by transsaccadic memory.     

Attentional selection of objects or features: evidence from a modified search task

Three experiments examined the domain of visual selective attention (i.e., feature-based selection vs. object-based selection). Experiment 1 extended the requirements of the visual search task by requiring a feature discrimination response to target elements presented for short durations (30-105 msec). Targets were embedded in 47 distractor elements and were defined by either a distinct color or a distinct orientation. Observers made a discrimination response to either the target's color or its orientation. When the target-defining feature and the feature to be discriminated were the same (matched conditions), accuracy was enhanced relative to when these features belonged to separate dimensions (mismatched conditions). In Experiment 2, similar results were found in a task in which the target-defining dimension varied from trial to trial and observers performed both color and orientation discriminations on every trial. The results from these two experiments are consistent with feature-based attentional selection, but not with object-based selection. Experiment 3 extended these findings by showing that the effect is rooted in the overlap between target and distractor values in the stimulus set. The results are discussed in the context of recent models of visual selective attention.     

Visual direction constancy across eyeblinks

When a visual target is displaced during a saccade, the perception of its displacement is suppressed. Its movement can usually only be detected if the displacement is quite large. This suppression can be eliminated by introducing a short blank period after the saccade and before the target reappears in a new location. This has been termed the blanking effect and has been attributed to the use of otherwise ignored extraretinal information. We examined whether similar effects occur with eyeblinks and other visual distractions. We found that suppression of displacement perception can also occur due to a blink (both immediately prior to the blink and during the blink), and that introducing a blank period after a blink reduces the displacement suppression in much the same way as after a saccade. The blanking effect does not occur when other visual distractions are used. This provides further support for the conclusion that the blanking effect arises from extraretinal signals about eye position.     

TRANSSACCADIC MEMORY AND INTEGRATION DURING REAL-WORLD OBJECT PERCEPTION

Abstract— What is the nature of the information that is preserved and combined across saccadic eye movements during the visual analysis of real-world objects? The two experiments reported investigated transsaccadic memory and transsaccadic integration, respectively In the critical condition, participants were presented with one set of contours from an object during one fixation and with a complementary set of contours during the next fixation In Experiment 1, participants could at best inconsistently detect contour changes across the saccade In Experiment 2, a change in visible contour had no influence on object identification. These results suggest that a veridical representation of object contour is neither consistently preserved nor integrated across a saccade.     

Effects of perceptual context on transsaccadic visual matching

Transsaccadic visual matching refers to the phenomenon in which presaccadic signals at the location of the saccade goal influence the visibility of postsaccadic test signals presented at the fovea (Jüttner & Röhler, 1993). The present study uses variations of the perceptual context, provided by the structure of the presaccadic stimulus display, to investigate the influence of spatial information, decision factors, and visual attention on this form of transsaccadic information processing. The experiments yielded the following results: First, analysis of the data in terms of signal detection theory revealed that transsaccadic visual matching manifests in a shift of decision criterion (ß) rather than in a change of sensory sensitivity (d′). The criterion shift leads to a suppression of postsaccadic stimulus information that is incompatible with presaccadic processed information. Second, the matching effect strongly depends on the structure of the presaccadic display, which suggests that mechanisms of visual attention provide the spatial binding of pre- and postsaccadic stimulus information. Third, transsaccadic matching is phenomenologically tied to the execution of the saccade and effective during a postsaccadic period extending up to 160 msec after termination of the eye movement. These findings indicate a form of context-sensitive evaluation process that could subsidize the maintenance of visual stability.     

Information integration across saccadic eye movements

The visual world contains more information than can be perceived in a single glance. Consequently, one's perceptual representation of the environment is built up via the integration of information across saccadic eye movements. The properties of transsaccadic integration were investigated in six experiments. Subjects viewed a random-dot pattern in one fixation, then judged whether a second dot pattern viewed in a subsequent fixation was identical to or different from the first. Interpattern interval, pattern complexity, and pattern displacement were varied in order to determined the duration, capacity, and representational format of transsaccadic memory. The experimental results indicated that transsaccadic memory is an undetailed, limited-capacity, long-lasting memory that is not strictly tied to absolute spatial position. In all these respects it is similar to, and perhaps identical with, visual short-term memory. The implication of these results for theories of perceptual stability across saccades are discussed.     

Object files across eye movements: Previous fixations affect the latencies of corrective saccades

One of the factors contributing to a seamless visual experience is object correspondence—that is, the integration of pre- and postsaccadic visual object information into one representation. Previous research had suggested that before the execution of a saccade, a target object is loaded into visual working memory and subsequently is used to locate the target object after the saccade. Until now, studies on object correspondence have not taken previous fixations into account. In the present study, we investigated the influence of previously fixated information on object correspondence. To this end, we adapted a gaze correction paradigm in which a saccade was executed toward either a previously fixated or a novel target. During the saccade, the stimuli were displaced such that the participant’s gaze landed between the target stimulus and a distractor. Participants then executed a corrective saccade to the target. The results indicated that these corrective saccades had lower latencies toward previously fixated than toward nonfixated targets, indicating object-specific facilitation. In two follow-up experiments, we showed that presaccadic spatial and object (surface feature) information can contribute separately to the execution of a corrective saccade, as well as in conjunction. Whereas the execution of a corrective saccade to a previously fixated target object at a previously fixated location is slowed down (i.e., inhibition of return), corrective saccades toward either a previously fixated target object or a previously fixated location are facilitated. We concluded that corrective saccades are executed on the basis of object files rather than of unintegrated feature information.     

眼跳的双相调节理论的行为证据

为了研究眼跳的双相调节理论是否适用于人类的视觉系统,本研究测量了人类被试对分别呈现在三种眼跳时间段（基线、眼跳抑制和眼跳增强）内的光栅的朝向辨别准确率。研究发现：相对于光栅呈现在基线时间段内,被试对呈现在抑制（或增强）时间段内的光栅的朝向辨别准确率显著地更低（或更高）（实验1）;另外,只有使用低或中等空间频率光栅作为测试刺激时,才有这种双相调节作用（实验2）。这些结果表明：人类的视觉系统在眼跳过程中存在双相调节机制,并且这种双相调节机制具有刺激选择性。     

Visual working memory enhances target discrimination accuracy with single-item displays

The maintenance of information in visual working memory has been shown to bias the concurrent processing in favor of matching visual input. The present study aimed to examine whether this bias can act at an early stage of processing to enhance target feature perception in single-item displays. Participants were sequentially presented with two distinct colored stimuli as memory samples and a retro-cue indicating which of the two samples should be maintained for subsequent memory test. During the retention interval, they had to discriminate the gap orientation of a Landolt target presented through a single visual stimulus that could match one or neither of the two samples. Across two experiments, we consistently found that discrimination performance was more accurate when the Landolt target was situated within a stimulus that matched the sample being retained in visual working memory, as compared with when the target was not. This effect cannot be attributed to the mechanism of passive priming, because we failed to observe priming effects when the stimulus containing the target matched the sample that was retro-cued to be irrelevant to the working memory task, as compared to when the stimulus matched neither sample. Given the fact that target stimuli were presented in single-item displays wherein external noise was precluded, the present findings demonstrate that the working memory bias of visual attention operating in the absence of stimulus competition facilitates early perceptual processing at the attended location via signal enhancement.

     

Episodic Representation of Diagnostic and Non-Diagnostic Object Color

In three experiments, we investigated transsaccadic object file representations. In each experiment, participants moved their eyes from a central fixation cross to a saccade target located between two peripheral objects. During the saccade, this preview display was replaced with a target display containing a single object to be named. On trials in which the target identity matched one of the preview objects, its color either matched or did not match the previewed object color. The results indicated that color changes disrupt perceptual continuity, but only for the class of objects for which color is diagnostic of object identity. When the color is not integral to identifying an object (for example, when the object is a letter or an object without a characteristic color), object continuity is preserved regardless of changes to the object's color. These results suggest that object features that are important for defining the object are incorporated into its episodic representation. Furthermore, the results are consistent with previous work showing that the quality of a feature's representation determines its importance in preserving continuity.     

When does visual attention select all features of a distractor?

What happens after visual attention is allocated to an object? Although many theories of attention assume that all of its features are selected and processed, there has been little direct evidence that an irrelevant feature dimension of an attended nontarget is processed. In 5 experiments presented here, the authors used a singleton paradigm to investigate the effect of attention on nontarget objects. Participants made a speeded feature discrimination of a target for which the response was either compatible or incompatible with an irrelevant feature dimension of a distractor. The results show that the irrelevant distractor features were processed to the point that they interfered with the response to the target. The response compatibility effect was observed even when the location of the target or the distractor was invariant, although it was much weaker when both locations were invariant. These results demonstrate that in many circumstances, an attended distractor is completely selected and fully processed, and the complete processing of distractors depends on a number of factors, many of which are related to the strength of attention to the distractor.     

Episodic representation of diagnostic and nondiagnostic object colour

In three experiments, we investigated transsaccadic object file representations. In each experiment, participants moved their eyes from a central fixation cross to a saccade target located between two peripheral objects. During the saccade, this preview display was replaced with a target display containing a single object to be named. On trials in which the target identity matched one of the preview objects, its colour either matched or did not match the previewed object colour. The results indicated that colour changes disrupt perceptual continuity, but only for the class of objects for which colour is diagnostic of object identity. When the colour is not integral to identifying an object (for example, when the object is a letter or an object without a characteristic colour), object continuity is preserved regardless of changes to the object's colour. These results suggest that object features that are important for defining the object are incorporated into its episodic representation. Furthermore, the results are consistent with previous work showing that the quality of a feature's representation determines its importance in preserving continuity.     

Temporal attentional capture: Effects of irrelevant singletons on rapid serial visual search

The presence of a unique yet irrelevantsingleton in visual search or spatial-cuing tasks is typically associated with performance costs, suggesting that singletons tend to capture attention. However, since singletons have always been spatially separated from targets in previous experiments, it remains unclear whether an irrelevant visual singleton that occurs at the same spatial location as the target but at a different point in time can produce temporal capture of attention. Here, we asked participants to search visual sequences at fixation for targets defined by size (larger or smaller than the nontargets). The presence (vs. absence) of a color singleton lengthened response times on the size discrimination task, suggesting that irrelevant singletons can lead to a temporal attentional capture.