Features,as well as space and time,guide object persistence

What role do surface features (e.g., color) play in the establishment and maintenance of episodic representations of objects (object files)? Mitroff and Alvarez (2007) showed that stimuli that were linked by a continuous spatiotemporal history yielded object-specific preview benefits—a standard index of object files—whereas stimuli linked only by shared surface features did not. Here, it is shown that abruptly changing the features of an object that has been established on the basis of spatiotemporal history can disrupt object-specific preview benefits (Experiments 1 and 2). Moreover, under some conditions, feature match alone can give rise to the preview benefits (Experiment 3). These results indicate that surface features, as well as spatiotemporal factors, play an important role in establishing and maintaining episodic object representations.     

The role of physical and conceptual properties in preserving object continuity

Six experiments investigated the nature of the object-file representation supporting object continuity. Participants viewed preview displays consisting of 2 stimuli (either line drawings or words) presented within square frames, followed by a target display consisting of a single stimulus (either a word or a picture) presented within 1 of the frames. The relationship between the target and preview stimuli was manipulated. The first 2 experiments found that participants responded more quickly when the target was identical to the preview stimulus in the same frame (object-specific priming). In Experiments 3, 4, 5, and 6, the physical form of the target stimulus (a word or picture in 1 frame) was changed completely from that of either preview stimulus (pictures or words in both frames). Despite this physical change, object-specific priming was observed. It is suggested that object files encode postcategorical information, rather than precise physical information.     

Are objects required for object-files? Roles of segmentation and spatiotemporal continuity in computing object persistence

Two central tasks of visual processing are (1) to segment undifferentiated retinal images into discrete objects, and (2) to represent those objects as the same persisting individuals over time and motion. Here we explore the interaction of these two types of processing in the context of object files—mid-level visual representations that “stick” to moving objects on the basis of spatiotemporal properties. Object files can be revealed by object-specific preview benefits (OSPBs), wherein a “preview” of information on a moving object speeds the recognition of that information at a later point when it appears again on the same object (compared to when it reappears on a different moving object), beyond display-wide priming. Here we explore the degree of segmentation required to establish object files in the first place. Surprisingly, we find that no explicit segmentation is required until after the previews disappear, when using purely motion-defined objects (consisting of random elements on a random background). Moreover, OSPBs are observed in such displays even after moderate (but not long) delays between the offset of the preview information and the onset of the motion. These effects indicate that object files can be established without initial static segmentation cues, so long as there is spatiotemporal continuity between the previews and the eventual appearance of the objects. We also find that top-down strategies can sometimes mimic OSPBs, but that these strategies can be eliminated by novel manipulations. We discuss how these results alter our understanding of the nature of object files, and also why researchers must take care to distinguish “true OSPBs” from “illusory OSPBs”.     

Object continuity and the transsaccadic representation of form

Transsaccadic object file representations were investigated in three experiments. Subjects moved their eyes from a central fixation cross to a location between two peripheral objects. During the saccade, this preview display was replaced with a target display containing a single object to be named. On trials on which the target identity matched one of the preview objects, its orientation either matched or did not match the previewed orientation. The results of Experiments 1 and 2 revealed that orientation changes disrupt perceptual continuity for objects located near fixation, but not for objects located further from fixation. The results of Experiment 3 confirmed that orientation changes do not disrupt continuity for distant objects, while showing that subjects nevertheless maintain an object-specific representation of the orientation of such objects. Together, the results suggest that object files represent orientation but that whether or not orientation plays a role in the processes that determine continuity depends on the quality of the perceptual representation.     

Initial scene representations facilitate eye movement guidance in visual search

What role does the initial glimpse of a scene play in subsequent eye movement guidance? In 4 experiments, a brief scene preview was followed by object search through the scene via a small moving window that was tied to fixation position. Experiment 1 demonstrated that the scene preview resulted in more efficient eye movements compared with a control preview. Experiments 2 and 3 showed that this scene preview benefit was not due to the conceptual category of the scene or identification of the target object in the preview. Experiment 4 demonstrated that the scene preview benefit was unaffected by changing the size of the scene from preview to search. Taken together, the results suggest that an abstract (size invariant) visual representation is generated in an initial scene glimpse and that this representation can be retained in memory and used to guide subsequent eye movements.     

Identifying objects across saccades: effects of extrafoveal preview and flanker object context.

Two object-naming experiments explored the influence of extrafoveal preview information and flanker object context on transsaccadic object identification. Both the presence of an extrafoveal preview of the target object and the contextual constraint provided by extrafoveal flanker objects were found to influence the speed of object identification, but the latter effect occurred only when an extrafoveal preview of the target object was not presented prior to fixation. The context effect was found to be due to facilitation from related flankers rather than inhibition from unrelated flankers. No evidence was obtained for the hypothesis that constraining context can increase the usefulness of an extrafoveal preview of a to-be-fixated object.     

Role of spatial location in integration of pictorial information across saccades

Identification of a fixated object in a visual display is facilitated by integrating information from a preview of that object in the periphery with information extracted on the subsequent foveal fixation (Pollatsek, Rayner, & Collins, 1984). These experiments investigated the extent to which this integration is dependent on the spatial location of the information remaining constant. Two preview objects were presented in the periphery; Ss fixated that region and named a single target object that appeared in the same spatial location in which one of the two preview objects had been presented. Of primary interest was the facilitative effect when a preview object was identical to the target object as a function of whether they were in the same spatial location. The major finding was that although there was a small effect of switching, there was still a substantial preview benefit even when the location of the identical object switched. In addition, the switching effect did not interact with the level of identity between the preview and target. There was also a preview benefit in conditions in which there were no eye movements and the preview and target objects were at least 5 degrees apart. Thus, the data indicate that the process object identification is relatively insensitive to location information and that object information and location information are coded fairly independently.     

Surface feature congruency effects in the object-reviewing paradigm are dependent on task memory demands

Perception of object continuity depends on establishing correspondence between objects viewed across disruptions in visual information. The role of spatiotemporal information in guiding object continuity is well documented; the role of surface features, however, is controversial. Some researchers have shown an object-specific preview benefit (OSPB)—a standard index of object continuity—only when correspondence could be based on an object’s spatiotemporal information, whereas others have found color-based OSPB, suggesting that surface features can also guide object continuity. This study shows that surface feature-based OSPB is dependent on the task memory demands. When the task involved letters and matching just one target letter to the preview ones, no color congruency effect was found under spatiotemporal discontinuity and spatiotemporal ambiguity (Experiments 1–3), indicating that the absence of feature-based OSPB cannot be accounted for by salient spatiotemporal discontinuity. When the task involved complex shapes and matching two target shapes to the preview ones, color-based OSPB was obtained. Critically, however, when a visual working memory task was performed concurrently with the matching task, the presence of a nonspatial (but not a spatial) working memory load eliminated the color-based OSPB (Experiments 4 and 5). These results suggest that the surface feature congruency effects that are observed in the object-reviewing paradigm (with the matching task) reflect memory-based strategies that participants use to solve a memory-demanding task; therefore, they are not reliable measures of online object continuity and cannot be taken as evidence for the role of surface features in establishing object correspondence.     

View-specific effects of depth rotation and foreshortening on the initial recognition and priming of familiar objects

In a series of three experiments, we examined, first, the effects of viewpoint in depth on the efficiency of initial picture naming and, second, the effects of priming on subsequent naming. On initial presentation, foreshortened views were harder to name than were more typical (nonforeshortened) views. In addition, priming increased as a function of the similarity of the prime and target. Indeed, if a foreshortened view of an object had already been named, the subjects named a subsequent foreshortened view of that object as fast as or faster than they named a subsequent, more typical view. These results provide evidence against theories that predict full view-invariant object recognition and view-invariant priming of object recognition. Instead, the results support theories that suggest that object recognition is mediated by stored representations that are both view- and object-specific.     

Resisting change: The influence of luminance changes on visual marking and the preview benefit

Visual search can benefit when one set of distractors is presented as a preview, prior to the appearance the second set of distractors plus the target (Watson & Humphreys, 1997). It has been shown that changing the shape of the old, previewed stimuli when the new items appear causes the old stimuli to recompete for selection with the new ones. In contrast, changing the luminance or color of the old stimuli has no detrimental effects. Here, we present five experiments that reassessed the effect of luminance changes in preview search. We show (1) that preview search is remarkably resistant to large changes in the absolute luminance of the old stimuli, even when those changes would ordinarily be sufficient to signal the appearance of a new object and draw attention (Experiments 1 and 2), and (2) that resistance to luminance changes can be bolstered by feature-based inhibitory processes (Experiments 3–5). These findings are discussed in terms of the possible ecological properties of time-based visual selection and possible mechanisms underlying the preview benefit.     

Inhibition and anticipation in visual search: evidence from effects of color foreknowledge on preview search

We present four experiments in which we examined the effects of color mixing and prior target color knowledge on preview search (Watson & Humphreys, 1997). The task was to detect a target letter (an N or a Z) that appeared along with other new letters, when old distractors remained in the visual field. In some conditions, participants were told the target's color, in others, they were not. Foreknowledge of the target's color produced large improvements in search for both baseline and preview presentations (Experiment 1). For preview presentations, the magnitude of this effect was reduced if the target shared its color with a single colored set of previewed letters (Experiment 2). Removing this similarity across the displays greatly improved search efficiency (Experiment 3). In Experiment 4, we assessed and rejected the proposal that the effects reflected the probability that the target was carried by a particular color. We discuss the results in terms of separate effects of (1) inhibitory carryover from a preview color group and (2) an anticipatory set for a known target color.     

Divide and conquer: how object files adapt when a persisting object splits into two

Coherent visual experience requires not only segmenting incoming visual input into a structured scene of objects, but also binding discrete views of objects into dynamic representations that persist across time and motion. However, surprisingly little work has explored the principles that guide the construction and maintenance of such persisting object representations. What causes a part of the visual field to be treated as the same object over time? In the cognitive development literature, a key principle of object persistence is cohesion: An object must always maintain a single bounded contour. Here we demonstrate for the first time that mechanisms of adult midlevel vision are affected by cohesion violations. Using the object-file framework, we tested whether object-specific preview benefits-a hallmark of persisting object representations-are obtained for dynamic objects that split into two during their motion. We found that these preview benefits do not fully persist through such cohesion violations without incurring significant performance costs. These results illustrate how cohesion is employed as a constraint that guides the maintenance of object representations in adult midlevel vision.     

Episodic representation of diagnostic and nondiagnostic object colour

In three experiments, we investigated transsaccadic object file representations. In each experiment, participants moved their eyes from a central fixation cross to a saccade target located between two peripheral objects. During the saccade, this preview display was replaced with a target display containing a single object to be named. On trials in which the target identity matched one of the preview objects, its colour either matched or did not match the previewed object colour. The results indicated that colour changes disrupt perceptual continuity, but only for the class of objects for which colour is diagnostic of object identity. When the colour is not integral to identifying an object (for example, when the object is a letter or an object without a characteristic colour), object continuity is preserved regardless of changes to the object's colour. These results suggest that object features that are important for defining the object are incorporated into its episodic representation. Furthermore, the results are consistent with previous work showing that the quality of a feature's representation determines its importance in preserving continuity.     

Episodic Representation of Diagnostic and Non-Diagnostic Object Color

In three experiments, we investigated transsaccadic object file representations. In each experiment, participants moved their eyes from a central fixation cross to a saccade target located between two peripheral objects. During the saccade, this preview display was replaced with a target display containing a single object to be named. On trials in which the target identity matched one of the preview objects, its color either matched or did not match the previewed object color. The results indicated that color changes disrupt perceptual continuity, but only for the class of objects for which color is diagnostic of object identity. When the color is not integral to identifying an object (for example, when the object is a letter or an object without a characteristic color), object continuity is preserved regardless of changes to the object's color. These results suggest that object features that are important for defining the object are incorporated into its episodic representation. Furthermore, the results are consistent with previous work showing that the quality of a feature's representation determines its importance in preserving continuity.     

The spread of attention to hidden portions of occluded surfaces

We report two experiments in which the two-rectangles method of Egly, Driver, and Rafal (1994) was used to test whether object-specific attentional cuing advantages can spread to hidden portions of occluded objects. Displays began with portions of two rectangles hidden by a third, occluding object. One end of one of the two rectangles was cued, after which the occluder rotated around its center point and target stimuli were presented. In one condition, the occluder was removed from in front of the other objects, either by rotating away from them (Experiment 1B) or by rotating and then slipping behind them (Experiment 1B). In another condition, the occluder first rotated away but then returned to its original position. In both experiments, an object-specific cuing advantage occurred in the occluderremoved condition for targets that appeared in what had been hidden locations of the cued object. No analogous advantage occurred in the occluder-returned condition.     

A new response-time measure of object persistence in the tunnel effect

The recognition of information about an object is facilitated by a preview of the information concerning that object. This facilitation is regarded as evidence for the representational persistence of the object. It is not known, however, if such facilitation is obtained even under the tunnel effect, in which a moving object is temporarily occluded. This facilitation may be a new way to measure the representational persistence of a moving object in the tunnel effect. We addressed this question by a "same-different" judgment task of a target symbol (" composite function" or "+"), drawn within the moving object, before and after encountering the occluder. Response times (RTs) were shorter when the object reappeared with spatial continuity at the proper place than it reappeared at the improper place, as in Experiments 1 and 3. Thus, facilitation was obtained even in the tunnel effect. When the occluder was invisible and deletion/accretion cues along the contour of the occluder were either removed (Experiment 2) or given improperly (Experiment 4), no facilitation was found. These results clearly indicate that the facilitated recognition was caused by amodal integration of the persisting representation from the unoccluded and modal phases. The present study demonstrates that the facilitated recognition (RT measurement) can be used to investigate the representational persistence in the tunnel effect.     

Transsaccadic perception of saccade target and flanker objects

To account for location-dependent and location-independent preview benefits in transsaccadic object perception, J. M. Henderson (1994) and J. M. Henderson and M. D. Anes (1994) proposed a dual-route model in which both episodic object representations and long-term memory representations store information across a saccade. Four experiments are reported in which the dual-route model was assessed. Preview benefits for saccade target objects were found to be location independent, whereas preview benefits for flanker objects were location dependent. These results support a single-route, 2-stage model of transsaccadic object perception. First, preattentive object files are set up to parse a set of attentional and/or saccade targets from peripheral vision, causing location-dependent preview benefits. Second, 1 object is attentionally selected for further processing, activating long-term memory representations and resulting in location-independent preview benefits.     

Spreading suppression and the guidance of search by movement: Evidence from negative color carry-over effects

A growing number of studies have shown that significant impairments to search and selection can occur if the target item carries a feature of the irrelevant distractors currently being ignored Braithwaite, Humphreys, and Hodsoll (Journal of Experimental Psychology: Human Perception and Performance, 29, 758–778, 2003). However, these effects have been documented only when search has been extended over time (i.e., in preview search), and not in standard search displays with simultaneously presented items. Here, we present the first evidence that similar costs to selection can occur in simultaneous displays under appropriate circumstances. In the present experiment, participants searched a display for a moving target letter among static and moving distractors. Search efficiency was significantly enhanced for a moving target when half of the letters moved (and half remained static), allowing the static items to be excluded from search. However, if the moving target then shared its color with the irrelevant static items, significant costs emerged, relative to baselines. These results are consistent with the involvement of a general feature-based suppression mechanism in selection, operating over space as well as time.     

Preview benefit in speaking occurs regardless of preview timing

Speakers access information from objects they will name but have not looked at yet, indexed by preview benefit—faster processing of the target when a preview object previously occupying its location was related rather than unrelated to the target. This suggests that speakers distribute attention over multiple objects, but it does not reveal the time course of the processing of a current and a to-be-named object. Is the preview benefit a consequence of attention shifting to the next-to-be-named object shortly before the eyes move to that location, or does the benefit reflect a more unconstrained deployment of attention to upcoming objects? Using the multiple-object naming paradigm with a gaze-contingent display change manipulation, we addressed this issue by manipulating the latency of the onset of the preview (SOA) and whether the preview represented the same concept as (but a different visual token of) the target or an unrelated concept. The results revealed that the preview benefit was robust, regardless of the latency of the preview onset or the latency of the saccade to the target (the lag between preview offset and fixation on the target). Together, these data suggest that preview benefit is not restricted to the time during an attention shift preceding an eye movement, and that speakers are able to take advantage of information from nonfoveal objects whenever such objects are visually available.