Spatial attention is necessary for object-based attention: Evidence from temporal-order judgments

Attentional selection is a dynamic process that relies on multiple types of representations. That object representations contribute to attentional selection has been known for decades; however, most evidence for this contribution has been gleaned from studies that have relied on various forms of spatial cueing (some endogenous and some exogenous). It has thus remained unclear whether object-based attentional selection is a direct result of spatial cuing, or whether it still emerges without any spatial marker. Here we used a novel method—the temporal-order judgment (TOJ)—to examine whether object-based guidance emerges in the absence of spatial cuing. Participants were presented with two rectangles oriented either horizontally or vertically. Following a 150-ms preview time, two target stimuli were presented on the same or on different objects, and participants were asked to report which of the two stimuli had appeared first. The targets consisted of stimuli that formed a percept of a “hole” or a “hill.” First, we demonstrated that the “hill” target was indeed processed faster, as evidenced by a positive perceived simultaneity (PSS) measure. We then demonstrated that if two targets appeared with equal probabilities on the same and on different objects, the PSS values, although positive, were not modulated by the objects. In a subsequent set of experiments, we showed that objects can modulate attentional allocation—however, only when they are biased by a spatial (endogenous) cue. In other words, in the absence of a spatial cue or bias, object representations do not guide attentional selection. In addition to providing new constraints for theories of object-based attentional guidance, these experiments introduce a novel paradigm for measuring object-based attentional effects.     

Object-based attention: Shifting or uncertainty?

The contribution of object-based attentional guidance to visual processing is widely accepted, and recent models of attentional selection now include both space- and object-based representations. Nevertheless, although the mechanism of space-based attentional selection has been well characterized, the mechanism underlying object-based attentional selection remains poorly understood. Recent attempts at identifying the mechanism giving rise to object-based attentional selection have put forth two conflicting alternatives. The first suggests that object-based effects are driven by attentional uncertainty (i.e., the attentional prioritization hypothesis), whereas the second suggests that objects guide attentional selection only when an attentional shift is necessitated (i.e., the attentional-shifting hypothesis). Here, we directly investigated which of the two suggested accounts drives object-based effects, by pitting attentional certainty against attentional shifting. In a series of four experiments, we manipulated the certainty of target location, shifting of attention, and the stimulus onset asynchrony. It was observed that object-based effects depended solely on certainty of the forthcoming target location. These results suggest that attentional prioritization, and not a mere shift of attention, gives rise to object-based guidance of attentional selection. In addition, these results lend further support to the attentional prioritization account of object-based attention and provide further constraints on the mechanisms of object-based selection.     

The return of object-based attention: selection of multiple-region objects

Objects can control the focus of attention, allowing features on the same object to be selected more easily than features on different objects. In the present experiments, we investigated the perceptual processes that contribute to such object-based attentional effects. Previous research has demonstrated that object-based effects occur for single-region objects but not for multiple-region objects under some conditions (Experiment 1, Watson & Kramer, 1999). Such results are surprising, because most objects in natural scenes are composed of multiple regions. Previous findings could therefore limit the usefulness of an object-based selection mechanism. We explored the generality of these single-region selection results by manipulating the extent to which different (i.e., multiple) regions of a single object perceptually grouped together. Object-based attentional effects were attenuated when multiple regions did not group into a single perceptual object (Experiment 1). However, when multiple regions grouped together based on (1) edge continuation (Experiments 2 and 3) or (2) part and occlusion cues (Experiment 4), we observed object-based effects. Our results suggest that object-based attention is a robust process that can select multiple-region objects, provided the regions of such objects cohere on the basis of perceptual grouping cues.     

Object-based attentional selection and awareness of objects

This study examined whether object-based attentional selection depends on the observer's awareness of objects, using objects defined by perceptual completion. As an indicator of object-based attention, we studied the same-object advantage, where observers respond faster to a target within a cued object than within a noncued object. The same-object advantage was not found in the condition where observers were unaware of the objects (inattentional blindness). On the other hand, the same-object advantage was observed in the condition where observers were aware of the objects. These results suggest that the intensity of object representations can be influenced by observers’ awareness of objects, which affects the occurrence of object-based effects. We propose that attention/inattention (or awareness/unawareness) is graded and observers’ awareness of the objects might serve to boost an otherwise noisy/low signal representation for obtaining object-based effects.     

Space-, object-, and feature-based attention interact to organize visual scenes

Biased-competition accounts of attentional processing propose that attention arises from distributed interactions within and among different types of perceptual representations (e.g., spatial, featural, and object-based). Although considerable research has examined the facilitation in processing afforded by attending selectively to spatial locations, or to features, or to objects, surprisingly little research has addressed a key prediction of the biased-competition account: that attending to any stimulus should give rise to simultaneous interactions across all the types of perceptual representations encompassed by that stimulus. Here we show that, when an object in a visual display is cued, space-, feature-, and object-based forms of attention interact to enhance processing of that object and to create a scene-wide pattern of attentional facilitation. These results provide evidence to support the biased-competition framework and suggest that attention might be thought of as a mechanism by which multiple, disparate bottom-up, and even top-down, visual perceptual representations are coordinated and preferentially enhanced.     

Object-Based Visual Selection: Evidence From Perceptual Completion

A large body of evidence suggests that visual attention selects objects as well as spatial locations. If attention is to be regarded as truly object based, then it should operate not only on object representations that are explicit in the image, but also on representations that are the result of earlier perceptual completion processes. Reporting the results of two experiments, we show that when attention is directed to part of a perceptual object, other parts of that object enjoy an attentional advantage as well. In particular, we show that this object-specific attentional advantage accrues to partly-occluded objects and to objects defined by subjective contours. The results corroborate the claim that perceptual completion precedes object-based attentional selection.     

Object-based selection operates on a grouped array of locations

In two experiments, space- and object-based selection effects were investigated, using variants of the ring-cuing paradigm of Egly and Homa (1984). The results revealed significant cuing modulation for nonring configurations of target locations spanning a range of retinal eccentricities, with the cuing effects independent of eccentricity and confined to the configuration of locations (rather than extending to locations within the space enclosed by the cued configuration). These results are consistent with object-based selection operating on a grouped spatial array (Vecera & Farah, 1994). Object selection may be based on a supradimensional saliency map representation of the field, modulated by feature-specific segmentation mechanisms (e.g., an object may be made salient on the basis of its color). Complex objects may be represented by grouped saliency signals. In this way, a two-dimensional spatial (saliency) representation may provide the common format for object-based selection, prior to full object definition.     

无关长时记忆表征能否引导视觉注意选择?

与任务相关的长时记忆表征在引导视觉注意选择的过程中扮演着重要的角色,它可以使人们在熟悉的视觉情境中快速搜索目标刺激,并偏离干扰刺激。但当长时记忆表征与任务无关时,还能否引导视觉注意选择?目前还不清楚。实验1采用眼动追踪技术直接比较无关工作记忆表征与无关长时记忆表征在视觉搜索阶段对视觉注意的捕获效应,行为反应时与首次注视点百分率的结果都发现,当无关工作记忆表征在视觉搜索中再次出现时能引导视觉注意偏向到与之匹配的干扰刺激,但无关长时记忆表征并没有表现出类似的注意引导效应;实验2探讨记忆表征由工作记忆系统转移到长时记忆系统的过程中对视觉注意的引导效应,结果发现,随着记忆表征的转移,注意引导效应消失了,实验3排除工作记忆表征的干扰后,依然没有发现无关长时记忆表征对注意的引导效应。以上结果表明,无关长时记忆表征并不能像工作记忆表征一样引导视觉注意选择,工作记忆表征和长时记忆表征对视觉注意的引导属于两个不同的认知过程。     

物体表征强度对基于动态物体的注意的影响

基于物体的注意已得到许多静态物体实验的证实, 然而, 对注意分配如何受动态物体影响的研究较少, 存在提示物体假设和动态更新假设两种观点。提示物体假设认为基于物体的注意由最初的物体决定, 而动态更新假设则认为由变化之后的物体决定。动态物体的注意研究还发现了即时物体效应, 即注意基于新物体进行。对于物体变化时注意究竟基于旧物体还是新物体, 新旧物体的相对物体表征强度在其中起决定作用; 当提示物体表征较强时表现为提示物体(即旧物体)决定注意分配, 而当即时物体表征较强时表现为即时物体(即新物体)决定注意分配。相对物体表征强度的概念对理解物体动态变化情况下基于物体的注意的分配以及解决相关理论之冲突可能有重要作用。     

Features,as well as space and time,guide object persistence

What role do surface features (e.g., color) play in the establishment and maintenance of episodic representations of objects (object files)? Mitroff and Alvarez (2007) showed that stimuli that were linked by a continuous spatiotemporal history yielded object-specific preview benefits—a standard index of object files—whereas stimuli linked only by shared surface features did not. Here, it is shown that abruptly changing the features of an object that has been established on the basis of spatiotemporal history can disrupt object-specific preview benefits (Experiments 1 and 2). Moreover, under some conditions, feature match alone can give rise to the preview benefits (Experiment 3). These results indicate that surface features, as well as spatiotemporal factors, play an important role in establishing and maintaining episodic object representations.     

Object-based attentional selection and aging

The authors conducted 2 studies to examine potential age-related differences in object-based attentional selection. Participants were briefly presented with pairs of wrenches and were asked to make 1 response if both target properties (i.e., an open end and a hexagonal end) were present and another response if only a single target property was present in the display. The critical manipulation was whether the target properties were present on 1 wrench or distributed between 2 wrenches. Space-based models of selective attention predict no difference in performance between these conditions. However, object-based attentional selection models predict better performance when both target properties appear on a single object. The results from both of the studies were consistent with object-based models of attentional selection. Furthermore, both young and old adults showed similar performance effects, suggesting the object-based attentional selection is insensitive to normal aging.     

Object-based visual selective attention and perceptual organization

We report the results of four experiments that were conducted to examine both the representations that provide candidate entities available for object-based attentional selection and the influence of bottom-up factors (i.e., geometric and surface characteristics of objects) and top-down factors (i.e., context and expectancies) on the selection process. Subjects performed the same task in each of the experiments. They were asked to determine whether two target properties, a bent end and an open end of a wrench, appeared in a brief display of two wrenches. In each experiment, the target properties could occur on a single wrench or one property could occur on each of two wrenches. The question of central interest was whether a same-object effect (faster and/or more accurate performance when the target properties appeared on one vs. two wrenches) would be observed in different experimental conditions. Several interesting results were obtained. First, depending on the geometric (i.e., concave discontinuities on object contours) and surface characteristics (i.e., homogeneous regions of color and texture) of the stimuli, attention was preferentially directed to one of three representational levels, as indicated by the presence or absence of the same-object effect. Second, although geometric and surface characteristics defined the candidate objects available for attentional selection, top-down factors were quite influential in determining which representational level would be selected. Third, the results suggest that uniform connectedness plays an important role in defining the entities available for attention selection. These results are discussed in terms of the manner in which attention selects objects in the visual environment.     

Transsaccadic perception of saccade target and flanker objects

To account for location-dependent and location-independent preview benefits in transsaccadic object perception, J. M. Henderson (1994) and J. M. Henderson and M. D. Anes (1994) proposed a dual-route model in which both episodic object representations and long-term memory representations store information across a saccade. Four experiments are reported in which the dual-route model was assessed. Preview benefits for saccade target objects were found to be location independent, whereas preview benefits for flanker objects were location dependent. These results support a single-route, 2-stage model of transsaccadic object perception. First, preattentive object files are set up to parse a set of attentional and/or saccade targets from peripheral vision, causing location-dependent preview benefits. Second, 1 object is attentionally selected for further processing, activating long-term memory representations and resulting in location-independent preview benefits.     

Central-cue discriminability modulates object-based attention by influencing spatial attention

The role of central-cue discriminability in modulating object-based effects was examined using Egly, Driver, and Rafal's (1994) "double-rectangle" spatial cueing paradigm. Based on the attentional focusing hypothesis (Goldsmith & Yeari, 2003), we hypothesized that highly discriminable central-arrow cues would be processed with attention spread across the two rectangles (potential target locations), thereby strengthening the perceptual representation of these objects so that they influence the subsequent endogenous deployment of attention, yielding object-based effects. By contrast, less discriminable central-arrow cues should induce a more narrow attentional focus to the center of the display, thereby weakening the rectangle object representations so that they no longer influence the subsequent attentional deployment. Central-arrow-cue discriminability was manipulated by size and luminance contrast. The results supported the predictions, reinforcing the attentional focusing hypothesis and highlighting the need to consider central-cue discriminability when designing experiments and in comparing experimental results.     

Every moment counts: smooth transitions of object boundaries reflect constant updating in object-based attention

Detection of a target is faster when it is presented on an attended rather than an unattended object (i.e., object-based attention). Using the double-rectangle cuing paradigm (Egly, Driver, & Rafal, 1994), we previously showed that object-based attention operates on a dynamic representation: Object-based attentional guidance is affected by subsequent changes occurring to an attended object (Lin & Yeh, 2011). The present study provides further support for our dynamic-updating hypothesis, demonstrating that changes are indeed updated into the existing object representation. After a cue display, we introduced changes between the initial display (four hashes) and the final display (four squares with an occluder between them). We found object-based attention only with smooth transitions between the initial and final displays, not when transitions were in the reverse order (Exp. 1) or contained any single disruption of the smooth transition (Exp. 2). These results confirm our hypothesis that attention operates on a dynamic object representation that is constantly and continuously updated.     

The persistence of object file representations

Coherent visual experience of dynamic scenes requires not only that the visual system segment scenes into component objects but that these object representations persist, so that an object can be identified as the same object from an earlier time. Object files (OFs) are visual representations thought to mediate such abilities: OFs lie between lower level sensory processing and higher level recognition, and they track salient objects over time and motion. OFs have traditionally been studied via object-specific preview benefits (OSPBs), in which discriminations of an object's features are speeded when an earlier preview of those features occurred on the same object, as opposed to on a different object, beyond general displaywide priming. Despite its popularity, many fundamental aspects of the OF framework remain unexplored. For example, although OFs are thought to be involved primarily in online visual processing, we do not know how long such representations persist; previous studies found OSPBs for up to 1500 msec but did not test for longer durations. We explored this issue using a modified object reviewing paradigm and found that robust OSPBs persist for more than five times longer than has previously been tested-for at least 8 sec, and possibly for much longer. Object files may be the "glue" that makes visual experience coherent not just in online moment-by-moment processing, but on the scale of seconds that characterizes our everyday perceptual experiences. These findings also bear on research in infant cognition, where OFs are thought to explain infants' abilities to track and enumerate small sets of objects over longer durations.     

客体同维度特征的视觉工作记忆存储机制

客体理论认为视觉工作记忆的存储单位是客体, 人类能够把组成物体的所有特征整合成一个单元进行记忆, 不管这些特征是来自不同维度还是同一维度。然而同一维度多个特征可以被整合成客体记忆的结果只被少数研究证实, 大量研究发现同一维度的多个特征不能被整合记忆, 这形成了弱客体理论的基本观点。为了解决两大理论之间的争议, 本研究主要探究同维度特征能否被整合记忆。通过分析以往研究, 我们认为实验范式和物体意义两个因素可能是导致之前大部分研究没有发现维度内特征能够被整合记忆的原因。因此, 实验1采用回忆报告范式替代以往研究经常使用的变化觉察范式, 结果发现, 同一维度的多个特征难以被整合记忆。实验2以记忆无意义物体的特征为基线, 探究在记忆有意义物体的特征时是否可能将多个特征进行整合记忆。结果发现, 对于有意义物体的特征的记忆成绩并没有显著好于记忆无意义物体特征的成绩, 说明即使采用具有较强整合线索的有意义物体作为载体, 同一维度多个特征也难以被整合记忆。两个实验结果进一步支持了弱客体理论。     

The spatial distribution of attention within and across objects

Attention operates to select both spatial locations and perceptual objects. However, the specific mechanism by which attention is oriented to objects is not well understood. We examined the means by which object structure constrains the distribution of spatial attention (i.e., a "grouped array"). Using a modified version of the Egly et al. object cuing task, we systematically manipulated within-object distance and object boundaries. Four major findings are reported: 1) spatial attention forms a gradient across the attended object; 2) object boundaries limit the distribution of this gradient, with the spread of attention constrained by a boundary; 3) boundaries within an object operate similarly to across-object boundaries: we observed object-based effects across a discontinuity within a single object, without the demand to divide or switch attention between discrete object representations; and 4) the gradient of spatial attention across an object directly modulates perceptual sensitivity, implicating a relatively early locus for the grouped array representation.     

Attention to memory: orienting attention to sound object representations

Despite a growing acceptance that attention and memory interact, and that attention can be focused on an active internal mental representation (i.e., reflective attention), there has been a paucity of work focusing on reflective attention to ‘sound objects’ (i.e., mental representations of actual sound sources in the environment). Further research on the dynamic interactions between auditory attention and memory, as well as its degree of neuroplasticity, is important for understanding how sound objects are represented, maintained, and accessed in the brain. This knowledge can then guide the development of training programs to help individuals with attention and memory problems. This review article focuses on attention to memory with an emphasis on behavioral and neuroimaging studies that have begun to explore the mechanisms that mediate reflective attentional orienting in vision and more recently, in audition. Reflective attention refers to situations in which attention is oriented toward internal representations rather than focused on external stimuli. We propose four general principles underlying attention to short-term memory. Furthermore, we suggest that mechanisms involved in orienting attention to visual object representations may also apply for orienting attention to sound object representations.     

Object-based control of attention is sensitive to recent experience

How is attention guided by past experience? In visual search, numerous studies have shown that recent trials influence responses to the current trial. Repeating features such as color, shape, or location of a target facilitates performance. Here we examine whether recent experience also modulates a more abstract dimension of attentional control, object-based and location-based control. Participants performed a cued target discrimination task with stimuli presented on 2 rectangles. Response times to targets appearing in an uncued location on a cued rectangle were faster than to targets on the uncued rectangle, demonstrating an object-based attentional benefit. We investigated the object-based benefit on the current trial contingent on the cue-target relationship on the previous trial. The object-based benefit was significant only when the cued object contained the target on the previous trial, not when the uncued object contained the target. This effect of recent experience was not due to either the repetition of spatial cue-target location or the repetition of the response, but to adaptation to contingencies in the environment. Our results suggest a unifying view of attentional control that spans the concrete dimensions of control (e.g., determining the relative importance of red vs. blue) to the abstract (determining the relative importance of objects vs. locations in space). Attention closely tracks the short time scale structure of the environment and automatically adapts to optimize performance to this structure.