Object-based selection from spatially-invariant representations: evidence from a feature-report task

Attention selects objects as well as locations. When attention selects an object's features, observers identify two features from a single object more accurately than two features from two different objects (object-based effect of attention; e.g., Duncan, Journal of Experimental Psychology: General, 113, 501-517, 1984). Several studies have demonstrated that object-based attention can operate at a late visual processing stage that is independent of objects' spatial information (Awh, Dhaliwal, Christensen, & Matsukura, Psychological Science, 12, 329-334, 2001; Matsukura & Vecera, Psychonomic Bulletin & Review, 16, 529-536, 2009; Vecera, Journal of Experimental Psychology: General, 126, 14-18, 1997; Vecera & Farah, Journal of Experimental Psychology: General, 123, 146-160, 1994). In the present study, we asked two questions regarding this late object-based selection mechanism. In Part I, we investigated how observers' foreknowledge of to-be-reported features allows attention to select objects, as opposed to individual features. Using a feature-report task, a significant object-based effect was observed when to-be-reported features were known in advance but not when this advance knowledge was absent. In Part II, we examined what drives attention to select objects rather than individual features in the absence of observers' foreknowledge of to-be-reported features. Results suggested that, when there was no opportunity for observers to direct their attention to objects that possess to-be-reported features at the time of stimulus presentation, these stimuli must retain strong perceptual cues to establish themselves as separate objects.     

The return of object-based attention: selection of multiple-region objects

Objects can control the focus of attention, allowing features on the same object to be selected more easily than features on different objects. In the present experiments, we investigated the perceptual processes that contribute to such object-based attentional effects. Previous research has demonstrated that object-based effects occur for single-region objects but not for multiple-region objects under some conditions (Experiment 1, Watson & Kramer, 1999). Such results are surprising, because most objects in natural scenes are composed of multiple regions. Previous findings could therefore limit the usefulness of an object-based selection mechanism. We explored the generality of these single-region selection results by manipulating the extent to which different (i.e., multiple) regions of a single object perceptually grouped together. Object-based attentional effects were attenuated when multiple regions did not group into a single perceptual object (Experiment 1). However, when multiple regions grouped together based on (1) edge continuation (Experiments 2 and 3) or (2) part and occlusion cues (Experiment 4), we observed object-based effects. Our results suggest that object-based attention is a robust process that can select multiple-region objects, provided the regions of such objects cohere on the basis of perceptual grouping cues.     

物体表征强度对基于动态物体的注意的影响

基于物体的注意已得到许多静态物体实验的证实, 然而, 对注意分配如何受动态物体影响的研究较少, 存在提示物体假设和动态更新假设两种观点。提示物体假设认为基于物体的注意由最初的物体决定, 而动态更新假设则认为由变化之后的物体决定。动态物体的注意研究还发现了即时物体效应, 即注意基于新物体进行。对于物体变化时注意究竟基于旧物体还是新物体, 新旧物体的相对物体表征强度在其中起决定作用; 当提示物体表征较强时表现为提示物体(即旧物体)决定注意分配, 而当即时物体表征较强时表现为即时物体(即新物体)决定注意分配。相对物体表征强度的概念对理解物体动态变化情况下基于物体的注意的分配以及解决相关理论之冲突可能有重要作用。     

Selective attention warps spatial representation: parallel but opposing effects on attended versus inhibited objects

Selective attention not only influences which objects in a display are perceived, but also directly changes the character of how they are perceived--for example, making attended objects appear larger or sharper. In studies of multiple-object tracking and probe detection, we explored the influence of sustained selective attention on where objects are seen to be in relation to each other in dynamic multi-object displays. Surprisingly, we found that sustained attention can warp the representation of space in a way that is object-specific: In immediate recall of the positions of objects that have just disappeared, space between targets is compressed, whereas space between distractors is expanded. These effects suggest that sustained attention can warp spatial representation in unexpected ways.     

Feature selection in feature network models: Finding predictive subsets of features with the Positive Lasso

A set of features is the basis for the network representation of proximity data achieved by feature network models (FNMs). Features are binary variables that characterize the objects in an experiment, with some measure of proximity as response variable. Sometimes features are provided by theory and play an important role in the construction of the experimental conditions. In some research settings, the features are not known a priori. This paper shows how to generate features in this situation and how to select an adequate subset of features that takes into account a good compromise between model fit and model complexity, using a new version of least angle regression that restricts coefficients to be non‐negative, called the Positive Lasso. It will be shown that features can be generated efficiently with Gray codes that are naturally linked to the FNMs. The model selection strategy makes use of the fact that FNM can be considered as univariate multiple regression model. A simulation study shows that the proposed strategy leads to satisfactory results if the number of objects is less than or equal to 22. If the number of objects is larger than 22, the number of features selected by our method exceeds the true number of features in some conditions.     

Oculomotion mediates attentional guidance toward temporarily close objects

Previous research has identified multiple features of individual objects that are capable of guiding visual attention. However, in dynamic multi-element displays not only individual object features but also changing spatial relations between two or more objects might signal relevance. Here we report a series of experiments that investigated the hypothesis that reduced inter-object spacing guides visual attention toward the corresponding objects. Our participants discriminated between different probes that appeared on moving objects while we manipulated spatial proximity between the objects at the moment of probe onset. Indeed, our results confirm that there is a bias toward temporarily close objects, which persists even when such a bias is harmful for the actual task (Experiments 1a and 1b). Remarkably, this bias is mediated by oculomotor processes. Controlling for eye-movements reverses the pattern of results (Experiment 2a), whereas the location of the gaze tends toward the temporarily close objects under free viewing conditions (Experiment 2b). Taken together, our results provide insights into the interplay of attentional and oculomotor processes during dynamic scene processing. Thereby, they also add to the growing body of evidence showing that within dynamic perception, attentional and oculomotor processes act conjointly and are hardly separable.     

Templates for rejection: configuring attention to ignore task-irrelevant features

Theories of attention are compatible with the idea that we can bias attention to avoid selecting objects that have known nontarget features. Although this may underlie several existing phenomena, the explicit guidance of attention away from known nontargets has yet to be demonstrated. Here we show that observers can use feature cues (i.e., color) to bias attention away from nontarget items during visual search. These negative cues were used to quickly instantiate a template for rejection that reliably facilitated search across the cue-to-search stimulus onset asynchronies (SOAs), although negative cues were not as potent as cues that guide attention toward target features. Furthermore, by varying the search set size we show a template for rejection is increasingly effective in facilitating search as scene complexity increases. Our findings demonstrate that knowing what not to look for can be used to configure attention to avoid certain features, complimenting what is known about setting attention to select certain target features.     

The Neural Basis of Selective Attention: Cortical Sources and Targets of Attentional Modulation

ABSTRACT— Selective attention is an intrinsic component of perceptual representation in a visual system that is hierarchically organized. Modulatory signals originate in brain regions that represent behavioral goals; these signals specify which perceptual objects are to be represented by sensory neurons that are subject to contextual modulation. Attention can be deployed to spatial locations, features, or objects, and corresponding modulatory signals must be targeted within these domains. Open questions include how nonspatial perceptual domains are modulated by attention and how abstract goals are transformed into targeted modulatory signals.     

Attentional selection of complex objects: Joint effects of surface uniformity and part structure

What object properties warrant selection by object-based attention? Previous research has suggested that surface uniformity is required for object-based attentional selection (Watson &; Kramer, 1999), yet nonuniform objects are encountered frequently. In the present experiments, we investigated the interplay between surface uniformity and part boundaries and their effect on object-based attention. Specifically, we asked if attention can select nonuniform objects whose surface changes occur at part boundaries. Although uniformly colored objects did exhibit object-based effects, we only observed an object-based effect for multicolored objects when surface changes occurred at part boundaries. These findings suggest that attention can only select nonuniform objects when the surface change occurs at a part boundary.     

Attending to objects: costs or benefits?

The single-object advantage is said to occur when performance is faster and/or more accurate when the two targets to be compared appear on one object than when they appear on two different objects. The single-object advantage has been interpreted to suggest that attention can select objects rather than unparsed regions of visual space. In five experiments we explored whether directing attention to one object rather than two objects produces a benefit or a minor cost. Participants were required to compare two target features that belonged to one object, to two objects, or did not belong to any object. In addition, we varied the relevance to the task of object-related global information, such as symmetry of the object and perceptual cluttering of the background. Results showed that attending to one object in comparison to attending to no object produced a benefit only when object-related global information was relevant to the task. In contrast, when object-related global information was irrelevant to the task, attending to one object produced a cost. Thus, it can be concluded that attending to an object does not produce an absolute benefit, but rather produces a smaller cost than attending to two objects.     

Surface formation and depth in monocular scene perception

The visual perception of monocular stimuli perceived as 3-D objects has received considerable attention from researchers in human and machine vision. However, most previous research has focused on how individual 3-D objects are perceived. Here this is extended to a study of how the structure of 3-D scenes containing multiple, possibly disconnected objects and features is perceived. Da Vinci stereopsis, stereo capture, and other surface formation and interpolation phenomena in stereopsis and structure-from-motion suggest that small features having ambiguous depth may be assigned depth by interpolation with features having unambiguous depth. I investigated whether vision may use similar mechanisms to assign relative depth to multiple objects and features in sparse monocular images, such as line drawings, especially when other depth cues are absent. I propose that vision tends to organize disconnected objects and features into common surfaces to construct 3-D-scene interpretations. Interpolations that are too weak to generate a visible surface percept may still be strong enough to assign relative depth to objects within a scene. When there exists more than one possible surface interpolation in a scene, the visual system's preference for one interpolation over another seems to be influenced by a number of factors, including: (i) proximity, (ii) smoothness, (iii) a preference for roughly frontoparallel surfaces and 'ground' surfaces, (iv) attention and fixation, and (v) higher-level factors. I present a variety of demonstrations and an experiment to support this surface-formation hypothesis.     

The perceptual root of object-based storage: an interactive model of perception and visual working memory

Mainstream theories of visual perception assume that visual working memory (VWM) is critical for integrating online perceptual information and constructing coherent visual experiences in changing environments. Given the dynamic interaction between online perception and VWM, we propose that how visual information is processed during visual perception can directly determine how the information is going to be selected, consolidated, and maintained in VWM. We demonstrate the validity of this hypothesis by investigating what kinds of perceptual information can be stored as integrated objects in VWM. Three criteria for object-based storage are introduced: (a) automatic selection of task-irrelevant features, (b) synchronous consolidation of multiple features, and (c) stable maintenance of feature conjunctions. The results show that the outputs of parallel perception meet all three criteria, as opposed to the outputs of serial attentive processing, which fail all three criteria. These results indicate that (a) perception and VWM are not two sequential processes, but are dynamically intertwined; (b) there are dissociated mechanisms in VWM for storing information identified at different stages of perception; and (c) the integrated object representations in VWM originate from the "preattentive" or "proto" objects created by parallel perception. These results suggest how visual perception, attention, and VWM can be explained by a unified framework.     

Selective attention to the parts of an object

Recent empirical results suggest that there is a decrement in dividing attention between two objects in a scene compared with focusing attention on a single object. However, objects can be made of individual parts. Is there a decrement for dividing attention across different parts of a single object? We addressed this question in two experiments. In Experiment 1, we demonstrated that attention can exhibit part-based selection—that is, the subjects were more accurate in reporting two attributes from the same part of an object than they were in reporting attributes from different parts of an object. In Experiment 2, we demonstrated that part-based attentional decrements occurred simultaneously with object-based attentional decrements. The results from Experiment 2 demonstrated that part-based attention is evident at the same time as objects are processed as coherent wholes. Our results imply that there is an attentional mechanism that can select either objects or their parts.     

Intersubjectivity and Receptive Experience

Wilfrid Sellars's iconic exposé of the ‘myth of the given’ taught us that experience must present the world to us as normatively laden, in the sense that the contents of experience must license inferences, rule out and justify various beliefs, and rationalize actions. Somehow our beliefs must be governed by the objects as they present themselves to us. Often this requirement is cashed out using language that attributes agent‐like properties to objects: we are described as ‘accountable to’ objects, while objects ‘hold us’ to standards, and so forth. But such language is either deeply anti‐naturalistic or trades on a set of metaphors in need of a literal translation. We offer an explanation of how the material features of the world, as received in experience, can rationally constrain our beliefs and practices—one that makes no recourse to this imagery. In particular, we examine the structure of ostensive practices (that is, practices of directing one another's attention to objects and features of the world) and the distinctive role they play in making us jointly beholden to how things actually are.     

When motor attention improves selective attention: The dissociating role of saliency

There is evidence that preparing and maintaining a motor plan (“motor attention”) can bias visual selective attention. For example, a motor attended grasp biases visual attention to select appropriately graspable object features (Symes, Tucker, Ellis, Vainio, & Ottoboni, 2008). According to the biased competition model of selective attention, the relative weightings of stimulus-driven and goal-directed factors determine selection. The current study investigated how the goal-directed bias of motor attention might operate when the stimulus-driven salience of the target was varied. Using a change detection task, two almost identical photographed scenes of simplistic graspable objects were presented flickering back and forth. The target object changed visually, and this change was either high or low salience. Target salience determined whether or not the motor attended grasp significantly biased visual selective attention. Specifically, motor attention only had a reliable influence on target detection times when the visual salience of the target was low.     

Feature selection for inductive generalization

Judging similarities among objects, events, and experiences is one of the most basic cognitive abilities, allowing us to make predictions and generalizations. The main assumption in similarity judgment is that people selectively attend to salient features of stimuli and judge their similarities on the basis of the common and distinct features of the stimuli. However, it is unclear how people select features from stimuli and how they weigh features. Here, we present a computational method that helps address these questions. Our procedure combines image-processing techniques with a machine-learning algorithm and assesses feature weights that can account for both similarity and categorization judgment data. Our analysis suggests that a small number of local features are particularly important to explain our behavioral data.     

Influence of semantic consistency and perceptual features on visual attention during scene viewing in toddlers

Conceptual representations of everyday scenes are built in interaction with visual environment and these representations guide our visual attention. Perceptual features and object-scene semantic consistency have been found to attract our attention during scene exploration. The present study examined how visual attention in 24-month-old toddlers is attracted by semantic violations and how perceptual features (i. e. saliency, centre distance, clutter and object size) and linguistic properties (i. e. object label frequency and label length) affect gaze distribution. We compared eye movements of 24-month-old toddlers and adults while exploring everyday scenes which either contained an inconsistent (e.g., soap on a breakfast table) or consistent (e.g., soap in a bathroom) object. Perceptual features such as saliency, centre distance and clutter of the scene affected looking times in the toddler group during the whole viewing time whereas looking times in adults were affected only by centre distance during the early viewing time. Adults looked longer to inconsistent than consistent objects either if the objects had a high or a low saliency. In contrast, toddlers presented semantic consistency effect only when objects were highly salient. Additionally, toddlers with lower vocabulary skills looked longer to inconsistent objects while toddlers with higher vocabulary skills look equally long to both consistent and inconsistent objects. Our results indicate that 24-month-old children use scene context to guide visual attention when exploring the visual environment. However, perceptual features have a stronger influence in eye movement guidance in toddlers than in adults. Our results also indicate that language skills influence cognitive but not perceptual guidance of eye movements during scene perception in toddlers.     

How does attention select and track spatially extended objects? New effects of attentional concentration and amplification

Real-world situations involve attending to spatially extended objects, often under conditions of motion and high processing load. The present experiments investigated such processing by requiring observers to attentionally track a number of long, moving lines. Concurrently, observers responded to sporadic probes as a measure of the distribution of attention across the lines. The results revealed that attention is concentrated at the centers of lines during tracking, despite their uniformity, and that this center advantage grew as the lines became longer: Not only did observers get worse near the endpoints, but they became better at the lines' centers, as if attention became more concentrated as the objects became more extended. These results begin to show how attention is flexibly allocated in online visual processing to extended dynamic objects.     

Saccadic eye movement programming: sensory and attentional factors

The relationship between attention and eye movements is explored by consideration of the variety of ways attention may affect saccade programming. Four forms of attention are distinguished: one exogenous and three endogenous through either locations or objects or features. Each of these can control or influence the saccadic generation process. Visual onsets generate a rapid transient signal with low resolution that travels from the visual system to the oculomotor system. Generation of an eye movement is associated with an attentional signal, probably also with low resolution, travelling from the oculomotor system to the visual system. A high-resolution attentional signal, which appears to require voluntary effort, can also select saccadic targets.     

Attention can operate on semantic objects defined by individual Chinese characters

Attention can select perceptual objects, but it is less clear whether attention can operate on objects defined by higher level cognition, such as semantic associations. Recent studies have shown that attention may be based on objects defined by Chinese two-character compound words, suggesting that attention can operate on semantic objects. In the present study, object-based attention (OBA) effect was investigated at the level of individual Chinese characters, and the role of character structure and radical order in OBA was explored by using a spatial cueing paradigm. In Experiment 1, we found OBA effect for conditions that had legal radical order, but not for other conditions in which the radical order information was disrupted. Character structure, however, had no influence on the OBA effect. In Experiment 2, we observed OBA effect for all conditions after enhancing the radical order and character structure information by adding perceptual cues. The results extend previous findings of a “semantic object”-based attention effect from the two-character word level to the individual character level. Moreover, we found that radical order but not character structure was important for this semantic OBA effect. We conclude that visual attention can be based on semantic objects at the level of individual characters, and that the development of semantic objects is affected by the perceptual grouping of the radicals.