Attention to memory: orienting attention to sound object representations

Despite a growing acceptance that attention and memory interact, and that attention can be focused on an active internal mental representation (i.e., reflective attention), there has been a paucity of work focusing on reflective attention to ‘sound objects’ (i.e., mental representations of actual sound sources in the environment). Further research on the dynamic interactions between auditory attention and memory, as well as its degree of neuroplasticity, is important for understanding how sound objects are represented, maintained, and accessed in the brain. This knowledge can then guide the development of training programs to help individuals with attention and memory problems. This review article focuses on attention to memory with an emphasis on behavioral and neuroimaging studies that have begun to explore the mechanisms that mediate reflective attentional orienting in vision and more recently, in audition. Reflective attention refers to situations in which attention is oriented toward internal representations rather than focused on external stimuli. We propose four general principles underlying attention to short-term memory. Furthermore, we suggest that mechanisms involved in orienting attention to visual object representations may also apply for orienting attention to sound object representations.     

Attention doesn’t slide: spatiotopic updating after eye movements instantiates a new, discrete attentional locus

During natural vision, eye movements can drastically alter the retinotopic (eye-centered) coordinates of locations and objects, yet the spatiotopic (world-centered) percept remains stable. Maintaining visuospatial attention in spatiotopic coordinates requires updating of attentional representations following each eye movement. However, this updating is not instantaneous; attentional facilitation temporarily lingers at the previous retinotopic location after a saccade, a phenomenon known as the retinotopic attentional trace. At various times after a saccade, we probed attention at an intermediate location between the retinotopic and spatiotopic locations to determine whether a single locus of attentional facilitation slides progressively from the previous retinotopic location to the appropriate spatiotopic location, or whether retinotopic facilitation decays while a new, independent spatiotopic locus concurrently becomes active. Facilitation at the intermediate location was not significant at any time, suggesting that top-down attention can result in enhancement of discrete retinotopic and spatiotopic locations without passing through intermediate locations.     

Automatic and voluntary focusing of attention

In this study, we investigate whether attentional focusing, like attentional orienting, comprises two independent mechanisms. We provide direct empirical evidence in favor of the existence of two mechanisms--one exogenous, or automatic, and one endogenous, or voluntary--that play a role in adjusting the size of the focus of attention. When a new object suddenly occurs in the visual field, the focus is first automatically fitted to it, and then an endogenous effort has to be exerted to maintain attention in the focused mode. Also, we provide evidence that voluntary focusing needs a perceptual object in order to operate.     

Organizational and spatial dynamics of attentional focusing in hierarchically structured objects

Is the focusing of visual attention object-based, space-based, both, or neither? Attentional focusing latencies in hierarchically structured compound-letter objects were examined, orthogonally manipulating global size (larger vs. smaller) and organizational complexity (two-level structure vs. three-level structure). In a dynamic focusing task, participants successively identified the global and local letters in the same trial. Overall response latencies were generally longer for larger versus smaller global objects and for three-level versus two-level object structure, indicating that attentional focusing time increases both with the magnitude of change in attentional aperture size and with the number of traversed levels of object structure. Additional experiments showed that this pattern is unique to tasks that require dynamic attentional focusing. Taken together, the results support a hierarchical object-based-spatial model of attentional focusing.     

The hare and the snail: Dissociating visual orienting from conscious perception

A method for investigating attentional effects of peripheral visual objects, independently of perceptual identification, is described. We report an experiment using this method which shows that visual processing of peripheral objects differs radically, depending on whether participants move attention in response to an object or consciously perceive that object. When luminance contrast was reduced, conscious perceptual discrimination of peripheral letters was massively slower and less accurate—but both low and high contrast letters elicited rapid attentional orienting effects and these rapid orienting effects were equal in magnitude across low and high contrast. This pattern is consistent with known differences in luminance sensitivity between the dorsal and ventral visual processing streams, and with rapid dorsal–ventral interaction mediated via re-entrant feedback. Our findings show that the control system responsible for rapid movements of attention is exquisitely sensitive to visual form information at low levels of contrast, and involves a different neurocognitive pathway to that which gives rise to conscious perception.     

Object-centered attention in 8-month-old infants

We examined the extent to which visual orienting in 8-month-old infants shows evidence of being guided by object-based representations. Infants’ preferences to look at conspicuous targets presented on one of two stationary objects were measured following an event (cue) which directed their covert attention to one of the objects. The results indicate that by 8 months of age a cue presented on one part of an object directs attention to the whole object (object-centered attention). This then affects responses to targets that appear elsewhere on the cued object.     

Object-Based Visual Selection: Evidence From Perceptual Completion

A large body of evidence suggests that visual attention selects objects as well as spatial locations. If attention is to be regarded as truly object based, then it should operate not only on object representations that are explicit in the image, but also on representations that are the result of earlier perceptual completion processes. Reporting the results of two experiments, we show that when attention is directed to part of a perceptual object, other parts of that object enjoy an attentional advantage as well. In particular, we show that this object-specific attentional advantage accrues to partly-occluded objects and to objects defined by subjective contours. The results corroborate the claim that perceptual completion precedes object-based attentional selection.     

Object-based visual attention with endogenous orienting

In a series of experiments, we examined covert orienting using endogenous cuing, in which attention is voluntarily directed toward a peripheral location. In one experiment, subjects were cued to attend to one end of an oblong object. They then detected targets on the cued object or elsewhere. In another experiment, subjects provided judgments of the relative temporal order of two flashes after their attention had moved endogenously. In a third experiment, subjects were directed to attend to an empty spatial location and subsequently discriminated features of objects that appeared at or near the locus of attention. In each of these situations, attentional orienting was object based, in the sense that nonattended locations that were on the cued object had an advantage over nonattended locations that were not on the object. The results are discussed in terms of their implications for object-based representations and the differences between exogenous and endogenous orienting of attention.     

Memory-based attentional capture by colour and shape contents in visual working memory

Current theories assume that there is substantial overlap between visual working memory (VWM) and visual attention functioning, such that active representations in VWM automatically act as an attentional set, resulting in attentional biases towards objects that match the mnemonic content. Most evidence for this comes from visual search tasks in which a distractor similar to the memory interferes with the detection of a simultaneous target. Here we provide additional evidence using one of the most popular paradigms in the literature for demonstrating an active attentional set: The contingent spatial orienting paradigm of Folk and colleagues. This paradigm allows memory-based attentional biases to be more directly attributed to spatial orienting. Experiment 1 demonstrated a memory-contingent spatial attention effect for colour but not for shape contents of VWM. Experiment 2 tested the hypothesis that the placeholders used for spatial cueing interfered with the shape processing, and showed that memory-based attentional capture for shape returned when placeholders were removed. The results of the present study are consistent with earlier findings from distractor interference paradigms, and provide additional evidence that biases in spatial orienting contribute to memory-based influences on attention.     

Objects and their locations in exogenous cuing.

Anatomical, physiological, and behavioral studies provide support for separate object- and location-based components of visual attention. Although studies of object-based components have usually involved voluntary attention, more recent evidence has suggested that objects may play an independent role in reflexive exogenous orienting, at least at long stimulus onset asynchronies (SOAs). In the present experiments, the role of objects in reflexive attentional orienting was investigated by developing a task in which location and object cuing could be separately examined for both short and long SOAs. Typical location cuing effects were obtained, indicating facilitation at short cue-target intervals and inhibition of return (IOR) at longer intervals. In contrast, object cuing resulted in facilitation for cued objects at long cue-target intervals and no object-based IOR. Interestingly, object cuing primarily affected targets at cued locations, and not those at uncued locations. Together, the experiments examine the interactive nature of objects and locations in exogenous orienting and seem most consistent with a location-mediated view of object-based orienting.     

Space-, object-, and feature-based attention interact to organize visual scenes

Biased-competition accounts of attentional processing propose that attention arises from distributed interactions within and among different types of perceptual representations (e.g., spatial, featural, and object-based). Although considerable research has examined the facilitation in processing afforded by attending selectively to spatial locations, or to features, or to objects, surprisingly little research has addressed a key prediction of the biased-competition account: that attending to any stimulus should give rise to simultaneous interactions across all the types of perceptual representations encompassed by that stimulus. Here we show that, when an object in a visual display is cued, space-, feature-, and object-based forms of attention interact to enhance processing of that object and to create a scene-wide pattern of attentional facilitation. These results provide evidence to support the biased-competition framework and suggest that attention might be thought of as a mechanism by which multiple, disparate bottom-up, and even top-down, visual perceptual representations are coordinated and preferentially enhanced.     

Central-cue discriminability modulates object-based attention by influencing spatial attention

The role of central-cue discriminability in modulating object-based effects was examined using Egly, Driver, and Rafal's (1994) "double-rectangle" spatial cueing paradigm. Based on the attentional focusing hypothesis (Goldsmith & Yeari, 2003), we hypothesized that highly discriminable central-arrow cues would be processed with attention spread across the two rectangles (potential target locations), thereby strengthening the perceptual representation of these objects so that they influence the subsequent endogenous deployment of attention, yielding object-based effects. By contrast, less discriminable central-arrow cues should induce a more narrow attentional focus to the center of the display, thereby weakening the rectangle object representations so that they no longer influence the subsequent attentional deployment. Central-arrow-cue discriminability was manipulated by size and luminance contrast. The results supported the predictions, reinforcing the attentional focusing hypothesis and highlighting the need to consider central-cue discriminability when designing experiments and in comparing experimental results.     

Objects and their locations in exogenous cuing

Anatomical, physiological, and behavioral studies provide support for separate object- and locationbased components of visual attention. Although studies of object-based components have usually involved voluntary attention, more recent evidence has suggested that objects may play an independent role in reflexiveexogenous orienting, at least at long stimulus onset asynchronies (SOAs). In the present experiments, the role of objects in reflexive attentional orienting was investigated by developing a task in which location and object cuing could be separately examined for both short and long SOAs. Typical location cuing effects were obtained, indicating facilitation at short cue—target intervals and inhibition of return (IOR) at longer intervals. In contrast, object cuing resulted in facilitation for cued objects at long cue—target intervals and no object-based IOR. Interestingly, object cuing primarily affected targets at cued locations, and not those at uncued locations. Together, the experiments examine the interactive nature of objects and locations in exogenous orienting and seem most consistent with a location-mediated view of object-based orienting.     

Object onset and parvocellular guidance of attentional allocation

The parvocellular visual pathway in the primate brain is known to be involved with the processing of color. However, a subject of debate is whether an abrupt change in color, conveyed via this pathway, is capable of automatically attracting attention. It has been shown that the appearance of new objects defined solely by color is indeed capable of modulating attention. However, given evidence suggesting that the visual system is particularly sensitive to new onsets, it is unclear to what extent such results reflect effects of color change per se, rather than effects of object onset. We assessed attentional capture by color change that occurred as a result of either new objects appearing or already-present "old" objects changing color. Results showed that although new object onsets accrued attention, changing the color of old objects did not. We conclude that abrupt color change per se is not sufficient to capture attention.     

Contribution of bottom-up and top-down motion processes to perceived position

Perceived position depends on many factors, including motion present in a visual scene. Convincing evidence shows that high-level motion perception--which is driven by top-down processes such as attentional tracking or inferred motion--can influence the perceived position of an object. Is high-level motion sufficient to influence perceived position, and is attention to or awareness of motion direction necessary to displace objects' perceived positions? Consistent with previous reports, the first experiment revealed that the perception of motion, even when no physical motion was present, was sufficient to shift perceived position. A second experiment showed that when subjects were unable to identify the direction of a physically present motion stimulus, the apparent locations of other objects were still influenced. Thus, motion influences perceived position by at least two distinct processes. The first involves a passive, preattentive mechanism that does not depend on perceptual awareness; the second, a top-down process that depends on the perceptual awareness of motion direction. Each contributes to perceived position, but independently of the other.     

意义关联的注意定向效应：基于空间位置的抑制和捕获

采用线索化范式, 通过3个实验建立线索和靶子的意义关联, 考察了意义性线索在不同空间位置的注意定向效应。结果表明, 在下视野出现抑制效应, 且位置越下抑制效应越显著; 在上视野出现捕获效应, 且位置越上捕获效应越显著; 同时注意定向效应的程度受引导线索性质的影响。这些结果说明：(1)客体间的意义关联能够引导视觉空间注意, 表现出不同空间位置的注意定向效应; (2)客体性质能够影响意义关联的注意定向, 表现为客体的生动性越高, 调节能力越强, 抽象性越高, 调节能力越弱; (3)意义关联的注意定向具有规律性变化, 表现为基于空间位置的抑制和捕获效应。     

Eye gaze versus arrows as spatial cues: two qualitatively different modes of attentional selection

This study aimed to evaluate the type of attentional selection (location- and/or object-based) triggered by two different types of central noninformative cues: eye gaze and arrows. Two rectangular objects were presented in the visual field, and subjects' attention was directed to the end of a rectangle via the observation of noninformative directional arrows or eye gaze. Similar experiments with peripheral cues have shown an object-based effect: faster target identification when the target is presented on the cued object as compared to the uncued object, even when the distance between target and cue was the same. The three reported experiments aimed to compare the location- and object-based attentional orienting observed with arrows and eye gaze, in order to dissociate the orienting mechanisms underlying the two types of orienting cues. Results showed similar cueing effects on the cued versus oppositely cued locations for the two cue types, replicating several studies with nonpredictive gaze and arrow cues. However, a pure object-based effect occurred only when an arrow cue was presented, whereas a pure location-based effect was only found for eye-gaze cues. It is suggested that attention is nonspecifically directed to nearby objects when a noninformative arrow is used as cue, whereas it is selectively directed to a specific cued location when noninformative eye gaze is used. This may be mediated by theory of mind mechanisms.     

Motion and position shifts induced by the double-drift stimulus are unaffected by attentional load

The double-drift stimulus produces a strong shift in apparent motion direction that generates large errors of perceived position. In this study, we tested the effect of attentional load on the perceptual estimates of motion direction and position for double-drift stimuli. In each trial, four objects appeared, one in each quadrant of a large screen, and they moved upward or downward on an angled trajectory. The target object whose direction or position was to be judged was either cued with a small arrow prior to object motion (low attentional load condition) or cued after the objects stopped moving and disappeared (high attentional load condition). In Experiment 1, these objects appeared 10° from the central fixation, and participants reported the perceived direction of the target’s trajectory after the stimulus disappeared by adjusting the direction of an arrow at the center of the response screen. In Experiment 2, the four double-drift objects could appear between 6 ° and 14° from the central fixation, and participants reported the location of the target object after its disappearance by moving the position of a small circle on the response screen. The errors in direction and position judgments showed little effect of the attentional manipulation—similar errors were seen in both experiments whether or not the participant knew which double-drift object would be tested. This suggests that orienting endogenous attention (i.e., by only attending to one object in the precued trials) does not interact with the strength of the motion or position shifts for the double-drift stimulus.     

Top-down task sets for combined features: Behavioral and electrophysiological evidence for two stages in attentional object selection

We studied whether visual search for targets defined by a combination of features from different dimensions is guided by separately represented target features or by an integrated representation of the target objects. In Experiment 1, participants searched for target singleton bars that were defined by a specific combination of color (red or blue) and size (small or large). The target arrays were preceded by cue arrays that contained a spatially uninformative color/size singleton. Behavioral spatial-cueing effects indicative of attentional capture were triggered only by cues that matched both target-defining features, but not by partially target-matching cues, suggesting that attention was guided by integrated object representations. However, the presence of reliable N2pc components for partially matching cues demonstrated that these cues did capture attention, in line with independent feature-based guidance of attention. This dissociation between the electrophysiological and behavioral markers of attentional capture was confirmed in Experiment 2, in which targets were defined by a color/size disjunction. Our results suggest that the attentional selection of targets that are defined by a combination of features is a two-stage process: Attention is initially captured by all target-matching features, but is then rapidly withdrawn from nontarget objects that share some but not all features with the current target.     

Object representations maintain attentional control settings across space and time

Previous research has revealed that we create and maintain mental representations for perceived objects on the basis of their spatiotemporal continuity. An important question is what type of information can be maintained within these so-called object files. We provide evidence that object files retain specific attentional control settings for items presented inside the object, even when it disappears from vision. The objects were entire visual search displays consisting of multiple items moving into and out of view. It was demonstrated that search was speeded when the search target position was repeated from trial to trial, but especially so when spatiotemporal continuity suggested that the entire display was the same object. We conclude that complete spatial attentional biases can be stored in an object file.