Spatial attention and audiovisual interactions in apparent motion

In this study, the authors combined the cross-modal dynamic capture task (involving the horizontal apparent movement of visual and auditory stimuli) with spatial cuing in the vertical dimension to investigate the role of spatial attention in cross-modal interactions during motion perception. Spatial attention was manipulated endogenously, either by means of a blocked design or by predictive peripheral cues, and exogenously by means of nonpredictive peripheral cues. The results of 3 experiments demonstrate a reduction in the magnitude of the cross-modal dynamic capture effect on cued trials compared with uncued trials. The introduction of neutral cues (Experiments 4 and 5) confirmed the existence of both attentional costs and benefits. This attention-related reduction in cross-modal dynamic capture was larger when a peripheral cue was used compared with when attention was oriented in a purely endogenous manner. In sum, the results suggest that spatial attention reduces illusory binding by facilitating the segregation of unimodal signals, thereby modulating audiovisual interactions in information processing. Thus, the effect of spatial attention occurs prior to or at the same time as cross-modal interactions involving motion information.     

Multisensory integration affects visuo-spatial working memory

In the present study, we investigate how spatial attention, driven by unisensory and multisensory cues, can bias the access of information into visuo-spatial working memory (VSWM). In a series of four experiments, we compared the effectiveness of spatially-nonpredictive visual, auditory, or audiovisual cues in capturing participants' spatial attention towards a location where to-be-remembered visual stimuli were or were not presented (cued/uncued trials, respectively). The results suggest that the effect of peripheral visual cues in biasing the access of information into VSWM depend on the size of the attentional focus, while auditory cues did not have direct effects in biasing VSWM. Finally, spatially congruent multisensory cues showed an enlarged attentional effect in VSWM as compared to unimodal visual cues, as a likely consequence of multisensory integration. This latter result sheds new light on the interplay between spatial attention and VSWM, pointing to the special role exerted by multisensory (audiovisual) cues.     

Region segmentation and contextual cuing

Contextual information provides an important source for behavioral orienting. For instance, in the contextualcuing paradigm, repetitions of the spatial layout of elements in a search display can guide attention to the target location. The present study explored how this contextual-cuing effect is influenced by the grouping of search elements. In Experiment 1, four nontarget items could be arranged collinearly to form an imaginary square. The presence of such a square eliminated the contextual-cuing effect, despite the fact that the square’s location still had a predictive value for the target location. Three follow-up experiments demonstrated that other types of grouping abolished contextual cuing in a similar way and that the mere presence of a task-irrelevant singleton had only a diminishing effect (by half ) on contextual cuing. These findings suggest that a segmented, salient region can interfere with contextual cuing, reducing its predictive impact on search.     

Contingent attentional capture or delayed allocation of attention?

Under certain circumstances, external stimuli will elicit an involuntary shift of spatial attention, referred to as attentional capture. According to the contingent involuntary orienting account (Folk, Remington, & Johnston, 1992), capture is conditioned by top-down factors that set attention to respond involuntarily to stimulus properties relevant to one's behavioral goals. Evidence for this comes from spatial cuing studies showing that a spatial cuing effect is observed only when cues have goal-relevant properties. Here, we examine alternative, decision-level explanations of the spatial cuing effect that attribute evidence of capture to postpresentation delays in the voluntary allocation of attention, rather than to on-line involuntary shifts in direct response to the cue. In three spatial cuing experiments, delayed-allocation accounts were tested by examining whether items at the cued location were preferentially processed. The experiments provide evidence that costs and benefits in spatial cuing experiments do reflect the on-line capture of attention. The implications of these results for models of attentional control are discussed.     

Spatial working memory load impairs signal enhancement, but not attentional orienting

The present study examined the effect of spatial working memory load on the attentional cuing effect. It is well-known that spatial working memory and spatial attention functionally overlap or share a common resource. Given this functional overlapping, it is possible that spatial working memory would also interact with the attentional cuing effect. Considering the distinction between channel selection and channel enhancement by attention (Prinzmetal, McCool, & Park, 2005), we expected that the interaction between spatial working memory and the cuing effect would differ with attentional processing type. Two experiments conducted with the spatial cuing paradigm showed that the magnitude of the cuing effect as measured by reaction time, reflecting channel selection, was uninfluenced by spatial working memory load. In contrast, spatial working memory load reduced the cuing effect as measured by accuracy, reflecting channel enhancement. These results suggest that spatial working memory load impairs signal enhancement by attention and does not influence attentional orienting per se. The interaction between spatial working memory and visual perception is also discussed.     

Is the exogenous orienting of spatial attention truly automatic? Evidence from unimodal and multisensory studies

The last decade has seen great progress in the study of the nature of crossmodal links in exogenous and endogenous spatial attention (see [Spence, C., McDonald, J., & Driver, J. (2004). Exogenous spatial cuing studies of human crossmodal attention and multisensory integration. In C. Spence, & J. Driver (Eds.), Crossmodal space and crossmodal attention (pp. 277-320). Oxford, UK: Oxford University Press.], for a recent review). A growing body of research now highlights the existence of robust crossmodal links between auditory, visual, and tactile spatial attention. However, until recently, studies of exogenous and endogenous attention have proceeded relatively independently. In daily life, however, these two forms of attentional orienting continuously compete for the control of our attentional resources, and ultimately, our awareness. It is therefore critical to try and understand how exogenous and endogenous attention interact in both the unimodal context of the laboratory and the multisensory contexts that are more representative of everyday life. To date, progress in understanding the interaction between these two forms of orienting has primarily come from unimodal studies of visual attention. We therefore start by summarizing what has been learned from this large body of empirical research, before going on to review more recent studies that have started to investigate the interaction between endogenous and exogenous orienting in a multisensory setting. We also discuss the evidence suggesting that exogenous spatial orienting is not truly automatic, at least when assessed in a crossmodal context. Several possible models describing the interaction between endogenous and exogenous orienting are outlined and then evaluated in terms of the extant data.     

The suppression of reflexive visual and auditory orienting when attention is otherwise engaged

Two experiments were conducted to examine whether abrupt onsets are capable of reflexively capturing attention when they occur outside the current focus of spatial attention, as would be expected if exogenous orienting operates in a truly automatic fashion. The authors established a highly focused attentional state by means of the central presentation of a stream of visual or auditory characters, which participants sometimes had to monitor. No intramodal reflexive cuing effects were observed in either audition or vision when participants performed either an exogenous visual or auditory orthogonal cuing task together with the central focused attention task. These results suggest that reflexive unimodal orienting is not truly automatic. The fact that cuing effects were eliminated under both unimodal and cross-modal conditions is consistent with the view that auditory and visual reflexive spatial orienting are controlled by a common underlying neural substrate.     

Attentional guidance of the eyes by contextual information and abrupt onsets.

Contextual cuing is a memory-based phenomenon in which previously encountered global pattern information in a display can automatically guide attention to the location of a target (Chun & Jiang, 1998), leading to rapid and accurate responses. What is not clear is how contextual cuing works. By monitoring eye movements, we investigated the roles that recognition and guidance play in contextual cuing. Recognition does not appear to occur on every trial and sometimes does not have its effects until later in the search process. When recognition does occur, attention is guided straight to the target rather than in the general direction. In Experiment 2, we investigated the interaction between memory-driven search (contextual cuing) and stimulus-driven attentional capture by abrupt onsets. Contextual cuing was able to override capture by abrupt onsets. In contrast, onsets had almost no effect on the degree of contextual cuing. These data are discussed in terms of the role of top-down and bottom-up factors in the guidance of attention in visual search.     

Top-down control over biased competition during covert spatial orienting

Larger benefits of spatial attention are observed when distractor interference is prevalent, supporting the view that spatial selection facilitates visual processing by suppressing distractor interference. The present work shows that cuing effects with identical visual displays can grow substantially as the probability of distractor interference increases. The probability of interference had no impact on spatial cuing effects in the absence of distractors, suggesting that the enlarged cuing effects were not caused by changes in signal enhancement or in the spatial distribution of attention. These findings suggest that attentional control settings determine more than where spatial attention is directed; top-down settings also influence how attention affects visual processing, with increased levels of distractor exclusion when distractor interference is likely.     

Hemispheric asymmetry: Looking for a novel signature of the modulation of spatial attention in multisensory processing

The extent to which attention modulates multisensory processing in a top-down fashion is still a subject of debate among researchers. Typically, cognitive psychologists interested in this question have manipulated the participants’ attention in terms of single/dual tasking or focal/divided attention between sensory modalities. We suggest an alternative approach, one that builds on the extensive older literature highlighting hemispheric asymmetries in the distribution of spatial attention. Specifically, spatial attention in vision, audition, and touch is typically biased preferentially toward the right hemispace, especially under conditions of high perceptual load. We review the evidence demonstrating such an attentional bias toward the right in extinction patients and healthy adults, along with the evidence of such rightward-biased attention in multisensory experimental settings. We then evaluate those studies that have demonstrated either a more pronounced multisensory effect in right than in left hemispace, or else similar effects in the two hemispaces. The results suggest that the influence of rightward-biased attention is more likely to be observed when the crossmodal signals interact at later stages of information processing and under conditions of higher perceptual load—that is, conditions under which attention is perhaps a compulsory enhancer of information processing. We therefore suggest that the spatial asymmetry in attention may provide a useful signature of top-down attentional modulation in multisensory processing.     

Auditory-visual contextual cuing effect

Under incidental learning conditions, a spatial layout can be acquired implicitly and facilitate visual searches (the contextual cuing effect). Whereas previous studies have shown a cuing effect in the visual domain, the present study examined whether a contextual cuing effect could develop from association between auditory events and visual target locations (Experiments 1 and 2). In the training phase, participants searched for a T among Ls, preceded by 2 sec of auditory stimulus. The target location could be predicted from the preceding auditory stimulus. In the test phase, the auditory-visual association pairings were disrupted. The results revealed that a contextual cuing effect occurs by auditory-visual association. Participants did not notice the auditory-visual association. Experiment 3 explored a boundary condition for the auditory-visual contextual cuing effect. These results suggest that visual attention can be guided implicitly by crossmodal association, and they extend the idea that the visual system is sensitive to all kinds of statistical consistency.     

Reward expectation influences audiovisual spatial integration

In order to determine the spatial location of an object that is simultaneously seen and heard, the brain assigns higher weights to the sensory inputs that provide the most reliable information. For example, in the well-known ventriloquism effect, the perceived location of a sound is shifted toward the location of a concurrent but spatially misaligned visual stimulus. This perceptual illusion can be explained by the usually much higher spatial resolution of the visual system as compared to the auditory system. Recently, it has been demonstrated that this cross-modal binding process is not fully automatic, but can be modulated by emotional learning. Here we tested whether cross-modal binding is similarly affected by motivational factors, as exemplified by reward expectancy. Participants received a monetary reward for precise and accurate localization of brief auditory stimuli. Auditory stimuli were accompanied by task-irrelevant, spatially misaligned visual stimuli. Thus, the participants’ motivational goal of maximizing their reward was put in conflict with the spatial bias of auditory localization induced by the ventriloquist situation. Crucially, the amounts of expected reward differed between the two hemifields. As compared to the hemifield associated with a low reward, the ventriloquism effect was reduced in the high-reward hemifield. This finding suggests that reward expectations modulate cross-modal binding processes, possibly mediated via cognitive control mechanisms. The motivational significance of the stimulus material, thus, constitutes an important factor that needs to be considered in the study of top-down influences on multisensory integration.     

Configural and contextual prioritization in object-based attention

When attention is directed to a location within an object, other locations within that object also enjoy an attentional advantage. Recently we demonstrated that this object-based advantage is mediated by increased attentional priority assigned to locations within an already attended object and not to early sensory enhancement due to the "spread" of attention within the attended object (Shomstein & Yantis, 2002). At least two factors might contribute to the assignment of attentional priority, one related to the configuration of objects in a scene and the other related to the probability of target appearance in each location imposed by task contingencies. We investigated the relative contribution of these factors by cuing one end of one of a pair of rectangles; a subsequent target appeared most often in the cued location. We manipulated attentional priority setting by varying (1) the probability that a target would appear in each of two uncued locations and (2) the cue to target stimulus onset asynchrony (SOA). On invalidly cued trials, the target appeared in the high-probability location (defined by an absolute spatial location, e.g., upper right) 83% of the time and in the low-probability location (e.g., lower left) 17% of the time. In both conditions, uncued targets appeared in the cued object half the time and in the uncued object half the time. At short SOAs, the same-object and probability effects were approximately additive. However, at longer SOAs, the same-object effects disappeared, and reaction times depended exclusively on location probability. These results suggest that observers adopt an implicit configural scanning strategy (in which unattended locations within an attended object have high priority) or an implicit contextual scanning strategy (in which objectively high-probability locations have high priority) depending on task contingencies and the amount of time that is available to deploy attention.     

外源性注意与多感觉整合的交互关系

外源性注意与多感觉整合的交互关系是一个复杂且具有争议的研究领域, 一直以来备受研究者们关注。为了解释两者间的交互作用机制, 本文基于已有研究成果从两方面综述了外源性注意与多感觉整合的交互关系：(1)外源性注意可以通过自下而上的方式调节多感觉整合, 包括空间不确定性、感知觉敏感度和感觉通道间信号强度差异三种理论假说; (2)多感觉整合可以调节外源性注意。一方面, 来自多感觉通道的刺激能够以自下而上的方式自动整合, 整合后的多感觉通道刺激比单通道刺激具有更大的凸显性从而有效地吸引注意。另一方面, 整合后的多感觉通道刺激能够作为多感觉信号模板存储于大脑之中, 从而在任务中实现自上而下地调节注意捕获。     

Endogenous orienting modulates the Simon effect: critical factors in experimental design

Responses are faster when the side of stimulus and response correspond than when they do not correspond, even if stimulus location is irrelevant to the task at hand: the correspondence, spatial compatibility effect, or Simon effect. Generally, it is assumed that an automatically generated spatial code is responsible for this effect, but the precise mechanism underlying the formation of this code is still under dispute. Two major alternatives have been proposed: the referential-coding account, which can be subdivided into a static version and an attention-centered version, and the attention-shift account. These accounts hold clear-cut predictions for attentional cuing experiments. The former would assume a Simon effect irrespective of attentional cuing in its static version, whereas the attention-centered version of the referential-coding account and the attention-shift account would predict a decreased Simon effect on validly as opposed to invalid cued trials. However, results from previous studies are equivocal to the effects of attentional cuing on the Simon effect. We argue here that attentional cueing reliably modulates the Simon effect if some crucial experimental conditions, mostly relevant for optimizing attentional allocation, are met. Furthermore, we propose that the Simon effect may be better understood within the perspective of supra-modal spatial attention, thereby providing an explanation for observed discrepancies in the literature.     

The owl and the pussycat: Gaze cues and visuospatial orienting

Recent research has shown that nonpredictive gaze cues trigger reflexive shifts in attention toward the looked-at location. But just how generalizable is this spatial cuing effect? In particular, are people especially tuned to gaze cues provided by conspecifics, or can comparable shifts in visual attention be triggered by other cue providers and directional cues? To investigate these issues, we used a standard cuing paradigm to compare the attentional orienting produced by different cue providers (i.e., animate vs. inanimate) and directional cues (i.e., eyes vs. arrows). The results of three experiments revealed that attentional orienting was insensitive to both the identity of the cue provider and the nature of the triggering cue. However, compared with arrows, gaze cues prompted a general enhancement in the efficiency of processing operations. We consider the implications of these findings for accounts of reflexive visual orienting.     

Contingent attentional capture by top-down control settings: converging evidence from event-related potentials

Theories of attentional control are divided over whether the capture of spatial attention depends primarily on stimulus salience or is contingent on attentional control settings induced by task demands. The authors addressed this issue using the N2-posterior- contralateral (N2pc) effect, a component of the event-related brain potential thought to reflect attentional allocation. They presented a cue display followed by a target display of 4 letters. Each display contained a green item and a red item. Some participants responded to the red letter and others to the green letter. Converging lines of evidence indicated that attention was captured by the cues with the same color as the target. First, these target-color cues produced a cuing validity effect on behavioral measures. Second, distractors appearing in the cued location produced larger compatibility effects. Third, the target-color cue produced a robust N2pc effect, similar in magnitude to the N2pc effect to the target itself. Furthermore, the target-color cue elicited a similar N2pc effect regardless of whether it competed with a simultaneous abrupt onset. The findings provide converging evidence for attentional capture contingent on top-down control settings.     

The effect of visual threat on spatial attention to touch

Viewing a threatening stimulus can bias visual attention toward that location. Such effects have typically been investigated only in the visual modality, despite the fact that many threatening stimuli are most dangerous when close to or in contact with the body. Recent multisensory research indicates that a neutral visual stimulus, such as a light flash, can lead to a tactile attention shift towards a nearby body part. Here, we investigated whether the threat value of a visual stimulus modulates its effect on attention to touch. Participants made speeded discrimination responses about tactile stimuli presented to one or other hand, preceded by a picture cue (snake, spider, flower or mushroom) presented close to the same or the opposite hand. Pictures of snakes led to a significantly greater tactile attentional facilitation effect than did non-threatening pictures of flowers and mushrooms. Furthermore, there was a correlation between self-reported fear of snakes and spiders and the magnitude of early facilitation following cues of that type. These findings demonstrate that the attentional bias towards threat extends to the tactile modality and indicate that perceived threat value can modulate the cross-modal effect that a visual cue has on attention to touch.     

Local contextual cuing in visual search

Previous research has indicated that covariations between the global layout of search displays and target locations result in contextual cuing: the global context guides attention to probable target locations. The present experiments extend these findings by showing that local redundancies also facilitate visual search. Participants searched for randomly located targets in invariant homogenous displays, i.e., the global context provided information neither about the location nor about the identity of the target. The only redundancy referred to spatial relations between the targets and certain distractors: Two of the distractors were frequently presented next to the targets. In four of five experiments, targets with frequent flankers were detected faster than targets with rare flankers. The data suggest that this local contextual cuing does not depend on awareness of the redundant local topography but needs the redundantly related stimuli to be attended to.     

Probing attentional modulation of contextual cueing

The repetition of spatial layout implicitly facilitates visual search (contextual cueing effect; Chun & Jiang, 1998). Although a substantial number of studies have explored the mechanism underlying the contextual cueing effect, the manner in which contextual information guides spatial attention to a target location during a visual search remains unclear. We investigated the nature of attentional modulation by contextual cueing, using a hybrid paradigm of a visual search task and a probe dot detection task. In the case of a repeated spatial layout, detection of a probe dot was facilitated at a search target location and was inhibited at distractor locations relative to nonrepeated spatial layouts. Furthermore, these facilitatory and inhibitory effects possessed different learning properties across epochs (Experiment 1) and different time courses within a trial (Experiment 2). These results suggest that contextual cueing modulates attentional processing via both facilitation to the location of “to-be-attended” stimuli and inhibition to the locations of “to-be-ignored” stimuli.