Cross-modal links in exogenous covert spatial orienting between touch, audition, and vision

Three experiments investigated cross-modal links between touch, audition, and vision in the control of covert exogenous orienting. In the first two experiments, participants made speeded discrimination responses (continuous vs. pulsed) for tactile targets presented randomly to the index finger of either hand. Targets were preceded at a variable stimulus onset asynchrony (150,200, or 300 msec) by a spatially uninformative cue that was either auditory (Experiment 1) or visual (Experiment 2) on the same or opposite side as the tactile target. Tactile discriminations were more rapid and accurate when cue and target occurred on the same side, revealing cross-modal covert orienting. In Experiment 3, spatially uninformative tactile cues were presented prior to randomly intermingled auditory and visual targets requiring an elevation discrimination response (up vs. down). Responses were significantly faster for targets in both modalities when presented ipsilateral to the tactile cue. These findings demonstrate that the peripheral presentation of spatially uninforrnative auditory and visual cues produces cross-modal orienting that affects touch, and that tactile cues can also produce cross-modal covert orienting that affects audition and vision.     

内源性注意与外源性注意的跨通道比较

该研究利用空间线索技术的实验模式,考察跨视觉和听觉通道的内源性选择注意与外源性选择性注意的相互关系。实验结果表明：(1)听觉中央线索在较长的SOA(至少500毫秒)条件下,可以引导内源性空间选择性注意;同时外周线索突现也能自动化地吸引部分注意资源。(2)听觉和视觉选择注意是分离的加工通道,但二者之间存在相互联系。     

Audiovisual links in exogenous covert spatial orienting

Subjects judged the elevation (up vs. down, regardless of laterality) of peripheral auditory or visual targets, following uninformative cues on either side with an intermediate elevation. Judgments were better for targets in either modality when preceded by an uninformative auditory cue on the side of the target. Experiment 2 ruled out nonattentional accounts for these spatial cuing effects. Experiment 3 found that visual cues affected elevation judgments for visual but not auditory targets. Experiment 4 confirmed that the effect on visual targets was attentional. In Experiment 5, visual cues produced spatial cuing when targets were always auditory, but saccades toward the cue may have been responsible. No such visual-to-auditory cuing effects were found in Experiment 6 when saccades were prevented, though they were present when eye movements were not monitored. These results suggest a one-way cross-modal dependence in exogenous covert orienting whereby audition influences vision, but not vice versa. Possible reasons for this asymmetry are discussed in terms of the representation of space within the brain.     

Electrophysiological evidence for the "missing link" in crossmodal attention.

Orienting attention involuntarily to the location of a sensory event influences responses to subsequent stimuli that appear in different modalities with one possible exception: orienting attention involuntarily to a sudden light sometimes fails to affect responses to subsequent sounds (e.g., Spence & Driver, 1997). Here we investigated the effects of involuntary attention to a brief flash on the processing of subsequent sounds in a design that eliminates stimulus-response compatibility effects and criterion shifts as confounding factors. In addition, the neural processes mediating crossmodal attention were studied by recording event-related brain potentials. Our data show that orienting attention to the location of a spatially nonpredictive visual cue modulates behavioural and neural responses to subsequent auditory targets when the stimulus onset asynchrony is short (between 100 and 300 ms). These findings are consistent with the hypothesis that involuntary shifts of attention are controlled by supramodal brain mechanisms rather than by modality-specific ones.     

Improving visual spatial working memory in younger and older adults: effects of cross-modal cues

Spatially informative auditory and vibrotactile (cross-modal) cues can facilitate attention but little is known about how similar cues influence visual spatial working memory (WM) across the adult lifespan. We investigated the effects of cues (spatially informative or alerting pre-cues vs. no cues), cue modality (auditory vs. vibrotactile vs. visual), memory array size (four vs. six items), and maintenance delay (900 vs. 1800 ms) on visual spatial location WM recognition accuracy in younger adults (YA) and older adults (OA). We observed a significant interaction between spatially informative pre-cue type, array size, and delay. OA and YA benefitted equally from spatially informative pre-cues, suggesting that attentional orienting prior to WM encoding, regardless of cue modality, is preserved with age. Contrary to predictions, alerting pre-cues generally impaired performance in both age groups, suggesting that maintaining a vigilant state of arousal by facilitating the alerting attention system does not help visual spatial location WM.     

On audiovisual spatial synergy: the fragility of the phenomenon

Recent literature has highlighted the importance and ubiquity of cross-modal links in spatial attention, whereby shifts in attention in one modality often induce corresponding shifts in other modalities. We attempted to provide further evidence for the case of audiovisual links during sustained endogenous attention by addressing several potential methodological confounds in previous demonstrations. However, we failed repeatedly to reproduce the phenomenon of spatial synergies between auditory and visual attention, found by Driver and Spence (1994) and frequently cited to support the automatic nature of cross-modal attention links. We discuss the results in light of recent evidence about cross-modal spatial links during sustained attention and support the idea that such links can weaken or even disappear under certain circumstances, such as during periods of sustained attention. The implication is that individuals can select inputs from different modalities from different locations more easily than previously had been thought.     

Modulation of auditory spatial attention by visual emotional cues: differential effects of attentional engagement and disengagement for pleasant and unpleasant cues

Previous research has demonstrated that threatening, compared to neutral pictures, can bias attention towards non-emotional auditory targets. Here we investigated which subcomponents of attention contributed to the influence of emotional visual stimuli on auditory spatial attention. Participants indicated the location of an auditory target, after brief (250 ms) presentation of a spatially non-predictive peripheral visual cue. Responses to targets were faster at the location of the preceding visual cue, compared to at the opposite location (cue validity effect). The cue validity effect was larger for targets following pleasant and unpleasant cues compared to neutral cues, for right-sided targets. For unpleasant cues, the crossmodal cue validity effect was driven by delayed attentional disengagement, and for pleasant cues, it was driven by enhanced engagement. We conclude that both pleasant and unpleasant visual cues influence the distribution of attention across modalities and that the associated attentional mechanisms depend on the valence of the visual cue.     

跨通道的内源性选择注意

该实验利用空间线索技术研究跨视觉和听觉通道的内源性选择性注意,实验结果表明视觉中央线索能可靠地引导出内源性视觉选择性注意,听觉中央线索在较长的ＳＯＡ（至少５００ｍｓ）条件下也能引导出内源性视觉选择性注意,支持视觉和听觉具有特异性的注意加工通道,但两者之间存在相互连接的假说。     

Attentional Orienting in Two-dimensional Space

This paper examines how the covert orienting of spatial attention affects motor responses to visual stimuli. Premotor theories, as well as hemi-field inhibition accounts of visual attention predict an increase in response times when a target stimulus appears in the opposite direction to a spatial cue. Some models also suggest that this meridional effect should be increased across oblique meridians. Two types of cue (central and peripheral) were used to orient attention towards locations prior to the onset of visual targets. Simple manual (press button) and saccadic responses were measured. No meridional effects were found with peripheral cues, whereas central cueing produced meridional effects across all meridians. Cueing effects did not vary significantly with two-dimensional axis for either manual or saccadic responses. Increases in response time with cue-target distance were found for both response and cue types. For saccades, distance gradients were shallower moving distally rather than proximally from the cued position. However, simple manual responses did not show this asymmetry. Orienting to central cues also modulated the amplitude of saccades. The results are consistent with an effect of attentional cues in oculomotor centres as well as the existence of actiondependent attentional representations. However, it is proposed that, rather than reflecting oculomotor programming, meridional effects arise from a directional organization within spatio-cognitive representations.     

Interaction between endogenous and exogenous orienting in crossmodal attention

Using a cue-target paradigm, we investigated the interaction between endogenous and exogenous orienting in cross-modal attention. A peripheral (exogenous) cue was presented after a central (endogenous) cue with a variable time interval. The endogenous and exogenous cues were presented in one sensory modality (auditory in Experiment 1 and visual in Experiment 2) whereas the target was presented in another modality. Both experiments showed a significant endogenous cuing effect (longer reaction times in the invalid condition than in the valid condition). However, exogenous cuing produced a facilitatory effect in both experiments in response to the target when endogenous cuing was valid, but it elicited a facilitatory effect in Experiment 1 and an inhibitory effect in Experiment 2 when endogenous cuing was invalid. These findings indicate that endogenous and exogenous cuing can co-operate in orienting attention to the crossmodal target. Moreover, the interaction between endogenous and exogenous orienting of attention is modulated by the modality between the cue and the target.     

跨感觉通道任务中刺激驱动注意捕获的不对称性

通过两个实验探讨了来自不同感觉通道或不同空间方位的奇异刺激在视听搜索范式中的注意捕获。实验一使用定位任务探讨刺激驱动注意捕获中跨通道效应且及其不对称性, 结果发现, 当靶子在听觉通道时, 只有来自听觉同侧空间方位的奇异刺激成功的捕获了注意; 而来自视觉同侧空间和异侧空间的奇异刺激并没有捕获注意。实验二使用检测任务进一步探讨刺激驱动的注意捕获中的跨通道效应且具有不对称性, 结果发现, 来自同侧和异侧的听觉奇异刺激均捕获了注意, 但是视觉奇异刺激却不能捕获注意。研究表明, 视听搜索范式中的奇异刺激的注意捕获具有不对称性, 且存在着一种超感觉通道的注意资源。     

Cross-modal associations between vision, touch, and audition influence visual search through top-down attention, not bottom-up capture

Recently, Guzman-Martinez, Ortega, Grabowecky, Mossbridge, and Suzuki (Current Biology : CB, 22(5), 383–388, 2012) reported that observers could systematically match auditory amplitude modulations and tactile amplitude modulations to visual spatial frequencies, proposing that these cross-modal matches produced automatic attentional effects. Using a series of visual search tasks, we investigated whether informative auditory, tactile, or bimodal cues can guide attention toward a visual Gabor of matched spatial frequency (among others with different spatial frequencies). These cues improved visual search for some but not all frequencies. Auditory cues improved search only for the lowest and highest spatial frequencies, whereas tactile cues were more effective and frequency specific, although less effective than visual cues. Importantly, although tactile cues could produce efficient search when informative, they had no effect when uninformative. This suggests that cross-modal frequency matching occurs at a cognitive rather than sensory level and, therefore, influences visual search through voluntary, goal-directed behavior, rather than automatic attentional capture.     

Capture of attention in selective frequency listening

Four signal-detection experiments demonstrated robust stimulus-driven, or exogenous, attentional processes in selective frequency listening. Detection of just-above-threshold signal tones was consistently better when the, signal matched the frequency of an uninformative cue tone, even with relatively long cue-signal delays (Experiment 1) or when as few as 1 in 8 signals were at the cued frequency (Experiment 2). Experiments 3 and 4 compared performance with informative and uninformative cues. The involvement of intentional, or endogenous, processes was found to only slightly increase the size of the cuing effect beyond that evident with solely exogenous processes, although the attention band, a measure of how narrowly attention is focused, was found to be wider when cues were informative. The implications for models of auditory attention are discussed.     

Auditory orienting of attention: Effects of cues and verbal workload with children and adults

The use of tone cues has an improving effect on the auditory orienting of attention for children as for adults. Verbal cues, on the contrary, do not seem to orient attention as efficiently before the age of 9 years. However, several studies have reported inconsistent effects of orienting attention on ear asymmetries. Multiple factors are questioned, such as the role of verbal workload. Indeed, the semantic nature of the dichotic pairs and their load of processing may explain orienting of attention performance. Thus, by controlling for the role of verbal workload, the present experiment aimed to evaluate the development of capacities for the auditory orienting of attention. Right-handed, 6- to 12-year-olds and adults were recruited to complete either a tone cue or a verbal cue dichotic listening task in the identification of familiar words or nonsense words. A factorial design analysis of variance showed a significant right-ear advantage for all the participants and for all the types of stimuli. A major developmental effect was observed in which verbal cues played an important role: they allowed the 6- to 8-year-olds to improve their performance of identification in the left ear. These effects were taken as evidence of the implication of top-down processes in cognitive flexibility across development.     

Is the exogenous orienting of spatial attention truly automatic? Evidence from unimodal and multisensory studies

The last decade has seen great progress in the study of the nature of crossmodal links in exogenous and endogenous spatial attention (see [Spence, C., McDonald, J., & Driver, J. (2004). Exogenous spatial cuing studies of human crossmodal attention and multisensory integration. In C. Spence, & J. Driver (Eds.), Crossmodal space and crossmodal attention (pp. 277-320). Oxford, UK: Oxford University Press.], for a recent review). A growing body of research now highlights the existence of robust crossmodal links between auditory, visual, and tactile spatial attention. However, until recently, studies of exogenous and endogenous attention have proceeded relatively independently. In daily life, however, these two forms of attentional orienting continuously compete for the control of our attentional resources, and ultimately, our awareness. It is therefore critical to try and understand how exogenous and endogenous attention interact in both the unimodal context of the laboratory and the multisensory contexts that are more representative of everyday life. To date, progress in understanding the interaction between these two forms of orienting has primarily come from unimodal studies of visual attention. We therefore start by summarizing what has been learned from this large body of empirical research, before going on to review more recent studies that have started to investigate the interaction between endogenous and exogenous orienting in a multisensory setting. We also discuss the evidence suggesting that exogenous spatial orienting is not truly automatic, at least when assessed in a crossmodal context. Several possible models describing the interaction between endogenous and exogenous orienting are outlined and then evaluated in terms of the extant data.     

On the generality of the displaywide contingent orienting hypothesis: Can a visual onset capture attention without top-down control settings for displaywide onset?

The contingent orienting hypothesis (Folk, Remington, & Johnston, 1992) states that attentional capture is contingent on top-down control settings induced by task demands. Past studies supporting this hypothesis have identified three kinds of top-down control settings: for target-specific features, for the strategy to search for a singleton, and for visual features in the target display as a whole. Previously, we have found stimulus-driven capture by onset that was not contingent on the first two kinds of settings (Yeh & Liao, 2008). The current study aims to test the third kind: the displaywide contingent orienting hypothesis (Gibson & Kelsey, 1998). Specifically, we ask whether an onset stimulus can still capture attention in the spatial cueing paradigm when attentional control settings for the displaywide onset of the target are excluded by making all letters in the target display emerge from placeholders. Results show that a preceding uninformative onset cue still captured attention to its location in a stimulus-driven fashion, whereas a color cue captured attention only when it was contingent on the setting for displaywide color. These results raise doubts as to the generality of the displaywide contingent orienting hypothesis and help delineate the boundary conditions on this hypothesis.     

Auditory, tactile, and multisensory cues facilitate search for dynamic visual stimuli

Presenting an auditory or tactile cue in temporal synchrony with a change in the color of a visual target can facilitate participants’ visual search performance. In the present study, we compared the magnitude of unimodal auditory, vibrotactile, and bimodal (i.e., multisensory) cuing benefits when the nonvisual cues were presented in temporal synchrony with the changing of the target’s color (Experiments 1 and 2). The target (a horizontal or vertical line segment) was presented among a number of distractors (tilted line segments) that also changed color at various times. In Experiments 3 and 4, the cues were also made spatially informative with regard to the location of the visual target. The unimodal and bimodal cues gave rise to an equivalent (significant) facilitation of participants’ visual search performance relative to a no-cue baseline condition. Making the unimodal auditory and vibrotactile cues spatially informative produced further performance improvements (on validly cued trials), as compared with cues that were spatially uninformative or otherwise spatially invalid. A final experiment was conducted in order to determine whether cue location (close to versus far from the visual display) would influence participants’ visual search performance. Auditory cues presented close to the visual search display were found to produce significantly better performance than cues presented over headphones. Taken together, these results have implications for the design of nonvisual and multisensory warning signals used in complex visual displays.     

Involuntary attention and identification accuracy

Using the spatial cuing paradigm, Prinzmetal, McCool, and Park (2005) made the distinction between voluntary and involuntary attention. They claimed that although accuracy was affected by an informative spatial cue (which controls voluntary attention), it was not affected by a noninformative cue (which controls involuntary attention). We reevaluate two reports that assert that noninformative spatial cues affect accuracy. Dufour (1999) reported that a noninformative auditory cue enhanced visual identification in a conjunction search task. Klein and Dick (2002) reported that, in an RSVP task with visual cues, the cue also enhanced accuracy at short stimulus onset asynchronies. We found that Dufour's results were due to overt orienting (eye movements) rather than to covert attention. The results of Klein and Dick were due either to location uncertainty or to a confounding of the order of stimulus presentation and condition.     

Modulation of object-based attention by spatial focus under endogenous and exogenous orienting

In R. Egly, J. Driver, and R. D. Rafal's (1994) influential double-rectangle spatial-cuing paradigm, exogenous cues consistently induce object-based attention, whereas endogenous cues generally induce space-based attention. This difference suggests an interdependency between mode of orienting (endogenous vs exogenous) and mode of selection (object based vs space based). However, mode of orienting is generally confounded with initial focus of attention: Endogenous orienting begins with attention focused on a central cue, whereas exogenous orienting begins with attention widely spread. In this study, an attentional-focusing hypothesis is examined and supported by experiments showing that for both endogenous and exogenous cuing, object-based effects are obtained under conditions that encourage spread attention, but they are attenuated under conditions that encourage focused attention. General implications for object-based attention are discussed. ((c) 2003 APA, all rights reserved)     

Attentional asymmetries in a visual orienting task are related to temperament

Spatial asymmetries are an intriguing feature of directed attention. Recent observations indicate an influence of temperament upon the direction of these asymmetries. It is unknown whether this influence generalises to visual orienting behaviour. The aim of the current study was therefore to explore the relationship between temperament and measures of spatial orienting as a function of target hemifield. An exogenous cueing task was administered to 92 healthy participants. Temperament was assessed using Carver and White's (1994) Behavioural Inhibition System and Behavioural Activation System (BIS/BAS) scales. Individuals with high sensitivity to punishment and low sensitivity to reward showed a leftward asymmetry of directed attention when there was no informative spatial cue provided. This asymmetry was not present when targets were preceded by spatial cues that were either valid or invalid. The findings support the notion that individual variations in temperament influence spatial asymmetries in visual orienting, but only when lateral targets are preceded by a non-directional (neutral) cue. The results are discussed in terms of hemispheric asymmetries and dopamine activity.