Stimulus array onset as a preparatory signal in attentional selection

Warning signals enhance psychomotor performance by optimising preparation for the arrival of an event. Recent evidence, however, suggests that a warning signal can also disrupt attentional preparation by interfering with the process of preparing. It was hypothesised that a warning signal consisting of a change to the task-relevant items (array onset) may be more effective than a traditional warning signal consisting of the arrival, or removal, of a bar-cue which is independent of the task array. In three experiments array onset was a more effective warning signal than the bar-cue because reaction times were significantly faster without an increase in errors. In addition, an auditory warning signal resulted in faster reaction time than the bar-cue but in performance equivalent to that with an onset warning signal. Thus, the superiority of an auditory warning signal, reported by Davis and Green, was not found, when the interference of the visual warning signal with preparation was reduced. These results suggest that a visual warning signal consisting of a change to the stimulus array is more effective than an event independent from the stimulus array.     

Identification of visual stimuli is improved by accompanying auditory stimuli: the role of eye movements and sound location

Can auditory signals influence the processing of visual information? The present study examined the effects of simple auditory signals (clicks and noise bursts) whose onset was simultaneous with that of the visual target, but which provided no information about the target. It was found that such a signal enhances performance in the visual task: the accessory sound reduced response times for target identification with no cost to accuracy. The spatial location of the sound (whether central to the display or at the target location) did not modify this facilitation. Furthermore, the same pattern of facilitation was evident whether the observer fixated centrally or moved their eyes to the target. The results were not altered by changes in the contrast (and therefore visibility) of the visual stimulus or by the perceived utility of the spatial location of the sound. We speculate that the auditory signal may promote attentional 'disengagement' and that, as a result, observers are able to process the visual target sooner when sound accompanies the display relative to when visual information is presented alone.     

Audiovisual phenomenal causality

We report three experiments in which visual or audiovisual displays depicted a surface (target) set into motion shortly after one or more events occurred. A visual motion was used as an initial event, followed directly either by the target motion or by one of three marker events: a collision sound, a blink of the target stimulus, or the blink together with the sound. The delay between the initial event and the onset of the target motion was varied systematically. The subjects had to rate the degree of perceived causality between these events. The results of the first experiment showed a systematic decline of causality judgments with an increasing time delay. Causality judgments increased when additional auditory or visual information marked the onset of the target motion. Visual blinks of the target and auditory clacks produced similar causality judgments. The second experiment tested several models of audiovisual causal processing by varying the position of the sound within the visual delay period. No systematic effect of the sound position occurred. The third experiment showed a subjective shortening of delays filled by a clack sound, as compared with unfilled delays. However, this shortening cannot fully explain the increased tolerance for delays containing the clack sound. Taken together, the results are consistent with the interpretation that the main source of the causality judgments in our experiments is the impression of a plausible unitary event and that perfect synchrony is not necessary in this case.     

Crossmodal spatial attention shift produced by centrally presented gaze cues1

Abstract: Despite previous failures to identify visual‐upon‐auditory spatial‐cuing effects, recent studies have demonstrated that the abrupt onset of a lateralized visual stimulus triggers a shift of spatial attention in response to auditory judgment. Nevertheless, whether a centrally presented visual stimulus orients auditory attention remained unclear. The present study investigated whether centrally presented gaze cues trigger a reflexive shift of attention in response to auditory judgment. Participants fixated on a schematic face in which the eyes looked left or right (the cue). A target sound was then presented to the left or right of the cue. Participants judged the direction of the target as quickly as possible. Even though participants were told that the gaze direction did not predict the direction of the target, the response time was significantly faster when the gaze was in the target direction than when it was in the non‐target direction. These findings provide initial evidence for visual‐upon‐auditory spatial‐cuing effects produced by centrally presented cues, suggesting that a reflexive crossmodal shift of attention does occur with a centrally presented visual stimulus.     

The modality shift effect and the effectiveness of warning signals in different modalities

Which is better, a visual or an auditory warning signal? Initial findings suggested that an auditory signal was more effective, speeding reaction to a target more than a visual warning signal, particularly at brief foreperiods [Bertelson, P., & Tisseyre, F. (1969). The time-course of preparation: confirmatory results with visual and auditory warning signals. Acta Psychologica, 30. In W.G. Koster (Ed.), Attention and Performance II (pp. 145-154); Davis, R., & Green, F. A. (1969). Intersensory differences in the effect of warning signals on reaction time. Acta Psychologica, 30. In W.G. Koster (Ed.), Attention and Performance II (pp. 155-167)]. This led to the hypothesis that an auditory signal is more alerting than a visual warning signal [Sanders, A. F. (1975). The foreperiod effect revisited. Quarterly Journal of Experimental Psychology, 27, 591-598; Posner, M. I., Nissen, M. J., & Klein, R. M. (1976). Visual dominance: an information-processing account of its origins and significance. Psychological Review, 83, 157-171]. Recently [Turatto, M., Benso, F., Galfano, G., & Umilta, C. (2002). Nonspatial attentional shifts between audition and vision. Journal of Experimental Psychology: Human Perception and Performance, 28, 628-639] found no evidence for an auditory warning signal advantage and showed that at brief foreperiods a signal in the same modality as the target facilitated responding more than a signal in a different modality. They accounted for this result in terms of the modality shift effect, with the signal exogenously recruiting attention to its modality, and thereby facilitating responding to targets arriving in the modality to which attention had been recruited. The present study conducted six experiments to understand the cause of these conflicting findings. The results suggest that an auditory warning signal is not more effective than a visual warning signal. Previous reports of an auditory superiority appear to have been caused by using different locations for the visual warning signal and visual target, resulting in the target arriving at an unattended location when the foreperiod was brief. Turatto et al.'s results were replicated with a modality shift effect at brief foreperiods. However, it is also suggested that previous measures of the modality shift effect may still have been confounded by a location cuing effect.     

Effects of directional auditory and visual warnings at intersections on reaction times and speed reduction times

Intersection collision warning systems (ICWSs) have an important impact on driving safety because making the potential collision at intersection predictable, allow reducing the probability and severity of accidents. Among the several types of alarms to alert the driver of an imminent collision, those most used concerning the auditory and the visual stimulus. However, it is unclear whether is more effective an audio or a visual warning. In addition, no study compared the effects on drivers’ behavior induced by an acoustic and a visual directional warning. The main objective of the present study was to assess, in response to a potential conflict event at the intersections, the effects of directional auditory and visual warnings on driving performance.A driving simulator experiment was carried out to collect drivers’ behavior in response to a vehicle that failed to stop at the intersection. The parameters reaction time and speed reduction time were used for the evaluation of the effects on driving performance. These duration variables were modeled following the survival analysis, by the use of the accelerated failure time duration model with a Weibull distribution.Results showed that when the directional warning system (auditory or visual) was present, the drivers were able to detect earlier the violator vehicle. This effect led to a more comfortable braking maneuver and, thus, less possibilities of an unexpected maneuver for the following vehicle, avoiding the car – following collisions. The effectiveness of ICWSs was more evident for the directional auditory speech message; for this condition, in fact, the lower reaction time and the longer speed reduction time were obtained.The outcomes of the present study provide useful suggestions about the most effective collision warning systems that the automotive industry should develop and equip on vehicles.     

Early development of attentional disengagement and phasic alertness

Attention development is a critical foundation for cognitive abilities. This study examines the relationship between phasic aspects of alertness and disengagement in infants, using the overlap paradigm. Research shows that visual disengagement in overlap condition is modulated by auditory cues in 6-year-olds. Our participants were aged 6 months (N = 20), 12 months (N = 27), and 24 months (N = 14). Phasic alertness during overlap and no-overlap tasks was manipulated using a spatially nondirective warning signal shortly before onset of the peripheral target. Responses in overlap condition were slower and fewer than in no-overlap condition. The signal showed a tendency to reduce latencies in both overlap and no-overlap conditions. While our hypothesis that the warning signal might be more effective in younger infants was not supported, we confirmed the association reported in previous studies between temperamental soothability and disengagement latencies in infancy.     

Overriding auditory attentional capture

Attentional capture by color singletons during shape search can be eliminated when the target is not a feature singleton (Bacon & Egeth, 1994). This suggests that a "singleton detection" search strategy must be adopted for attentional capture to occur. Here we find similar effects on auditory attentional capture. Irrelevant high-intensity singletons interfered with an auditory search task when the target itself was also a feature singleton. However, singleton interference was eliminated when the target was not a singleton (i.e., when nontargets were made heterogeneous, or when more than one target sound was presented). These results suggest that auditory attentional capture depends on the observer's attentional set, as does visual attentional capture. The suggestion that hearing might act as an early warning system that would always be tuned to unexpected unique stimuli must therefore be modified to accommodate these strategy-dependent capture effects.     

A comparison of auditory and visual apparent motion presented individually and with crossmodal moving distractors

Unimodal auditory and visual apparent motion (AM) and bimodal audiovisual AM were investigated to determine the effects of crossmodal integration on motion perception and direction-of-motion discrimination in each modality. To determine the optimal stimulus onset asynchrony (SOA) ranges for motion perception and direction discrimination, we initially measured unimodal visual and auditory AMs using one of four durations (50, 100, 200, or 400 ms) and ten SOAs (40-450 ms). In the bimodal conditions, auditory and visual AM were measured in the presence of temporally synchronous, spatially displaced distractors that were either congruent (moving in the same direction) or conflicting (moving in the opposite direction) with respect to target motion. Participants reported whether continuous motion was perceived and its direction. With unimodal auditory and visual AM, motion perception was affected differently by stimulus duration and SOA in the two modalities, while the opposite was observed for direction of motion. In the bimodal audiovisual AM condition, discriminating the direction of motion was affected only in the case of an auditory target. The perceived direction of auditory but not visual AM was reduced to chance levels when the crossmodal distractor direction was conflicting. Conversely, motion perception was unaffected by the distractor direction and, in some cases, the mere presence of a distractor facilitated movement perception.     

Auditory and audiovisual inhibition of return

Two experiments examined any inhibition-of-return (IOR) effects from auditory cues and from preceding auditory targets upon reaction times (RTs) for detecting subsequent auditory targets. Auditory RT was delayed if the preceding auditory cue was on the same side as the target, but was unaffected by the location of the auditorytarget from the preceding trial, suggesting that response inhibition for the cue may have produced its effects. By contrast, visual detection RT was inhibited by the ipsilateral presentation of a visual target on the preceding trial. In a third experiment, targets could be unpredictably auditory or visual, and no peripheral cues intervened. Both auditory and visual detection RTs were now delayed following an ipsilateral versus contralateral target in either modality on the preceding trial, even when eye position was monitored to ensure central fixation throughout. These data suggest that auditory target—target IOR arises only when target modality is unpredictable. They also provide the first unequivocal evidence for cross-modal IOR, since, unlike other recent studies (e.g., Reuter-Lorenz, Jha, & Rosenquist, 1996; Tassinari & Berlucchi, 1995; Tassinari & Campara, 1996), the present cross-modal effects cannot be explained in terms of response inhibition for the cue. The results are discussed in relation to neurophysiological studies and audiovisual links in saccade programming.     

Directing spatial attention towards the illusory location of a ventriloquized sound

In this study, we examined whether ventriloquism can rearrange external space on which spatial reflexive attention operates. The task was to judge the elevation (up vs down) of auditory targets delivered in the left or the right periphery, taking no account of side of presentation. Targets were preceded by either auditory, visual, or audiovisual cues to that side. Auditory, but not visual cues had an effect on the speed of auditory target discrimination. On the other hand, a ventriloquized cue, consisting of a tone in central location synchronized with a light flash in the periphery, facilitated responses to targets appearing on the same side as the flash. That effect presumably resulted from the attraction of the apparent location of the tone towards the flash, a well-known manifestation of ventriloquism. Ventriloquism thus can reorganize space in which reflexive attention operates.     

Spatial and temporal factors determine auditory-visual interactions in human saccadic eye movements

In this paper, we show that human saccadic eye movements toward a visual target are generated with a reduced latency when this target is spatially and temporally aligned with an irrelevant auditory nontarget. This effect gradually disappears if the temporal and/or spatial alignment of the visual and auditory stimuli are changed. When subjects are able to accurately localize the auditory stimulus in two dimensions, the spatial dependence of the reduction in latency depends on the actual radial distance between the auditory and the visual stimulus. If, however, only the azimuth of the sound source can be determined by the subjects, the horizontal target separation determines the strength of the interaction. Neither saccade accuracy nor saccade kinematics were affected in these paradigms. We propose that, in addition to an aspecific warning signal, the reduction of saccadic latency is due to interactions that take place at a multimodal stage of saccade programming, where theperceived positions of visual and auditory stimuli are represented in a common frame of reference. This hypothesis is in agreement with our finding that the saccades often are initially directed to the average position of the visual and the auditory target, provided that their spatial separation is not too large. Striking similarities with electrophysiological findings on multisensory interactions in the deep layers of the midbrain superior colliculus are discussed.     

Saccade latency and warning signals: Stimulus onset,offset, and change as warning events

Two experiments investigated saccade latency to a peripheral target under various warning signal conditions. In Experiment I, the effects of warning stimulus onset, change, and two offset conditions were compared at warning intervals of 0, 100, 300, and 600 msec. Warning stimulus onset, change, and offset were all effective in reducing saccade latency as compared to a no-warning control condition, but warning stimulus offset resulted in shorter saccade latency than onset or change at all warning intervals. Experiment 2 compared onset and offset warning conditions at ?300-, ?250-, ?200-, ?150-, ?100-, ?50-, 0-, and 50-msec intervals. Responses following onset were slower than those following offset at the latter five intervals, while warning onset resulted in slower saccades than no-warning control conditions at ?150-, ?100-, and ?50-msec intervals. These results indicate that the onset of a visual warning signal can have an interfering effect on the programming or execution of a saccade.     

内源性注意与外源性注意的跨通道比较

该研究利用空间线索技术的实验模式,考察跨视觉和听觉通道的内源性选择注意与外源性选择性注意的相互关系。实验结果表明：(1)听觉中央线索在较长的SOA(至少500毫秒)条件下,可以引导内源性空间选择性注意;同时外周线索突现也能自动化地吸引部分注意资源。(2)听觉和视觉选择注意是分离的加工通道,但二者之间存在相互联系。     

Effects of same-modality interference on immediate serial recall of auditory and visual information.

Two studies investigated the effects of same-modality interference on the immediate serial recall of auditorily and visually presented stimuli. Typically, research in which this task is used has been conducted in quiet rooms, excluding auditory information that is extraneous to the auditorily presented stimuli. However, visual information such as background items clearly within the subject's view have not been excluded during visual presentation. Therefore, in both the present studies, the authors used procedures that eliminated extra-list visual interference and introduced extra-list auditory interference. When same-modality interference was eliminated, weak visual recency effects were found, but they were smaller than those that were generated by auditorily presented items. Further, mid-list and end-of-list recall of visually presented stimuli was unaffected by the amount of interfering visual information. On the other hand, the introduction of auditory interference increased mid-list recall of auditory stimuli. The results of Experiment 2 showed that the mid-list effect occurred with a moderate, but not with a minimal or maximal, level of auditory interference, indicating that moderate amounts of auditory interference had an alerting effect that is not present in typical visual interference.     

A two-stage model for visual-auditory interaction in saccadic latencies

In two experiments, saccadic response time (SRT) for eye movements toward visual target stimuli at different horizontal positions was measured under simultaneous or near-simultaneous presentation of an auditory nontarget (distractor). The horizontal position of the auditory signal was varied, using a virtual auditory environment setup. Mean SRT to a visual target increased with distance to the auditory nontarget and with delay of the onset of the auditory signal relative to the onset of the visual stimulus. A stochastic model is presented that distinguishes a peripheral processing stage with separate parallel activation by visual and auditory information from a central processing stage at which intersensory integration takes place. Two model versions differing with respect to the role of the auditory distractors are tested against the SRT data.     

Rate limits in sensorimotor synchronization with auditory and visual sequences: the synchronization threshold and the benefits and costs of interval subdivision

Synchronization of finger taps with an isochronous event sequence becomes difficult when the event rate exceeds a certain limit. In Experiment 1, the synchronization threshold was reached at interonset intervals (IOIs) above 100 ms with auditory tone sequences (in a 1:4 tapping task) but at IOIs above 400 ms with visual flash sequences (1:1 tapping). Using IOIs above those limits, the author investigated in Experiment 2 the reduction in the variability of asynchronies that tends to occur when the intervals between target events are subdivided by additional identical events (1:1 vs. 1:n tapping). The subdivision benefit was found to decrease with IOI duration and to turn into a cost at IOIs of 200-250 ms in auditory sequences and at IOIs of 450-500 ms in visual sequences. The auditory results are relevant to the limits of metrical subdivision and beat rate in music. The visual results demonstrate the remarkably weak rhythmicity of (nonmoving) visual stimuli.     

Transient and sustained effects of an auditory accessory stimulus in a visual go/no go task

The present study examined the facilitation effects of an auditory accessory stimulus that was irrelevant to a visual reaction time (RT) task as a function of stimulus onset asynchrony between the accessory stimulus and the visual target stimulus. Results of the present experiment showed that the auditory accessory stimulus caused two variations of RT, short-term and long-term, that were distinguished on the basis of stimulus onset asynchrony. This finding suggested that effects of an accessory stimulus consisted of two qualitatively different facilitations. The Transient Facilitation appeared instantly after the onset of the accessory stimulus and then soon decayed, and the Sustained Facilitation increased and decreased more gradually than the former.     

Spatial orienting in the visual field: a unified perceptual space?

Visual attention can be oriented toward a spatial location in the visual field exogenously by an abrupt onset of a peripheral cue. In a series of behavioral studies on exogenous orienting of attention with a double-cue paradigm, we demonstrated a functional subdivision of perceptual space in the visual field. Specifically, inhibition of return (IOR) is much stronger at periphery relative to perifoveal visual field up to approximately 15° eccentricity, suggesting two dissociable functional areas in the visual field. To further investigate the generality of this functional subdivision of the visual field, we measured IOR effects with another single-cue paradigm and applied a very short cue-target interval that was typically anticipated not to observe any inhibitory effect at all. Consistent with this expectation, no IOR effects at the eccentricities up to 15° were observed. However, significant IOR effects beyond 15° eccentricities were consistently demonstrated. These results not only revealed an early onset of IOR for more peripheral stimuli, but also confirmed that the perceptual space in the visual field is not homogeneous but underlies a functional subdivision with a border of ca. 15° eccentricity.     

Saccade latency in children and adults: Effects of warning interval and target eccentricity

Saccadic response latency to the onset of an eccentric target was studied in children (mean age = 8.7) and adults. The independent variables investigated were fixation-light offset to target-light onset warning interval (0, 100, 300, and 600 msec) and target eccentricity (5° or 15°). Both children and adults showed shorter saccade latencies under warning-interval conditions. Children were found to have longer latencies than adults with 0 or 100 msec warning intervals but to respond with as short or shorter latencies with 300 or 600 msec warning intervals. Target eccentricity effects did not interact with age, and occurred only with a lower target intensity. Children defined as poor readers could initiate a response as quickly as good readers but were less able to maintain fixation-light fixation prior to target onset.