Using spatial vibrotactile cues to direct visual attention in driving scenes

We report two experiments designed to investigate the potential use of vibrotactile warning signals to present spatial information to car drivers. Participants performed an attention-demanding rapid serial visual presentation (RSVP) monitoring task. Meanwhile, whenever they felt a vibrotactile stimulus presented on either their front or back, they had to check the front and the rearview mirror for the rapid approach of a car, and brake or accelerate accordingly. We investigated whether speeded responses to potential emergency driving situations could be facilitated by the presentation of spatially-predictive (80% valid; Experiment 1) or spatially-nonpredictive (50% valid; Experiment 2) vibrotactile cues. Participants responded significantly more rapidly following both spatially-predictive and spatially-nonpredictive vibrotactile cues from the same rather than the opposite direction as the critical driving events. These results highlight the potential utility of vibrotactile warning signals in automobile interface design for directing a driver’s visual attention to time-critical events or information.     

内源性注意与外源性注意的跨通道比较

该研究利用空间线索技术的实验模式,考察跨视觉和听觉通道的内源性选择注意与外源性选择性注意的相互关系。实验结果表明：(1)听觉中央线索在较长的SOA(至少500毫秒)条件下,可以引导内源性空间选择性注意;同时外周线索突现也能自动化地吸引部分注意资源。(2)听觉和视觉选择注意是分离的加工通道,但二者之间存在相互联系。     

跨通道的内源性选择注意

该实验利用空间线索技术研究跨视觉和听觉通道的内源性选择性注意,实验结果表明视觉中央线索能可靠地引导出内源性视觉选择性注意,听觉中央线索在较长的ＳＯＡ（至少５００ｍｓ）条件下也能引导出内源性视觉选择性注意,支持视觉和听觉具有特异性的注意加工通道,但两者之间存在相互连接的假说。     

High perceptual load causes inattentional blindness and deafness in drivers

ABSTRACT

Perceptual load theory of attention predicts that the level of perceptual load in a primary task affects the processing of additional stimuli. Given the lack of ecologically valid evidence for the model, the current study assessed the effect of perceptual load on driver awareness during simulated driving tasks. The results showed that perceptual load dramatically affected driver awareness for visual and auditory stimuli, even those that were driving relevant and safety critical (e.g. pedestrians or the sound of a car horn). The results support load theory and suggest that perceptual load may be an important factor in driver safety.     

Effects of directional auditory and visual warnings at intersections on reaction times and speed reduction times

Intersection collision warning systems (ICWSs) have an important impact on driving safety because making the potential collision at intersection predictable, allow reducing the probability and severity of accidents. Among the several types of alarms to alert the driver of an imminent collision, those most used concerning the auditory and the visual stimulus. However, it is unclear whether is more effective an audio or a visual warning. In addition, no study compared the effects on drivers’ behavior induced by an acoustic and a visual directional warning. The main objective of the present study was to assess, in response to a potential conflict event at the intersections, the effects of directional auditory and visual warnings on driving performance.A driving simulator experiment was carried out to collect drivers’ behavior in response to a vehicle that failed to stop at the intersection. The parameters reaction time and speed reduction time were used for the evaluation of the effects on driving performance. These duration variables were modeled following the survival analysis, by the use of the accelerated failure time duration model with a Weibull distribution.Results showed that when the directional warning system (auditory or visual) was present, the drivers were able to detect earlier the violator vehicle. This effect led to a more comfortable braking maneuver and, thus, less possibilities of an unexpected maneuver for the following vehicle, avoiding the car – following collisions. The effectiveness of ICWSs was more evident for the directional auditory speech message; for this condition, in fact, the lower reaction time and the longer speed reduction time were obtained.The outcomes of the present study provide useful suggestions about the most effective collision warning systems that the automotive industry should develop and equip on vehicles.     

Timing for the absence of a stimulus: the gap paradigm reversed

Contrary to data showing sensitivity to nontemporal properties of timed signals, current theories of interval timing assume that animals can use the presence or absence of a signal as equally valid cues as long as duration is the most predictive feature. Consequently, the authors examined rats' behavior when timing the absence of a visual or auditory stimulus in trace conditioning and in a "reversed" gap procedure. Memory for timing was tested by presenting the stimulus as a reversed gap into its timed absence. Results suggest that in trace conditioning (Experiment 1), rats time for the absence of a stimulus by using its offset as a time marker. As in the standard gap procedure, the insertion of a reversed gap was expected to "stop" rats' internal clock. In contrast, a reversed gap of 1-, 5-, or 15-s duration "reset" the timing process in both trace conditioning (Experiment 2) and the reversed gap procedure (Experiment 3). A direct comparison of the standard and reversed gap procedures (Experiment 4) supported these findings. Results suggest that attentional mechanisms involving the salience or content of the gap might contribute to the response rule adopted in a gap procedure.     

Adaptive warning signals adjusted to driver passenger conversation: Impact of system awareness on behavioral adaptations

The study investigated behavioral adaptation caused by warning signals that adaptively support drivers engaged in a passenger conversation. Novel advanced driver assistance systems (ADAS) could monitor the driver state to provide warnings adjusted to the driver’s current need for support. While first research indicates positive effects of dynamically adjusting ADAS, the overall safety potential of such adaptive systems remains unclear as little is known about adverse behavioral effects. Occasional inappropriate support due to an incorrect prediction of the current driver state might lead to critical situations when drivers are aware of the adaptive nature of the system and thus rely on the expected system behavior. To better understand behavioral adaptation to dynamically adjusting warnings, 46 participants driving on a test track reacted to two types of warnings (auditory, vibrotactile-auditory) while engaging in driver-passenger conversation or not. In a compensating warning strategy, vibrotactile-auditory warnings were displayed during conversations and auditory warnings in situations without conversation. This strategy was compared to a non-compensating warning strategy in which these assignments were reversed. The impact of behavioral adaptation was measured by considering reactions to simulated failures of these strategies. The role of system awareness for behavioral adaptation was investigated by manipulating awareness of these warning strategies across groups. We found that vibrotactile-auditory warnings reduced the detrimental effects of conversation on reaction times. Crucially, adverse behavioral adaptation was observed whenever an expected vibrotactile-auditory warning was replaced by an auditory warning but this effect was restricted to drivers in the awareness group. The results show that adaptive warning signals optimize the effectiveness of warnings during driver-passenger conversation but adverse behavioral adaptation develops when drivers are aware of the underlying warning strategy. This implies that future adaptive systems are less likely to be associated with behavioral adaptation if the adaptive nature of the system remains unnoticeable to the driver. Our findings could be used for developing and optimizing user-centered ADAS.     

Auditory, tactile, and multisensory cues facilitate search for dynamic visual stimuli

Presenting an auditory or tactile cue in temporal synchrony with a change in the color of a visual target can facilitate participants’ visual search performance. In the present study, we compared the magnitude of unimodal auditory, vibrotactile, and bimodal (i.e., multisensory) cuing benefits when the nonvisual cues were presented in temporal synchrony with the changing of the target’s color (Experiments 1 and 2). The target (a horizontal or vertical line segment) was presented among a number of distractors (tilted line segments) that also changed color at various times. In Experiments 3 and 4, the cues were also made spatially informative with regard to the location of the visual target. The unimodal and bimodal cues gave rise to an equivalent (significant) facilitation of participants’ visual search performance relative to a no-cue baseline condition. Making the unimodal auditory and vibrotactile cues spatially informative produced further performance improvements (on validly cued trials), as compared with cues that were spatially uninformative or otherwise spatially invalid. A final experiment was conducted in order to determine whether cue location (close to versus far from the visual display) would influence participants’ visual search performance. Auditory cues presented close to the visual search display were found to produce significantly better performance than cues presented over headphones. Taken together, these results have implications for the design of nonvisual and multisensory warning signals used in complex visual displays.     

Does increasing the warning signal intensity decrease or increase simple reaction time?

The purpose of the study was to reconcile the contradictory evidence reporting either a shortening or lengthening of the simple reaction time (RT) as a function of the intensity of a warning signal. The lengthening of auditory RT is obtained when short visual or auditory warning signals are of constant intensity within a session and succeeded by a fore-period. Visual RT did not vary under similar circumstances. There was no effect when a warning signal of constant intensity overlapped in time with the response stimulus. The shortening of RT occurred with auditory warning signals of variable intensity and overlapping in time with the response stimulus. The shortening of RT was interpreted as facilitation-by-arousal. The lengthening of RT is a contextual effect but the data do not support accounts based on sensory-neural adaptation or criterion changes.     

The modality shift effect and the effectiveness of warning signals in different modalities

Which is better, a visual or an auditory warning signal? Initial findings suggested that an auditory signal was more effective, speeding reaction to a target more than a visual warning signal, particularly at brief foreperiods [Bertelson, P., & Tisseyre, F. (1969). The time-course of preparation: confirmatory results with visual and auditory warning signals. Acta Psychologica, 30. In W.G. Koster (Ed.), Attention and Performance II (pp. 145-154); Davis, R., & Green, F. A. (1969). Intersensory differences in the effect of warning signals on reaction time. Acta Psychologica, 30. In W.G. Koster (Ed.), Attention and Performance II (pp. 155-167)]. This led to the hypothesis that an auditory signal is more alerting than a visual warning signal [Sanders, A. F. (1975). The foreperiod effect revisited. Quarterly Journal of Experimental Psychology, 27, 591-598; Posner, M. I., Nissen, M. J., & Klein, R. M. (1976). Visual dominance: an information-processing account of its origins and significance. Psychological Review, 83, 157-171]. Recently [Turatto, M., Benso, F., Galfano, G., & Umilta, C. (2002). Nonspatial attentional shifts between audition and vision. Journal of Experimental Psychology: Human Perception and Performance, 28, 628-639] found no evidence for an auditory warning signal advantage and showed that at brief foreperiods a signal in the same modality as the target facilitated responding more than a signal in a different modality. They accounted for this result in terms of the modality shift effect, with the signal exogenously recruiting attention to its modality, and thereby facilitating responding to targets arriving in the modality to which attention had been recruited. The present study conducted six experiments to understand the cause of these conflicting findings. The results suggest that an auditory warning signal is not more effective than a visual warning signal. Previous reports of an auditory superiority appear to have been caused by using different locations for the visual warning signal and visual target, resulting in the target arriving at an unattended location when the foreperiod was brief. Turatto et al.'s results were replicated with a modality shift effect at brief foreperiods. However, it is also suggested that previous measures of the modality shift effect may still have been confounded by a location cuing effect.     

Attention and expectation in human predictive learning: the role of uncertainty

Three localized, visual pattern stimuli were trained as predictive signals of auditory outcomes. One signal partially predicted an aversive noise in Experiment 1 and a neutral tone in Experiment 2, whereas the other signals consistently predicted either the occurrence or absence of the noise. The expectation of the noise was measured during each signal presentation, and only participants for whom this expectation demonstrated contingency knowledge showed differential attention to the signals. Importantly, when attention was measured by visual fixations, the contingency-aware group attended more to the partially predictive signal than to the consistent predictors in both experiments. This profile of visual attention supports the Pearce and Hall (1980) theory of the role of attention in associative learning.     

Signal evaluation environment: a new method for the design of peripheral in-vehicle warning signals

An evaluation method called the Signal Evaluation Environment (SEE) was developed for use in the early stages of the design process of peripheral warning signals while driving. Accident analyses have shown that with complex driving situations such as intersections, the visual scan strategies of the driver contribute to overlooking other road users who have the right of way. Salient peripheral warning signals could disrupt these strategies and direct drivers’ attention towards these road users. To select effective warning signals, the SEE was developed as a laboratory task requiring visual–cognitive processes similar to those used at intersections. For validation of the SEE, four experiments were conducted using different stimulus characteristics (size, colour contrast, shape, flashing) that influence peripheral vision. The results confirm that the SEE is able to differentiate between the selected stimulus characteristics. The SEE is a useful initial tool for designing peripheral signals, allowing quick and efficient preselection of beneficial signals.     

Sexual activity while driving: A content analysis of media reports

Sexual activity while driving fits the definition of distracted driving because it involves the diversion of attention away from the driving task. However, this risky driving behaviour has received little attention compared to other distracted driving activities. To address the lack of research on sexual activity while driving, the internet was searched from April to June 2020 for media reports in which sexual activities occurred within the cabin of a moving vehicle, taking specific note of: gender, the presence of others, time of day, use of substances, the nature of the circumstances surrounding the incident, and whether crashes had occurred. A total of 106 unique and verified cases were identified from 2004 to 2020. The reports involved 76 male (71.7%) and 30 female drivers (28.3%), and there were 43 (40.5%) serious incidents that involved a crash and 23 fatalities (21.7%). In 17 (16.0%) incidents their vehicle hit another car, and a pedestrian or cyclist was hit in 3 (2.8%) incidents. The risk of a serious incident was higher during oral sex or intercourse than solitary activities (i.e. masturbation). A total of 63 (59.5%) mild incidents (without crashes or fatalities) were identified, in which reports included accounts by witnesses or police regarding sexual activity while driving. Given the potential seriousness of incidents, this topic deserves further research to better understand the prevalence and safety implications of sexual activity while driving.     

Cell phone-induced failures of visual attention during simulated driving

This research examined the effects of hands-free cell phone conversations on simulated driving. The authors found that these conversations impaired driver's reactions to vehicles braking in front of them. The authors assessed whether this impairment could be attributed to a withdrawal of attention from the visual scene, yielding a form of inattention blindness. Cell phone conversations impaired explicit recognition memory for roadside billboards. Eye-tracking data indicated that this was due to reduced attention to foveal information. This interpretation was bolstered by data showing that cell phone conversations impaired implicit perceptual memory for items presented at fixation. The data suggest that the impairment of driving performance produced by cell phone conversations is mediated, at least in part, by reduced attention to visual inputs.     

Spatial attention and audiovisual interactions in apparent motion

In this study, the authors combined the cross-modal dynamic capture task (involving the horizontal apparent movement of visual and auditory stimuli) with spatial cuing in the vertical dimension to investigate the role of spatial attention in cross-modal interactions during motion perception. Spatial attention was manipulated endogenously, either by means of a blocked design or by predictive peripheral cues, and exogenously by means of nonpredictive peripheral cues. The results of 3 experiments demonstrate a reduction in the magnitude of the cross-modal dynamic capture effect on cued trials compared with uncued trials. The introduction of neutral cues (Experiments 4 and 5) confirmed the existence of both attentional costs and benefits. This attention-related reduction in cross-modal dynamic capture was larger when a peripheral cue was used compared with when attention was oriented in a purely endogenous manner. In sum, the results suggest that spatial attention reduces illusory binding by facilitating the segregation of unimodal signals, thereby modulating audiovisual interactions in information processing. Thus, the effect of spatial attention occurs prior to or at the same time as cross-modal interactions involving motion information.     

Improving visual spatial working memory in younger and older adults: effects of cross-modal cues

Spatially informative auditory and vibrotactile (cross-modal) cues can facilitate attention but little is known about how similar cues influence visual spatial working memory (WM) across the adult lifespan. We investigated the effects of cues (spatially informative or alerting pre-cues vs. no cues), cue modality (auditory vs. vibrotactile vs. visual), memory array size (four vs. six items), and maintenance delay (900 vs. 1800 ms) on visual spatial location WM recognition accuracy in younger adults (YA) and older adults (OA). We observed a significant interaction between spatially informative pre-cue type, array size, and delay. OA and YA benefitted equally from spatially informative pre-cues, suggesting that attentional orienting prior to WM encoding, regardless of cue modality, is preserved with age. Contrary to predictions, alerting pre-cues generally impaired performance in both age groups, suggesting that maintaining a vigilant state of arousal by facilitating the alerting attention system does not help visual spatial location WM.     

Speech shadowing while driving: on the difficulty of splitting attention between eye and ear

Abstract - We investigated the role of cross-modal links in spatial attention in modulating the efficiency of dual-task performance. The difficulty of combining speech shadowing with a simulated driving task was modulated by the spatial location from which the speech was presented. In both single- and dual-task conditions, participants found it significantly easier to shadow one of two auditory streams when the relevant speech was presented from directly in front of them, rather than from the side. This frontal speech advantage was more pronounced when participants performed the demanding simulated driving task at the same time as shadowing than when they performed the shadowing task alone. These results demonstrate that people process auditory information more efficiently (with a lower overall dual-task decrement) when relevant auditory and visual stimuli are presented from the same, rather than different, spatial locations. These results are related to recent findings showing that there are extensive cross-modal links in spatial attention, and have clear implications for the design of better user interfaces.     

Effect of auditory in-vehicle warning information on drivers’ brake response time to red-light running vehicles during collision avoidance

There is usually a high red-light running (RLR) collision rate at signalized intersections because of the unpredictability of dangerous RLR vehicles traversing intersections illegally. The RLR collision warning systems can help drivers be aware of the red-light running (RLR) vehicles and take collision avoidance actions timely. The objective of this paper is to evaluate the effects of auditory warning information on brake response time (RT) to red-light running vehicles during the collision avoidance process based on a driving simulator experiment. Warning status (e.g., warning vs. no warning), warning lead time (3 s vs. 5 s) and warning content (directional information vs. undirectional information) were considered to examine the effectiveness of the RLR collision warning system under different conditions. The experiment results showed that the auditory warning information can effectively reduce brake RT and collision occurrence rate and RT is the most influential variable on the collision occurrence. Although early warning is more effective than late warning in reducing brake RT and collision rate, the late warning can still lower the collision rate by 37%. However, the directional warning information did not have apparent advantages over the undirectional warning information. The findings of this study are helpful for the designers of RLR collision warning systems to enhance the effectiveness of the systems’ application on traffic safety.     

Absence of perceptual processing during reconfiguration of task set

The authors manipulated stimulus contrast and response-stimulus interval in the alternating runs paradigm to investigate whether early processing could be carried out during a task switch. Subjects alternated between judging the magnitude and the parity of a digit. The results suggested that early processing was not carried out during the task switch (Experiment 1), even in the absence of potentially confounding auditory or visual warning signals (Experiment 2). This processing was, however, carried out in parallel with a demanding operation in a 2nd task (Experiment 3), using the display parameters of Experiments 1 and 2 in the psychological refractory period paradigm. It is concluded that, functionally, task switching may impose a hard bottleneck even for very early stimulus processing. ((c) 2003 APA, all rights reserved)     

Field operational test of a seatbelt reminder system: Effects on driver behaviour and acceptance

The long-term effects on driver behaviour and acceptance of a seatbelt reminder system were examined in an on-road study. The system was capable of detecting seatbelt use in all seating positions and produced a two-stage visual and auditory warning if occupants were unrestrained. The effects of this system were evaluated alone and in combination with two other intelligent transport systems: intelligent speed adaptation and a following distance warning system. Twenty-three fleet car drivers drove an instrumented vehicle (SafeCar) for at least 16,500 km as part of their everyday driving. The results revealed that driver and passenger interaction with the seatbelt reminder system led to large and significant decreases in the percentage of trips where occupants were unbelted, in the percentage of total driving time spent unbelted, and in the time taken to fasten a seatbelt in response to system warnings. The seatbelt reminder system was rated by drivers as being useful, effective and socially acceptable, and led to a decrease in drivers’ subjective workload. These results were found even though the baseline pre-exposure seatbelt wearing compliance rates among participants were high.