Potential perceptual bases for successful use of a vibrotactile speech perception aid

This paper examines the possibility that perception of vibrotactile speech stimuli is enhanced in adults with early and life-long use of hearing aids. We present evidence that vibrotactile aid benefit in adults is directly related to the age at which the hearing aid was fitted and the duration of its use. The stimulus mechanism responsible for this effect is hypothesized to be long-term vibrotactile stimulation by high powered hearing aids. We speculate on possible mechanisms for enhanced vibrotactile speech perception as the result of hearing aid use: (1) long-term experience receiving degraded or impoverished speech stimuli results in a speech processing system that is more effective for novel stimuli, independent of perceptual modality; and/or (2) long-term sensory/perceptual experience causes neural changes that result in more effective delivery of speech information via somatosensory pathways.     

Improving visual spatial working memory in younger and older adults: effects of cross-modal cues

Spatially informative auditory and vibrotactile (cross-modal) cues can facilitate attention but little is known about how similar cues influence visual spatial working memory (WM) across the adult lifespan. We investigated the effects of cues (spatially informative or alerting pre-cues vs. no cues), cue modality (auditory vs. vibrotactile vs. visual), memory array size (four vs. six items), and maintenance delay (900 vs. 1800 ms) on visual spatial location WM recognition accuracy in younger adults (YA) and older adults (OA). We observed a significant interaction between spatially informative pre-cue type, array size, and delay. OA and YA benefitted equally from spatially informative pre-cues, suggesting that attentional orienting prior to WM encoding, regardless of cue modality, is preserved with age. Contrary to predictions, alerting pre-cues generally impaired performance in both age groups, suggesting that maintaining a vigilant state of arousal by facilitating the alerting attention system does not help visual spatial location WM.     

A wearable vibrotactile biofeedback system improves balance control of healthy young adults following perturbations from quiet stance

Maintaining postural equilibrium requires fast reactions and constant adjustments of the center of mass (CoM) position to prevent falls, especially when there is a sudden perturbation of the support surface. During this study, a newly developed wearable feedback system provided immediate vibrotactile clues to users based on plantar force measurement, in an attempt to reduce reaction time and CoM displacement in response to a perturbation of the floor. Ten healthy young adults participated in this study. They stood on a support surface, which suddenly moved in one of four horizontal directions (forward, backward, left and right), with the biofeedback system turned on or off. The testing sequence of the four perturbation directions and the two system conditions (turned on or off) was randomized. The resulting reaction time and CoM displacement were analysed. Results showed that the vibrotactile feedback system significantly improved balance control during translational perturbations. The positive results of this preliminary study highlight the potential of a plantar force measurement based biofeedback system in improving balance under perturbations of the support surface. Future system optimizations could facilitate its application in fall prevention in real life conditions, such as standing in buses or trains that suddenly decelerate or accelerate.     

Using spatial vibrotactile cues to direct visual attention in driving scenes

We report two experiments designed to investigate the potential use of vibrotactile warning signals to present spatial information to car drivers. Participants performed an attention-demanding rapid serial visual presentation (RSVP) monitoring task. Meanwhile, whenever they felt a vibrotactile stimulus presented on either their front or back, they had to check the front and the rearview mirror for the rapid approach of a car, and brake or accelerate accordingly. We investigated whether speeded responses to potential emergency driving situations could be facilitated by the presentation of spatially-predictive (80% valid; Experiment 1) or spatially-nonpredictive (50% valid; Experiment 2) vibrotactile cues. Participants responded significantly more rapidly following both spatially-predictive and spatially-nonpredictive vibrotactile cues from the same rather than the opposite direction as the critical driving events. These results highlight the potential utility of vibrotactile warning signals in automobile interface design for directing a driver’s visual attention to time-critical events or information.     

Vibrotactile timing: Are vibrotactile judgements of duration affected by repetitive stimulation?

Timing in the vibrotactile modality was explored. Previous research has shown that repetitive auditory stimulation (in the form of click-trains) and visual stimulation (in the form of flickers) can alter duration judgements in a manner consistent with a “speeding up” of an internal clock. In Experiments 1 and 2 we investigated whether repetitive vibrotactile stimulation in the form of vibration trains would also alter duration judgements of either vibrotactile stimuli or visual stimuli. Participants gave verbal estimates of the duration of vibrotactile and visual stimuli that were preceded either by five seconds of 5-Hz vibration trains, or, by a five-second period of no vibrotactile stimulation, the end of which was signalled by a single vibration pulse (control condition). The results showed that durations were overestimated in the vibrotactile train conditions relative to the control condition; however, the effects were not multiplicative (did not increase with increasing stimulus duration) and as such were not consistent with a speeding up of the internal clock, but rather with an additive attentional effect. An additional finding was that the slope of the vibrotactile psychometric (control condition) function was not significantly different from that of the visual (control condition) function, which replicates a finding from a previous cross-modal comparison of timing.     

Responses to visual,tactile and visual–tactile forward collision warnings while gaze on and off the road

The objective of the current driving simulator study (N = 20) was to assess brake reaction time (BRT) and subjective experiences of visual (V), tactile (T), and visual–tactile (VT) collision warnings when the drivers’ visual orientation was manipulated between four locations (i.e., road and three different mirror locations). V warning was a blinking light in a windscreen, T warning was implemented by a vibrating accelerator pedal, and VT warning was their synchronous combination. The results showed that all the warning stimuli were detected in 100% accuracy in all visual orientations, but T and VT warnings produced significantly faster BRTs when compared to V warning. It was found that BRT to V warning was the slowest while observing the furthermost side mirror. However, BRTs following T and VT warnings remained unaffected by the visual orientations. Both the objective BRT measurements and subjective evaluations indicated a superiority of T and VT warnings against a sole V warning, not only in general terms, but also separately for different visual orientations.     

Good vibrations: Human interval timing in the vibrotactile modality

This article reports a detailed examination of timing in the vibrotactile modality and comparison with that of visual and auditory modalities. Three experiments investigated human timing in the vibrotactile modality. In Experiment 1, a staircase threshold procedure with a standard duration of 1,000 ms revealed a difference threshold of 160.35 ms for vibrotactile stimuli, which was significantly higher than that for auditory stimuli (103.25 ms) but not significantly lower than that obtained for visual stimuli (196.76 ms). In Experiment 2, verbal estimation revealed a significant slope difference between vibrotactile and auditory timing, but not between vibrotactile and visual timing. That is, both vibrations and lights were judged as shorter than sounds, and this comparative difference was greater at longer durations than at shorter ones. In Experiment 3, performance on a temporal generalization task showed characteristics consistent with the predications of scalar expectancy theory (SET: Gibbon, 1977) with both mean accuracy and scalar variance exhibited. The results were modelled using the modified Church and Gibbon model (MCG; derived by Wearden, 1992, from Church & Gibbon 1982). The model was found to give an excellent fit to the data, and the parameter values obtained were compared with those for visual and auditory temporal generalization. The pattern of results suggest that timing in the vibrotactile modality conforms to SET and that the internal clock speed for vibrotactile stimuli is significantly slower than that for auditory stimuli, which is logically consistent with the significant differences in difference threshold that were obtained.     

Haptic modality takes its time: Dynamic of activations of sensory modalities in perceptual and memory processes

Based on claims resulting from grounded cognition theory that perceptual and memory processes are using the same distributed systems, the present study investigated the temporal aspect of access to memory traces through haptic and auditory modalities. Unlike in the case of visual or auditory components, the perception of a vibrotactile component is more sequential in nature and therefore cannot be fully processed before the end of the signal. The present study explores the dynamic of components activation in a situation of audio‐vibrotactile asynchrony. We used a short‐term priming paradigm consisting of an association phase (between a vibration and sound) and a test phase testing priming effect of a vibrotactile stimulation on the processing of a target sound. Results showed an interference with a simultaneous processing and a facilitation with a sequential processing. The temporality process of perceptual components is also important at a memory level.     

Efficacy of haptic blind spot warnings applied through a steering wheel or a seatbelt

This study evaluates the efficacy of haptic feedback for the Blind Spot Warnings (BSWs) that are delivered to a driver through a steering wheel or a seatbelt. To this end, we developed a virtual driving simulator that implemented potential side collision scenarios. Haptic BSWs were issued as a vibrotactile alert during lane changes if a car in the target lane approached from the participant’s blind spot at a faster speed. The two haptic warning types were assessed through a human factors experiment with participants of two age groups: younger (30–40 years) and older (50–60 years). No warning condition was also included as the control condition. As performance measures, the Collision Prevention Rate (CPR) and the Minimum Distance by which a collision was Avoided (MDA) were collected. As preference measures, the participants’ perception of usefulness of the haptic warnings and their overall satisfaction were used. Experimental results showed that the highest CPR, the longest MDA, and the highest preference were achieved when BSWs were delivered through the steering wheel. For the seatbelt BSW, the CPR and MDA did not increase with statistical significance than those of the no-warning condition, but the participants felt that the haptic seatbelt was useful with high satisfaction. Interestingly, the scores of perceived usefulness and satisfaction were higher with the older group, suggesting that older drivers can be more willing to accept these new types of warning. In addition, the experiment suggested several factors that need to be studied to further improve the performance and preference of haptic BSW, such as warning issue timing and vibration intensity.