Vibrotactile letter recognition: The effects of a ma king stimulus

A series of experiments examined the effect of masking stimuli on the ability of observers to recognize letters of the alphabet through their fingertips. The letters were generated on the 6 × 24 vibrotactile array of the Optacon, a reading aid for the blind. Letter recognition was interfered with by the presence of masking stimuli occurring at the same site on the skin either before (forward masking) or after (backward masking) the target letter had been presented. In general, backward masking interfered with letter recognition more than did forward masking. Backward masking was particularly effective for letters in which the information critical for identification is located on the right side of the letter. Presenting the letters reversed resulted in more forward masking for those letters with critical information now located on the left side. Increasing the time between the target letter and the masking stimuli resulted in improved letter recognition. The implications of the results for tactile reading are discussed.     

Temporal integration of vibrotactile patterns

Three experiments were conducted to measure the temporal integration of vibrotactile patterns presented to the fingertip. In Experiment 1, letters were divided in half and the time between the onsets of the first half of the letter and second half of the letter, stimulus onset asynchrony (SOA), was varied. The recognizability of the letters declined as the SOA was increased from 9 to 100 msec. In Experiment 2, the time between two patterns constituting a masking stimulus was varied and the stimulus effectiveness in interfering with letter recognition was determined. The amount of masking increased as the SOA increased from 9 to 50 msec. In Experiment 3, the SOA between a letter and its complement (the portions of the tactile array not activated by the letter) was varied. Increasing SOA from 9 to approximately 50 msec led to increasingly accurate letter recognition. The results of the three experiments suggest that the skin is capable of complete temporal integration over a time period of less than 10 msec, and that the temporal integration function becomes asymptotic in 50 to 100 msec. The results also suggest that the onset of a vibrotactile pattern is critical for generating contours. The implications of the results for modes of generating tactile patterns and for temporal masking functions are discussed.     

Effect of auditory masking on lingual vibrotactile thresholds and magnitude estimation scaling responses

Auditory masking has become a frequently employed part of the procedure used in vibrotactile research. Research investigating the effect of auditory masking on lingual vibrotactile thresholds of sensitivity has shown that there is little difference between lingual vibrotactile thresholds under masking and no masking conditions. The purpose of the present study was to extend the investigation of the effect of auditory masking to include lingual vibrotactile suprathreshold scaling responses. 20 young adult subjects of mean age 19 yr. completed lingual vibrotactile-threshold and magnitude-estimation scaling tasks under conditions of bilateral auditory masking and no masking. Similar lingual vibrotactile-threshold values and magnitude-estimation power-function exponents for the conditions of masking and no masking were noted.     

Modes of vibrotactile pattern generation

Two modes of generating vibrotactile patterns, static and scanned, were examined. In the static mode, all elements making up the pattern were turned on and off simultaneously. In the scanned mode, the pattern to be identified was moved across the tactile array. The patterns were letters of the alphabet presented to the fingertips by means of the Optacon, a reading aid for the blind. The results of the first experiment showed that the performance on a letter recognition task decreased as pattern duration decreased and that at all durations below 200-msec performance in the static mode was better than in the scanned mode. Good letter recognition was possible at durations of 4 msec in the static mode. The results of the second experiment showed that letter recognition in the static mode was highly dependent on the perceived intensity of the letters presented, whereas intensity changes in the scanned mode had little effect on letter recognition. The results of the third experiment showed that both modes of pattern presentation produced similar results in the presence of masking stimuli. The implications of the results for cutaneous pattern perception and information transmission and visual letter recognition are discussed.     

Vibrotactile masking: A comparison of energy and pattern maskers

Subjects were required to identify vibrotactile patterns presented to their fingertips. The patterns, letters of the alphabet, were presented singly or in the presence of other vibrotactile masking stimuli. Two types of masking stimuli were used: an energy masker and a pattern masker. The effectiveness of these two types of maskers in interfering with letter recognition was tested, using them as forward and as backward maskers and presenting them at several different levels of intensity. The results showed more masking by the pattern masker, more backward than forward masking, and more masking as intensity increased. In addition, compared with the energy masker, the pattern masker showed both a greater difference between forward and backward masking and a greater increase in masking as masker intensity increased. The results are discussed in terms of a two-factor model of vibrotactfle masking.     

Spatial constraints on visual-tactile cross-modal distractor congruency effects

Across three experiments, participants made speeded elevation discrimination responses to vibrotactile targets presented to the thumb (held in a lower position) or the index finger (upper position) of either hand, while simultaneously trying to ignore visual distractors presented independently from either the same or a different elevation. Performance on the vibrotactile elevation discrimination task was slower and less accurate when the visual distractor was incongruent with the elevation of the vibrotactile target (e.g., a lower light during the presentation of an upper vibrotactile target to the index finger) than when they were congruent, showing that people cannot completely ignore vision when selectively attending to vibrotactile information. We investigated the attentional, temporal, and spatial modulation of these cross-modal congruency effects by manipulating the direction of endogenous tactile spatial attention, the stimulus onset asynchrony between target and distractor, and the spatial separation between the vibrotactile target, any visual distractors, and the participant’s two hands within and across hemifields. Our results provide new insights into the spatiotemporal modulation of crossmodal congruency effects and highlight the utility of this paradigm for investigating the contributions of visual, tactile, and proprioceptive inputs to the multisensory representation of peripersonal space.     

Tactile selective attention and body posture: assessing the multisensory contributions of vision and proprioception

This study addressed the role of proprioceptive and visual cues to body posture during the deployment of tactile spatial attention. Participants made speeded elevation judgments (up vs. down) to vibrotactile targets presented to the finger or thumb of either hand, while attempting to ignore vibrotactile distractors presented to the opposite hand. The first two experiments established the validity of this paradigm and showed that congruency effects were stronger when the target hand was uncertain (Experiment 1) than when it was certain (Experiment 2). Varying the orientation of the hands revealed that these congruency effects were determined by the position of the target and distractor in external space, and not by the particular skin sites stimulated (Experiment 3). Congruency effects increased as the hands were brought closer together in the dark (Experiment 4), demonstrating the role of proprioceptive input in modulating tactile selective attention. This spatial modulation was also demonstrated when a mirror was used to alter the visually perceived separation between the hands (Experiment 5). These results suggest that tactile, spatially selective attention can operate according to an abstract spatial frame of reference, which is significantly modulated by multisensory contributions from both proprioception and vision.     

Counterexample to the hypothesis of functional similarity between tactile and visual pattern perception

In earlier work, the author has demonstrated that tactile pattern perception and visual pattern perception exhibit many parallels when the effective spatial resolution of vision is reduced to that of touch, thus supporting the hypothesis that the two pattern senses are functionally similar when matched in spatial bandwidth. The present experiments demonstrate a clear counter-example to this hypothesis of functional similarity. Specifically, it was found that the lateral masking effect of a surround on tactile character recognition increases when the surround changes in composition from solid lines to dots, whereas for vision, recognition performance goes in the opposite direction. This finding necessitates some modification of the model of character recognition proposed by the author (Loornis, 1990) as it applies to the sensing of raised tactile patterns. One possible modification would be to incorporate, as the initial stage of pattern transformation, the continuum mechanics model for the skin that was developed by Phillips and Johnson (1981b).     

Vibrotactile frequency recognition: forward and backward masking effects

Forward and backward vibrotactile recognition masking was investigated in 4 subjects with 240-Hz and 160-Hz targets of 20 ms duration and four 200-Hz masks, using interstimulus intervals (ISIs) ranging from -500 to 500 ms. Two of the masks (short) were 20 ms and two (long) were 200 ms in duration. One of each set of masks was matched in subjective intensity to the targets, but the others were more intense. The range of ISIs over which masking was obtained was comparable to that found by Massaro (1970) with auditory stimuli. Both short masks produced more masking than either long mask except at short ISIs. Larger mask intensities increased masking only at very short ISIs, and longer mask durations increased backward but not forward masking.     

Effects of auditory masking on lingual vibrotactile magnitude-estimation scaling responses of young children

Studies of lingual vibrotactile magnitude-estimation scaling have focused primarily on the responses of normal young adults. Little is known about the scaling responses of young children to suprathreshold vibratory stimulation because of the complexities of the experimental procedure. Binaural auditory masking is one aspect of the procedure that has recently been studied in adults. The purpose of this study was to investigate the effects of binaural auditory masking on lingual vibrotactile magnitude-estimation responses of young children. Four children whose mean age was 4.6 yr. completed magnitude-estimation scaling tasks for eight lingual vibrotactile suprathreshold intensity levels (6, 10, 16, 20, 26, 30, 36, 40 dB SL) under masking and no masking conditions. Results suggest possible effects of auditory masking on the lingual vibrotactile magnitude-estimation scaling responses of these young children that have not been found for such responses of adults.     

Audiotactile temporal order judgments

We report a series of three experiments in which participants made unspeeded 'Which modality came first?' temporal order judgments (TOJs) to pairs of auditory and tactile stimuli presented at varying stimulus onset asynchronies (SOAs) using the method of constant stimuli. The stimuli were presented from either the same or different locations in order to explore the potential effect of redundant spatial information on audiotactile temporal perception. In Experiment 1, the auditory and tactile stimuli had to be separated by nearly 80 ms for inexperienced participants to be able to judge their temporal order accurately (i.e., for the just noticeable difference (JND) to be achieved), no matter whether the stimuli were presented from the same or different spatial positions. More experienced psychophysical observers (Experiment 2) also failed to show any effect of relative spatial position on audiotactile TOJ performance, despite having much lower JNDs (40 ms) overall. A similar pattern of results was found in Experiment 3 when silent electrocutaneous stimulation was used rather than vibrotactile stimulation. Thus, relative spatial position seems to be a less important factor in determining performance for audiotactile TOJ than for other modality pairings (e.g., audiovisual and visuotactile).     

Tactile—visual temporal ventriloquism: No effect of spatial disparity

Participants made visual temporal order judgments (TOJs) about which of two lights appeared first while taskirrelevant vibrotactile stimuli delivered to the index finger were presented before the first and after the second light. Temporally misaligned tactile stimuli captured the onsets of the lights, thereby improving sensitivity on the visual TOJ task, indicative of tactile-visual (TV) temporal ventriloquism (Experiment 1). The size of this effect was comparable to auditory-visual (AV) temporal ventriloquism (Experiment 2). Spatial discordance between the TV stimuli, as in the AV case, did not harm the effect (Experiments 3 and 4). TV stimuli thus behaved like AV stimuli, demonstrating that spatial co-occurrence is not a necessary constraint for intersensory pairing to occur.     

Tactile--visual temporal ventriloquism: no effect of spatial disparity

Participants made visual temporal order judgments (TOJs) about which of two lights appeared first while task-irrelevant vibrotactile stimuli delivered to the index finger were presented before the first and after the second light. Temporally misaligned tactile stimuli captured the onsets of the lights, thereby improving sensitivity on the visual TOJ task, indicative of tactile-visual (TV) temporal ventriloquism (Experiment 1). The size of this effect was comparable to auditory-visual (AV) temporal ventriloquism (Experiment 2). Spatial discordance between the TV stimuli, as in the AV case, did not harm the effect (Experiments 3 and 4). TV stimuli thus behaved like AV stimuli, demonstrating that spatial co-occurrence is not a necessary constraint for intersensory pairing to occur.     

Effect of orientation on visual and vibrotactile letter identification

The effect of stimulus orientation of letters presented either visually or vibrotactually was examined to obtain basic information on sensory substitution using the tactile sense. The reaction time (RT) to identify the letters F and R presented in normal or mirror-image form at four orientations each was measured. In addition, conditions of 0 degree and 270 degrees of head rotation from vertical and arm rotation from the midline axis were employed. Data from 5 trained subjects showed that vibrotactile RTs were always longer than visual RTs. Stimulus rotation away from normal orientation increased visual RTs significantly but not vibrotactile RTs. Visual orientation effect then seemed to be determined by the body-coordinate system but not the vibrotactile orientation. Although further studies are warranted, from the results of this experiment, any convenient and constant stimulus orientation could be used with a wearable vibrotactile display system to exploit passive touch.     

Spatial localization of touch in the first year of life: early influence of a visual spatial code and the development of remapping across changes in limb position

Two experiments investigated infants' ability to localize tactile sensations in peripersonal space. Infants aged 10 months (Experiment 1) and 6.5 months (Experiment 2) were presented with vibrotactile stimuli unpredictably to either hand while they adopted either a crossed- or uncrossed-hands posture. At 6.5 months, infants' responses were predominantly manual, whereas at 10 months, visual orienting behavior was more evident. Analyses of the direction of the responses indicated that (a) both age groups were able to locate tactile stimuli, (b) the ability to remap visual and manual responses to tactile stimuli across postural changes develops between 6.5 and 10 months of age, and (c) the 6.5-month-olds were biased to respond manually in the direction appropriate to the more familiar uncrossed-hands posture across both postures. The authors argue that there is an early visual influence on tactile spatial perception and suggest that the ability to remap visual and manual directional responses across changes in posture develops between 6.5 and 10 months, most likely because of the experience of crossing the midline gained during this period.     

Forward masking of faces by spatially quantized random and structured masks: On the roles of wholistic configuration, local features, and spatial-frequency spectra in perceptual identification

The forward masking of faces by spatially quantized masking images was studied. Masks were used in order to exert different types of degrading effects on the early representations in facial information processing. Three types of source images for masks were used: Same-face images (with regard to targets), different-face images, and random Gaussian noise that was spectrally similar to facial images. They were all spatially quantized over the same range of quantization values. Same-face masks had virtually no masking effect at any of the quantization values. Different-face masks had strong masking effects only with fine-scale quantization, but led to the same efficiency of recognition as in the same-face mask condition with the coarsest quantization. Moreover, compared with the noise-mask condition, coarsely quantized different-face masks led to a relatively facilitated level of recognition efficiency. The masking effect of the noise mask did not vary significantly with the coarseness of quantization. The results supported neither a local feature processing account, nor a generalized spatial-frequency processing account, but were consistent with the microgenetic configuration-processing theory of face recognition. Also, the suitability of a spatial quantization technique for image configuration processing research has been demonstrated.     

Do "mudsplashes" induce tactile change blindness?

The phenomenon of change blindness (the surprising inability of people to correctly perceive changes between consecutively presented displays), primarily reported in vision, has recently been shown to occur for positional changes presented in tactile displays as well. Here, we studied people's ability to detect changes in the number of tactile stimuli in successively presented displays composed of one to three stimuli distributed over the body surface. In Experiment 1, a tactile mask consisting of the simultaneous activation of all seven possible tactile stimulators was sometimes presented between the two to-be-discriminated tactile displays. In Experiment 2, a "mudsplash" paradigm was used, with a brief irrelevant tactile distractor presented at the moment of change of the tactile display. Change blindness was demonstrated in both experiments, thus showing that the failure to detect tactile change is not necessarily related to (1) the physical disruption between consecutive events, (2) the effect of masking covering the location of the change, or (3) the erasure or resetting of the information contained within an internal representation of the tactile display. These results are interpreted in terms of a limitation in the number of spatial locations/events that can be consciously accessed at any one time. This limitation appears to constrain change-detection performance, no matter the sensory modality in which the stimuli are presented.     

Do “mudsplashes” induce tactile change blindness?

The phenomenon of change blindness (the surprising inability of people to correctly perceive changes between consecutively presented displays), primarily reported in vision, has recently been shown to occur for positional changes presented in tactile displays as well. Here, we studied people’s ability to detect changes in the number of tactile stimuli in successively presented displays composed of one to three stimuli distributed over the body surface. In Experiment 1, a tactile mask consisting of the simultaneous activation of all seven possible tactile stimulators was sometimes presented between the two to-be-discriminated tactile displays. In Experiment 2, a “mudsplash” paradigm was used, with a brief irrelevant tactile distractor presented at the moment of change of the tactile display. Change blindness was demonstrated in both experiments, thus showing that the failure to detect tactile change is not necessarily related to (1) the physical disruption between consecutive events, (2) the effect of masking covering the location of the change, or (3) the erasure or resetting of the information contained within an internal representation of the tactile display. These results are interpreted in terms of a limitation in the number of spatial locations/events that can be consciously accessed at any one time. This limitation appears to constrain change-detection performance, no matter the sensory modality in which the stimuli are presented.     

Effect of simultaneous auditory stimulation on vibrotactile thresholds

Vibrotactile thresholds were determined at 250 and 400 Hz in the presence of (1) the sounds emitted by the vibrator, (2) continuous tonal or narrow-band masking noise, or (3) a pulsed tone synchronized with the vibrator signal. The measure of a cross-modality effect was the threshold shift occurring between each condition and the control condition, in which earmuff silencers eliminated the vibrator sounds. Continuous tones or noise had no effect upon vibrotactile thresholds. However, auditory signals synchronized with the vibrator signals did significantly elevate vibrotactile thresholds.     

Selective attention in vibrotactile tasks: detecting the presence and absence of amplitude change

Selective spatial attention has a greater effect on detection of the absence of an amplitude change than it has on detection of the presence of such a change. Attention to one of four fingertips was manipulated by an 80% valid tactile cue in two-interval forced-choice tasks. In one task, the target was a vibrotactile amplitude change appearing among constant-amplitude distractors; in the other task, targets of constant amplitude had to be detected amid amplitude changes at the other fingertips. Cuing had a greater effect on the latter task than it did on the former. This asymmetry is consistent with the presence-absence asymmetry found in visual search and does not depend on the difficulty of the two tasks. A statistical model shows that a pooled activity mechanism could account for these experimental results.