Is attention shared between the ears?

This study tests the locus of attention during selective listening for speech-like stimuli. Can processing be differentially allocated to the two ears? Two conditions were used. The simultaneous condition involved one of four randomly chosen stop-consonants being presented to one of the ears chosen at random. The sequential condition involved two intervals; in the first S listened to the right ear; in the second S listened to the left ear. One of the four consonants was presented to an attended ear during one of these intervals. Experiment I used no distracting stimuli. Experiment II utilized a distracting consonant not confusable with any of the four target consonants. This distractor was always presented to any ear not containing a target. In both experiments, simultaneous and sequential performance were essentially identical, despite the need for attention sharing between the two ears during the simultaneous condition. We conclude that selective attention does not occur during perceptual processing of speech sounds presented to the two ears. We suggest that attentive effects arise in short-term memory following processing.     

The failure to detect tactile change: A tactile analogue of visual change blindness

A large body of empirical research now shows that people are surprisingly poor at detecting significant changes in visually presented scenes. This phenomenon is known aschange blindness in vision. A similar phenomenon occurs in audition, but to date no such effect has been documented in touch. In the present study, we explored the ability of people to detect changes introduced between two consecutively presented vibrotactile patterns presented over the body surface. The patterns consisted of two or three vibrotactile stimuli presented for 200 msec. The position of one of the vibrotactile stimuli composing the display was repeatedly changed (alternating between two different positions) on 50% of the trials, but the same pattern was presented repeatedly on the remaining trials. Three conditions were investigated: No interval between the patterns, an empty interval between the patterns, and a masked interval between the patterns. Change detection was near perfect in the no-interval block. Performance deteriorated somewhat in the empty-interval block, but by far the worst change detection performance occurred in the masked-interval block. These results demonstrate that “change blindness” can also affect tactile perception.     

Critical-band effects in two-channel auditory signal detection

Two-channel auditory signal detection was investigated with 50-msec sinusoidal signals masked by binaurally uncorrelated noise. In the two-channel tasks, the signals in each earphone channel were presented with an independent probability during the single observation interval and the observers were required to detect the inputs in a single earphone (selective-attention condition) or in both earphones (divided-attention condition). When the signals in each earphone were within the same critical band (the assumed singled processing unit in frequency domain), there was a decrement in detection performance in both the selective- and divided-attention (i.e. dichotic) conditions compared with the monaural condition. However, when signals were separated in frequency by several critical bands, a decrement in dichotic performance, as compared with monaural performance, occurred only in the divided-attention condition. These findings are discussed in terms of their implications regarding models of multichannel signal processing and the definition of input channels in terms of earphones.     

Vibrotactile--auditory interactions are post-perceptual

Vibrotactile stimuli can elicit compelling auditory sensations, even when sound energy levels are minimal and undetectable. It has previously been shown that subjects judge auditory tones embedded in white noise to be louder when they are accompanied by a vibrotactile stimulus of the same frequency. A first experiment replicated this result at four different levels of auditory stimulation (no tone, tone at detection threshold, tone at 5 dB above threshold, and tone at 10 dB above threshold). The presence of a vibrotactile stimulus induced an increase in the perceived loudness of auditory tones at three of the four values in this range. In two further experiments, a 2-interval forced-choice procedure was used to assess the nature of this cross-modal interaction. Subjects were biased when vibrotaction was applied in one interval, but applying vibrotaction in both intervals produced performance comparable to conditions without vibrotactile stimuli. This demonstrates that vibrotaction is sometimes ignored when judging the presence of an auditory tone. Hence the interaction between vibrotaction and audition does not appear to occur at an early perceptual level.     

Discrimination of time intervals presented in sequences: spatial effects with multiple auditory sources

This article discusses two experiments on the discrimination of time intervals presented in sequences marked by brief auditory signals. Participants had to indicate whether the last interval in a series of three intervals marked by four auditory signals was shorter or longer than the previous intervals. Three base durations were under investigation: 75, 150, and 225 ms. In Experiment 1, sounds were presented through headphones, from a single-speaker in front of the participants or by four equally spaced speakers. In all three presentation modes, the highest different threshold was obtained in the lower base duration condition (75 ms), thus indicating an impairment of temporal processing when sounds are presented too rapidly. The results also indicate the presence, in each presentation mode, of a 'time-shrinking effect' (i.e., with the last interval being perceived as briefer than the preceding ones) at 75 ms, but not at 225 ms. Lastly, using different sound sources to mark time did not significantly impair discrimination. In Experiment 2, three signals were presented from the same source, and the last signal was presented at one of two locations, either close or far. The perceived duration was not influenced by the location of the fourth signal when the participant knew before each trial where the sounds would be delivered. However, when the participant was uncertain as to its location, more space between markers resulted in longer perceived duration, a finding that applies only at 150 and 225 ms. Moreover, the perceived duration was affected by the direction of the sequences (left-right vs. right-left).     

A simulated “cocktail party” with up to three sound sources

Listeners identified spoken words, letters, and numbers and the spatial location of these utterances in three listening conditions as a function of the number of simultaneously presented utterances. The three listening conditions were a normal listening condition, in which the sounds were presented over seven possible loudspeakers to a listener seated in a sound-deadened listening room; a one-headphone listening condition, in which a single microphone that was placed in the listening room delivered the sounds to a single headphone worn by the listener in a remote room; and a stationary KEMAR listening condition, in which binaural recordings from an acoustic manikin placed in the listening room were delivered to a listener in the remote room. The listeners were presented one, two, or three simultaneous utterances. The results show that utterance identification was better in the normal listening condition than in the one-headphone condition, with the KEMAR listening condition yielding intermediate levels of performance. However, the differences between listening in the normal and in the one-headphone conditions were much smaller when two, rather than three, utterances were presented at a time. Localization performance was good for both the normal and the KEMAR listening conditions and at chance for the one-headphone condition. The results suggest that binaural processing is probably more important for solving the “cocktail party” problem when there are more than two concurrent sound sources.     

Multisensory numerosity judgments for visual and tactile stimuli

To date, numerosity judgments have been studied only under conditions of unimodal stimulus presentation. It is therefore unclear whether the same limitations on correctly reporting the number of unimodal visual or tactile stimuli presented in a display might be expected under conditions in which participants have to count stimuli presented simultaneously in two or more different sensory modalities. In Experiment 1, we investigated numerosity judgments using both unimodal and bimodal displays consisting of one to six vibrotactile stimuli (presented over the body surface) and one to six visual stimuli (seen on the body via mirror reflection). Participants had to count the number of stimuli regardless of their modality of presentation. Bimodal numerosity judgments were significantly less accurate than predicted on the basis of an independent modality-specific resources account, thus showing that numerosity judgments might rely on a unitary amodal system instead. The results of a second experiment demonstrated that divided attention costs could not account for the poor performance in the bimodal conditions of Experiment 1. We discuss these results in relation to current theories of cross-modal integration and to the cognitive resources and/or common higher order spatial representations possibly accessed by both visual and tactile stimuli.     

The perception of tactile distance: influences of body site, space, and time

Vibrotactile prostheses for deaf or blind persons have been applied to any number of different locations on the body, including the finger, wrist, forearm, abdomen, back, and nape of the neck. The discriminability of patterns presented by such devices can be affected by the acuity of the site of application and the resolution of the display. In addition, the mutual influences among stimuli close together in both space and time can affect percepts within a broad range of parameters. For example, consideration must be given to a variety of tactile illusions often associated with the spatial separations and the range of temporal intervals typically used in cutaneous communication displays. Experiments are reported in which magnitude estimates and cross-modality matches of perceived extent produced by pairs of vibrotactile taps presented to separate loci were obtained on three different body sites. Perceived distance was directly related both to the timing between the taps and to their physical separation. The findings show a consistent relationship to cortical magnification across body sites.     

Spatial constraints on visual-tactile cross-modal distractor congruency effects

Across three experiments, participants made speeded elevation discrimination responses to vibrotactile targets presented to the thumb (held in a lower position) or the index finger (upper position) of either hand, while simultaneously trying to ignore visual distractors presented independently from either the same or a different elevation. Performance on the vibrotactile elevation discrimination task was slower and less accurate when the visual distractor was incongruent with the elevation of the vibrotactile target (e.g., a lower light during the presentation of an upper vibrotactile target to the index finger) than when they were congruent, showing that people cannot completely ignore vision when selectively attending to vibrotactile information. We investigated the attentional, temporal, and spatial modulation of these cross-modal congruency effects by manipulating the direction of endogenous tactile spatial attention, the stimulus onset asynchrony between target and distractor, and the spatial separation between the vibrotactile target, any visual distractors, and the participant’s two hands within and across hemifields. Our results provide new insights into the spatiotemporal modulation of crossmodal congruency effects and highlight the utility of this paradigm for investigating the contributions of visual, tactile, and proprioceptive inputs to the multisensory representation of peripersonal space.     

The schedule dependency of the signaled reinforcement effect

In Experiment 1, rats leverpressed for food reinforcement on either a variable ratio (VR) 30 schedule or a variable interval (VI) 15-s schedule. One group in each condition received a signal filling a 500-ms delay of reinforcement. This treatment enhanced rates on the VR schedule, and attenuated rates on the VI schedule, relative to the rate seen in an unsignaled control condition. In Experiment 2 there was no delay of reinforcement and the signal and food were presented simultaneously. Attenuated rates of responding were observed on VI schedules with a range of mean interval values (15 to 300 s). Experiment 3 used a range of VR schedules (10 to 150) with simultaneous presentations of signal and food. A signal-induced enhancement of response rate was found at all VR values. In Experiment 4, a signal elevated response rates on a tandem VI VR schedule, but depressed rates on a tandem VR VI schedule, compared to control conditions receiving unsignaled delayed reinforcement. These results are taken to show that the effect of a signal accompanying reinforcement depends upon the nature of the behavior that is reinforced during exposure to a given schedule.     

A lateral masking effect in tactile and blurred visual letter recognition

In a letter recognition task in which the letters were presented temporally across two columns of a vibrotactile array, the masking effects of added columns of steady vibrotactile stimulation were investigated. The primary variable studied was the spatial separation between the masking columns and the letter-carrying columns. The results indicate a spatially dependent masking effect which is independent of the tactile masking associated with mask onset. A comparable masking effect was obtained with visual letter recognition using the same relative stimulus configurations viewed under conditions of optical blurring. An interpretation of the tactile masking is offered in terms of the limited spatial resolution of the cutaneous sense.     

Tactile short-term memory for stimuli presented on the fingertips and across the rest of the body surface

The aim of this study was to investigate the extent to which tactile information that is unavailable for full conscious report can be accessed using partial-report procedures. In Experiment 1, participants reported the total number of tactile stimuli (up to six) presented simultaneously to their fingertips (numerosity judgment task). In another condition, after being presented with the tactile display, they had to detect whether or not the position indicated by a (visual or tactile) probe had previously contained a tactile stimulus (partial-report task). Participants correctly reported up to three stimuli in the numerosity judgment task, but their performance was far better in the partial-report task: Up to six stimuli were perceived at the shortest target-probe intervals. A similar pattern of results was observed when the participants performed a concurrent articulatory suppression task (Exp. 2). The results of a final experiment revealed that performance in the partial-report task was overall better for stimuli presented on the fingertips than for stimuli presented across the rest of the body surface. These results demonstrate that tactile information that is unavailable for report in a numerosity task can nevertheless sometimes still be accessed when a partial-report procedure is used instead.     

Effect of orientation on visual and vibrotactile letter identification

The effect of stimulus orientation of letters presented either visually or vibrotactually was examined to obtain basic information on sensory substitution using the tactile sense. The reaction time (RT) to identify the letters F and R presented in normal or mirror-image form at four orientations each was measured. In addition, conditions of 0 degree and 270 degrees of head rotation from vertical and arm rotation from the midline axis were employed. Data from 5 trained subjects showed that vibrotactile RTs were always longer than visual RTs. Stimulus rotation away from normal orientation increased visual RTs significantly but not vibrotactile RTs. Visual orientation effect then seemed to be determined by the body-coordinate system but not the vibrotactile orientation. Although further studies are warranted, from the results of this experiment, any convenient and constant stimulus orientation could be used with a wearable vibrotactile display system to exploit passive touch.     

The initial effect of noise on a simple vibrotactile learning task

In two experiments the effect of loud noise on a simple vibrotactile learning task was studied. After learning the task to criterion, 10 male and 10 female Ss received two pairs of test trials, one without noise, and one in continuous noise (a 1,000 cps pure tone at 90 dB SPL). An additional 10 male and 10 female Ss learned the same task and also received the same two pairs of test trials, but instead of receiving continuous noise for the second condition, they received an intermittent noise (random numbers presented at 2 sec intervals at 95 dB SPL). In the first experiment noise had a significant effect on the performance of the 20-subject group and also on the females in the group. Noise did not significantly affect the performance of males. In the second experiment noise had no significant effect on either males or females.     

Numerosity judgments for tactile stimuli distributed over the body surface

A large body of research now supports the claim that two different and dissociable processes are involved in making numerosity judgments regarding visual stimuli: subitising (fast and nearly errorless) for up to 4 stimuli, and counting (slow and error-prone) when more than 4 stimuli are presented. We studied tactile numerosity judgments for combinations of 1-7 vibrotactile stimuli presented simultaneously over the body surface. In experiment 1, the stimuli were presented once, while in experiment 2 conditions of single presentation and repeated presentation of the stimulus were compared. Neither experiment provided any evidence for a discontinuity in the slope of either the RT or error data suggesting that subitisation does not occur for tactile stimuli. By systematically varying the intensity of the vibrotactile stimuli in experiment 3, we were able to demonstrate that participants were not simply using the 'global intensity' of the whole tactile display to make their tactile numerosity judgments, but were, instead, using information concerning the number of tactors activated. The results of the three experiments reported here are discussed in relation to current theories of counting and subitising, and potential implications for the design of tactile user interfaces are highlighted.     

An n-back task using vibrotactile stimulation with comparison to an auditory analogue

We report a vibrotactile version of the common n-back task used to study working memory. Subjects wore vibrotactile stimulators on three fingers of one hand, and they responded by pressing a button with the other hand whenever the current finger matched the one stimulated n items back. Experiment 1 showed a steep decline in performance as n increased from 1 to 3; each additional level ofn decreased performance by 1.5 d' units on average. Experiment 2 supported a central capacity locus for the vibrotactile task by showing that it correlated strongly with an auditory analogue; both tasks were also related to standard digit span. The vibrotactile version of n-back may be particularly useful in dual-task contexts. It allows the assessment of cognitive capacity in sensory-impaired populations in which touch remains intact, and it may find use in brain-imaging studies in which vibrotactile stimuli impose a memory load.     

不同时距条件下面孔表情知觉的时间整合效应

通过把面孔表情分割成三部分,按照不同的时间间隔以及不同的呈现时间相继呈现,考察了被试对面孔表情的时间整合效果,以此探讨时间整合的加工过程和影响因素。结果发现：（1）面孔表情的时间整合效果受时间结构和刺激材料的影响。（2）分离呈现的面孔表情能否进行时间整合与SOA的大小有关。（3）面孔表情的时间整合存在类型差异。（4）面孔表情的时间整合是在一个有限的视觉缓冲器内进行的,图像记忆和长时记忆与面孔表情的时间整合过程关系密切。     

Auditory, tactile, and multisensory cues facilitate search for dynamic visual stimuli

Presenting an auditory or tactile cue in temporal synchrony with a change in the color of a visual target can facilitate participants’ visual search performance. In the present study, we compared the magnitude of unimodal auditory, vibrotactile, and bimodal (i.e., multisensory) cuing benefits when the nonvisual cues were presented in temporal synchrony with the changing of the target’s color (Experiments 1 and 2). The target (a horizontal or vertical line segment) was presented among a number of distractors (tilted line segments) that also changed color at various times. In Experiments 3 and 4, the cues were also made spatially informative with regard to the location of the visual target. The unimodal and bimodal cues gave rise to an equivalent (significant) facilitation of participants’ visual search performance relative to a no-cue baseline condition. Making the unimodal auditory and vibrotactile cues spatially informative produced further performance improvements (on validly cued trials), as compared with cues that were spatially uninformative or otherwise spatially invalid. A final experiment was conducted in order to determine whether cue location (close to versus far from the visual display) would influence participants’ visual search performance. Auditory cues presented close to the visual search display were found to produce significantly better performance than cues presented over headphones. Taken together, these results have implications for the design of nonvisual and multisensory warning signals used in complex visual displays.     

Crossmodal change blindness between vision and touch

Change blindness is the name given to people's inability to detect changes introduced between two consecutively-presented scenes when they are separated by a distractor that masks the transients that are typically associated with change. Change blindness has been reported within vision, audition, and touch, but has never before been investigated when successive patterns are presented to different sensory modalities. In the study reported here, we investigated change detection performance when the two to-be-compared stimulus patterns were presented in the same sensory modality (i.e., both visual or both tactile) and when one stimulus pattern was tactile while the other was presented visually or vice versa. The two to-be-compared patterns were presented consecutively, separated by an empty interval, or else separated by a masked interval. In the latter case, the masked interval could either be tactile or visual. The first experiment investigated visual-tactile and tactile-visual change detection performance. The results showed that in the absence of masking, participants detected changes in position accurately, despite the fact that the two to-be-compared displays were presented in different sensory modalities. Furthermore, when a mask was presented between the two to-be-compared displays, crossmodal change blindness was elicited no matter whether the mask was visual or tactile. The results of two further experiments showed that performance was better overall in the unimodal (visual or tactile) conditions than in the crossmodal conditions. These results suggest that certain of the processes underlying change blindness are multisensory in nature. We discuss these findings in relation to recent claims regarding the crossmodal nature of spatial attention.     

Haptic modality takes its time: Dynamic of activations of sensory modalities in perceptual and memory processes

Based on claims resulting from grounded cognition theory that perceptual and memory processes are using the same distributed systems, the present study investigated the temporal aspect of access to memory traces through haptic and auditory modalities. Unlike in the case of visual or auditory components, the perception of a vibrotactile component is more sequential in nature and therefore cannot be fully processed before the end of the signal. The present study explores the dynamic of components activation in a situation of audio‐vibrotactile asynchrony. We used a short‐term priming paradigm consisting of an association phase (between a vibration and sound) and a test phase testing priming effect of a vibrotactile stimulation on the processing of a target sound. Results showed an interference with a simultaneous processing and a facilitation with a sequential processing. The temporality process of perceptual components is also important at a memory level.